2023-10-14T18:31:56.946 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T18:31:56.947 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --name yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/orig.config.yaml 2023-10-14T18:31:56.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:31:57.083 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783 branch: quincy-release description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: yweinste@redhat.com first_in_suite: false job_id: '7425783' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: quincy-release ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: quincy-release sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2462 sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: quincy-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYk2JnFV1hD/9osJXVTkGSTgA66jIeVDyNBUnusYENk2bNNhg4LLUUYXCAVNS+Lfzt8uNZzM9KaiolF18sa+oo= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrB5DKII1ZhJrgg4sZTw+5WRJyFLlocJrMLwnjOuqNWYLrwG2GQVOyPtDHybcTqAGavr0+uv76+71zljJPXVs8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_20:07:38 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T18:31:57.083 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa; will attempt to use it 2023-10-14T18:31:57.084 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa/tasks 2023-10-14T18:31:57.085 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T18:31:57.087 INFO:teuthology.task.internal:Checking packages... 2023-10-14T18:31:57.111 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586' 2023-10-14T18:31:57.112 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T18:31:57.112 INFO:teuthology.packaging:ref: None 2023-10-14T18:31:57.113 INFO:teuthology.packaging:tag: None 2023-10-14T18:31:57.113 INFO:teuthology.packaging:branch: quincy-release 2023-10-14T18:31:57.113 INFO:teuthology.packaging:sha1: 9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:31:57.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy-release 2023-10-14T18:31:57.344 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1415.g9d6d32bb 2023-10-14T18:31:57.344 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T18:31:57.351 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T18:31:57.351 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T18:31:57.358 INFO:teuthology.task.internal:Saving configuration 2023-10-14T18:31:57.375 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T18:31:57.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:31:57.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:26:47.461219', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYk2JnFV1hD/9osJXVTkGSTgA66jIeVDyNBUnusYENk2bNNhg4LLUUYXCAVNS+Lfzt8uNZzM9KaiolF18sa+oo='} 2023-10-14T18:31:57.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:26:47.462745', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrB5DKII1ZhJrgg4sZTw+5WRJyFLlocJrMLwnjOuqNWYLrwG2GQVOyPtDHybcTqAGavr0+uv76+71zljJPXVs8='} 2023-10-14T18:31:57.431 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T18:31:57.438 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T18:31:57.438 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T18:31:57.439 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T18:31:57.510 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4beb91caf0>, signals=[15]) 2023-10-14T18:31:57.511 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T18:31:57.517 INFO:teuthology.task.internal:Opening connections... 2023-10-14T18:31:57.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:31:57.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:31:57.586 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:31:57.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:31:57.655 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T18:31:57.663 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-14T18:31:57.678 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-14T18:31:57.679 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-14T18:31:57.730 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T18:31:57.731 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T18:31:57.731 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-10-14T18:31:57.731 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-10-14T18:31:57.732 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.4" 2023-10-14T18:31:57.732 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-10-14T18:31:57.732 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T18:31:57.732 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-14T18:31:57.732 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T18:31:57.733 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T18:31:57.733 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T18:31:57.733 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T18:31:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:31:57.733 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T18:31:57.734 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T18:31:57.734 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T18:31:57.734 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T18:31:57.735 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-14T18:31:57.754 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-14T18:31:57.773 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-14T18:31:57.773 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-14T18:31:57.829 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T18:31:57.830 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)" 2023-10-14T18:31:57.830 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-14T18:31:57.830 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-14T18:31:57.830 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4" 2023-10-14T18:31:57.831 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-14T18:31:57.831 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-14T18:31:57.831 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-14T18:31:57.831 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-14T18:31:57.832 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T18:31:57.832 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T18:31:57.832 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T18:31:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:31:57.832 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T18:31:57.833 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-14T18:31:57.833 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T18:31:57.833 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-14T18:31:57.833 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-14T18:31:57.855 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T18:31:57.864 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T18:31:57.870 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T18:31:57.870 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-10-14T18:31:57.873 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-10-14T18:31:57.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T18:31:57.894 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T18:31:57.894 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-10-14T18:31:57.925 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-10-14T18:31:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T18:31:57.944 INFO:teuthology.orchestra.run.smithi144.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-14T18:31:57.945 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T18:31:58.002 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T18:31:58.018 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-14T18:31:58.019 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-14T18:31:58.019 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-14T18:31:58.019 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T18:31:58.020 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T18:31:58.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:31:58.033 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-14T18:31:58.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:31:58.036 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-14T18:31:58.085 INFO:teuthology.orchestra.run.smithi079.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:31:58.086 INFO:teuthology.task.kernel:Running kernel on smithi079: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:31:58.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2023-10-14T18:31:58.092 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:31:58.093 INFO:teuthology.task.kernel:Running kernel on smithi144: 4.18.0-305.25.1.el8_4.x86_64 2023-10-14T18:31:58.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2023-10-14T18:31:59.512 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-14T18:31:59.513 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-14T18:31:59.546 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-14T18:31:59.548 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-14T18:32:00.946 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-14T18:32:00.961 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-10-14T18:32:01.571 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-14T18:32:02.572 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-10-14T18:32:04.886 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-14T18:32:05.709 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T18:32:05.709 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T18:32:05.710 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T18:32:05.861 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-14T18:32:05.862 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2023-10-14T18:32:05.863 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-14T18:32:05.980 DEBUG:teuthology.orchestra.run.smithi144:> echo no | sudo yum reinstall kernel || true 2023-10-14T18:32:06.020 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-14T18:32:06.325 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-14T18:32:06.326 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-14T18:32:06.621 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 06:32:04 PM UTC. 2023-10-14T18:32:06.739 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-14T18:32:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-14T18:32:06.740 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-14T18:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:06.768 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:06.795 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-14T18:32:06.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum reinstall -y kernel || true 2023-10-14T18:32:06.886 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-14T18:32:06.887 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2023-10-14T18:32:06.887 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-14T18:32:07.014 DEBUG:teuthology.orchestra.run.smithi079:> echo no | sudo yum reinstall kernel || true 2023-10-14T18:32:07.189 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-14T18:32:07.189 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-14T18:32:07.361 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-14T18:32:07.362 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-14T18:32:07.482 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:03 ago on Sat 14 Oct 2023 06:32:04 PM UTC. 2023-10-14T18:32:07.619 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:32:07.619 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:07.620 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:07.630 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-14T18:32:07.658 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 06:32:06 PM UTC. 2023-10-14T18:32:07.685 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:32:07.801 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:32:07.801 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:07.802 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:07.810 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.811 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.811 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.811 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T18:32:07.811 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T18:32:07.812 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-14T18:32:07.812 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T18:32:07.812 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:32:07.837 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2023-10-14T18:32:07.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum reinstall -y kernel || true 2023-10-14T18:32:07.936 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.937 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2023-10-14T18:32:07.965 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2023-10-14T18:32:07.965 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2023-10-14T18:32:07.965 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.02 2023-10-14T18:32:07.965 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 99.el8_4.1 2023-10-14T18:32:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2023-10-14T18:32:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T18:32:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:Group : System Environment/Base 2023-10-14T18:32:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 9264631 2023-10-14T18:32:07.966 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2023-10-14T18:32:07.967 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T18:32:07.967 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T18:32:07.967 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T18:32:07.967 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T18:32:07.967 INFO:teuthology.orchestra.run.smithi144.stdout:Relocations : (not relocatable) 2023-10-14T18:32:07.968 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : Red Hat, Inc. 2023-10-14T18:32:07.968 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : Red Hat, Inc. 2023-10-14T18:32:07.968 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T18:32:07.968 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2023-10-14T18:32:07.968 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2023-10-14T18:32:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:32:07.969 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T18:32:07.969 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T18:32:07.969 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T18:32:07.969 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2023-10-14T18:32:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:32:07.970 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T18:32:07.971 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T18:32:07.971 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:07.971 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T18:32:08.227 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-14T18:32:08.228 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-14T18:32:08.513 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 06:32:06 PM UTC. 2023-10-14T18:32:08.650 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-14T18:32:08.650 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:08.651 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-14T18:32:08.670 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2023-10-14T18:32:08.723 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:32:08.847 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:08.848 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:08.848 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:08.848 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-14T18:32:08.849 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-14T18:32:08.849 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-14T18:32:08.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2023-10-14T18:32:08.850 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T18:32:08.975 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:08.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:08.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2023-10-14T18:32:09.002 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2023-10-14T18:32:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2023-10-14T18:32:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.02 2023-10-14T18:32:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 99.el8_4.1 2023-10-14T18:32:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2023-10-14T18:32:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-14T18:32:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:Group : System Environment/Base 2023-10-14T18:32:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 9264631 2023-10-14T18:32:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2023-10-14T18:32:09.004 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-14T18:32:09.005 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-14T18:32:09.005 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-14T18:32:09.005 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-14T18:32:09.005 INFO:teuthology.orchestra.run.smithi079.stdout:Relocations : (not relocatable) 2023-10-14T18:32:09.006 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : Red Hat, Inc. 2023-10-14T18:32:09.006 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : Red Hat, Inc. 2023-10-14T18:32:09.006 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T18:32:09.006 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2023-10-14T18:32:09.007 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2023-10-14T18:32:09.007 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:32:09.007 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T18:32:09.007 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T18:32:09.008 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T18:32:09.008 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2023-10-14T18:32:09.008 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:32:09.008 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T18:32:09.009 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T18:32:09.010 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:09.010 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T18:32:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2023-10-14T18:32:10.414 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2023-10-14T18:32:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:done 2023-10-14T18:32:10.973 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-14T18:32:11.009 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.4YtwG4Oc25 2023-10-14T18:32:11.009 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4YtwG4Oc25 2023-10-14T18:32:11.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.4YtwG4Oc25 2023-10-14T18:32:11.250 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.4YtwG4Oc25 is 6KB 2023-10-14T18:32:11.299 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.4YtwG4Oc25 2023-10-14T18:32:11.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T18:32:11.390 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T18:32:11.390 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T18:32:11.390 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T18:32:11.390 INFO:teuthology.orchestra.run.smithi144.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T18:32:11.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:11.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2023-10-14T18:32:12.570 INFO:teuthology.orchestra.run.smithi079.stderr:done 2023-10-14T18:32:12.572 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-14T18:32:12.586 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.7gIzFWk6Fw 2023-10-14T18:32:12.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7gIzFWk6Fw 2023-10-14T18:32:12.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.7gIzFWk6Fw 2023-10-14T18:32:12.821 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.7gIzFWk6Fw is 6KB 2023-10-14T18:32:12.870 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.7gIzFWk6Fw 2023-10-14T18:32:12.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T18:32:12.953 INFO:teuthology.orchestra.run.smithi079.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-14T18:32:12.953 INFO:teuthology.orchestra.run.smithi079.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-14T18:32:12.953 INFO:teuthology.orchestra.run.smithi079.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-14T18:32:12.954 INFO:teuthology.orchestra.run.smithi079.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-14T18:32:12.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-14T18:32:13.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2023-10-14T18:32:41.586 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-14T18:32:41.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:32:41.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:32:43.141 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-14T18:32:43.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:32:43.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:33:00.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-14T18:33:01.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-14T18:33:09.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:33:09.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:33:10.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:33:10.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:33:13.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-14T18:33:25.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:33:25.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:33:44.058 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-14T18:33:59.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:33:59.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:33:59.506 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-14T18:33:59.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:33:59.858 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T18:33:59.858 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-14T18:33:59.910 INFO:teuthology.orchestra.run.smithi079.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T18:33:59.911 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:33:59.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T18:33:59.911 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T18:34:00.912 DEBUG:teuthology.parallel:result is None 2023-10-14T18:34:09.037 DEBUG:teuthology.orchestra.remote:timed out 2023-10-14T18:34:21.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:34:21.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:34:21.436 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-14T18:34:21.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:34:21.739 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-14T18:34:21.739 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-14T18:34:21.755 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-14T18:34:21.755 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-14T18:34:21.755 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T18:34:21.755 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-14T18:34:22.756 DEBUG:teuthology.parallel:result is None 2023-10-14T18:34:22.757 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T18:34:22.766 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T18:34:22.767 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T18:34:22.771 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T18:34:22.788 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T18:34:22.801 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T18:34:22.815 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T18:34:22.815 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T18:34:22.828 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T18:34:22.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T18:34:22.867 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T18:34:22.868 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T18:34:22.891 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T18:34:22.976 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:34:22.992 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:34:23.004 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:34:23.022 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T18:34:23.024 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T18:34:23.035 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T18:34:23.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T18:34:23.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T18:34:23.066 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T18:34:23.086 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T18:34:23.086 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T18:34:23.105 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T18:34:23.121 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:34:23.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:34:23.256 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:34:23.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:34:23.377 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:34:23.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T18:34:23.441 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:34:23.484 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T18:34:23.543 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:34:23.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T18:34:23.665 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:34:23.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T18:34:23.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-10-14T18:34:23.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-10-14T18:34:23.786 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:34:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:34:24.304 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T18:34:24.314 INFO:teuthology.task.internal:Starting timer... 2023-10-14T18:34:24.314 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T18:34:24.331 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T18:34:24.346 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T18:34:24.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2023-10-14T18:34:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: [ OK ] 2023-10-14T18:34:24.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-10-14T18:34:24.475 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: [ OK ] 2023-10-14T18:34:24.476 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T18:34:24.477 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2023-10-14T18:34:24.501 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2023-10-14T18:34:24.502 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-10-14T18:34:24.541 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-10-14T18:34:24.542 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-10-14T18:34:24.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:34:24.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:34:24.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:34:24.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:34:24.606 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T18:34:24.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2023-10-14T18:34:24.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-10-14T18:34:24.674 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T18:34:24.684 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-14T18:34:24.685 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T18:34:24.701 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T18:34:24.702 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T18:42:35.976 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-10-14T18:42:35.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:42:35.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:42:36.049 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-14T18:42:36.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-14T18:42:36.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:42:36.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T18:42:36.187 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-14T18:42:36.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-14T18:42:36.253 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T18:42:36.265 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T18:42:36.265 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T18:42:36.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:42:36.268 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T18:42:36.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:42:36.295 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T18:42:36.308 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T18:42:36.322 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T18:42:36.336 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T18:42:36.342 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2023-10-14T18:42:36.352 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2023-10-14T18:42:36.366 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T18:42:36.371 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-10-14T18:42:36.381 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T18:42:36.382 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-10-14T18:42:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T18:42:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T18:42:36.444 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-10-14T18:42:36.447 INFO:teuthology.orchestra.run.smithi079.stdout:210 Number of sources = 4 2023-10-14T18:42:36.447 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:42:36.447 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-14T18:42:36.447 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.448 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.448 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.448 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.467 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-14T18:42:36.469 INFO:teuthology.orchestra.run.smithi144.stdout:210 Number of sources = 4 2023-10-14T18:42:36.470 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:42:36.470 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-14T18:42:36.470 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.470 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.470 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.471 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:42:36.472 INFO:teuthology.run_tasks:Running task install... 2023-10-14T18:42:36.480 DEBUG:teuthology.task.install:project ceph 2023-10-14T18:42:36.480 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}} 2023-10-14T18:42:36.481 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'} 2023-10-14T18:42:36.481 INFO:teuthology.task.install:Using flavor: default 2023-10-14T18:42:36.487 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T18:42:36.487 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T18:42:36.488 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T18:42:36.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:42:36.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'tag': None, 'wait_for_package': False} 2023-10-14T18:42:36.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:42:36.655 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T18:42:36.656 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T18:42:36.664 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/ 2023-10-14T18:42:36.665 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1415.g9d6d32bb 2023-10-14T18:42:36.774 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T18:42:36.775 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:42:36.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T18:42:36.801 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-14T18:42:36.801 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T18:42:36.829 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy-release/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T18:42:36.830 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:42:36.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T18:42:36.856 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-14T18:42:36.856 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T18:42:36.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T18:42:36.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T18:42:36.941 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T18:42:36.996 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T18:42:37.004 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2023-10-14T18:42:37.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2023-10-14T18:42:37.059 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-10-14T18:42:37.060 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-10-14T18:42:37.397 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-14T18:42:37.451 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-14T18:42:37.712 INFO:teuthology.orchestra.run.smithi079.stdout:44 files removed 2023-10-14T18:42:37.753 INFO:teuthology.orchestra.run.smithi144.stdout:44 files removed 2023-10-14T18:42:37.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-14T18:42:37.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-14T18:42:38.114 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-14T18:42:38.154 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-14T18:42:38.803 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 280 kB/s | 78 kB 00:00 2023-10-14T18:42:38.973 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 193 kB/s | 78 kB 00:00 2023-10-14T18:42:39.165 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 28 kB/s | 9.1 kB 00:00 2023-10-14T18:42:39.260 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 37 kB/s | 9.1 kB 00:00 2023-10-14T18:42:39.511 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-14T18:42:39.547 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-10-14T18:42:39.670 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-14T18:42:39.671 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-14T18:42:40.340 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-14T18:42:41.862 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2023-10-14T18:42:43.662 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-14T18:42:44.021 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 118 MB/s | 33 MB 00:00 2023-10-14T18:42:45.287 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-14T18:42:45.646 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 119 MB/s | 33 MB 00:00 2023-10-14T18:42:49.177 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 113 MB/s | 38 MB 00:00 2023-10-14T18:42:50.776 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 126 MB/s | 38 MB 00:00 2023-10-14T18:42:57.420 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T18:42:57.421 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T18:42:57.432 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-14T18:42:57.432 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-14T18:42:57.433 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-14T18:42:57.434 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T18:42:57.436 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T18:42:57.438 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-14T18:42:57.439 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-14T18:42:57.931 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-14T18:42:57.942 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-14T18:42:57.943 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-10-14T18:42:57.943 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-14T18:42:57.943 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-10-14T18:42:57.943 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T18:42:57.943 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T18:42:57.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T18:42:57.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T18:42:57.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T18:42:57.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T18:42:57.944 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T18:42:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T18:42:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T18:42:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T18:42:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T18:42:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T18:42:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T18:42:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T18:42:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 255 k 2023-10-14T18:42:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 18 k 2023-10-14T18:42:57.947 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-14T18:42:57.947 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T18:42:57.947 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T18:42:57.947 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T18:42:57.947 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T18:42:57.948 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T18:42:57.948 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T18:42:57.948 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-14T18:42:57.948 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T18:42:57.948 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T18:42:57.949 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T18:42:57.949 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T18:42:57.949 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T18:42:57.949 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T18:42:57.949 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T18:42:57.950 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T18:42:57.950 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-14T18:42:57.950 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-10-14T18:42:57.950 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T18:42:57.950 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T18:42:57.951 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-10-14T18:42:57.951 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T18:42:57.951 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T18:42:57.951 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T18:42:57.952 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T18:42:57.952 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T18:42:57.952 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T18:42:57.952 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T18:42:57.952 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T18:42:57.953 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T18:42:57.953 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T18:42:57.953 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T18:42:57.953 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T18:42:57.953 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T18:42:57.954 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T18:42:57.954 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T18:42:57.954 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-14T18:42:57.954 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T18:42:57.954 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T18:42:57.955 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T18:42:57.955 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T18:42:57.955 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T18:42:57.955 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T18:42:57.955 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T18:42:57.956 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T18:42:57.956 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-14T18:42:57.956 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T18:42:57.956 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T18:42:57.956 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T18:42:57.957 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T18:42:57.957 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T18:42:57.957 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T18:42:57.957 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T18:42:57.957 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T18:42:57.958 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T18:42:57.958 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T18:42:57.958 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T18:42:57.959 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T18:42:57.959 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T18:42:57.960 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T18:42:57.960 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T18:42:57.960 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T18:42:57.961 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T18:42:57.961 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T18:42:57.961 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T18:42:57.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T18:42:57.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T18:42:57.962 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T18:42:57.963 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T18:42:57.963 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T18:42:57.964 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T18:42:57.964 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T18:42:57.964 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T18:42:57.965 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T18:42:57.965 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T18:42:57.965 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T18:42:57.966 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T18:42:57.966 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T18:42:57.966 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T18:42:57.967 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T18:42:57.967 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T18:42:57.967 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T18:42:57.967 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T18:42:57.968 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T18:42:57.968 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T18:42:57.968 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T18:42:57.968 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T18:42:57.968 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T18:42:57.969 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T18:42:57.969 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T18:42:57.969 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T18:42:57.969 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T18:42:57.969 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T18:42:57.970 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T18:42:57.970 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T18:42:57.970 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T18:42:57.970 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T18:42:57.970 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T18:42:57.971 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T18:42:57.971 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T18:42:57.971 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T18:42:57.971 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T18:42:57.971 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T18:42:57.972 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T18:42:57.972 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T18:42:57.972 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T18:42:57.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:42:57.972 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-14T18:42:57.973 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================================================== 2023-10-14T18:42:57.973 INFO:teuthology.orchestra.run.smithi144.stdout:Install 118 Packages 2023-10-14T18:42:57.973 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 2 Packages 2023-10-14T18:42:57.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:42:57.974 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 202 M 2023-10-14T18:42:57.974 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-10-14T18:42:58.085 INFO:teuthology.orchestra.run.smithi144.stdout:(1/120): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-14T18:42:58.241 INFO:teuthology.orchestra.run.smithi144.stdout:(2/120): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x8 5.5 MB/s | 876 kB 00:00 2023-10-14T18:42:58.272 INFO:teuthology.orchestra.run.smithi144.stdout:(3/120): ceph-immutable-object-cache-17.2.6-141 5.3 MB/s | 161 kB 00:00 2023-10-14T18:42:58.469 INFO:teuthology.orchestra.run.smithi144.stdout:(4/120): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86 12 MB/s | 2.3 MB 00:00 2023-10-14T18:42:58.628 INFO:teuthology.orchestra.run.smithi144.stdout:(5/120): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86 9.9 MB/s | 1.6 MB 00:00 2023-10-14T18:42:58.982 INFO:teuthology.orchestra.run.smithi144.stdout:(6/120): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86 11 MB/s | 3.9 MB 00:00 2023-10-14T18:42:59.139 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T18:42:59.140 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T18:42:59.150 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-14T18:42:59.151 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-14T18:42:59.152 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-14T18:42:59.153 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T18:42:59.155 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T18:42:59.157 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-14T18:42:59.158 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-14T18:42:59.644 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-14T18:42:59.655 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================================================== 2023-10-14T18:42:59.655 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2023-10-14T18:42:59.656 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================================================== 2023-10-14T18:42:59.656 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2023-10-14T18:42:59.656 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T18:42:59.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 6.4 k 2023-10-14T18:42:59.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.2 M 2023-10-14T18:42:59.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 876 k 2023-10-14T18:42:59.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 161 k 2023-10-14T18:42:59.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 1.6 M 2023-10-14T18:42:59.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 121 k 2023-10-14T18:42:59.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 1.7 M 2023-10-14T18:42:59.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 7.4 M 2023-10-14T18:42:59.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 47 k 2023-10-14T18:42:59.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T18:42:59.659 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 52 M 2023-10-14T18:42:59.659 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 267 k 2023-10-14T18:42:59.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 80 k 2023-10-14T18:42:59.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 255 k 2023-10-14T18:42:59.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 18 k 2023-10-14T18:42:59.660 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-14T18:42:59.660 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T18:42:59.660 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T18:42:59.660 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 25 k 2023-10-14T18:42:59.661 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 797 k 2023-10-14T18:42:59.661 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 130 k 2023-10-14T18:42:59.661 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T18:42:59.661 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-14T18:42:59.661 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T18:42:59.662 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 190 k 2023-10-14T18:42:59.662 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 370 k 2023-10-14T18:42:59.662 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 359 k 2023-10-14T18:42:59.662 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 107 k 2023-10-14T18:42:59.662 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 90 k 2023-10-14T18:42:59.663 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T18:42:59.663 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T18:42:59.663 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-14T18:42:59.663 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2023-10-14T18:42:59.663 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.5 M 2023-10-14T18:42:59.664 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.6 M 2023-10-14T18:42:59.664 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2023-10-14T18:42:59.664 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T18:42:59.664 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 23 M 2023-10-14T18:42:59.664 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 23 k 2023-10-14T18:42:59.665 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 2.3 M 2023-10-14T18:42:59.665 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 238 k 2023-10-14T18:42:59.665 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 3.9 M 2023-10-14T18:42:59.665 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 17 M 2023-10-14T18:42:59.665 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1415.g9d6d32bb.el8 ceph-noarch 14 k 2023-10-14T18:42:59.666 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 24 k 2023-10-14T18:42:59.666 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T18:42:59.666 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T18:42:59.666 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-14T18:42:59.666 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T18:42:59.667 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T18:42:59.667 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 174 k 2023-10-14T18:42:59.667 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-14T18:42:59.667 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-14T18:42:59.668 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T18:42:59.668 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-14T18:42:59.668 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T18:42:59.668 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 506 k 2023-10-14T18:42:59.669 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-14T18:42:59.669 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 5.6 M 2023-10-14T18:42:59.669 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T18:42:59.669 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-14T18:42:59.670 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T18:42:59.670 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T18:42:59.670 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T18:42:59.670 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T18:42:59.670 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-14T18:42:59.671 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T18:42:59.671 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T18:42:59.671 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T18:42:59.671 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T18:42:59.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T18:42:59.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T18:42:59.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T18:42:59.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T18:42:59.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T18:42:59.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 45 k 2023-10-14T18:42:59.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:17.2.6-1415.g9d6d32bb.el8 ceph 115 k 2023-10-14T18:42:59.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T18:42:59.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T18:42:59.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T18:42:59.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T18:42:59.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T18:42:59.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T18:42:59.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T18:42:59.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T18:42:59.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T18:42:59.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T18:42:59.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T18:42:59.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T18:42:59.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T18:42:59.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T18:42:59.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T18:42:59.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T18:42:59.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T18:42:59.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T18:42:59.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T18:42:59.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T18:42:59.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T18:42:59.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T18:42:59.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T18:42:59.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T18:42:59.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T18:42:59.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T18:42:59.679 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T18:42:59.679 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T18:42:59.679 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T18:42:59.680 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-14T18:42:59.680 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T18:42:59.680 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T18:42:59.680 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T18:42:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T18:42:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T18:42:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T18:42:59.681 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T18:42:59.682 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T18:42:59.682 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T18:42:59.682 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T18:42:59.682 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-14T18:42:59.683 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T18:42:59.683 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T18:42:59.683 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T18:42:59.683 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:42:59.683 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-10-14T18:42:59.684 INFO:teuthology.orchestra.run.smithi079.stdout:====================================================================================================================== 2023-10-14T18:42:59.684 INFO:teuthology.orchestra.run.smithi079.stdout:Install 118 Packages 2023-10-14T18:42:59.684 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 2 Packages 2023-10-14T18:42:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:42:59.685 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 202 M 2023-10-14T18:42:59.685 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2023-10-14T18:42:59.693 INFO:teuthology.orchestra.run.smithi144.stdout:(7/120): ceph-common-17.2.6-1415.g9d6d32bb.el8. 14 MB/s | 23 MB 00:01 2023-10-14T18:43:00.074 INFO:teuthology.orchestra.run.smithi079.stdout:(1/120): ceph-17.2.6-1415.g9d6d32bb.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-10-14T18:43:00.488 INFO:teuthology.orchestra.run.smithi144.stdout:(8/120): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x86 11 MB/s | 17 MB 00:01 2023-10-14T18:43:00.536 INFO:teuthology.orchestra.run.smithi144.stdout:(9/120): ceph-selinux-17.2.6-1415.g9d6d32bb.el8 505 kB/s | 24 kB 00:00 2023-10-14T18:43:01.006 INFO:teuthology.orchestra.run.smithi079.stdout:(2/120): ceph-fuse-17.2.6-1415.g9d6d32bb.el8.x8 941 kB/s | 876 kB 00:00 2023-10-14T18:43:01.027 INFO:teuthology.orchestra.run.smithi144.stdout:(10/120): ceph-radosgw-17.2.6-1415.g9d6d32bb.el 13 MB/s | 17 MB 00:01 2023-10-14T18:43:01.091 INFO:teuthology.orchestra.run.smithi144.stdout:(11/120): cephfs-mirror-17.2.6-1415.g9d6d32bb.e 3.9 MB/s | 255 kB 00:00 2023-10-14T18:43:01.139 INFO:teuthology.orchestra.run.smithi079.stdout:(3/120): ceph-immutable-object-cache-17.2.6-141 1.2 MB/s | 161 kB 00:00 2023-10-14T18:43:01.144 INFO:teuthology.orchestra.run.smithi144.stdout:(12/120): libcephfs-devel-17.2.6-1415.g9d6d32bb 465 kB/s | 25 kB 00:00 2023-10-14T18:43:01.289 INFO:teuthology.orchestra.run.smithi079.stdout:(4/120): ceph-base-17.2.6-1415.g9d6d32bb.el8.x8 3.3 MB/s | 5.2 MB 00:01 2023-10-14T18:43:01.557 INFO:teuthology.orchestra.run.smithi079.stdout:(5/120): ceph-mgr-17.2.6-1415.g9d6d32bb.el8.x86 5.9 MB/s | 1.6 MB 00:00 2023-10-14T18:43:01.591 INFO:teuthology.orchestra.run.smithi144.stdout:(13/120): libcephfs2-17.2.6-1415.g9d6d32bb.el8. 1.7 MB/s | 797 kB 00:00 2023-10-14T18:43:01.816 INFO:teuthology.orchestra.run.smithi144.stdout:(14/120): libcephsqlite-17.2.6-1415.g9d6d32bb.e 774 kB/s | 174 kB 00:00 2023-10-14T18:43:01.933 INFO:teuthology.orchestra.run.smithi144.stdout:(15/120): librados-devel-17.2.6-1415.g9d6d32bb. 1.1 MB/s | 130 kB 00:00 2023-10-14T18:43:02.216 INFO:teuthology.orchestra.run.smithi079.stdout:(6/120): ceph-mds-17.2.6-1415.g9d6d32bb.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-14T18:43:02.250 INFO:teuthology.orchestra.run.smithi079.stdout:(7/120): ceph-mon-17.2.6-1415.g9d6d32bb.el8.x86 5.7 MB/s | 3.9 MB 00:00 2023-10-14T18:43:02.288 INFO:teuthology.orchestra.run.smithi144.stdout:(16/120): libradosstriper1-17.2.6-1415.g9d6d32b 1.4 MB/s | 506 kB 00:00 2023-10-14T18:43:03.645 INFO:teuthology.orchestra.run.smithi144.stdout:(17/120): ceph-base-17.2.6-1415.g9d6d32bb.el8.x 936 kB/s | 5.2 MB 00:05 2023-10-14T18:43:03.730 INFO:teuthology.orchestra.run.smithi144.stdout:(18/120): python3-ceph-argparse-17.2.6-1415.g9d 526 kB/s | 45 kB 00:00 2023-10-14T18:43:03.925 INFO:teuthology.orchestra.run.smithi144.stdout:(19/120): python3-ceph-common-17.2.6-1415.g9d6d 593 kB/s | 115 kB 00:00 2023-10-14T18:43:03.992 INFO:teuthology.orchestra.run.smithi144.stdout:(20/120): librgw2-17.2.6-1415.g9d6d32bb.el8.x86 3.3 MB/s | 5.6 MB 00:01 2023-10-14T18:43:04.104 INFO:teuthology.orchestra.run.smithi144.stdout:(21/120): python3-cephfs-17.2.6-1415.g9d6d32bb. 1.0 MB/s | 190 kB 00:00 2023-10-14T18:43:04.134 INFO:teuthology.orchestra.run.smithi144.stdout:(22/120): python3-rados-17.2.6-1415.g9d6d32bb.e 2.6 MB/s | 370 kB 00:00 2023-10-14T18:43:04.199 INFO:teuthology.orchestra.run.smithi144.stdout:(23/120): python3-rgw-17.2.6-1415.g9d6d32bb.el8 1.6 MB/s | 107 kB 00:00 2023-10-14T18:43:04.572 INFO:teuthology.orchestra.run.smithi144.stdout:(24/120): ceph-test-17.2.6-1415.g9d6d32bb.el8.x 13 MB/s | 52 MB 00:04 2023-10-14T18:43:04.573 INFO:teuthology.orchestra.run.smithi144.stdout:(25/120): rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x8 241 kB/s | 90 kB 00:00 2023-10-14T18:43:04.575 INFO:teuthology.orchestra.run.smithi144.stdout:(26/120): python3-rbd-17.2.6-1415.g9d6d32bb.el8 761 kB/s | 359 kB 00:00 2023-10-14T18:43:04.625 INFO:teuthology.orchestra.run.smithi144.stdout:(27/120): rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86 3.3 MB/s | 174 kB 00:00 2023-10-14T18:43:04.641 INFO:teuthology.orchestra.run.smithi144.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1415.g 354 kB/s | 23 kB 00:00 2023-10-14T18:43:04.688 INFO:teuthology.orchestra.run.smithi144.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1415.g9d6d32b 1.9 MB/s | 121 kB 00:00 2023-10-14T18:43:04.869 INFO:teuthology.orchestra.run.smithi144.stdout:(30/120): rbd-mirror-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 3.5 MB 00:00 2023-10-14T18:43:04.917 INFO:teuthology.orchestra.run.smithi144.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1415.g9d 4.9 MB/s | 238 kB 00:00 2023-10-14T18:43:04.964 INFO:teuthology.orchestra.run.smithi144.stdout:(32/120): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.e 995 kB/s | 47 kB 00:00 2023-10-14T18:43:05.008 INFO:teuthology.orchestra.run.smithi144.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1415.g9 333 kB/s | 14 kB 00:00 2023-10-14T18:43:05.055 INFO:teuthology.orchestra.run.smithi144.stdout:(34/120): ceph-volume-17.2.6-1415.g9d6d32bb.el8 5.6 MB/s | 267 kB 00:00 2023-10-14T18:43:05.082 INFO:teuthology.orchestra.run.smithi144.stdout:(35/120): cephadm-17.2.6-1415.g9d6d32bb.el8.noa 2.9 MB/s | 80 kB 00:00 2023-10-14T18:43:05.112 INFO:teuthology.orchestra.run.smithi144.stdout:(36/120): cephfs-top-17.2.6-1415.g9d6d32bb.el8. 600 kB/s | 18 kB 00:00 2023-10-14T18:43:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:(8/120): ceph-radosgw-17.2.6-1415.g9d6d32bb.el8 5.8 MB/s | 17 MB 00:02 2023-10-14T18:43:05.188 INFO:teuthology.orchestra.run.smithi079.stdout:(9/120): ceph-selinux-17.2.6-1415.g9d6d32bb.el8 740 kB/s | 24 kB 00:00 2023-10-14T18:43:05.417 INFO:teuthology.orchestra.run.smithi144.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-10-14T18:43:05.448 INFO:teuthology.orchestra.run.smithi144.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.8 MB/s | 59 kB 00:00 2023-10-14T18:43:05.486 INFO:teuthology.orchestra.run.smithi144.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 2.0 MB/s | 75 kB 00:00 2023-10-14T18:43:05.567 INFO:teuthology.orchestra.run.smithi144.stdout:(40/120): ceph-mgr-diskprediction-local-17.2.6- 8.4 MB/s | 7.4 MB 00:00 2023-10-14T18:43:05.631 INFO:teuthology.orchestra.run.smithi144.stdout:(41/120): ceph-mgr-dashboard-17.2.6-1415.g9d6d3 1.7 MB/s | 1.7 MB 00:00 2023-10-14T18:43:05.747 INFO:teuthology.orchestra.run.smithi144.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-10-14T18:43:05.768 INFO:teuthology.orchestra.run.smithi079.stdout:(10/120): ceph-osd-17.2.6-1415.g9d6d32bb.el8.x8 4.7 MB/s | 17 MB 00:03 2023-10-14T18:43:05.773 INFO:teuthology.orchestra.run.smithi144.stdout:(43/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 212 kB/s | 44 kB 00:00 2023-10-14T18:43:05.779 INFO:teuthology.orchestra.run.smithi144.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 1.0 MB/s | 33 kB 00:00 2023-10-14T18:43:05.812 INFO:teuthology.orchestra.run.smithi144.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 425 kB/s | 16 kB 00:00 2023-10-14T18:43:05.820 INFO:teuthology.orchestra.run.smithi079.stdout:(11/120): cephfs-mirror-17.2.6-1415.g9d6d32bb.e 4.8 MB/s | 255 kB 00:00 2023-10-14T18:43:05.865 INFO:teuthology.orchestra.run.smithi079.stdout:(12/120): libcephfs-devel-17.2.6-1415.g9d6d32bb 556 kB/s | 25 kB 00:00 2023-10-14T18:43:05.865 INFO:teuthology.orchestra.run.smithi144.stdout:(46/120): python3-beautifulsoup4-4.6.3-2.el8.1. 791 kB/s | 185 kB 00:00 2023-10-14T18:43:05.878 INFO:teuthology.orchestra.run.smithi144.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-14T18:43:05.909 INFO:teuthology.orchestra.run.smithi144.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 357 kB/s | 11 kB 00:00 2023-10-14T18:43:05.930 INFO:teuthology.orchestra.run.smithi144.stdout:(49/120): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-14T18:43:05.941 INFO:teuthology.orchestra.run.smithi144.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 561 kB/s | 18 kB 00:00 2023-10-14T18:43:05.953 INFO:teuthology.orchestra.run.smithi079.stdout:(13/120): libcephfs2-17.2.6-1415.g9d6d32bb.el8. 8.8 MB/s | 797 kB 00:00 2023-10-14T18:43:05.972 INFO:teuthology.orchestra.run.smithi144.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 1.5 MB/s | 49 kB 00:00 2023-10-14T18:43:05.993 INFO:teuthology.orchestra.run.smithi079.stdout:(14/120): libcephsqlite-17.2.6-1415.g9d6d32bb.e 4.3 MB/s | 174 kB 00:00 2023-10-14T18:43:06.004 INFO:teuthology.orchestra.run.smithi144.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.8 MB/s | 59 kB 00:00 2023-10-14T18:43:06.029 INFO:teuthology.orchestra.run.smithi144.stdout:(53/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-10-14T18:43:06.032 INFO:teuthology.orchestra.run.smithi079.stdout:(15/120): librados-devel-17.2.6-1415.g9d6d32bb. 3.3 MB/s | 130 kB 00:00 2023-10-14T18:43:06.036 INFO:teuthology.orchestra.run.smithi144.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.9 MB/s | 60 kB 00:00 2023-10-14T18:43:06.078 INFO:teuthology.orchestra.run.smithi144.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 373 kB/s | 16 kB 00:00 2023-10-14T18:43:06.109 INFO:teuthology.orchestra.run.smithi144.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.1 MB/s | 34 kB 00:00 2023-10-14T18:43:06.124 INFO:teuthology.orchestra.run.smithi079.stdout:(16/120): libradosstriper1-17.2.6-1415.g9d6d32b 5.4 MB/s | 506 kB 00:00 2023-10-14T18:43:06.200 INFO:teuthology.orchestra.run.smithi144.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-10-14T18:43:06.211 INFO:teuthology.orchestra.run.smithi144.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-14T18:43:06.232 INFO:teuthology.orchestra.run.smithi144.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 2.0 MB/s | 64 kB 00:00 2023-10-14T18:43:06.243 INFO:teuthology.orchestra.run.smithi144.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 602 kB/s | 19 kB 00:00 2023-10-14T18:43:06.263 INFO:teuthology.orchestra.run.smithi144.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 770 kB/s | 24 kB 00:00 2023-10-14T18:43:06.275 INFO:teuthology.orchestra.run.smithi144.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 922 kB/s | 29 kB 00:00 2023-10-14T18:43:06.295 INFO:teuthology.orchestra.run.smithi144.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 881 kB/s | 27 kB 00:00 2023-10-14T18:43:06.376 INFO:teuthology.orchestra.run.smithi079.stdout:(17/120): ceph-common-17.2.6-1415.g9d6d32bb.el8 3.5 MB/s | 23 MB 00:06 2023-10-14T18:43:06.399 INFO:teuthology.orchestra.run.smithi144.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-14T18:43:06.414 INFO:teuthology.orchestra.run.smithi144.stdout:(65/120): python3-kubernetes-11.0.0-6.el8.noarc 2.4 MB/s | 1.2 MB 00:00 2023-10-14T18:43:06.414 INFO:teuthology.orchestra.run.smithi079.stdout:(18/120): python3-ceph-argparse-17.2.6-1415.g9d 1.2 MB/s | 45 kB 00:00 2023-10-14T18:43:06.420 INFO:teuthology.orchestra.run.smithi144.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-14T18:43:06.436 INFO:teuthology.orchestra.run.smithi079.stdout:(19/120): python3-ceph-common-17.2.6-1415.g9d6d 5.3 MB/s | 115 kB 00:00 2023-10-14T18:43:06.437 INFO:teuthology.orchestra.run.smithi144.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.6 MB/s | 61 kB 00:00 2023-10-14T18:43:06.452 INFO:teuthology.orchestra.run.smithi144.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 735 kB/s | 23 kB 00:00 2023-10-14T18:43:06.456 INFO:teuthology.orchestra.run.smithi144.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-14T18:43:06.462 INFO:teuthology.orchestra.run.smithi079.stdout:(20/120): python3-cephfs-17.2.6-1415.g9d6d32bb. 7.0 MB/s | 190 kB 00:00 2023-10-14T18:43:06.476 INFO:teuthology.orchestra.run.smithi144.stdout:(70/120): python3-webtest-2.0.33-1.el8.noarch.r 1.3 MB/s | 85 kB 00:00 2023-10-14T18:43:06.506 INFO:teuthology.orchestra.run.smithi144.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.5 MB/s | 44 kB 00:00 2023-10-14T18:43:06.513 INFO:teuthology.orchestra.run.smithi079.stdout:(21/120): python3-rados-17.2.6-1415.g9d6d32bb.e 7.2 MB/s | 370 kB 00:00 2023-10-14T18:43:06.520 INFO:teuthology.orchestra.run.smithi144.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-14T18:43:06.537 INFO:teuthology.orchestra.run.smithi144.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.6 MB/s | 161 kB 00:00 2023-10-14T18:43:06.556 INFO:teuthology.orchestra.run.smithi144.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-14T18:43:06.569 INFO:teuthology.orchestra.run.smithi079.stdout:(22/120): python3-rbd-17.2.6-1415.g9d6d32bb.el8 6.3 MB/s | 359 kB 00:00 2023-10-14T18:43:06.575 INFO:teuthology.orchestra.run.smithi144.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-14T18:43:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:(23/120): python3-rgw-17.2.6-1415.g9d6d32bb.el8 4.6 MB/s | 107 kB 00:00 2023-10-14T18:43:06.618 INFO:teuthology.orchestra.run.smithi079.stdout:(24/120): rbd-fuse-17.2.6-1415.g9d6d32bb.el8.x8 3.5 MB/s | 90 kB 00:00 2023-10-14T18:43:06.657 INFO:teuthology.orchestra.run.smithi144.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 59 MB/s | 4.8 MB 00:00 2023-10-14T18:43:06.807 INFO:teuthology.orchestra.run.smithi144.stdout:(77/120): python3-scipy-1.0.0-20.module+el8.1.0 41 MB/s | 15 MB 00:00 2023-10-14T18:43:06.808 INFO:teuthology.orchestra.run.smithi144.stdout:(78/120): python3-markupsafe-0.23-19.el8.x86_64 257 kB/s | 39 kB 00:00 2023-10-14T18:43:06.814 INFO:teuthology.orchestra.run.smithi079.stdout:(25/120): librgw2-17.2.6-1415.g9d6d32bb.el8.x86 8.1 MB/s | 5.6 MB 00:00 2023-10-14T18:43:06.828 INFO:teuthology.orchestra.run.smithi144.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-10-14T18:43:06.832 INFO:teuthology.orchestra.run.smithi144.stdout:(80/120): bison-3.0.4-10.el8.x86_64.rpm 27 MB/s | 688 kB 00:00 2023-10-14T18:43:06.845 INFO:teuthology.orchestra.run.smithi144.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 14 MB/s | 225 kB 00:00 2023-10-14T18:43:06.847 INFO:teuthology.orchestra.run.smithi144.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.4 MB/s | 126 kB 00:00 2023-10-14T18:43:06.861 INFO:teuthology.orchestra.run.smithi079.stdout:(26/120): rbd-nbd-17.2.6-1415.g9d6d32bb.el8.x86 3.6 MB/s | 174 kB 00:00 2023-10-14T18:43:06.863 INFO:teuthology.orchestra.run.smithi144.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-14T18:43:06.884 INFO:teuthology.orchestra.run.smithi144.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 27 MB/s | 538 kB 00:00 2023-10-14T18:43:06.903 INFO:teuthology.orchestra.run.smithi144.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 64 MB/s | 3.7 MB 00:00 2023-10-14T18:43:06.905 INFO:teuthology.orchestra.run.smithi079.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1415.g 524 kB/s | 23 kB 00:00 2023-10-14T18:43:06.907 INFO:teuthology.orchestra.run.smithi144.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-14T18:43:06.917 INFO:teuthology.orchestra.run.smithi144.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-14T18:43:06.921 INFO:teuthology.orchestra.run.smithi144.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.5 MB/s | 110 kB 00:00 2023-10-14T18:43:06.938 INFO:teuthology.orchestra.run.smithi144.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-10-14T18:43:06.939 INFO:teuthology.orchestra.run.smithi144.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-14T18:43:06.944 INFO:teuthology.orchestra.run.smithi079.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1415.g9d6d32b 3.1 MB/s | 121 kB 00:00 2023-10-14T18:43:06.948 INFO:teuthology.orchestra.run.smithi144.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.3 MB/s | 54 kB 00:00 2023-10-14T18:43:06.954 INFO:teuthology.orchestra.run.smithi144.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 35 MB/s | 709 kB 00:00 2023-10-14T18:43:07.016 INFO:teuthology.orchestra.run.smithi079.stdout:(29/120): rbd-mirror-17.2.6-1415.g9d6d32bb.el8. 8.7 MB/s | 3.5 MB 00:00 2023-10-14T18:43:07.022 INFO:teuthology.orchestra.run.smithi144.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 64 MB/s | 4.7 MB 00:00 2023-10-14T18:43:07.042 INFO:teuthology.orchestra.run.smithi144.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 52 MB/s | 4.6 MB 00:00 2023-10-14T18:43:07.050 INFO:teuthology.orchestra.run.smithi144.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-14T18:43:07.065 INFO:teuthology.orchestra.run.smithi144.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 848 kB/s | 19 kB 00:00 2023-10-14T18:43:07.074 INFO:teuthology.orchestra.run.smithi144.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.8 MB/s | 43 kB 00:00 2023-10-14T18:43:07.088 INFO:teuthology.orchestra.run.smithi144.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.4 MB/s | 155 kB 00:00 2023-10-14T18:43:07.098 INFO:teuthology.orchestra.run.smithi144.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.8 MB/s | 220 kB 00:00 2023-10-14T18:43:07.111 INFO:teuthology.orchestra.run.smithi144.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.1 MB/s | 48 kB 00:00 2023-10-14T18:43:07.123 INFO:teuthology.orchestra.run.smithi144.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 9.2 MB/s | 229 kB 00:00 2023-10-14T18:43:07.134 INFO:teuthology.orchestra.run.smithi144.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.9 MB/s | 43 kB 00:00 2023-10-14T18:43:07.151 INFO:teuthology.orchestra.run.smithi079.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1415.g9d6d3 8.2 MB/s | 1.7 MB 00:00 2023-10-14T18:43:07.158 INFO:teuthology.orchestra.run.smithi144.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 746 kB/s | 18 kB 00:00 2023-10-14T18:43:07.172 INFO:teuthology.orchestra.run.smithi144.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 47 MB/s | 2.3 MB 00:00 2023-10-14T18:43:07.186 INFO:teuthology.orchestra.run.smithi144.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2023-10-14T18:43:07.195 INFO:teuthology.orchestra.run.smithi079.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1415.g9d 5.3 MB/s | 238 kB 00:00 2023-10-14T18:43:07.196 INFO:teuthology.orchestra.run.smithi144.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 3.5 MB/s | 83 kB 00:00 2023-10-14T18:43:07.211 INFO:teuthology.orchestra.run.smithi144.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 2.4 MB/s | 59 kB 00:00 2023-10-14T18:43:07.221 INFO:teuthology.orchestra.run.smithi144.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 6.6 MB/s | 169 kB 00:00 2023-10-14T18:43:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:(32/120): ceph-mgr-rook-17.2.6-1415.g9d6d32bb.e 1.2 MB/s | 47 kB 00:00 2023-10-14T18:43:07.235 INFO:teuthology.orchestra.run.smithi144.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.5 MB/s | 38 kB 00:00 2023-10-14T18:43:07.245 INFO:teuthology.orchestra.run.smithi144.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2023-10-14T18:43:07.260 INFO:teuthology.orchestra.run.smithi144.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2023-10-14T18:43:07.269 INFO:teuthology.orchestra.run.smithi144.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2023-10-14T18:43:07.275 INFO:teuthology.orchestra.run.smithi079.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1415.g9 347 kB/s | 14 kB 00:00 2023-10-14T18:43:07.291 INFO:teuthology.orchestra.run.smithi144.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 18 MB/s | 559 kB 00:00 2023-10-14T18:43:07.300 INFO:teuthology.orchestra.run.smithi144.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 20 MB/s | 639 kB 00:00 2023-10-14T18:43:07.316 INFO:teuthology.orchestra.run.smithi144.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 2.8 MB/s | 70 kB 00:00 2023-10-14T18:43:07.323 INFO:teuthology.orchestra.run.smithi079.stdout:(34/120): ceph-volume-17.2.6-1415.g9d6d32bb.el8 5.4 MB/s | 267 kB 00:00 2023-10-14T18:43:07.326 INFO:teuthology.orchestra.run.smithi144.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 7.6 MB/s | 200 kB 00:00 2023-10-14T18:43:07.340 INFO:teuthology.orchestra.run.smithi144.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 4.0 MB/s | 97 kB 00:00 2023-10-14T18:43:07.354 INFO:teuthology.orchestra.run.smithi144.stdout:(118/120): thrift-0.13.0-2.el8.x86_64.rpm 1.9 MB/s | 1.7 MB 00:00 2023-10-14T18:43:07.362 INFO:teuthology.orchestra.run.smithi079.stdout:(35/120): cephadm-17.2.6-1415.g9d6d32bb.el8.noa 2.0 MB/s | 80 kB 00:00 2023-10-14T18:43:07.400 INFO:teuthology.orchestra.run.smithi079.stdout:(36/120): cephfs-top-17.2.6-1415.g9d6d32bb.el8. 486 kB/s | 18 kB 00:00 2023-10-14T18:43:07.529 INFO:teuthology.orchestra.run.smithi079.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 MB/s | 306 kB 00:00 2023-10-14T18:43:07.550 INFO:teuthology.orchestra.run.smithi079.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.7 MB/s | 59 kB 00:00 2023-10-14T18:43:07.572 INFO:teuthology.orchestra.run.smithi079.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.3 MB/s | 75 kB 00:00 2023-10-14T18:43:07.617 INFO:teuthology.orchestra.run.smithi079.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 11 MB/s | 476 kB 00:00 2023-10-14T18:43:07.636 INFO:teuthology.orchestra.run.smithi079.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.2 MB/s | 44 kB 00:00 2023-10-14T18:43:07.659 INFO:teuthology.orchestra.run.smithi079.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 8.2 MB/s | 185 kB 00:00 2023-10-14T18:43:07.675 INFO:teuthology.orchestra.run.smithi144.stdout:(119/120): librados2-17.2.6-1415.g9d6d32bb.el8. 9.9 MB/s | 3.5 MB 00:00 2023-10-14T18:43:07.678 INFO:teuthology.orchestra.run.smithi079.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.7 MB/s | 33 kB 00:00 2023-10-14T18:43:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 858 kB/s | 16 kB 00:00 2023-10-14T18:43:07.720 INFO:teuthology.orchestra.run.smithi079.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.6 MB/s | 173 kB 00:00 2023-10-14T18:43:07.751 INFO:teuthology.orchestra.run.smithi079.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 12 MB/s | 384 kB 00:00 2023-10-14T18:43:07.771 INFO:teuthology.orchestra.run.smithi079.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 4.0 MB/s | 81 kB 00:00 2023-10-14T18:43:07.790 INFO:teuthology.orchestra.run.smithi079.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 585 kB/s | 11 kB 00:00 2023-10-14T18:43:07.810 INFO:teuthology.orchestra.run.smithi079.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 923 kB/s | 18 kB 00:00 2023-10-14T18:43:07.853 INFO:teuthology.orchestra.run.smithi079.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 27 MB/s | 1.2 MB 00:00 2023-10-14T18:43:07.873 INFO:teuthology.orchestra.run.smithi079.stdout:(51/120): ceph-mgr-diskprediction-local-17.2.6- 8.7 MB/s | 7.4 MB 00:00 2023-10-14T18:43:07.874 INFO:teuthology.orchestra.run.smithi079.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2023-10-14T18:43:07.893 INFO:teuthology.orchestra.run.smithi079.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.1 MB/s | 60 kB 00:00 2023-10-14T18:43:07.915 INFO:teuthology.orchestra.run.smithi079.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2023-10-14T18:43:07.934 INFO:teuthology.orchestra.run.smithi079.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 813 kB/s | 16 kB 00:00 2023-10-14T18:43:07.954 INFO:teuthology.orchestra.run.smithi079.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2023-10-14T18:43:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:(57/120): python3-more-itertools-7.2.0-3.el8.no 708 kB/s | 59 kB 00:00 2023-10-14T18:43:07.974 INFO:teuthology.orchestra.run.smithi079.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 9.4 MB/s | 196 kB 00:00 2023-10-14T18:43:07.990 INFO:teuthology.orchestra.run.smithi079.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.8 MB/s | 64 kB 00:00 2023-10-14T18:43:07.993 INFO:teuthology.orchestra.run.smithi079.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 984 kB/s | 19 kB 00:00 2023-10-14T18:43:08.013 INFO:teuthology.orchestra.run.smithi079.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2023-10-14T18:43:08.013 INFO:teuthology.orchestra.run.smithi079.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 1.0 MB/s | 24 kB 00:00 2023-10-14T18:43:08.032 INFO:teuthology.orchestra.run.smithi079.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2023-10-14T18:43:08.053 INFO:teuthology.orchestra.run.smithi079.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2023-10-14T18:43:08.074 INFO:teuthology.orchestra.run.smithi079.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.1 MB/s | 61 kB 00:00 2023-10-14T18:43:08.078 INFO:teuthology.orchestra.run.smithi079.stdout:(66/120): python3-waitress-1.4.3-1.el8.noarch.r 3.9 MB/s | 255 kB 00:00 2023-10-14T18:43:08.092 INFO:teuthology.orchestra.run.smithi079.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 4.3 MB/s | 85 kB 00:00 2023-10-14T18:43:08.097 INFO:teuthology.orchestra.run.smithi079.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-10-14T18:43:08.101 INFO:teuthology.orchestra.run.smithi079.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-14T18:43:08.144 INFO:teuthology.orchestra.run.smithi079.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 34 MB/s | 1.7 MB 00:00 2023-10-14T18:43:08.173 INFO:teuthology.orchestra.run.smithi079.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.5 MB/s | 44 kB 00:00 2023-10-14T18:43:08.186 INFO:teuthology.orchestra.run.smithi079.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-14T18:43:08.202 INFO:teuthology.orchestra.run.smithi079.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-14T18:43:08.220 INFO:teuthology.orchestra.run.smithi079.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-10-14T18:43:08.240 INFO:teuthology.orchestra.run.smithi079.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-14T18:43:08.397 INFO:teuthology.orchestra.run.smithi079.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-10-14T18:43:08.410 INFO:teuthology.orchestra.run.smithi079.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-14T18:43:08.428 INFO:teuthology.orchestra.run.smithi079.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-10-14T18:43:08.436 INFO:teuthology.orchestra.run.smithi079.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 26 MB/s | 688 kB 00:00 2023-10-14T18:43:08.443 INFO:teuthology.orchestra.run.smithi079.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-10-14T18:43:08.452 INFO:teuthology.orchestra.run.smithi079.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 14 MB/s | 225 kB 00:00 2023-10-14T18:43:08.459 INFO:teuthology.orchestra.run.smithi079.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.7 MB/s | 126 kB 00:00 2023-10-14T18:43:08.474 INFO:teuthology.orchestra.run.smithi079.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-14T18:43:08.493 INFO:teuthology.orchestra.run.smithi079.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 28 MB/s | 538 kB 00:00 2023-10-14T18:43:08.511 INFO:teuthology.orchestra.run.smithi079.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2023-10-14T18:43:08.515 INFO:teuthology.orchestra.run.smithi079.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-14T18:43:08.525 INFO:teuthology.orchestra.run.smithi079.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-14T18:43:08.530 INFO:teuthology.orchestra.run.smithi079.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.4 MB/s | 110 kB 00:00 2023-10-14T18:43:08.542 INFO:teuthology.orchestra.run.smithi079.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-14T18:43:08.543 INFO:teuthology.orchestra.run.smithi079.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2023-10-14T18:43:08.557 INFO:teuthology.orchestra.run.smithi079.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.9 MB/s | 54 kB 00:00 2023-10-14T18:43:08.563 INFO:teuthology.orchestra.run.smithi079.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-14T18:43:08.632 INFO:teuthology.orchestra.run.smithi079.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 63 MB/s | 4.7 MB 00:00 2023-10-14T18:43:08.650 INFO:teuthology.orchestra.run.smithi079.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-10-14T18:43:08.658 INFO:teuthology.orchestra.run.smithi079.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-14T18:43:08.662 INFO:teuthology.orchestra.run.smithi079.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.5 MB/s | 19 kB 00:00 2023-10-14T18:43:08.674 INFO:teuthology.orchestra.run.smithi079.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.7 MB/s | 43 kB 00:00 2023-10-14T18:43:08.684 INFO:teuthology.orchestra.run.smithi079.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.3 MB/s | 155 kB 00:00 2023-10-14T18:43:08.694 INFO:teuthology.orchestra.run.smithi079.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 11 MB/s | 220 kB 00:00 2023-10-14T18:43:08.700 INFO:teuthology.orchestra.run.smithi079.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.8 MB/s | 48 kB 00:00 2023-10-14T18:43:08.709 INFO:teuthology.orchestra.run.smithi079.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-14T18:43:08.713 INFO:teuthology.orchestra.run.smithi079.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.1 MB/s | 43 kB 00:00 2023-10-14T18:43:08.715 INFO:teuthology.orchestra.run.smithi144.stdout:(120/120): librbd1-17.2.6-1415.g9d6d32bb.el8.x8 2.6 MB/s | 3.6 MB 00:01 2023-10-14T18:43:08.721 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-10-14T18:43:08.721 INFO:teuthology.orchestra.run.smithi144.stdout:Total 19 MB/s | 202 MB 00:10 2023-10-14T18:43:08.727 INFO:teuthology.orchestra.run.smithi079.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.3 MB/s | 18 kB 00:00 2023-10-14T18:43:08.750 INFO:teuthology.orchestra.run.smithi079.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 57 MB/s | 2.3 MB 00:00 2023-10-14T18:43:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 24 MB/s | 605 kB 00:00 2023-10-14T18:43:08.763 INFO:teuthology.orchestra.run.smithi079.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 6.2 MB/s | 83 kB 00:00 2023-10-14T18:43:08.765 INFO:teuthology.orchestra.run.smithi079.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.4 MB/s | 59 kB 00:00 2023-10-14T18:43:08.769 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-10-14T18:43:08.779 INFO:teuthology.orchestra.run.smithi079.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-14T18:43:08.780 INFO:teuthology.orchestra.run.smithi079.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.6 MB/s | 38 kB 00:00 2023-10-14T18:43:08.793 INFO:teuthology.orchestra.run.smithi079.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.3 MB/s | 86 kB 00:00 2023-10-14T18:43:08.793 INFO:teuthology.orchestra.run.smithi079.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-14T18:43:08.806 INFO:teuthology.orchestra.run.smithi079.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.6 MB/s | 47 kB 00:00 2023-10-14T18:43:08.811 INFO:teuthology.orchestra.run.smithi079.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 31 MB/s | 559 kB 00:00 2023-10-14T18:43:08.825 INFO:teuthology.orchestra.run.smithi079.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 33 MB/s | 639 kB 00:00 2023-10-14T18:43:08.826 INFO:teuthology.orchestra.run.smithi079.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.7 MB/s | 70 kB 00:00 2023-10-14T18:43:08.840 INFO:teuthology.orchestra.run.smithi079.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-10-14T18:43:08.841 INFO:teuthology.orchestra.run.smithi079.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.5 MB/s | 97 kB 00:00 2023-10-14T18:43:08.881 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-10-14T18:43:08.881 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-10-14T18:43:09.514 INFO:teuthology.orchestra.run.smithi079.stdout:(118/120): ceph-test-17.2.6-1415.g9d6d32bb.el8. 12 MB/s | 52 MB 00:04 2023-10-14T18:43:09.534 INFO:teuthology.orchestra.run.smithi079.stdout:(119/120): librbd1-17.2.6-1415.g9d6d32bb.el8.x8 5.2 MB/s | 3.6 MB 00:00 2023-10-14T18:43:09.548 INFO:teuthology.orchestra.run.smithi079.stdout:(120/120): librados2-17.2.6-1415.g9d6d32bb.el8. 4.9 MB/s | 3.5 MB 00:00 2023-10-14T18:43:09.551 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2023-10-14T18:43:09.551 INFO:teuthology.orchestra.run.smithi079.stdout:Total 20 MB/s | 202 MB 00:09 2023-10-14T18:43:09.602 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2023-10-14T18:43:09.715 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2023-10-14T18:43:09.715 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2023-10-14T18:43:10.583 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-10-14T18:43:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-10-14T18:43:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2023-10-14T18:43:11.411 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2023-10-14T18:43:15.451 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-10-14T18:43:15.688 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-14T18:43:15.919 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-14T18:43:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2023-10-14T18:43:16.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-14T18:43:16.245 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-14T18:43:16.246 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-14T18:43:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-14T18:43:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-14T18:43:16.703 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-14T18:43:16.819 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-14T18:43:16.841 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-14T18:43:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-14T18:43:17.098 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T18:43:17.454 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-14T18:43:17.486 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T18:43:17.669 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T18:43:17.715 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:43:17.842 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:43:18.082 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:43:18.100 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 5/122 2023-10-14T18:43:18.171 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:43:18.319 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:43:18.449 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:43:18.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:43:18.760 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:43:18.913 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T18:43:19.117 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T18:43:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-14T18:43:19.756 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:43:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-14T18:43:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:43:19.986 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:43:20.100 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:43:20.110 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-14T18:43:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-14T18:43:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-14T18:43:20.531 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:43:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-14T18:43:20.644 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:43:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:43:20.830 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T18:43:20.858 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:43:20.922 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T18:43:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T18:43:21.064 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-14T18:43:21.103 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 14/122 2023-10-14T18:43:21.273 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-14T18:43:21.291 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-14T18:43:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-14T18:43:21.589 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-14T18:43:22.156 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-14T18:43:22.277 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-14T18:43:22.306 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-14T18:43:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-14T18:43:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-14T18:43:22.855 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-14T18:43:23.031 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-14T18:43:23.148 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-14T18:43:23.326 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-14T18:43:23.809 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-14T18:43:23.857 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-14T18:43:24.051 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-14T18:43:24.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-14T18:43:24.806 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-14T18:43:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-14T18:43:25.097 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-14T18:43:25.130 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-14T18:43:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-14T18:43:25.407 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-14T18:43:25.472 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-14T18:43:25.708 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-14T18:43:25.737 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-14T18:43:25.961 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-14T18:43:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-14T18:43:26.145 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 26/122 2023-10-14T18:43:26.298 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-14T18:43:26.308 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 27/122 2023-10-14T18:43:26.458 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 26/122 2023-10-14T18:43:26.581 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 28/122 2023-10-14T18:43:26.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 27/122 2023-10-14T18:43:26.841 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 28/122 2023-10-14T18:43:27.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-14T18:43:27.876 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-14T18:43:27.953 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-14T18:43:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-14T18:43:28.272 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-14T18:43:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-14T18:43:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-14T18:43:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-14T18:43:28.789 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-14T18:43:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-14T18:43:29.054 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-14T18:43:29.267 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-14T18:43:31.174 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-14T18:43:31.387 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-14T18:43:31.559 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-14T18:43:31.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-14T18:43:31.821 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-14T18:43:31.964 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-14T18:43:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-14T18:43:32.203 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-14T18:43:32.321 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 38/122 2023-10-14T18:43:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 38/122 2023-10-14T18:43:32.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 39/122 2023-10-14T18:43:32.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 39/122 2023-10-14T18:43:32.739 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 40/122 2023-10-14T18:43:32.785 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 40/122 2023-10-14T18:43:32.937 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-14T18:43:32.991 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-14T18:43:33.143 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-14T18:43:33.181 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-14T18:43:33.355 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-14T18:43:33.368 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-14T18:43:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-14T18:43:33.565 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-14T18:43:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-14T18:43:33.724 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-14T18:43:33.883 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-14T18:43:33.945 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-14T18:43:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-14T18:43:34.140 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-14T18:43:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-14T18:43:34.492 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-14T18:43:34.671 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-14T18:43:34.761 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-14T18:43:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-14T18:43:35.004 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-14T18:43:35.267 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-14T18:43:35.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-14T18:43:35.497 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-14T18:43:35.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-14T18:43:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-14T18:43:35.862 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-14T18:43:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-14T18:43:36.058 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-14T18:43:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-14T18:43:36.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-14T18:43:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-14T18:43:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-14T18:43:36.445 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-14T18:43:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-14T18:43:36.524 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-14T18:43:36.710 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-14T18:43:36.737 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-14T18:43:36.874 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-14T18:43:36.948 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-14T18:43:37.061 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-14T18:43:37.129 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-14T18:43:37.308 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-14T18:43:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-14T18:43:37.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-14T18:43:37.602 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-14T18:43:37.805 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-14T18:43:37.812 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-14T18:43:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-14T18:43:38.035 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-14T18:43:38.178 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-14T18:43:38.206 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-14T18:43:38.400 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-14T18:43:38.423 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-14T18:43:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-14T18:43:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-14T18:43:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-14T18:43:38.906 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-14T18:43:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-14T18:43:39.139 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-14T18:43:39.235 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-14T18:43:39.356 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-14T18:43:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-14T18:43:39.530 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-14T18:43:39.719 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-14T18:43:39.858 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-14T18:43:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-14T18:43:40.123 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-14T18:43:40.231 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-14T18:43:40.358 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-14T18:43:40.514 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-14T18:43:40.625 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-14T18:43:40.697 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-14T18:43:40.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-14T18:43:40.983 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-14T18:43:41.085 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-14T18:43:41.334 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-14T18:43:42.125 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-14T18:43:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-14T18:43:42.482 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-14T18:43:42.683 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-14T18:43:42.810 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-14T18:43:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-14T18:43:43.037 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-14T18:43:43.268 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-14T18:43:43.393 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-14T18:43:43.679 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-14T18:43:43.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-14T18:43:43.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-14T18:43:44.019 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-14T18:43:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-14T18:43:44.285 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-14T18:43:44.397 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-14T18:43:44.544 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-14T18:43:44.794 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-14T18:43:49.624 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:49.863 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:49.872 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:50.468 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:50.786 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T18:43:50.887 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T18:43:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T18:43:51.233 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:51.847 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 87/122 2023-10-14T18:43:52.167 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T18:43:52.251 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 88/122 2023-10-14T18:43:52.442 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T18:44:09.036 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T18:44:09.037 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2023-10-14T18:44:09.037 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2023-10-14T18:44:09.037 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-14T18:44:09.037 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /run 2023-10-14T18:44:09.038 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2023-10-14T18:44:09.038 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2023-10-14T18:44:09.038 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2023-10-14T18:44:09.038 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2023-10-14T18:44:09.038 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-14T18:44:09.039 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:09.434 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T18:44:10.530 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 89/122 2023-10-14T18:44:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-10-14T18:44:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-10-14T18:44:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-14T18:44:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-10-14T18:44:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-10-14T18:44:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-10-14T18:44:10.531 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-10-14T18:44:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-10-14T18:44:10.532 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-14T18:44:10.532 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T18:44:10.923 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T18:44:11.124 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T18:44:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T18:44:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T18:44:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T18:44:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T18:44:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T18:44:12.410 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 90/122 2023-10-14T18:44:12.571 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T18:44:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 91/122 2023-10-14T18:44:12.997 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T18:44:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 92/122 2023-10-14T18:44:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T18:44:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 93/122 2023-10-14T18:44:14.960 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T18:44:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T18:44:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 95/122 2023-10-14T18:44:15.537 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 96/122 2023-10-14T18:44:15.740 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T18:44:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T18:44:16.189 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T18:44:16.548 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T18:44:16.782 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 94/122 2023-10-14T18:44:16.953 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 95/122 2023-10-14T18:44:17.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 96/122 2023-10-14T18:44:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T18:44:17.315 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T18:44:17.321 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T18:44:17.414 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T18:44:17.539 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 97/122 2023-10-14T18:44:17.745 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 100/122 2023-10-14T18:44:17.778 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T18:44:17.956 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T18:44:17.993 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T18:44:18.131 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T18:44:18.143 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T18:44:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 98/122 2023-10-14T18:44:18.954 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T18:44:19.058 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 99/122 2023-10-14T18:44:19.468 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 100/122 2023-10-14T18:44:19.704 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T18:44:19.741 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 101/122 2023-10-14T18:44:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 103/122 2023-10-14T18:44:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T18:44:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 102/122 2023-10-14T18:44:20.038 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T18:44:20.133 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T18:44:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T18:44:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T18:44:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T18:44:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T18:44:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T18:44:21.541 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 103/122 2023-10-14T18:44:21.812 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T18:44:21.938 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 104/122 2023-10-14T18:44:22.087 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T18:44:22.130 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 105/122 2023-10-14T18:44:22.287 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T18:44:22.635 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 106/122 2023-10-14T18:44:22.796 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T18:44:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T18:44:26.321 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 108/122 2023-10-14T18:44:26.462 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-14T18:44:27.179 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-14T18:44:27.481 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-14T18:44:27.668 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 111/122 2023-10-14T18:44:27.757 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 107/122 2023-10-14T18:44:27.866 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-14T18:44:28.025 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 113/122 2023-10-14T18:44:28.110 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 108/122 2023-10-14T18:44:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-14T18:44:28.286 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-14T18:44:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 115/122 2023-10-14T18:44:28.595 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 116/122 2023-10-14T18:44:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 117/122 2023-10-14T18:44:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-14T18:44:29.016 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-14T18:44:29.220 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-14T18:44:29.279 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-14T18:44:29.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-14T18:44:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-14T18:44:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-14T18:44:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T18:44:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 111/122 2023-10-14T18:44:29.698 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T18:44:29.699 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:29.739 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-14T18:44:29.932 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 113/122 2023-10-14T18:44:30.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-14T18:44:30.277 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 115/122 2023-10-14T18:44:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 116/122 2023-10-14T18:44:30.499 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:30.500 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/122 2023-10-14T18:44:30.500 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/122 2023-10-14T18:44:30.500 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/122 2023-10-14T18:44:30.500 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T18:44:30.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 5/122 2023-10-14T18:44:30.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:44:30.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:44:30.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T18:44:30.501 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 9/122 2023-10-14T18:44:30.502 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:44:30.502 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/122 2023-10-14T18:44:30.502 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/122 2023-10-14T18:44:30.502 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:44:30.502 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 14/122 2023-10-14T18:44:30.503 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 15/122 2023-10-14T18:44:30.503 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/122 2023-10-14T18:44:30.503 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 17/122 2023-10-14T18:44:30.503 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 18/122 2023-10-14T18:44:30.503 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 19/122 2023-10-14T18:44:30.504 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 20/122 2023-10-14T18:44:30.504 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 21/122 2023-10-14T18:44:30.504 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 22/122 2023-10-14T18:44:30.504 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/122 2023-10-14T18:44:30.504 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/122 2023-10-14T18:44:30.505 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/122 2023-10-14T18:44:30.505 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/122 2023-10-14T18:44:30.505 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/122 2023-10-14T18:44:30.505 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/122 2023-10-14T18:44:30.506 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 29/122 2023-10-14T18:44:30.514 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 30/122 2023-10-14T18:44:30.514 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 31/122 2023-10-14T18:44:30.514 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 32/122 2023-10-14T18:44:30.514 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 33/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 34/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 35/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 36/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 37/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 38/122 2023-10-14T18:44:30.515 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-14T18:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-14T18:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-14T18:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-14T18:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-14T18:44:30.516 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-14T18:44:30.517 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-14T18:44:30.517 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-14T18:44:30.517 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-14T18:44:30.517 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-14T18:44:30.518 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-14T18:44:30.518 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-14T18:44:30.518 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-14T18:44:30.518 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-14T18:44:30.519 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-14T18:44:30.519 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-14T18:44:30.519 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-14T18:44:30.519 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-14T18:44:30.520 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-14T18:44:30.520 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-14T18:44:30.520 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-14T18:44:30.520 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-14T18:44:30.520 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-14T18:44:30.521 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-14T18:44:30.521 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-14T18:44:30.521 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-14T18:44:30.521 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-14T18:44:30.522 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-14T18:44:30.522 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-14T18:44:30.522 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-14T18:44:30.522 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-14T18:44:30.523 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-14T18:44:30.523 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-14T18:44:30.523 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-14T18:44:30.523 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-14T18:44:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-14T18:44:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-14T18:44:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-14T18:44:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-14T18:44:30.524 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-14T18:44:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-14T18:44:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-14T18:44:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-14T18:44:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-14T18:44:30.525 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-14T18:44:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-14T18:44:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-14T18:44:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-14T18:44:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-14T18:44:30.526 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-14T18:44:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-14T18:44:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-14T18:44:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-14T18:44:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-14T18:44:30.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-14T18:44:30.528 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-14T18:44:30.528 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-14T18:44:30.528 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-14T18:44:30.528 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-14T18:44:30.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-14T18:44:30.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-14T18:44:30.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-14T18:44:30.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-14T18:44:30.529 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-14T18:44:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-14T18:44:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-14T18:44:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-14T18:44:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-14T18:44:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-14T18:44:30.531 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-14T18:44:30.531 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-14T18:44:30.531 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-14T18:44:30.531 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-14T18:44:30.531 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-14T18:44:30.532 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-14T18:44:30.532 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-14T18:44:30.532 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-14T18:44:30.532 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-14T18:44:30.532 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-14T18:44:30.533 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-14T18:44:30.533 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 119/122 2023-10-14T18:44:30.533 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-14T18:44:30.533 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 121/122 2023-10-14T18:44:30.653 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 117/122 2023-10-14T18:44:30.856 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-14T18:44:31.035 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-14T18:44:31.130 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-14T18:44:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-14T18:44:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-14T18:44:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T18:44:31.530 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-14T18:44:31.530 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 1/122 2023-10-14T18:44:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2/122 2023-10-14T18:44:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 3/122 2023-10-14T18:44:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 4/122 2023-10-14T18:44:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1415.g9d6d3 5/122 2023-10-14T18:44:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 6/122 2023-10-14T18:44:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 7/122 2023-10-14T18:44:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 8/122 2023-10-14T18:44:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 9/122 2023-10-14T18:44:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 10/122 2023-10-14T18:44:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 11/122 2023-10-14T18:44:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 12/122 2023-10-14T18:44:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 13/122 2023-10-14T18:44:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_ 14/122 2023-10-14T18:44:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 15/122 2023-10-14T18:44:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 16/122 2023-10-14T18:44:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_6 17/122 2023-10-14T18:44:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86 18/122 2023-10-14T18:44:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 19/122 2023-10-14T18:44:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el 20/122 2023-10-14T18:44:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8. 21/122 2023-10-14T18:44:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_6 22/122 2023-10-14T18:44:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 23/122 2023-10-14T18:44:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 24/122 2023-10-14T18:44:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 25/122 2023-10-14T18:44:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 26/122 2023-10-14T18:44:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 27/122 2023-10-14T18:44:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 28/122 2023-10-14T18:44:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb. 29/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noa 30/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.n 31/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6 32/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el 33/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 34/122 2023-10-14T18:44:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.e 35/122 2023-10-14T18:44:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 36/122 2023-10-14T18:44:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 37/122 2023-10-14T18:44:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 38/122 2023-10-14T18:44:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-14T18:44:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-14T18:44:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-14T18:44:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-14T18:44:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-14T18:44:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-14T18:44:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-14T18:44:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-14T18:44:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-14T18:44:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-14T18:44:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-14T18:44:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-14T18:44:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-14T18:44:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-14T18:44:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-14T18:44:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-14T18:44:32.476 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-14T18:44:32.477 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-14T18:44:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-14T18:44:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-14T18:44:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-14T18:44:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-14T18:44:32.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-14T18:44:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-14T18:44:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-14T18:44:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-14T18:44:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-14T18:44:32.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-14T18:44:32.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-14T18:44:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-14T18:44:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-14T18:44:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-14T18:44:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-14T18:44:32.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-14T18:44:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-14T18:44:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-14T18:44:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-14T18:44:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-14T18:44:32.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-14T18:44:32.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-14T18:44:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-14T18:44:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-14T18:44:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-14T18:44:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-14T18:44:32.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-14T18:44:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-14T18:44:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-14T18:44:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-14T18:44:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-14T18:44:32.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-14T18:44:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-14T18:44:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-14T18:44:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-14T18:44:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-14T18:44:32.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-14T18:44:32.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-14T18:44:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-14T18:44:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-14T18:44:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-14T18:44:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-14T18:44:32.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 119/122 2023-10-14T18:44:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-14T18:44:32.489 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 121/122 2023-10-14T18:44:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:32.719 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Oct 2023 06:42:50 PM UTC. 2023-10-14T18:44:34.799 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-14T18:44:34.799 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Oct 2023 06:42:49 PM UTC. 2023-10-14T18:44:34.864 INFO:teuthology.orchestra.run.smithi079.stdout:Installed products updated. 2023-10-14T18:44:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:35.019 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2023-10-14T18:44:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.020 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2023-10-14T18:44:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T18:44:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T18:44:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-14T18:44:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T18:44:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-14T18:44:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T18:44:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.5-12.el8.x86_64 2023-10-14T18:44:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-14T18:44:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-14T18:44:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T18:44:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-14T18:44:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T18:44:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T18:44:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T18:44:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T18:44:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T18:44:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T18:44:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-14T18:44:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T18:44:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T18:44:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-14T18:44:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T18:44:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T18:44:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T18:44:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T18:44:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T18:44:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-14T18:44:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T18:44:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T18:44:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T18:44:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T18:44:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T18:44:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T18:44:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T18:44:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T18:44:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T18:44:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T18:44:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T18:44:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T18:44:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T18:44:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T18:44:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T18:44:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T18:44:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T18:44:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T18:44:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T18:44:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T18:44:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T18:44:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T18:44:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T18:44:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T18:44:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T18:44:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T18:44:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T18:44:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T18:44:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T18:44:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T18:44:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T18:44:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T18:44:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T18:44:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T18:44:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T18:44:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T18:44:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T18:44:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T18:44:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T18:44:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T18:44:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T18:44:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T18:44:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T18:44:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T18:44:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T18:44:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T18:44:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T18:44:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T18:44:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T18:44:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T18:44:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-14T18:44:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T18:44:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-14T18:44:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:35.046 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-14T18:44:35.287 DEBUG:teuthology.parallel:result is None 2023-10-14T18:44:36.823 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-10-14T18:44:36.978 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:36.979 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-10-14T18:44:36.979 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.979 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.980 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-10-14T18:44:36.980 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T18:44:36.980 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T18:44:36.980 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.980 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.981 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.982 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.982 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.982 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.983 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.983 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.984 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.984 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.984 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.985 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.985 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.985 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.986 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.986 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.986 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.987 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.987 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:17.2.6-1415.g9d6d32bb.el8.noarch 2023-10-14T18:44:36.987 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-14T18:44:36.988 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T18:44:36.988 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-14T18:44:36.988 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T18:44:36.989 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.5-12.el8.x86_64 2023-10-14T18:44:36.989 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-14T18:44:36.989 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-14T18:44:36.990 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T18:44:36.990 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.990 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.991 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.991 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-14T18:44:36.992 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-14T18:44:36.992 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T18:44:36.992 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-14T18:44:36.992 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T18:44:36.993 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.993 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.994 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-14T18:44:36.994 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.994 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T18:44:36.995 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-14T18:44:36.995 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T18:44:36.995 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T18:44:36.996 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-14T18:44:36.996 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T18:44:36.996 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T18:44:36.996 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T18:44:36.997 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-14T18:44:36.997 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-14T18:44:36.997 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-14T18:44:36.997 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T18:44:36.998 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T18:44:36.998 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T18:44:36.998 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T18:44:36.998 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-14T18:44:36.998 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T18:44:36.999 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T18:44:36.999 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T18:44:36.999 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:36.999 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.000 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.000 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T18:44:37.000 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T18:44:37.000 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T18:44:37.000 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T18:44:37.001 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T18:44:37.001 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T18:44:37.001 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-14T18:44:37.001 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T18:44:37.001 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T18:44:37.002 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T18:44:37.002 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T18:44:37.002 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T18:44:37.003 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T18:44:37.003 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T18:44:37.003 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T18:44:37.004 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T18:44:37.004 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-14T18:44:37.005 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-14T18:44:37.005 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T18:44:37.005 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T18:44:37.006 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T18:44:37.006 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T18:44:37.007 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T18:44:37.007 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T18:44:37.007 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T18:44:37.008 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.008 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.008 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T18:44:37.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T18:44:37.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.009 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T18:44:37.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T18:44:37.010 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-14T18:44:37.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T18:44:37.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T18:44:37.011 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T18:44:37.012 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T18:44:37.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T18:44:37.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T18:44:37.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T18:44:37.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T18:44:37.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T18:44:37.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T18:44:37.015 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.015 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.015 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:17.2.6-1415.g9d6d32bb.el8.x86_64 2023-10-14T18:44:37.015 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-14T18:44:37.015 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T18:44:37.016 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-14T18:44:37.016 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T18:44:37.016 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-14T18:44:37.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:37.017 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-14T18:44:37.264 DEBUG:teuthology.parallel:result is None 2023-10-14T18:44:37.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:44:37.415 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T18:44:37.439 INFO:teuthology.orchestra.run.smithi079.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T18:44:37.440 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T18:44:37.440 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T18:44:37.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d6d32bb3452d5179bde2ee1cfa05df7a65f4586 2023-10-14T18:44:37.591 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T18:44:37.613 INFO:teuthology.orchestra.run.smithi144.stdout:17.2.6-1415.g9d6d32bb.el8 2023-10-14T18:44:37.613 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1415.g9d6d32bb.el8 2023-10-14T18:44:37.614 INFO:teuthology.task.install:The correct ceph version 17.2.6-1415.g9d6d32bb is installed. 2023-10-14T18:44:37.614 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T18:44:37.615 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:37.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T18:44:37.654 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:37.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T18:44:37.693 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T18:44:37.694 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:37.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T18:44:37.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T18:44:37.783 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:37.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T18:44:37.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T18:44:37.872 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T18:44:37.873 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:37.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T18:44:37.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T18:44:37.961 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:37.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T18:44:37.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T18:44:38.050 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T18:44:38.050 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:38.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T18:44:38.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T18:44:38.138 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:38.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T18:44:38.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T18:44:38.228 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T18:44:38.290 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T18:44:38.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2023-10-14T18:44:38.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-10-14T18:44:38.317 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T18:44:38.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T18:44:38.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T18:44:38.382 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T18:44:38.382 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T18:44:38.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T18:44:38.454 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T18:44:38.455 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T18:44:38.455 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T18:44:38.455 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:38.456 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T18:44:38.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:38.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:38.635 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:38.636 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T18:44:38.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:38.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:38.806 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T18:44:38.807 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T18:44:38.807 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783', 'branch': 'quincy-release', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7425783', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'quincy-release'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'quincy-release', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2462, 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'quincy-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9d6d32bb3452d5179bde2ee1cfa05df7a65f4586/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYk2JnFV1hD/9osJXVTkGSTgA66jIeVDyNBUnusYENk2bNNhg4LLUUYXCAVNS+Lfzt8uNZzM9KaiolF18sa+oo=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrB5DKII1ZhJrgg4sZTw+5WRJyFLlocJrMLwnjOuqNWYLrwG2GQVOyPtDHybcTqAGavr0+uv76+71zljJPXVs8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '9d6d32bb3452d5179bde2ee1cfa05df7a65f4586', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_20:07:38', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T18:44:38.808 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T18:44:38.811 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T18:44:38.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T18:44:38.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T18:44:38.921 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:38.922 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T18:44:38.943 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T18:44:38.943 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-10-14T18:44:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T18:44:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:38.998 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 218782 Links: 1 2023-10-14T18:44:38.999 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:38.999 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:38.999 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-14 18:44:30.095171536 +0000 2023-10-14T18:44:38.999 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-14 18:42:05.596374885 +0000 2023-10-14T18:44:38.999 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-14 18:42:05.596374885 +0000 2023-10-14T18:44:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-14T18:44:39.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T18:44:39.061 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-14T18:44:39.061 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-14T18:44:39.061 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000251669 s, 2.0 MB/s 2023-10-14T18:44:39.062 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T18:44:39.118 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-10-14T18:44:39.173 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T18:44:39.173 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:39.173 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 219580 Links: 1 2023-10-14T18:44:39.174 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:39.174 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:39.174 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-14 18:44:30.096171513 +0000 2023-10-14T18:44:39.174 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-14 18:42:06.104363559 +0000 2023-10-14T18:44:39.174 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-14 18:42:06.104363559 +0000 2023-10-14T18:44:39.175 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-14T18:44:39.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T18:44:39.236 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-14T18:44:39.236 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-14T18:44:39.236 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000244962 s, 2.1 MB/s 2023-10-14T18:44:39.238 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T18:44:39.294 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-10-14T18:44:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T18:44:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:39.349 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 222355 Links: 1 2023-10-14T18:44:39.350 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:39.350 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:39.350 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-14 18:44:30.096171513 +0000 2023-10-14T18:44:39.350 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-14 18:42:06.571353146 +0000 2023-10-14T18:44:39.350 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-14 18:42:06.571353146 +0000 2023-10-14T18:44:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-14T18:44:39.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T18:44:39.413 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-14T18:44:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-14T18:44:39.414 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000262918 s, 1.9 MB/s 2023-10-14T18:44:39.414 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T18:44:39.469 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-10-14T18:44:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T18:44:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 219650 Links: 1 2023-10-14T18:44:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-14 18:44:30.096171513 +0000 2023-10-14T18:44:39.526 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-14 18:42:07.064342153 +0000 2023-10-14T18:44:39.526 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-14 18:42:07.064342153 +0000 2023-10-14T18:44:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-14T18:44:39.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T18:44:39.587 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-14T18:44:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-14T18:44:39.588 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000213516 s, 2.4 MB/s 2023-10-14T18:44:39.589 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T18:44:39.645 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:39.646 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:39.646 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T18:44:39.661 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T18:44:39.662 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-10-14T18:44:39.717 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T18:44:39.718 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:39.718 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 222325 Links: 1 2023-10-14T18:44:39.718 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:39.719 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:39.719 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-14 18:44:32.021142290 +0000 2023-10-14T18:44:39.719 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-14 18:42:06.071889552 +0000 2023-10-14T18:44:39.720 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-14 18:42:06.071889552 +0000 2023-10-14T18:44:39.720 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-14T18:44:39.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T18:44:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-14T18:44:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-14T18:44:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000253815 s, 2.0 MB/s 2023-10-14T18:44:39.784 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T18:44:39.839 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-10-14T18:44:39.894 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T18:44:39.895 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:39.895 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 215971 Links: 1 2023-10-14T18:44:39.895 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:39.895 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:39.896 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-14 18:44:32.021142290 +0000 2023-10-14T18:44:39.896 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-14 18:42:06.562881484 +0000 2023-10-14T18:44:39.896 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-14 18:42:06.562881484 +0000 2023-10-14T18:44:39.896 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-14T18:44:39.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T18:44:39.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-14T18:44:39.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-14T18:44:39.958 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000223083 s, 2.3 MB/s 2023-10-14T18:44:39.959 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T18:44:40.015 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-10-14T18:44:40.071 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T18:44:40.071 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:40.071 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 216921 Links: 1 2023-10-14T18:44:40.071 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:40.072 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:40.072 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-14 18:44:32.021142290 +0000 2023-10-14T18:44:40.072 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-14 18:42:07.079872988 +0000 2023-10-14T18:44:40.072 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-14 18:42:07.079872988 +0000 2023-10-14T18:44:40.073 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-14T18:44:40.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T18:44:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-14T18:44:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-14T18:44:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000209817 s, 2.4 MB/s 2023-10-14T18:44:40.135 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T18:44:40.190 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-10-14T18:44:40.244 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T18:44:40.245 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T18:44:40.245 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 222679 Links: 1 2023-10-14T18:44:40.245 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T18:44:40.245 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T18:44:40.245 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-14 18:44:32.021142290 +0000 2023-10-14T18:44:40.246 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-14 18:42:07.572864887 +0000 2023-10-14T18:44:40.246 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-14 18:42:07.572864887 +0000 2023-10-14T18:44:40.246 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-14T18:44:40.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T18:44:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-14T18:44:40.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-14T18:44:40.308 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00023194 s, 2.2 MB/s 2023-10-14T18:44:40.309 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T18:44:40.364 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:40.364 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T18:44:40.365 INFO:tasks.ceph:Generating config... 2023-10-14T18:44:40.366 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T18:44:40.366 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T18:44:40.366 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T18:44:40.367 INFO:tasks.ceph:[client] pid file = 2023-10-14T18:44:40.367 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T18:44:40.367 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T18:44:40.368 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-14T18:44:40.368 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-14T18:44:40.368 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-14T18:44:40.368 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-14T18:44:40.369 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-14T18:44:40.369 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-14T18:44:40.369 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T18:44:40.369 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T18:44:40.370 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T18:44:40.370 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T18:44:40.370 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T18:44:40.371 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T18:44:40.371 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T18:44:40.371 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T18:44:40.371 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T18:44:40.372 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T18:44:40.372 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T18:44:40.372 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T18:44:40.372 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T18:44:40.373 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T18:44:40.373 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T18:44:40.373 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T18:44:40.373 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-14T18:44:40.374 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-14T18:44:40.374 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-14T18:44:40.374 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T18:44:40.374 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T18:44:40.375 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T18:44:40.375 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T18:44:40.376 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T18:44:40.376 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T18:44:40.376 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T18:44:40.376 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T18:44:40.377 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T18:44:40.377 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T18:44:40.377 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-14T18:44:40.377 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T18:44:40.378 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T18:44:40.378 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T18:44:40.378 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-14T18:44:40.378 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-14T18:44:40.379 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-14T18:44:40.379 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T18:44:40.379 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T18:44:40.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T18:44:40.430 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T18:44:40.433 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T18:44:40.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T18:44:40.536 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]')] 2023-10-14T18:44:40.537 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T18:44:40.538 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:40.538 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T18:44:40.591 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:40.673 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:40.673 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 73e97ab7-e872-4b12-8e7a-6b299bb24b40 2023-10-14T18:44:40.673 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = octopus 2023-10-14T18:44:40.673 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2023-10-14T18:44:40.674 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 73e97ab7-e872-4b12-8e7a-6b299bb24b40 2023-10-14T18:44:40.674 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2023-10-14T18:44:40.673449+0000 2023-10-14T18:44:40.674 INFO:teuthology.orchestra.run.smithi079.stdout:created 2023-10-14T18:44:40.673449+0000 2023-10-14T18:44:40.674 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 15 (octopus) 2023-10-14T18:44:40.675 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2023-10-14T18:44:40.675 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2023-10-14T18:44:40.675 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2023-10-14T18:44:40.675 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2023-10-14T18:44:40.675 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T18:44:40.677 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T18:44:40.731 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 73e97ab7-e872-4b12-8e7a-6b299bb24b40... 2023-10-14T18:44:40.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T18:44:40.773 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T18:44:40.813 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2023-10-14T18:44:40.814 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2023-10-14T18:44:40.814 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T18:44:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2023-10-14T18:44:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2023-10-14T18:44:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.815 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2023-10-14T18:44:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2023-10-14T18:44:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2023-10-14T18:44:40.816 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2023-10-14T18:44:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2023-10-14T18:44:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T18:44:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2023-10-14T18:44:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T18:44:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T18:44:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2023-10-14T18:44:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2023-10-14T18:44:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2023-10-14T18:44:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2023-10-14T18:44:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2023-10-14T18:44:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2023-10-14T18:44:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2023-10-14T18:44:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2023-10-14T18:44:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T18:44:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T18:44:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2023-10-14T18:44:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T18:44:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2023-10-14T18:44:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2023-10-14T18:44:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2023-10-14T18:44:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2023-10-14T18:44:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2023-10-14T18:44:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-10-14T18:44:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2023-10-14T18:44:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 73e97ab7-e872-4b12-8e7a-6b299bb24b40 2023-10-14T18:44:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.825 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2023-10-14T18:44:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2023-10-14T18:44:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2023-10-14T18:44:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2023-10-14T18:44:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2023-10-14T18:44:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2023-10-14T18:44:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2023-10-14T18:44:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2023-10-14T18:44:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2023-10-14T18:44:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2023-10-14T18:44:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2023-10-14T18:44:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2023-10-14T18:44:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2023-10-14T18:44:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2023-10-14T18:44:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2023-10-14T18:44:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2023-10-14T18:44:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2023-10-14T18:44:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2023-10-14T18:44:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2023-10-14T18:44:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2023-10-14T18:44:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2023-10-14T18:44:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2023-10-14T18:44:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2023-10-14T18:44:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-14T18:44:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2023-10-14T18:44:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2023-10-14T18:44:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: memstore device bytes = 200000000 2023-10-14T18:44:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T18:44:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2023-10-14T18:44:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2023-10-14T18:44:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 1.0 2023-10-14T18:44:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: osd mon report interval = 5 2023-10-14T18:44:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = memstore 2023-10-14T18:44:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-14T18:44:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-14T18:44:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-14T18:44:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-14T18:44:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2023-10-14T18:44:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.837 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2023-10-14T18:44:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-14T18:44:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-14T18:44:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2023-10-14T18:44:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-14T18:44:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2023-10-14T18:44:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2023-10-14T18:44:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-14T18:44:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2023-10-14T18:44:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2023-10-14T18:44:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-14T18:44:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T18:44:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T18:44:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T18:44:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T18:44:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T18:44:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T18:44:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2023-10-14T18:44:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2023-10-14T18:44:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2023-10-14T18:44:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2023-10-14T18:44:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull ratio = 0.6 2023-10-14T18:44:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.7 2023-10-14T18:44:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.6 2023-10-14T18:44:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:40.843 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2023-10-14T18:44:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2023-10-14T18:44:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2023-10-14T18:44:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2023-10-14T18:44:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T18:44:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T18:44:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2023-10-14T18:44:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-10-14T18:44:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2023-10-14T18:44:40.845 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2023-10-14T18:44:40.846 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-14T18:44:40.846 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-14T18:44:40.846 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-14T18:44:40.846 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-10-14T18:44:40.846 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-10-14T18:44:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-10-14T18:44:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: debug objectcacher = 20 2023-10-14T18:44:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: debug objecter = 20 2023-10-14T18:44:40.847 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2023-10-14T18:44:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: debug objectcacher = 20 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: debug objecter = 20 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-14T18:44:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2023-10-14T18:44:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2023-10-14T18:44:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2023-10-14T18:44:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2023-10-14T18:44:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-14T18:44:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-14T18:44:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-14T18:44:40.851 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-10-14T18:44:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-10-14T18:44:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T18:44:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-10-14T18:44:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-10-14T18:44:40.853 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.853 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-10-14T18:44:40.853 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.853 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-10-14T18:44:40.854 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-10-14T18:44:40.854 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.854 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-10-14T18:44:40.854 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-10-14T18:44:40.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.855 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T18:44:40.855 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-10-14T18:44:40.855 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.855 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T18:44:40.856 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T18:44:40.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.856 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-10-14T18:44:40.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.857 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-10-14T18:44:40.857 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-10-14T18:44:40.857 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-10-14T18:44:40.858 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-10-14T18:44:40.858 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-10-14T18:44:40.858 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-10-14T18:44:40.858 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-10-14T18:44:40.861 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T18:44:40.861 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T18:44:40.861 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-10-14T18:44:40.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.862 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T18:44:40.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.862 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-10-14T18:44:40.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.863 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-10-14T18:44:40.863 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.863 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-10-14T18:44:40.863 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-10-14T18:44:40.864 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-10-14T18:44:40.864 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.79,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-10-14T18:44:40.864 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2023-10-14T18:44:40.864 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 73e97ab7-e872-4b12-8e7a-6b299bb24b40 2023-10-14T18:44:40.864 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.865 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-10-14T18:44:40.865 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-10-14T18:44:40.865 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.865 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-10-14T18:44:40.865 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-10-14T18:44:40.866 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-10-14T18:44:40.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.866 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-10-14T18:44:40.866 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-10-14T18:44:40.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.867 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-10-14T18:44:40.867 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-10-14T18:44:40.867 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-10-14T18:44:40.867 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.868 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-10-14T18:44:40.868 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-10-14T18:44:40.868 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.868 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-10-14T18:44:40.869 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.869 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-10-14T18:44:40.869 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-10-14T18:44:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-10-14T18:44:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-10-14T18:44:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2023-10-14T18:44:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-10-14T18:44:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-10-14T18:44:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2023-10-14T18:44:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2023-10-14T18:44:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-14T18:44:40.872 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-10-14T18:44:40.873 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2023-10-14T18:44:40.873 INFO:teuthology.orchestra.run.smithi144.stdout: memstore device bytes = 200000000 2023-10-14T18:44:40.873 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T18:44:40.873 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-10-14T18:44:40.874 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-10-14T18:44:40.874 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 1.0 2023-10-14T18:44:40.874 INFO:teuthology.orchestra.run.smithi144.stdout: osd mon report interval = 5 2023-10-14T18:44:40.874 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = memstore 2023-10-14T18:44:40.874 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-10-14T18:44:40.875 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.875 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-10-14T18:44:40.875 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-14T18:44:40.875 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-10-14T18:44:40.875 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-14T18:44:40.876 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-14T18:44:40.876 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-14T18:44:40.876 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-14T18:44:40.876 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-10-14T18:44:40.876 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.877 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-10-14T18:44:40.877 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-14T18:44:40.877 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-10-14T18:44:40.877 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-10-14T18:44:40.877 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-10-14T18:44:40.878 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-10-14T18:44:40.878 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-10-14T18:44:40.878 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-10-14T18:44:40.879 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-10-14T18:44:40.879 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-10-14T18:44:40.879 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-10-14T18:44:40.879 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.879 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T18:44:40.880 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T18:44:40.880 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T18:44:40.880 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.880 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T18:44:40.881 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T18:44:40.881 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T18:44:40.881 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.881 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-10-14T18:44:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-10-14T18:44:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-10-14T18:44:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2023-10-14T18:44:40.882 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull ratio = 0.6 2023-10-14T18:44:40.883 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.7 2023-10-14T18:44:40.883 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.6 2023-10-14T18:44:40.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-14T18:44:40.883 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-10-14T18:44:40.883 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-10-14T18:44:40.884 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-10-14T18:44:40.884 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-10-14T18:44:40.884 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T18:44:40.884 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T18:44:40.884 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2023-10-14T18:44:40.885 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-14T18:44:40.885 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-14T18:44:40.885 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2023-10-14T18:44:40.885 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-10-14T18:44:40.885 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-10-14T18:44:40.886 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-10-14T18:44:40.886 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-10-14T18:44:40.886 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-10-14T18:44:40.886 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-10-14T18:44:40.886 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-10-14T18:44:40.887 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-10-14T18:44:40.887 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-10-14T18:44:40.887 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-10-14T18:44:40.887 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-14T18:44:40.887 INFO:teuthology.orchestra.run.smithi144.stdout: debug objectcacher = 20 2023-10-14T18:44:40.888 INFO:teuthology.orchestra.run.smithi144.stdout: debug objecter = 20 2023-10-14T18:44:40.888 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-10-14T18:44:40.888 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-10-14T18:44:40.889 INFO:teuthology.orchestra.run.smithi144.stdout: debug objectcacher = 20 2023-10-14T18:44:40.889 INFO:teuthology.orchestra.run.smithi144.stdout: debug objecter = 20 2023-10-14T18:44:40.889 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2023-10-14T18:44:40.889 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2023-10-14T18:44:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-10-14T18:44:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2023-10-14T18:44:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2023-10-14T18:44:40.890 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2023-10-14T18:44:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2023-10-14T18:44:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-10-14T18:44:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-10-14T18:44:40.891 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-10-14T18:44:40.892 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T18:44:40.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T18:44:40.943 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T18:44:40.944 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:40.944 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T18:44:40.959 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:40.959 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T18:44:41.014 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:44:41.014 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:41.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T18:44:41.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T18:44:41.088 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:41.088 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:41.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:44:41.143 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:41.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T18:44:41.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T18:44:41.177 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:41.178 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:41.232 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T18:44:41.233 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T18:44:41.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T18:44:41.280 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T18:44:41.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T18:44:41.336 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T18:44:41.339 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T18:44:41.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T18:44:41.386 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T18:44:41.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T18:44:41.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T18:44:41.500 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T18:44:41.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T18:44:41.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T18:44:41.575 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T18:44:41.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T18:44:41.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T18:44:41.689 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T18:44:41.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T18:44:41.715 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T18:44:41.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T18:44:41.754 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T18:44:41.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T18:44:41.844 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T18:44:41.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T18:44:41.895 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T18:44:41.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T18:44:41.985 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T18:44:41.997 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T18:44:41.998 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T18:44:41.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T18:44:42.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:42.023 INFO:tasks.ceph:role: osd.0 2023-10-14T18:44:42.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:44:42.023 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T18:44:42.093 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:42.094 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:42.094 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:42.094 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 2023-10-14T18:44:42.094 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:42.094 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:42.095 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:42.095 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:42.095 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:42.095 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:42.520 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-14T18:44:42.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-14T18:44:42.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T18:44:42.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T18:44:42.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T18:44:42.785 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:42.786 INFO:tasks.ceph:role: osd.1 2023-10-14T18:44:42.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:44:42.786 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T18:44:42.857 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:42.857 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:42.857 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:42.857 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 2023-10-14T18:44:42.858 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:42.858 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:42.858 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:42.858 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:42.858 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:42.859 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:43.289 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-14T18:44:43.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-14T18:44:43.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T18:44:43.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T18:44:43.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T18:44:43.484 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:43.484 INFO:tasks.ceph:role: osd.2 2023-10-14T18:44:43.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:44:43.485 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T18:44:43.556 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:43.557 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:43.557 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:43.557 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 2023-10-14T18:44:43.557 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:43.558 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:43.558 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:43.558 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:43.558 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:43.558 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:44.004 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-14T18:44:44.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-14T18:44:44.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T18:44:44.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T18:44:44.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T18:44:44.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:44.274 INFO:tasks.ceph:role: osd.3 2023-10-14T18:44:44.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:44:44.274 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T18:44:44.347 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:44.347 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:44.348 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:44.348 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 2023-10-14T18:44:44.348 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:44.349 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:44.349 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:44.349 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:44.350 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:44.350 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:44.792 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-14T18:44:44.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-14T18:44:44.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T18:44:44.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T18:44:44.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:45.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.076+0000 7f59e6252540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T18:44:45.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.076+0000 7f59e6252540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T18:44:45.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.076+0000 7f59e6252540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-14T18:44:45.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T18:44:45.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.190+0000 7fe55a00e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T18:44:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.190+0000 7fe55a00e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T18:44:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.191+0000 7fe55a00e540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-14T18:44:45.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T18:44:45.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:45.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.342+0000 7facd6f61540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T18:44:45.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.342+0000 7facd6f61540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T18:44:45.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.343+0000 7facd6f61540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-14T18:44:45.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T18:44:45.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.498+0000 7f1e9f1e9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T18:44:45.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.498+0000 7f1e9f1e9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T18:44:45.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:45.499+0000 7f1e9f1e9540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-14T18:44:45.505 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T18:44:45.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T18:44:45.600 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:45.601 INFO:tasks.ceph:role: osd.4 2023-10-14T18:44:45.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:44:45.601 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T18:44:45.676 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:45.677 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:45.677 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:45.677 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-14T18:44:45.677 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:45.677 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:45.678 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:45.678 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:45.678 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:45.678 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:46.101 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-14T18:44:46.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-14T18:44:46.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T18:44:46.283 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T18:44:46.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T18:44:46.383 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:46.383 INFO:tasks.ceph:role: osd.5 2023-10-14T18:44:46.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:44:46.384 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T18:44:46.455 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:46.455 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-14T18:44:46.456 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:46.456 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:46.456 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:46.457 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:46.457 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:46.457 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:46.881 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-14T18:44:46.882 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-14T18:44:46.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T18:44:46.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T18:44:47.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T18:44:47.089 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:47.089 INFO:tasks.ceph:role: osd.6 2023-10-14T18:44:47.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:44:47.090 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T18:44:47.160 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:47.161 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-14T18:44:47.161 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:47.162 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:47.162 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:47.162 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:47.162 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:47.609 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-14T18:44:47.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-14T18:44:47.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T18:44:47.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T18:44:47.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T18:44:47.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T18:44:47.847 INFO:tasks.ceph:role: osd.7 2023-10-14T18:44:47.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:44:47.848 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T18:44:47.919 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T18:44:47.920 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T18:44:47.920 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T18:44:47.920 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2023-10-14T18:44:47.920 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T18:44:47.920 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-10-14T18:44:47.921 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T18:44:47.921 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T18:44:47.921 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T18:44:47.921 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T18:44:48.365 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-10-14T18:44:48.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-10-14T18:44:48.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T18:44:48.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T18:44:48.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:48.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.674+0000 7f4aa8b69540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T18:44:48.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.675+0000 7f4aa8b69540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T18:44:48.676 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.675+0000 7f4aa8b69540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-14T18:44:48.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T18:44:48.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:48.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.791+0000 7fade32cc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T18:44:48.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.791+0000 7fade32cc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T18:44:48.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.792+0000 7fade32cc540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-14T18:44:48.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T18:44:48.862 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:48.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.942+0000 7f8827f89540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T18:44:48.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.942+0000 7f8827f89540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T18:44:48.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:48.942+0000 7f8827f89540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-14T18:44:48.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T18:44:49.016 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:49.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:49.095+0000 7f183a7b1540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T18:44:49.096 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:49.095+0000 7f183a7b1540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T18:44:49.097 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:49.096+0000 7f183a7b1540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-14T18:44:49.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T18:44:49.167 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T18:44:49.167 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T18:44:49.194 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T18:44:49.259 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T18:44:49.323 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T18:44:49.387 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T18:44:49.451 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T18:44:49.515 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T18:44:49.579 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T18:44:49.604 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T18:44:49.669 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T18:44:49.732 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T18:44:49.796 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.796 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T18:44:49.860 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T18:44:49.923 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:49.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T18:44:49.990 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:49.991 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T18:44:50.011 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:50.012 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T18:44:50.072 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:50.073 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T18:44:50.088 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:50.089 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T18:44:50.142 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T18:44:50.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T18:44:50.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T18:44:50.186 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2023-10-14T18:44:50.186 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw== 2023-10-14T18:44:50.186 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-14T18:44:50.186 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ== 2023-10-14T18:44:50.187 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-14T18:44:50.187 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA== 2023-10-14T18:44:50.187 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2023-10-14T18:44:50.187 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw== 2023-10-14T18:44:50.187 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2023-10-14T18:44:50.188 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q== 2023-10-14T18:44:50.188 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2023-10-14T18:44:50.188 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q== 2023-10-14T18:44:50.188 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2023-10-14T18:44:50.188 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A== 2023-10-14T18:44:50.189 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2023-10-14T18:44:50.189 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ== 2023-10-14T18:44:50.189 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-14T18:44:50.189 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w== 2023-10-14T18:44:50.189 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-10-14T18:44:50.190 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g== 2023-10-14T18:44:50.190 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2023-10-14T18:44:50.190 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw== 2023-10-14T18:44:50.190 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2023-10-14T18:44:50.190 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw== 2023-10-14T18:44:50.191 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2023-10-14T18:44:50.191 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA== 2023-10-14T18:44:50.191 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2023-10-14T18:44:50.191 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw== 2023-10-14T18:44:50.191 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-10-14T18:44:50.192 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg== 2023-10-14T18:44:50.192 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2023-10-14T18:44:50.192 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ== 2023-10-14T18:44:50.192 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2023-10-14T18:44:50.192 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg== 2023-10-14T18:44:50.193 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2023-10-14T18:44:50.193 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw== 2023-10-14T18:44:50.205 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2023-10-14T18:44:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw== 2023-10-14T18:44:50.205 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-10-14T18:44:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ== 2023-10-14T18:44:50.206 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-10-14T18:44:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA== 2023-10-14T18:44:50.206 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2023-10-14T18:44:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw== 2023-10-14T18:44:50.207 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2023-10-14T18:44:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q== 2023-10-14T18:44:50.207 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2023-10-14T18:44:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q== 2023-10-14T18:44:50.207 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A== 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ== 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w== 2023-10-14T18:44:50.208 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-10-14T18:44:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g== 2023-10-14T18:44:50.209 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2023-10-14T18:44:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw== 2023-10-14T18:44:50.209 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2023-10-14T18:44:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw== 2023-10-14T18:44:50.210 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2023-10-14T18:44:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA== 2023-10-14T18:44:50.210 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2023-10-14T18:44:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw== 2023-10-14T18:44:50.210 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-10-14T18:44:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg== 2023-10-14T18:44:50.211 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2023-10-14T18:44:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ== 2023-10-14T18:44:50.211 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2023-10-14T18:44:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg== 2023-10-14T18:44:50.212 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2023-10-14T18:44:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw== 2023-10-14T18:44:50.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T18:44:50.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T18:44:50.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:50.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:50.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:50.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:50.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.829 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:50.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T18:44:50.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T18:44:51.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:51.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:51.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:51.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T18:44:51.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T18:44:51.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.806 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T18:44:51.868 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T18:44:51.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T18:44:51.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T18:44:51.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T18:44:52.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T18:44:52.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T18:44:52.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T18:44:52.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T18:44:52.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T18:44:52.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T18:44:52.327 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:52.330 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T18:44:52.381 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T18:44:52.382 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T18:44:52.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T18:44:52.385 INFO:tasks.ceph.mon.a:Started 2023-10-14T18:44:52.385 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T18:44:52.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T18:44:52.424 INFO:tasks.ceph.mon.b:Started 2023-10-14T18:44:52.424 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T18:44:52.425 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T18:44:52.426 INFO:tasks.ceph.mon.c:Started 2023-10-14T18:44:52.427 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T18:44:52.427 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T18:44:52.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T18:44:52.430 INFO:tasks.ceph.mgr.y:Started 2023-10-14T18:44:52.431 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T18:44:52.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T18:44:52.434 INFO:tasks.ceph.mgr.x:Started 2023-10-14T18:44:52.434 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T18:44:52.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T18:44:52.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.551+0000 7f84077f7700 1 Processor -- start 2023-10-14T18:44:52.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.551+0000 7f84077f7700 1 -- start start 2023-10-14T18:44:52.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f84077f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f84000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f84077f7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f84077f7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000b0790 con 0x7f840015a290 2023-10-14T18:44:52.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f84077f7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000ce1f0 con 0x7f840006acb0 2023-10-14T18:44:52.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f84077f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b0b20 con 0x7f8400159ec0 2023-10-14T18:44:52.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50202/0 (socket says 172.21.15.79:50202) 2023-10-14T18:44:52.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 learned_addr learned my addr 172.21.15.79:0/4228676608 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:44:52.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405593700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f84000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 msgr2=0x7f84000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T18:44:52.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 msgr2=0x7f84000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T18:44:52.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T18:44:52.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T18:44:52.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405593700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 msgr2=0x7f84000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T18:44:52.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405593700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 msgr2=0x7f84000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T18:44:52.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405593700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f84000af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-14T18:44:52.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.552+0000 7f8405593700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f84000af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T18:44:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521142282 0 0) 0x7f84000b0790 con 0x7f840015a290 2023-10-14T18:44:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec003570 con 0x7f840015a290 2023-10-14T18:44:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506323359 0 0) 0x7f83ec003570 con 0x7f840015a290 2023-10-14T18:44:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 msgr2=0x7f84000af940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T18:44:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f84000af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 msgr2=0x7f84000afe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T18:44:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 --2- 172.21.15.79:0/4228676608 >> v2:172.21.15.79:3300/0 conn(0x7f840006acb0 0x7f84000afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000b04b0 con 0x7f840015a290 2023-10-14T18:44:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.1 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f83f0001470 con 0x7f840015a290 2023-10-14T18:44:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 >> v1:172.21.15.144:6789/0 conn(0x7f840015a290 legacy=0x7f840006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83ec003ae0 0x7f83ec003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f83ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ec004d50 0x7f83ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000ce1f0 con 0x7f83ec004d50 2023-10-14T18:44:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b0b20 con 0x7f83ec003ae0 2023-10-14T18:44:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec00bcc0 con 0x7f8400159ec0 2023-10-14T18:44:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ec004d50 0x7f83ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f8404d92700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f83ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.737+0000 7f8405593700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83ec003ae0 0x7f83ec003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 msgr2=0x7f83ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f83ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83ec003ae0 msgr2=0x7f83ec003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83ec003ae0 0x7f83ec003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec003570 con 0x7f83ec004d50 2023-10-14T18:44:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8404d92700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8400159ec0 0x7f83ec004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:44:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f8405d94700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ec004d50 0x7f83ec0051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f840006b0b0 tx=0x7f83f80091c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723bc8889ce78e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80097c0 con 0x7f83ec004d50 2023-10-14T18:44:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800f040 con 0x7f83ec004d50 2023-10-14T18:44:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.738+0000 7f83f7fff700 1 -- 172.21.15.79:0/4228676608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8007d50 con 0x7f83ec004d50 2023-10-14T18:44:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 -- 172.21.15.79:0/4228676608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ec004d50 msgr2=0x7f83ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 --2- 172.21.15.79:0/4228676608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83ec004d50 0x7f83ec0051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f840006b0b0 tx=0x7f83f80091c0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f8405d94700 1 -- 172.21.15.79:0/4228676608 reap_dead start 2023-10-14T18:44:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 -- 172.21.15.79:0/4228676608 shutdown_connections 2023-10-14T18:44:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 -- 172.21.15.79:0/4228676608 >> 172.21.15.79:0/4228676608 conn(0x7f84000d1880 msgr2=0x7f84000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:52.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 -- 172.21.15.79:0/4228676608 shutdown_connections 2023-10-14T18:44:52.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.739+0000 7f84077f7700 1 -- 172.21.15.79:0/4228676608 wait complete. 2023-10-14T18:44:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.740+0000 7f84077f7700 1 Processor -- start 2023-10-14T18:44:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.740+0000 7f84077f7700 1 -- start start 2023-10-14T18:44:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83ec004d50 0x7f84000caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8400154ad0 0x7f8400151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c8ba0 con 0x7f8400156870 2023-10-14T18:44:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c7f90 con 0x7f8400154ad0 2023-10-14T18:44:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f84077f7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c8270 con 0x7f83ec004d50 2023-10-14T18:44:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f8405d94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f8405593700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83ec004d50 0x7f84000caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f8405d94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50222/0 (socket says 172.21.15.79:50222) 2023-10-14T18:44:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f8405d94700 1 -- 172.21.15.79:0/4209960422 learned_addr learned my addr 172.21.15.79:0/4209960422 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:44:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.741+0000 7f8404d92700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8400154ad0 0x7f8400151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 -- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83ec004d50 msgr2=0x7f84000caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83ec004d50 0x7f84000caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 -- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8400154ad0 msgr2=0x7f8400151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8400154ad0 0x7f8400151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 -- 172.21.15.79:0/4209960422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000c8550 con 0x7f8400156870 2023-10-14T18:44:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.742+0000 7f8405d94700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84000cbc50 tx=0x7f83f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.743+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8007ea0 con 0x7f8400156870 2023-10-14T18:44:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.743+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000c8830 con 0x7f8400156870 2023-10-14T18:44:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.743+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8021070 con 0x7f8400156870 2023-10-14T18:44:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.743+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8400152130 con 0x7f8400156870 2023-10-14T18:44:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.743+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8007170 con 0x7f8400156870 2023-10-14T18:44:52.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.744+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f83f8028690 con 0x7f8400156870 2023-10-14T18:44:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.744+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f83f8023070 con 0x7f8400156870 2023-10-14T18:44:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.744+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e00052b0 con 0x7f8400156870 2023-10-14T18:44:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.748+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f83f802d020 con 0x7f8400156870 2023-10-14T18:44:52.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.823+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f83e0005830 con 0x7f8400156870 2023-10-14T18:44:52.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.826+0000 7f83f57fa700 1 -- 172.21.15.79:0/4209960422 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f83f8009720 con 0x7f8400156870 2023-10-14T18:44:52.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 msgr2=0x7f8400156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:52.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84000cbc50 tx=0x7f83f8018000 comp rx=0 tx=0).stop 2023-10-14T18:44:52.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 shutdown_connections 2023-10-14T18:44:52.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8400156870 0x7f8400156cc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83ec004d50 0x7f84000caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 --2- 172.21.15.79:0/4209960422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8400154ad0 0x7f8400151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:52.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 >> 172.21.15.79:0/4209960422 conn(0x7f84000d1880 msgr2=0x7f84000cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:52.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 shutdown_connections 2023-10-14T18:44:52.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:52.827+0000 7f84077f7700 1 -- 172.21.15.79:0/4209960422 wait complete. 2023-10-14T18:44:52.831 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2023-10-14T18:44:52.840 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T18:44:52.840 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:52.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T18:44:52.865 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:52.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T18:44:52.930 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:52.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T18:44:52.996 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-14T18:44:52.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T18:44:53.061 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:53.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T18:44:53.086 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:53.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T18:44:53.150 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:53.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T18:44:53.214 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-14T18:44:53.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T18:44:53.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-14T18:44:53.435 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.434+0000 7f5f1fee8700 1 Processor -- start 2023-10-14T18:44:53.435 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.434+0000 7f5f1fee8700 1 -- start start 2023-10-14T18:44:53.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1fee8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f18157cc0 0x7f5f180b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1fee8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f180afb50 con 0x7f5f180ca9e0 2023-10-14T18:44:53.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1fee8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f180afe30 con 0x7f5f18069f80 2023-10-14T18:44:53.438 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1fee8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180b0110 con 0x7f5f18157cc0 2023-10-14T18:44:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1e485700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5f18069f80 0x7f5f180c90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37206/0 (socket says 172.21.15.144:37206) 2023-10-14T18:44:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1e485700 1 -- 172.21.15.144:0/2602659474 learned_addr learned my addr 172.21.15.144:0/2602659474 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-14T18:44:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.435+0000 7f5f1dc84700 1 --2- 172.21.15.144:0/2602659474 >> v2:172.21.15.79:3300/0 conn(0x7f5f18157cc0 0x7f5f180b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913868559 0 0) 0x7f5f180afe30 con 0x7f5f18069f80 2023-10-14T18:44:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f04003570 con 0x7f5f18069f80 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611822623 0 0) 0x7f5f180afb50 con 0x7f5f180ca9e0 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f180afe30 con 0x7f5f180ca9e0 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1dc84700 1 -- 172.21.15.144:0/2602659474 >> v1:172.21.15.144:6789/0 conn(0x7f5f18069f80 legacy=0x7f5f180c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1dc84700 1 -- 172.21.15.144:0/2602659474 >> v1:172.21.15.79:6789/0 conn(0x7f5f180ca9e0 legacy=0x7f5f18069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1dc84700 1 -- 172.21.15.144:0/2602659474 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180b03f0 con 0x7f5f18157cc0 2023-10-14T18:44:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1dc84700 1 --2- 172.21.15.144:0/2602659474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f18157cc0 0x7f5f180b0bf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098e0 tx=0x7f5f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca28e1b2db533699 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08011630 con 0x7f5f18157cc0 2023-10-14T18:44:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08011790 con 0x7f5f18157cc0 2023-10-14T18:44:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.436+0000 7f5f1cc82700 1 -- 172.21.15.144:0/2602659474 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08011b30 con 0x7f5f18157cc0 2023-10-14T18:44:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 -- 172.21.15.144:0/2602659474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f18157cc0 msgr2=0x7f5f180b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/2602659474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f18157cc0 0x7f5f180b0bf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098e0 tx=0x7f5f080091a0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 -- 172.21.15.144:0/2602659474 shutdown_connections 2023-10-14T18:44:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/2602659474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f18157cc0 0x7f5f180b0bf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 -- 172.21.15.144:0/2602659474 >> 172.21.15.144:0/2602659474 conn(0x7f5f180cb5c0 msgr2=0x7f5f180cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 -- 172.21.15.144:0/2602659474 shutdown_connections 2023-10-14T18:44:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.437+0000 7f5f1fee8700 1 -- 172.21.15.144:0/2602659474 wait complete. 2023-10-14T18:44:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.438+0000 7f5f1fee8700 1 Processor -- start 2023-10-14T18:44:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.438+0000 7f5f1fee8700 1 -- start start 2023-10-14T18:44:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f180ca9e0 0x7f5f180c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 0x7f5f180c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c5490 con 0x7f5f180ca9e0 2023-10-14T18:44:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18158b60 con 0x7f5f18069f80 2023-10-14T18:44:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1fee8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18158230 con 0x7f5f18157cc0 2023-10-14T18:44:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1e485700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 0x7f5f180c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51072/0 (socket says 172.21.15.144:51072) 2023-10-14T18:44:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 -- 172.21.15.144:0/3945466908 learned_addr learned my addr 172.21.15.144:0/3945466908 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1d483700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f180ca9e0 0x7f5f180c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 -- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 msgr2=0x7f5f180c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 0x7f5f180c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 -- 172.21.15.144:0/3945466908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f180ca9e0 msgr2=0x7f5f180c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f180ca9e0 0x7f5f180c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1dc84700 1 -- 172.21.15.144:0/3945466908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009420 con 0x7f5f18069f80 2023-10-14T18:44:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.439+0000 7f5f1e485700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 0x7f5f180c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f1dc84700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806f210 tx=0x7f5f08017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0801f070 con 0x7f5f18069f80 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08000bc0 con 0x7f5f18069f80 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f18158510 con 0x7f5f18069f80 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08025420 con 0x7f5f18069f80 2023-10-14T18:44:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f181566e0 con 0x7f5f18069f80 2023-10-14T18:44:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5f08023070 con 0x7f5f18069f80 2023-10-14T18:44:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.440+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5f0802f440 con 0x7f5f18069f80 2023-10-14T18:44:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.441+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f181589b0 con 0x7f5f18069f80 2023-10-14T18:44:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.443+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5f0802a070 con 0x7f5f18069f80 2023-10-14T18:44:53.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.525+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f5f1804c3c0 con 0x7f5f18069f80 2023-10-14T18:44:53.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.528+0000 7f5f0dffb700 1 -- 172.21.15.144:0/3945466908 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f08015020 con 0x7f5f18069f80 2023-10-14T18:44:53.529 INFO:teuthology.orchestra.run.smithi144.stdout:0 2023-10-14T18:44:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 msgr2=0x7f5f180c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5f1806f210 tx=0x7f5f08017000 comp rx=0 tx=0).stop 2023-10-14T18:44:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 shutdown_connections 2023-10-14T18:44:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f18157cc0 0x7f5f180c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18069f80 0x7f5f180c9d00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 --2- 172.21.15.144:0/3945466908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f180ca9e0 0x7f5f180c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 >> 172.21.15.144:0/3945466908 conn(0x7f5f180cb5c0 msgr2=0x7f5f180b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 shutdown_connections 2023-10-14T18:44:53.532 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.529+0000 7f5f1fee8700 1 -- 172.21.15.144:0/3945466908 wait complete. 2023-10-14T18:44:53.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-14T18:44:53.658 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.657+0000 7f9d09930700 1 Processor -- start 2023-10-14T18:44:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.657+0000 7f9d09930700 1 -- start start 2023-10-14T18:44:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d09930700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d040cb280 0x7f9d04156530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.661 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d09930700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 0x7f9d040c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d09930700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040cc440 con 0x7f9d04156160 2023-10-14T18:44:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d09930700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040c31a0 con 0x7f9d040cb280 2023-10-14T18:44:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d09930700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c7bb0 con 0x7f9d040c71d0 2023-10-14T18:44:53.662 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 0x7f9d040c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d02ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d04156160 0x7f9d040c2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37222/0 (socket says 172.21.15.144:37222) 2023-10-14T18:44:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d02ffd700 1 -- 172.21.15.144:0/2455262217 learned_addr learned my addr 172.21.15.144:0/2455262217 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-14T18:44:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d027fc700 1 --2- 172.21.15.144:0/2455262217 >> v2:172.21.15.79:3300/0 conn(0x7f9d040cb280 0x7f9d04156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d037fe700 1 -- 172.21.15.144:0/2455262217 >> v2:172.21.15.79:3300/0 conn(0x7f9d040cb280 msgr2=0x7f9d04156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:53.663 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d037fe700 1 --2- 172.21.15.144:0/2455262217 >> v2:172.21.15.79:3300/0 conn(0x7f9d040cb280 0x7f9d04156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d037fe700 1 -- 172.21.15.144:0/2455262217 >> v1:172.21.15.144:6789/0 conn(0x7f9d04156160 legacy=0x7f9d040c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d01ffb700 1 -- 172.21.15.144:0/2455262217 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757812000 0 0) 0x7f9d040cc440 con 0x7f9d04156160 2023-10-14T18:44:53.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.658+0000 7f9d037fe700 1 -- 172.21.15.144:0/2455262217 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040cb830 con 0x7f9d040c71d0 2023-10-14T18:44:53.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d037fe700 1 --2- 172.21.15.144:0/2455262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 0x7f9d040c7670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009e90 tx=0x7f9cfc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b2ac31d1c3697ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.664 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d01ffb700 1 -- 172.21.15.144:0/2455262217 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00bbf0 con 0x7f9d040c71d0 2023-10-14T18:44:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d01ffb700 1 -- 172.21.15.144:0/2455262217 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc00bd50 con 0x7f9d040c71d0 2023-10-14T18:44:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d01ffb700 1 -- 172.21.15.144:0/2455262217 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc011650 con 0x7f9d040c71d0 2023-10-14T18:44:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 -- 172.21.15.144:0/2455262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 msgr2=0x7f9d040c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 --2- 172.21.15.144:0/2455262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 0x7f9d040c7670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009e90 tx=0x7f9cfc009780 comp rx=0 tx=0).stop 2023-10-14T18:44:53.665 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 -- 172.21.15.144:0/2455262217 shutdown_connections 2023-10-14T18:44:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 --2- 172.21.15.144:0/2455262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d040c71d0 0x7f9d040c7670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 --2- 172.21.15.144:0/2455262217 >> v2:172.21.15.79:3300/0 conn(0x7f9d040cb280 0x7f9d04156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 -- 172.21.15.144:0/2455262217 >> 172.21.15.144:0/2455262217 conn(0x7f9d04067660 msgr2=0x7f9d04067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 -- 172.21.15.144:0/2455262217 shutdown_connections 2023-10-14T18:44:53.666 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.659+0000 7f9d09930700 1 -- 172.21.15.144:0/2455262217 wait complete. 2023-10-14T18:44:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 Processor -- start 2023-10-14T18:44:53.667 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 -- start start 2023-10-14T18:44:53.669 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d040c71d0 0x7f9d040ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 0x7f9d040ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04166880 con 0x7f9d040c71d0 2023-10-14T18:44:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040ae1d0 con 0x7f9d040cb280 2023-10-14T18:44:53.670 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.661+0000 7f9d09930700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04166af0 con 0x7f9d04156160 2023-10-14T18:44:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:47688/0 (socket says 172.21.15.144:47688) 2023-10-14T18:44:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 0x7f9d040ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 -- 172.21.15.144:0/2181724535 learned_addr learned my addr 172.21.15.144:0/2181724535 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:53.671 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d02ffd700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d040c71d0 0x7f9d040ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 -- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 msgr2=0x7f9d040ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 0x7f9d040ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 -- 172.21.15.144:0/2181724535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d040c71d0 msgr2=0x7f9d040ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d040c71d0 0x7f9d040ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.672 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 -- 172.21.15.144:0/2181724535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009a20 con 0x7f9d04156160 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d027fc700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 0x7f9d040ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d037fe700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc011780 tx=0x7f9cfc01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00bbf0 con 0x7f9d04156160 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc020040 con 0x7f9d04156160 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc01add0 con 0x7f9d04156160 2023-10-14T18:44:53.673 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d04166dd0 con 0x7f9d04156160 2023-10-14T18:44:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d040ae4b0 con 0x7f9d04156160 2023-10-14T18:44:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9cfc024600 con 0x7f9d04156160 2023-10-14T18:44:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.662+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f9cfc02e820 con 0x7f9d04156160 2023-10-14T18:44:53.674 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.663+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0404c3c0 con 0x7f9d04156160 2023-10-14T18:44:53.675 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.665+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9cfc015070 con 0x7f9d04156160 2023-10-14T18:44:53.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.749+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f9d040cbb10 con 0x7f9d04156160 2023-10-14T18:44:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.752+0000 7f9ceaffd700 1 -- 172.21.15.144:0/2181724535 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9cfc024a90 con 0x7f9d04156160 2023-10-14T18:44:53.753 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:44:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 msgr2=0x7f9d041656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc011780 tx=0x7f9cfc01a000 comp rx=0 tx=0).stop 2023-10-14T18:44:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 shutdown_connections 2023-10-14T18:44:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d04156160 0x7f9d041656b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d040c71d0 0x7f9d040ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 --2- 172.21.15.144:0/2181724535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d040cb280 0x7f9d040ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 >> 172.21.15.144:0/2181724535 conn(0x7f9d04067660 msgr2=0x7f9d040c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 shutdown_connections 2023-10-14T18:44:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.753+0000 7f9d09930700 1 -- 172.21.15.144:0/2181724535 wait complete. 2023-10-14T18:44:53.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-14T18:44:53.883 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.882+0000 7f6575f03700 1 Processor -- start 2023-10-14T18:44:53.884 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.882+0000 7f6575f03700 1 -- start start 2023-10-14T18:44:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f6575f03700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6570159ec0 0x7f65700af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f6575f03700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700b0790 con 0x7f657006acb0 2023-10-14T18:44:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f6575f03700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700ce1f0 con 0x7f657015a290 2023-10-14T18:44:53.886 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f6575f03700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700b0b20 con 0x7f6570159ec0 2023-10-14T18:44:53.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f656f7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6570159ec0 0x7f65700af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f656effd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f657015a290 0x7f657006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37230/0 (socket says 172.21.15.144:37230) 2023-10-14T18:44:53.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.883+0000 7f656effd700 1 -- 172.21.15.144:0/4149434755 learned_addr learned my addr 172.21.15.144:0/4149434755 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-14T18:44:53.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656f7fe700 1 -- 172.21.15.144:0/4149434755 >> v1:172.21.15.144:6789/0 conn(0x7f657015a290 legacy=0x7f657006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.887 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656f7fe700 1 -- 172.21.15.144:0/4149434755 >> v1:172.21.15.79:6789/0 conn(0x7f657006acb0 legacy=0x7f65700cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656f7fe700 1 -- 172.21.15.144:0/4149434755 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700b04b0 con 0x7f6570159ec0 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656e7fc700 1 -- 172.21.15.144:0/4149434755 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624240233 0 0) 0x7f65700ce1f0 con 0x7f657015a290 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656f7fe700 1 --2- 172.21.15.144:0/4149434755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6570159ec0 0x7f65700af940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6560009e60 tx=0x7f6560009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43240c235aa2b695 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656e7fc700 1 -- 172.21.15.144:0/4149434755 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656000e070 con 0x7f6570159ec0 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656e7fc700 1 -- 172.21.15.144:0/4149434755 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656000bc30 con 0x7f6570159ec0 2023-10-14T18:44:53.888 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.884+0000 7f656e7fc700 1 -- 172.21.15.144:0/4149434755 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560012430 con 0x7f6570159ec0 2023-10-14T18:44:53.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 -- 172.21.15.144:0/4149434755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6570159ec0 msgr2=0x7f65700af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 --2- 172.21.15.144:0/4149434755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6570159ec0 0x7f65700af940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6560009e60 tx=0x7f6560009780 comp rx=0 tx=0).stop 2023-10-14T18:44:53.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 -- 172.21.15.144:0/4149434755 shutdown_connections 2023-10-14T18:44:53.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 --2- 172.21.15.144:0/4149434755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6570159ec0 0x7f65700af940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.889 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 -- 172.21.15.144:0/4149434755 >> 172.21.15.144:0/4149434755 conn(0x7f65700d1880 msgr2=0x7f65700cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 -- 172.21.15.144:0/4149434755 shutdown_connections 2023-10-14T18:44:53.890 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.885+0000 7f6575f03700 1 -- 172.21.15.144:0/4149434755 wait complete. 2023-10-14T18:44:53.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.886+0000 7f6575f03700 1 Processor -- start 2023-10-14T18:44:53.892 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.886+0000 7f6575f03700 1 -- start start 2023-10-14T18:44:53.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6570159ec0 0x7f657015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:53.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701596d0 con 0x7f6570159ec0 2023-10-14T18:44:53.893 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65700cb570 con 0x7f657015a290 2023-10-14T18:44:53.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700c83a0 con 0x7f657006acb0 2023-10-14T18:44:53.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.894 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51108/0 (socket says 172.21.15.144:51108) 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:47694/0 (socket says 172.21.15.144:47694) 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 -- 172.21.15.144:0/3628831842 learned_addr learned my addr 172.21.15.144:0/3628831842 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656effd700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6570159ec0 0x7f657015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 -- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 msgr2=0x7f65700c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.895 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 -- 172.21.15.144:0/3628831842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6570159ec0 msgr2=0x7f657015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6570159ec0 0x7f657015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 -- 172.21.15.144:0/3628831842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009a20 con 0x7f657015a290 2023-10-14T18:44:53.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656f7fe700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:53.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f656ffff700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f656800c560 tx=0x7f6568007e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:53.896 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800ce50 con 0x7f657015a290 2023-10-14T18:44:53.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568011590 con 0x7f657015a290 2023-10-14T18:44:53.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568011930 con 0x7f657015a290 2023-10-14T18:44:53.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.887+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6570157160 con 0x7f657015a290 2023-10-14T18:44:53.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.888+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6570156b10 con 0x7f657015a290 2023-10-14T18:44:53.897 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.888+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f656801c440 con 0x7f657015a290 2023-10-14T18:44:53.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.888+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6568012850 con 0x7f657015a290 2023-10-14T18:44:53.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.888+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657004c3c0 con 0x7f657015a290 2023-10-14T18:44:53.898 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.890+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6568017070 con 0x7f657015a290 2023-10-14T18:44:53.898 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:53.892+0000 7f525cbeb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T18:44:53.927 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:53.926+0000 7f49c72ed180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T18:44:53.973 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.973+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f65700ceab0 con 0x7f657015a290 2023-10-14T18:44:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.976+0000 7f65677fe700 1 -- 172.21.15.144:0/3628831842 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6568012420 con 0x7f657015a290 2023-10-14T18:44:53.978 INFO:teuthology.orchestra.run.smithi144.stdout:2 2023-10-14T18:44:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 msgr2=0x7f6570155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f656800c560 tx=0x7f6568007e90 comp rx=0 tx=0).stop 2023-10-14T18:44:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 shutdown_connections 2023-10-14T18:44:53.979 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657015a290 0x7f6570155290 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657006acb0 0x7f65700c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 --2- 172.21.15.144:0/3628831842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6570159ec0 0x7f657015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 >> 172.21.15.144:0/3628831842 conn(0x7f65700d1880 msgr2=0x7f65700c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 shutdown_connections 2023-10-14T18:44:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:53.977+0000 7f6575f03700 1 -- 172.21.15.144:0/3628831842 wait complete. 2023-10-14T18:44:53.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-14T18:44:54.023 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.023+0000 7f525cbeb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T18:44:54.066 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.065+0000 7f49c72ed180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T18:44:54.099 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.098+0000 7f525cbeb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T18:44:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.104+0000 7f6b446cb700 1 Processor -- start 2023-10-14T18:44:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.104+0000 7f6b446cb700 1 -- start start 2023-10-14T18:44:54.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.105+0000 7f6b446cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 0x7f6b3c0b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.105+0000 7f6b446cb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3c0b4c30 0x7f6b3c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.108 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.105+0000 7f6b446cb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c0b14f0 con 0x7f6b3c159fd0 2023-10-14T18:44:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.105+0000 7f6b446cb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c0b17d0 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.105+0000 7f6b446cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0b1ab0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3c0b4c30 0x7f6b3c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.109 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3c0b4c30 0x7f6b3c159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51114/0 (socket says 172.21.15.144:51114) 2023-10-14T18:44:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b42c68700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b3c159fd0 0x7f6b3c0cfe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37244/0 (socket says 172.21.15.144:37244) 2023-10-14T18:44:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 -- 172.21.15.144:0/16213789 learned_addr learned my addr 172.21.15.144:0/16213789 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b42467700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 0x7f6b3c0b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 -- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 msgr2=0x7f6b3c0b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:54.110 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 0x7f6b3c0b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 -- 172.21.15.144:0/16213789 >> v1:172.21.15.144:6789/0 conn(0x7f6b3c159fd0 legacy=0x7f6b3c0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 -- 172.21.15.144:0/16213789 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0b1d90 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41465700 1 -- 172.21.15.144:0/16213789 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732776725 0 0) 0x7f6b3c0b14f0 con 0x7f6b3c159fd0 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b42467700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 0x7f6b3c0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41c66700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c159a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b380099b0 tx=0x7f6b38009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f9823d8dc54c690 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.111 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41465700 1 -- 172.21.15.144:0/16213789 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38009ea0 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41465700 1 -- 172.21.15.144:0/16213789 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800b8f0 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.106+0000 7f6b41465700 1 -- 172.21.15.144:0/16213789 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800bc90 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 -- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4c30 msgr2=0x7f6b3c159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c159a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b380099b0 tx=0x7f6b38009250 comp rx=0 tx=0).stop 2023-10-14T18:44:54.112 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 -- 172.21.15.144:0/16213789 shutdown_connections 2023-10-14T18:44:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c0b4860 0x7f6b3c0b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 --2- 172.21.15.144:0/16213789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c159a90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 -- 172.21.15.144:0/16213789 >> 172.21.15.144:0/16213789 conn(0x7f6b3c09a0f0 msgr2=0x7f6b3c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 -- 172.21.15.144:0/16213789 shutdown_connections 2023-10-14T18:44:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.107+0000 7f6b446cb700 1 -- 172.21.15.144:0/16213789 wait complete. 2023-10-14T18:44:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.108+0000 7f6b446cb700 1 Processor -- start 2023-10-14T18:44:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.108+0000 7f6b446cb700 1 -- start start 2023-10-14T18:44:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 0x7f6b3c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c14daf0 con 0x7f6b3c0b4c30 2023-10-14T18:44:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c150740 con 0x7f6b3c0b4860 2023-10-14T18:44:54.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0d1c50 con 0x7f6b3c159fd0 2023-10-14T18:44:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42c68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 0x7f6b3c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51126/0 (socket says 172.21.15.144:51126) 2023-10-14T18:44:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 -- 172.21.15.144:0/1086072602 learned_addr learned my addr 172.21.15.144:0/1086072602 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b41c66700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 -- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 msgr2=0x7f6b3c151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 0x7f6b3c151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 -- 172.21.15.144:0/1086072602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 msgr2=0x7f6b3c156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 -- 172.21.15.144:0/1086072602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300093c0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b41c66700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:44:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42c68700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 0x7f6b3c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b42467700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000ec80 tx=0x7f6b30009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30005a00 con 0x7f6b3c0b4860 2023-10-14T18:44:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30005b60 con 0x7f6b3c0b4860 2023-10-14T18:44:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b380094f0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.109+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000c920 con 0x7f6b3c0b4860 2023-10-14T18:44:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.110+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c14fea0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.110+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6b30006030 con 0x7f6b3c0b4860 2023-10-14T18:44:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.110+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f6b30013910 con 0x7f6b3c0b4860 2023-10-14T18:44:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.110+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c15cfb0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.112+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6b3003a6d0 con 0x7f6b3c0b4860 2023-10-14T18:44:54.145 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.145+0000 7f49c72ed180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T18:44:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.195+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f6b3c15b380 con 0x7f6b3c0b4860 2023-10-14T18:44:54.199 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.199+0000 7f6b2e7fc700 1 -- 172.21.15.144:0/1086072602 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b30029030 con 0x7f6b3c0b4860 2023-10-14T18:44:54.200 INFO:teuthology.orchestra.run.smithi144.stdout:3 2023-10-14T18:44:54.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 msgr2=0x7f6b3c0d1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000ec80 tx=0x7f6b30009120 comp rx=0 tx=0).stop 2023-10-14T18:44:54.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 shutdown_connections 2023-10-14T18:44:54.201 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b3c159fd0 0x7f6b3c151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3c0b4860 0x7f6b3c0d1710 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 --2- 172.21.15.144:0/1086072602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b3c0b4c30 0x7f6b3c156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 >> 172.21.15.144:0/1086072602 conn(0x7f6b3c09a0f0 msgr2=0x7f6b3c14f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 shutdown_connections 2023-10-14T18:44:54.202 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.200+0000 7f6b446cb700 1 -- 172.21.15.144:0/1086072602 wait complete. 2023-10-14T18:44:54.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-14T18:44:54.283 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.282+0000 7f525cbeb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T18:44:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.328+0000 7f4a2b23c700 1 Processor -- start 2023-10-14T18:44:54.329 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.328+0000 7f4a2b23c700 1 -- start start 2023-10-14T18:44:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a2b23c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 0x7f4a240b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.332 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a2b23c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a240b3570 0x7f4a2415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a2b23c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240b14f0 con 0x7f4a240b4c30 2023-10-14T18:44:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a2b23c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240b17d0 con 0x7f4a240b4860 2023-10-14T18:44:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a2b23c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a240b1ab0 con 0x7f4a240b3570 2023-10-14T18:44:54.333 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a297d9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a240b3570 0x7f4a2415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a297d9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a240b3570 0x7f4a2415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51142/0 (socket says 172.21.15.144:51142) 2023-10-14T18:44:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a297d9700 1 -- 172.21.15.144:0/833576253 learned_addr learned my addr 172.21.15.144:0/833576253 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.329+0000 7f4a28fd8700 1 --2- 172.21.15.144:0/833576253 >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 0x7f4a240b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a297d9700 1 -- 172.21.15.144:0/833576253 >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 msgr2=0x7f4a240b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:54.334 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a297d9700 1 --2- 172.21.15.144:0/833576253 >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 0x7f4a240b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a297d9700 1 -- 172.21.15.144:0/833576253 >> v1:172.21.15.79:6789/0 conn(0x7f4a240b4c30 legacy=0x7f4a24159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a297d9700 1 -- 172.21.15.144:0/833576253 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a240b1d90 con 0x7f4a240b3570 2023-10-14T18:44:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a28fd8700 1 --2- 172.21.15.144:0/833576253 >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 0x7f4a240b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:44:54.335 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a297d9700 1 --2- 172.21.15.144:0/833576253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b3570 0x7f4a2415a1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a240b0460 tx=0x7f4a1c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7db3342b09a9217 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a237fe700 1 -- 172.21.15.144:0/833576253 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00e070 con 0x7f4a240b3570 2023-10-14T18:44:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a237fe700 1 -- 172.21.15.144:0/833576253 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00bae0 con 0x7f4a240b3570 2023-10-14T18:44:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.330+0000 7f4a237fe700 1 -- 172.21.15.144:0/833576253 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0092e0 con 0x7f4a240b3570 2023-10-14T18:44:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 -- 172.21.15.144:0/833576253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b3570 msgr2=0x7f4a2415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.336 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/833576253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b3570 0x7f4a2415a1a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a240b0460 tx=0x7f4a1c009840 comp rx=0 tx=0).stop 2023-10-14T18:44:54.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 -- 172.21.15.144:0/833576253 shutdown_connections 2023-10-14T18:44:54.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/833576253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b3570 0x7f4a2415a1a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/833576253 >> v2:172.21.15.79:3300/0 conn(0x7f4a240b4860 0x7f4a240b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.337 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 -- 172.21.15.144:0/833576253 >> 172.21.15.144:0/833576253 conn(0x7f4a2409a0f0 msgr2=0x7f4a24067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 -- 172.21.15.144:0/833576253 shutdown_connections 2023-10-14T18:44:54.338 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.331+0000 7f4a2b23c700 1 -- 172.21.15.144:0/833576253 wait complete. 2023-10-14T18:44:54.340 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.333+0000 7f4a2b23c700 1 Processor -- start 2023-10-14T18:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.333+0000 7f4a2b23c700 1 -- start start 2023-10-14T18:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.341 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 0x7f4a240aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240b4c30 0x7f4a240acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240aefb0 con 0x7f4a240b4c30 2023-10-14T18:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24158990 con 0x7f4a240b4860 2023-10-14T18:44:54.342 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a2b23c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240b0260 con 0x7f4a240b3570 2023-10-14T18:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a28fd8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a23fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 0x7f4a240aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a28fd8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:47726/0 (socket says 172.21.15.144:47726) 2023-10-14T18:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a28fd8700 1 -- 172.21.15.144:0/1382376076 learned_addr learned my addr 172.21.15.144:0/1382376076 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.343 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.334+0000 7f4a297d9700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240b4c30 0x7f4a240acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 -- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 msgr2=0x7f4a240aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 0x7f4a240aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 -- 172.21.15.144:0/1382376076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240b4c30 msgr2=0x7f4a240acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.344 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240b4c30 0x7f4a240acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 -- 172.21.15.144:0/1382376076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009ae0 con 0x7f4a240b3570 2023-10-14T18:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a23fff700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 0x7f4a240aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a28fd8700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e920 tx=0x7f4a18008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18005a00 con 0x7f4a240b3570 2023-10-14T18:44:54.345 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18005b60 con 0x7f4a240b3570 2023-10-14T18:44:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a240afdd0 con 0x7f4a240b3570 2023-10-14T18:44:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18006020 con 0x7f4a240b3570 2023-10-14T18:44:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a240af270 con 0x7f4a240b3570 2023-10-14T18:44:54.346 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4a18006390 con 0x7f4a240b3570 2023-10-14T18:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.335+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4a18013b50 con 0x7f4a240b3570 2023-10-14T18:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.336+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a240b00b0 con 0x7f4a240b3570 2023-10-14T18:44:54.347 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.338+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4a1803a6d0 con 0x7f4a240b3570 2023-10-14T18:44:54.347 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.342+0000 7f49c72ed180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T18:44:54.422 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.421+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f4a2404c3c0 con 0x7f4a240b3570 2023-10-14T18:44:54.426 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.425+0000 7f4a20ff9700 1 -- 172.21.15.144:0/1382376076 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a18029070 con 0x7f4a240b3570 2023-10-14T18:44:54.427 INFO:teuthology.orchestra.run.smithi144.stdout:4 2023-10-14T18:44:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 msgr2=0x7f4a24158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800e920 tx=0x7f4a18008040 comp rx=0 tx=0).stop 2023-10-14T18:44:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 shutdown_connections 2023-10-14T18:44:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a240b4c30 0x7f4a240acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a240b3570 0x7f4a24158450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.430 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 --2- 172.21.15.144:0/1382376076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a240b4860 0x7f4a240aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.431 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 >> 172.21.15.144:0/1382376076 conn(0x7f4a2409a0f0 msgr2=0x7f4a2415c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.431 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 shutdown_connections 2023-10-14T18:44:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.426+0000 7f4a2b23c700 1 -- 172.21.15.144:0/1382376076 wait complete. 2023-10-14T18:44:54.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-14T18:44:54.456 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.455+0000 7f525cbeb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T18:44:54.523 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.522+0000 7f49c72ed180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T18:44:54.532 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.531+0000 7f525cbeb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T18:44:54.554 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.553+0000 7fbedcf55700 1 Processor -- start 2023-10-14T18:44:54.555 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.553+0000 7fbedcf55700 1 -- start start 2023-10-14T18:44:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.554+0000 7fbedcf55700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbed8143970 0x7fbed8069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.554+0000 7fbedcf55700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed815e380 con 0x7fbed8070e10 2023-10-14T18:44:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.554+0000 7fbedcf55700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed806ab70 con 0x7fbed81435a0 2023-10-14T18:44:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.554+0000 7fbedcf55700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed806fb70 con 0x7fbed8143970 2023-10-14T18:44:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbed8143970 0x7fbed8069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbed8143970 0x7fbed8069e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51162/0 (socket says 172.21.15.144:51162) 2023-10-14T18:44:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 -- 172.21.15.144:0/2057024776 learned_addr learned my addr 172.21.15.144:0/2057024776 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed659c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbed81435a0 0x7fbed8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37246/0 (socket says 172.21.15.144:37246) 2023-10-14T18:44:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 -- 172.21.15.144:0/2057024776 >> v1:172.21.15.144:6789/0 conn(0x7fbed81435a0 legacy=0x7fbed8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 -- 172.21.15.144:0/2057024776 >> v1:172.21.15.79:6789/0 conn(0x7fbed8070e10 legacy=0x7fbed806a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 -- 172.21.15.144:0/2057024776 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed815da50 con 0x7fbed8143970 2023-10-14T18:44:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed5d9b700 1 --2- 172.21.15.144:0/2057024776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed8143970 0x7fbed8069e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbec00099b0 tx=0x7fbec0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e61706494ae2ea40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed559a700 1 -- 172.21.15.144:0/2057024776 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000b860 con 0x7fbed8143970 2023-10-14T18:44:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed559a700 1 -- 172.21.15.144:0/2057024776 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec000b9c0 con 0x7fbed8143970 2023-10-14T18:44:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.555+0000 7fbed559a700 1 -- 172.21.15.144:0/2057024776 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000bd60 con 0x7fbed8143970 2023-10-14T18:44:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 -- 172.21.15.144:0/2057024776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed8143970 msgr2=0x7fbed8069e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 --2- 172.21.15.144:0/2057024776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed8143970 0x7fbed8069e40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbec00099b0 tx=0x7fbec0009250 comp rx=0 tx=0).stop 2023-10-14T18:44:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 -- 172.21.15.144:0/2057024776 shutdown_connections 2023-10-14T18:44:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 --2- 172.21.15.144:0/2057024776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed8143970 0x7fbed8069e40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 -- 172.21.15.144:0/2057024776 >> 172.21.15.144:0/2057024776 conn(0x7fbed80ca520 msgr2=0x7fbed80ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 -- 172.21.15.144:0/2057024776 shutdown_connections 2023-10-14T18:44:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.556+0000 7fbedcf55700 1 -- 172.21.15.144:0/2057024776 wait complete. 2023-10-14T18:44:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.557+0000 7fbedcf55700 1 Processor -- start 2023-10-14T18:44:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.557+0000 7fbedcf55700 1 -- start start 2023-10-14T18:44:54.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 0x7fbed816af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.566 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 0x7fbed80c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80ab910 con 0x7fbed8143970 2023-10-14T18:44:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80ac710 con 0x7fbed81435a0 2023-10-14T18:44:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed816b440 con 0x7fbed8070e10 2023-10-14T18:44:54.567 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed5d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 0x7fbed816af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed5d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51164/0 (socket says 172.21.15.144:51164) 2023-10-14T18:44:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed5d9b700 1 -- 172.21.15.144:0/641166080 learned_addr learned my addr 172.21.15.144:0/641166080 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed6d9d700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 0x7fbed80c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 -- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 msgr2=0x7fbed80c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 -- 172.21.15.144:0/641166080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 msgr2=0x7fbed80c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 0x7fbed80c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 -- 172.21.15.144:0/641166080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec00094f0 con 0x7fbed8070e10 2023-10-14T18:44:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed6d9d700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 0x7fbed80c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:44:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed5d9b700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbed659c700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 0x7fbed816af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7f0 tx=0x7fbec8007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8005a70 con 0x7fbed8070e10 2023-10-14T18:44:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8005bf0 con 0x7fbed8070e10 2023-10-14T18:44:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed80aad00 con 0x7fbed8070e10 2023-10-14T18:44:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec80070d0 con 0x7fbed8070e10 2023-10-14T18:44:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed80ab2c0 con 0x7fbed8070e10 2023-10-14T18:44:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.558+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbec801c440 con 0x7fbed8070e10 2023-10-14T18:44:54.571 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.559+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fbec8007700 con 0x7fbed8070e10 2023-10-14T18:44:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.560+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed804c3c0 con 0x7fbed8070e10 2023-10-14T18:44:54.572 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.561+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbec8017070 con 0x7fbed8070e10 2023-10-14T18:44:54.604 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.603+0000 7f49c72ed180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T18:44:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.644+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fbed815dd30 con 0x7fbed8070e10 2023-10-14T18:44:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.648+0000 7fbece7fc700 1 -- 172.21.15.144:0/641166080 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbec801c880 con 0x7fbed8070e10 2023-10-14T18:44:54.649 INFO:teuthology.orchestra.run.smithi144.stdout:5 2023-10-14T18:44:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 msgr2=0x7fbed816af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 0x7fbed816af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7f0 tx=0x7fbec8007eb0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 shutdown_connections 2023-10-14T18:44:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed8143970 0x7fbed80c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed8070e10 0x7fbed816af00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 --2- 172.21.15.144:0/641166080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed81435a0 0x7fbed80c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 >> 172.21.15.144:0/641166080 conn(0x7fbed80ca520 msgr2=0x7fbed8068880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 shutdown_connections 2023-10-14T18:44:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.649+0000 7fbedcf55700 1 -- 172.21.15.144:0/641166080 wait complete. 2023-10-14T18:44:54.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-14T18:44:54.665 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.664+0000 7f525cbeb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T18:44:54.748 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.747+0000 7f49c72ed180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T18:44:54.760 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:54.760+0000 7f525cbeb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T18:44:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.779+0000 7f4f0b770700 1 Processor -- start 2023-10-14T18:44:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.779+0000 7f4f0b770700 1 -- start start 2023-10-14T18:44:54.782 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0b770700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f040b4860 0x7f4f040b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0b770700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 0x7f4f0415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0b770700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f040b14f0 con 0x7f4f040b4c30 2023-10-14T18:44:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0b770700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040b17d0 con 0x7f4f040b4860 2023-10-14T18:44:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0b770700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040b1ab0 con 0x7f4f040b3570 2023-10-14T18:44:54.783 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 0x7f4f0415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f08d0b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4f040b4c30 0x7f4f04159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37260/0 (socket says 172.21.15.144:37260) 2023-10-14T18:44:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f08d0b700 1 -- 172.21.15.144:0/1358718548 learned_addr learned my addr 172.21.15.144:0/1358718548 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-10-14T18:44:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f0950c700 1 --2- 172.21.15.144:0/1358718548 >> v2:172.21.15.79:3300/0 conn(0x7f4f040b4860 0x7f4f040b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4efbfff700 1 -- 172.21.15.144:0/1358718548 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041125528 0 0) 0x7f4f040b14f0 con 0x7f4f040b4c30 2023-10-14T18:44:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4efbfff700 1 -- 172.21.15.144:0/1358718548 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef0003570 con 0x7f4f040b4c30 2023-10-14T18:44:54.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 -- 172.21.15.144:0/1358718548 >> v2:172.21.15.79:3300/0 conn(0x7f4f040b4860 msgr2=0x7f4f040b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:54.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 --2- 172.21.15.144:0/1358718548 >> v2:172.21.15.79:3300/0 conn(0x7f4f040b4860 0x7f4f040b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 -- 172.21.15.144:0/1358718548 >> v1:172.21.15.144:6789/0 conn(0x7f4f040b4c30 legacy=0x7f4f04159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.785 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 -- 172.21.15.144:0/1358718548 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f040b1d90 con 0x7f4f040b3570 2023-10-14T18:44:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.780+0000 7f4f09d0d700 1 --2- 172.21.15.144:0/1358718548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 0x7f4f0415a1a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009e60 tx=0x7f4efc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de3906656acf3e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4efbfff700 1 -- 172.21.15.144:0/1358718548 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00e070 con 0x7f4f040b3570 2023-10-14T18:44:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4efbfff700 1 -- 172.21.15.144:0/1358718548 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc00bb40 con 0x7f4f040b3570 2023-10-14T18:44:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4efbfff700 1 -- 172.21.15.144:0/1358718548 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc012430 con 0x7f4f040b3570 2023-10-14T18:44:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 -- 172.21.15.144:0/1358718548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 msgr2=0x7f4f0415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 --2- 172.21.15.144:0/1358718548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 0x7f4f0415a1a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009e60 tx=0x7f4efc009780 comp rx=0 tx=0).stop 2023-10-14T18:44:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 -- 172.21.15.144:0/1358718548 shutdown_connections 2023-10-14T18:44:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 --2- 172.21.15.144:0/1358718548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b3570 0x7f4f0415a1a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 --2- 172.21.15.144:0/1358718548 >> v2:172.21.15.79:3300/0 conn(0x7f4f040b4860 0x7f4f040b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 -- 172.21.15.144:0/1358718548 >> 172.21.15.144:0/1358718548 conn(0x7f4f0409a0f0 msgr2=0x7f4f04067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 -- 172.21.15.144:0/1358718548 shutdown_connections 2023-10-14T18:44:54.788 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.781+0000 7f4f0b770700 1 -- 172.21.15.144:0/1358718548 wait complete. 2023-10-14T18:44:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.782+0000 7f4f0b770700 1 Processor -- start 2023-10-14T18:44:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.782+0000 7f4f0b770700 1 -- start start 2023-10-14T18:44:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 0x7f4f0409bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f040b4c30 0x7f4f04149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0409d460 con 0x7f4f040b3570 2023-10-14T18:44:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0409c850 con 0x7f4f040b4c30 2023-10-14T18:44:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0b770700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0409cb30 con 0x7f4f040b4860 2023-10-14T18:44:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f08d0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f0950c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 0x7f4f0409bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f09d0d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f040b4c30 0x7f4f04149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f08d0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:47758/0 (socket says 172.21.15.144:47758) 2023-10-14T18:44:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.783+0000 7f4f08d0b700 1 -- 172.21.15.144:0/3603165105 learned_addr learned my addr 172.21.15.144:0/3603165105 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 -- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f040b4c30 msgr2=0x7f4f04149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f040b4c30 0x7f4f04149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 -- 172.21.15.144:0/3603165105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 msgr2=0x7f4f0409bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 0x7f4f0409bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 -- 172.21.15.144:0/3603165105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009a20 con 0x7f4f040b4860 2023-10-14T18:44:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f0950c700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 0x7f4f0409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f08d0b700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c590 tx=0x7f4f00007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00005b30 con 0x7f4f040b4860 2023-10-14T18:44:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00005cb0 con 0x7f4f040b4860 2023-10-14T18:44:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0409ce10 con 0x7f4f040b4860 2023-10-14T18:44:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00007320 con 0x7f4f040b4860 2023-10-14T18:44:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.784+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0409c460 con 0x7f4f040b4860 2023-10-14T18:44:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.785+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4f0001c6c0 con 0x7f4f040b4860 2023-10-14T18:44:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.785+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f4f00005e20 con 0x7f4f040b4860 2023-10-14T18:44:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.785+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0404c3c0 con 0x7f4f040b4860 2023-10-14T18:44:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.787+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4f00017070 con 0x7f4f040b4860 2023-10-14T18:44:54.847 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:54.846+0000 7f49c72ed180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T18:44:54.870 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.869+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f4f0409d5a0 con 0x7f4f040b4860 2023-10-14T18:44:54.875 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.875+0000 7f4ef97fa700 1 -- 172.21.15.144:0/3603165105 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f00007750 con 0x7f4f040b4860 2023-10-14T18:44:54.876 INFO:teuthology.orchestra.run.smithi144.stdout:6 2023-10-14T18:44:54.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 msgr2=0x7f4f040af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:54.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000c590 tx=0x7f4f00007e00 comp rx=0 tx=0).stop 2023-10-14T18:44:54.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 shutdown_connections 2023-10-14T18:44:54.877 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f040b4c30 0x7f4f04149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f040b3570 0x7f4f0409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 --2- 172.21.15.144:0/3603165105 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f040b4860 0x7f4f040af0b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 >> 172.21.15.144:0/3603165105 conn(0x7f4f0409a0f0 msgr2=0x7f4f0415bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 shutdown_connections 2023-10-14T18:44:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:54.876+0000 7f4f0b770700 1 -- 172.21.15.144:0/3603165105 wait complete. 2023-10-14T18:44:54.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-14T18:44:55.003 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 Processor -- start 2023-10-14T18:44:55.004 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 -- start start 2023-10-14T18:44:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3984155700 0x7f398406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3984159210 con 0x7f398415c450 2023-10-14T18:44:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3984158f30 con 0x7f3984158950 2023-10-14T18:44:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f398b17b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398415b970 con 0x7f3984155700 2023-10-14T18:44:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.003+0000 7f3988f17700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3984155700 0x7f398406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3984155700 0x7f398406c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51182/0 (socket says 172.21.15.144:51182) 2023-10-14T18:44:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 -- 172.21.15.144:0/3820896432 learned_addr learned my addr 172.21.15.144:0/3820896432 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3989718700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3984158950 0x7f3984067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37266/0 (socket says 172.21.15.144:37266) 2023-10-14T18:44:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 -- 172.21.15.144:0/3820896432 >> v1:172.21.15.144:6789/0 conn(0x7f3984158950 legacy=0x7f3984067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 -- 172.21.15.144:0/3820896432 >> v1:172.21.15.79:6789/0 conn(0x7f398415c450 legacy=0x7f3984158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 -- 172.21.15.144:0/3820896432 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398415bc50 con 0x7f3984155700 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f39837fe700 1 -- 172.21.15.144:0/3820896432 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234291460 0 0) 0x7f3984158f30 con 0x7f3984158950 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f3988f17700 1 --2- 172.21.15.144:0/3820896432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f398406c380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39780099b0 tx=0x7f3978009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8253f784a42d301 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f39837fe700 1 -- 172.21.15.144:0/3820896432 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800b820 con 0x7f3984155700 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f39837fe700 1 -- 172.21.15.144:0/3820896432 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800b980 con 0x7f3984155700 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.004+0000 7f39837fe700 1 -- 172.21.15.144:0/3820896432 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800bd20 con 0x7f3984155700 2023-10-14T18:44:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 -- 172.21.15.144:0/3820896432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 msgr2=0x7f398406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 --2- 172.21.15.144:0/3820896432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f398406c380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39780099b0 tx=0x7f3978009250 comp rx=0 tx=0).stop 2023-10-14T18:44:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 -- 172.21.15.144:0/3820896432 shutdown_connections 2023-10-14T18:44:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 --2- 172.21.15.144:0/3820896432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f398406c380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 -- 172.21.15.144:0/3820896432 >> 172.21.15.144:0/3820896432 conn(0x7f39840cb030 msgr2=0x7f398406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:55.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 -- 172.21.15.144:0/3820896432 shutdown_connections 2023-10-14T18:44:55.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.005+0000 7f398b17b700 1 -- 172.21.15.144:0/3820896432 wait complete. 2023-10-14T18:44:55.011 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.006+0000 7f398b17b700 1 Processor -- start 2023-10-14T18:44:55.013 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.006+0000 7f398b17b700 1 -- start start 2023-10-14T18:44:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 0x7f39840c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398415c450 0x7f3984155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cb6c0 con 0x7f398415c450 2023-10-14T18:44:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3984151bf0 con 0x7f3984155700 2023-10-14T18:44:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3984151ed0 con 0x7f3984158950 2023-10-14T18:44:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3988f17700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3988f17700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51184/0 (socket says 172.21.15.144:51184) 2023-10-14T18:44:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3988f17700 1 -- 172.21.15.144:0/517829260 learned_addr learned my addr 172.21.15.144:0/517829260 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-14T18:44:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 0x7f39840c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3989718700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398415c450 0x7f3984155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 -- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 msgr2=0x7f39840c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 -- 172.21.15.144:0/517829260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398415c450 msgr2=0x7f3984155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398415c450 0x7f3984155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 -- 172.21.15.144:0/517829260 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39780094f0 con 0x7f3984158950 2023-10-14T18:44:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3988f17700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:44:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3983fff700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 0x7f39840c69e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f397000b4c0 tx=0x7f3970009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000f510 con 0x7f3984158950 2023-10-14T18:44:55.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000f670 con 0x7f3984158950 2023-10-14T18:44:55.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000fa30 con 0x7f3984158950 2023-10-14T18:44:55.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.007+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39841521b0 con 0x7f3984158950 2023-10-14T18:44:55.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.008+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984156010 con 0x7f3984158950 2023-10-14T18:44:55.018 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.008+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f397001a400 con 0x7f3984158950 2023-10-14T18:44:55.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.008+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f397000fe20 con 0x7f3984158950 2023-10-14T18:44:55.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.008+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398404c3c0 con 0x7f3984158950 2023-10-14T18:44:55.019 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.010+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f397001a890 con 0x7f3984158950 2023-10-14T18:44:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.093+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f398415bf30 con 0x7f3984158950 2023-10-14T18:44:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.100+0000 7f3980ff9700 1 -- 172.21.15.144:0/517829260 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f397001aa30 con 0x7f3984158950 2023-10-14T18:44:55.101 INFO:teuthology.orchestra.run.smithi144.stdout:7 2023-10-14T18:44:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 msgr2=0x7f39840c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 0x7f39840c69e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f397000b4c0 tx=0x7f3970009060 comp rx=0 tx=0).stop 2023-10-14T18:44:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 shutdown_connections 2023-10-14T18:44:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398415c450 0x7f3984155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3984155700 0x7f39840c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 --2- 172.21.15.144:0/517829260 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3984158950 0x7f39840c69e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 >> 172.21.15.144:0/517829260 conn(0x7f39840cb030 msgr2=0x7f39840c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.101+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 shutdown_connections 2023-10-14T18:44:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-14T18:44:55.102+0000 7f398b17b700 1 -- 172.21.15.144:0/517829260 wait complete. 2023-10-14T18:44:55.114 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T18:44:55.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T18:44:55.117 INFO:tasks.ceph.osd.0:Started 2023-10-14T18:44:55.117 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T18:44:55.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T18:44:55.120 INFO:tasks.ceph.osd.1:Started 2023-10-14T18:44:55.120 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T18:44:55.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T18:44:55.122 INFO:tasks.ceph.osd.2:Started 2023-10-14T18:44:55.123 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T18:44:55.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T18:44:55.125 INFO:tasks.ceph.osd.3:Started 2023-10-14T18:44:55.127 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T18:44:55.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T18:44:55.131 INFO:tasks.ceph.osd.4:Started 2023-10-14T18:44:55.131 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T18:44:55.132 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T18:44:55.134 INFO:tasks.ceph.osd.5:Started 2023-10-14T18:44:55.134 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T18:44:55.134 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T18:44:55.136 INFO:tasks.ceph.osd.6:Started 2023-10-14T18:44:55.137 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T18:44:55.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T18:44:55.141 INFO:tasks.ceph.osd.7:Started 2023-10-14T18:44:55.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:44:55.205 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-14T18:44:55.205+0000 7f185b6c2540 -1 Falling back to public interface 2023-10-14T18:44:55.211 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-14T18:44:55.210+0000 7f7c3c212540 -1 Falling back to public interface 2023-10-14T18:44:55.211 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-14T18:44:55.210+0000 7f0db63f9540 -1 Falling back to public interface 2023-10-14T18:44:55.212 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-14T18:44:55.211+0000 7f7c3663b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2023-10-14T18:44:55.215 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-14T18:44:55.214+0000 7fccf1d75540 -1 Falling back to public interface 2023-10-14T18:44:55.218 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-14T18:44:55.218+0000 7f03f1ba3540 -1 Falling back to public interface 2023-10-14T18:44:55.219 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-14T18:44:55.219+0000 7f2d19c29540 -1 Falling back to public interface 2023-10-14T18:44:55.221 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-14T18:44:55.220+0000 7f185b6c2540 -1 osd.2 0 log_to_monitors true 2023-10-14T18:44:55.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-14T18:44:55.221+0000 7fd3994a0540 -1 Falling back to public interface 2023-10-14T18:44:55.224 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-14T18:44:55.223+0000 7f2d14052700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6825/0: (98) Address already in use 2023-10-14T18:44:55.225 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-14T18:44:55.224+0000 7f7c3c212540 -1 osd.5 0 log_to_monitors true 2023-10-14T18:44:55.226 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-14T18:44:55.224+0000 7f0db63f9540 -1 osd.4 0 log_to_monitors true 2023-10-14T18:44:55.229 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-14T18:44:55.229+0000 7fccf1d75540 -1 osd.0 0 log_to_monitors true 2023-10-14T18:44:55.234 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-14T18:44:55.234+0000 7fb12204c540 -1 Falling back to public interface 2023-10-14T18:44:55.235 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-14T18:44:55.234+0000 7f03f1ba3540 -1 osd.7 0 log_to_monitors true 2023-10-14T18:44:55.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-14T18:44:55.236+0000 7f2d19c29540 -1 osd.3 0 log_to_monitors true 2023-10-14T18:44:55.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-14T18:44:55.238+0000 7fd3994a0540 -1 osd.1 0 log_to_monitors true 2023-10-14T18:44:55.250 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-14T18:44:55.249+0000 7fb12204c540 -1 osd.6 0 log_to_monitors true 2023-10-14T18:44:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.295+0000 7fdc0efe0700 1 Processor -- start 2023-10-14T18:44:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.295+0000 7fdc0efe0700 1 -- start start 2023-10-14T18:44:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0efe0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc0806a060 0x7fdc080ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0efe0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc0815a030 0x7fdc080ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0efe0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc08068de0 con 0x7fdc08159c60 2023-10-14T18:44:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0efe0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080b1460 con 0x7fdc0806a060 2023-10-14T18:44:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0efe0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080affc0 con 0x7fdc0815a030 2023-10-14T18:44:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc0806a060 0x7fdc080ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0dfde700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc08159c60 0x7fdc0815ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:43858/0 (socket says 172.21.15.79:43858) 2023-10-14T18:44:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0dfde700 1 -- 172.21.15.79:0/2757536072 learned_addr learned my addr 172.21.15.79:0/2757536072 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:44:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0e7df700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc0815a030 0x7fdc080ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 -- 172.21.15.79:0/2757536072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc0815a030 msgr2=0x7fdc080ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc0815a030 0x7fdc080ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 -- 172.21.15.79:0/2757536072 >> v1:172.21.15.79:6789/0 conn(0x7fdc08159c60 legacy=0x7fdc0815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0cfdc700 1 -- 172.21.15.79:0/2757536072 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430312790 0 0) 0x7fdc08068de0 con 0x7fdc08159c60 2023-10-14T18:44:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 -- 172.21.15.79:0/2757536072 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080695f0 con 0x7fdc0806a060 2023-10-14T18:44:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.296+0000 7fdc0d7dd700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0806a060 0x7fdc080ce990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80098e0 tx=0x7fdbf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8c7494ec455253 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0cfdc700 1 -- 172.21.15.79:0/2757536072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800b640 con 0x7fdc0806a060 2023-10-14T18:44:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0cfdc700 1 -- 172.21.15.79:0/2757536072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800b7a0 con 0x7fdc0806a060 2023-10-14T18:44:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0cfdc700 1 -- 172.21.15.79:0/2757536072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800bb40 con 0x7fdc0806a060 2023-10-14T18:44:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 -- 172.21.15.79:0/2757536072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0806a060 msgr2=0x7fdc080ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0806a060 0x7fdc080ce990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80098e0 tx=0x7fdbf80091a0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 -- 172.21.15.79:0/2757536072 shutdown_connections 2023-10-14T18:44:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc0815a030 0x7fdc080ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/2757536072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0806a060 0x7fdc080ce990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 -- 172.21.15.79:0/2757536072 >> 172.21.15.79:0/2757536072 conn(0x7fdc0806c740 msgr2=0x7fdc08069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 -- 172.21.15.79:0/2757536072 shutdown_connections 2023-10-14T18:44:55.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.297+0000 7fdc0efe0700 1 -- 172.21.15.79:0/2757536072 wait complete. 2023-10-14T18:44:55.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.298+0000 7fdc0efe0700 1 Processor -- start 2023-10-14T18:44:55.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 -- start start 2023-10-14T18:44:55.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc0806a060 0x7fdc080b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc08159c60 0x7fdc081579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:55.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080abdb0 con 0x7fdc0815a030 2023-10-14T18:44:55.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080ac090 con 0x7fdc0806a060 2023-10-14T18:44:55.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0efe0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080ac370 con 0x7fdc08159c60 2023-10-14T18:44:55.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0e7df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0e7df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50292/0 (socket says 172.21.15.79:50292) 2023-10-14T18:44:55.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0e7df700 1 -- 172.21.15.79:0/1747850936 learned_addr learned my addr 172.21.15.79:0/1747850936 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:44:55.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0dfde700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc0806a060 0x7fdc080b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.299+0000 7fdc0d7dd700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc08159c60 0x7fdc081579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:55.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 -- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc08159c60 msgr2=0x7fdc081579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc08159c60 0x7fdc081579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 -- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc0806a060 msgr2=0x7fdc080b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc0806a060 0x7fdc080b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 -- 172.21.15.79:0/1747850936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8009420 con 0x7fdc0815a030 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0e7df700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009df0 tx=0x7fdc0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0000cb30 con 0x7fdc0815a030 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0000f040 con 0x7fdc0815a030 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00014480 con 0x7fdc0815a030 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc080ac650 con 0x7fdc0815a030 2023-10-14T18:44:55.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.300+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0815d390 con 0x7fdc0815a030 2023-10-14T18:44:55.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.301+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdc00014830 con 0x7fdc0815a030 2023-10-14T18:44:55.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.301+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fdc00013ac0 con 0x7fdc0815a030 2023-10-14T18:44:55.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.301+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0815d5e0 con 0x7fdc0815a030 2023-10-14T18:44:55.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.303+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdc00018020 con 0x7fdc0815a030 2023-10-14T18:44:55.344 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:55.344+0000 7f525cbeb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T18:44:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.372+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc08068340 con 0x7fdc0815a030 2023-10-14T18:44:55.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.373+0000 7fdbfdffb700 1 -- 172.21.15.79:0/1747850936 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fdc00013e60 con 0x7fdc0815a030 2023-10-14T18:44:55.374 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:44:55.374 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:44:55.095083+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:44:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 msgr2=0x7fdc081542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:55.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009df0 tx=0x7fdc0000b040 comp rx=0 tx=0).stop 2023-10-14T18:44:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 shutdown_connections 2023-10-14T18:44:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc0815a030 0x7fdc081542f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc0806a060 0x7fdc080b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 --2- 172.21.15.79:0/1747850936 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdc08159c60 0x7fdc081579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:55.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 >> 172.21.15.79:0/1747850936 conn(0x7fdc0806c740 msgr2=0x7fdc0806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:55.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 shutdown_connections 2023-10-14T18:44:55.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:44:55.374+0000 7fdc0efe0700 1 -- 172.21.15.79:0/1747850936 wait complete. 2023-10-14T18:44:55.386 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T18:44:55.387 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T18:44:55.416 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:55.415+0000 7f49c72ed180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T18:44:55.424 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:55.424+0000 7f525cbeb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T18:44:55.493 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:55.492+0000 7f49c72ed180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T18:44:55.500 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:55.500+0000 7f525cbeb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T18:44:55.569 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:55.568+0000 7f49c72ed180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T18:44:56.090 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:56.089+0000 7f525cbeb180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T18:44:56.144 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:56.143+0000 7f49c72ed180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T18:44:56.193 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T18:44:56.228 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:56.227+0000 7f525cbeb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T18:44:56.282 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:56.281+0000 7f49c72ed180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T18:44:56.301 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.300+0000 7f281fc8a700 1 Processor -- start 2023-10-14T18:44:56.301 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.300+0000 7f281fc8a700 1 -- start start 2023-10-14T18:44:56.304 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281fc8a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f28180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:56.304 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281fc8a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28180b1680 0x7f2818159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:56.304 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281fc8a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180b2890 con 0x7f28180af5b0 2023-10-14T18:44:56.304 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281fc8a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180b1c80 con 0x7f28180b1680 2023-10-14T18:44:56.304 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281fc8a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180b1f60 con 0x7f28180af1e0 2023-10-14T18:44:56.305 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281d225700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28180af5b0 0x7f281806f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:43862/0 (socket says 172.21.15.79:43862) 2023-10-14T18:44:56.305 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.301+0000 7f281d225700 1 -- 172.21.15.79:0/3066893628 learned_addr learned my addr 172.21.15.79:0/3066893628 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:44:56.305 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 --2- 172.21.15.79:0/3066893628 >> v2:172.21.15.144:3300/0 conn(0x7f28180b1680 0x7f2818159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:56.305 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281da26700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f28180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:56.305 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281ca24700 1 -- 172.21.15.79:0/3066893628 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180206018 0 0) 0x7f28180b2890 con 0x7f28180af5b0 2023-10-14T18:44:56.306 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281ca24700 1 -- 172.21.15.79:0/3066893628 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2804003570 con 0x7f28180af5b0 2023-10-14T18:44:56.306 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 -- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 msgr2=0x7f28180b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:44:56.306 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f28180b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.307 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 -- 172.21.15.79:0/3066893628 >> v1:172.21.15.79:6789/0 conn(0x7f28180af5b0 legacy=0x7f281806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:56.307 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 -- 172.21.15.79:0/3066893628 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180b2240 con 0x7f28180b1680 2023-10-14T18:44:56.307 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281e227700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180b1680 0x7f2818159b50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2810009e60 tx=0x7f2810009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c2d281880acc82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:56.307 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281ca24700 1 -- 172.21.15.79:0/3066893628 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000e070 con 0x7f28180b1680 2023-10-14T18:44:56.307 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281ca24700 1 -- 172.21.15.79:0/3066893628 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281000bab0 con 0x7f28180b1680 2023-10-14T18:44:56.308 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.302+0000 7f281ca24700 1 -- 172.21.15.79:0/3066893628 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281000be30 con 0x7f28180b1680 2023-10-14T18:44:56.308 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 -- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180b1680 msgr2=0x7f2818159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:56.308 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180b1680 0x7f2818159b50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2810009e60 tx=0x7f2810009780 comp rx=0 tx=0).stop 2023-10-14T18:44:56.308 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 -- 172.21.15.79:0/3066893628 shutdown_connections 2023-10-14T18:44:56.308 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180b1680 0x7f2818159b50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.309 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3066893628 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f28180b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.309 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 -- 172.21.15.79:0/3066893628 >> 172.21.15.79:0/3066893628 conn(0x7f28180cd1e0 msgr2=0x7f28180cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:56.309 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 -- 172.21.15.79:0/3066893628 shutdown_connections 2023-10-14T18:44:56.309 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.303+0000 7f281fc8a700 1 -- 172.21.15.79:0/3066893628 wait complete. 2023-10-14T18:44:56.312 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.304+0000 7f281fc8a700 1 Processor -- start 2023-10-14T18:44:56.312 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.304+0000 7f281fc8a700 1 -- start start 2023-10-14T18:44:56.312 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f2818151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:56.312 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180af5b0 0x7f281815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:56.312 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:44:56.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818099920 con 0x7f28180b1680 2023-10-14T18:44:56.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818099030 con 0x7f28180af5b0 2023-10-14T18:44:56.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28180992d0 con 0x7f28180af1e0 2023-10-14T18:44:56.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:56.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50302/0 (socket says 172.21.15.79:50302) 2023-10-14T18:44:56.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 -- 172.21.15.79:0/3459973770 learned_addr learned my addr 172.21.15.79:0/3459973770 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:44:56.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281d225700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180af5b0 0x7f281815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:56.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281da26700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f2818151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:44:56.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 -- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 msgr2=0x7f2818151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:56.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f2818151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 -- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180af5b0 msgr2=0x7f281815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180af5b0 0x7f281815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 -- 172.21.15.79:0/3459973770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810009a20 con 0x7f28180b1680 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281e227700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2818072020 tx=0x7f2810019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810012e10 con 0x7f28180b1680 2023-10-14T18:44:56.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810027470 con 0x7f28180b1680 2023-10-14T18:44:56.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28180995b0 con 0x7f28180b1680 2023-10-14T18:44:56.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.305+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810027830 con 0x7f28180b1680 2023-10-14T18:44:56.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.306+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281815cc20 con 0x7f28180b1680 2023-10-14T18:44:56.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.306+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2810024070 con 0x7f28180b1680 2023-10-14T18:44:56.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.306+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7f281001dc40 con 0x7f28180b1680 2023-10-14T18:44:56.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.306+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2818099a90 con 0x7f28180b1680 2023-10-14T18:44:56.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.309+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2810027c20 con 0x7f28180b1680 2023-10-14T18:44:56.374 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:56.374+0000 7f49c72ed180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T18:44:56.376 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.375+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f281804c3c0 con 0x7f28180b1680 2023-10-14T18:44:56.376 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.376+0000 7f280dffb700 1 -- 172.21.15.79:0/3459973770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f281001d470 con 0x7f28180b1680 2023-10-14T18:44:56.377 INFO:teuthology.misc.health.smithi079.stdout: 2023-10-14T18:44:56.377 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":11,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:44:56.096306+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:44:56.378 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 msgr2=0x7f2818154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:44:56.378 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2818072020 tx=0x7f2810019000 comp rx=0 tx=0).stop 2023-10-14T18:44:56.378 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 shutdown_connections 2023-10-14T18:44:56.378 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28180b1680 0x7f2818154780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.379 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28180af1e0 0x7f2818151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.379 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 --2- 172.21.15.79:0/3459973770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28180af5b0 0x7f281815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:44:56.379 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 >> 172.21.15.79:0/3459973770 conn(0x7f28180cd1e0 msgr2=0x7f28180ae0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:44:56.379 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 shutdown_connections 2023-10-14T18:44:56.379 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:44:56.377+0000 7f281fc8a700 1 -- 172.21.15.79:0/3459973770 wait complete. 2023-10-14T18:44:56.387 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T18:44:56.459 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:56.459+0000 7f525cbeb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T18:44:56.623 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:56.622+0000 7f49c72ed180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T18:44:56.699 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:56.699+0000 7f49c72ed180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T18:44:56.706 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:56.706+0000 7f525cbeb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T18:44:56.783 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:56.783+0000 7f525cbeb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T18:44:57.115 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-14T18:44:57.115+0000 7f1852ae5700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T18:44:57.116 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-14T18:44:57.115+0000 7fb11946f700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T18:44:57.116 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-14T18:44:57.116+0000 7f184c8de700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.117 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-10-14T18:44:57.116+0000 7fb113268700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.122 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-14T18:44:57.121+0000 7f7c33635700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T18:44:57.122 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-14T18:44:57.122+0000 7fcce9999700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T18:44:57.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-14T18:44:57.122+0000 7fd3908c3700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T18:44:57.123 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-14T18:44:57.123+0000 7f2d1184d700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T18:44:57.124 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-14T18:44:57.123+0000 7f0dae01d700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T18:44:57.124 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-14T18:44:57.123+0000 7fcce2f91700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.125 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-10-14T18:44:57.123+0000 7f7c2d42e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-14T18:44:57.124+0000 7fd38a6bc700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.125 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-14T18:44:57.123+0000 7f03e8fc6700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T18:44:57.126 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-14T18:44:57.124+0000 7f2d0ae45700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.126 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-10-14T18:44:57.124+0000 7f0da7615700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.126 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-10-14T18:44:57.124+0000 7f03e2dbf700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T18:44:57.529 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:57.528+0000 7f49c72ed180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T18:44:57.602 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:57.601+0000 7f49c72ed180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T18:44:57.664 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:57.663+0000 7f525cbeb180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T18:44:57.676 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:57.675+0000 7f49c72ed180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T18:44:57.737 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:57.736+0000 7f525cbeb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T18:44:57.809 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:57.808+0000 7f49c72ed180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T18:44:57.810 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:57.809+0000 7f525cbeb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T18:44:57.929 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:57.928+0000 7f49c72ed180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T18:44:57.939 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:57.939+0000 7f525cbeb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T18:44:58.037 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:58.037+0000 7f525cbeb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T18:44:58.080 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:58.079+0000 7f49c72ed180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T18:44:58.159 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:58.159+0000 7f49c72ed180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T18:44:58.192 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:58.191+0000 7f525cbeb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T18:44:58.235 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:58.234+0000 7f49c72ed180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T18:44:58.268 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:58.268+0000 7f525cbeb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T18:44:58.310 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:58.310+0000 7f49c72ed180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T18:44:58.345 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:58.344+0000 7f525cbeb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T18:44:58.422 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-14T18:44:58.422+0000 7f525cbeb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T18:44:59.340 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:59.339+0000 7f49806ec700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T18:44:59.341 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-10-14T18:44:59.340+0000 7f49806ec700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T18:45:03.193 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:03.309 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.309+0000 7f3b4f59e700 1 Processor -- start 2023-10-14T18:45:03.310 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.309+0000 7f3b4f59e700 1 -- start start 2023-10-14T18:45:03.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b500cd850 0x7f3b500b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.313 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b500cba70 0x7f3b500b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cdc20 0x7f3b50157250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5015d870 con 0x7f3b500cd850 2023-10-14T18:45:03.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b17f0 con 0x7f3b500cba70 2023-10-14T18:45:03.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5015e660 con 0x7f3b500cdc20 2023-10-14T18:45:03.314 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b500cd850 0x7f3b500b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b500cd850 0x7f3b500b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51526/0 (socket says 172.21.15.79:51526) 2023-10-14T18:45:03.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 -- 172.21.15.79:0/3137081490 learned_addr learned my addr 172.21.15.79:0/3137081490 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:03.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4dd9b700 1 --2- 172.21.15.79:0/3137081490 >> v2:172.21.15.144:3300/0 conn(0x7f3b500cba70 0x7f3b500b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.315 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4ed9d700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cdc20 0x7f3b50157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 -- 172.21.15.79:0/3137081490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cdc20 msgr2=0x7f3b50157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:03.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cdc20 0x7f3b50157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 -- 172.21.15.79:0/3137081490 >> v2:172.21.15.144:3300/0 conn(0x7f3b500cba70 msgr2=0x7f3b500b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:03.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/3137081490 >> v2:172.21.15.144:3300/0 conn(0x7f3b500cba70 0x7f3b500b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.316 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.310+0000 7f3b4e59c700 1 -- 172.21.15.79:0/3137081490 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5015da50 con 0x7f3b500cd850 2023-10-14T18:45:03.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b500b2be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b50069bb0 tx=0x7f3b48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e31dc4d1e266c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4d59a700 1 -- 172.21.15.79:0/3137081490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e070 con 0x7f3b500cd850 2023-10-14T18:45:03.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4d59a700 1 -- 172.21.15.79:0/3137081490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800b970 con 0x7f3b500cd850 2023-10-14T18:45:03.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4d59a700 1 -- 172.21.15.79:0/3137081490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480092e0 con 0x7f3b500cd850 2023-10-14T18:45:03.317 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 -- 172.21.15.79:0/3137081490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 msgr2=0x7f3b500b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.318 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b500b2be0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b50069bb0 tx=0x7f3b48009840 comp rx=0 tx=0).stop 2023-10-14T18:45:03.318 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 -- 172.21.15.79:0/3137081490 shutdown_connections 2023-10-14T18:45:03.318 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cdc20 0x7f3b50157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.318 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/3137081490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b500b2be0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.318 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/3137081490 >> v2:172.21.15.144:3300/0 conn(0x7f3b500cba70 0x7f3b500b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.319 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 -- 172.21.15.79:0/3137081490 >> 172.21.15.79:0/3137081490 conn(0x7f3b50067660 msgr2=0x7f3b50067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:03.319 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 -- 172.21.15.79:0/3137081490 shutdown_connections 2023-10-14T18:45:03.319 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.311+0000 7f3b4f59e700 1 -- 172.21.15.79:0/3137081490 wait complete. 2023-10-14T18:45:03.319 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.312+0000 7f3b4f59e700 1 Processor -- start 2023-10-14T18:45:03.319 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.312+0000 7f3b4f59e700 1 -- start start 2023-10-14T18:45:03.322 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cba70 0x7f3b500c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.322 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.323 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 0x7f3b5016ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.323 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50155360 con 0x7f3b500cd850 2023-10-14T18:45:03.323 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50154750 con 0x7f3b500cdc20 2023-10-14T18:45:03.323 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50154a30 con 0x7f3b500cba70 2023-10-14T18:45:03.324 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.324 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51528/0 (socket says 172.21.15.79:51528) 2023-10-14T18:45:03.324 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4dd9b700 1 -- 172.21.15.79:0/1533921053 learned_addr learned my addr 172.21.15.79:0/1533921053 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:03.324 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.313+0000 7f3b4ed9d700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 0x7f3b5016ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.324 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cba70 0x7f3b500c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.325 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 -- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cba70 msgr2=0x7f3b500c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.325 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cba70 0x7f3b500c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.325 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 -- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 msgr2=0x7f3b5016ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.325 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 0x7f3b5016ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.326 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 -- 172.21.15.79:0/1533921053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009ae0 con 0x7f3b500cd850 2023-10-14T18:45:03.326 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4ed9d700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 0x7f3b5016ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:03.326 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4dd9b700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800ec80 tx=0x7f3b380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.326 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800c9d0 con 0x7f3b500cd850 2023-10-14T18:45:03.327 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3800cb30 con 0x7f3b500cd850 2023-10-14T18:45:03.327 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50154d10 con 0x7f3b500cd850 2023-10-14T18:45:03.328 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38013470 con 0x7f3b500cd850 2023-10-14T18:45:03.328 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.314+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5016b1c0 con 0x7f3b500cd850 2023-10-14T18:45:03.328 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.315+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50155510 con 0x7f3b500cd850 2023-10-14T18:45:03.329 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.315+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b38013820 con 0x7f3b500cd850 2023-10-14T18:45:03.329 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.315+0000 7f3b467fc700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.329 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.316+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3b38084550 con 0x7f3b500cd850 2023-10-14T18:45:03.330 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.316+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.330 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.316+0000 7f3b4e59c700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 0x7f3b300693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b501590f0 tx=0x7f3b48018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.330 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.320+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b50155510 con 0x7f3b500cd850 2023-10-14T18:45:03.504 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.503+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b501554a0 con 0x7f3b500cd850 2023-10-14T18:45:03.504 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.504+0000 7f3b467fc700 1 -- 172.21.15.79:0/1533921053 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f3b38051b10 con 0x7f3b500cd850 2023-10-14T18:45:03.505 INFO:teuthology.misc.health.smithi079.stdout: 2023-10-14T18:45:03.505 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":16,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:01.133055+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:03.507 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 msgr2=0x7f3b300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.507 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 0x7f3b300693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3b501590f0 tx=0x7f3b48018000 comp rx=0 tx=0).stop 2023-10-14T18:45:03.508 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 msgr2=0x7f3b50154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.508 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800ec80 tx=0x7f3b380091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.508 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 shutdown_connections 2023-10-14T18:45:03.508 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b30066f30 0x7f3b300693e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.508 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b500cdc20 0x7f3b5016ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.509 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b500cba70 0x7f3b500c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.509 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 --2- 172.21.15.79:0/1533921053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b500cd850 0x7f3b50154090 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.509 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 >> 172.21.15.79:0/1533921053 conn(0x7f3b50067660 msgr2=0x7f3b500b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:03.509 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 shutdown_connections 2023-10-14T18:45:03.509 INFO:teuthology.misc.health.smithi079.stderr:2023-10-14T18:45:03.506+0000 7f3b4f59e700 1 -- 172.21.15.79:0/1533921053 wait complete. 2023-10-14T18:45:03.517 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T18:45:03.518 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T18:45:03.518 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:45:03.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:45:03.521 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:45:03.522 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:45:03.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:45:03.524 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:45:03.525 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:45:03.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:45:03.528 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:45:03.529 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:45:03.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:45:03.531 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:45:03.532 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T18:45:03.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:03.595 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:45:03.595 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:45:03.608 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:45:03.609 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:45:03.609 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-10-14T18:45:03.608+0000 7f2cda4fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T18:45:03.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.653+0000 7fc6cdc8b700 1 Processor -- start 2023-10-14T18:45:03.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.653+0000 7fc6cdc8b700 1 -- start start 2023-10-14T18:45:03.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cdc8b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80afcf0 0x7fc6c8070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cdc8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6c806eaa0 0x7fc6c81597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cdc8b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c815dd90 con 0x7fc6c80708c0 2023-10-14T18:45:03.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cdc8b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c806f960 con 0x7fc6c806eaa0 2023-10-14T18:45:03.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cdc8b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c806f3a0 con 0x7fc6c80afcf0 2023-10-14T18:45:03.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cd48a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc6c806eaa0 0x7fc6c81597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6ccc89700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc6c80708c0 0x7fc6c815e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60622/0 (socket says 172.21.15.79:60622) 2023-10-14T18:45:03.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6ccc89700 1 -- 172.21.15.79:0/853057557 learned_addr learned my addr 172.21.15.79:0/853057557 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:03.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6bffff700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80afcf0 0x7fc6c8070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cd48a700 1 -- 172.21.15.79:0/853057557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80afcf0 msgr2=0x7fc6c8070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:03.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cd48a700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80afcf0 0x7fc6c8070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cd48a700 1 -- 172.21.15.79:0/853057557 >> v1:172.21.15.79:6789/0 conn(0x7fc6c80708c0 legacy=0x7fc6c815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6cd48a700 1 -- 172.21.15.79:0/853057557 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c806f680 con 0x7fc6c806eaa0 2023-10-14T18:45:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.654+0000 7fc6bf7fe700 1 -- 172.21.15.79:0/853057557 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747175584 0 0) 0x7fc6c815dd90 con 0x7fc6c80708c0 2023-10-14T18:45:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cd48a700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c81597a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00098e0 tx=0x7fc6c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dcb9b14cd69fb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6bf7fe700 1 -- 172.21.15.79:0/853057557 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000b640 con 0x7fc6c806eaa0 2023-10-14T18:45:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6bf7fe700 1 -- 172.21.15.79:0/853057557 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000b7a0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6bf7fe700 1 -- 172.21.15.79:0/853057557 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000bb40 con 0x7fc6c806eaa0 2023-10-14T18:45:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/853057557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 msgr2=0x7fc6c81597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c81597a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00098e0 tx=0x7fc6c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/853057557 shutdown_connections 2023-10-14T18:45:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c81597a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/853057557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80afcf0 0x7fc6c8070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/853057557 >> 172.21.15.79:0/853057557 conn(0x7fc6c80cd8f0 msgr2=0x7fc6c80cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/853057557 shutdown_connections 2023-10-14T18:45:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.655+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/853057557 wait complete. 2023-10-14T18:45:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.656+0000 7fc6cdc8b700 1 Processor -- start 2023-10-14T18:45:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 -- start start 2023-10-14T18:45:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80708c0 0x7fc6c8067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c80afcf0 0x7fc6c8067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c7060 con 0x7fc6c806eaa0 2023-10-14T18:45:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8155320 con 0x7fc6c80afcf0 2023-10-14T18:45:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6cdc8b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80c6450 con 0x7fc6c80708c0 2023-10-14T18:45:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6ccc89700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6ccc89700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51588/0 (socket says 172.21.15.79:51588) 2023-10-14T18:45:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6ccc89700 1 -- 172.21.15.79:0/1399815103 learned_addr learned my addr 172.21.15.79:0/1399815103 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.657+0000 7fc6bffff700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80708c0 0x7fc6c8067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6cd48a700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c80afcf0 0x7fc6c8067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 -- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80708c0 msgr2=0x7fc6c8067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80708c0 0x7fc6c8067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 -- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c80afcf0 msgr2=0x7fc6c8067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c80afcf0 0x7fc6c8067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 -- 172.21.15.79:0/1399815103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009420 con 0x7fc6c806eaa0 2023-10-14T18:45:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6ccc89700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cc70 tx=0x7fc6c4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400a890 con 0x7fc6c806eaa0 2023-10-14T18:45:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c400a9f0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400adb0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c80c6730 con 0x7fc6c806eaa0 2023-10-14T18:45:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.658+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80c6cf0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.659+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c806d640 con 0x7fc6c806eaa0 2023-10-14T18:45:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.659+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6c4007300 con 0x7fc6c806eaa0 2023-10-14T18:45:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.660+0000 7fc6bcff9700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 0x7fc6b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.660+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc6c4084490 con 0x7fc6c806eaa0 2023-10-14T18:45:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.660+0000 7fc6bffff700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 0x7fc6b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.660+0000 7fc6bffff700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 0x7fc6b40693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8155f90 tx=0x7fc6b80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.664+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6c4051ad0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.846+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c804bb80 con 0x7fc6c806eaa0 2023-10-14T18:45:03.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.847+0000 7fc6bcff9700 1 -- 172.21.15.79:0/1399815103 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fc6c40550f0 con 0x7fc6c806eaa0 2023-10-14T18:45:03.848 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:03.848 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:01.133055+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 msgr2=0x7fc6b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 0x7fc6b40693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8155f90 tx=0x7fc6b80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 msgr2=0x7fc6c8154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400cc70 tx=0x7fc6c4001a30 comp rx=0 tx=0).stop 2023-10-14T18:45:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 shutdown_connections 2023-10-14T18:45:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc6b4066f30 0x7fc6b40693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6c80afcf0 0x7fc6c8067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6c806eaa0 0x7fc6c8154de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 --2- 172.21.15.79:0/1399815103 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6c80708c0 0x7fc6c8067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.848+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 >> 172.21.15.79:0/1399815103 conn(0x7fc6c80cd8f0 msgr2=0x7fc6c80cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.849+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 shutdown_connections 2023-10-14T18:45:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.849+0000 7fc6cdc8b700 1 -- 172.21.15.79:0/1399815103 wait complete. 2023-10-14T18:45:03.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:45:03.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:03.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.977+0000 7f89f7e5f700 1 Processor -- start 2023-10-14T18:45:03.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.977+0000 7f89f7e5f700 1 -- start start 2023-10-14T18:45:03.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f7e5f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89f00cd300 0x7f89f015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f7e5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f00d1470 0x7f89f00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f7e5f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f01513f0 con 0x7f89f00b6760 2023-10-14T18:45:03.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f7e5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f015e7a0 con 0x7f89f00d1470 2023-10-14T18:45:03.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f7e5f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f015db20 con 0x7f89f00cd300 2023-10-14T18:45:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f63fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f00d1470 0x7f89f00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f63fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f00d1470 0x7f89f00cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51604/0 (socket says 172.21.15.79:51604) 2023-10-14T18:45:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f63fc700 1 -- 172.21.15.79:0/288329316 learned_addr learned my addr 172.21.15.79:0/288329316 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.978+0000 7f89f5bfb700 1 --2- 172.21.15.79:0/288329316 >> v2:172.21.15.144:3300/0 conn(0x7f89f00cd300 0x7f89f015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f63fc700 1 -- 172.21.15.79:0/288329316 >> v2:172.21.15.144:3300/0 conn(0x7f89f00cd300 msgr2=0x7f89f015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f63fc700 1 --2- 172.21.15.79:0/288329316 >> v2:172.21.15.144:3300/0 conn(0x7f89f00cd300 0x7f89f015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f63fc700 1 -- 172.21.15.79:0/288329316 >> v1:172.21.15.144:6789/0 conn(0x7f89f00b6760 legacy=0x7f89f00d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f63fc700 1 -- 172.21.15.79:0/288329316 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f015de00 con 0x7f89f00d1470 2023-10-14T18:45:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f63fc700 1 --2- 172.21.15.79:0/288329316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00cf310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89f0089ea0 tx=0x7f89e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699cc8b5c208998a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f4bf9700 1 -- 172.21.15.79:0/288329316 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800b820 con 0x7f89f00d1470 2023-10-14T18:45:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f4bf9700 1 -- 172.21.15.79:0/288329316 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e800b980 con 0x7f89f00d1470 2023-10-14T18:45:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f4bf9700 1 -- 172.21.15.79:0/288329316 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800bd20 con 0x7f89f00d1470 2023-10-14T18:45:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f7e5f700 1 -- 172.21.15.79:0/288329316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 msgr2=0x7f89f00cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.979+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/288329316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00cf310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89f0089ea0 tx=0x7f89e8009250 comp rx=0 tx=0).stop 2023-10-14T18:45:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 -- 172.21.15.79:0/288329316 shutdown_connections 2023-10-14T18:45:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/288329316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00cf310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/288329316 >> v2:172.21.15.144:3300/0 conn(0x7f89f00cd300 0x7f89f015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 -- 172.21.15.79:0/288329316 >> 172.21.15.79:0/288329316 conn(0x7f89f0068d90 msgr2=0x7f89f0069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 -- 172.21.15.79:0/288329316 shutdown_connections 2023-10-14T18:45:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.980+0000 7f89f7e5f700 1 -- 172.21.15.79:0/288329316 wait complete. 2023-10-14T18:45:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 Processor -- start 2023-10-14T18:45:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 -- start start 2023-10-14T18:45:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f00b6760 0x7f89f0169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89f00cd300 0x7f89f015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015d890 con 0x7f89f00d1470 2023-10-14T18:45:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f014d5a0 con 0x7f89f00b6760 2023-10-14T18:45:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f7e5f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f015cff0 con 0x7f89f00cd300 2023-10-14T18:45:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.981+0000 7f89f63fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51614/0 (socket says 172.21.15.79:51614) 2023-10-14T18:45:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 -- 172.21.15.79:0/388311476 learned_addr learned my addr 172.21.15.79:0/388311476 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f5bfb700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f00b6760 0x7f89f0169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f53fa700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89f00cd300 0x7f89f015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 -- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89f00cd300 msgr2=0x7f89f015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89f00cd300 0x7f89f015c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 -- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f00b6760 msgr2=0x7f89f0169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f00b6760 0x7f89f0169540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 -- 172.21.15.79:0/388311476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094f0 con 0x7f89f00d1470 2023-10-14T18:45:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f63fc700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009290 tx=0x7f89e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e801b450 con 0x7f89f00d1470 2023-10-14T18:45:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8020070 con 0x7f89f00d1470 2023-10-14T18:45:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f015d2d0 con 0x7f89f00d1470 2023-10-14T18:45:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e801b820 con 0x7f89f00d1470 2023-10-14T18:45:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.982+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f015cce0 con 0x7f89f00d1470 2023-10-14T18:45:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.983+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f004c3c0 con 0x7f89f00d1470 2023-10-14T18:45:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.984+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89e8022030 con 0x7f89f00d1470 2023-10-14T18:45:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.984+0000 7f89e5ffb700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.984+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f89e8086210 con 0x7f89f00d1470 2023-10-14T18:45:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.984+0000 7f89f5bfb700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.985+0000 7f89f5bfb700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 0x7f89d40693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009fd0 tx=0x7f89ec009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:03.988+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89e80537d0 con 0x7f89f00d1470 2023-10-14T18:45:04.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.168+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89f004c3c0 con 0x7f89f00d1470 2023-10-14T18:45:04.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.169+0000 7f89e5ffb700 1 -- 172.21.15.79:0/388311476 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89e8056df0 con 0x7f89f00d1470 2023-10-14T18:45:04.170 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:04.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 msgr2=0x7f89d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 0x7f89d40693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009fd0 tx=0x7f89ec009880 comp rx=0 tx=0).stop 2023-10-14T18:45:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 msgr2=0x7f89f00b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009290 tx=0x7f89e8016000 comp rx=0 tx=0).stop 2023-10-14T18:45:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 shutdown_connections 2023-10-14T18:45:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f89d4066f30 0x7f89d40693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f00d1470 0x7f89f00b0d70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f00b6760 0x7f89f0169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 --2- 172.21.15.79:0/388311476 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f89f00cd300 0x7f89f015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.170+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 >> 172.21.15.79:0/388311476 conn(0x7f89f0068d90 msgr2=0x7f89f014e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.171+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 shutdown_connections 2023-10-14T18:45:04.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.171+0000 7f89f7e5f700 1 -- 172.21.15.79:0/388311476 wait complete. 2023-10-14T18:45:04.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 Processor -- start 2023-10-14T18:45:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 -- start start 2023-10-14T18:45:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04640b0e50 0x7f04640c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04640b1220 0x7f046406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 0x7f04640cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046415de60 con 0x7f04640b0e50 2023-10-14T18:45:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046415e140 con 0x7f04640b1220 2023-10-14T18:45:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.296+0000 7f0469dab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046415e420 con 0x7f046406dad0 2023-10-14T18:45:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04640b0e50 0x7f04640c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04640b0e50 0x7f04640c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51622/0 (socket says 172.21.15.79:51622) 2023-10-14T18:45:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 -- 172.21.15.79:0/2119677216 learned_addr learned my addr 172.21.15.79:0/2119677216 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f0462ffd700 1 --2- 172.21.15.79:0/2119677216 >> v2:172.21.15.144:3300/0 conn(0x7f04640b1220 0x7f046406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f0463fff700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 0x7f04640cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 -- 172.21.15.79:0/2119677216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 msgr2=0x7f04640cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 0x7f04640cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 -- 172.21.15.79:0/2119677216 >> v2:172.21.15.144:3300/0 conn(0x7f04640b1220 msgr2=0x7f046406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 --2- 172.21.15.79:0/2119677216 >> v2:172.21.15.144:3300/0 conn(0x7f04640b1220 0x7f046406d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 -- 172.21.15.79:0/2119677216 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046415e700 con 0x7f04640b0e50 2023-10-14T18:45:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f0463fff700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 0x7f04640cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04637fe700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b0e50 0x7f04640c9180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f046406cd30 tx=0x7f0454009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cf9c9d17294b02 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04627fc700 1 -- 172.21.15.79:0/2119677216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454009e70 con 0x7f04640b0e50 2023-10-14T18:45:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04627fc700 1 -- 172.21.15.79:0/2119677216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045400b860 con 0x7f04640b0e50 2023-10-14T18:45:04.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.297+0000 7f04627fc700 1 -- 172.21.15.79:0/2119677216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400bc20 con 0x7f04640b0e50 2023-10-14T18:45:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 -- 172.21.15.79:0/2119677216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b0e50 msgr2=0x7f04640c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b0e50 0x7f04640c9180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f046406cd30 tx=0x7f0454009250 comp rx=0 tx=0).stop 2023-10-14T18:45:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 -- 172.21.15.79:0/2119677216 shutdown_connections 2023-10-14T18:45:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f046406dad0 0x7f04640cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 --2- 172.21.15.79:0/2119677216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b0e50 0x7f04640c9180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 --2- 172.21.15.79:0/2119677216 >> v2:172.21.15.144:3300/0 conn(0x7f04640b1220 0x7f046406d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 -- 172.21.15.79:0/2119677216 >> 172.21.15.79:0/2119677216 conn(0x7f0464069870 msgr2=0x7f0464069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:04.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 -- 172.21.15.79:0/2119677216 shutdown_connections 2023-10-14T18:45:04.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.298+0000 7f0469dab700 1 -- 172.21.15.79:0/2119677216 wait complete. 2023-10-14T18:45:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.299+0000 7f0469dab700 1 Processor -- start 2023-10-14T18:45:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.299+0000 7f0469dab700 1 -- start start 2023-10-14T18:45:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046406dad0 0x7f0464145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04640b0e50 0x7f04640cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640c75c0 con 0x7f04640b1220 2023-10-14T18:45:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464153af0 con 0x7f046406dad0 2023-10-14T18:45:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046416e0b0 con 0x7f04640b0e50 2023-10-14T18:45:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51624/0 (socket says 172.21.15.79:51624) 2023-10-14T18:45:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 -- 172.21.15.79:0/1091573302 learned_addr learned my addr 172.21.15.79:0/1091573302 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f04637fe700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046406dad0 0x7f0464145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0462ffd700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04640b0e50 0x7f04640cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 -- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04640b0e50 msgr2=0x7f04640cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04640b0e50 0x7f04640cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 -- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046406dad0 msgr2=0x7f0464145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046406dad0 0x7f0464145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 -- 172.21.15.79:0/1091573302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540094f0 con 0x7f04640b1220 2023-10-14T18:45:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0463fff700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f045c00d0d0 tx=0x7f045c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00dc10 con 0x7f04640b1220 2023-10-14T18:45:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00f040 con 0x7f04640b1220 2023-10-14T18:45:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046416e390 con 0x7f04640b1220 2023-10-14T18:45:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c015400 con 0x7f04640b1220 2023-10-14T18:45:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.300+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046416e950 con 0x7f04640b1220 2023-10-14T18:45:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.301+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04640c7750 con 0x7f04640b1220 2023-10-14T18:45:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.302+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f045c015770 con 0x7f04640b1220 2023-10-14T18:45:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.302+0000 7f044b7fe700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:04.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.302+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f045c084940 con 0x7f04640b1220 2023-10-14T18:45:04.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.302+0000 7f04637fe700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:04.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.303+0000 7f04637fe700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f046406cd30 tx=0x7f0454017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:04.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.306+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04640c7750 con 0x7f04640b1220 2023-10-14T18:45:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.532+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04640c7700 con 0x7f04640b1220 2023-10-14T18:45:04.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.533+0000 7f044b7fe700 1 -- 172.21.15.79:0/1091573302 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f045c051f00 con 0x7f04640b1220 2023-10-14T18:45:04.534 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:04.534 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-14T18:45:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 msgr2=0x7f04500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f046406cd30 tx=0x7f0454017000 comp rx=0 tx=0).stop 2023-10-14T18:45:04.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 msgr2=0x7f0464156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f045c00d0d0 tx=0x7f045c0099f0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 shutdown_connections 2023-10-14T18:45:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04640b1220 0x7f0464156340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f046406dad0 0x7f0464145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 --2- 172.21.15.79:0/1091573302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04640b0e50 0x7f04640cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 >> 172.21.15.79:0/1091573302 conn(0x7f0464069870 msgr2=0x7f04640c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 shutdown_connections 2023-10-14T18:45:04.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:04.535+0000 7f0469dab700 1 -- 172.21.15.79:0/1091573302 wait complete. 2023-10-14T18:45:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 2 2023-10-14T18:45:06.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.672+0000 7f34474a8700 1 Processor -- start 2023-10-14T18:45:06.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 -- start start 2023-10-14T18:45:06.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34401523e0 0x7f344006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 0x7f34400cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344006c010 con 0x7f3440152010 2023-10-14T18:45:06.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344006bd10 con 0x7f34401523e0 2023-10-14T18:45:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.673+0000 7f34474a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344015c060 con 0x7f3440158e50 2023-10-14T18:45:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34401523e0 0x7f344006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f34401523e0 0x7f344006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51636/0 (socket says 172.21.15.79:51636) 2023-10-14T18:45:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 -- 172.21.15.79:0/2253999991 learned_addr learned my addr 172.21.15.79:0/2253999991 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:06.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3445a45700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 0x7f34400cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 -- 172.21.15.79:0/2253999991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 msgr2=0x7f34400cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 0x7f34400cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 -- 172.21.15.79:0/2253999991 >> v1:172.21.15.144:6789/0 conn(0x7f3440152010 legacy=0x7f344015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 -- 172.21.15.79:0/2253999991 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344015c340 con 0x7f34401523e0 2023-10-14T18:45:06.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3445a45700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 0x7f34400cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3444a43700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34401523e0 0x7f344006c4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34300099b0 tx=0x7f3430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9fae17683eb641 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3437fff700 1 -- 172.21.15.79:0/2253999991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000b860 con 0x7f34401523e0 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3437fff700 1 -- 172.21.15.79:0/2253999991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000b9c0 con 0x7f34401523e0 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.674+0000 7f3437fff700 1 -- 172.21.15.79:0/2253999991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000bd60 con 0x7f34401523e0 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 -- 172.21.15.79:0/2253999991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34401523e0 msgr2=0x7f344006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34401523e0 0x7f344006c4a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34300099b0 tx=0x7f3430009250 comp rx=0 tx=0).stop 2023-10-14T18:45:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 -- 172.21.15.79:0/2253999991 shutdown_connections 2023-10-14T18:45:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3440158e50 0x7f34400cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 --2- 172.21.15.79:0/2253999991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34401523e0 0x7f344006c4a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 -- 172.21.15.79:0/2253999991 >> 172.21.15.79:0/2253999991 conn(0x7f3440069870 msgr2=0x7f3440069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:06.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 -- 172.21.15.79:0/2253999991 shutdown_connections 2023-10-14T18:45:06.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.675+0000 7f34474a8700 1 -- 172.21.15.79:0/2253999991 wait complete. 2023-10-14T18:45:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.676+0000 7f34474a8700 1 Processor -- start 2023-10-14T18:45:06.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.676+0000 7f34474a8700 1 -- start start 2023-10-14T18:45:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34401523e0 0x7f3440068f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3440158e50 0x7f3440150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344015b0c0 con 0x7f3440152010 2023-10-14T18:45:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400c5bf0 con 0x7f3440158e50 2023-10-14T18:45:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f34474a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34400c5e90 con 0x7f34401523e0 2023-10-14T18:45:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51652/0 (socket says 172.21.15.79:51652) 2023-10-14T18:45:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 -- 172.21.15.79:0/2347365332 learned_addr learned my addr 172.21.15.79:0/2347365332 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:06.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445a45700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3440158e50 0x7f3440150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3444a43700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34401523e0 0x7f3440068f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 -- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34401523e0 msgr2=0x7f3440068f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34401523e0 0x7f3440068f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 -- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3440158e50 msgr2=0x7f3440150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3440158e50 0x7f3440150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.677+0000 7f3445244700 1 -- 172.21.15.79:0/2347365332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300094f0 con 0x7f3440152010 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f3445244700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f343c00c8e0 tx=0x7f343c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c012630 con 0x7f3440152010 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0127b0 con 0x7f3440152010 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34400c6170 con 0x7f3440152010 2023-10-14T18:45:06.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c012b70 con 0x7f3440152010 2023-10-14T18:45:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.678+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34400c6730 con 0x7f3440152010 2023-10-14T18:45:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.679+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344004c3c0 con 0x7f3440152010 2023-10-14T18:45:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.679+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f343c003030 con 0x7f3440152010 2023-10-14T18:45:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.680+0000 7f34357fa700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 0x7f34240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:06.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.680+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f343c084120 con 0x7f3440152010 2023-10-14T18:45:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.680+0000 7f3444a43700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 0x7f34240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.680+0000 7f3444a43700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 0x7f34240693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34300099b0 tx=0x7f3430017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.684+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f343c0516e0 con 0x7f3440152010 2023-10-14T18:45:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.905+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3440067660 con 0x7f3440152010 2023-10-14T18:45:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.906+0000 7f34357fa700 1 -- 172.21.15.79:0/2347365332 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f343c054d00 con 0x7f3440152010 2023-10-14T18:45:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:06.907 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-14T18:45:06.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 msgr2=0x7f34240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 0x7f34240693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34300099b0 tx=0x7f3430017000 comp rx=0 tx=0).stop 2023-10-14T18:45:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 msgr2=0x7f344014e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f343c00c8e0 tx=0x7f343c001710 comp rx=0 tx=0).stop 2023-10-14T18:45:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 shutdown_connections 2023-10-14T18:45:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3424066f30 0x7f34240693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3440158e50 0x7f3440150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3440152010 0x7f344014e330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 --2- 172.21.15.79:0/2347365332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34401523e0 0x7f3440068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 >> 172.21.15.79:0/2347365332 conn(0x7f3440069870 msgr2=0x7f344006c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 shutdown_connections 2023-10-14T18:45:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:06.908+0000 7f34474a8700 1 -- 172.21.15.79:0/2347365332 wait complete. 2023-10-14T18:45:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2023-10-14T18:45:06.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.033+0000 7efcce4ae700 1 Processor -- start 2023-10-14T18:45:07.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.033+0000 7efcce4ae700 1 -- start start 2023-10-14T18:45:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcce4ae700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcc80cf060 0x7efcc80b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcce4ae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc8067800 con 0x7efcc8159fb0 2023-10-14T18:45:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcce4ae700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc8067ae0 con 0x7efcc8159be0 2023-10-14T18:45:07.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcce4ae700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc80701f0 con 0x7efcc80cf060 2023-10-14T18:45:07.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccccab700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efcc8159fb0 0x7efcc80ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60634/0 (socket says 172.21.15.79:60634) 2023-10-14T18:45:07.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccccab700 1 -- 172.21.15.79:0/3416469708 learned_addr learned my addr 172.21.15.79:0/3416469708 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:07.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccdcad700 1 --2- 172.21.15.79:0/3416469708 >> v2:172.21.15.79:3300/0 conn(0x7efcc80cf060 0x7efcc80b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcbffff700 1 -- 172.21.15.79:0/3416469708 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271870597 0 0) 0x7efcc8067800 con 0x7efcc8159fb0 2023-10-14T18:45:07.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efcbffff700 1 -- 172.21.15.79:0/3416469708 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb4003570 con 0x7efcc8159fb0 2023-10-14T18:45:07.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccdcad700 1 -- 172.21.15.79:0/3416469708 >> v1:172.21.15.144:6789/0 conn(0x7efcc8159be0 legacy=0x7efcc8068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccdcad700 1 -- 172.21.15.79:0/3416469708 >> v1:172.21.15.79:6789/0 conn(0x7efcc8159fb0 legacy=0x7efcc80ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.034+0000 7efccdcad700 1 -- 172.21.15.79:0/3416469708 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8067dc0 con 0x7efcc80cf060 2023-10-14T18:45:07.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efccdcad700 1 --2- 172.21.15.79:0/3416469708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b3c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098e0 tx=0x7efcc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f1d1be6e4c9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcbffff700 1 -- 172.21.15.79:0/3416469708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000b640 con 0x7efcc80cf060 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcbffff700 1 -- 172.21.15.79:0/3416469708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000b7a0 con 0x7efcc80cf060 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcbffff700 1 -- 172.21.15.79:0/3416469708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000bb40 con 0x7efcc80cf060 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 -- 172.21.15.79:0/3416469708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 msgr2=0x7efcc80b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 --2- 172.21.15.79:0/3416469708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b3c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098e0 tx=0x7efcc00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 -- 172.21.15.79:0/3416469708 shutdown_connections 2023-10-14T18:45:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 --2- 172.21.15.79:0/3416469708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b3c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 -- 172.21.15.79:0/3416469708 >> 172.21.15.79:0/3416469708 conn(0x7efcc806bc70 msgr2=0x7efcc806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 -- 172.21.15.79:0/3416469708 shutdown_connections 2023-10-14T18:45:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.035+0000 7efcce4ae700 1 -- 172.21.15.79:0/3416469708 wait complete. 2023-10-14T18:45:07.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.036+0000 7efcce4ae700 1 Processor -- start 2023-10-14T18:45:07.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 -- start start 2023-10-14T18:45:07.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 0x7efcc8145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc8159fb0 0x7efcc815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80c6590 con 0x7efcc80cf060 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80b3f20 con 0x7efcc8159be0 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efcce4ae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80b4200 con 0x7efcc8159fb0 2023-10-14T18:45:07.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efccd4ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efccd4ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51674/0 (socket says 172.21.15.79:51674) 2023-10-14T18:45:07.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.037+0000 7efccd4ac700 1 -- 172.21.15.79:0/934625129 learned_addr learned my addr 172.21.15.79:0/934625129 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:07.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 -- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc8159fb0 msgr2=0x7efcc815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc8159fb0 0x7efcc815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccccab700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 0x7efcc8145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 -- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 msgr2=0x7efcc8145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 0x7efcc8145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 -- 172.21.15.79:0/934625129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009420 con 0x7efcc80cf060 2023-10-14T18:45:07.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccccab700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 0x7efcc8145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:07.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efccd4ac700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcc400cb10 tx=0x7efcc40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400a760 con 0x7efcc80cf060 2023-10-14T18:45:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400a8e0 con 0x7efcc80cf060 2023-10-14T18:45:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc80b44e0 con 0x7efcc80cf060 2023-10-14T18:45:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400aca0 con 0x7efcc80cf060 2023-10-14T18:45:07.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.038+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc80b1cb0 con 0x7efcc80cf060 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.039+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc80c6700 con 0x7efcc80cf060 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.039+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcc4003030 con 0x7efcc80cf060 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.040+0000 7efcbd7fa700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.040+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efcc4084280 con 0x7efcc80cf060 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.040+0000 7efccccab700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.040+0000 7efccccab700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb80058d0 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.044+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcc4051840 con 0x7efcc80cf060 2023-10-14T18:45:07.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.225+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcc804bb80 con 0x7efcc80cf060 2023-10-14T18:45:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.225+0000 7efcbd7fa700 1 -- 172.21.15.79:0/934625129 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7efcc4054e60 con 0x7efcc80cf060 2023-10-14T18:45:07.226 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:07.227 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:01.133055+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 msgr2=0x7efcac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 0x7efcac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb80058d0 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2023-10-14T18:45:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 msgr2=0x7efcc80b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efcc400cb10 tx=0x7efcc40017b0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 shutdown_connections 2023-10-14T18:45:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efcac066f30 0x7efcac0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcc8159fb0 0x7efcc815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcc80cf060 0x7efcc80b1770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 --2- 172.21.15.79:0/934625129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcc8159be0 0x7efcc8145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 >> 172.21.15.79:0/934625129 conn(0x7efcc806bc70 msgr2=0x7efcc8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.227+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 shutdown_connections 2023-10-14T18:45:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.228+0000 7efcce4ae700 1 -- 172.21.15.79:0/934625129 wait complete. 2023-10-14T18:45:07.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:45:07.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.358+0000 7f234b068700 1 Processor -- start 2023-10-14T18:45:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.358+0000 7f234b068700 1 -- start start 2023-10-14T18:45:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.359+0000 7f234b068700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23441413b0 0x7f2344068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.359+0000 7f234b068700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.359+0000 7f234b068700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234406e8a0 con 0x7f234406e2e0 2023-10-14T18:45:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.359+0000 7f234b068700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234406eb80 con 0x7f23441413b0 2023-10-14T18:45:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.359+0000 7f234b068700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234406ee60 con 0x7f2344141780 2023-10-14T18:45:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23441413b0 0x7f2344068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2349605700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f234406e2e0 0x7f2344067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:57436/0 (socket says 172.21.15.79:57436) 2023-10-14T18:45:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23441413b0 0x7f2344068a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51678/0 (socket says 172.21.15.79:51678) 2023-10-14T18:45:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2343fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2349605700 1 -- 172.21.15.79:0/238886351 learned_addr learned my addr 172.21.15.79:0/238886351 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 -- 172.21.15.79:0/238886351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 msgr2=0x7f2344070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 --2- 172.21.15.79:0/238886351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 -- 172.21.15.79:0/238886351 >> v1:172.21.15.144:6789/0 conn(0x7f234406e2e0 legacy=0x7f2344067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 -- 172.21.15.79:0/238886351 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234406f140 con 0x7f23441413b0 2023-10-14T18:45:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f23437fe700 1 -- 172.21.15.79:0/238886351 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273746543 0 0) 0x7f234406e8a0 con 0x7f234406e2e0 2023-10-14T18:45:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f2348e04700 1 --2- 172.21.15.79:0/238886351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344068a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2334009e60 tx=0x7f2334009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49fda9f83189daa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f23437fe700 1 -- 172.21.15.79:0/238886351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400e070 con 0x7f23441413b0 2023-10-14T18:45:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f23437fe700 1 -- 172.21.15.79:0/238886351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400bb60 con 0x7f23441413b0 2023-10-14T18:45:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.360+0000 7f23437fe700 1 -- 172.21.15.79:0/238886351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012430 con 0x7f23441413b0 2023-10-14T18:45:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 -- 172.21.15.79:0/238886351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 msgr2=0x7f2344068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 --2- 172.21.15.79:0/238886351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344068a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2334009e60 tx=0x7f2334009780 comp rx=0 tx=0).stop 2023-10-14T18:45:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 -- 172.21.15.79:0/238886351 shutdown_connections 2023-10-14T18:45:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 --2- 172.21.15.79:0/238886351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344068a10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 --2- 172.21.15.79:0/238886351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 -- 172.21.15.79:0/238886351 >> 172.21.15.79:0/238886351 conn(0x7f23440ce570 msgr2=0x7f23440ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 -- 172.21.15.79:0/238886351 shutdown_connections 2023-10-14T18:45:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.361+0000 7f234b068700 1 -- 172.21.15.79:0/238886351 wait complete. 2023-10-14T18:45:07.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.362+0000 7f234b068700 1 Processor -- start 2023-10-14T18:45:07.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.362+0000 7f234b068700 1 -- start start 2023-10-14T18:45:07.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f234406e2e0 0x7f234415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c5110 con 0x7f23441413b0 2023-10-14T18:45:07.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c53f0 con 0x7f234406e2e0 2023-10-14T18:45:07.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c56d0 con 0x7f2344141780 2023-10-14T18:45:07.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51682/0 (socket says 172.21.15.79:51682) 2023-10-14T18:45:07.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 -- 172.21.15.79:0/1367681419 learned_addr learned my addr 172.21.15.79:0/1367681419 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:07.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2348e04700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f234406e2e0 0x7f234415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2349605700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 -- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 msgr2=0x7f2344070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 -- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f234406e2e0 msgr2=0x7f234415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f234406e2e0 0x7f234415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 -- 172.21.15.79:0/1367681419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009a20 con 0x7f23441413b0 2023-10-14T18:45:07.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2349605700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:07.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2343fff700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f232c00e900 tx=0x7f232c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c013680 con 0x7f23441413b0 2023-10-14T18:45:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c0137e0 con 0x7f23441413b0 2023-10-14T18:45:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c59b0 con 0x7f23441413b0 2023-10-14T18:45:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c013ba0 con 0x7f23441413b0 2023-10-14T18:45:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.363+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234415a990 con 0x7f23441413b0 2023-10-14T18:45:07.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.364+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234404c3c0 con 0x7f23441413b0 2023-10-14T18:45:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.365+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f232c00c460 con 0x7f23441413b0 2023-10-14T18:45:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.365+0000 7f2340ff9700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 0x7f23240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.365+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f232c084320 con 0x7f23441413b0 2023-10-14T18:45:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.365+0000 7f2348e04700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 0x7f23240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.365+0000 7f2348e04700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 0x7f23240693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f23340097c0 tx=0x7f2334019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.369+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f232c0518e0 con 0x7f23441413b0 2023-10-14T18:45:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.554+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f234406f420 con 0x7f23441413b0 2023-10-14T18:45:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.554+0000 7f2340ff9700 1 -- 172.21.15.79:0/1367681419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f232c054f00 con 0x7f23441413b0 2023-10-14T18:45:07.555 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 msgr2=0x7f23240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 0x7f23240693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f23340097c0 tx=0x7f2334019000 comp rx=0 tx=0).stop 2023-10-14T18:45:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 msgr2=0x7f2344157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f232c00e900 tx=0x7f232c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 shutdown_connections 2023-10-14T18:45:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2324066f30 0x7f23240693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2344141780 0x7f2344070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f234406e2e0 0x7f234415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 --2- 172.21.15.79:0/1367681419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23441413b0 0x7f2344157540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 >> 172.21.15.79:0/1367681419 conn(0x7f23440ce570 msgr2=0x7f23440b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 shutdown_connections 2023-10-14T18:45:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.556+0000 7f234b068700 1 -- 172.21.15.79:0/1367681419 wait complete. 2023-10-14T18:45:07.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:45:07.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.683+0000 7ff759eb3700 1 Processor -- start 2023-10-14T18:45:07.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.683+0000 7ff759eb3700 1 -- start start 2023-10-14T18:45:07.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff759eb3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff75406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff759eb3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75415c360 con 0x7ff75415b0d0 2023-10-14T18:45:07.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff759eb3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff75415b790 con 0x7ff7541577d0 2023-10-14T18:45:07.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff759eb3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75415ba30 con 0x7ff754157ba0 2023-10-14T18:45:07.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff753fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff75415b0d0 0x7ff75415c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60642/0 (socket says 172.21.15.79:60642) 2023-10-14T18:45:07.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff753fff700 1 -- 172.21.15.79:0/33138901 learned_addr learned my addr 172.21.15.79:0/33138901 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:07.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff752ffd700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff75406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283188879 0 0) 0x7ff75415c360 con 0x7ff75415b0d0 2023-10-14T18:45:07.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff73c003570 con 0x7ff75415b0d0 2023-10-14T18:45:07.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3576920882 0 0) 0x7ff73c003570 con 0x7ff75415b0d0 2023-10-14T18:45:07.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 msgr2=0x7ff75406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:07.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff75406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 >> v1:172.21.15.144:6789/0 conn(0x7ff7541577d0 legacy=0x7ff7540cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75415bd10 con 0x7ff75415b0d0 2023-10-14T18:45:07.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff74c0017f0 con 0x7ff75415b0d0 2023-10-14T18:45:07.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 >> v1:172.21.15.79:6789/0 conn(0x7ff75415b0d0 legacy=0x7ff75415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff73c003a90 0x7ff73c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff73c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff73c004d50 0x7ff73c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75415ba30 con 0x7ff73c003a90 2023-10-14T18:45:07.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c00bba0 con 0x7ff73c004d50 2023-10-14T18:45:07.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c00bd60 con 0x7ff754157ba0 2023-10-14T18:45:07.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.684+0000 7ff7537fe700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff73c003a90 0x7ff73c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff752ffd700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff73c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff753fff700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff73c004d50 0x7ff73c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 -- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 msgr2=0x7ff73c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff754157ba0 0x7ff73c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 -- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff73c004d50 msgr2=0x7ff73c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff73c004d50 0x7ff73c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 -- 172.21.15.79:0/33138901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c003570 con 0x7ff73c003a90 2023-10-14T18:45:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7537fe700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff73c003a90 0x7ff73c003ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7440018b0 tx=0x7ff744007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdbd53b15ac265 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744012420 con 0x7ff73c003a90 2023-10-14T18:45:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744012580 con 0x7ff73c003a90 2023-10-14T18:45:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff7527fc700 1 -- 172.21.15.79:0/33138901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744012920 con 0x7ff73c003a90 2023-10-14T18:45:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff759eb3700 1 -- 172.21.15.79:0/33138901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff73c003a90 msgr2=0x7ff73c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff759eb3700 1 --2- 172.21.15.79:0/33138901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff73c003a90 0x7ff73c003ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7440018b0 tx=0x7ff744007d30 comp rx=0 tx=0).stop 2023-10-14T18:45:07.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff753fff700 1 -- 172.21.15.79:0/33138901 reap_dead start 2023-10-14T18:45:07.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff759eb3700 1 -- 172.21.15.79:0/33138901 shutdown_connections 2023-10-14T18:45:07.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.685+0000 7ff759eb3700 1 -- 172.21.15.79:0/33138901 >> 172.21.15.79:0/33138901 conn(0x7ff754068ce0 msgr2=0x7ff7540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.686+0000 7ff759eb3700 1 -- 172.21.15.79:0/33138901 shutdown_connections 2023-10-14T18:45:07.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.686+0000 7ff759eb3700 1 -- 172.21.15.79:0/33138901 wait complete. 2023-10-14T18:45:07.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 Processor -- start 2023-10-14T18:45:07.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 -- start start 2023-10-14T18:45:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff73c003a90 0x7ff7540b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7540a8db0 0x7ff754159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a8920 con 0x7ff7540a7610 2023-10-14T18:45:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a7a80 con 0x7ff7540a8db0 2023-10-14T18:45:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.687+0000 7ff759eb3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a7d10 con 0x7ff73c003a90 2023-10-14T18:45:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51706/0 (socket says 172.21.15.79:51706) 2023-10-14T18:45:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 -- 172.21.15.79:0/4169855418 learned_addr learned my addr 172.21.15.79:0/4169855418 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff753fff700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7540a8db0 0x7ff754159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff7537fe700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff73c003a90 0x7ff7540b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 -- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff73c003a90 msgr2=0x7ff7540b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff73c003a90 0x7ff7540b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 -- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7540a8db0 msgr2=0x7ff754159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7540a8db0 0x7ff754159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 -- 172.21.15.79:0/4169855418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540a7ff0 con 0x7ff7540a7610 2023-10-14T18:45:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff752ffd700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff748011d40 tx=0x7ff7480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74800fa10 con 0x7ff7540a7610 2023-10-14T18:45:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74800fb70 con 0x7ff7540a7610 2023-10-14T18:45:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff748014440 con 0x7ff7540a7610 2023-10-14T18:45:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540a82d0 con 0x7ff7540a7610 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.688+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff754142110 con 0x7ff7540a7610 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.689+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7540a8a90 con 0x7ff7540a7610 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.689+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff748014870 con 0x7ff7540a7610 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.690+0000 7ff73b7fe700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 0x7ff7400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.690+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff748018030 con 0x7ff7540a7610 2023-10-14T18:45:07.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.690+0000 7ff7537fe700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 0x7ff7400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.690+0000 7ff7537fe700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 0x7ff7400693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff744001010 tx=0x7ff744015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:07.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.694+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7480520f0 con 0x7ff7540a7610 2023-10-14T18:45:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.877+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff75404c3c0 con 0x7ff7540a7610 2023-10-14T18:45:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.877+0000 7ff73b7fe700 1 -- 172.21.15.79:0/4169855418 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff748022090 con 0x7ff7540a7610 2023-10-14T18:45:07.879 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:07.879 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:45:07.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:07.879 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:45:07.879 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:45:07.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:07.880 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:45:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 msgr2=0x7ff7400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 0x7ff7400693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff744001010 tx=0x7ff744015000 comp rx=0 tx=0).stop 2023-10-14T18:45:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 msgr2=0x7ff754141bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff748011d40 tx=0x7ff7480091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 shutdown_connections 2023-10-14T18:45:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff740066f30 0x7ff7400693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7540a8db0 0x7ff754159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff73c003a90 0x7ff7540b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 --2- 172.21.15.79:0/4169855418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7540a7610 0x7ff754141bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 >> 172.21.15.79:0/4169855418 conn(0x7ff754068ce0 msgr2=0x7ff754156720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.879+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 shutdown_connections 2023-10-14T18:45:07.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:07.880+0000 7ff759eb3700 1 -- 172.21.15.79:0/4169855418 wait complete. 2023-10-14T18:45:07.892 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:45:07.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:45:08.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 Processor -- start 2023-10-14T18:45:08.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 -- start start 2023-10-14T18:45:08.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd5415ac90 0x7fcd540d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd540d08e0 con 0x7fcd540d1450 2023-10-14T18:45:08.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd54157e90 con 0x7fcd54157ac0 2023-10-14T18:45:08.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.010+0000 7fcd58eae700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5415b2f0 con 0x7fcd5415ac90 2023-10-14T18:45:08.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd52d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd5415ac90 0x7fcd540d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd49d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd540d1450 0x7fcd5415a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60654/0 (socket says 172.21.15.79:60654) 2023-10-14T18:45:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd49d9b700 1 -- 172.21.15.79:0/3059674163 learned_addr learned my addr 172.21.15.79:0/3059674163 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd52d9d700 1 -- 172.21.15.79:0/3059674163 >> v1:172.21.15.144:6789/0 conn(0x7fcd54157ac0 legacy=0x7fcd540d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd52d9d700 1 -- 172.21.15.79:0/3059674163 >> v1:172.21.15.79:6789/0 conn(0x7fcd540d1450 legacy=0x7fcd5415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd51d9b700 1 -- 172.21.15.79:0/3059674163 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529281465 0 0) 0x7fcd3c001110 con 0x7fcd540d1450 2023-10-14T18:45:08.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd52d9d700 1 -- 172.21.15.79:0/3059674163 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540cf8e0 con 0x7fcd5415ac90 2023-10-14T18:45:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd52d9d700 1 --2- 172.21.15.79:0/3059674163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd540d03a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e60 tx=0x7fcd4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480154befec18cab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd51d9b700 1 -- 172.21.15.79:0/3059674163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00e070 con 0x7fcd5415ac90 2023-10-14T18:45:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd51d9b700 1 -- 172.21.15.79:0/3059674163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00bc30 con 0x7fcd5415ac90 2023-10-14T18:45:08.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.011+0000 7fcd51d9b700 1 -- 172.21.15.79:0/3059674163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c012430 con 0x7fcd5415ac90 2023-10-14T18:45:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 -- 172.21.15.79:0/3059674163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 msgr2=0x7fcd540d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 --2- 172.21.15.79:0/3059674163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd540d03a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e60 tx=0x7fcd4c009780 comp rx=0 tx=0).stop 2023-10-14T18:45:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 -- 172.21.15.79:0/3059674163 shutdown_connections 2023-10-14T18:45:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 --2- 172.21.15.79:0/3059674163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd540d03a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 -- 172.21.15.79:0/3059674163 >> 172.21.15.79:0/3059674163 conn(0x7fcd540680f0 msgr2=0x7fcd540b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:08.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 -- 172.21.15.79:0/3059674163 shutdown_connections 2023-10-14T18:45:08.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.012+0000 7fcd58eae700 1 -- 172.21.15.79:0/3059674163 wait complete. 2023-10-14T18:45:08.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.013+0000 7fcd58eae700 1 Processor -- start 2023-10-14T18:45:08.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.013+0000 7fcd58eae700 1 -- start start 2023-10-14T18:45:08.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd540d1450 0x7fcd54152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 0x7fcd5416b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5416b410 con 0x7fcd5415ac90 2023-10-14T18:45:08.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5416d830 con 0x7fcd54157ac0 2023-10-14T18:45:08.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5416ab70 con 0x7fcd540d1450 2023-10-14T18:45:08.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51722/0 (socket says 172.21.15.79:51722) 2023-10-14T18:45:08.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 -- 172.21.15.79:0/454840655 learned_addr learned my addr 172.21.15.79:0/454840655 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:08.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd49d9b700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 0x7fcd5416b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd5259c700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd540d1450 0x7fcd54152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 -- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd540d1450 msgr2=0x7fcd54152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd540d1450 0x7fcd54152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 -- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 msgr2=0x7fcd5416b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 0x7fcd5416b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 -- 172.21.15.79:0/454840655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c009a20 con 0x7fcd5415ac90 2023-10-14T18:45:08.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd49d9b700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 0x7fcd5416b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:08.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd52d9d700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd54158020 tx=0x7fcd4c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c01b630 con 0x7fcd5415ac90 2023-10-14T18:45:08.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c01b790 con 0x7fcd5415ac90 2023-10-14T18:45:08.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c01bb50 con 0x7fcd5415ac90 2023-10-14T18:45:08.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5416ae50 con 0x7fcd5415ac90 2023-10-14T18:45:08.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.014+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd541531e0 con 0x7fcd5415ac90 2023-10-14T18:45:08.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.015+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54153040 con 0x7fcd5415ac90 2023-10-14T18:45:08.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.016+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd4c01c400 con 0x7fcd5415ac90 2023-10-14T18:45:08.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.016+0000 7fcd4affd700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 0x7fcd340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.016+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcd4c086230 con 0x7fcd5415ac90 2023-10-14T18:45:08.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.016+0000 7fcd5259c700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 0x7fcd340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.016+0000 7fcd5259c700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 0x7fcd340693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd540b2d20 tx=0x7fcd44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.020+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd54153040 con 0x7fcd5415ac90 2023-10-14T18:45:08.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.203+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcd54153040 con 0x7fcd5415ac90 2023-10-14T18:45:08.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.486+0000 7fcd4affd700 1 -- 172.21.15.79:0/454840655 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcd54153040 con 0x7fcd5415ac90 2023-10-14T18:45:08.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.489+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 msgr2=0x7fcd340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.489+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 0x7fcd340693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd540b2d20 tx=0x7fcd44009040 comp rx=0 tx=0).stop 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.489+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 msgr2=0x7fcd5416d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.489+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd54158020 tx=0x7fcd4c019000 comp rx=0 tx=0).stop 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 shutdown_connections 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd34066f30 0x7fcd340693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5415ac90 0x7fcd5416d2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd540d1450 0x7fcd54152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 --2- 172.21.15.79:0/454840655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd54157ac0 0x7fcd5416b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 >> 172.21.15.79:0/454840655 conn(0x7fcd540680f0 msgr2=0x7fcd5415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 shutdown_connections 2023-10-14T18:45:08.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.490+0000 7fcd58eae700 1 -- 172.21.15.79:0/454840655 wait complete. 2023-10-14T18:45:08.493 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:45:08.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:45:08.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.624+0000 7fb7e25d7700 1 Processor -- start 2023-10-14T18:45:08.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.624+0000 7fb7e25d7700 1 -- start start 2023-10-14T18:45:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e25d7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc159ec0 0x7fb7dc0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e25d7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7dc15a290 0x7fb7dc0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e25d7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc0b0790 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e25d7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0ce1f0 con 0x7fb7dc15a290 2023-10-14T18:45:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e25d7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0b0b20 con 0x7fb7dc159ec0 2023-10-14T18:45:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7db7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7dc15a290 0x7fb7dc0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e0b74700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb7dc06a5a0 0x7fb7dc15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39626/0 (socket says 172.21.15.79:39626) 2023-10-14T18:45:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7e0b74700 1 -- 172.21.15.79:0/4038744983 learned_addr learned my addr 172.21.15.79:0/4038744983 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7dbfff700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc159ec0 0x7fb7dc0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7db7fe700 1 -- 172.21.15.79:0/4038744983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc159ec0 msgr2=0x7fb7dc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7db7fe700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc159ec0 0x7fb7dc0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.625+0000 7fb7db7fe700 1 -- 172.21.15.79:0/4038744983 >> v1:172.21.15.79:6789/0 conn(0x7fb7dc06a5a0 legacy=0x7fb7dc15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7db7fe700 1 -- 172.21.15.79:0/4038744983 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0b04b0 con 0x7fb7dc15a290 2023-10-14T18:45:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7daffd700 1 -- 172.21.15.79:0/4038744983 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525211120 0 0) 0x7fb7dc0b0790 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7db7fe700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc15a290 0x7fb7dc0afe80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00098e0 tx=0x7fb7d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf739cf320bf1c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7daffd700 1 -- 172.21.15.79:0/4038744983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0009e80 con 0x7fb7dc15a290 2023-10-14T18:45:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7daffd700 1 -- 172.21.15.79:0/4038744983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000b860 con 0x7fb7dc15a290 2023-10-14T18:45:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7daffd700 1 -- 172.21.15.79:0/4038744983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000bbe0 con 0x7fb7dc15a290 2023-10-14T18:45:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 -- 172.21.15.79:0/4038744983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc15a290 msgr2=0x7fb7dc0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc15a290 0x7fb7dc0afe80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00098e0 tx=0x7fb7d00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 -- 172.21.15.79:0/4038744983 shutdown_connections 2023-10-14T18:45:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc159ec0 0x7fb7dc0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/4038744983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc15a290 0x7fb7dc0afe80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 -- 172.21.15.79:0/4038744983 >> 172.21.15.79:0/4038744983 conn(0x7fb7dc0d1880 msgr2=0x7fb7dc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 -- 172.21.15.79:0/4038744983 shutdown_connections 2023-10-14T18:45:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.626+0000 7fb7e25d7700 1 -- 172.21.15.79:0/4038744983 wait complete. 2023-10-14T18:45:08.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.627+0000 7fb7e25d7700 1 Processor -- start 2023-10-14T18:45:08.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 -- start start 2023-10-14T18:45:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7dc159ec0 0x7fb7dc0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc15a290 0x7fb7dc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0c7e60 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0c8700 con 0x7fb7dc159ec0 2023-10-14T18:45:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7e25d7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0c98f0 con 0x7fb7dc15a290 2023-10-14T18:45:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36426/0 (socket says 172.21.15.79:36426) 2023-10-14T18:45:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.628+0000 7fb7dbfff700 1 -- 172.21.15.79:0/1737763442 learned_addr learned my addr 172.21.15.79:0/1737763442 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7e0b74700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc15a290 0x7fb7dc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7db7fe700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7dc159ec0 0x7fb7dc0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 -- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc15a290 msgr2=0x7fb7dc153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc15a290 0x7fb7dc153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 -- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7dc159ec0 msgr2=0x7fb7dc0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7dc159ec0 0x7fb7dc0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 -- 172.21.15.79:0/1737763442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0009420 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7dbfff700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d890 tx=0x7fb7cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00b600 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00b760 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00bae0 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc0c80b0 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.629+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc0c8b90 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.630+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0c89e0 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.630+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7cc01e460 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.630+0000 7fb7c3fff700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 0x7fb7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.631+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb7cc084a00 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.631+0000 7fb7db7fe700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 0x7fb7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.631+0000 7fb7db7fe700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 0x7fb7c80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00091e0 tx=0x7fb7d0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.635+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7cc051e50 con 0x7fb7dc06a5a0 2023-10-14T18:45:08.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:08.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:08.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:08.818+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb7dc0c8d80 con 0x7fb7dc06a5a0 2023-10-14T18:45:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.492+0000 7fb7c3fff700 1 -- 172.21.15.79:0/1737763442 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb7cc055470 con 0x7fb7dc06a5a0 2023-10-14T18:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 msgr2=0x7fb7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 0x7fb7c80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7d00091e0 tx=0x7fb7d0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 msgr2=0x7fb7dc0c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00d890 tx=0x7fb7cc008040 comp rx=0 tx=0).stop 2023-10-14T18:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 shutdown_connections 2023-10-14T18:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7c8066f30 0x7fb7c80693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7dc15a290 0x7fb7dc153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7dc06a5a0 0x7fb7dc0c8f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 --2- 172.21.15.79:0/1737763442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7dc159ec0 0x7fb7dc0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.498+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 >> 172.21.15.79:0/1737763442 conn(0x7fb7dc0d1880 msgr2=0x7fb7dc0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.499+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 shutdown_connections 2023-10-14T18:45:09.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.499+0000 7fb7e25d7700 1 -- 172.21.15.79:0/1737763442 wait complete. 2023-10-14T18:45:09.504 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:45:09.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:45:09.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 Processor -- start 2023-10-14T18:45:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 -- start start 2023-10-14T18:45:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f701579b0 0x7f7f70157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f70158e90 con 0x7f7f700c9c10 2023-10-14T18:45:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7006fca0 con 0x7f7f7006f8d0 2023-10-14T18:45:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.634+0000 7f7f76ae8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f701582c0 con 0x7f7f701579b0 2023-10-14T18:45:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7f700c9c10 0x7f7f7006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39634/0 (socket says 172.21.15.79:39634) 2023-10-14T18:45:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6ffff700 1 -- 172.21.15.79:0/223154892 learned_addr learned my addr 172.21.15.79:0/223154892 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562977901 0 0) 0x7f7f70158e90 con 0x7f7f700c9c10 2023-10-14T18:45:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f74884700 1 --2- 172.21.15.79:0/223154892 >> v2:172.21.15.144:3300/0 conn(0x7f7f701579b0 0x7f7f70157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f58003570 con 0x7f7f700c9c10 2023-10-14T18:45:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718615273 0 0) 0x7f7f58003570 con 0x7f7f700c9c10 2023-10-14T18:45:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 >> v2:172.21.15.144:3300/0 conn(0x7f7f701579b0 msgr2=0x7f7f70157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 --2- 172.21.15.79:0/223154892 >> v2:172.21.15.144:3300/0 conn(0x7f7f701579b0 0x7f7f70157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 >> v1:172.21.15.144:6789/0 conn(0x7f7f7006f8d0 legacy=0x7f7f7015b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70158560 con 0x7f7f700c9c10 2023-10-14T18:45:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7f64001470 con 0x7f7f700c9c10 2023-10-14T18:45:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 >> v1:172.21.15.79:6789/0 conn(0x7f7f700c9c10 legacy=0x7f7f7006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 0x7f7f58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f58004810 0x7f7f58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580051c0 0x7f7f5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701582c0 con 0x7f7f58003a60 2023-10-14T18:45:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5800c0d0 con 0x7f7f580051c0 2023-10-14T18:45:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5800c290 con 0x7f7f58004810 2023-10-14T18:45:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f74884700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 0x7f7f58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f75085700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580051c0 0x7f7f5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.635+0000 7f7f6ffff700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f58004810 0x7f7f58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 -- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f58004810 msgr2=0x7f7f58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f58004810 0x7f7f58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 -- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580051c0 msgr2=0x7f7f5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580051c0 0x7f7f5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 -- 172.21.15.79:0/223154892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58003570 con 0x7f7f58003a60 2023-10-14T18:45:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f75085700 1 -- 172.21.15.79:0/223154892 reap_dead start 2023-10-14T18:45:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f74884700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 0x7f7f58003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000e210 tx=0x7f7f6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5d8acf67150b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000eac0 con 0x7f7f58003a60 2023-10-14T18:45:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000f040 con 0x7f7f58003a60 2023-10-14T18:45:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f6f7fe700 1 -- 172.21.15.79:0/223154892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000ee70 con 0x7f7f58003a60 2023-10-14T18:45:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 -- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 msgr2=0x7f7f58003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 0x7f7f58003e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000e210 tx=0x7f7f6000b040 comp rx=0 tx=0).stop 2023-10-14T18:45:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 -- 172.21.15.79:0/223154892 shutdown_connections 2023-10-14T18:45:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/223154892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f58003a60 0x7f7f58003e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 -- 172.21.15.79:0/223154892 >> 172.21.15.79:0/223154892 conn(0x7f7f70067660 msgr2=0x7f7f70067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 -- 172.21.15.79:0/223154892 shutdown_connections 2023-10-14T18:45:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.636+0000 7f7f76ae8700 1 -- 172.21.15.79:0/223154892 wait complete. 2023-10-14T18:45:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.637+0000 7f7f76ae8700 1 Processor -- start 2023-10-14T18:45:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 -- start start 2023-10-14T18:45:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f58003a60 0x7f7f70099c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f7009a160 0x7f7f7014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70149570 con 0x7f7f7014c030 2023-10-14T18:45:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7014c4b0 con 0x7f7f58003a60 2023-10-14T18:45:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f76ae8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700c3680 con 0x7f7f7009a160 2023-10-14T18:45:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f75085700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f75085700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36438/0 (socket says 172.21.15.79:36438) 2023-10-14T18:45:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.638+0000 7f7f75085700 1 -- 172.21.15.79:0/3201003340 learned_addr learned my addr 172.21.15.79:0/3201003340 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f74884700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f58003a60 0x7f7f70099c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f6ffff700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f7009a160 0x7f7f7014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 -- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f7009a160 msgr2=0x7f7f7014baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f7009a160 0x7f7f7014baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 -- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f58003a60 msgr2=0x7f7f70099c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f58003a60 0x7f7f70099c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 -- 172.21.15.79:0/3201003340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700c3960 con 0x7f7f7014c030 2023-10-14T18:45:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f75085700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006dc80 tx=0x7f7f68007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68006a30 con 0x7f7f7014c030 2023-10-14T18:45:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68006bb0 con 0x7f7f7014c030 2023-10-14T18:45:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700b0010 con 0x7f7f7014c030 2023-10-14T18:45:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68007030 con 0x7f7f7014c030 2023-10-14T18:45:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.639+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700b05d0 con 0x7f7f7014c030 2023-10-14T18:45:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.640+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700b07f0 con 0x7f7f7014c030 2023-10-14T18:45:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.640+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f680073e0 con 0x7f7f7014c030 2023-10-14T18:45:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.641+0000 7f7f6cff9700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 0x7f7f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.641+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7f68083d40 con 0x7f7f7014c030 2023-10-14T18:45:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.641+0000 7f7f74884700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 0x7f7f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.641+0000 7f7f74884700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 0x7f7f5c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000afd0 tx=0x7f7f6001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.645+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f68050f70 con 0x7f7f7014c030 2023-10-14T18:45:09.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:09.871+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f7004c3c0 con 0x7f7f7014c030 2023-10-14T18:45:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.503+0000 7f7f6cff9700 1 -- 172.21.15.79:0/3201003340 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f68019070 con 0x7f7f7014c030 2023-10-14T18:45:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 msgr2=0x7f7f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 0x7f7f5c0693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000afd0 tx=0x7f7f6001a000 comp rx=0 tx=0).stop 2023-10-14T18:45:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 msgr2=0x7f7f700c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006dc80 tx=0x7f7f68007d30 comp rx=0 tx=0).stop 2023-10-14T18:45:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 shutdown_connections 2023-10-14T18:45:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7f5c066f30 0x7f7f5c0693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f7014c030 0x7f7f700c2950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f58003a60 0x7f7f70099c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 --2- 172.21.15.79:0/3201003340 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f7009a160 0x7f7f7014baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 >> 172.21.15.79:0/3201003340 conn(0x7f7f70067660 msgr2=0x7f7f70159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 shutdown_connections 2023-10-14T18:45:10.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.506+0000 7f7f76ae8700 1 -- 172.21.15.79:0/3201003340 wait complete. 2023-10-14T18:45:10.510 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T18:45:10.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:10.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.635+0000 7fe76b3b5700 1 Processor -- start 2023-10-14T18:45:10.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.635+0000 7fe76b3b5700 1 -- start start 2023-10-14T18:45:10.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe764159e10 0x7fe7640b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 0x7fe7640b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640b1610 0x7fe7640cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76415e800 con 0x7fe7640b1610 2023-10-14T18:45:10.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76415db80 con 0x7fe76415a1e0 2023-10-14T18:45:10.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe76b3b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415de60 con 0x7fe764159e10 2023-10-14T18:45:10.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe769952700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640b1610 0x7fe7640cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe769952700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7640b1610 0x7fe7640cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36444/0 (socket says 172.21.15.79:36444) 2023-10-14T18:45:10.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.636+0000 7fe769952700 1 -- 172.21.15.79:0/3981303411 learned_addr learned my addr 172.21.15.79:0/3981303411 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:10.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe768950700 1 --2- 172.21.15.79:0/3981303411 >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 0x7fe7640b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769151700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe764159e10 0x7fe7640b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 -- 172.21.15.79:0/3981303411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe764159e10 msgr2=0x7fe7640b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:10.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe764159e10 0x7fe7640b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 -- 172.21.15.79:0/3981303411 >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 msgr2=0x7fe7640b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:10.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 --2- 172.21.15.79:0/3981303411 >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 0x7fe7640b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 -- 172.21.15.79:0/3981303411 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76415e140 con 0x7fe7640b1610 2023-10-14T18:45:10.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe768950700 1 --2- 172.21.15.79:0/3981303411 >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 0x7fe7640b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:10.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe769952700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640b1610 0x7fe7640cd740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7640d0ca0 tx=0x7fe75c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e042351ab453a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe75bfff700 1 -- 172.21.15.79:0/3981303411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00b860 con 0x7fe7640b1610 2023-10-14T18:45:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe75bfff700 1 -- 172.21.15.79:0/3981303411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c00b9c0 con 0x7fe7640b1610 2023-10-14T18:45:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe75bfff700 1 -- 172.21.15.79:0/3981303411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00bd60 con 0x7fe7640b1610 2023-10-14T18:45:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3981303411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640b1610 msgr2=0x7fe7640cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640b1610 0x7fe7640cd740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7640d0ca0 tx=0x7fe75c009250 comp rx=0 tx=0).stop 2023-10-14T18:45:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3981303411 shutdown_connections 2023-10-14T18:45:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe764159e10 0x7fe7640b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3981303411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7640b1610 0x7fe7640cd740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3981303411 >> v2:172.21.15.144:3300/0 conn(0x7fe76415a1e0 0x7fe7640b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.637+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3981303411 >> 172.21.15.79:0/3981303411 conn(0x7fe764067660 msgr2=0x7fe764067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.638+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3981303411 shutdown_connections 2023-10-14T18:45:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.638+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3981303411 wait complete. 2023-10-14T18:45:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 Processor -- start 2023-10-14T18:45:10.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 -- start start 2023-10-14T18:45:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7640b1610 0x7fe764153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe76415a1e0 0x7fe7640d1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640c69b0 con 0x7fe764159e10 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640c5da0 con 0x7fe7640b1610 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.639+0000 7fe76b3b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640c6080 con 0x7fe76415a1e0 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36460/0 (socket says 172.21.15.79:36460) 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 -- 172.21.15.79:0/3109337870 learned_addr learned my addr 172.21.15.79:0/3109337870 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:10.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe769151700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7640b1610 0x7fe764153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe769952700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe76415a1e0 0x7fe7640d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 -- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe76415a1e0 msgr2=0x7fe7640d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe76415a1e0 0x7fe7640d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 -- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7640b1610 msgr2=0x7fe764153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7640b1610 0x7fe764153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 -- 172.21.15.79:0/3109337870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0094f0 con 0x7fe764159e10 2023-10-14T18:45:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe768950700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d860 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7540125f0 con 0x7fe764159e10 2023-10-14T18:45:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754012750 con 0x7fe764159e10 2023-10-14T18:45:10.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754012af0 con 0x7fe764159e10 2023-10-14T18:45:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640c6360 con 0x7fe764159e10 2023-10-14T18:45:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.640+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe764153a70 con 0x7fe764159e10 2023-10-14T18:45:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.641+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640c6b60 con 0x7fe764159e10 2023-10-14T18:45:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.641+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe754013480 con 0x7fe764159e10 2023-10-14T18:45:10.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.642+0000 7fe7597fa700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.642+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7540845d0 con 0x7fe764159e10 2023-10-14T18:45:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.642+0000 7fe769151700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.642+0000 7fe769151700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe760009fd0 tx=0x7fe760009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.646+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7640c6b60 con 0x7fe764159e10 2023-10-14T18:45:10.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.828+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe76404c3c0 con 0x7fe764159e10 2023-10-14T18:45:10.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.829+0000 7fe7597fa700 1 -- 172.21.15.79:0/3109337870 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fe754051840 con 0x7fe764159e10 2023-10-14T18:45:10.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:09.872410+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:10.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.830+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 msgr2=0x7fe7480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.830+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe760009fd0 tx=0x7fe760009880 comp rx=0 tx=0).stop 2023-10-14T18:45:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.830+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 msgr2=0x7fe7640d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.830+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe75400d860 tx=0x7fe754008040 comp rx=0 tx=0).stop 2023-10-14T18:45:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 shutdown_connections 2023-10-14T18:45:10.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe76415a1e0 0x7fe7640d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7640b1610 0x7fe764153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 --2- 172.21.15.79:0/3109337870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe764159e10 0x7fe7640d0cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 >> 172.21.15.79:0/3109337870 conn(0x7fe764067660 msgr2=0x7fe7640b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:10.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 shutdown_connections 2023-10-14T18:45:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.831+0000 7fe76b3b5700 1 -- 172.21.15.79:0/3109337870 wait complete. 2023-10-14T18:45:10.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:10.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.956+0000 7f7170877700 1 Processor -- start 2023-10-14T18:45:10.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.956+0000 7f7170877700 1 -- start start 2023-10-14T18:45:10.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f7170877700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f716c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f7170877700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c15e040 con 0x7f716c1432f0 2023-10-14T18:45:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f7170877700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c068b20 con 0x7f716c1436c0 2023-10-14T18:45:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f7170877700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c06ac70 con 0x7f716c070e10 2023-10-14T18:45:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f716b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f716c1432f0 0x7f716c069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39640/0 (socket says 172.21.15.79:39640) 2023-10-14T18:45:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.957+0000 7f716b7fe700 1 -- 172.21.15.79:0/4243838362 learned_addr learned my addr 172.21.15.79:0/4243838362 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:10.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f716c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919058118 0 0) 0x7f716c15e040 con 0x7f716c1432f0 2023-10-14T18:45:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7154003570 con 0x7f716c1432f0 2023-10-14T18:45:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461315367 0 0) 0x7f716c068b20 con 0x7f716c1436c0 2023-10-14T18:45:10.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c15e040 con 0x7f716c1436c0 2023-10-14T18:45:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744461761 0 0) 0x7f7154003570 con 0x7f716c1432f0 2023-10-14T18:45:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 msgr2=0x7f716c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f716c15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 >> v1:172.21.15.144:6789/0 conn(0x7f716c1436c0 legacy=0x7f716c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c06a990 con 0x7f716c1432f0 2023-10-14T18:45:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f715c0017f0 con 0x7f716c1432f0 2023-10-14T18:45:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f716c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 >> v1:172.21.15.79:6789/0 conn(0x7f716c1432f0 legacy=0x7f716c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f7154003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7154004160 0x7f7154004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7154004d50 0x7f71540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c06ac70 con 0x7f7154004d50 2023-10-14T18:45:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715400bba0 con 0x7f7154004160 2023-10-14T18:45:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715400bd60 con 0x7f716c070e10 2023-10-14T18:45:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7154004d50 0x7f71540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716b7fe700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f7154003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716affd700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7154004160 0x7f7154004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 -- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 msgr2=0x7f7154003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f716c070e10 0x7f7154003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 -- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7154004160 msgr2=0x7f7154004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7154004160 0x7f7154004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 -- 172.21.15.79:0/4243838362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009420 con 0x7f7154004d50 2023-10-14T18:45:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.958+0000 7f716bfff700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7154004d50 0x7f71540051c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f716c0717e0 tx=0x7f71640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ea7c759d79fd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164009740 con 0x7f7154004d50 2023-10-14T18:45:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400e8f0 con 0x7f7154004d50 2023-10-14T18:45:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f716a7fc700 1 -- 172.21.15.79:0/4243838362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400ec90 con 0x7f7154004d50 2023-10-14T18:45:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 -- 172.21.15.79:0/4243838362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7154004d50 msgr2=0x7f71540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 --2- 172.21.15.79:0/4243838362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7154004d50 0x7f71540051c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f716c0717e0 tx=0x7f71640091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f716bfff700 1 -- 172.21.15.79:0/4243838362 reap_dead start 2023-10-14T18:45:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 -- 172.21.15.79:0/4243838362 shutdown_connections 2023-10-14T18:45:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 -- 172.21.15.79:0/4243838362 >> 172.21.15.79:0/4243838362 conn(0x7f716c0cd8e0 msgr2=0x7f716c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 -- 172.21.15.79:0/4243838362 shutdown_connections 2023-10-14T18:45:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.959+0000 7f7170877700 1 -- 172.21.15.79:0/4243838362 wait complete. 2023-10-14T18:45:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.960+0000 7f7170877700 1 Processor -- start 2023-10-14T18:45:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.960+0000 7f7170877700 1 -- start start 2023-10-14T18:45:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 0x7f716c169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f716c15bcc0 0x7f716c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c16e220 con 0x7f716c16d870 2023-10-14T18:45:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0c4a30 con 0x7f716c15bcc0 2023-10-14T18:45:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f7170877700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15c760 con 0x7f7154004d50 2023-10-14T18:45:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36484/0 (socket says 172.21.15.79:36484) 2023-10-14T18:45:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 -- 172.21.15.79:0/1659933785 learned_addr learned my addr 172.21.15.79:0/1659933785 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716affd700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f716c15bcc0 0x7f716c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716b7fe700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 0x7f716c169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 -- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 msgr2=0x7f716c169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 0x7f716c169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 -- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f716c15bcc0 msgr2=0x7f716c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f716c15bcc0 0x7f716c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716bfff700 1 -- 172.21.15.79:0/1659933785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c15ca40 con 0x7f716c16d870 2023-10-14T18:45:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.961+0000 7f716b7fe700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 0x7f716c169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f716bfff700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f716c071210 tx=0x7f7164019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164022070 con 0x7f716c16d870 2023-10-14T18:45:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164027410 con 0x7f716c16d870 2023-10-14T18:45:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c0c4cd0 con 0x7f716c16d870 2023-10-14T18:45:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640277d0 con 0x7f716c16d870 2023-10-14T18:45:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.962+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c15cd20 con 0x7f716c16d870 2023-10-14T18:45:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.963+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c0c4ec0 con 0x7f716c16d870 2023-10-14T18:45:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.963+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f716401b400 con 0x7f716c16d870 2023-10-14T18:45:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.963+0000 7f71537fe700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 0x7f71580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.963+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7164000e40 con 0x7f716c16d870 2023-10-14T18:45:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.964+0000 7f716b7fe700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 0x7f71580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.964+0000 7f716b7fe700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 0x7f71580693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f715c002020 tx=0x7f715c006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:10.968+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7164052e20 con 0x7f716c16d870 2023-10-14T18:45:11.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.151+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f716c15d9f0 con 0x7f716c16d870 2023-10-14T18:45:11.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.152+0000 7f71537fe700 1 -- 172.21.15.79:0/1659933785 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f716402c090 con 0x7f716c16d870 2023-10-14T18:45:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:11.153 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:09.872410+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:11.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 msgr2=0x7f71580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 0x7f71580693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f715c002020 tx=0x7f715c006040 comp rx=0 tx=0).stop 2023-10-14T18:45:11.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 msgr2=0x7f716c16dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f716c071210 tx=0x7f7164019000 comp rx=0 tx=0).stop 2023-10-14T18:45:11.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 shutdown_connections 2023-10-14T18:45:11.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7158066f30 0x7f71580693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f716c16d870 0x7f716c16dce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7154004d50 0x7f716c169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 --2- 172.21.15.79:0/1659933785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f716c15bcc0 0x7f716c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 >> 172.21.15.79:0/1659933785 conn(0x7f716c0cd8e0 msgr2=0x7f716c06e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:11.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 shutdown_connections 2023-10-14T18:45:11.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.154+0000 7f7170877700 1 -- 172.21.15.79:0/1659933785 wait complete. 2023-10-14T18:45:11.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:45:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.283+0000 7fb19165e700 1 Processor -- start 2023-10-14T18:45:11.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.283+0000 7fb19165e700 1 -- start start 2023-10-14T18:45:11.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb19165e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb18c0cd300 0x7fb18c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb19165e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0b6760 0x7fb18c0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb19165e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c1513f0 con 0x7fb18c0d12a0 2023-10-14T18:45:11.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb19165e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c15e7a0 con 0x7fb18c0cd300 2023-10-14T18:45:11.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb19165e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0d1700 con 0x7fb18c0b6760 2023-10-14T18:45:11.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb18affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb18c0cd300 0x7fb18c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb18b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb18c0d12a0 0x7fb18c06a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39648/0 (socket says 172.21.15.79:39648) 2023-10-14T18:45:11.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb18b7fe700 1 -- 172.21.15.79:0/1799606421 learned_addr learned my addr 172.21.15.79:0/1799606421 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:11.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.284+0000 7fb18a7fc700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0b6760 0x7fb18c0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb18affd700 1 -- 172.21.15.79:0/1799606421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0b6760 msgr2=0x7fb18c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:11.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb18affd700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0b6760 0x7fb18c0d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb18affd700 1 -- 172.21.15.79:0/1799606421 >> v1:172.21.15.79:6789/0 conn(0x7fb18c0d12a0 legacy=0x7fb18c06a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb18affd700 1 -- 172.21.15.79:0/1799606421 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c15db20 con 0x7fb18c0cd300 2023-10-14T18:45:11.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb189ffb700 1 -- 172.21.15.79:0/1799606421 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596745574 0 0) 0x7fb18c1513f0 con 0x7fb18c0d12a0 2023-10-14T18:45:11.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb18affd700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0cd300 0x7fb18c15afb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009e60 tx=0x7fb17c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61d220b0cdb46c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:11.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb189ffb700 1 -- 172.21.15.79:0/1799606421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00e070 con 0x7fb18c0cd300 2023-10-14T18:45:11.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb189ffb700 1 -- 172.21.15.79:0/1799606421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c00bc30 con 0x7fb18c0cd300 2023-10-14T18:45:11.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb189ffb700 1 -- 172.21.15.79:0/1799606421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c012430 con 0x7fb18c0cd300 2023-10-14T18:45:11.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 -- 172.21.15.79:0/1799606421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0cd300 msgr2=0x7fb18c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0cd300 0x7fb18c15afb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009e60 tx=0x7fb17c009780 comp rx=0 tx=0).stop 2023-10-14T18:45:11.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 -- 172.21.15.79:0/1799606421 shutdown_connections 2023-10-14T18:45:11.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0cd300 0x7fb18c15afb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 --2- 172.21.15.79:0/1799606421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0b6760 0x7fb18c0d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 -- 172.21.15.79:0/1799606421 >> 172.21.15.79:0/1799606421 conn(0x7fb18c068d90 msgr2=0x7fb18c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:11.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 -- 172.21.15.79:0/1799606421 shutdown_connections 2023-10-14T18:45:11.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.285+0000 7fb19165e700 1 -- 172.21.15.79:0/1799606421 wait complete. 2023-10-14T18:45:11.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 Processor -- start 2023-10-14T18:45:11.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 -- start start 2023-10-14T18:45:11.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c0cd300 0x7fb18c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0d12a0 0x7fb18c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c151a10 con 0x7fb18c0b6760 2023-10-14T18:45:11.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c155300 con 0x7fb18c0cd300 2023-10-14T18:45:11.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb19165e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c151730 con 0x7fb18c0d12a0 2023-10-14T18:45:11.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb18affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb18affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36498/0 (socket says 172.21.15.79:36498) 2023-10-14T18:45:11.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.287+0000 7fb18affd700 1 -- 172.21.15.79:0/493654478 learned_addr learned my addr 172.21.15.79:0/493654478 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:11.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18a7fc700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c0cd300 0x7fb18c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18b7fe700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0d12a0 0x7fb18c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 -- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0d12a0 msgr2=0x7fb18c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0d12a0 0x7fb18c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 -- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c0cd300 msgr2=0x7fb18c157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:11.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c0cd300 0x7fb18c157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:11.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 -- 172.21.15.79:0/493654478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009a20 con 0x7fb18c0b6760 2023-10-14T18:45:11.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb18affd700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18c15d9e0 tx=0x7fb17c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c012e50 con 0x7fb18c0b6760 2023-10-14T18:45:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c01d630 con 0x7fb18c0b6760 2023-10-14T18:45:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c154cb0 con 0x7fb18c0b6760 2023-10-14T18:45:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c01d9f0 con 0x7fb18c0b6760 2023-10-14T18:45:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.288+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0b5420 con 0x7fb18c0b6760 2023-10-14T18:45:11.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.289+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c154b10 con 0x7fb18c0b6760 2023-10-14T18:45:11.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.289+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb17c024070 con 0x7fb18c0b6760 2023-10-14T18:45:11.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.289+0000 7fb172ffd700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:11.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.290+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb17c086c30 con 0x7fb18c0b6760 2023-10-14T18:45:11.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.290+0000 7fb18a7fc700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:11.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.290+0000 7fb18a7fc700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:11.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.294+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb18c154b10 con 0x7fb18c0b6760 2023-10-14T18:45:11.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:11.522+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb18c154b10 con 0x7fb18c0b6760 2023-10-14T18:45:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.515+0000 7fb172ffd700 1 -- 172.21.15.79:0/493654478 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb18c154b10 con 0x7fb18c0b6760 2023-10-14T18:45:12.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 msgr2=0x7fb1780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb180006fd0 tx=0x7fb180008040 comp rx=0 tx=0).stop 2023-10-14T18:45:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 msgr2=0x7fb18c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18c15d9e0 tx=0x7fb17c019000 comp rx=0 tx=0).stop 2023-10-14T18:45:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 shutdown_connections 2023-10-14T18:45:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb18c0d12a0 0x7fb18c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb18c0b6760 0x7fb18c0b4ee0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 --2- 172.21.15.79:0/493654478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb18c0cd300 0x7fb18c157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.517+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 >> 172.21.15.79:0/493654478 conn(0x7fb18c068d90 msgr2=0x7fb18c1507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:12.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.518+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 shutdown_connections 2023-10-14T18:45:12.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.518+0000 7fb19165e700 1 -- 172.21.15.79:0/493654478 wait complete. 2023-10-14T18:45:12.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:45:12.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.648+0000 7f07fd2aa700 1 Processor -- start 2023-10-14T18:45:12.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.648+0000 7f07fd2aa700 1 -- start start 2023-10-14T18:45:12.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.649+0000 7f07fd2aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f07f8070e10 0x7f07f80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.649+0000 7f07fd2aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 0x7f07f806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.649+0000 7f07fd2aa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f806f980 con 0x7f07f80affe0 2023-10-14T18:45:12.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.649+0000 7f07fd2aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f806f230 con 0x7f07f8070e10 2023-10-14T18:45:12.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.649+0000 7f07fd2aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80cd8c0 con 0x7f07f8068880 2023-10-14T18:45:12.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 0x7f07f806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f67fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f07f8070e10 0x7f07f80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f6ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f07f80affe0 0x7f07f8070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:44330/0 (socket says 172.21.15.79:44330) 2023-10-14T18:45:12.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f6ffd700 1 -- 172.21.15.79:0/1507581562 learned_addr learned my addr 172.21.15.79:0/1507581562 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:12.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 -- 172.21.15.79:0/1507581562 >> v2:172.21.15.144:3300/0 conn(0x7f07f8070e10 msgr2=0x7f07f80c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:12.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 --2- 172.21.15.79:0/1507581562 >> v2:172.21.15.144:3300/0 conn(0x7f07f8070e10 0x7f07f80c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 -- 172.21.15.79:0/1507581562 >> v1:172.21.15.144:6789/0 conn(0x7f07f80affe0 legacy=0x7f07f8070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 -- 172.21.15.79:0/1507581562 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80ccfd0 con 0x7f07f8068880 2023-10-14T18:45:12.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f77fe700 1 --2- 172.21.15.79:0/1507581562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 0x7f07f806ecf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07f00098e0 tx=0x7f07f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d074ff42209a6cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:12.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f5ffb700 1 -- 172.21.15.79:0/1507581562 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000b640 con 0x7f07f8068880 2023-10-14T18:45:12.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f5ffb700 1 -- 172.21.15.79:0/1507581562 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000b7a0 con 0x7f07f8068880 2023-10-14T18:45:12.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.650+0000 7f07f5ffb700 1 -- 172.21.15.79:0/1507581562 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000bb40 con 0x7f07f8068880 2023-10-14T18:45:12.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1507581562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 msgr2=0x7f07f806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1507581562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 0x7f07f806ecf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07f00098e0 tx=0x7f07f00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1507581562 shutdown_connections 2023-10-14T18:45:12.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1507581562 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8068880 0x7f07f806ecf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1507581562 >> v2:172.21.15.144:3300/0 conn(0x7f07f8070e10 0x7f07f80c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1507581562 >> 172.21.15.79:0/1507581562 conn(0x7f07f80ce570 msgr2=0x7f07f80ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:12.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1507581562 shutdown_connections 2023-10-14T18:45:12.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.651+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1507581562 wait complete. 2023-10-14T18:45:12.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.652+0000 7f07fd2aa700 1 Processor -- start 2023-10-14T18:45:12.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.652+0000 7f07fd2aa700 1 -- start start 2023-10-14T18:45:12.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8070e10 0x7f07f815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f80affe0 0x7f07f80c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c5e50 con 0x7f07f8068880 2023-10-14T18:45:12.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c6130 con 0x7f07f80affe0 2023-10-14T18:45:12.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07fd2aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80c6410 con 0x7f07f8070e10 2023-10-14T18:45:12.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36512/0 (socket says 172.21.15.79:36512) 2023-10-14T18:45:12.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 -- 172.21.15.79:0/1338924918 learned_addr learned my addr 172.21.15.79:0/1338924918 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:12.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f77fe700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f80affe0 0x7f07f80c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f67fc700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8070e10 0x7f07f815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 -- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8070e10 msgr2=0x7f07f815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8070e10 0x7f07f815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 -- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f80affe0 msgr2=0x7f07f80c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f80affe0 0x7f07f80c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 -- 172.21.15.79:0/1338924918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0009420 con 0x7f07f8068880 2023-10-14T18:45:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.653+0000 7f07f6ffd700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07e800cc70 tx=0x7f07e80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.654+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800a890 con 0x7f07f8068880 2023-10-14T18:45:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.654+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800aa10 con 0x7f07f8068880 2023-10-14T18:45:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.654+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80c66f0 con 0x7f07f8068880 2023-10-14T18:45:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.654+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800add0 con 0x7f07f8068880 2023-10-14T18:45:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.654+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80c5ad0 con 0x7f07f8068880 2023-10-14T18:45:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.655+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f804c3c0 con 0x7f07f8068880 2023-10-14T18:45:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.655+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07e8007300 con 0x7f07f8068880 2023-10-14T18:45:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.655+0000 7f07deffd700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.655+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07e80847c0 con 0x7f07f8068880 2023-10-14T18:45:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.656+0000 7f07f67fc700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.656+0000 7f07f67fc700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07f8159d60 tx=0x7f07ec0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:12.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.659+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07e8051ab0 con 0x7f07f8068880 2023-10-14T18:45:12.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:12.885+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f07f806f430 con 0x7f07f8068880 2023-10-14T18:45:13.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.517+0000 7f07deffd700 1 -- 172.21.15.79:0/1338924918 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f07e80550d0 con 0x7f07f8068880 2023-10-14T18:45:13.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 msgr2=0x7f07e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 0x7f07e40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07f8159d60 tx=0x7f07ec0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 msgr2=0x7f07f80c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f07e800cc70 tx=0x7f07e80019f0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 shutdown_connections 2023-10-14T18:45:13.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07e4066f30 0x7f07e40693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07f80affe0 0x7f07f80c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f8068880 0x7f07f80c5590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.519+0000 7f07fd2aa700 1 --2- 172.21.15.79:0/1338924918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07f8070e10 0x7f07f815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.520+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 >> 172.21.15.79:0/1338924918 conn(0x7f07f80ce570 msgr2=0x7f07f806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:13.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.520+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 shutdown_connections 2023-10-14T18:45:13.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.520+0000 7f07fd2aa700 1 -- 172.21.15.79:0/1338924918 wait complete. 2023-10-14T18:45:13.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:13.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 Processor -- start 2023-10-14T18:45:13.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 -- start start 2023-10-14T18:45:13.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd28015a620 0x7fd28015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28015d580 0x7fd280158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28015cbb0 con 0x7fd280157870 2023-10-14T18:45:13.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28015bdb0 con 0x7fd28015d580 2023-10-14T18:45:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.653+0000 7fd285b71700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28015bfa0 con 0x7fd28015a620 2023-10-14T18:45:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28015d580 0x7fd280158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd28015d580 0x7fd280158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36518/0 (socket says 172.21.15.79:36518) 2023-10-14T18:45:13.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 -- 172.21.15.79:0/758145070 learned_addr learned my addr 172.21.15.79:0/758145070 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 -- 172.21.15.79:0/758145070 >> v2:172.21.15.144:3300/0 conn(0x7fd28015a620 msgr2=0x7fd28015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 --2- 172.21.15.79:0/758145070 >> v2:172.21.15.144:3300/0 conn(0x7fd28015a620 0x7fd28015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 -- 172.21.15.79:0/758145070 >> v1:172.21.15.144:6789/0 conn(0x7fd280157870 legacy=0x7fd28015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 -- 172.21.15.79:0/758145070 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28015c280 con 0x7fd28015d580 2023-10-14T18:45:13.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27ffff700 1 --2- 172.21.15.79:0/758145070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015d580 0x7fd280158110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd28015cb20 tx=0x7fd278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c927fce39bffc27 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:13.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27e7fc700 1 -- 172.21.15.79:0/758145070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800b820 con 0x7fd28015d580 2023-10-14T18:45:13.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27e7fc700 1 -- 172.21.15.79:0/758145070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800b980 con 0x7fd28015d580 2023-10-14T18:45:13.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.654+0000 7fd27e7fc700 1 -- 172.21.15.79:0/758145070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800bd20 con 0x7fd28015d580 2023-10-14T18:45:13.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 -- 172.21.15.79:0/758145070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015d580 msgr2=0x7fd280158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 --2- 172.21.15.79:0/758145070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015d580 0x7fd280158110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd28015cb20 tx=0x7fd278009250 comp rx=0 tx=0).stop 2023-10-14T18:45:13.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 -- 172.21.15.79:0/758145070 shutdown_connections 2023-10-14T18:45:13.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 --2- 172.21.15.79:0/758145070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015d580 0x7fd280158110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 --2- 172.21.15.79:0/758145070 >> v2:172.21.15.144:3300/0 conn(0x7fd28015a620 0x7fd28015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 -- 172.21.15.79:0/758145070 >> 172.21.15.79:0/758145070 conn(0x7fd280068ce0 msgr2=0x7fd2800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 -- 172.21.15.79:0/758145070 shutdown_connections 2023-10-14T18:45:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.655+0000 7fd285b71700 1 -- 172.21.15.79:0/758145070 wait complete. 2023-10-14T18:45:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.656+0000 7fd285b71700 1 Processor -- start 2023-10-14T18:45:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.656+0000 7fd285b71700 1 -- start start 2023-10-14T18:45:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd280157870 0x7fd280157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd28015d580 0x7fd280149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800b1ec0 con 0x7fd28015a620 2023-10-14T18:45:13.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800cfb00 con 0x7fd280157870 2023-10-14T18:45:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800cfde0 con 0x7fd28015d580 2023-10-14T18:45:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36530/0 (socket says 172.21.15.79:36530) 2023-10-14T18:45:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 -- 172.21.15.79:0/712691411 learned_addr learned my addr 172.21.15.79:0/712691411 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27f7fe700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd280157870 0x7fd280157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27ffff700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd28015d580 0x7fd280149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 -- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd28015d580 msgr2=0x7fd280149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd28015d580 0x7fd280149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 -- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd280157870 msgr2=0x7fd280157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd280157870 0x7fd280157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 -- 172.21.15.79:0/712691411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780094f0 con 0x7fd28015a620 2023-10-14T18:45:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd27effd700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b810 tx=0x7fd274009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400f5f0 con 0x7fd28015a620 2023-10-14T18:45:13.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400f750 con 0x7fd28015a620 2023-10-14T18:45:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2800d00c0 con 0x7fd28015a620 2023-10-14T18:45:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.657+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400fb10 con 0x7fd28015a620 2023-10-14T18:45:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.658+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2800b1ae0 con 0x7fd28015a620 2023-10-14T18:45:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.658+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2800b2030 con 0x7fd28015a620 2023-10-14T18:45:13.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.659+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd274010480 con 0x7fd28015a620 2023-10-14T18:45:13.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.659+0000 7fd2677fe700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:13.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.659+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd274084440 con 0x7fd28015a620 2023-10-14T18:45:13.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.659+0000 7fd27f7fe700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:13.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.660+0000 7fd27f7fe700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 0x7fd26c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:13.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.663+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd274051730 con 0x7fd28015a620 2023-10-14T18:45:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.888+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd28004c3c0 con 0x7fd28015a620 2023-10-14T18:45:13.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.889+0000 7fd2677fe700 1 -- 172.21.15.79:0/712691411 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fd274054d50 con 0x7fd28015a620 2023-10-14T18:45:13.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:13.890 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:13.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.890+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 msgr2=0x7fd26c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.890+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 0x7fd26c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).stop 2023-10-14T18:45:13.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.890+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 msgr2=0x7fd2800cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:13.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.890+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd27400b810 tx=0x7fd274009220 comp rx=0 tx=0).stop 2023-10-14T18:45:13.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 shutdown_connections 2023-10-14T18:45:13.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd26c066f30 0x7fd26c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd28015d580 0x7fd280149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd280157870 0x7fd280157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 --2- 172.21.15.79:0/712691411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd28015a620 0x7fd2800cf2b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:13.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 >> 172.21.15.79:0/712691411 conn(0x7fd280068ce0 msgr2=0x7fd28014c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:13.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 shutdown_connections 2023-10-14T18:45:13.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:13.891+0000 7fd285b71700 1 -- 172.21.15.79:0/712691411 wait complete. 2023-10-14T18:45:13.894 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:13.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:14.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.017+0000 7eff2db64700 1 Processor -- start 2023-10-14T18:45:14.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.017+0000 7eff2db64700 1 -- start start 2023-10-14T18:45:14.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2db64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2db64700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 0x7eff2815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2db64700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff280cb7c0 con 0x7eff280cdab0 2023-10-14T18:45:14.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2db64700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2815e850 con 0x7eff2815cbd0 2023-10-14T18:45:14.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2db64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280cd030 con 0x7eff280cd6e0 2023-10-14T18:45:14.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2cb62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2d363700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 0x7eff2815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2cb62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:38036/0 (socket says 172.21.15.79:38036) 2023-10-14T18:45:14.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.018+0000 7eff2cb62700 1 -- 172.21.15.79:0/2505511664 learned_addr learned my addr 172.21.15.79:0/2505511664 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:14.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2cb62700 1 -- 172.21.15.79:0/2505511664 >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 msgr2=0x7eff2815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:14.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2cb62700 1 --2- 172.21.15.79:0/2505511664 >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 0x7eff2815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2cb62700 1 -- 172.21.15.79:0/2505511664 >> v1:172.21.15.144:6789/0 conn(0x7eff280cdab0 legacy=0x7eff2815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff277fe700 1 -- 172.21.15.79:0/2505511664 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323815499 0 0) 0x7eff280cb7c0 con 0x7eff280cdab0 2023-10-14T18:45:14.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2cb62700 1 -- 172.21.15.79:0/2505511664 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2815e290 con 0x7eff280cd6e0 2023-10-14T18:45:14.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2d363700 1 --2- 172.21.15.79:0/2505511664 >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 0x7eff2815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:14.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2cb62700 1 --2- 172.21.15.79:0/2505511664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0099b0 tx=0x7eff1c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0a1fb31f2778c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff277fe700 1 -- 172.21.15.79:0/2505511664 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c009ea0 con 0x7eff280cd6e0 2023-10-14T18:45:14.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff277fe700 1 -- 172.21.15.79:0/2505511664 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b860 con 0x7eff280cd6e0 2023-10-14T18:45:14.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff277fe700 1 -- 172.21.15.79:0/2505511664 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00bc00 con 0x7eff280cd6e0 2023-10-14T18:45:14.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2db64700 1 -- 172.21.15.79:0/2505511664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 msgr2=0x7eff280cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.019+0000 7eff2db64700 1 --2- 172.21.15.79:0/2505511664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0099b0 tx=0x7eff1c009250 comp rx=0 tx=0).stop 2023-10-14T18:45:14.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 -- 172.21.15.79:0/2505511664 shutdown_connections 2023-10-14T18:45:14.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 --2- 172.21.15.79:0/2505511664 >> v2:172.21.15.144:3300/0 conn(0x7eff2815cbd0 0x7eff2815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 --2- 172.21.15.79:0/2505511664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff280cbc50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 -- 172.21.15.79:0/2505511664 >> 172.21.15.79:0/2505511664 conn(0x7eff28067660 msgr2=0x7eff28067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 -- 172.21.15.79:0/2505511664 shutdown_connections 2023-10-14T18:45:14.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.020+0000 7eff2db64700 1 -- 172.21.15.79:0/2505511664 wait complete. 2023-10-14T18:45:14.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.021+0000 7eff2db64700 1 Processor -- start 2023-10-14T18:45:14.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.021+0000 7eff2db64700 1 -- start start 2023-10-14T18:45:14.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.021+0000 7eff2db64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff2814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 0x7eff280b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c7d20 con 0x7eff280cdab0 2023-10-14T18:45:14.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c82e0 con 0x7eff2815cbd0 2023-10-14T18:45:14.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280b5710 con 0x7eff280cd6e0 2023-10-14T18:45:14.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36542/0 (socket says 172.21.15.79:36542) 2023-10-14T18:45:14.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 -- 172.21.15.79:0/3353637865 learned_addr learned my addr 172.21.15.79:0/3353637865 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:14.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2d363700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 0x7eff280b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2cb62700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff2814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 -- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 msgr2=0x7eff2814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff2814ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 -- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 msgr2=0x7eff280b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 0x7eff280b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 -- 172.21.15.79:0/3353637865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009a20 con 0x7eff280cdab0 2023-10-14T18:45:14.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2d363700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 0x7eff280b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:14.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff27fff700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c810 tx=0x7eff14007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14011590 con 0x7eff280cdab0 2023-10-14T18:45:14.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14011710 con 0x7eff280cdab0 2023-10-14T18:45:14.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14011ad0 con 0x7eff280cdab0 2023-10-14T18:45:14.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0094f0 con 0x7eff280cdab0 2023-10-14T18:45:14.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.022+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff280b4860 con 0x7eff280cdab0 2023-10-14T18:45:14.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.023+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28089280 con 0x7eff280cdab0 2023-10-14T18:45:14.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.024+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff14012420 con 0x7eff280cdab0 2023-10-14T18:45:14.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.024+0000 7eff24ff9700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 0x7eff0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.024+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff14083960 con 0x7eff280cdab0 2023-10-14T18:45:14.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.024+0000 7eff2cb62700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 0x7eff0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.024+0000 7eff2cb62700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 0x7eff0c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0099b0 tx=0x7eff1c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.028+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff1404b5a0 con 0x7eff280cdab0 2023-10-14T18:45:14.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.212+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff280c8420 con 0x7eff280cdab0 2023-10-14T18:45:14.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.213+0000 7eff24ff9700 1 -- 172.21.15.79:0/3353637865 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7eff14017070 con 0x7eff280cdab0 2023-10-14T18:45:14.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:14.214 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:14.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 msgr2=0x7eff0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 0x7eff0c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0099b0 tx=0x7eff1c017000 comp rx=0 tx=0).stop 2023-10-14T18:45:14.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 msgr2=0x7eff280b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c810 tx=0x7eff14007da0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 shutdown_connections 2023-10-14T18:45:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff0c066f30 0x7eff0c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff2815cbd0 0x7eff280b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff280cd6e0 0x7eff2814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 --2- 172.21.15.79:0/3353637865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280cdab0 0x7eff280b3a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 >> 172.21.15.79:0/3353637865 conn(0x7eff28067660 msgr2=0x7eff28156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 shutdown_connections 2023-10-14T18:45:14.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.215+0000 7eff2db64700 1 -- 172.21.15.79:0/3353637865 wait complete. 2023-10-14T18:45:14.228 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:45:14.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.342+0000 7fb6cfb5a700 1 Processor -- start 2023-10-14T18:45:14.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.342+0000 7fb6cfb5a700 1 -- start start 2023-10-14T18:45:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cfb5a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6c815a620 0x7fb6c815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cfb5a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 0x7fb6c8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cfb5a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c815cbb0 con 0x7fb6c8157870 2023-10-14T18:45:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cfb5a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c815bdb0 con 0x7fb6c815a620 2023-10-14T18:45:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cfb5a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c815bfa0 con 0x7fb6c815d580 2023-10-14T18:45:14.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd8f6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb6c8157870 0x7fb6c815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39652/0 (socket says 172.21.15.79:39652) 2023-10-14T18:45:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd8f6700 1 -- 172.21.15.79:0/3855107469 learned_addr learned my addr 172.21.15.79:0/3855107469 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd0f5700 1 --2- 172.21.15.79:0/3855107469 >> v2:172.21.15.79:3300/0 conn(0x7fb6c815a620 0x7fb6c815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6ce0f7700 1 --2- 172.21.15.79:0/3855107469 >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 0x7fb6c8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cc8f4700 1 -- 172.21.15.79:0/3855107469 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348422432 0 0) 0x7fb6c815cbb0 con 0x7fb6c8157870 2023-10-14T18:45:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cc8f4700 1 -- 172.21.15.79:0/3855107469 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b4003570 con 0x7fb6c8157870 2023-10-14T18:45:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd0f5700 1 -- 172.21.15.79:0/3855107469 >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 msgr2=0x7fb6c8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd0f5700 1 --2- 172.21.15.79:0/3855107469 >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 0x7fb6c8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd0f5700 1 -- 172.21.15.79:0/3855107469 >> v1:172.21.15.79:6789/0 conn(0x7fb6c8157870 legacy=0x7fb6c815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6cd0f5700 1 -- 172.21.15.79:0/3855107469 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c815c280 con 0x7fb6c815a620 2023-10-14T18:45:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.343+0000 7fb6ce0f7700 1 --2- 172.21.15.79:0/3855107469 >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 0x7fb6c8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cd0f5700 1 --2- 172.21.15.79:0/3855107469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c815a620 0x7fb6c815d040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6c806b4e0 tx=0x7fb6b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9119a5041113beb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cc8f4700 1 -- 172.21.15.79:0/3855107469 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8011630 con 0x7fb6c815a620 2023-10-14T18:45:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cc8f4700 1 -- 172.21.15.79:0/3855107469 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8011790 con 0x7fb6c815a620 2023-10-14T18:45:14.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cc8f4700 1 -- 172.21.15.79:0/3855107469 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8011b10 con 0x7fb6c815a620 2023-10-14T18:45:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/3855107469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c815a620 msgr2=0x7fb6c815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/3855107469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c815a620 0x7fb6c815d040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6c806b4e0 tx=0x7fb6b80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/3855107469 shutdown_connections 2023-10-14T18:45:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/3855107469 >> v2:172.21.15.144:3300/0 conn(0x7fb6c815d580 0x7fb6c8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/3855107469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c815a620 0x7fb6c815d040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/3855107469 >> 172.21.15.79:0/3855107469 conn(0x7fb6c8068ce0 msgr2=0x7fb6c80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/3855107469 shutdown_connections 2023-10-14T18:45:14.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.344+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/3855107469 wait complete. 2023-10-14T18:45:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.345+0000 7fb6cfb5a700 1 Processor -- start 2023-10-14T18:45:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.345+0000 7fb6cfb5a700 1 -- start start 2023-10-14T18:45:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6c815a620 0x7fb6c8153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6c815d580 0x7fb6c80b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8149800 con 0x7fb6c8157870 2023-10-14T18:45:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80b6be0 con 0x7fb6c815a620 2023-10-14T18:45:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cfb5a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80b6340 con 0x7fb6c815d580 2023-10-14T18:45:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36566/0 (socket says 172.21.15.79:36566) 2023-10-14T18:45:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 -- 172.21.15.79:0/1404821203 learned_addr learned my addr 172.21.15.79:0/1404821203 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 -- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6c815d580 msgr2=0x7fb6c80b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6c815d580 0x7fb6c80b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 -- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6c815a620 msgr2=0x7fb6c8153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6c815a620 0x7fb6c8153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.346+0000 7fb6cd8f6700 1 -- 172.21.15.79:0/1404821203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b8009420 con 0x7fb6c8157870 2023-10-14T18:45:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6cd8f6700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400cd00 tx=0x7fb6c4001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400ab10 con 0x7fb6c8157870 2023-10-14T18:45:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400ac70 con 0x7fb6c8157870 2023-10-14T18:45:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c80b6620 con 0x7fb6c8157870 2023-10-14T18:45:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40070f0 con 0x7fb6c8157870 2023-10-14T18:45:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.347+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c81538b0 con 0x7fb6c8157870 2023-10-14T18:45:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.348+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c804c3c0 con 0x7fb6c8157870 2023-10-14T18:45:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.348+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6c40074a0 con 0x7fb6c8157870 2023-10-14T18:45:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.348+0000 7fb6bdffb700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.349+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6c4084a30 con 0x7fb6c8157870 2023-10-14T18:45:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.349+0000 7fb6cd0f5700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.349+0000 7fb6cd0f5700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 0x7fb6ac0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6c815aa20 tx=0x7fb6b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.353+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6c4051d20 con 0x7fb6c8157870 2023-10-14T18:45:14.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.531+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6c8149940 con 0x7fb6ac066f30 2023-10-14T18:45:14.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.539+0000 7fb6bdffb700 1 -- 172.21.15.79:0/1404821203 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251356 (secure 0 0 0) 0x7fb6b8000c50 con 0x7fb6ac066f30 2023-10-14T18:45:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:14.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 msgr2=0x7fb6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 0x7fb6ac0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6c815aa20 tx=0x7fb6b8017000 comp rx=0 tx=0).stop 2023-10-14T18:45:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 msgr2=0x7fb6c80b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400cd00 tx=0x7fb6c4001b00 comp rx=0 tx=0).stop 2023-10-14T18:45:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 shutdown_connections 2023-10-14T18:45:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6ac066f30 0x7fb6ac0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6c815d580 0x7fb6c80b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c8157870 0x7fb6c80b5c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 --2- 172.21.15.79:0/1404821203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6c815a620 0x7fb6c8153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.542+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 >> 172.21.15.79:0/1404821203 conn(0x7fb6c8068ce0 msgr2=0x7fb6c8159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.543+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 shutdown_connections 2023-10-14T18:45:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.543+0000 7fb6cfb5a700 1 -- 172.21.15.79:0/1404821203 wait complete. 2023-10-14T18:45:14.548 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:14.555 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T18:45:14.334869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560953,"statfs":{"total":1600000000,"available":1598416640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.848659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488029+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486913+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487731+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487982+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486690+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487958+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486640+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489793+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490619+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488955+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489021+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488106+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490746+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488726+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491642+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489096+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488328+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490177+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491300+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490435+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T18:45:01.141834+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:01.141834+0000","last_peered":"2023-10-14T18:45:01.141834+0000","last_clean":"2023-10-14T18:45:01.141834+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:01.141834+0000","last_undegraded":"2023-10-14T18:45:01.141834+0000","last_fullsized":"2023-10-14T18:45:01.141834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487209+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487637+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488383+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488887+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488701+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491413+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488831+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491801+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:14.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:14.622 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-10-14T18:45:14.621+0000 7f2cd44f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:45:14.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.709+0000 7f38fead7700 1 Processor -- start 2023-10-14T18:45:14.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.709+0000 7f38fead7700 1 -- start start 2023-10-14T18:45:14.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fead7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38f815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fead7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f815cbb0 con 0x7f38f815d580 2023-10-14T18:45:14.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fead7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f815bfa0 con 0x7f38f8157870 2023-10-14T18:45:14.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fead7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f815bdb0 con 0x7f38f815a620 2023-10-14T18:45:14.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fd074700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38f815d580 0x7f38f8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39668/0 (socket says 172.21.15.79:39668) 2023-10-14T18:45:14.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38fd074700 1 -- 172.21.15.79:0/2997083776 learned_addr learned my addr 172.21.15.79:0/2997083776 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:14.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f7fff700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38f815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076544772 0 0) 0x7f38f815cbb0 con 0x7f38f815d580 2023-10-14T18:45:14.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e4003570 con 0x7f38f815d580 2023-10-14T18:45:14.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835998578 0 0) 0x7f38f815bfa0 con 0x7f38f8157870 2023-10-14T18:45:14.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f815cbb0 con 0x7f38f8157870 2023-10-14T18:45:14.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510276604 0 0) 0x7f38e4003570 con 0x7f38f815d580 2023-10-14T18:45:14.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 msgr2=0x7f38f815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:14.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38f815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 >> v1:172.21.15.144:6789/0 conn(0x7f38f8157870 legacy=0x7f38f815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f815c280 con 0x7f38f815d580 2023-10-14T18:45:14.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f38e0001470 con 0x7f38f815d580 2023-10-14T18:45:14.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 >> v1:172.21.15.79:6789/0 conn(0x7f38f815d580 legacy=0x7f38f8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4003c20 0x7f38e4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38e4004810 0x7f38e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e400bb40 con 0x7f38e4004810 2023-10-14T18:45:14.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e400bcb0 con 0x7f38e4003c20 2023-10-14T18:45:14.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.710+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e400be70 con 0x7f38f815a620 2023-10-14T18:45:14.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38e4004810 0x7f38e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38fc873700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4003c20 0x7f38e4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38fd074700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 -- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 msgr2=0x7f38e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:14.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 -- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4003c20 msgr2=0x7f38e4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:14.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4003c20 0x7f38e4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 -- 172.21.15.79:0/2997083776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4003570 con 0x7f38e4004810 2023-10-14T18:45:14.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38fd074700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f815a620 0x7f38e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:14.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38fc873700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4003c20 0x7f38e4004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:14.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f7fff700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38e4004810 0x7f38e4004c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38f815aa20 tx=0x7f38e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e646db76d2ccd218 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800ea90 con 0x7f38e4004810 2023-10-14T18:45:14.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800f040 con 0x7f38e4004810 2023-10-14T18:45:14.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.711+0000 7f38f77fe700 1 -- 172.21.15.79:0/2997083776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800ee40 con 0x7f38e4004810 2023-10-14T18:45:14.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 -- 172.21.15.79:0/2997083776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38e4004810 msgr2=0x7f38e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 --2- 172.21.15.79:0/2997083776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38e4004810 0x7f38e4004c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38f815aa20 tx=0x7f38e800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:14.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fd074700 1 -- 172.21.15.79:0/2997083776 reap_dead start 2023-10-14T18:45:14.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 -- 172.21.15.79:0/2997083776 shutdown_connections 2023-10-14T18:45:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 -- 172.21.15.79:0/2997083776 >> 172.21.15.79:0/2997083776 conn(0x7f38f8068ce0 msgr2=0x7f38f80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 -- 172.21.15.79:0/2997083776 shutdown_connections 2023-10-14T18:45:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.712+0000 7f38fead7700 1 -- 172.21.15.79:0/2997083776 wait complete. 2023-10-14T18:45:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.713+0000 7f38fead7700 1 Processor -- start 2023-10-14T18:45:14.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.713+0000 7f38fead7700 1 -- start start 2023-10-14T18:45:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4004810 0x7f38f814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f8158da0 0x7f38f80d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81536d0 con 0x7f38f8152d20 2023-10-14T18:45:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f80d01e0 con 0x7f38e4004810 2023-10-14T18:45:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f8159f00 con 0x7f38f8158da0 2023-10-14T18:45:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36596/0 (socket says 172.21.15.79:36596) 2023-10-14T18:45:14.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 -- 172.21.15.79:0/4076628882 learned_addr learned my addr 172.21.15.79:0/4076628882 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38f7fff700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f8158da0 0x7f38f80d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fc873700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4004810 0x7f38f814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 -- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f8158da0 msgr2=0x7f38f80d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f8158da0 0x7f38f80d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 -- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4004810 msgr2=0x7f38f814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4004810 0x7f38f814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 -- 172.21.15.79:0/4076628882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80d0b40 con 0x7f38f8152d20 2023-10-14T18:45:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fd074700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38f806b4b0 tx=0x7f38e0001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0010520 con 0x7f38f8152d20 2023-10-14T18:45:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e0010680 con 0x7f38f8152d20 2023-10-14T18:45:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e0010a40 con 0x7f38f8152d20 2023-10-14T18:45:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f81592f0 con 0x7f38f8152d20 2023-10-14T18:45:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.714+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f81598b0 con 0x7f38f8152d20 2023-10-14T18:45:14.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.715+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f80b0610 con 0x7f38f8152d20 2023-10-14T18:45:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.716+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38e001d3b0 con 0x7f38f8152d20 2023-10-14T18:45:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.716+0000 7f38f4ff9700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 0x7f38d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.716+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38e0083e10 con 0x7f38f8152d20 2023-10-14T18:45:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.716+0000 7f38fc873700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 0x7f38d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.717+0000 7f38fc873700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 0x7f38d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38f00039e0 tx=0x7f38f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:14.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.720+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38f80b0610 con 0x7f38f8152d20 2023-10-14T18:45:14.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.900+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38f80b0610 con 0x7f38d8066f30 2023-10-14T18:45:14.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.908+0000 7f38f4ff9700 1 -- 172.21.15.79:0/4076628882 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251356 (secure 0 0 0) 0x7f38f80b0610 con 0x7f38d8066f30 2023-10-14T18:45:14.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:14.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 msgr2=0x7f38d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 0x7f38d80693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38f00039e0 tx=0x7f38f0009040 comp rx=0 tx=0).stop 2023-10-14T18:45:14.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 msgr2=0x7f38f8153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:14.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38f806b4b0 tx=0x7f38e0001c20 comp rx=0 tx=0).stop 2023-10-14T18:45:14.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 shutdown_connections 2023-10-14T18:45:14.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f38d8066f30 0x7f38d80693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38f8152d20 0x7f38f8153190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38e4004810 0x7f38f814a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 --2- 172.21.15.79:0/4076628882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f38f8158da0 0x7f38f80d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:14.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 >> 172.21.15.79:0/4076628882 conn(0x7f38f8068ce0 msgr2=0x7f38f814c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:14.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 shutdown_connections 2023-10-14T18:45:14.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:14.911+0000 7f38fead7700 1 -- 172.21.15.79:0/4076628882 wait complete. 2023-10-14T18:45:14.915 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:14.923 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T18:45:14.334869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560953,"statfs":{"total":1600000000,"available":1598416640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.848659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488029+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486913+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487731+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487982+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486690+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487958+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486640+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489793+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490619+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488955+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489021+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488106+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490746+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488726+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491642+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489096+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488328+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490177+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491300+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490435+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T18:45:01.141834+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:01.141834+0000","last_peered":"2023-10-14T18:45:01.141834+0000","last_clean":"2023-10-14T18:45:01.141834+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:01.141834+0000","last_undegraded":"2023-10-14T18:45:01.141834+0000","last_fullsized":"2023-10-14T18:45:01.141834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487209+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487637+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488383+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488887+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488701+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491413+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488831+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491801+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:14.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:15.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.076+0000 7f4918881700 1 Processor -- start 2023-10-14T18:45:15.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.076+0000 7f4918881700 1 -- start start 2023-10-14T18:45:15.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4918881700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49140b0f30 0x7f49140cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4918881700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491415aea0 0x7f4914067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4918881700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49140cb8b0 con 0x7f49140b1300 2023-10-14T18:45:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4918881700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4914068f80 con 0x7f491415aea0 2023-10-14T18:45:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4918881700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4914069260 con 0x7f49140b0f30 2023-10-14T18:45:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4912d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491415aea0 0x7f4914067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4911d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f49140b1300 0x7f49140cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39684/0 (socket says 172.21.15.79:39684) 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f4911d9b700 1 -- 172.21.15.79:0/4165095361 learned_addr learned my addr 172.21.15.79:0/4165095361 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.077+0000 7f491259c700 1 --2- 172.21.15.79:0/4165095361 >> v2:172.21.15.144:3300/0 conn(0x7f49140b0f30 0x7f49140cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4912d9d700 1 -- 172.21.15.79:0/4165095361 >> v2:172.21.15.144:3300/0 conn(0x7f49140b0f30 msgr2=0x7f49140cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4912d9d700 1 --2- 172.21.15.79:0/4165095361 >> v2:172.21.15.144:3300/0 conn(0x7f49140b0f30 0x7f49140cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4912d9d700 1 -- 172.21.15.79:0/4165095361 >> v1:172.21.15.79:6789/0 conn(0x7f49140b1300 legacy=0x7f49140cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4912d9d700 1 -- 172.21.15.79:0/4165095361 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914069540 con 0x7f491415aea0 2023-10-14T18:45:15.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f491159a700 1 -- 172.21.15.79:0/4165095361 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196997805 0 0) 0x7f49140cb8b0 con 0x7f49140b1300 2023-10-14T18:45:15.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4912d9d700 1 --2- 172.21.15.79:0/4165095361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491415aea0 0x7f4914067660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49140712b0 tx=0x7f490c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a550eb89b1ee2902 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f491159a700 1 -- 172.21.15.79:0/4165095361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011630 con 0x7f491415aea0 2023-10-14T18:45:15.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f491159a700 1 -- 172.21.15.79:0/4165095361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c011790 con 0x7f491415aea0 2023-10-14T18:45:15.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f491159a700 1 -- 172.21.15.79:0/4165095361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011b30 con 0x7f491415aea0 2023-10-14T18:45:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 -- 172.21.15.79:0/4165095361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491415aea0 msgr2=0x7f4914067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 --2- 172.21.15.79:0/4165095361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491415aea0 0x7f4914067660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49140712b0 tx=0x7f490c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 -- 172.21.15.79:0/4165095361 shutdown_connections 2023-10-14T18:45:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 --2- 172.21.15.79:0/4165095361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491415aea0 0x7f4914067660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 --2- 172.21.15.79:0/4165095361 >> v2:172.21.15.144:3300/0 conn(0x7f49140b0f30 0x7f49140cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 -- 172.21.15.79:0/4165095361 >> 172.21.15.79:0/4165095361 conn(0x7f491406fdc0 msgr2=0x7f491406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:15.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 -- 172.21.15.79:0/4165095361 shutdown_connections 2023-10-14T18:45:15.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.078+0000 7f4918881700 1 -- 172.21.15.79:0/4165095361 wait complete. 2023-10-14T18:45:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.079+0000 7f4918881700 1 Processor -- start 2023-10-14T18:45:15.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 -- start start 2023-10-14T18:45:15.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49140b1300 0x7f4914151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491415aea0 0x7f49140c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914154e20 con 0x7f49140b0f30 2023-10-14T18:45:15.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491416ad10 con 0x7f49140b1300 2023-10-14T18:45:15.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f4918881700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4914154210 con 0x7f491415aea0 2023-10-14T18:45:15.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f491259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f491259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36614/0 (socket says 172.21.15.79:36614) 2023-10-14T18:45:15.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f491259c700 1 -- 172.21.15.79:0/3672696526 learned_addr learned my addr 172.21.15.79:0/3672696526 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:15.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f491259c700 1 -- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491415aea0 msgr2=0x7f49140c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.080+0000 7f491259c700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491415aea0 0x7f49140c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f491259c700 1 -- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49140b1300 msgr2=0x7f4914151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f491259c700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49140b1300 0x7f4914151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f491259c700 1 -- 172.21.15.79:0/3672696526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c009420 con 0x7f49140b0f30 2023-10-14T18:45:15.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f491259c700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4904009e50 tx=0x7f490400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490400cc20 con 0x7f49140b0f30 2023-10-14T18:45:15.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490400f040 con 0x7f49140b0f30 2023-10-14T18:45:15.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49141544f0 con 0x7f49140b0f30 2023-10-14T18:45:15.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904014480 con 0x7f49140b0f30 2023-10-14T18:45:15.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.081+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4914154ab0 con 0x7f49140b0f30 2023-10-14T18:45:15.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.082+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491404c3c0 con 0x7f49140b0f30 2023-10-14T18:45:15.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.082+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49040147f0 con 0x7f49140b0f30 2023-10-14T18:45:15.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.083+0000 7f490a7fc700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.083+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4904084f70 con 0x7f49140b0f30 2023-10-14T18:45:15.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.083+0000 7f4911d9b700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.083+0000 7f4911d9b700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 0x7f48f40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0011e0 tx=0x7f48fc0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.087+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49040521e0 con 0x7f49140b0f30 2023-10-14T18:45:15.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.265+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4914154f60 con 0x7f48f4066f30 2023-10-14T18:45:15.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.273+0000 7f490a7fc700 1 -- 172.21.15.79:0/3672696526 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251356 (secure 0 0 0) 0x7f48fc0058e0 con 0x7f48f4066f30 2023-10-14T18:45:15.276 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:15.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 msgr2=0x7f48f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 0x7f48f40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0011e0 tx=0x7f48fc0079d0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 msgr2=0x7f491416a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4904009e50 tx=0x7f490400b040 comp rx=0 tx=0).stop 2023-10-14T18:45:15.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 shutdown_connections 2023-10-14T18:45:15.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48f4066f30 0x7f48f40693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491415aea0 0x7f49140c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49140b0f30 0x7f491416a7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 --2- 172.21.15.79:0/3672696526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49140b1300 0x7f4914151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 >> 172.21.15.79:0/3672696526 conn(0x7f491406fdc0 msgr2=0x7f4914151370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 shutdown_connections 2023-10-14T18:45:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.275+0000 7f4918881700 1 -- 172.21.15.79:0/3672696526 wait complete. 2023-10-14T18:45:15.281 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:15.288 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T18:45:14.334869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560953,"statfs":{"total":1600000000,"available":1598416640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.848659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488029+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486913+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487731+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487982+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486690+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487958+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486640+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489793+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490619+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488955+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489021+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488106+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490746+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488726+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491642+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489096+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488328+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490177+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491300+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490435+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T18:45:01.141834+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:01.141834+0000","last_peered":"2023-10-14T18:45:01.141834+0000","last_clean":"2023-10-14T18:45:01.141834+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:01.141834+0000","last_undegraded":"2023-10-14T18:45:01.141834+0000","last_fullsized":"2023-10-14T18:45:01.141834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487209+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487637+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488383+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488887+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488701+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491413+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488831+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491801+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:15.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-14T18:45:15.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-14T18:45:15.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-14T18:45:15.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-14T18:45:15.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-14T18:45:15.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-14T18:45:15.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-14T18:45:15.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-14T18:45:15.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-14T18:45:15.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-14T18:45:15.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-14T18:45:15.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-14T18:45:15.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-14T18:45:15.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-14T18:45:15.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-14T18:45:15.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-14T18:45:15.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-14T18:45:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-14T18:45:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-14T18:45:15.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-14T18:45:15.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488029+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:45:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-14T18:45:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-14T18:45:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.486913+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:45:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-14T18:45:15.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-14T18:45:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487731+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-14T18:45:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-14T18:45:15.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487982+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-14T18:45:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-14T18:45:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.486690+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:45:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-14T18:45:15.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-14T18:45:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487958+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:45:15.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-14T18:45:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-14T18:45:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.486640+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:45:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-14T18:45:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-10-14T18:45:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.489793+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:45:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-14T18:45:15.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-14T18:45:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488345+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:45:15.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-14T18:45:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-10-14T18:45:15.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.490619+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:45:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-14T18:45:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-14T18:45:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488955+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-14T18:45:15.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-14T18:45:15.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.489021+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:45:15.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-14T18:45:15.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-14T18:45:15.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488106+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:45:15.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-14T18:45:15.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-10-14T18:45:15.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.490746+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:45:15.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-14T18:45:15.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-14T18:45:15.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488726+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:45:15.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-14T18:45:15.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-14T18:45:15.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.491642+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:45:15.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-14T18:45:15.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-10-14T18:45:15.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.489096+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:45:15.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-14T18:45:15.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-14T18:45:15.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488328+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-14T18:45:15.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-10-14T18:45:15.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.490177+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:45:15.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-14T18:45:15.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-14T18:45:15.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-14T18:45:15.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.491300+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:45:15.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-14T18:45:15.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-10-14T18:45:15.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.490435+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:45:15.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-14T18:45:15.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-14T18:45:15.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487209+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-14T18:45:15.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487637+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-14T18:45:15.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-14T18:45:15.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488383+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-14T18:45:15.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-14T18:45:15.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488345+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:45:15.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-14T18:45:15.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-14T18:45:15.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487407+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-14T18:45:15.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-14T18:45:15.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488887+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-14T18:45:15.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-14T18:45:15.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488701+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-14T18:45:15.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-14T18:45:15.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.487407+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:45:15.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-14T18:45:15.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-14T18:45:15.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.491413+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:45:15.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-14T18:45:15.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-14T18:45:15.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.488831+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:45:15.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-14T18:45:15.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-14T18:45:15.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:45:08.481618+0000', 'last_change': '2023-10-14T18:45:08.491801+0000', 'last_active': '2023-10-14T18:45:08.481618+0000', 'last_peered': '2023-10-14T18:45:08.481618+0000', 'last_clean': '2023-10-14T18:45:08.481618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:08.481618+0000', 'last_undegraded': '2023-10-14T18:45:08.481618+0000', 'last_fullsized': '2023-10-14T18:45:08.481618+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:08.481618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:45:15.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-14T18:45:15.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-14T18:45:15.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-14T18:45:15.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-14T18:45:15.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-14T18:45:15.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-14T18:45:15.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-14T18:45:15.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-14T18:45:15.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-14T18:45:15.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-14T18:45:15.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-14T18:45:15.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-14T18:45:15.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-14T18:45:15.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-14T18:45:15.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:45:09.485807+0000', 'last_change': '2023-10-14T18:45:09.485807+0000', 'last_active': '2023-10-14T18:45:09.485807+0000', 'last_peered': '2023-10-14T18:45:09.485807+0000', 'last_clean': '2023-10-14T18:45:09.485807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:45:09.485807+0000', 'last_undegraded': '2023-10-14T18:45:09.485807+0000', 'last_fullsized': '2023-10-14T18:45:09.485807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'last_clean_scrub_stamp': '2023-10-14T18:45:09.485807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:45:15.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T18:45:15.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.471+0000 7fee1bfff700 1 Processor -- start 2023-10-14T18:45:15.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.471+0000 7fee1bfff700 1 -- start start 2023-10-14T18:45:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee1c157520 0x7fee1c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 0x7fee1c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 0x7fee1c0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c15a270 con 0x7fee1c157520 2023-10-14T18:45:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c15b050 con 0x7fee1c1578f0 2023-10-14T18:45:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c071080 con 0x7fee1c070c40 2023-10-14T18:45:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee1c157520 0x7fee1c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fee1c157520 0x7fee1c067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36626/0 (socket says 172.21.15.79:36626) 2023-10-14T18:45:15.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1affd700 1 -- 172.21.15.79:0/191765130 learned_addr learned my addr 172.21.15.79:0/191765130 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1b7fe700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 0x7fee1c0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.472+0000 7fee1a7fc700 1 --2- 172.21.15.79:0/191765130 >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 0x7fee1c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 -- 172.21.15.79:0/191765130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 msgr2=0x7fee1c0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 0x7fee1c0ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 -- 172.21.15.79:0/191765130 >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 msgr2=0x7fee1c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 --2- 172.21.15.79:0/191765130 >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 0x7fee1c070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 -- 172.21.15.79:0/191765130 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c15a480 con 0x7fee1c157520 2023-10-14T18:45:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1b7fe700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 0x7fee1c0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1a7fc700 1 --2- 172.21.15.79:0/191765130 >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 0x7fee1c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1affd700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c157520 0x7fee1c067660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee1c06db60 tx=0x7fee0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ac96ece31f9cbc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee19ffb700 1 -- 172.21.15.79:0/191765130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00e070 con 0x7fee1c157520 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee19ffb700 1 -- 172.21.15.79:0/191765130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00ba50 con 0x7fee1c157520 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee19ffb700 1 -- 172.21.15.79:0/191765130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0092e0 con 0x7fee1c157520 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 -- 172.21.15.79:0/191765130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c157520 msgr2=0x7fee1c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c157520 0x7fee1c067660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee1c06db60 tx=0x7fee0c009840 comp rx=0 tx=0).stop 2023-10-14T18:45:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 -- 172.21.15.79:0/191765130 shutdown_connections 2023-10-14T18:45:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c070c40 0x7fee1c0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 --2- 172.21.15.79:0/191765130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c157520 0x7fee1c067660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 --2- 172.21.15.79:0/191765130 >> v2:172.21.15.144:3300/0 conn(0x7fee1c1578f0 0x7fee1c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 -- 172.21.15.79:0/191765130 >> 172.21.15.79:0/191765130 conn(0x7fee1c0cd8f0 msgr2=0x7fee1c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 -- 172.21.15.79:0/191765130 shutdown_connections 2023-10-14T18:45:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.473+0000 7fee1bfff700 1 -- 172.21.15.79:0/191765130 wait complete. 2023-10-14T18:45:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 Processor -- start 2023-10-14T18:45:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 -- start start 2023-10-14T18:45:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 0x7fee1c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c157520 0x7fee1c153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0b3260 con 0x7fee1c1578f0 2023-10-14T18:45:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c15c980 con 0x7fee1c070c40 2023-10-14T18:45:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c15c230 con 0x7fee1c157520 2023-10-14T18:45:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36642/0 (socket says 172.21.15.79:36642) 2023-10-14T18:45:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.475+0000 7fee1b7fe700 1 -- 172.21.15.79:0/2279330179 learned_addr learned my addr 172.21.15.79:0/2279330179 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1a7fc700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c157520 0x7fee1c153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1affd700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 0x7fee1c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 -- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c157520 msgr2=0x7fee1c153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c157520 0x7fee1c153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 -- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 msgr2=0x7fee1c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 0x7fee1c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 -- 172.21.15.79:0/2279330179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c009ae0 con 0x7fee1c1578f0 2023-10-14T18:45:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1affd700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 0x7fee1c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1b7fe700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c880 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14011600 con 0x7fee1c1578f0 2023-10-14T18:45:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14011780 con 0x7fee1c1578f0 2023-10-14T18:45:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c0b25e0 con 0x7fee1c1578f0 2023-10-14T18:45:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14011b40 con 0x7fee1c1578f0 2023-10-14T18:45:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.476+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c0b2ba0 con 0x7fee1c1578f0 2023-10-14T18:45:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.477+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c0b33a0 con 0x7fee1c1578f0 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.477+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee140193b0 con 0x7fee1c1578f0 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.478+0000 7fee02ffd700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.478+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee14084460 con 0x7fee1c1578f0 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.478+0000 7fee1affd700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.478+0000 7fee1affd700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009880 tx=0x7fee0c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.482+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee1c0b33a0 con 0x7fee1c1578f0 2023-10-14T18:45:15.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.744+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fee1c0b33a0 con 0x7fee1c1578f0 2023-10-14T18:45:15.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.744+0000 7fee02ffd700 1 -- 172.21.15.79:0/2279330179 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1102 (secure 0 0 0) 0x7fee1c0b33a0 con 0x7fee1c1578f0 2023-10-14T18:45:15.745 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:15.745 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1697309098,"num_in_osds":8,"osd_in_since":1697309095,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1583360,"bytes_avail":1598416640,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-14T18:44:52.717920+0000","services":{}},"progress_events":{}} 2023-10-14T18:45:15.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 msgr2=0x7fee080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009880 tx=0x7fee0c018000 comp rx=0 tx=0).stop 2023-10-14T18:45:15.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 msgr2=0x7fee1c154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee1400c880 tx=0x7fee14008040 comp rx=0 tx=0).stop 2023-10-14T18:45:15.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 shutdown_connections 2023-10-14T18:45:15.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee1c1578f0 0x7fee1c154c90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee1c070c40 0x7fee1c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 --2- 172.21.15.79:0/2279330179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee1c157520 0x7fee1c153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 >> 172.21.15.79:0/2279330179 conn(0x7fee1c0cd8f0 msgr2=0x7fee1c0c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:15.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 shutdown_connections 2023-10-14T18:45:15.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.746+0000 7fee1bfff700 1 -- 172.21.15.79:0/2279330179 wait complete. 2023-10-14T18:45:15.758 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T18:45:15.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:15.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.872+0000 7fdeb4ed7700 1 Processor -- start 2023-10-14T18:45:15.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.872+0000 7fdeb4ed7700 1 -- start start 2023-10-14T18:45:15.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeb4ed7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdeb01577d0 0x7fdeb00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeb4ed7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb015c360 con 0x7fdeb006ac30 2023-10-14T18:45:15.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeb4ed7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb015b790 con 0x7fdeb0157ba0 2023-10-14T18:45:15.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeb4ed7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb015ba30 con 0x7fdeb01577d0 2023-10-14T18:45:15.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeaed9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdeb006ac30 0x7fdeb015c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39698/0 (socket says 172.21.15.79:39698) 2023-10-14T18:45:15.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeaed9d700 1 -- 172.21.15.79:0/2878425376 learned_addr learned my addr 172.21.15.79:0/2878425376 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:15.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeae59c700 1 --2- 172.21.15.79:0/2878425376 >> v2:172.21.15.144:3300/0 conn(0x7fdeb01577d0 0x7fdeb00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300074246 0 0) 0x7fdeb015c360 con 0x7fdeb006ac30 2023-10-14T18:45:15.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.873+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003570 con 0x7fdeb006ac30 2023-10-14T18:45:15.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393671781 0 0) 0x7fde9c003570 con 0x7fdeb006ac30 2023-10-14T18:45:15.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeae59c700 1 -- 172.21.15.79:0/2878425376 >> v1:172.21.15.144:6789/0 conn(0x7fdeb0157ba0 legacy=0x7fdeb006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeae59c700 1 -- 172.21.15.79:0/2878425376 >> v1:172.21.15.79:6789/0 conn(0x7fdeb006ac30 legacy=0x7fdeb015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeae59c700 1 -- 172.21.15.79:0/2878425376 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb015bd10 con 0x7fdeb01577d0 2023-10-14T18:45:15.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeae59c700 1 --2- 172.21.15.79:0/2878425376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb00cd770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a6be0b7d7496da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea80017f0 con 0x7fdeb01577d0 2023-10-14T18:45:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0011420 con 0x7fdeb01577d0 2023-10-14T18:45:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeadd9b700 1 -- 172.21.15.79:0/2878425376 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00117a0 con 0x7fdeb01577d0 2023-10-14T18:45:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/2878425376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 msgr2=0x7fdeb00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.874+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/2878425376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb00cd770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdea00098e0 tx=0x7fdea00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.875+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/2878425376 shutdown_connections 2023-10-14T18:45:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.875+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/2878425376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb00cd770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.875+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/2878425376 >> 172.21.15.79:0/2878425376 conn(0x7fdeb0068ce0 msgr2=0x7fdeb00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.875+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/2878425376 shutdown_connections 2023-10-14T18:45:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.875+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/2878425376 wait complete. 2023-10-14T18:45:15.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.876+0000 7fdeb4ed7700 1 Processor -- start 2023-10-14T18:45:15.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.876+0000 7fdeb4ed7700 1 -- start start 2023-10-14T18:45:15.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.876+0000 7fdeb4ed7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 0x7fdeb015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.876+0000 7fdeb4ed7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.876+0000 7fdeb4ed7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeb4ed7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015de80 con 0x7fdeb0157ba0 2023-10-14T18:45:15.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeb4ed7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015f5a0 con 0x7fdeb01577d0 2023-10-14T18:45:15.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeb4ed7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015fa30 con 0x7fdeb006ac30 2023-10-14T18:45:15.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36654/0 (socket says 172.21.15.79:36654) 2023-10-14T18:45:15.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 -- 172.21.15.79:0/3488411897 learned_addr learned my addr 172.21.15.79:0/3488411897 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:15.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdea5d9b700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeae59c700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 0x7fdeb015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 -- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 msgr2=0x7fdeb015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 0x7fdeb015e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 -- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 msgr2=0x7fdeb015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 -- 172.21.15.79:0/3488411897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009420 con 0x7fdeb0157ba0 2023-10-14T18:45:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeae59c700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 0x7fdeb015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeaed9d700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cc40 tx=0x7fdea8007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8004dc0 con 0x7fdeb0157ba0 2023-10-14T18:45:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800a620 con 0x7fdeb0157ba0 2023-10-14T18:45:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb015e990 con 0x7fdeb0157ba0 2023-10-14T18:45:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800a9e0 con 0x7fdeb0157ba0 2023-10-14T18:45:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.877+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb015ef50 con 0x7fdeb0157ba0 2023-10-14T18:45:15.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.878+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb004c3c0 con 0x7fdeb0157ba0 2023-10-14T18:45:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.878+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdea8007150 con 0x7fdeb0157ba0 2023-10-14T18:45:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.879+0000 7fdea6ffd700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 0x7fde900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.879+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdea8083e40 con 0x7fdeb0157ba0 2023-10-14T18:45:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.879+0000 7fdeae59c700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 0x7fde900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.879+0000 7fdeae59c700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 0x7fde900693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdea000a010 tx=0x7fdea0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:15.883+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdea8051130 con 0x7fdeb0157ba0 2023-10-14T18:45:16.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.059+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdeb015c090 con 0x7fde90066f30 2023-10-14T18:45:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.067+0000 7fdea6ffd700 1 -- 172.21.15.79:0/3488411897 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251356 (secure 0 0 0) 0x7fdea0000ce0 con 0x7fde90066f30 2023-10-14T18:45:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 msgr2=0x7fde900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 0x7fde900693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdea000a010 tx=0x7fdea0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 msgr2=0x7fdeb016a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdea800cc40 tx=0x7fdea8007c70 comp rx=0 tx=0).stop 2023-10-14T18:45:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 shutdown_connections 2023-10-14T18:45:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde90066f30 0x7fde900693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdeb0157ba0 0x7fdeb016a600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdeb006ac30 0x7fdeb015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 --2- 172.21.15.79:0/3488411897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb01577d0 0x7fdeb015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 >> 172.21.15.79:0/3488411897 conn(0x7fdeb0068ce0 msgr2=0x7fdeb00cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:16.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 shutdown_connections 2023-10-14T18:45:16.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:16.070+0000 7fdeb4ed7700 1 -- 172.21.15.79:0/3488411897 wait complete. 2023-10-14T18:45:16.075 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:16.082 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-14T18:45:14.334869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1546,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560953,"statfs":{"total":1600000000,"available":1598416640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.848659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488029+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486913+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487731+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487982+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486690+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487958+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:18:18.468478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.486640+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489793+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490619+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488955+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489021+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488106+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490746+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488726+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491642+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.489096+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488328+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490177+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491300+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.490435+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-14T18:45:01.141834+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:01.141834+0000","last_peered":"2023-10-14T18:45:01.141834+0000","last_clean":"2023-10-14T18:45:01.141834+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:01.141834+0000","last_undegraded":"2023-10-14T18:45:01.141834+0000","last_fullsized":"2023-10-14T18:45:01.141834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487209+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487637+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488383+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488345+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:28.350133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488887+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488701+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.487407+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491413+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.488831+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:45:08.481618+0000","last_change":"2023-10-14T18:45:08.491801+0000","last_active":"2023-10-14T18:45:08.481618+0000","last_peered":"2023-10-14T18:45:08.481618+0000","last_clean":"2023-10-14T18:45:08.481618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:08.481618+0000","last_undegraded":"2023-10-14T18:45:08.481618+0000","last_fullsized":"2023-10-14T18:45:08.481618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:45:09.485807+0000","last_change":"2023-10-14T18:45:09.485807+0000","last_active":"2023-10-14T18:45:09.485807+0000","last_peered":"2023-10-14T18:45:09.485807+0000","last_clean":"2023-10-14T18:45:09.485807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:45:09.485807+0000","last_undegraded":"2023-10-14T18:45:09.485807+0000","last_fullsized":"2023-10-14T18:45:09.485807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359463,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:19.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:19.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.214+0000 7f39e73ab700 1 Processor -- start 2023-10-14T18:45:19.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.214+0000 7f39e73ab700 1 -- start start 2023-10-14T18:45:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e73ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39e00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e73ab700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e00cb370 con 0x7f39e0067d70 2023-10-14T18:45:19.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e73ab700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e00b0c60 con 0x7f39e00cbd40 2023-10-14T18:45:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e73ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e006a1e0 con 0x7f39e00b0890 2023-10-14T18:45:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e5948700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39e0067d70 0x7f39e0159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45478/0 (socket says 172.21.15.79:45478) 2023-10-14T18:45:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.215+0000 7f39e5948700 1 -- 172.21.15.79:0/2150136605 learned_addr learned my addr 172.21.15.79:0/2150136605 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e5147700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39e00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415026543 0 0) 0x7f39e00cb370 con 0x7f39e0067d70 2023-10-14T18:45:19.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc003570 con 0x7f39e0067d70 2023-10-14T18:45:19.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350545752 0 0) 0x7f39cc003570 con 0x7f39e0067d70 2023-10-14T18:45:19.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 msgr2=0x7f39e00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39e00cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 >> v1:172.21.15.144:6789/0 conn(0x7f39e00cbd40 legacy=0x7f39e0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e006cb80 con 0x7f39e0067d70 2023-10-14T18:45:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f39d8001470 con 0x7f39e0067d70 2023-10-14T18:45:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 >> v1:172.21.15.79:6789/0 conn(0x7f39e0067d70 legacy=0x7f39e0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39cc003a90 0x7f39cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc004810 0x7f39cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39cc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e006a1e0 con 0x7f39cc004810 2023-10-14T18:45:19.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc00bb60 con 0x7f39cc003a90 2023-10-14T18:45:19.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc00bd20 con 0x7f39e00b0890 2023-10-14T18:45:19.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc004810 0x7f39cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e5147700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39cc003a90 0x7f39cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e5948700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39cc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 -- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 msgr2=0x7f39cc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39e00b0890 0x7f39cc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 -- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39cc003a90 msgr2=0x7f39cc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39cc003a90 0x7f39cc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.216+0000 7f39e4946700 1 -- 172.21.15.79:0/2150136605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc003570 con 0x7f39cc004810 2023-10-14T18:45:19.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e4946700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc004810 0x7f39cc004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39d0001880 tx=0x7f39d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f25714829cc40a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012420 con 0x7f39cc004810 2023-10-14T18:45:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0012580 con 0x7f39cc004810 2023-10-14T18:45:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39d7fff700 1 -- 172.21.15.79:0/2150136605 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012920 con 0x7f39cc004810 2023-10-14T18:45:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 -- 172.21.15.79:0/2150136605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc004810 msgr2=0x7f39cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 --2- 172.21.15.79:0/2150136605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc004810 0x7f39cc004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39d0001880 tx=0x7f39d0007d30 comp rx=0 tx=0).stop 2023-10-14T18:45:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e5948700 1 -- 172.21.15.79:0/2150136605 reap_dead start 2023-10-14T18:45:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 -- 172.21.15.79:0/2150136605 shutdown_connections 2023-10-14T18:45:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 -- 172.21.15.79:0/2150136605 >> 172.21.15.79:0/2150136605 conn(0x7f39e006fe50 msgr2=0x7f39e0069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 -- 172.21.15.79:0/2150136605 shutdown_connections 2023-10-14T18:45:19.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.217+0000 7f39e73ab700 1 -- 172.21.15.79:0/2150136605 wait complete. 2023-10-14T18:45:19.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.218+0000 7f39e73ab700 1 Processor -- start 2023-10-14T18:45:19.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.218+0000 7f39e73ab700 1 -- start start 2023-10-14T18:45:19.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 0x7f39e00b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 0x7f39e015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015d790 con 0x7f39e00ac380 2023-10-14T18:45:19.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00b42d0 con 0x7f39e015cdd0 2023-10-14T18:45:19.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e73ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e00b4760 con 0x7f39cc004810 2023-10-14T18:45:19.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e4946700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e4946700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59296/0 (socket says 172.21.15.79:59296) 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.219+0000 7f39e4946700 1 -- 172.21.15.79:0/3496761948 learned_addr learned my addr 172.21.15.79:0/3496761948 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e5147700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 0x7f39e00b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e5948700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 0x7f39e015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 -- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 msgr2=0x7f39e00b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 0x7f39e00b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 -- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 msgr2=0x7f39e015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 0x7f39e015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 -- 172.21.15.79:0/3496761948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00ac7f0 con 0x7f39e00ac380 2023-10-14T18:45:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e5948700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 0x7f39e015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e5147700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 0x7f39e00b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e4946700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39d0001e70 tx=0x7f39d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012ea0 con 0x7f39e00ac380 2023-10-14T18:45:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0001200 con 0x7f39e00ac380 2023-10-14T18:45:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e00b36c0 con 0x7f39e00ac380 2023-10-14T18:45:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0012920 con 0x7f39e00ac380 2023-10-14T18:45:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.220+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e00b3c80 con 0x7f39e00ac380 2023-10-14T18:45:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.221+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e00b4460 con 0x7f39e00ac380 2023-10-14T18:45:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.221+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39d0019070 con 0x7f39e00ac380 2023-10-14T18:45:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.222+0000 7f39d57fa700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.222+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39d0085da0 con 0x7f39e00ac380 2023-10-14T18:45:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.222+0000 7f39e5147700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.223+0000 7f39e5147700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 0x7f39c40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0094d0 tx=0x7f39dc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.226+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d0052f70 con 0x7f39e00ac380 2023-10-14T18:45:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.404+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39e004c3c0 con 0x7f39c4066f30 2023-10-14T18:45:19.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.412+0000 7f39d57fa700 1 -- 172.21.15.79:0/3496761948 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260149 (secure 0 0 0) 0x7f39e004c3c0 con 0x7f39c4066f30 2023-10-14T18:45:19.416 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:19.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 msgr2=0x7f39c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 0x7f39c40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39dc0094d0 tx=0x7f39dc00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:19.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 msgr2=0x7f39e015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39d0001e70 tx=0x7f39d0015000 comp rx=0 tx=0).stop 2023-10-14T18:45:19.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 shutdown_connections 2023-10-14T18:45:19.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39c4066f30 0x7f39c40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39e015cdd0 0x7f39e015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39cc004810 0x7f39e00b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 --2- 172.21.15.79:0/3496761948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39e00ac380 0x7f39e015a050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 >> 172.21.15.79:0/3496761948 conn(0x7f39e006fe50 msgr2=0x7f39e00ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:19.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 shutdown_connections 2023-10-14T18:45:19.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.415+0000 7f39e73ab700 1 -- 172.21.15.79:0/3496761948 wait complete. 2023-10-14T18:45:19.420 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:19.427 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T18:45:18.336005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505788+0000","last_change":"2023-10-14T18:45:10.504806+0000","last_active":"2023-10-14T18:45:10.505788+0000","last_peered":"2023-10-14T18:45:10.505788+0000","last_clean":"2023-10-14T18:45:10.505788+0000","last_became_active":"2023-10-14T18:45:10.504592+0000","last_became_peered":"2023-10-14T18:45:10.504592+0000","last_unstale":"2023-10-14T18:45:10.505788+0000","last_undegraded":"2023-10-14T18:45:10.505788+0000","last_fullsized":"2023-10-14T18:45:10.505788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501740+0000","last_change":"2023-10-14T18:45:10.501684+0000","last_active":"2023-10-14T18:45:10.501740+0000","last_peered":"2023-10-14T18:45:10.501740+0000","last_clean":"2023-10-14T18:45:10.501740+0000","last_became_active":"2023-10-14T18:45:10.501468+0000","last_became_peered":"2023-10-14T18:45:10.501468+0000","last_unstale":"2023-10-14T18:45:10.501740+0000","last_undegraded":"2023-10-14T18:45:10.501740+0000","last_fullsized":"2023-10-14T18:45:10.501740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501737+0000","last_change":"2023-10-14T18:45:10.501682+0000","last_active":"2023-10-14T18:45:10.501737+0000","last_peered":"2023-10-14T18:45:10.501737+0000","last_clean":"2023-10-14T18:45:10.501737+0000","last_became_active":"2023-10-14T18:45:10.501209+0000","last_became_peered":"2023-10-14T18:45:10.501209+0000","last_unstale":"2023-10-14T18:45:10.501737+0000","last_undegraded":"2023-10-14T18:45:10.501737+0000","last_fullsized":"2023-10-14T18:45:10.501737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510790+0000","last_change":"2023-10-14T18:45:10.508252+0000","last_active":"2023-10-14T18:45:10.510790+0000","last_peered":"2023-10-14T18:45:10.510790+0000","last_clean":"2023-10-14T18:45:10.510790+0000","last_became_active":"2023-10-14T18:45:10.506413+0000","last_became_peered":"2023-10-14T18:45:10.506413+0000","last_unstale":"2023-10-14T18:45:10.510790+0000","last_undegraded":"2023-10-14T18:45:10.510790+0000","last_fullsized":"2023-10-14T18:45:10.510790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502782+0000","last_change":"2023-10-14T18:45:10.502278+0000","last_active":"2023-10-14T18:45:10.502782+0000","last_peered":"2023-10-14T18:45:10.502782+0000","last_clean":"2023-10-14T18:45:10.502782+0000","last_became_active":"2023-10-14T18:45:10.502034+0000","last_became_peered":"2023-10-14T18:45:10.502034+0000","last_unstale":"2023-10-14T18:45:10.502782+0000","last_undegraded":"2023-10-14T18:45:10.502782+0000","last_fullsized":"2023-10-14T18:45:10.502782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511005+0000","last_change":"2023-10-14T18:45:10.510963+0000","last_active":"2023-10-14T18:45:10.511005+0000","last_peered":"2023-10-14T18:45:10.511005+0000","last_clean":"2023-10-14T18:45:10.511005+0000","last_became_active":"2023-10-14T18:45:10.509764+0000","last_became_peered":"2023-10-14T18:45:10.509764+0000","last_unstale":"2023-10-14T18:45:10.511005+0000","last_undegraded":"2023-10-14T18:45:10.511005+0000","last_fullsized":"2023-10-14T18:45:10.511005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499650+0000","last_change":"2023-10-14T18:45:10.499583+0000","last_active":"2023-10-14T18:45:10.499650+0000","last_peered":"2023-10-14T18:45:10.499650+0000","last_clean":"2023-10-14T18:45:10.499650+0000","last_became_active":"2023-10-14T18:45:10.499349+0000","last_became_peered":"2023-10-14T18:45:10.499349+0000","last_unstale":"2023-10-14T18:45:10.499650+0000","last_undegraded":"2023-10-14T18:45:10.499650+0000","last_fullsized":"2023-10-14T18:45:10.499650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502699+0000","last_change":"2023-10-14T18:45:10.502642+0000","last_active":"2023-10-14T18:45:10.502699+0000","last_peered":"2023-10-14T18:45:10.502699+0000","last_clean":"2023-10-14T18:45:10.502699+0000","last_became_active":"2023-10-14T18:45:10.502429+0000","last_became_peered":"2023-10-14T18:45:10.502429+0000","last_unstale":"2023-10-14T18:45:10.502699+0000","last_undegraded":"2023-10-14T18:45:10.502699+0000","last_fullsized":"2023-10-14T18:45:10.502699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508406+0000","last_change":"2023-10-14T18:45:10.507819+0000","last_active":"2023-10-14T18:45:10.508406+0000","last_peered":"2023-10-14T18:45:10.508406+0000","last_clean":"2023-10-14T18:45:10.508406+0000","last_became_active":"2023-10-14T18:45:10.506697+0000","last_became_peered":"2023-10-14T18:45:10.506697+0000","last_unstale":"2023-10-14T18:45:10.508406+0000","last_undegraded":"2023-10-14T18:45:10.508406+0000","last_fullsized":"2023-10-14T18:45:10.508406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:15.231896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503640+0000","last_change":"2023-10-14T18:45:10.503569+0000","last_active":"2023-10-14T18:45:10.503640+0000","last_peered":"2023-10-14T18:45:10.503640+0000","last_clean":"2023-10-14T18:45:10.503640+0000","last_became_active":"2023-10-14T18:45:10.503321+0000","last_became_peered":"2023-10-14T18:45:10.503321+0000","last_unstale":"2023-10-14T18:45:10.503640+0000","last_undegraded":"2023-10-14T18:45:10.503640+0000","last_fullsized":"2023-10-14T18:45:10.503640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.510687+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.510465+0000","last_became_peered":"2023-10-14T18:45:10.510465+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509012+0000","last_change":"2023-10-14T18:45:10.508916+0000","last_active":"2023-10-14T18:45:10.509012+0000","last_peered":"2023-10-14T18:45:10.509012+0000","last_clean":"2023-10-14T18:45:10.509012+0000","last_became_active":"2023-10-14T18:45:10.508688+0000","last_became_peered":"2023-10-14T18:45:10.508688+0000","last_unstale":"2023-10-14T18:45:10.509012+0000","last_undegraded":"2023-10-14T18:45:10.509012+0000","last_fullsized":"2023-10-14T18:45:10.509012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:53.054157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501887+0000","last_change":"2023-10-14T18:45:10.499725+0000","last_active":"2023-10-14T18:45:10.501887+0000","last_peered":"2023-10-14T18:45:10.501887+0000","last_clean":"2023-10-14T18:45:10.501887+0000","last_became_active":"2023-10-14T18:45:10.499536+0000","last_became_peered":"2023-10-14T18:45:10.499536+0000","last_unstale":"2023-10-14T18:45:10.501887+0000","last_undegraded":"2023-10-14T18:45:10.501887+0000","last_fullsized":"2023-10-14T18:45:10.501887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500498+0000","last_change":"2023-10-14T18:45:10.500406+0000","last_active":"2023-10-14T18:45:10.500498+0000","last_peered":"2023-10-14T18:45:10.500498+0000","last_clean":"2023-10-14T18:45:10.500498+0000","last_became_active":"2023-10-14T18:45:10.500169+0000","last_became_peered":"2023-10-14T18:45:10.500169+0000","last_unstale":"2023-10-14T18:45:10.500498+0000","last_undegraded":"2023-10-14T18:45:10.500498+0000","last_fullsized":"2023-10-14T18:45:10.500498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509572+0000","last_change":"2023-10-14T18:45:10.509512+0000","last_active":"2023-10-14T18:45:10.509572+0000","last_peered":"2023-10-14T18:45:10.509572+0000","last_clean":"2023-10-14T18:45:10.509572+0000","last_became_active":"2023-10-14T18:45:10.509284+0000","last_became_peered":"2023-10-14T18:45:10.509284+0000","last_unstale":"2023-10-14T18:45:10.509572+0000","last_undegraded":"2023-10-14T18:45:10.509572+0000","last_fullsized":"2023-10-14T18:45:10.509572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510815+0000","last_change":"2023-10-14T18:45:10.510079+0000","last_active":"2023-10-14T18:45:10.510815+0000","last_peered":"2023-10-14T18:45:10.510815+0000","last_clean":"2023-10-14T18:45:10.510815+0000","last_became_active":"2023-10-14T18:45:10.506192+0000","last_became_peered":"2023-10-14T18:45:10.506192+0000","last_unstale":"2023-10-14T18:45:10.510815+0000","last_undegraded":"2023-10-14T18:45:10.510815+0000","last_fullsized":"2023-10-14T18:45:10.510815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512268+0000","last_change":"2023-10-14T18:45:10.512204+0000","last_active":"2023-10-14T18:45:10.512268+0000","last_peered":"2023-10-14T18:45:10.512268+0000","last_clean":"2023-10-14T18:45:10.512268+0000","last_became_active":"2023-10-14T18:45:10.511231+0000","last_became_peered":"2023-10-14T18:45:10.511231+0000","last_unstale":"2023-10-14T18:45:10.512268+0000","last_undegraded":"2023-10-14T18:45:10.512268+0000","last_fullsized":"2023-10-14T18:45:10.512268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500876+0000","last_change":"2023-10-14T18:45:10.500810+0000","last_active":"2023-10-14T18:45:10.500876+0000","last_peered":"2023-10-14T18:45:10.500876+0000","last_clean":"2023-10-14T18:45:10.500876+0000","last_became_active":"2023-10-14T18:45:10.500601+0000","last_became_peered":"2023-10-14T18:45:10.500601+0000","last_unstale":"2023-10-14T18:45:10.500876+0000","last_undegraded":"2023-10-14T18:45:10.500876+0000","last_fullsized":"2023-10-14T18:45:10.500876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508428+0000","last_change":"2023-10-14T18:45:10.508118+0000","last_active":"2023-10-14T18:45:10.508428+0000","last_peered":"2023-10-14T18:45:10.508428+0000","last_clean":"2023-10-14T18:45:10.508428+0000","last_became_active":"2023-10-14T18:45:10.507261+0000","last_became_peered":"2023-10-14T18:45:10.507261+0000","last_unstale":"2023-10-14T18:45:10.508428+0000","last_undegraded":"2023-10-14T18:45:10.508428+0000","last_fullsized":"2023-10-14T18:45:10.508428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:43.467593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516240+0000","last_change":"2023-10-14T18:45:09.502434+0000","last_active":"2023-10-14T18:45:10.516240+0000","last_peered":"2023-10-14T18:45:10.516240+0000","last_clean":"2023-10-14T18:45:10.516240+0000","last_became_active":"2023-10-14T18:45:09.502209+0000","last_became_peered":"2023-10-14T18:45:09.502209+0000","last_unstale":"2023-10-14T18:45:10.516240+0000","last_undegraded":"2023-10-14T18:45:10.516240+0000","last_fullsized":"2023-10-14T18:45:10.516240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502473+0000","last_change":"2023-10-14T18:45:10.502419+0000","last_active":"2023-10-14T18:45:10.502473+0000","last_peered":"2023-10-14T18:45:10.502473+0000","last_clean":"2023-10-14T18:45:10.502473+0000","last_became_active":"2023-10-14T18:45:10.502191+0000","last_became_peered":"2023-10-14T18:45:10.502191+0000","last_unstale":"2023-10-14T18:45:10.502473+0000","last_undegraded":"2023-10-14T18:45:10.502473+0000","last_fullsized":"2023-10-14T18:45:10.502473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518917+0000","last_change":"2023-10-14T18:45:09.495053+0000","last_active":"2023-10-14T18:45:10.518917+0000","last_peered":"2023-10-14T18:45:10.518917+0000","last_clean":"2023-10-14T18:45:10.518917+0000","last_became_active":"2023-10-14T18:45:09.494826+0000","last_became_peered":"2023-10-14T18:45:09.494826+0000","last_unstale":"2023-10-14T18:45:10.518917+0000","last_undegraded":"2023-10-14T18:45:10.518917+0000","last_fullsized":"2023-10-14T18:45:10.518917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501605+0000","last_change":"2023-10-14T18:45:10.501557+0000","last_active":"2023-10-14T18:45:10.501605+0000","last_peered":"2023-10-14T18:45:10.501605+0000","last_clean":"2023-10-14T18:45:10.501605+0000","last_became_active":"2023-10-14T18:45:10.500923+0000","last_became_peered":"2023-10-14T18:45:10.500923+0000","last_unstale":"2023-10-14T18:45:10.501605+0000","last_undegraded":"2023-10-14T18:45:10.501605+0000","last_fullsized":"2023-10-14T18:45:10.501605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516200+0000","last_change":"2023-10-14T18:45:09.505639+0000","last_active":"2023-10-14T18:45:10.516200+0000","last_peered":"2023-10-14T18:45:10.516200+0000","last_clean":"2023-10-14T18:45:10.516200+0000","last_became_active":"2023-10-14T18:45:09.505410+0000","last_became_peered":"2023-10-14T18:45:09.505410+0000","last_unstale":"2023-10-14T18:45:10.516200+0000","last_undegraded":"2023-10-14T18:45:10.516200+0000","last_fullsized":"2023-10-14T18:45:10.516200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511210+0000","last_change":"2023-10-14T18:45:10.511079+0000","last_active":"2023-10-14T18:45:10.511210+0000","last_peered":"2023-10-14T18:45:10.511210+0000","last_clean":"2023-10-14T18:45:10.511210+0000","last_became_active":"2023-10-14T18:45:10.510806+0000","last_became_peered":"2023-10-14T18:45:10.510806+0000","last_unstale":"2023-10-14T18:45:10.511210+0000","last_undegraded":"2023-10-14T18:45:10.511210+0000","last_fullsized":"2023-10-14T18:45:10.511210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515405+0000","last_change":"2023-10-14T18:45:09.504487+0000","last_active":"2023-10-14T18:45:10.515405+0000","last_peered":"2023-10-14T18:45:10.515405+0000","last_clean":"2023-10-14T18:45:10.515405+0000","last_became_active":"2023-10-14T18:45:09.504255+0000","last_became_peered":"2023-10-14T18:45:09.504255+0000","last_unstale":"2023-10-14T18:45:10.515405+0000","last_undegraded":"2023-10-14T18:45:10.515405+0000","last_fullsized":"2023-10-14T18:45:10.515405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:56.816202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511025+0000","last_change":"2023-10-14T18:45:10.510969+0000","last_active":"2023-10-14T18:45:10.511025+0000","last_peered":"2023-10-14T18:45:10.511025+0000","last_clean":"2023-10-14T18:45:10.511025+0000","last_became_active":"2023-10-14T18:45:10.510799+0000","last_became_peered":"2023-10-14T18:45:10.510799+0000","last_unstale":"2023-10-14T18:45:10.511025+0000","last_undegraded":"2023-10-14T18:45:10.511025+0000","last_fullsized":"2023-10-14T18:45:10.511025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518837+0000","last_change":"2023-10-14T18:45:09.500085+0000","last_active":"2023-10-14T18:45:10.518837+0000","last_peered":"2023-10-14T18:45:10.518837+0000","last_clean":"2023-10-14T18:45:10.518837+0000","last_became_active":"2023-10-14T18:45:09.499843+0000","last_became_peered":"2023-10-14T18:45:09.499843+0000","last_unstale":"2023-10-14T18:45:10.518837+0000","last_undegraded":"2023-10-14T18:45:10.518837+0000","last_fullsized":"2023-10-14T18:45:10.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503509+0000","last_change":"2023-10-14T18:45:10.503087+0000","last_active":"2023-10-14T18:45:10.503509+0000","last_peered":"2023-10-14T18:45:10.503509+0000","last_clean":"2023-10-14T18:45:10.503509+0000","last_became_active":"2023-10-14T18:45:10.502874+0000","last_became_peered":"2023-10-14T18:45:10.502874+0000","last_unstale":"2023-10-14T18:45:10.503509+0000","last_undegraded":"2023-10-14T18:45:10.503509+0000","last_fullsized":"2023-10-14T18:45:10.503509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:44.694101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516052+0000","last_change":"2023-10-14T18:45:09.500407+0000","last_active":"2023-10-14T18:45:10.516052+0000","last_peered":"2023-10-14T18:45:10.516052+0000","last_clean":"2023-10-14T18:45:10.516052+0000","last_became_active":"2023-10-14T18:45:09.500159+0000","last_became_peered":"2023-10-14T18:45:09.500159+0000","last_unstale":"2023-10-14T18:45:10.516052+0000","last_undegraded":"2023-10-14T18:45:10.516052+0000","last_fullsized":"2023-10-14T18:45:10.516052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503008+0000","last_change":"2023-10-14T18:45:10.502958+0000","last_active":"2023-10-14T18:45:10.503008+0000","last_peered":"2023-10-14T18:45:10.503008+0000","last_clean":"2023-10-14T18:45:10.503008+0000","last_became_active":"2023-10-14T18:45:10.502750+0000","last_became_peered":"2023-10-14T18:45:10.502750+0000","last_unstale":"2023-10-14T18:45:10.503008+0000","last_undegraded":"2023-10-14T18:45:10.503008+0000","last_fullsized":"2023-10-14T18:45:10.503008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:08.710513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493584+0000","last_change":"2023-10-14T18:45:09.500758+0000","last_active":"2023-10-14T18:45:10.493584+0000","last_peered":"2023-10-14T18:45:10.493584+0000","last_clean":"2023-10-14T18:45:10.493584+0000","last_became_active":"2023-10-14T18:45:09.500521+0000","last_became_peered":"2023-10-14T18:45:09.500521+0000","last_unstale":"2023-10-14T18:45:10.493584+0000","last_undegraded":"2023-10-14T18:45:10.493584+0000","last_fullsized":"2023-10-14T18:45:10.493584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495482+0000","last_change":"2023-10-14T18:45:10.495391+0000","last_active":"2023-10-14T18:45:10.495482+0000","last_peered":"2023-10-14T18:45:10.495482+0000","last_clean":"2023-10-14T18:45:10.495482+0000","last_became_active":"2023-10-14T18:45:10.495163+0000","last_became_peered":"2023-10-14T18:45:10.495163+0000","last_unstale":"2023-10-14T18:45:10.495482+0000","last_undegraded":"2023-10-14T18:45:10.495482+0000","last_fullsized":"2023-10-14T18:45:10.495482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499343+0000","last_change":"2023-10-14T18:45:09.504439+0000","last_active":"2023-10-14T18:45:10.499343+0000","last_peered":"2023-10-14T18:45:10.499343+0000","last_clean":"2023-10-14T18:45:10.499343+0000","last_became_active":"2023-10-14T18:45:09.503977+0000","last_became_peered":"2023-10-14T18:45:09.503977+0000","last_unstale":"2023-10-14T18:45:10.499343+0000","last_undegraded":"2023-10-14T18:45:10.499343+0000","last_fullsized":"2023-10-14T18:45:10.499343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500472+0000","last_change":"2023-10-14T18:45:10.500298+0000","last_active":"2023-10-14T18:45:10.500472+0000","last_peered":"2023-10-14T18:45:10.500472+0000","last_clean":"2023-10-14T18:45:10.500472+0000","last_became_active":"2023-10-14T18:45:10.500086+0000","last_became_peered":"2023-10-14T18:45:10.500086+0000","last_unstale":"2023-10-14T18:45:10.500472+0000","last_undegraded":"2023-10-14T18:45:10.500472+0000","last_fullsized":"2023-10-14T18:45:10.500472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498655+0000","last_change":"2023-10-14T18:45:09.503955+0000","last_active":"2023-10-14T18:45:10.498655+0000","last_peered":"2023-10-14T18:45:10.498655+0000","last_clean":"2023-10-14T18:45:10.498655+0000","last_became_active":"2023-10-14T18:45:09.503727+0000","last_became_peered":"2023-10-14T18:45:09.503727+0000","last_unstale":"2023-10-14T18:45:10.498655+0000","last_undegraded":"2023-10-14T18:45:10.498655+0000","last_fullsized":"2023-10-14T18:45:10.498655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502492+0000","last_change":"2023-10-14T18:45:10.502425+0000","last_active":"2023-10-14T18:45:10.502492+0000","last_peered":"2023-10-14T18:45:10.502492+0000","last_clean":"2023-10-14T18:45:10.502492+0000","last_became_active":"2023-10-14T18:45:10.502206+0000","last_became_peered":"2023-10-14T18:45:10.502206+0000","last_unstale":"2023-10-14T18:45:10.502492+0000","last_undegraded":"2023-10-14T18:45:10.502492+0000","last_fullsized":"2023-10-14T18:45:10.502492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500075+0000","last_change":"2023-10-14T18:45:09.505574+0000","last_active":"2023-10-14T18:45:10.500075+0000","last_peered":"2023-10-14T18:45:10.500075+0000","last_clean":"2023-10-14T18:45:10.500075+0000","last_became_active":"2023-10-14T18:45:09.504963+0000","last_became_peered":"2023-10-14T18:45:09.504963+0000","last_unstale":"2023-10-14T18:45:10.500075+0000","last_undegraded":"2023-10-14T18:45:10.500075+0000","last_fullsized":"2023-10-14T18:45:10.500075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507028+0000","last_change":"2023-10-14T18:45:10.506952+0000","last_active":"2023-10-14T18:45:10.507028+0000","last_peered":"2023-10-14T18:45:10.507028+0000","last_clean":"2023-10-14T18:45:10.507028+0000","last_became_active":"2023-10-14T18:45:10.506621+0000","last_became_peered":"2023-10-14T18:45:10.506621+0000","last_unstale":"2023-10-14T18:45:10.507028+0000","last_undegraded":"2023-10-14T18:45:10.507028+0000","last_fullsized":"2023-10-14T18:45:10.507028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515309+0000","last_change":"2023-10-14T18:45:09.501054+0000","last_active":"2023-10-14T18:45:10.515309+0000","last_peered":"2023-10-14T18:45:10.515309+0000","last_clean":"2023-10-14T18:45:10.515309+0000","last_became_active":"2023-10-14T18:45:09.500522+0000","last_became_peered":"2023-10-14T18:45:09.500522+0000","last_unstale":"2023-10-14T18:45:10.515309+0000","last_undegraded":"2023-10-14T18:45:10.515309+0000","last_fullsized":"2023-10-14T18:45:10.515309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507400+0000","last_change":"2023-10-14T18:45:10.507329+0000","last_active":"2023-10-14T18:45:10.507400+0000","last_peered":"2023-10-14T18:45:10.507400+0000","last_clean":"2023-10-14T18:45:10.507400+0000","last_became_active":"2023-10-14T18:45:10.507042+0000","last_became_peered":"2023-10-14T18:45:10.507042+0000","last_unstale":"2023-10-14T18:45:10.507400+0000","last_undegraded":"2023-10-14T18:45:10.507400+0000","last_fullsized":"2023-10-14T18:45:10.507400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.519581+0000","last_change":"2023-10-14T18:45:09.502428+0000","last_active":"2023-10-14T18:45:10.519581+0000","last_peered":"2023-10-14T18:45:10.519581+0000","last_clean":"2023-10-14T18:45:10.519581+0000","last_became_active":"2023-10-14T18:45:09.502204+0000","last_became_peered":"2023-10-14T18:45:09.502204+0000","last_unstale":"2023-10-14T18:45:10.519581+0000","last_undegraded":"2023-10-14T18:45:10.519581+0000","last_fullsized":"2023-10-14T18:45:10.519581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505808+0000","last_change":"2023-10-14T18:45:10.505484+0000","last_active":"2023-10-14T18:45:10.505808+0000","last_peered":"2023-10-14T18:45:10.505808+0000","last_clean":"2023-10-14T18:45:10.505808+0000","last_became_active":"2023-10-14T18:45:10.505215+0000","last_became_peered":"2023-10-14T18:45:10.505215+0000","last_unstale":"2023-10-14T18:45:10.505808+0000","last_undegraded":"2023-10-14T18:45:10.505808+0000","last_fullsized":"2023-10-14T18:45:10.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516904+0000","last_change":"2023-10-14T18:45:09.500718+0000","last_active":"2023-10-14T18:45:10.516904+0000","last_peered":"2023-10-14T18:45:10.516904+0000","last_clean":"2023-10-14T18:45:10.516904+0000","last_became_active":"2023-10-14T18:45:09.500458+0000","last_became_peered":"2023-10-14T18:45:09.500458+0000","last_unstale":"2023-10-14T18:45:10.516904+0000","last_undegraded":"2023-10-14T18:45:10.516904+0000","last_fullsized":"2023-10-14T18:45:10.516904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496812+0000","last_change":"2023-10-14T18:45:10.496651+0000","last_active":"2023-10-14T18:45:10.496812+0000","last_peered":"2023-10-14T18:45:10.496812+0000","last_clean":"2023-10-14T18:45:10.496812+0000","last_became_active":"2023-10-14T18:45:10.496150+0000","last_became_peered":"2023-10-14T18:45:10.496150+0000","last_unstale":"2023-10-14T18:45:10.496812+0000","last_undegraded":"2023-10-14T18:45:10.496812+0000","last_fullsized":"2023-10-14T18:45:10.496812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500483+0000","last_change":"2023-10-14T18:45:09.503379+0000","last_active":"2023-10-14T18:45:10.500483+0000","last_peered":"2023-10-14T18:45:10.500483+0000","last_clean":"2023-10-14T18:45:10.500483+0000","last_became_active":"2023-10-14T18:45:09.503137+0000","last_became_peered":"2023-10-14T18:45:09.503137+0000","last_unstale":"2023-10-14T18:45:10.500483+0000","last_undegraded":"2023-10-14T18:45:10.500483+0000","last_fullsized":"2023-10-14T18:45:10.500483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510222+0000","last_change":"2023-10-14T18:45:10.509982+0000","last_active":"2023-10-14T18:45:10.510222+0000","last_peered":"2023-10-14T18:45:10.510222+0000","last_clean":"2023-10-14T18:45:10.510222+0000","last_became_active":"2023-10-14T18:45:10.509462+0000","last_became_peered":"2023-10-14T18:45:10.509462+0000","last_unstale":"2023-10-14T18:45:10.510222+0000","last_undegraded":"2023-10-14T18:45:10.510222+0000","last_fullsized":"2023-10-14T18:45:10.510222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498432+0000","last_change":"2023-10-14T18:45:09.502982+0000","last_active":"2023-10-14T18:45:10.498432+0000","last_peered":"2023-10-14T18:45:10.498432+0000","last_clean":"2023-10-14T18:45:10.498432+0000","last_became_active":"2023-10-14T18:45:09.499379+0000","last_became_peered":"2023-10-14T18:45:09.499379+0000","last_unstale":"2023-10-14T18:45:10.498432+0000","last_undegraded":"2023-10-14T18:45:10.498432+0000","last_fullsized":"2023-10-14T18:45:10.498432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505816+0000","last_change":"2023-10-14T18:45:10.504993+0000","last_active":"2023-10-14T18:45:10.505816+0000","last_peered":"2023-10-14T18:45:10.505816+0000","last_clean":"2023-10-14T18:45:10.505816+0000","last_became_active":"2023-10-14T18:45:10.504493+0000","last_became_peered":"2023-10-14T18:45:10.504493+0000","last_unstale":"2023-10-14T18:45:10.505816+0000","last_undegraded":"2023-10-14T18:45:10.505816+0000","last_fullsized":"2023-10-14T18:45:10.505816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516768+0000","last_change":"2023-10-14T18:45:09.498248+0000","last_active":"2023-10-14T18:45:10.516768+0000","last_peered":"2023-10-14T18:45:10.516768+0000","last_clean":"2023-10-14T18:45:10.516768+0000","last_became_active":"2023-10-14T18:45:09.498027+0000","last_became_peered":"2023-10-14T18:45:09.498027+0000","last_unstale":"2023-10-14T18:45:10.516768+0000","last_undegraded":"2023-10-14T18:45:10.516768+0000","last_fullsized":"2023-10-14T18:45:10.516768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503199+0000","last_change":"2023-10-14T18:45:10.503098+0000","last_active":"2023-10-14T18:45:10.503199+0000","last_peered":"2023-10-14T18:45:10.503199+0000","last_clean":"2023-10-14T18:45:10.503199+0000","last_became_active":"2023-10-14T18:45:10.502805+0000","last_became_peered":"2023-10-14T18:45:10.502805+0000","last_unstale":"2023-10-14T18:45:10.503199+0000","last_undegraded":"2023-10-14T18:45:10.503199+0000","last_fullsized":"2023-10-14T18:45:10.503199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515581+0000","last_change":"2023-10-14T18:45:09.500202+0000","last_active":"2023-10-14T18:45:10.515581+0000","last_peered":"2023-10-14T18:45:10.515581+0000","last_clean":"2023-10-14T18:45:10.515581+0000","last_became_active":"2023-10-14T18:45:09.499922+0000","last_became_peered":"2023-10-14T18:45:09.499922+0000","last_unstale":"2023-10-14T18:45:10.515581+0000","last_undegraded":"2023-10-14T18:45:10.515581+0000","last_fullsized":"2023-10-14T18:45:10.515581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510239+0000","last_change":"2023-10-14T18:45:10.510150+0000","last_active":"2023-10-14T18:45:10.510239+0000","last_peered":"2023-10-14T18:45:10.510239+0000","last_clean":"2023-10-14T18:45:10.510239+0000","last_became_active":"2023-10-14T18:45:10.509761+0000","last_became_peered":"2023-10-14T18:45:10.509761+0000","last_unstale":"2023-10-14T18:45:10.510239+0000","last_undegraded":"2023-10-14T18:45:10.510239+0000","last_fullsized":"2023-10-14T18:45:10.510239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497491+0000","last_change":"2023-10-14T18:45:09.496779+0000","last_active":"2023-10-14T18:45:10.497491+0000","last_peered":"2023-10-14T18:45:10.497491+0000","last_clean":"2023-10-14T18:45:10.497491+0000","last_became_active":"2023-10-14T18:45:09.495762+0000","last_became_peered":"2023-10-14T18:45:09.495762+0000","last_unstale":"2023-10-14T18:45:10.497491+0000","last_undegraded":"2023-10-14T18:45:10.497491+0000","last_fullsized":"2023-10-14T18:45:10.497491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.507894+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.506095+0000","last_became_peered":"2023-10-14T18:45:10.506095+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500192+0000","last_change":"2023-10-14T18:45:09.502756+0000","last_active":"2023-10-14T18:45:10.500192+0000","last_peered":"2023-10-14T18:45:10.500192+0000","last_clean":"2023-10-14T18:45:10.500192+0000","last_became_active":"2023-10-14T18:45:09.502106+0000","last_became_peered":"2023-10-14T18:45:09.502106+0000","last_unstale":"2023-10-14T18:45:10.500192+0000","last_undegraded":"2023-10-14T18:45:10.500192+0000","last_fullsized":"2023-10-14T18:45:10.500192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503488+0000","last_change":"2023-10-14T18:45:10.502149+0000","last_active":"2023-10-14T18:45:10.503488+0000","last_peered":"2023-10-14T18:45:10.503488+0000","last_clean":"2023-10-14T18:45:10.503488+0000","last_became_active":"2023-10-14T18:45:10.501936+0000","last_became_peered":"2023-10-14T18:45:10.501936+0000","last_unstale":"2023-10-14T18:45:10.503488+0000","last_undegraded":"2023-10-14T18:45:10.503488+0000","last_fullsized":"2023-10-14T18:45:10.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:42.510534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499404+0000","last_change":"2023-10-14T18:45:10.499352+0000","last_active":"2023-10-14T18:45:10.499404+0000","last_peered":"2023-10-14T18:45:10.499404+0000","last_clean":"2023-10-14T18:45:10.499404+0000","last_became_active":"2023-10-14T18:45:10.499125+0000","last_became_peered":"2023-10-14T18:45:10.499125+0000","last_unstale":"2023-10-14T18:45:10.499404+0000","last_undegraded":"2023-10-14T18:45:10.499404+0000","last_fullsized":"2023-10-14T18:45:10.499404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497717+0000","last_change":"2023-10-14T18:45:09.499972+0000","last_active":"2023-10-14T18:45:10.497717+0000","last_peered":"2023-10-14T18:45:10.497717+0000","last_clean":"2023-10-14T18:45:10.497717+0000","last_became_active":"2023-10-14T18:45:09.499750+0000","last_became_peered":"2023-10-14T18:45:09.499750+0000","last_unstale":"2023-10-14T18:45:10.497717+0000","last_undegraded":"2023-10-14T18:45:10.497717+0000","last_fullsized":"2023-10-14T18:45:10.497717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502621+0000","last_change":"2023-10-14T18:45:10.502562+0000","last_active":"2023-10-14T18:45:10.502621+0000","last_peered":"2023-10-14T18:45:10.502621+0000","last_clean":"2023-10-14T18:45:10.502621+0000","last_became_active":"2023-10-14T18:45:10.502354+0000","last_became_peered":"2023-10-14T18:45:10.502354+0000","last_unstale":"2023-10-14T18:45:10.502621+0000","last_undegraded":"2023-10-14T18:45:10.502621+0000","last_fullsized":"2023-10-14T18:45:10.502621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500588+0000","last_change":"2023-10-14T18:45:09.502815+0000","last_active":"2023-10-14T18:45:10.500588+0000","last_peered":"2023-10-14T18:45:10.500588+0000","last_clean":"2023-10-14T18:45:10.500588+0000","last_became_active":"2023-10-14T18:45:09.502586+0000","last_became_peered":"2023-10-14T18:45:09.502586+0000","last_unstale":"2023-10-14T18:45:10.500588+0000","last_undegraded":"2023-10-14T18:45:10.500588+0000","last_fullsized":"2023-10-14T18:45:10.500588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494733+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:10.494733+0000","last_peered":"2023-10-14T18:45:10.494733+0000","last_clean":"2023-10-14T18:45:10.494733+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:10.494733+0000","last_undegraded":"2023-10-14T18:45:10.494733+0000","last_fullsized":"2023-10-14T18:45:10.494733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506423+0000","last_change":"2023-10-14T18:45:10.506374+0000","last_active":"2023-10-14T18:45:10.506423+0000","last_peered":"2023-10-14T18:45:10.506423+0000","last_clean":"2023-10-14T18:45:10.506423+0000","last_became_active":"2023-10-14T18:45:10.506224+0000","last_became_peered":"2023-10-14T18:45:10.506224+0000","last_unstale":"2023-10-14T18:45:10.506423+0000","last_undegraded":"2023-10-14T18:45:10.506423+0000","last_fullsized":"2023-10-14T18:45:10.506423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493318+0000","last_change":"2023-10-14T18:45:09.504373+0000","last_active":"2023-10-14T18:45:10.493318+0000","last_peered":"2023-10-14T18:45:10.493318+0000","last_clean":"2023-10-14T18:45:10.493318+0000","last_became_active":"2023-10-14T18:45:09.504143+0000","last_became_peered":"2023-10-14T18:45:09.504143+0000","last_unstale":"2023-10-14T18:45:10.493318+0000","last_undegraded":"2023-10-14T18:45:10.493318+0000","last_fullsized":"2023-10-14T18:45:10.493318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493501+0000","last_change":"2023-10-14T18:45:09.506472+0000","last_active":"2023-10-14T18:45:10.493501+0000","last_peered":"2023-10-14T18:45:10.493501+0000","last_clean":"2023-10-14T18:45:10.493501+0000","last_became_active":"2023-10-14T18:45:09.506235+0000","last_became_peered":"2023-10-14T18:45:09.506235+0000","last_unstale":"2023-10-14T18:45:10.493501+0000","last_undegraded":"2023-10-14T18:45:10.493501+0000","last_fullsized":"2023-10-14T18:45:10.493501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499447+0000","last_change":"2023-10-14T18:45:10.499346+0000","last_active":"2023-10-14T18:45:10.499447+0000","last_peered":"2023-10-14T18:45:10.499447+0000","last_clean":"2023-10-14T18:45:10.499447+0000","last_became_active":"2023-10-14T18:45:10.499148+0000","last_became_peered":"2023-10-14T18:45:10.499148+0000","last_unstale":"2023-10-14T18:45:10.499447+0000","last_undegraded":"2023-10-14T18:45:10.499447+0000","last_fullsized":"2023-10-14T18:45:10.499447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T18:45:11.541163+0000","last_change":"2023-10-14T18:45:09.501194+0000","last_active":"2023-10-14T18:45:11.541163+0000","last_peered":"2023-10-14T18:45:11.541163+0000","last_clean":"2023-10-14T18:45:11.541163+0000","last_became_active":"2023-10-14T18:45:09.500823+0000","last_became_peered":"2023-10-14T18:45:09.500823+0000","last_unstale":"2023-10-14T18:45:11.541163+0000","last_undegraded":"2023-10-14T18:45:11.541163+0000","last_fullsized":"2023-10-14T18:45:11.541163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501838+0000","last_change":"2023-10-14T18:45:10.499131+0000","last_active":"2023-10-14T18:45:10.501838+0000","last_peered":"2023-10-14T18:45:10.501838+0000","last_clean":"2023-10-14T18:45:10.501838+0000","last_became_active":"2023-10-14T18:45:10.498855+0000","last_became_peered":"2023-10-14T18:45:10.498855+0000","last_unstale":"2023-10-14T18:45:10.501838+0000","last_undegraded":"2023-10-14T18:45:10.501838+0000","last_fullsized":"2023-10-14T18:45:10.501838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515364+0000","last_change":"2023-10-14T18:45:09.503127+0000","last_active":"2023-10-14T18:45:10.515364+0000","last_peered":"2023-10-14T18:45:10.515364+0000","last_clean":"2023-10-14T18:45:10.515364+0000","last_became_active":"2023-10-14T18:45:09.499701+0000","last_became_peered":"2023-10-14T18:45:09.499701+0000","last_unstale":"2023-10-14T18:45:10.515364+0000","last_undegraded":"2023-10-14T18:45:10.515364+0000","last_fullsized":"2023-10-14T18:45:10.515364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501481+0000","last_change":"2023-10-14T18:45:10.501420+0000","last_active":"2023-10-14T18:45:10.501481+0000","last_peered":"2023-10-14T18:45:10.501481+0000","last_clean":"2023-10-14T18:45:10.501481+0000","last_became_active":"2023-10-14T18:45:10.500635+0000","last_became_peered":"2023-10-14T18:45:10.500635+0000","last_unstale":"2023-10-14T18:45:10.501481+0000","last_undegraded":"2023-10-14T18:45:10.501481+0000","last_fullsized":"2023-10-14T18:45:10.501481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494616+0000","last_change":"2023-10-14T18:45:09.506431+0000","last_active":"2023-10-14T18:45:10.494616+0000","last_peered":"2023-10-14T18:45:10.494616+0000","last_clean":"2023-10-14T18:45:10.494616+0000","last_became_active":"2023-10-14T18:45:09.506187+0000","last_became_peered":"2023-10-14T18:45:09.506187+0000","last_unstale":"2023-10-14T18:45:10.494616+0000","last_undegraded":"2023-10-14T18:45:10.494616+0000","last_fullsized":"2023-10-14T18:45:10.494616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:17.117466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512381+0000","last_change":"2023-10-14T18:45:10.510948+0000","last_active":"2023-10-14T18:45:10.512381+0000","last_peered":"2023-10-14T18:45:10.512381+0000","last_clean":"2023-10-14T18:45:10.512381+0000","last_became_active":"2023-10-14T18:45:10.510290+0000","last_became_peered":"2023-10-14T18:45:10.510290+0000","last_unstale":"2023-10-14T18:45:10.512381+0000","last_undegraded":"2023-10-14T18:45:10.512381+0000","last_fullsized":"2023-10-14T18:45:10.512381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:36.074105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497573+0000","last_change":"2023-10-14T18:45:09.502242+0000","last_active":"2023-10-14T18:45:10.497573+0000","last_peered":"2023-10-14T18:45:10.497573+0000","last_clean":"2023-10-14T18:45:10.497573+0000","last_became_active":"2023-10-14T18:45:09.501997+0000","last_became_peered":"2023-10-14T18:45:09.501997+0000","last_unstale":"2023-10-14T18:45:10.497573+0000","last_undegraded":"2023-10-14T18:45:10.497573+0000","last_fullsized":"2023-10-14T18:45:10.497573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501857+0000","last_change":"2023-10-14T18:45:10.499268+0000","last_active":"2023-10-14T18:45:10.501857+0000","last_peered":"2023-10-14T18:45:10.501857+0000","last_clean":"2023-10-14T18:45:10.501857+0000","last_became_active":"2023-10-14T18:45:10.498937+0000","last_became_peered":"2023-10-14T18:45:10.498937+0000","last_unstale":"2023-10-14T18:45:10.501857+0000","last_undegraded":"2023-10-14T18:45:10.501857+0000","last_fullsized":"2023-10-14T18:45:10.501857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497497+0000","last_change":"2023-10-14T18:45:09.493047+0000","last_active":"2023-10-14T18:45:10.497497+0000","last_peered":"2023-10-14T18:45:10.497497+0000","last_clean":"2023-10-14T18:45:10.497497+0000","last_became_active":"2023-10-14T18:45:09.492815+0000","last_became_peered":"2023-10-14T18:45:09.492815+0000","last_unstale":"2023-10-14T18:45:10.497497+0000","last_undegraded":"2023-10-14T18:45:10.497497+0000","last_fullsized":"2023-10-14T18:45:10.497497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496137+0000","last_change":"2023-10-14T18:45:10.496060+0000","last_active":"2023-10-14T18:45:10.496137+0000","last_peered":"2023-10-14T18:45:10.496137+0000","last_clean":"2023-10-14T18:45:10.496137+0000","last_became_active":"2023-10-14T18:45:10.495823+0000","last_became_peered":"2023-10-14T18:45:10.495823+0000","last_unstale":"2023-10-14T18:45:10.496137+0000","last_undegraded":"2023-10-14T18:45:10.496137+0000","last_fullsized":"2023-10-14T18:45:10.496137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514544+0000","last_change":"2023-10-14T18:45:09.504130+0000","last_active":"2023-10-14T18:45:10.514544+0000","last_peered":"2023-10-14T18:45:10.514544+0000","last_clean":"2023-10-14T18:45:10.514544+0000","last_became_active":"2023-10-14T18:45:09.503874+0000","last_became_peered":"2023-10-14T18:45:09.503874+0000","last_unstale":"2023-10-14T18:45:10.514544+0000","last_undegraded":"2023-10-14T18:45:10.514544+0000","last_fullsized":"2023-10-14T18:45:10.514544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509075+0000","last_change":"2023-10-14T18:45:10.509017+0000","last_active":"2023-10-14T18:45:10.509075+0000","last_peered":"2023-10-14T18:45:10.509075+0000","last_clean":"2023-10-14T18:45:10.509075+0000","last_became_active":"2023-10-14T18:45:10.508852+0000","last_became_peered":"2023-10-14T18:45:10.508852+0000","last_unstale":"2023-10-14T18:45:10.509075+0000","last_undegraded":"2023-10-14T18:45:10.509075+0000","last_fullsized":"2023-10-14T18:45:10.509075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495578+0000","last_change":"2023-10-14T18:45:09.501600+0000","last_active":"2023-10-14T18:45:10.495578+0000","last_peered":"2023-10-14T18:45:10.495578+0000","last_clean":"2023-10-14T18:45:10.495578+0000","last_became_active":"2023-10-14T18:45:09.501418+0000","last_became_peered":"2023-10-14T18:45:09.501418+0000","last_unstale":"2023-10-14T18:45:10.495578+0000","last_undegraded":"2023-10-14T18:45:10.495578+0000","last_fullsized":"2023-10-14T18:45:10.495578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502764+0000","last_change":"2023-10-14T18:45:10.502085+0000","last_active":"2023-10-14T18:45:10.502764+0000","last_peered":"2023-10-14T18:45:10.502764+0000","last_clean":"2023-10-14T18:45:10.502764+0000","last_became_active":"2023-10-14T18:45:10.501863+0000","last_became_peered":"2023-10-14T18:45:10.501863+0000","last_unstale":"2023-10-14T18:45:10.502764+0000","last_undegraded":"2023-10-14T18:45:10.502764+0000","last_fullsized":"2023-10-14T18:45:10.502764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514342+0000","last_change":"2023-10-14T18:45:09.497704+0000","last_active":"2023-10-14T18:45:10.514342+0000","last_peered":"2023-10-14T18:45:10.514342+0000","last_clean":"2023-10-14T18:45:10.514342+0000","last_became_active":"2023-10-14T18:45:09.497481+0000","last_became_peered":"2023-10-14T18:45:09.497481+0000","last_unstale":"2023-10-14T18:45:10.514342+0000","last_undegraded":"2023-10-14T18:45:10.514342+0000","last_fullsized":"2023-10-14T18:45:10.514342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511729+0000","last_change":"2023-10-14T18:45:10.511661+0000","last_active":"2023-10-14T18:45:10.511729+0000","last_peered":"2023-10-14T18:45:10.511729+0000","last_clean":"2023-10-14T18:45:10.511729+0000","last_became_active":"2023-10-14T18:45:10.507807+0000","last_became_peered":"2023-10-14T18:45:10.507807+0000","last_unstale":"2023-10-14T18:45:10.511729+0000","last_undegraded":"2023-10-14T18:45:10.511729+0000","last_fullsized":"2023-10-14T18:45:10.511729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515251+0000","last_change":"2023-10-14T18:45:09.496750+0000","last_active":"2023-10-14T18:45:10.515251+0000","last_peered":"2023-10-14T18:45:10.515251+0000","last_clean":"2023-10-14T18:45:10.515251+0000","last_became_active":"2023-10-14T18:45:09.496512+0000","last_became_peered":"2023-10-14T18:45:09.496512+0000","last_unstale":"2023-10-14T18:45:10.515251+0000","last_undegraded":"2023-10-14T18:45:10.515251+0000","last_fullsized":"2023-10-14T18:45:10.515251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508444+0000","last_change":"2023-10-14T18:45:10.508346+0000","last_active":"2023-10-14T18:45:10.508444+0000","last_peered":"2023-10-14T18:45:10.508444+0000","last_clean":"2023-10-14T18:45:10.508444+0000","last_became_active":"2023-10-14T18:45:10.507586+0000","last_became_peered":"2023-10-14T18:45:10.507586+0000","last_unstale":"2023-10-14T18:45:10.508444+0000","last_undegraded":"2023-10-14T18:45:10.508444+0000","last_fullsized":"2023-10-14T18:45:10.508444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499036+0000","last_change":"2023-10-14T18:45:10.498971+0000","last_active":"2023-10-14T18:45:10.499036+0000","last_peered":"2023-10-14T18:45:10.499036+0000","last_clean":"2023-10-14T18:45:10.499036+0000","last_became_active":"2023-10-14T18:45:10.498667+0000","last_became_peered":"2023-10-14T18:45:10.498667+0000","last_unstale":"2023-10-14T18:45:10.499036+0000","last_undegraded":"2023-10-14T18:45:10.499036+0000","last_fullsized":"2023-10-14T18:45:10.499036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507241+0000","last_change":"2023-10-14T18:45:10.507172+0000","last_active":"2023-10-14T18:45:10.507241+0000","last_peered":"2023-10-14T18:45:10.507241+0000","last_clean":"2023-10-14T18:45:10.507241+0000","last_became_active":"2023-10-14T18:45:10.506991+0000","last_became_peered":"2023-10-14T18:45:10.506991+0000","last_unstale":"2023-10-14T18:45:10.507241+0000","last_undegraded":"2023-10-14T18:45:10.507241+0000","last_fullsized":"2023-10-14T18:45:10.507241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.504549+0000","last_change":"2023-10-14T18:45:10.504274+0000","last_active":"2023-10-14T18:45:10.504549+0000","last_peered":"2023-10-14T18:45:10.504549+0000","last_clean":"2023-10-14T18:45:10.504549+0000","last_became_active":"2023-10-14T18:45:10.504016+0000","last_became_peered":"2023-10-14T18:45:10.504016+0000","last_unstale":"2023-10-14T18:45:10.504549+0000","last_undegraded":"2023-10-14T18:45:10.504549+0000","last_fullsized":"2023-10-14T18:45:10.504549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494756+0000","last_change":"2023-10-14T18:45:10.494605+0000","last_active":"2023-10-14T18:45:10.494756+0000","last_peered":"2023-10-14T18:45:10.494756+0000","last_clean":"2023-10-14T18:45:10.494756+0000","last_became_active":"2023-10-14T18:45:10.494395+0000","last_became_peered":"2023-10-14T18:45:10.494395+0000","last_unstale":"2023-10-14T18:45:10.494756+0000","last_undegraded":"2023-10-14T18:45:10.494756+0000","last_fullsized":"2023-10-14T18:45:10.494756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.133322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505981+0000","last_change":"2023-10-14T18:45:10.505899+0000","last_active":"2023-10-14T18:45:10.505981+0000","last_peered":"2023-10-14T18:45:10.505981+0000","last_clean":"2023-10-14T18:45:10.505981+0000","last_became_active":"2023-10-14T18:45:10.505342+0000","last_became_peered":"2023-10-14T18:45:10.505342+0000","last_unstale":"2023-10-14T18:45:10.505981+0000","last_undegraded":"2023-10-14T18:45:10.505981+0000","last_fullsized":"2023-10-14T18:45:10.505981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499958+0000","last_change":"2023-10-14T18:45:10.499873+0000","last_active":"2023-10-14T18:45:10.499958+0000","last_peered":"2023-10-14T18:45:10.499958+0000","last_clean":"2023-10-14T18:45:10.499958+0000","last_became_active":"2023-10-14T18:45:10.499655+0000","last_became_peered":"2023-10-14T18:45:10.499655+0000","last_unstale":"2023-10-14T18:45:10.499958+0000","last_undegraded":"2023-10-14T18:45:10.499958+0000","last_fullsized":"2023-10-14T18:45:10.499958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505832+0000","last_change":"2023-10-14T18:45:10.505751+0000","last_active":"2023-10-14T18:45:10.505832+0000","last_peered":"2023-10-14T18:45:10.505832+0000","last_clean":"2023-10-14T18:45:10.505832+0000","last_became_active":"2023-10-14T18:45:10.505332+0000","last_became_peered":"2023-10-14T18:45:10.505332+0000","last_unstale":"2023-10-14T18:45:10.505832+0000","last_undegraded":"2023-10-14T18:45:10.505832+0000","last_fullsized":"2023-10-14T18:45:10.505832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509361+0000","last_change":"2023-10-14T18:45:10.509310+0000","last_active":"2023-10-14T18:45:10.509361+0000","last_peered":"2023-10-14T18:45:10.509361+0000","last_clean":"2023-10-14T18:45:10.509361+0000","last_became_active":"2023-10-14T18:45:10.509153+0000","last_became_peered":"2023-10-14T18:45:10.509153+0000","last_unstale":"2023-10-14T18:45:10.509361+0000","last_undegraded":"2023-10-14T18:45:10.509361+0000","last_fullsized":"2023-10-14T18:45:10.509361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510739+0000","last_change":"2023-10-14T18:45:10.507728+0000","last_active":"2023-10-14T18:45:10.510739+0000","last_peered":"2023-10-14T18:45:10.510739+0000","last_clean":"2023-10-14T18:45:10.510739+0000","last_became_active":"2023-10-14T18:45:10.505783+0000","last_became_peered":"2023-10-14T18:45:10.505783+0000","last_unstale":"2023-10-14T18:45:10.510739+0000","last_undegraded":"2023-10-14T18:45:10.510739+0000","last_fullsized":"2023-10-14T18:45:10.510739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506116+0000","last_change":"2023-10-14T18:45:10.506057+0000","last_active":"2023-10-14T18:45:10.506116+0000","last_peered":"2023-10-14T18:45:10.506116+0000","last_clean":"2023-10-14T18:45:10.506116+0000","last_became_active":"2023-10-14T18:45:10.505663+0000","last_became_peered":"2023-10-14T18:45:10.505663+0000","last_unstale":"2023-10-14T18:45:10.506116+0000","last_undegraded":"2023-10-14T18:45:10.506116+0000","last_fullsized":"2023-10-14T18:45:10.506116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512020+0000","last_change":"2023-10-14T18:45:10.511962+0000","last_active":"2023-10-14T18:45:10.512020+0000","last_peered":"2023-10-14T18:45:10.512020+0000","last_clean":"2023-10-14T18:45:10.512020+0000","last_became_active":"2023-10-14T18:45:10.508326+0000","last_became_peered":"2023-10-14T18:45:10.508326+0000","last_unstale":"2023-10-14T18:45:10.512020+0000","last_undegraded":"2023-10-14T18:45:10.512020+0000","last_fullsized":"2023-10-14T18:45:10.512020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496888+0000","last_change":"2023-10-14T18:45:10.496788+0000","last_active":"2023-10-14T18:45:10.496888+0000","last_peered":"2023-10-14T18:45:10.496888+0000","last_clean":"2023-10-14T18:45:10.496888+0000","last_became_active":"2023-10-14T18:45:10.496408+0000","last_became_peered":"2023-10-14T18:45:10.496408+0000","last_unstale":"2023-10-14T18:45:10.496888+0000","last_undegraded":"2023-10-14T18:45:10.496888+0000","last_fullsized":"2023-10-14T18:45:10.496888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511125+0000","last_change":"2023-10-14T18:45:10.511064+0000","last_active":"2023-10-14T18:45:10.511125+0000","last_peered":"2023-10-14T18:45:10.511125+0000","last_clean":"2023-10-14T18:45:10.511125+0000","last_became_active":"2023-10-14T18:45:10.510838+0000","last_became_peered":"2023-10-14T18:45:10.510838+0000","last_unstale":"2023-10-14T18:45:10.511125+0000","last_undegraded":"2023-10-14T18:45:10.511125+0000","last_fullsized":"2023-10-14T18:45:10.511125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:52:17.664748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:19.432 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:45:19.433 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T18:45:19.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T18:45:19.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T18:45:19.436 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T18:45:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.581+0000 7fe19de4a700 1 Processor -- start 2023-10-14T18:45:19.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.581+0000 7fe19de4a700 1 -- start start 2023-10-14T18:45:19.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe19de4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe198157870 0x7fe19815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe19de4a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe19815a620 0x7fe19815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe19de4a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19815cbb0 con 0x7fe19815d580 2023-10-14T18:45:19.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe19de4a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19815bfa0 con 0x7fe198157870 2023-10-14T18:45:19.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe19de4a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19815c280 con 0x7fe19815a620 2023-10-14T18:45:19.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe198157870 0x7fe19815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe198157870 0x7fe19815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59300/0 (socket says 172.21.15.79:59300) 2023-10-14T18:45:19.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 -- 172.21.15.79:0/543849275 learned_addr learned my addr 172.21.15.79:0/543849275 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:19.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe18effd700 1 --2- 172.21.15.79:0/543849275 >> v2:172.21.15.144:3300/0 conn(0x7fe19815a620 0x7fe19815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 -- 172.21.15.79:0/543849275 >> v2:172.21.15.144:3300/0 conn(0x7fe19815a620 msgr2=0x7fe19815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 --2- 172.21.15.79:0/543849275 >> v2:172.21.15.144:3300/0 conn(0x7fe19815a620 0x7fe19815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 -- 172.21.15.79:0/543849275 >> v1:172.21.15.144:6789/0 conn(0x7fe19815d580 legacy=0x7fe198158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 -- 172.21.15.79:0/543849275 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19815c560 con 0x7fe198157870 2023-10-14T18:45:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.582+0000 7fe1977fe700 1 --2- 172.21.15.79:0/543849275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe19815b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe19815cb20 tx=0x7fe188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bae99fe9947c7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe196ffd700 1 -- 172.21.15.79:0/543849275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188009e70 con 0x7fe198157870 2023-10-14T18:45:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe196ffd700 1 -- 172.21.15.79:0/543849275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800b860 con 0x7fe198157870 2023-10-14T18:45:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe196ffd700 1 -- 172.21.15.79:0/543849275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800bc00 con 0x7fe198157870 2023-10-14T18:45:19.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 -- 172.21.15.79:0/543849275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 msgr2=0x7fe19815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 --2- 172.21.15.79:0/543849275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe19815b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe19815cb20 tx=0x7fe188009250 comp rx=0 tx=0).stop 2023-10-14T18:45:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 -- 172.21.15.79:0/543849275 shutdown_connections 2023-10-14T18:45:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 --2- 172.21.15.79:0/543849275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe19815b6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 --2- 172.21.15.79:0/543849275 >> v2:172.21.15.144:3300/0 conn(0x7fe19815a620 0x7fe19815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 -- 172.21.15.79:0/543849275 >> 172.21.15.79:0/543849275 conn(0x7fe198068ce0 msgr2=0x7fe1980690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 -- 172.21.15.79:0/543849275 shutdown_connections 2023-10-14T18:45:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.583+0000 7fe19de4a700 1 -- 172.21.15.79:0/543849275 wait complete. 2023-10-14T18:45:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.584+0000 7fe19de4a700 1 Processor -- start 2023-10-14T18:45:19.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.584+0000 7fe19de4a700 1 -- start start 2023-10-14T18:45:19.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe19815a620 0x7fe19815ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe19815d580 0x7fe198149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19816eb30 con 0x7fe198157870 2023-10-14T18:45:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19815f470 con 0x7fe19815a620 2023-10-14T18:45:19.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe19de4a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19816dd70 con 0x7fe19815d580 2023-10-14T18:45:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59306/0 (socket says 172.21.15.79:59306) 2023-10-14T18:45:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 -- 172.21.15.79:0/2422959204 learned_addr learned my addr 172.21.15.79:0/2422959204 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:19.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 -- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe19815d580 msgr2=0x7fe198149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe19815d580 0x7fe198149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 -- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe19815a620 msgr2=0x7fe19815ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe19815a620 0x7fe19815ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.585+0000 7fe1977fe700 1 -- 172.21.15.79:0/2422959204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880094f0 con 0x7fe198157870 2023-10-14T18:45:19.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe1977fe700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe19806b530 tx=0x7fe188017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011420 con 0x7fe198157870 2023-10-14T18:45:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188011580 con 0x7fe198157870 2023-10-14T18:45:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19816e050 con 0x7fe198157870 2023-10-14T18:45:19.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011940 con 0x7fe198157870 2023-10-14T18:45:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.586+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19816e610 con 0x7fe198157870 2023-10-14T18:45:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.587+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19816e830 con 0x7fe198157870 2023-10-14T18:45:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.587+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe18802c3b0 con 0x7fe198157870 2023-10-14T18:45:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.587+0000 7fe18ffff700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 0x7fe17c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.588+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe188085c80 con 0x7fe198157870 2023-10-14T18:45:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.588+0000 7fe18effd700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 0x7fe17c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.588+0000 7fe18effd700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 0x7fe17c069460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe198150730 tx=0x7fe1800091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.592+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe18808c080 con 0x7fe198157870 2023-10-14T18:45:19.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.825+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe19804c3c0 con 0x7fe198157870 2023-10-14T18:45:19.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.828+0000 7fe18ffff700 1 -- 172.21.15.79:0/2422959204 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+163705 (secure 0 0 0) 0x7fe188015090 con 0x7fe198157870 2023-10-14T18:45:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:19.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.830+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 msgr2=0x7fe17c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 0x7fe17c069460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe198150730 tx=0x7fe1800091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 msgr2=0x7fe198149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe19806b530 tx=0x7fe188017000 comp rx=0 tx=0).stop 2023-10-14T18:45:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 shutdown_connections 2023-10-14T18:45:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe17c066fb0 0x7fe17c069460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe19815d580 0x7fe198149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe198157870 0x7fe198149970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 --2- 172.21.15.79:0/2422959204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe19815a620 0x7fe19815ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 >> 172.21.15.79:0/2422959204 conn(0x7fe198068ce0 msgr2=0x7fe198158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 shutdown_connections 2023-10-14T18:45:19.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.831+0000 7fe19de4a700 1 -- 172.21.15.79:0/2422959204 wait complete. 2023-10-14T18:45:19.843 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":85980},{"type":"v1","addr":"172.21.15.144:6833","nonce":85980}]},"active_addr":"172.21.15.144:6833/85980","active_change":"2023-10-14T18:44:58.324823+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1346916125}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1240911837}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4176477782}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":508002876}]}]} 2023-10-14T18:45:19.847 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T18:45:19.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T18:45:19.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.960+0000 7f111ad80700 1 Processor -- start 2023-10-14T18:45:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.960+0000 7f111ad80700 1 -- start start 2023-10-14T18:45:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f111ad80700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f111415e770 0x7f1114164cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f111ad80700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140cc660 con 0x7f111415e2d0 2023-10-14T18:45:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f111ad80700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140ccf00 con 0x7f1114159e30 2023-10-14T18:45:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f111ad80700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1114068ec0 con 0x7f111415e770 2023-10-14T18:45:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f1113fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f111415e2d0 0x7f1114067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45490/0 (socket says 172.21.15.79:45490) 2023-10-14T18:45:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f1113fff700 1 -- 172.21.15.79:0/3895871727 learned_addr learned my addr 172.21.15.79:0/3895871727 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f111931d700 1 --2- 172.21.15.79:0/3895871727 >> v2:172.21.15.144:3300/0 conn(0x7f111415e770 0x7f1114164cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.961+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696181225 0 0) 0x7f11140cc660 con 0x7f111415e2d0 2023-10-14T18:45:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1104003570 con 0x7f111415e2d0 2023-10-14T18:45:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799250343 0 0) 0x7f1104003570 con 0x7f111415e2d0 2023-10-14T18:45:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 >> v2:172.21.15.144:3300/0 conn(0x7f111415e770 msgr2=0x7f1114164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 --2- 172.21.15.79:0/3895871727 >> v2:172.21.15.144:3300/0 conn(0x7f111415e770 0x7f1114164cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 >> v1:172.21.15.144:6789/0 conn(0x7f1114159e30 legacy=0x7f111415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140cc8b0 con 0x7f111415e2d0 2023-10-14T18:45:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1100001470 con 0x7f111415e2d0 2023-10-14T18:45:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 >> v1:172.21.15.79:6789/0 conn(0x7f111415e2d0 legacy=0x7f1114067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104003a60 0x7f1104003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 0x7f1104004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040051c0 0x7f110400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114068ec0 con 0x7f1104004810 2023-10-14T18:45:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110400c0d0 con 0x7f11040051c0 2023-10-14T18:45:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110400c290 con 0x7f1104003a60 2023-10-14T18:45:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 0x7f1104004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f111931d700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040051c0 0x7f110400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1118b1c700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104003a60 0x7f1104003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 -- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104003a60 msgr2=0x7f1104003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104003a60 0x7f1104003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 -- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040051c0 msgr2=0x7f110400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040051c0 0x7f110400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 -- 172.21.15.79:0/3895871727 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104003570 con 0x7f1104004810 2023-10-14T18:45:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f111931d700 1 -- 172.21.15.79:0/3895871727 reap_dead start 2023-10-14T18:45:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f1113fff700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 0x7f1104004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f110000c3c0 tx=0x7f1100001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2818b56d3bfbe4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000cc10 con 0x7f1104004810 2023-10-14T18:45:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000cd70 con 0x7f1104004810 2023-10-14T18:45:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.962+0000 7f11137fe700 1 -- 172.21.15.79:0/3895871727 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100005b50 con 0x7f1104004810 2023-10-14T18:45:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 -- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 msgr2=0x7f1104004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 0x7f1104004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f110000c3c0 tx=0x7f1100001e50 comp rx=0 tx=0).stop 2023-10-14T18:45:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 -- 172.21.15.79:0/3895871727 shutdown_connections 2023-10-14T18:45:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 --2- 172.21.15.79:0/3895871727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1104004810 0x7f1104004c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 -- 172.21.15.79:0/3895871727 >> 172.21.15.79:0/3895871727 conn(0x7f111406a310 msgr2=0x7f11140cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 -- 172.21.15.79:0/3895871727 shutdown_connections 2023-10-14T18:45:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.963+0000 7f111ad80700 1 -- 172.21.15.79:0/3895871727 wait complete. 2023-10-14T18:45:19.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.964+0000 7f111ad80700 1 Processor -- start 2023-10-14T18:45:19.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.964+0000 7f111ad80700 1 -- start start 2023-10-14T18:45:19.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104004810 0x7f11140b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 0x7f111414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111416a960 con 0x7f111416df60 2023-10-14T18:45:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111414f440 con 0x7f111416e3d0 2023-10-14T18:45:19.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111ad80700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111416ab50 con 0x7f1104004810 2023-10-14T18:45:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59322/0 (socket says 172.21.15.79:59322) 2023-10-14T18:45:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 -- 172.21.15.79:0/2670480892 learned_addr learned my addr 172.21.15.79:0/2670480892 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111931d700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 0x7f111414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1118b1c700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104004810 0x7f11140b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 -- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104004810 msgr2=0x7f11140b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104004810 0x7f11140b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 -- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 msgr2=0x7f111414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 0x7f111414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:19.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f1113fff700 1 -- 172.21.15.79:0/2670480892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111416e920 con 0x7f111416df60 2023-10-14T18:45:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.965+0000 7f111931d700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 0x7f111414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f1113fff700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f110400c0a0 tx=0x7f1100015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100022070 con 0x7f111416df60 2023-10-14T18:45:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100004e40 con 0x7f111416df60 2023-10-14T18:45:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000cc10 con 0x7f111416df60 2023-10-14T18:45:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111416ec00 con 0x7f111416df60 2023-10-14T18:45:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.966+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141526f0 con 0x7f111416df60 2023-10-14T18:45:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.967+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111404c3c0 con 0x7f111416df60 2023-10-14T18:45:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.967+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f110001e430 con 0x7f111416df60 2023-10-14T18:45:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.967+0000 7f1110ff9700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 0x7f10f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.967+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1100085780 con 0x7f111416df60 2023-10-14T18:45:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.968+0000 7f1118b1c700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 0x7f10f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.968+0000 7f1118b1c700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 0x7f10f80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:19.971+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11000529f0 con 0x7f111416df60 2023-10-14T18:45:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.156+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11140b4910 con 0x7f111416df60 2023-10-14T18:45:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.156+0000 7f1110ff9700 1 -- 172.21.15.79:0/2670480892 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f1100056010 con 0x7f111416df60 2023-10-14T18:45:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:20.158 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 msgr2=0x7f10f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 0x7f10f80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1108000c00 tx=0x7f1108009040 comp rx=0 tx=0).stop 2023-10-14T18:45:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 msgr2=0x7f111414e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f110400c0a0 tx=0x7f1100015000 comp rx=0 tx=0).stop 2023-10-14T18:45:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 shutdown_connections 2023-10-14T18:45:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f10f8066f30 0x7f10f80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f111416e3d0 0x7f111414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1104004810 0x7f11140b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 --2- 172.21.15.79:0/2670480892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f111416df60 0x7f111414e9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 >> 172.21.15.79:0/2670480892 conn(0x7f111406a310 msgr2=0x7f11140c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.158+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 shutdown_connections 2023-10-14T18:45:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.159+0000 7f111ad80700 1 -- 172.21.15.79:0/2670480892 wait complete. 2023-10-14T18:45:20.171 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T18:45:20.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.284+0000 7f55f2c32700 1 Processor -- start 2023-10-14T18:45:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.284+0000 7f55f2c32700 1 -- start start 2023-10-14T18:45:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55ec157870 0x7f55ec15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55ec15a620 0x7f55ec15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec15d580 0x7f55ec158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec15cbb0 con 0x7f55ec15a620 2023-10-14T18:45:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec15bfa0 con 0x7f55ec157870 2023-10-14T18:45:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f2c32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec15c280 con 0x7f55ec15d580 2023-10-14T18:45:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55e3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55ec15a620 0x7f55ec15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55e3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55ec15a620 0x7f55ec15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59334/0 (socket says 172.21.15.79:59334) 2023-10-14T18:45:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55e3fff700 1 -- 172.21.15.79:0/1825609554 learned_addr learned my addr 172.21.15.79:0/1825609554 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f09ce700 1 --2- 172.21.15.79:0/1825609554 >> v2:172.21.15.144:3300/0 conn(0x7f55ec157870 0x7f55ec15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.285+0000 7f55f11cf700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec15d580 0x7f55ec158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 -- 172.21.15.79:0/1825609554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec15d580 msgr2=0x7f55ec158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec15d580 0x7f55ec158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 -- 172.21.15.79:0/1825609554 >> v2:172.21.15.144:3300/0 conn(0x7f55ec157870 msgr2=0x7f55ec15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 --2- 172.21.15.79:0/1825609554 >> v2:172.21.15.144:3300/0 conn(0x7f55ec157870 0x7f55ec15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 -- 172.21.15.79:0/1825609554 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec15c560 con 0x7f55ec15a620 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e3fff700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec15d040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55ec069d80 tx=0x7f55dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67065e040a3e85 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e37fe700 1 -- 172.21.15.79:0/1825609554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00b640 con 0x7f55ec15a620 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e37fe700 1 -- 172.21.15.79:0/1825609554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00b7a0 con 0x7f55ec15a620 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55e37fe700 1 -- 172.21.15.79:0/1825609554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00bb60 con 0x7f55ec15a620 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 -- 172.21.15.79:0/1825609554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 msgr2=0x7f55ec15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec15d040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55ec069d80 tx=0x7f55dc009250 comp rx=0 tx=0).stop 2023-10-14T18:45:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 -- 172.21.15.79:0/1825609554 shutdown_connections 2023-10-14T18:45:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec15d580 0x7f55ec158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 --2- 172.21.15.79:0/1825609554 >> v2:172.21.15.144:3300/0 conn(0x7f55ec157870 0x7f55ec15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 --2- 172.21.15.79:0/1825609554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec15d040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 -- 172.21.15.79:0/1825609554 >> 172.21.15.79:0/1825609554 conn(0x7f55ec068ce0 msgr2=0x7f55ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 -- 172.21.15.79:0/1825609554 shutdown_connections 2023-10-14T18:45:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.286+0000 7f55f2c32700 1 -- 172.21.15.79:0/1825609554 wait complete. 2023-10-14T18:45:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.288+0000 7f55f2c32700 1 Processor -- start 2023-10-14T18:45:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.288+0000 7f55f2c32700 1 -- start start 2023-10-14T18:45:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.288+0000 7f55f2c32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec157870 0x7f55ec149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.288+0000 7f55f2c32700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.288+0000 7f55f2c32700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55ec15d580 0x7f55ec14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f2c32700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0b2290 con 0x7f55ec15a620 2023-10-14T18:45:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f2c32700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0b2570 con 0x7f55ec15d580 2023-10-14T18:45:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f2c32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec0b2850 con 0x7f55ec157870 2023-10-14T18:45:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59344/0 (socket says 172.21.15.79:59344) 2023-10-14T18:45:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 -- 172.21.15.79:0/2116742309 learned_addr learned my addr 172.21.15.79:0/2116742309 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f11cf700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55ec15d580 0x7f55ec14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f09ce700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec157870 0x7f55ec149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 -- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec157870 msgr2=0x7f55ec149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec157870 0x7f55ec149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 -- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55ec15d580 msgr2=0x7f55ec14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55ec15d580 0x7f55ec14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 -- 172.21.15.79:0/2116742309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0094f0 con 0x7f55ec15a620 2023-10-14T18:45:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e3fff700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f55ec06b530 tx=0x7f55dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00b910 con 0x7f55ec15a620 2023-10-14T18:45:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00ba70 con 0x7f55ec15a620 2023-10-14T18:45:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc011630 con 0x7f55ec15a620 2023-10-14T18:45:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec0b2b30 con 0x7f55ec15a620 2023-10-14T18:45:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.289+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0b1df0 con 0x7f55ec15a620 2023-10-14T18:45:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.290+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec0b2040 con 0x7f55ec15a620 2023-10-14T18:45:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.291+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55dc0119a0 con 0x7f55ec15a620 2023-10-14T18:45:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.291+0000 7f55e0ff9700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.291+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55dc085c70 con 0x7f55ec15a620 2023-10-14T18:45:20.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.291+0000 7f55f09ce700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.292+0000 7f55f09ce700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 0x7f55d80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f570 tx=0x7f55e800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.295+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55dc052ee0 con 0x7f55ec15a620 2023-10-14T18:45:20.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.479+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55ec04c3c0 con 0x7f55ec15a620 2023-10-14T18:45:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.479+0000 7f55e0ff9700 1 -- 172.21.15.79:0/2116742309 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f55dc015090 con 0x7f55ec15a620 2023-10-14T18:45:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:20.481 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 msgr2=0x7f55d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 0x7f55d80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55e800f570 tx=0x7f55e800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 msgr2=0x7f55ec0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f55ec06b530 tx=0x7f55dc017000 comp rx=0 tx=0).stop 2023-10-14T18:45:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 shutdown_connections 2023-10-14T18:45:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55d8066f30 0x7f55d80693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55ec15d580 0x7f55ec14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f55ec157870 0x7f55ec149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 --2- 172.21.15.79:0/2116742309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55ec15a620 0x7f55ec0b18b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.481+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 >> 172.21.15.79:0/2116742309 conn(0x7f55ec068ce0 msgr2=0x7f55ec15a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.482+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 shutdown_connections 2023-10-14T18:45:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.482+0000 7f55f2c32700 1 -- 172.21.15.79:0/2116742309 wait complete. 2023-10-14T18:45:20.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T18:45:20.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T18:45:20.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T18:45:20.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T18:45:20.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T18:45:20.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T18:45:20.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T18:45:20.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T18:45:20.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.682+0000 7f42a91e1700 1 Processor -- start 2023-10-14T18:45:20.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.682+0000 7f42a91e1700 1 -- start start 2023-10-14T18:45:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42a406d4c0 0x7f42a406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42a406f1a0 0x7f42a40ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40c7960 con 0x7f42a406d4c0 2023-10-14T18:45:20.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40c7c40 con 0x7f42a406f1a0 2023-10-14T18:45:20.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.683+0000 7f42a91e1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c7f20 con 0x7f42a40bf970 2023-10-14T18:45:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:54980/0 (socket says 172.21.15.79:54980) 2023-10-14T18:45:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 -- 172.21.15.79:0/4117568522 learned_addr learned my addr 172.21.15.79:0/4117568522 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a359e700 1 --2- 172.21.15.79:0/4117568522 >> v2:172.21.15.144:3300/0 conn(0x7f42a406f1a0 0x7f42a40ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 -- 172.21.15.79:0/4117568522 >> v2:172.21.15.144:3300/0 conn(0x7f42a406f1a0 msgr2=0x7f42a40ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/4117568522 >> v2:172.21.15.144:3300/0 conn(0x7f42a406f1a0 0x7f42a40ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 -- 172.21.15.79:0/4117568522 >> v2:172.21.15.79:3300/0 conn(0x7f42a406d4c0 msgr2=0x7f42a406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/4117568522 >> v2:172.21.15.79:3300/0 conn(0x7f42a406d4c0 0x7f42a406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.684+0000 7f42a2d9d700 1 -- 172.21.15.79:0/4117568522 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40c8200 con 0x7f42a40bf970 2023-10-14T18:45:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.686+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/4117568522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42a406ebb0 tx=0x7f4298009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196eb18efedbdc13 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.686+0000 7f42a1d9b700 1 -- 172.21.15.79:0/4117568522 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298009e70 con 0x7f42a40bf970 2023-10-14T18:45:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.686+0000 7f42a1d9b700 1 -- 172.21.15.79:0/4117568522 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800b8f0 con 0x7f42a40bf970 2023-10-14T18:45:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.686+0000 7f42a1d9b700 1 -- 172.21.15.79:0/4117568522 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800bc90 con 0x7f42a40bf970 2023-10-14T18:45:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.687+0000 7f42a91e1700 1 -- 172.21.15.79:0/4117568522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 msgr2=0x7f42a40bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.687+0000 7f42a91e1700 1 --2- 172.21.15.79:0/4117568522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42a406ebb0 tx=0x7f4298009250 comp rx=0 tx=0).stop 2023-10-14T18:45:20.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.691+0000 7f42a91e1700 1 -- 172.21.15.79:0/4117568522 shutdown_connections 2023-10-14T18:45:20.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.691+0000 7f42a91e1700 1 --2- 172.21.15.79:0/4117568522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a40bf970 0x7f42a40bfd40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.691+0000 7f42a91e1700 1 --2- 172.21.15.79:0/4117568522 >> v2:172.21.15.144:3300/0 conn(0x7f42a406f1a0 0x7f42a40ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.691+0000 7f42a91e1700 1 --2- 172.21.15.79:0/4117568522 >> v2:172.21.15.79:3300/0 conn(0x7f42a406d4c0 0x7f42a406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.691+0000 7f42a91e1700 1 -- 172.21.15.79:0/4117568522 >> 172.21.15.79:0/4117568522 conn(0x7f42a4067660 msgr2=0x7f42a4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.692+0000 7f42a91e1700 1 -- 172.21.15.79:0/4117568522 shutdown_connections 2023-10-14T18:45:20.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.692+0000 7f42a91e1700 1 -- 172.21.15.79:0/4117568522 wait complete. 2023-10-14T18:45:20.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.692+0000 7f0a89be4700 1 Processor -- start 2023-10-14T18:45:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f42a91e1700 1 Processor -- start 2023-10-14T18:45:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f0a89be4700 1 -- start start 2023-10-14T18:45:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f0a89be4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a840caa00 0x7f0a840c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f0a89be4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8406e650 con 0x7f0a840c8800 2023-10-14T18:45:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f0a89be4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a84067cd0 con 0x7f0a840ca630 2023-10-14T18:45:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.693+0000 7f0a89be4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840cae70 con 0x7f0a840caa00 2023-10-14T18:45:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a840caa00 0x7f0a840c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a840caa00 0x7f0a840c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55136/0 (socket says 172.21.15.79:55136) 2023-10-14T18:45:20.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1259834374 learned_addr learned my addr 172.21.15.79:0/1259834374 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1259834374 >> v1:172.21.15.144:6789/0 conn(0x7f0a840ca630 legacy=0x7f0a840adb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T18:45:20.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1259834374 >> v1:172.21.15.79:6789/0 conn(0x7f0a840c8800 legacy=0x7f0a841566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1259834374 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840679a0 con 0x7f0a840caa00 2023-10-14T18:45:20.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f0a82ffd700 1 --2- 172.21.15.79:0/1259834374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840caa00 0x7f0a840c82c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a780099b0 tx=0x7f0a78009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7da2c07699bee28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.694+0000 7f42a91e1700 1 -- start start 2023-10-14T18:45:20.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a406d4c0 0x7f42a415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a406f1a0 0x7f42a40c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 0x7f42a40c0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c2c60 con 0x7f42a40bf970 2023-10-14T18:45:20.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c0850 con 0x7f42a406f1a0 2023-10-14T18:45:20.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a91e1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c0c50 con 0x7f42a406d4c0 2023-10-14T18:45:20.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7fef03a87700 1 Processor -- start 2023-10-14T18:45:20.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f0a827fc700 1 -- 172.21.15.79:0/1259834374 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800b7e0 con 0x7f0a840caa00 2023-10-14T18:45:20.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f0a827fc700 1 -- 172.21.15.79:0/1259834374 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800b940 con 0x7f0a840caa00 2023-10-14T18:45:20.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f0a827fc700 1 -- 172.21.15.79:0/1259834374 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800bce0 con 0x7f0a840caa00 2023-10-14T18:45:20.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 0x7f42a40c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 0x7f42a40c0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59372/0 (socket says 172.21.15.79:59372) 2023-10-14T18:45:20.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 -- 172.21.15.79:0/841506359 learned_addr learned my addr 172.21.15.79:0/841506359 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a259c700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a406f1a0 0x7f42a40c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a406d4c0 0x7f42a415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7fef03a87700 1 -- start start 2023-10-14T18:45:20.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f0a89be4700 1 -- 172.21.15.79:0/1259834374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840caa00 msgr2=0x7f0a840c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1259834374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840caa00 0x7f0a840c82c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a780099b0 tx=0x7f0a78009250 comp rx=0 tx=0).stop 2023-10-14T18:45:20.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 -- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a406d4c0 msgr2=0x7f42a415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42a406d4c0 0x7f42a415b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 -- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a406f1a0 msgr2=0x7f42a40c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a406f1a0 0x7f42a40c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.695+0000 7f42a359e700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980094f0 con 0x7f42a40bf970 2023-10-14T18:45:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f42a359e700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 0x7f42a40c0310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f429c009ef0 tx=0x7f429c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00cb70 con 0x7f42a40bf970 2023-10-14T18:45:20.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00f040 con 0x7f42a40bf970 2023-10-14T18:45:20.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a40c0f30 con 0x7f42a40bf970 2023-10-14T18:45:20.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a40c30f0 con 0x7f42a40bf970 2023-10-14T18:45:20.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c014480 con 0x7f42a40bf970 2023-10-14T18:45:20.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7fef03a87700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feefc0c7670 0x7feefc156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7fef03a87700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feefc069d00 0x7feefc06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7fef03a87700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc069870 con 0x7feefc153b50 2023-10-14T18:45:20.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7fef03a87700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0c8610 con 0x7feefc069d00 2023-10-14T18:45:20.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.696+0000 7fef03a87700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc06a660 con 0x7feefc0c7670 2023-10-14T18:45:20.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef01823700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feefc153b50 0x7feefc0c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:48352/0 (socket says 172.21.15.79:48352) 2023-10-14T18:45:20.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef01823700 1 -- 172.21.15.79:0/2604151868 learned_addr learned my addr 172.21.15.79:0/2604151868 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:20.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4284000fd0 con 0x7f42a40bf970 2023-10-14T18:45:20.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 --2- 172.21.15.79:0/2604151868 >> v2:172.21.15.79:3300/0 conn(0x7feefc069d00 0x7feefc06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef01022700 1 --2- 172.21.15.79:0/2604151868 >> v2:172.21.15.144:3300/0 conn(0x7feefc0c7670 0x7feefc156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 -- 172.21.15.79:0/2604151868 >> v2:172.21.15.144:3300/0 conn(0x7feefc0c7670 msgr2=0x7feefc156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 --2- 172.21.15.79:0/2604151868 >> v2:172.21.15.144:3300/0 conn(0x7feefc0c7670 0x7feefc156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 -- 172.21.15.79:0/2604151868 >> v1:172.21.15.144:6789/0 conn(0x7feefc153b50 legacy=0x7feefc0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 -- 172.21.15.79:0/2604151868 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc1573e0 con 0x7feefc069d00 2023-10-14T18:45:20.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7fef02024700 1 --2- 172.21.15.79:0/2604151868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc06a120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feefc0b2e80 tx=0x7feef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6a2033192a176d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f0a89be4700 1 -- 172.21.15.79:0/1259834374 shutdown_connections 2023-10-14T18:45:20.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1259834374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840caa00 0x7f0a840c82c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f0a89be4700 1 -- 172.21.15.79:0/1259834374 >> 172.21.15.79:0/1259834374 conn(0x7f0a8406a250 msgr2=0x7f0a8406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f0a89be4700 1 -- 172.21.15.79:0/1259834374 shutdown_connections 2023-10-14T18:45:20.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.697+0000 7f0a89be4700 1 -- 172.21.15.79:0/1259834374 wait complete. 2023-10-14T18:45:20.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7fef00821700 1 -- 172.21.15.79:0/2604151868 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800b6b0 con 0x7feefc069d00 2023-10-14T18:45:20.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f0a89be4700 1 Processor -- start 2023-10-14T18:45:20.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.698+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f429c014830 con 0x7f42a40bf970 2023-10-14T18:45:20.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.698+0000 7f428affd700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4290066f30 0x7f42900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f429c085ac0 con 0x7f42a40bf970 2023-10-14T18:45:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4290066f30 0x7f42900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f428affd700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7f429006f140 0x7f4290071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4290071c00 con 0x7f429006f140 2023-10-14T18:45:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f429c085e90 con 0x7f42a40bf970 2023-10-14T18:45:20.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f42a259c700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7f429006f140 0x7f4290071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f0a89be4700 1 -- start start 2023-10-14T18:45:20.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7fef00821700 1 -- 172.21.15.79:0/2604151868 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800b830 con 0x7feefc069d00 2023-10-14T18:45:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7fef00821700 1 -- 172.21.15.79:0/2604151868 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800bbf0 con 0x7feefc069d00 2023-10-14T18:45:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 -- 172.21.15.79:0/2604151868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 msgr2=0x7feefc06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 --2- 172.21.15.79:0/2604151868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc06a120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feefc0b2e80 tx=0x7feef80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840c8800 0x7f0a840c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 0x7f0a840c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a840caa00 0x7f0a840b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a841661b0 con 0x7f0a840ca630 2023-10-14T18:45:20.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84150340 con 0x7f0a840c8800 2023-10-14T18:45:20.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a89be4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84166470 con 0x7f0a840caa00 2023-10-14T18:45:20.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.699+0000 7f42a259c700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7f429006f140 0x7f4290071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f42a2d9d700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4290066f30 0x7f42900693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42a406ebb0 tx=0x7f4298017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a82ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 0x7f0a840c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a82ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 0x7f0a840c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59390/0 (socket says 172.21.15.79:59390) 2023-10-14T18:45:20.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1074114385 learned_addr learned my addr 172.21.15.79:0/1074114385 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f0a837fe700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840c8800 0x7f0a840c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== osd.2 v2:172.21.15.79:6800/86333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f4290071c00 con 0x7f429006f140 2023-10-14T18:45:20.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a840caa00 msgr2=0x7f0a840b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 -- 172.21.15.79:0/2604151868 shutdown_connections 2023-10-14T18:45:20.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 --2- 172.21.15.79:0/2604151868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc06a120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 --2- 172.21.15.79:0/2604151868 >> v2:172.21.15.144:3300/0 conn(0x7feefc0c7670 0x7feefc156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.700+0000 7fef03a87700 1 -- 172.21.15.79:0/2604151868 >> 172.21.15.79:0/2604151868 conn(0x7feefc067660 msgr2=0x7feefc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a840caa00 0x7f0a840b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840c8800 msgr2=0x7f0a840c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840c8800 0x7f0a840c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 -- 172.21.15.79:0/1074114385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780094f0 con 0x7f0a840ca630 2023-10-14T18:45:20.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7fef03a87700 1 -- 172.21.15.79:0/2604151868 shutdown_connections 2023-10-14T18:45:20.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7fef03a87700 1 -- 172.21.15.79:0/2604151868 wait complete. 2023-10-14T18:45:20.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a837fe700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a840c8800 0x7f0a840c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:20.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.701+0000 7f0a82ffd700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 0x7f0a840c3b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a840cd8d0 tx=0x7f0a78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7f1f7be21700 1 Processor -- start 2023-10-14T18:45:20.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7fe6e0b86700 1 Processor -- start 2023-10-14T18:45:20.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7fe6e0b86700 1 -- start start 2023-10-14T18:45:20.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7f1f7be21700 1 -- start start 2023-10-14T18:45:20.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7fef03a87700 1 Processor -- start 2023-10-14T18:45:20.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.702+0000 7fef03a87700 1 -- start start 2023-10-14T18:45:20.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7801b470 con 0x7f0a840ca630 2023-10-14T18:45:20.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7801b5d0 con 0x7f0a840ca630 2023-10-14T18:45:20.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7801b990 con 0x7f0a840ca630 2023-10-14T18:45:20.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a84166750 con 0x7f0a840ca630 2023-10-14T18:45:20.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84166d10 con 0x7f0a840ca630 2023-10-14T18:45:20.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6e0b86700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe6dc0ca3e0 0x7fe6dc159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6e0b86700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc0c9f50 con 0x7fe6dc15e160 2023-10-14T18:45:20.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6e0b86700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc15e6d0 con 0x7fe6dc0c7550 2023-10-14T18:45:20.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6e0b86700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6dc0c9900 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6dad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe6dc15e160 0x7fe6dc15a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45510/0 (socket says 172.21.15.79:45510) 2023-10-14T18:45:20.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6dad9d700 1 -- 172.21.15.79:0/155757332 learned_addr learned my addr 172.21.15.79:0/155757332 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:20.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6d9d9b700 1 --2- 172.21.15.79:0/155757332 >> v2:172.21.15.144:3300/0 conn(0x7fe6dc0ca3e0 0x7fe6dc159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7be21700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 0x7f1f740cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7be21700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 0x7f1f740ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7be21700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f740c9450 con 0x7f1f740b0cd0 2023-10-14T18:45:20.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7be21700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f740ce960 con 0x7f1f740b10a0 2023-10-14T18:45:20.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7be21700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740cc520 con 0x7f1f7415b820 2023-10-14T18:45:20.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f7a3be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 0x7f1f740ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7f1f793bc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 0x7f1f740cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f793bc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 0x7f1f740cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59396/0 (socket says 172.21.15.79:59396) 2023-10-14T18:45:20.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f793bc700 1 -- 172.21.15.79:0/1736466910 learned_addr learned my addr 172.21.15.79:0/1736466910 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f79bbd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1f740b0cd0 0x7f1f740ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:48384/0 (socket says 172.21.15.79:48384) 2023-10-14T18:45:20.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fef03a87700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fef03a87700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feefc0c7670 0x7feefc152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fef03a87700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feefc153b50 0x7feefc153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fef03a87700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0b1540 con 0x7feefc069d00 2023-10-14T18:45:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc0b2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59410/0 (socket says 172.21.15.79:59410) 2023-10-14T18:45:20.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 -- 172.21.15.79:0/3766100053 learned_addr learned my addr 172.21.15.79:0/3766100053 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01022700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feefc0c7670 0x7feefc152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6d9d9b700 1 -- 172.21.15.79:0/155757332 >> v1:172.21.15.144:6789/0 conn(0x7fe6dc0c7550 legacy=0x7fe6dc15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6d9d9b700 1 -- 172.21.15.79:0/155757332 >> v1:172.21.15.79:6789/0 conn(0x7fe6dc15e160 legacy=0x7fe6dc15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef02024700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feefc153b50 0x7feefc153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.703+0000 7fe6d959a700 1 -- 172.21.15.79:0/155757332 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299874333 0 0) 0x7fe6dc0c9f50 con 0x7fe6dc15e160 2023-10-14T18:45:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fe6d9d9b700 1 -- 172.21.15.79:0/155757332 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0c9be0 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0b20a0 con 0x7feefc153b50 2023-10-14T18:45:20.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0b1770 con 0x7feefc0c7670 2023-10-14T18:45:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f7a3be700 1 -- 172.21.15.79:0/1736466910 >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 msgr2=0x7f1f740cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f7a3be700 1 --2- 172.21.15.79:0/1736466910 >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 0x7f1f740cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f7a3be700 1 -- 172.21.15.79:0/1736466910 >> v1:172.21.15.144:6789/0 conn(0x7f1f740b0cd0 legacy=0x7f1f740ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f7a3be700 1 -- 172.21.15.79:0/1736466910 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740cc910 con 0x7f1f7415b820 2023-10-14T18:45:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 -- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feefc0c7670 msgr2=0x7feefc152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feefc0c7670 0x7feefc152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 -- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feefc153b50 msgr2=0x7feefc153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feefc153b50 0x7feefc153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009420 con 0x7feefc069d00 2023-10-14T18:45:20.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fe6d9d9b700 1 --2- 172.21.15.79:0/155757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 0x7fe6dc159d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098e0 tx=0x7fe6d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfa7398e98d0431 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01022700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feefc0c7670 0x7feefc152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:20.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7f1f7a3be700 1 --2- 172.21.15.79:0/1736466910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 0x7f1f740ca930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009e60 tx=0x7f1f6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa381ca20ae2ffa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fef01823700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc0b2530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feef400cc70 tx=0x7feef4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.704+0000 7fe6d959a700 1 -- 172.21.15.79:0/155757332 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0009e80 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7fe6d959a700 1 -- 172.21.15.79:0/155757332 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000b820 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7fe6d959a700 1 -- 172.21.15.79:0/155757332 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d000bba0 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f1f78bbb700 1 -- 172.21.15.79:0/1736466910 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00e070 con 0x7f1f7415b820 2023-10-14T18:45:20.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f1f78bbb700 1 -- 172.21.15.79:0/1736466910 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00bb60 con 0x7f1f7415b820 2023-10-14T18:45:20.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f1f78bbb700 1 -- 172.21.15.79:0/1736466910 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c012430 con 0x7f1f7415b820 2023-10-14T18:45:20.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400a940 con 0x7feefc069d00 2023-10-14T18:45:20.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a7801bd40 con 0x7f0a840ca630 2023-10-14T18:45:20.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef400aac0 con 0x7feefc069d00 2023-10-14T18:45:20.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc0b1a50 con 0x7feefc069d00 2023-10-14T18:45:20.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400ae80 con 0x7feefc069d00 2023-10-14T18:45:20.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fe6e0b86700 1 -- 172.21.15.79:0/155757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 msgr2=0x7fe6dc159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/155757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 0x7fe6dc159d50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098e0 tx=0x7fe6d00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f0a6b7fe700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a70067000 0x7f0a700694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a78085fe0 con 0x7f0a840ca630 2023-10-14T18:45:20.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fe6e0b86700 1 -- 172.21.15.79:0/155757332 shutdown_connections 2023-10-14T18:45:20.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/155757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 0x7fe6dc159d50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fe6e0b86700 1 -- 172.21.15.79:0/155757332 >> 172.21.15.79:0/155757332 conn(0x7fe6dc067660 msgr2=0x7fe6dc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.705+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0c3e20 con 0x7feefc069d00 2023-10-14T18:45:20.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feefc0c40d0 con 0x7feefc069d00 2023-10-14T18:45:20.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7f1f7be21700 1 -- 172.21.15.79:0/1736466910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 msgr2=0x7f1f740ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1736466910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 0x7f1f740ca930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009e60 tx=0x7f1f6c009780 comp rx=0 tx=0).stop 2023-10-14T18:45:20.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7f0a837fe700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a70067000 0x7f0a700694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7f157f1b0700 1 Processor -- start 2023-10-14T18:45:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.706+0000 7f157f1b0700 1 -- start start 2023-10-14T18:45:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 -- 172.21.15.79:0/1736466910 shutdown_connections 2023-10-14T18:45:20.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1736466910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f7415b820 0x7f1f740ca930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1736466910 >> v2:172.21.15.79:3300/0 conn(0x7f1f740b10a0 0x7f1f740cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 -- 172.21.15.79:0/1736466910 >> 172.21.15.79:0/1736466910 conn(0x7f1f7406fdc0 msgr2=0x7f1f7406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f0a837fe700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a70067000 0x7f0a700694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006fd0 tx=0x7f0a740090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feef4007300 con 0x7feefc069d00 2023-10-14T18:45:20.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 -- 172.21.15.79:0/1736466910 shutdown_connections 2023-10-14T18:45:20.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7f1f7be21700 1 -- 172.21.15.79:0/1736466910 wait complete. 2023-10-14T18:45:20.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feee0066f00 0x7feee00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feef4085310 con 0x7feefc069d00 2023-10-14T18:45:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7feee006f110 0x7feee0071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feee0071bd0 con 0x7feee006f110 2023-10-14T18:45:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.707+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feef40856e0 con 0x7feefc069d00 2023-10-14T18:45:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7fef01022700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feee0066f00 0x7feee00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7fef02024700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7feee006f110 0x7feee0071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157f1b0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f157815a9c0 0x7f1578159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157f1b0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 0x7f157806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157f1b0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780c7cd0 con 0x7f15780acd60 2023-10-14T18:45:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157f1b0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780c9170 con 0x7f157815a9c0 2023-10-14T18:45:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157f1b0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157806eb50 con 0x7f157815ad90 2023-10-14T18:45:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f1577fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f15780acd60 0x7f1578159fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45514/0 (socket says 172.21.15.79:45514) 2023-10-14T18:45:20.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f1577fff700 1 -- 172.21.15.79:0/3385511102 learned_addr learned my addr 172.21.15.79:0/3385511102 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157d74d700 1 --2- 172.21.15.79:0/3385511102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 0x7f157806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7fef01022700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feee0066f00 0x7feee00693b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feeec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157cf4c700 1 --2- 172.21.15.79:0/3385511102 >> v2:172.21.15.79:3300/0 conn(0x7f157815a9c0 0x7f1578159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f15777fe700 1 -- 172.21.15.79:0/3385511102 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778227643 0 0) 0x7f15780c7cd0 con 0x7f15780acd60 2023-10-14T18:45:20.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157d74d700 1 -- 172.21.15.79:0/3385511102 >> v2:172.21.15.79:3300/0 conn(0x7f157815a9c0 msgr2=0x7f1578159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157d74d700 1 --2- 172.21.15.79:0/3385511102 >> v2:172.21.15.79:3300/0 conn(0x7f157815a9c0 0x7f1578159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157d74d700 1 -- 172.21.15.79:0/3385511102 >> v1:172.21.15.79:6789/0 conn(0x7f15780acd60 legacy=0x7f1578159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f157d74d700 1 -- 172.21.15.79:0/3385511102 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15780c73a0 con 0x7f157815ad90 2023-10-14T18:45:20.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f1f7be21700 1 Processor -- start 2023-10-14T18:45:20.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.708+0000 7f1f7be21700 1 -- start start 2023-10-14T18:45:20.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f157d74d700 1 --2- 172.21.15.79:0/3385511102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 0x7f157806de00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1570009e60 tx=0x7f1570009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5c5d7236855bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7fe6e0b86700 1 -- 172.21.15.79:0/155757332 shutdown_connections 2023-10-14T18:45:20.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f0a640015f0 0x7f0a64003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 --> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a64006b90 con 0x7f0a640015f0 2023-10-14T18:45:20.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7fe6e0b86700 1 -- 172.21.15.79:0/155757332 wait complete. 2023-10-14T18:45:20.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f0a83fff700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f0a640015f0 0x7f0a64003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f0a83fff700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f0a640015f0 0x7f0a64003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f740b0cd0 0x7f1f740c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f740b10a0 0x7f1f740c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f7415b820 0x7f1f740c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740689f0 con 0x7f1f7415b820 2023-10-14T18:45:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c6a10 con 0x7f1f740b0cd0 2023-10-14T18:45:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7be21700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c6c40 con 0x7f1f740b10a0 2023-10-14T18:45:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f79bbd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f740b0cd0 0x7f1f740c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f7a3be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f7415b820 0x7f1f740c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f79bbd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f740b0cd0 0x7f1f740c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55190/0 (socket says 172.21.15.79:55190) 2023-10-14T18:45:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f79bbd700 1 -- 172.21.15.79:0/1599333733 learned_addr learned my addr 172.21.15.79:0/1599333733 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f740b10a0 0x7f1f740c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== osd.1 v2:172.21.15.79:6822/86335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f0a64006b90 con 0x7f0a640015f0 2023-10-14T18:45:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 -- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f740b0cd0 msgr2=0x7f1f740c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f740b0cd0 0x7f1f740c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 -- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f7415b820 msgr2=0x7f1f740c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f7415b820 0x7f1f740c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.710+0000 7f1f793bc700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c009a20 con 0x7f1f740b10a0 2023-10-14T18:45:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7fe6e0b86700 1 Processor -- start 2023-10-14T18:45:20.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f1f793bc700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f740b10a0 0x7f1f740c64d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006d40 tx=0x7f1f64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7fe6e0b86700 1 -- start start 2023-10-14T18:45:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64013680 con 0x7f1f740b10a0 2023-10-14T18:45:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640137e0 con 0x7f1f740b10a0 2023-10-14T18:45:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64013b60 con 0x7f1f740b10a0 2023-10-14T18:45:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f74068430 con 0x7f1f740b10a0 2023-10-14T18:45:20.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74068da0 con 0x7f1f740b10a0 2023-10-14T18:45:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fbad4c68700 1 Processor -- start 2023-10-14T18:45:20.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 0x7fe6dc0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6dc15e160 0x7fe6dc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 0x7fe6dc0c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0b1520 con 0x7fe6dc0c4610 2023-10-14T18:45:20.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0b1800 con 0x7fe6dc0ca3e0 2023-10-14T18:45:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6e0b86700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0b1100 con 0x7fe6dc15e160 2023-10-14T18:45:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 0x7fe6dc0c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 0x7fe6dc0c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59442/0 (socket says 172.21.15.79:59442) 2023-10-14T18:45:20.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 -- 172.21.15.79:0/2736953816 learned_addr learned my addr 172.21.15.79:0/2736953816 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fbad4c68700 1 -- start start 2023-10-14T18:45:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6d9d9b700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6dc15e160 0x7fe6dc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 -- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6dc15e160 msgr2=0x7fe6dc156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6dc15e160 0x7fe6dc156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 -- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 msgr2=0x7fe6dc0abbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc0ca3e0 0x7fe6dc0abbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7fe6dad9d700 1 -- 172.21.15.79:0/2736953816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0009420 con 0x7fe6dc0c4610 2023-10-14T18:45:20.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f74068c00 con 0x7f1f740b10a0 2023-10-14T18:45:20.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6dad9d700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 0x7fe6dc0c6700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400cbf0 tx=0x7fe6d4001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400a980 con 0x7fe6dc0c4610 2023-10-14T18:45:20.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc0c4ad0 con 0x7fe6dc0c4610 2023-10-14T18:45:20.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc0c5090 con 0x7fe6dc0c4610 2023-10-14T18:45:20.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400acf0 con 0x7fe6dc0c4610 2023-10-14T18:45:20.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400ae60 con 0x7fe6dc0c4610 2023-10-14T18:45:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.709+0000 7f15777fe700 1 -- 172.21.15.79:0/3385511102 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157000e070 con 0x7f157815ad90 2023-10-14T18:45:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f15777fe700 1 -- 172.21.15.79:0/3385511102 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157000bb60 con 0x7f157815ad90 2023-10-14T18:45:20.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f15777fe700 1 -- 172.21.15.79:0/3385511102 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570012430 con 0x7f157815ad90 2023-10-14T18:45:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f157f1b0700 1 -- 172.21.15.79:0/3385511102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 msgr2=0x7f157806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.711+0000 7f157f1b0700 1 --2- 172.21.15.79:0/3385511102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 0x7f157806de00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1570009e60 tx=0x7f1570009780 comp rx=0 tx=0).stop 2023-10-14T18:45:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 -- 172.21.15.79:0/3385511102 shutdown_connections 2023-10-14T18:45:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 --2- 172.21.15.79:0/3385511102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815ad90 0x7f157806de00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 --2- 172.21.15.79:0/3385511102 >> v2:172.21.15.79:3300/0 conn(0x7f157815a9c0 0x7f1578159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 -- 172.21.15.79:0/3385511102 >> 172.21.15.79:0/3385511102 conn(0x7f1578067660 msgr2=0x7f1578067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 -- 172.21.15.79:0/3385511102 shutdown_connections 2023-10-14T18:45:20.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.712+0000 7f157f1b0700 1 -- 172.21.15.79:0/3385511102 wait complete. 2023-10-14T18:45:20.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7f157f1b0700 1 Processor -- start 2023-10-14T18:45:20.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7f157f1b0700 1 -- start start 2023-10-14T18:45:20.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f6400c3e0 con 0x7f1f740b10a0 2023-10-14T18:45:20.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f69ffb700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f58066fb0 0x7f1f58069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f64084680 con 0x7f1f740b10a0 2023-10-14T18:45:20.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f69ffb700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7f1f5806f140 0x7f1f58071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f79bbd700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f58066fb0 0x7f1f58069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f58071c00 con 0x7f1f5806f140 2023-10-14T18:45:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fbad4c68700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad006f1a0 0x7fbad00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fbad4c68700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbad00b0160 0x7fbad0070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fbad4c68700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad00ca270 con 0x7fbad00afd90 2023-10-14T18:45:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fbad4c68700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad00c87c0 con 0x7fbad006f1a0 2023-10-14T18:45:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.713+0000 7fbad4c68700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad006e3e0 con 0x7fbad00b0160 2023-10-14T18:45:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad006f1a0 0x7fbad00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad006f1a0 0x7fbad00c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59450/0 (socket says 172.21.15.79:59450) 2023-10-14T18:45:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 -- 172.21.15.79:0/2474154165 learned_addr learned my addr 172.21.15.79:0/2474154165 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 -- 172.21.15.79:0/2474154165 >> v2:172.21.15.144:3300/0 conn(0x7fbad00b0160 msgr2=0x7fbad0070700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T18:45:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 --2- 172.21.15.79:0/2474154165 >> v2:172.21.15.144:3300/0 conn(0x7fbad00b0160 0x7fbad0070700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 -- 172.21.15.79:0/2474154165 >> v1:172.21.15.79:6789/0 conn(0x7fbad00afd90 legacy=0x7fbad015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 -- 172.21.15.79:0/2474154165 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad006e6c0 con 0x7fbad006f1a0 2023-10-14T18:45:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacdd9b700 1 --2- 172.21.15.79:0/2474154165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad006f1a0 0x7fbad00c9c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbad00cb460 tx=0x7fbac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8487db9fd4aa6e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacd59a700 1 -- 172.21.15.79:0/2474154165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000b820 con 0x7fbad006f1a0 2023-10-14T18:45:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacd59a700 1 -- 172.21.15.79:0/2474154165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000b980 con 0x7fbad006f1a0 2023-10-14T18:45:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.714+0000 7fbacd59a700 1 -- 172.21.15.79:0/2474154165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000bd40 con 0x7fbad006f1a0 2023-10-14T18:45:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7fbad4c68700 1 -- 172.21.15.79:0/2474154165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad006f1a0 msgr2=0x7fbad00c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7fbad4c68700 1 --2- 172.21.15.79:0/2474154165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad006f1a0 0x7fbad00c9c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbad00cb460 tx=0x7fbac0009250 comp rx=0 tx=0).stop 2023-10-14T18:45:20.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 0x7f1578148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815a9c0 0x7f1578169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f157815ad90 0x7f15780b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1578148ff0 con 0x7f157815ad90 2023-10-14T18:45:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15780c3e10 con 0x7f15780acd60 2023-10-14T18:45:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157f1b0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15780c40b0 con 0x7f157815a9c0 2023-10-14T18:45:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 0x7f1578148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 0x7f1578148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55214/0 (socket says 172.21.15.79:55214) 2023-10-14T18:45:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 -- 172.21.15.79:0/2253268889 learned_addr learned my addr 172.21.15.79:0/2253268889 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 -- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815a9c0 msgr2=0x7f1578169750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f157815a9c0 0x7f1578169750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 -- 172.21.15.79:0/2253268889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f157815ad90 msgr2=0x7f15780b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f157815ad90 0x7f15780b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.715+0000 7f157cf4c700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570009a20 con 0x7f15780acd60 2023-10-14T18:45:20.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f64051850 con 0x7f1f740b10a0 2023-10-14T18:45:20.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1f7a3be700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7f1f5806f140 0x7f1f58071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f157cf4c700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 0x7f1578148ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ec80 tx=0x7f156c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7fef02024700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7feee006f110 0x7feee0071520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1f79bbd700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f58066fb0 0x7f1f58069460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f70004fd0 tx=0x7f1f70007f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00c9d0 con 0x7f15780acd60 2023-10-14T18:45:20.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00cb30 con 0x7f15780acd60 2023-10-14T18:45:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c013470 con 0x7f15780acd60 2023-10-14T18:45:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15780c4390 con 0x7f15780acd60 2023-10-14T18:45:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15780c4950 con 0x7f15780acd60 2023-10-14T18:45:20.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6d4007300 con 0x7fe6dc0c4610 2023-10-14T18:45:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7fe6ca7fc700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe6bc066f30 0x7fe6bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6d4084a60 con 0x7fe6dc0c4610 2023-10-14T18:45:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== osd.4 v2:172.21.15.144:6804/86566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7feee0071bd0 con 0x7feee006f110 2023-10-14T18:45:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.716+0000 7f1f7a3be700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7f1f5806f140 0x7f1f58071550 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== osd.0 v2:172.21.15.79:6808/86336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1f58071c00 con 0x7f1f5806f140 2023-10-14T18:45:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.718+0000 7fe6da59c700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe6bc066f30 0x7fe6bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7fbad4c68700 1 -- 172.21.15.79:0/2474154165 shutdown_connections 2023-10-14T18:45:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7fbad4c68700 1 --2- 172.21.15.79:0/2474154165 >> v2:172.21.15.144:3300/0 conn(0x7fbad00b0160 0x7fbad0070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7fbad4c68700 1 --2- 172.21.15.79:0/2474154165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad006f1a0 0x7fbad00c9c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.717+0000 7fbad4c68700 1 -- 172.21.15.79:0/2474154165 >> 172.21.15.79:0/2474154165 conn(0x7fbad00ca4f0 msgr2=0x7fbad00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.718+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f157804c3c0 con 0x7f15780acd60 2023-10-14T18:45:20.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.718+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7fe6c00015f0 0x7fe6c0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.718+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 --> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6c0006b90 con 0x7fe6c00015f0 2023-10-14T18:45:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.718+0000 7fe6da59c700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe6bc066f30 0x7fe6bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7fbad4c68700 1 -- 172.21.15.79:0/2474154165 shutdown_connections 2023-10-14T18:45:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f156c005a00 con 0x7f15780acd60 2023-10-14T18:45:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f155c067000 0x7f155c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f156c084ad0 con 0x7f15780acd60 2023-10-14T18:45:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f155c06f210 0x7f155c071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f155c071cd0 con 0x7f155c06f210 2023-10-14T18:45:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f156c038ea0 con 0x7f15780acd60 2023-10-14T18:45:20.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.719+0000 7fbad4c68700 1 -- 172.21.15.79:0/2474154165 wait complete. 2023-10-14T18:45:20.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.720+0000 7fbad4c68700 1 Processor -- start 2023-10-14T18:45:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.720+0000 7fbad4c68700 1 -- start start 2023-10-14T18:45:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad006f1a0 0x7fbad00b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad00afd90 0x7fbad00c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 0x7fbad01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c53f0 con 0x7fbad00b0160 2023-10-14T18:45:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c56d0 con 0x7fbad006f1a0 2023-10-14T18:45:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbad4c68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c59b0 con 0x7fbad00afd90 2023-10-14T18:45:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.721+0000 7fbaced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 0x7fbad01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 0x7fbad01595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59476/0 (socket says 172.21.15.79:59476) 2023-10-14T18:45:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 -- 172.21.15.79:0/3588291787 learned_addr learned my addr 172.21.15.79:0/3588291787 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbace59c700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad006f1a0 0x7fbad00b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 -- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad00afd90 msgr2=0x7fbad00c4b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad00afd90 0x7fbad00c4b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 -- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad006f1a0 msgr2=0x7fbad00b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad006f1a0 0x7fbad00b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 -- 172.21.15.79:0/3588291787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00094f0 con 0x7fbad00b0160 2023-10-14T18:45:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbaced9d700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 0x7fbad01595b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbac800b7f0 tx=0x7fbac8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8010470 con 0x7fbad00b0160 2023-10-14T18:45:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad00c5c90 con 0x7fbad00b0160 2023-10-14T18:45:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80105f0 con 0x7fbad00b0160 2023-10-14T18:45:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80109b0 con 0x7fbad00b0160 2023-10-14T18:45:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.722+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad00c5070 con 0x7fbad00b0160 2023-10-14T18:45:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.724+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbac801a460 con 0x7fbad00b0160 2023-10-14T18:45:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.724+0000 7fbabe7fc700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbab80670a0 0x7fbab8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.725+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbac80845b0 con 0x7fbad00b0160 2023-10-14T18:45:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.725+0000 7fbace59c700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbab80670a0 0x7fbab8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.725+0000 7f157d74d700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f155c06f210 0x7f155c071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.725+0000 7fbace59c700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbab80670a0 0x7fbab8069550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbac4006fd0 tx=0x7fbac40090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.726+0000 7f157d74d700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f155c06f210 0x7f155c071620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.726+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== osd.5 v2:172.21.15.144:6800/86565 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f155c071cd0 con 0x7f155c06f210 2023-10-14T18:45:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.728+0000 7fe6d9d9b700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7fe6c00015f0 0x7fe6c0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.728+0000 7fbad4c68700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7fbab40015f0 0x7fbab4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.728+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 --> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbab4006b90 con 0x7fbab40015f0 2023-10-14T18:45:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.729+0000 7fe6d9d9b700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7fe6c00015f0 0x7fe6c0003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.729+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== osd.6 v2:172.21.15.144:6824/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fe6c0006b90 con 0x7fe6c00015f0 2023-10-14T18:45:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.730+0000 7fba9143f700 1 Processor -- start 2023-10-14T18:45:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.730+0000 7fba9143f700 1 -- start start 2023-10-14T18:45:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.730+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 --> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4284002d30 con 0x7f429006f140 2023-10-14T18:45:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.730+0000 7f428affd700 1 -- 172.21.15.79:0/841506359 <== osd.2 v2:172.21.15.79:6800/86333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4284002d30 con 0x7f429006f140 2023-10-14T18:45:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7f429006f140 msgr2=0x7f4290071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7f42a91e1700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7f429006f140 0x7f4290071550 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba9143f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba8c157870 0x7fba8c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba9143f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 0x7fba8c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba9143f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c15cbb0 con 0x7fba8c15d580 2023-10-14T18:45:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba9143f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c15bfa0 con 0x7fba8c157870 2023-10-14T18:45:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba9143f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c15c280 con 0x7fba8c15a620 2023-10-14T18:45:20.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fba8c15d580 0x7fba8c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45528/0 (socket says 172.21.15.79:45528) 2023-10-14T18:45:20.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8affd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba8c157870 0x7fba8c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8b7fe700 1 -- 172.21.15.79:0/352258022 learned_addr learned my addr 172.21.15.79:0/352258022 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:20.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/352258022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 0x7fba8c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba89ffb700 1 -- 172.21.15.79:0/352258022 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756778117 0 0) 0x7fba8c15cbb0 con 0x7fba8c15d580 2023-10-14T18:45:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba89ffb700 1 -- 172.21.15.79:0/352258022 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba74003570 con 0x7fba8c15d580 2023-10-14T18:45:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8a7fc700 1 -- 172.21.15.79:0/352258022 >> v2:172.21.15.144:3300/0 conn(0x7fba8c157870 msgr2=0x7fba8c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/352258022 >> v2:172.21.15.144:3300/0 conn(0x7fba8c157870 0x7fba8c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8a7fc700 1 -- 172.21.15.79:0/352258022 >> v1:172.21.15.79:6789/0 conn(0x7fba8c15d580 legacy=0x7fba8c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.731+0000 7fba8a7fc700 1 -- 172.21.15.79:0/352258022 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c15c560 con 0x7fba8c15a620 2023-10-14T18:45:20.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.732+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/352258022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 0x7fba8c15d040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba800098e0 tx=0x7fba800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb2ff6f0a73e8875 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.732+0000 7fba89ffb700 1 -- 172.21.15.79:0/352258022 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000b640 con 0x7fba8c15a620 2023-10-14T18:45:20.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.732+0000 7fba89ffb700 1 -- 172.21.15.79:0/352258022 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000b7c0 con 0x7fba8c15a620 2023-10-14T18:45:20.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.732+0000 7fba89ffb700 1 -- 172.21.15.79:0/352258022 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000bb80 con 0x7fba8c15a620 2023-10-14T18:45:20.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 -- 172.21.15.79:0/352258022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 msgr2=0x7fba8c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 --2- 172.21.15.79:0/352258022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 0x7fba8c15d040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba800098e0 tx=0x7fba800091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 -- 172.21.15.79:0/352258022 shutdown_connections 2023-10-14T18:45:20.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 --2- 172.21.15.79:0/352258022 >> v2:172.21.15.144:3300/0 conn(0x7fba8c157870 0x7fba8c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 --2- 172.21.15.79:0/352258022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15a620 0x7fba8c15d040 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 -- 172.21.15.79:0/352258022 >> 172.21.15.79:0/352258022 conn(0x7fba8c068ce0 msgr2=0x7fba8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 -- 172.21.15.79:0/352258022 shutdown_connections 2023-10-14T18:45:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.733+0000 7fba9143f700 1 -- 172.21.15.79:0/352258022 wait complete. 2023-10-14T18:45:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.734+0000 7fba9143f700 1 Processor -- start 2023-10-14T18:45:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.734+0000 7fba9143f700 1 -- start start 2023-10-14T18:45:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba8c157870 0x7fba8c14c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 0x7fba8c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15d580 0x7fba8c0d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0d1320 con 0x7fba8c15a620 2023-10-14T18:45:20.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0b1980 con 0x7fba8c157870 2023-10-14T18:45:20.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba9143f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0d0d60 con 0x7fba8c15d580 2023-10-14T18:45:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 0x7fba8c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 0x7fba8c0d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59482/0 (socket says 172.21.15.79:59482) 2023-10-14T18:45:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 -- 172.21.15.79:0/1354247416 learned_addr learned my addr 172.21.15.79:0/1354247416 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8b7fe700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15d580 0x7fba8c0d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8affd700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba8c157870 0x7fba8c14c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 -- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15d580 msgr2=0x7fba8c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba8c15d580 0x7fba8c0d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 -- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba8c157870 msgr2=0x7fba8c14c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba8c157870 0x7fba8c14c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009420 con 0x7fba8c15a620 2023-10-14T18:45:20.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.735+0000 7fba8a7fc700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 0x7fba8c0d0240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba80013000 tx=0x7fba80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8001f070 con 0x7fba8c15a620 2023-10-14T18:45:20.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000b930 con 0x7fba8c15a620 2023-10-14T18:45:20.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c0d1040 con 0x7fba8c15a620 2023-10-14T18:45:20.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80011420 con 0x7fba8c15a620 2023-10-14T18:45:20.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4290066f30 msgr2=0x7f42900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4290066f30 0x7f42900693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f42a406ebb0 tx=0x7f4298017000 comp rx=0 tx=0).stop 2023-10-14T18:45:20.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 msgr2=0x7f42a40c0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c151280 con 0x7fba8c15a620 2023-10-14T18:45:20.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 --2- 172.21.15.79:0/841506359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42a40bf970 0x7f42a40c0310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f429c009ef0 tx=0x7f429c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:20.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a359e700 1 -- 172.21.15.79:0/841506359 reap_dead start 2023-10-14T18:45:20.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 shutdown_connections 2023-10-14T18:45:20.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 >> 172.21.15.79:0/841506359 conn(0x7f42a4067660 msgr2=0x7f42a40ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 shutdown_connections 2023-10-14T18:45:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fbacdd9b700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7fbab40015f0 0x7fbab4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.736+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba8c04c3c0 con 0x7fba8c15a620 2023-10-14T18:45:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.737+0000 7fbacdd9b700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7fbab40015f0 0x7fbab4003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.737+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 --> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a64005c80 con 0x7f0a640015f0 2023-10-14T18:45:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.737+0000 7f1577fff700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f155c067000 0x7f155c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.737+0000 7f1577fff700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f155c067000 0x7f155c0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15781478d0 tx=0x7f1564007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.738+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== osd.3 v2:172.21.15.79:6816/86334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fbab4006b90 con 0x7fbab40015f0 2023-10-14T18:45:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba80011810 con 0x7fba8c15a620 2023-10-14T18:45:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba78066f30 0x7fba780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba80086090 con 0x7fba8c15a620 2023-10-14T18:45:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba8affd700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba78066f30 0x7fba780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7fba7806f0c0 0x7fba780714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba78071b80 con 0x7fba7806f0c0 2023-10-14T18:45:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba80086460 con 0x7fba8c15a620 2023-10-14T18:45:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.739+0000 7f0a6b7fe700 1 -- 172.21.15.79:0/1074114385 <== osd.1 v2:172.21.15.79:6822/86335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a64005c80 con 0x7f0a640015f0 2023-10-14T18:45:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.740+0000 7fba8affd700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba78066f30 0x7fba780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.741+0000 7fba8b7fe700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7fba7806f0c0 0x7fba780714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.741+0000 7fba8b7fe700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7fba7806f0c0 0x7fba780714d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.742+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== osd.7 v2:172.21.15.144:6816/86567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fba78071b80 con 0x7fba7806f0c0 2023-10-14T18:45:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.746+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 --> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f7404c3c0 con 0x7f1f5806f140 2023-10-14T18:45:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.746+0000 7f1f69ffb700 1 -- 172.21.15.79:0/1599333733 <== osd.0 v2:172.21.15.79:6808/86336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f7404c3c0 con 0x7f1f5806f140 2023-10-14T18:45:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.746+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 --> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feefc04c3c0 con 0x7feee006f110 2023-10-14T18:45:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7f1f5806f140 msgr2=0x7f1f58071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7f1f5806f140 0x7f1f58071550 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f42a91e1700 1 -- 172.21.15.79:0/841506359 wait complete. 2023-10-14T18:45:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f0a640015f0 msgr2=0x7f0a64003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f0a640015f0 0x7f0a64003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a70067000 msgr2=0x7f0a700694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a70067000 0x7f0a700694b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006fd0 tx=0x7f0a740090f0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 msgr2=0x7f0a840c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 --2- 172.21.15.79:0/1074114385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a840ca630 0x7f0a840c3b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a840cd8d0 tx=0x7f0a78016000 comp rx=0 tx=0).stop 2023-10-14T18:45:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7feef1ffb700 1 -- 172.21.15.79:0/3766100053 <== osd.4 v2:172.21.15.144:6804/86566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feefc04c3c0 con 0x7feee006f110 2023-10-14T18:45:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a83fff700 1 -- 172.21.15.79:0/1074114385 reap_dead start 2023-10-14T18:45:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 shutdown_connections 2023-10-14T18:45:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 >> 172.21.15.79:0/1074114385 conn(0x7f0a8406a250 msgr2=0x7f0a840c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f58066fb0 msgr2=0x7f1f58069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f58066fb0 0x7f1f58069460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1f70004fd0 tx=0x7f1f70007f70 comp rx=0 tx=0).stop 2023-10-14T18:45:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f740b10a0 msgr2=0x7f1f740c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 --2- 172.21.15.79:0/1599333733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f740b10a0 0x7f1f740c64d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006d40 tx=0x7f1f64009250 comp rx=0 tx=0).stop 2023-10-14T18:45:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7a3be700 1 -- 172.21.15.79:0/1599333733 reap_dead start 2023-10-14T18:45:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 shutdown_connections 2023-10-14T18:45:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 >> 172.21.15.79:0/1599333733 conn(0x7f1f7406fdc0 msgr2=0x7f1f740c41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 shutdown_connections 2023-10-14T18:45:20.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f0a89be4700 1 -- 172.21.15.79:0/1074114385 wait complete. 2023-10-14T18:45:20.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 shutdown_connections 2023-10-14T18:45:20.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.747+0000 7f1f7be21700 1 -- 172.21.15.79:0/1599333733 wait complete. 2023-10-14T18:45:20.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 --> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15780c7680 con 0x7f155c06f210 2023-10-14T18:45:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7feee006f110 msgr2=0x7feee0071520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7feee006f110 0x7feee0071520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feee0066f00 msgr2=0x7feee00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feee0066f00 0x7feee00693b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feeec006fd0 tx=0x7feeec008040 comp rx=0 tx=0).stop 2023-10-14T18:45:20.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 msgr2=0x7feefc0b2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 --2- 172.21.15.79:0/3766100053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feefc069d00 0x7feefc0b2530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feef400cc70 tx=0x7feef4001a30 comp rx=0 tx=0).stop 2023-10-14T18:45:20.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef02024700 1 -- 172.21.15.79:0/3766100053 reap_dead start 2023-10-14T18:45:20.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 shutdown_connections 2023-10-14T18:45:20.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 >> 172.21.15.79:0/3766100053 conn(0x7feefc067660 msgr2=0x7feefc0ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7f1574ff9700 1 -- 172.21.15.79:0/2253268889 <== osd.5 v2:172.21.15.144:6800/86565 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15780c7680 con 0x7f155c06f210 2023-10-14T18:45:20.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 shutdown_connections 2023-10-14T18:45:20.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.748+0000 7fef03a87700 1 -- 172.21.15.79:0/3766100053 wait complete. 2023-10-14T18:45:20.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f155c06f210 msgr2=0x7f155c071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f155c06f210 0x7f155c071620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f155c067000 msgr2=0x7f155c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f155c067000 0x7f155c0694b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15781478d0 tx=0x7f1564007940 comp rx=0 tx=0).stop 2023-10-14T18:45:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 msgr2=0x7f1578148ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 --2- 172.21.15.79:0/2253268889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15780acd60 0x7f1578148ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ec80 tx=0x7f156c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157d74d700 1 -- 172.21.15.79:0/2253268889 reap_dead start 2023-10-14T18:45:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 shutdown_connections 2023-10-14T18:45:20.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 >> 172.21.15.79:0/2253268889 conn(0x7f1578067660 msgr2=0x7f157806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 shutdown_connections 2023-10-14T18:45:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.750+0000 7f157f1b0700 1 -- 172.21.15.79:0/2253268889 wait complete. 2023-10-14T18:45:20.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.766+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 --> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbab4005c20 con 0x7fbab40015f0 2023-10-14T18:45:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.765+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 --> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6c0005c20 con 0x7fe6c00015f0 2023-10-14T18:45:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.765+0000 7fe6ca7fc700 1 -- 172.21.15.79:0/2736953816 <== osd.6 v2:172.21.15.144:6824/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6c0005c20 con 0x7fe6c00015f0 2023-10-14T18:45:20.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.765+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 --> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba8c15c840 con 0x7fba7806f0c0 2023-10-14T18:45:20.855 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T18:45:20.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7fe6c00015f0 msgr2=0x7fe6c0003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7fe6c00015f0 0x7fe6c0003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbabe7fc700 1 -- 172.21.15.79:0/3588291787 <== osd.3 v2:172.21.15.79:6816/86334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbab4005c20 con 0x7fbab40015f0 2023-10-14T18:45:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe6bc066f30 msgr2=0x7fe6bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe6bc066f30 0x7fe6bc0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc007b20 comp rx=0 tx=0).stop 2023-10-14T18:45:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 msgr2=0x7fe6dc0c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6e0b86700 1 --2- 172.21.15.79:0/2736953816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6dc0c4610 0x7fe6dc0c6700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400cbf0 tx=0x7fe6d4001980 comp rx=0 tx=0).stop 2023-10-14T18:45:20.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fe6dad9d700 1 -- 172.21.15.79:0/2736953816 reap_dead start 2023-10-14T18:45:20.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7fbab40015f0 msgr2=0x7fbab4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7fbab40015f0 0x7fbab4003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbab80670a0 msgr2=0x7fbab8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbab80670a0 0x7fbab8069550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbac4006fd0 tx=0x7fbac40090f0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 msgr2=0x7fbad01595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.767+0000 7fbad4c68700 1 --2- 172.21.15.79:0/3588291787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad00b0160 0x7fbad01595b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbac800b7f0 tx=0x7fbac8009840 comp rx=0 tx=0).stop 2023-10-14T18:45:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fbaced9d700 1 -- 172.21.15.79:0/3588291787 reap_dead start 2023-10-14T18:45:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 shutdown_connections 2023-10-14T18:45:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 >> 172.21.15.79:0/3588291787 conn(0x7fbad00ca4f0 msgr2=0x7fbad0156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 shutdown_connections 2023-10-14T18:45:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fba72ffd700 1 -- 172.21.15.79:0/1354247416 <== osd.7 v2:172.21.15.144:6816/86567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba8c15c840 con 0x7fba7806f0c0 2023-10-14T18:45:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fbad4c68700 1 -- 172.21.15.79:0/3588291787 wait complete. 2023-10-14T18:45:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7fba7806f0c0 msgr2=0x7fba780714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.768+0000 7fba9143f700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7fba7806f0c0 0x7fba780714d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba78066f30 msgr2=0x7fba780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba78066f30 0x7fba780693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba7c006fd0 tx=0x7fba7c008040 comp rx=0 tx=0).stop 2023-10-14T18:45:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 msgr2=0x7fba8c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:20.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 --2- 172.21.15.79:0/1354247416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba8c15a620 0x7fba8c0d0240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fba80013000 tx=0x7fba80017000 comp rx=0 tx=0).stop 2023-10-14T18:45:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba8b7fe700 1 -- 172.21.15.79:0/1354247416 reap_dead start 2023-10-14T18:45:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 shutdown_connections 2023-10-14T18:45:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 >> 172.21.15.79:0/1354247416 conn(0x7fba8c068ce0 msgr2=0x7fba8c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 shutdown_connections 2023-10-14T18:45:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 >> 172.21.15.79:0/2736953816 conn(0x7fe6dc067660 msgr2=0x7fe6dc15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:20.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 shutdown_connections 2023-10-14T18:45:20.867 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T18:45:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 shutdown_connections 2023-10-14T18:45:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fba9143f700 1 -- 172.21.15.79:0/1354247416 wait complete. 2023-10-14T18:45:20.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:20.769+0000 7fe6e0b86700 1 -- 172.21.15.79:0/2736953816 wait complete. 2023-10-14T18:45:20.869 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T18:45:20.871 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T18:45:20.872 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T18:45:20.873 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T18:45:20.875 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T18:45:20.876 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:20.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T18:45:21.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7fd39ca35700 1 Processor -- start 2023-10-14T18:45:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7fd39ca35700 1 -- start start 2023-10-14T18:45:21.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7fb68a21b700 1 Processor -- start 2023-10-14T18:45:21.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7fb68a21b700 1 -- start start 2023-10-14T18:45:21.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7f7e9fb94700 1 Processor -- start 2023-10-14T18:45:21.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.104+0000 7f7e9fb94700 1 -- start start 2023-10-14T18:45:21.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f48f3037700 1 Processor -- start 2023-10-14T18:45:21.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f48f3037700 1 -- start start 2023-10-14T18:45:21.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f3597ba4700 1 Processor -- start 2023-10-14T18:45:21.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd0858b7700 1 Processor -- start 2023-10-14T18:45:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb68406ee90 0x7fb6840cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd39ca35700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd39ca35700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980cc590 con 0x7fd398159dd0 2023-10-14T18:45:21.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd39ca35700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3980cc870 con 0x7fd3980cbfd0 2023-10-14T18:45:21.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd39ca35700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ccb50 con 0x7fd39815db70 2023-10-14T18:45:21.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6840c9580 0x7fb6840c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68415a750 con 0x7fb6840c9580 2023-10-14T18:45:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68415ddc0 con 0x7fb68406ee90 2023-10-14T18:45:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fb68a21b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68415e940 con 0x7fb68406f260 2023-10-14T18:45:21.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f7e9fb94700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f7e9fb94700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e980ac1a0 0x7f7e980ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f7e9fb94700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980acb40 con 0x7f7e9806d4c0 2023-10-14T18:45:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f7e9fb94700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980c7960 con 0x7f7e980ac1a0 2023-10-14T18:45:21.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7f7e9fb94700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c7c40 con 0x7f7e980bf970 2023-10-14T18:45:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.105+0000 7fd0858b7700 1 -- start start 2023-10-14T18:45:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55076/0 (socket says 172.21.15.79:55076) 2023-10-14T18:45:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 -- 172.21.15.79:0/1243815556 learned_addr learned my addr 172.21.15.79:0/1243815556 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55094/0 (socket says 172.21.15.79:55094) 2023-10-14T18:45:21.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 -- 172.21.15.79:0/425017417 learned_addr learned my addr 172.21.15.79:0/425017417 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 -- 172.21.15.79:0/1243815556 >> v1:172.21.15.144:6789/0 conn(0x7fd3980cbfd0 legacy=0x7fd39815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 -- 172.21.15.79:0/1243815556 >> v1:172.21.15.79:6789/0 conn(0x7fd398159dd0 legacy=0x7fd3980c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 -- 172.21.15.79:0/1243815556 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980cce30 con 0x7fd39815db70 2023-10-14T18:45:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f3037700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 0x7f48ec0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f3037700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 0x7f48ec0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f3037700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec06dfd0 con 0x7f48ec159fa0 2023-10-14T18:45:21.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f3037700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec0c80e0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f3037700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c9c60 con 0x7f48ec15a370 2023-10-14T18:45:21.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 -- 172.21.15.79:0/425017417 >> v2:172.21.15.79:3300/0 conn(0x7f7e980ac1a0 msgr2=0x7f7e980ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 --2- 172.21.15.79:0/425017417 >> v2:172.21.15.79:3300/0 conn(0x7f7e980ac1a0 0x7f7e980ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 -- 172.21.15.79:0/425017417 >> v1:172.21.15.79:6789/0 conn(0x7f7e9806d4c0 legacy=0x7f7e9806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f7e9d930700 1 -- 172.21.15.79:0/425017417 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980c7f20 con 0x7f7e980bf970 2023-10-14T18:45:21.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fd395d9b700 1 --2- 172.21.15.79:0/1243815556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3880099e0 tx=0x7fd388009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad827747eac311fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f48f15d4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 0x7f48ec0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48f15d4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 0x7f48ec0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55258/0 (socket says 172.21.15.79:55258) 2023-10-14T18:45:21.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48f15d4700 1 -- 172.21.15.79:0/3283274326 learned_addr learned my addr 172.21.15.79:0/3283274326 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 --2- 172.21.15.79:0/3283274326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 0x7f48ec0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd39559a700 1 -- 172.21.15.79:0/1243815556 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800b820 con 0x7fd39815db70 2023-10-14T18:45:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd0858b7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd08015e1d0 0x7fd080161ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd0858b7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0800a7da0 0x7fd080162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd0858b7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800b0420 con 0x7fd08015e5a0 2023-10-14T18:45:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd0858b7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800b2bf0 con 0x7fd0800a7da0 2023-10-14T18:45:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd0858b7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800b0140 con 0x7fd08015e1d0 2023-10-14T18:45:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd39559a700 1 -- 172.21.15.79:0/1243815556 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800b980 con 0x7fd39815db70 2023-10-14T18:45:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd39559a700 1 -- 172.21.15.79:0/1243815556 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bd20 con 0x7fd39815db70 2023-10-14T18:45:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48eb7fe700 1 -- 172.21.15.79:0/3283274326 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543118763 0 0) 0x7f48ec06dfd0 con 0x7f48ec159fa0 2023-10-14T18:45:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48eb7fe700 1 -- 172.21.15.79:0/3283274326 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d4003570 con 0x7f48ec159fa0 2023-10-14T18:45:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0800a7da0 0x7fd080162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0800a7da0 0x7fd080162430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59520/0 (socket says 172.21.15.79:59520) 2023-10-14T18:45:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07e7fc700 1 -- 172.21.15.79:0/4005953862 learned_addr learned my addr 172.21.15.79:0/4005953862 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07effd700 1 --2- 172.21.15.79:0/4005953862 >> v2:172.21.15.144:3300/0 conn(0x7fd08015e1d0 0x7fd080161ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7f3597ba4700 1 -- start start 2023-10-14T18:45:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3597ba4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35900c75c0 0x7f3590155b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3597ba4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f359006d6b0 0x7f35901560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3597ba4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35901565e0 con 0x7f359006d2e0 2023-10-14T18:45:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3597ba4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35900c8760 con 0x7f359006d6b0 2023-10-14T18:45:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3597ba4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35900af6e0 con 0x7f35900c75c0 2023-10-14T18:45:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 -- 172.21.15.79:0/3283274326 >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 msgr2=0x7f48ec0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 --2- 172.21.15.79:0/3283274326 >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 0x7f48ec0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 -- 172.21.15.79:0/3283274326 >> v1:172.21.15.144:6789/0 conn(0x7f48ec159fa0 legacy=0x7f48ec069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55090/0 (socket says 172.21.15.79:55090) 2023-10-14T18:45:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 -- 172.21.15.79:0/1540453903 learned_addr learned my addr 172.21.15.79:0/1540453903 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb683fff700 1 --2- 172.21.15.79:0/1540453903 >> v2:172.21.15.79:3300/0 conn(0x7fb6840c9580 0x7fb6840c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 -- 172.21.15.79:0/1540453903 >> v2:172.21.15.144:3300/0 conn(0x7fb68406ee90 msgr2=0x7fb6840cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 --2- 172.21.15.79:0/1540453903 >> v2:172.21.15.144:3300/0 conn(0x7fb68406ee90 0x7fb6840cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 -- 172.21.15.79:0/1540453903 >> v2:172.21.15.79:3300/0 conn(0x7fb6840c9580 msgr2=0x7fb6840c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.106+0000 7fb682ffd700 1 --2- 172.21.15.79:0/1540453903 >> v2:172.21.15.79:3300/0 conn(0x7fb6840c9580 0x7fb6840c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fb682ffd700 1 -- 172.21.15.79:0/1540453903 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68415e010 con 0x7fb68406f260 2023-10-14T18:45:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fb682ffd700 1 --2- 172.21.15.79:0/1540453903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb684069840 tx=0x7fb678009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd214af8750048a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f359513f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35900c75c0 0x7f3590155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f359513f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35900c75c0 0x7f3590155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55286/0 (socket says 172.21.15.79:55286) 2023-10-14T18:45:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f359513f700 1 -- 172.21.15.79:0/784817383 learned_addr learned my addr 172.21.15.79:0/784817383 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 -- 172.21.15.79:0/3283274326 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec06f470 con 0x7f48ec15a370 2023-10-14T18:45:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f48ebfff700 1 --2- 172.21.15.79:0/3283274326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 0x7f48ec0c7ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009e60 tx=0x7f48e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c4609d6834a0758 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fb6827fc700 1 -- 172.21.15.79:0/1540453903 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678009e70 con 0x7fb68406f260 2023-10-14T18:45:21.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fb6827fc700 1 -- 172.21.15.79:0/1540453903 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800b860 con 0x7fb68406f260 2023-10-14T18:45:21.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fb6827fc700 1 -- 172.21.15.79:0/1540453903 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800bbe0 con 0x7fb68406f260 2023-10-14T18:45:21.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07e7fc700 1 -- 172.21.15.79:0/4005953862 >> v2:172.21.15.144:3300/0 conn(0x7fd08015e1d0 msgr2=0x7fd080161ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7fd07e7fc700 1 --2- 172.21.15.79:0/4005953862 >> v2:172.21.15.144:3300/0 conn(0x7fd08015e1d0 0x7fd080161ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07e7fc700 1 -- 172.21.15.79:0/4005953862 >> v1:172.21.15.144:6789/0 conn(0x7fd08015e5a0 legacy=0x7fd08006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.107+0000 7f3596141700 1 --2- 172.21.15.79:0/784817383 >> v2:172.21.15.79:3300/0 conn(0x7f359006d6b0 0x7f35901560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07e7fc700 1 -- 172.21.15.79:0/4005953862 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800b2530 con 0x7fd0800a7da0 2023-10-14T18:45:21.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359513f700 1 -- 172.21.15.79:0/784817383 >> v2:172.21.15.79:3300/0 conn(0x7f359006d6b0 msgr2=0x7f35901560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359513f700 1 --2- 172.21.15.79:0/784817383 >> v2:172.21.15.79:3300/0 conn(0x7f359006d6b0 0x7f35901560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359513f700 1 -- 172.21.15.79:0/784817383 >> v1:172.21.15.144:6789/0 conn(0x7f359006d2e0 legacy=0x7f35900c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359513f700 1 -- 172.21.15.79:0/784817383 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900c7b50 con 0x7f35900c75c0 2023-10-14T18:45:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359493e700 1 -- 172.21.15.79:0/784817383 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628265098 0 0) 0x7f3580001110 con 0x7f359006d2e0 2023-10-14T18:45:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 -- 172.21.15.79:0/1243815556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 msgr2=0x7fd3980c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 --2- 172.21.15.79:0/1243815556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd3880099e0 tx=0x7fd388009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07e7fc700 1 --2- 172.21.15.79:0/4005953862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0800a7da0 0x7fd080162430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ac5b0 tx=0x7fd074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a8b35c6c8c957e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 -- 172.21.15.79:0/1243815556 shutdown_connections 2023-10-14T18:45:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 --2- 172.21.15.79:0/1243815556 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd39815db70 0x7fd3980c9710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 -- 172.21.15.79:0/1243815556 >> 172.21.15.79:0/1243815556 conn(0x7fd3980cd1e0 msgr2=0x7fd3980cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 -- 172.21.15.79:0/1243815556 shutdown_connections 2023-10-14T18:45:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359513f700 1 --2- 172.21.15.79:0/784817383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35900c75c0 0x7f3590155b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35900c3890 tx=0x7f358c0082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0ccc707e50d62db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07dffb700 1 -- 172.21.15.79:0/4005953862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074009e70 con 0x7fd0800a7da0 2023-10-14T18:45:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07dffb700 1 -- 172.21.15.79:0/4005953862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400b760 con 0x7fd0800a7da0 2023-10-14T18:45:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd07dffb700 1 -- 172.21.15.79:0/4005953862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400bb00 con 0x7fd0800a7da0 2023-10-14T18:45:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359493e700 1 -- 172.21.15.79:0/784817383 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c010070 con 0x7f35900c75c0 2023-10-14T18:45:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359493e700 1 -- 172.21.15.79:0/784817383 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00da50 con 0x7f35900c75c0 2023-10-14T18:45:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f359493e700 1 -- 172.21.15.79:0/784817383 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00ddf0 con 0x7f35900c75c0 2023-10-14T18:45:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f48eb7fe700 1 -- 172.21.15.79:0/3283274326 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400e070 con 0x7f48ec15a370 2023-10-14T18:45:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f48eb7fe700 1 -- 172.21.15.79:0/3283274326 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400bab0 con 0x7f48ec15a370 2023-10-14T18:45:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7f48eb7fe700 1 -- 172.21.15.79:0/3283274326 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400be50 con 0x7f48ec15a370 2023-10-14T18:45:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fd39ca35700 1 -- 172.21.15.79:0/1243815556 wait complete. 2023-10-14T18:45:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fb68a21b700 1 -- 172.21.15.79:0/1540453903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 msgr2=0x7fb6840cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.108+0000 7fb68a21b700 1 --2- 172.21.15.79:0/1540453903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb684069840 tx=0x7fb678009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f7e9d930700 1 --2- 172.21.15.79:0/425017417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e940099b0 tx=0x7f7e94009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd4b2ff5719ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f7e9c92e700 1 -- 172.21.15.79:0/425017417 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400b8b0 con 0x7f7e980bf970 2023-10-14T18:45:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 -- 172.21.15.79:0/4005953862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0800a7da0 msgr2=0x7fd080162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 --2- 172.21.15.79:0/4005953862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0800a7da0 0x7fd080162430 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0800ac5b0 tx=0x7fd074009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f48f3037700 1 -- 172.21.15.79:0/3283274326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 msgr2=0x7f48ec0c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f48f3037700 1 --2- 172.21.15.79:0/3283274326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 0x7f48ec0c7ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009e60 tx=0x7f48e4009780 comp rx=0 tx=0).stop 2023-10-14T18:45:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 -- 172.21.15.79:0/4005953862 shutdown_connections 2023-10-14T18:45:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 --2- 172.21.15.79:0/4005953862 >> v2:172.21.15.144:3300/0 conn(0x7fd08015e1d0 0x7fd080161ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 --2- 172.21.15.79:0/4005953862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0800a7da0 0x7fd080162430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 -- 172.21.15.79:0/4005953862 >> 172.21.15.79:0/4005953862 conn(0x7fd0800cd1e0 msgr2=0x7fd0800cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 -- 172.21.15.79:0/4005953862 shutdown_connections 2023-10-14T18:45:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fd0858b7700 1 -- 172.21.15.79:0/4005953862 wait complete. 2023-10-14T18:45:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 -- 172.21.15.79:0/784817383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35900c75c0 msgr2=0x7f3590155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 --2- 172.21.15.79:0/784817383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35900c75c0 0x7f3590155b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35900c3890 tx=0x7f358c0082d0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 -- 172.21.15.79:0/784817383 shutdown_connections 2023-10-14T18:45:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 --2- 172.21.15.79:0/784817383 >> v2:172.21.15.79:3300/0 conn(0x7f359006d6b0 0x7f35901560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 --2- 172.21.15.79:0/784817383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35900c75c0 0x7f3590155b60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f3597ba4700 1 -- 172.21.15.79:0/784817383 >> 172.21.15.79:0/784817383 conn(0x7f3590070700 msgr2=0x7f3590070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fb68a21b700 1 -- 172.21.15.79:0/1540453903 shutdown_connections 2023-10-14T18:45:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fb68a21b700 1 --2- 172.21.15.79:0/1540453903 >> v2:172.21.15.79:3300/0 conn(0x7fb6840c9580 0x7fb6840c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fb68a21b700 1 --2- 172.21.15.79:0/1540453903 >> v2:172.21.15.144:3300/0 conn(0x7fb68406ee90 0x7fb6840cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fb68a21b700 1 --2- 172.21.15.79:0/1540453903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb6840cd200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7fb68a21b700 1 -- 172.21.15.79:0/1540453903 >> 172.21.15.79:0/1540453903 conn(0x7fb684070700 msgr2=0x7fb684070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7fb68a21b700 1 -- 172.21.15.79:0/1540453903 shutdown_connections 2023-10-14T18:45:21.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7fb68a21b700 1 -- 172.21.15.79:0/1540453903 wait complete. 2023-10-14T18:45:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7fd39ca35700 1 Processor -- start 2023-10-14T18:45:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f7e9c92e700 1 -- 172.21.15.79:0/425017417 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9400ba10 con 0x7f7e980bf970 2023-10-14T18:45:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.109+0000 7f7e9c92e700 1 -- 172.21.15.79:0/425017417 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400bdb0 con 0x7f7e980bf970 2023-10-14T18:45:21.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 -- 172.21.15.79:0/425017417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 msgr2=0x7f7e980bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/425017417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e940099b0 tx=0x7f7e94009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7fd39ca35700 1 -- start start 2023-10-14T18:45:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f3597ba4700 1 -- 172.21.15.79:0/784817383 shutdown_connections 2023-10-14T18:45:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 -- 172.21.15.79:0/425017417 shutdown_connections 2023-10-14T18:45:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/425017417 >> v2:172.21.15.79:3300/0 conn(0x7f7e980ac1a0 0x7f7e980ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/425017417 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980bf970 0x7f7e980bfd40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 -- 172.21.15.79:0/425017417 >> 172.21.15.79:0/425017417 conn(0x7f7e98067660 msgr2=0x7f7e98067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f3597ba4700 1 -- 172.21.15.79:0/784817383 wait complete. 2023-10-14T18:45:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 -- 172.21.15.79:0/425017417 shutdown_connections 2023-10-14T18:45:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.110+0000 7f7e9fb94700 1 -- 172.21.15.79:0/425017417 wait complete. 2023-10-14T18:45:21.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3980cbfd0 0x7fd3980c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd398159dd0 0x7fd398157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c70a0 con 0x7fd3980cbfd0 2023-10-14T18:45:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b0890 con 0x7fd39815db70 2023-10-14T18:45:21.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd39ca35700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b2950 con 0x7fd398159dd0 2023-10-14T18:45:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd396d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd0858b7700 1 Processor -- start 2023-10-14T18:45:21.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd396d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55290/0 (socket says 172.21.15.79:55290) 2023-10-14T18:45:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd396d9d700 1 -- 172.21.15.79:0/2977531555 learned_addr learned my addr 172.21.15.79:0/2977531555 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7f48f3037700 1 -- 172.21.15.79:0/3283274326 shutdown_connections 2023-10-14T18:45:21.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7f48f3037700 1 --2- 172.21.15.79:0/3283274326 >> v2:172.21.15.144:3300/0 conn(0x7f48ec0c92a0 0x7f48ec0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7f48f3037700 1 --2- 172.21.15.79:0/3283274326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec15a370 0x7f48ec0c7ba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7f48f3037700 1 -- 172.21.15.79:0/3283274326 >> 172.21.15.79:0/3283274326 conn(0x7f48ec067660 msgr2=0x7f48ec067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fb68a21b700 1 Processor -- start 2023-10-14T18:45:21.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7f3597ba4700 1 Processor -- start 2023-10-14T18:45:21.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd39659c700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3980cbfd0 0x7fd3980c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f48f3037700 1 -- 172.21.15.79:0/3283274326 shutdown_connections 2023-10-14T18:45:21.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f7e9fb94700 1 Processor -- start 2023-10-14T18:45:21.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 -- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd398159dd0 msgr2=0x7fd398157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd398159dd0 0x7fd398157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 -- 172.21.15.79:0/2977531555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3980cbfd0 msgr2=0x7fd3980c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3980cbfd0 0x7fd3980c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 -- 172.21.15.79:0/2977531555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880094f0 con 0x7fd39815db70 2023-10-14T18:45:21.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f7e9fb94700 1 -- start start 2023-10-14T18:45:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f3597ba4700 1 -- start start 2023-10-14T18:45:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fb68a21b700 1 -- start start 2023-10-14T18:45:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.111+0000 7fd0858b7700 1 -- start start 2023-10-14T18:45:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f4df3540700 1 Processor -- start 2023-10-14T18:45:21.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f4df3540700 1 -- start start 2023-10-14T18:45:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd396d9d700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c820 tx=0x7fd390001630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7f9d3016f700 1 Processor -- start 2023-10-14T18:45:21.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 0x7fd08015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 0x7fd080160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080156ef0 con 0x7fd08015e1d0 2023-10-14T18:45:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800ace40 con 0x7fd08015e5a0 2023-10-14T18:45:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd0858b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800acb40 con 0x7fd0800a7da0 2023-10-14T18:45:21.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.112+0000 7fd07effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55114/0 (socket says 172.21.15.79:55114) 2023-10-14T18:45:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07effd700 1 -- 172.21.15.79:0/1133192361 learned_addr learned my addr 172.21.15.79:0/1133192361 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68406ee90 0x7fb68415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6840c9580 0x7fb6840c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07e7fc700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 0x7fd08015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 0x7fd080160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841585f0 con 0x7fb68406ee90 2023-10-14T18:45:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c55c0 con 0x7fb6840c9580 2023-10-14T18:45:21.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb68a21b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb684158030 con 0x7fb68406f260 2023-10-14T18:45:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 0x7f35900c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 0x7f35900c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35900c75c0 0x7f35900c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35900c4e30 con 0x7f35900c75c0 2023-10-14T18:45:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35900c5c50 con 0x7f359006d2e0 2023-10-14T18:45:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3597ba4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35900c5040 con 0x7f359006d6b0 2023-10-14T18:45:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f359513f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 0x7f35900c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f359513f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 0x7f35900c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55120/0 (socket says 172.21.15.79:55120) 2023-10-14T18:45:21.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f359513f700 1 -- 172.21.15.79:0/599495463 learned_addr learned my addr 172.21.15.79:0/599495463 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb682ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb6837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68406ee90 0x7fb68415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb682ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55132/0 (socket says 172.21.15.79:55132) 2023-10-14T18:45:21.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb682ffd700 1 -- 172.21.15.79:0/411674384 learned_addr learned my addr 172.21.15.79:0/411674384 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 0x7f7e980c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 0x7f7e980afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e980bf970 0x7f7e980b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c0af0 con 0x7f7e9806d4c0 2023-10-14T18:45:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c5a80 con 0x7f7e980bf970 2023-10-14T18:45:21.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9fb94700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9815c040 con 0x7f7e980ac1a0 2023-10-14T18:45:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f3595940700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 0x7f35900c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df3540700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4dec0cd3a0 0x7f4dec0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df3540700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4dec0afc20 0x7f4dec0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df3540700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b0380 con 0x7f4dec0bfbe0 2023-10-14T18:45:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df3540700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec15e9c0 con 0x7f4dec0afc20 2023-10-14T18:45:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df3540700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0b0660 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fb683fff700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6840c9580 0x7fb6840c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9e131700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e980bf970 0x7f7e980b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9d930700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 0x7f7e980c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9d930700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 0x7f7e980c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59564/0 (socket says 172.21.15.79:59564) 2023-10-14T18:45:21.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f7e9d930700 1 -- 172.21.15.79:0/3864558214 learned_addr learned my addr 172.21.15.79:0/3864558214 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 0x7f7e980afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df12dc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4dec0bfbe0 0x7f4dec0ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:48416/0 (socket says 172.21.15.79:48416) 2023-10-14T18:45:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df12dc700 1 -- 172.21.15.79:0/1400979880 learned_addr learned my addr 172.21.15.79:0/1400979880 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:21.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f4df0adb700 1 --2- 172.21.15.79:0/1400979880 >> v2:172.21.15.144:3300/0 conn(0x7f4dec0cd3a0 0x7f4dec0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 -- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 msgr2=0x7fd0801569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 -- 172.21.15.79:0/1133192361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 msgr2=0x7fd08015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 0x7fd08015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07f7fe700 1 -- 172.21.15.79:0/1133192361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740094f0 con 0x7fd08015e5a0 2023-10-14T18:45:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07effd700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7fd07e7fc700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 0x7fd08015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:21.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f9d3016f700 1 -- start start 2023-10-14T18:45:21.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd07f7fe700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 0x7fd080160ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c960 tx=0x7fd078001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 -- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6840c9580 msgr2=0x7fb6840c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6840c9580 0x7fb6840c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 -- 172.21.15.79:0/411674384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68406ee90 msgr2=0x7fb68415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68406ee90 0x7fb68415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328966290 0 0) 0x7f4dec0b0380 con 0x7f4dec0bfbe0 2023-10-14T18:45:21.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003570 con 0x7f4dec0bfbe0 2023-10-14T18:45:21.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.113+0000 7f48f3037700 1 -- 172.21.15.79:0/3283274326 wait complete. 2023-10-14T18:45:21.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 -- 172.21.15.79:0/411674384 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780094f0 con 0x7fb68406f260 2023-10-14T18:45:21.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb682ffd700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6780090b0 tx=0x7fb678017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d2806d4c0 0x7f9d2806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280c7960 con 0x7f9d2806d4c0 2023-10-14T18:45:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d280c7c40 con 0x7f9d2806f1a0 2023-10-14T18:45:21.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d3016f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c7f20 con 0x7f9d280bf970 2023-10-14T18:45:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3596141700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35900c75c0 0x7f35900c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 -- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 msgr2=0x7f35900c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 0x7f35900c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 -- 172.21.15.79:0/599495463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35900c75c0 msgr2=0x7f35900c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35900c75c0 0x7f35900c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 -- 172.21.15.79:0/599495463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c008570 con 0x7f359006d2e0 2023-10-14T18:45:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012630 con 0x7fd08015e5a0 2023-10-14T18:45:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0780127b0 con 0x7fd08015e5a0 2023-10-14T18:45:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08015fc90 con 0x7fd08015e5a0 2023-10-14T18:45:21.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d2df0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012b70 con 0x7fd08015e5a0 2023-10-14T18:45:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 -- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e980bf970 msgr2=0x7f7e980b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e980bf970 0x7f7e980b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 -- 172.21.15.79:0/3864558214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 msgr2=0x7f7e980c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 0x7f7e980c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd080160250 con 0x7fd08015e5a0 2023-10-14T18:45:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f7e9d12f700 1 -- 172.21.15.79:0/3864558214 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940094f0 con 0x7f7e980ac1a0 2023-10-14T18:45:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d2e70c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d2e70c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55366/0 (socket says 172.21.15.79:55366) 2023-10-14T18:45:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f9d2e70c700 1 -- 172.21.15.79:0/3725428965 learned_addr learned my addr 172.21.15.79:0/3725428965 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800b9d0 con 0x7fb68406f260 2023-10-14T18:45:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800bb30 con 0x7fb68406f260 2023-10-14T18:45:21.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67801a6a0 con 0x7fb68406f260 2023-10-14T18:45:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f3595940700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 0x7f35900c48f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f358000c510 tx=0x7f3580007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e9d12f700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 0x7f7e980afd20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800b5e0 tx=0x7f7e880090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011590 con 0x7f359006d2e0 2023-10-14T18:45:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580011710 con 0x7f359006d2e0 2023-10-14T18:45:21.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580011ad0 con 0x7f359006d2e0 2023-10-14T18:45:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f48f3037700 1 Processor -- start 2023-10-14T18:45:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb684158310 con 0x7fb68406f260 2023-10-14T18:45:21.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840c5ad0 con 0x7fb68406f260 2023-10-14T18:45:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0800acff0 con 0x7fd08015e5a0 2023-10-14T18:45:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 -- 172.21.15.79:0/3725428965 >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 msgr2=0x7f9d280ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/3725428965 >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 -- 172.21.15.79:0/3725428965 >> v2:172.21.15.79:3300/0 conn(0x7f9d2806d4c0 msgr2=0x7f9d2806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/3725428965 >> v2:172.21.15.79:3300/0 conn(0x7f9d2806d4c0 0x7f9d2806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 -- 172.21.15.79:0/3725428965 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280c8200 con 0x7f9d280bf970 2023-10-14T18:45:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2e70c700 1 --2- 172.21.15.79:0/3725428965 >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:21.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/3725428965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280bfd40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d2806ebb0 tx=0x7f9d20009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a3fba98b30d01f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800f510 con 0x7f7e980ac1a0 2023-10-14T18:45:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8800f690 con 0x7f7e980ac1a0 2023-10-14T18:45:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800fa50 con 0x7f7e980ac1a0 2023-10-14T18:45:21.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c0810 con 0x7f7e980ac1a0 2023-10-14T18:45:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e981496d0 con 0x7f7e980ac1a0 2023-10-14T18:45:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f9d2cf09700 1 -- 172.21.15.79:0/3725428965 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000e070 con 0x7f9d280bf970 2023-10-14T18:45:21.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f9d2cf09700 1 -- 172.21.15.79:0/3725428965 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000bbf0 con 0x7f9d280bf970 2023-10-14T18:45:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f9d2cf09700 1 -- 172.21.15.79:0/3725428965 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20012430 con 0x7f9d280bf970 2023-10-14T18:45:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840ab6d0 con 0x7fb68406f260 2023-10-14T18:45:21.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb67801aa50 con 0x7fb68406f260 2023-10-14T18:45:21.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df1add700 1 --2- 172.21.15.79:0/1400979880 >> v2:172.21.15.79:3300/0 conn(0x7f4dec0afc20 0x7f4dec0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289925826 0 0) 0x7f4dd8003570 con 0x7f4dec0bfbe0 2023-10-14T18:45:21.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df0adb700 1 -- 172.21.15.79:0/1400979880 >> v2:172.21.15.79:3300/0 conn(0x7f4dec0afc20 msgr2=0x7f4dec0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df0adb700 1 --2- 172.21.15.79:0/1400979880 >> v2:172.21.15.79:3300/0 conn(0x7f4dec0afc20 0x7f4dec0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df0adb700 1 -- 172.21.15.79:0/1400979880 >> v1:172.21.15.144:6789/0 conn(0x7f4dec0bfbe0 legacy=0x7f4dec0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df0adb700 1 -- 172.21.15.79:0/1400979880 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0b0940 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.114+0000 7f4df0adb700 1 --2- 172.21.15.79:0/1400979880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec0af6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4dec071230 tx=0x7f4ddc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7256201b1f561ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40017f0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc011420 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f4de3fff700 1 -- 172.21.15.79:0/1400979880 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0117c0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f4df3540700 1 -- 172.21.15.79:0/1400979880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0cd3a0 msgr2=0x7f4dec0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f4df3540700 1 --2- 172.21.15.79:0/1400979880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec0af6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4dec071230 tx=0x7f4ddc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35900c5320 con 0x7f359006d2e0 2023-10-14T18:45:21.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35900c58e0 con 0x7f359006d2e0 2023-10-14T18:45:21.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390012630 con 0x7fd39815db70 2023-10-14T18:45:21.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.115+0000 7f48f3037700 1 -- start start 2023-10-14T18:45:21.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 0x7f48ec0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 0x7f48ec16ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 0x7f48ec0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c52f0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c5e30 con 0x7f48ec15a370 2023-10-14T18:45:21.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.116+0000 7f48f3037700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec16e310 con 0x7f48ec159fa0 2023-10-14T18:45:21.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 0x7f48ec16ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 0x7f48ec16ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55158/0 (socket says 172.21.15.79:55158) 2023-10-14T18:45:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48ebfff700 1 -- 172.21.15.79:0/3717337523 learned_addr learned my addr 172.21.15.79:0/3717337523 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 0x7f48ec0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f15d4700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 0x7f48ec0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 -- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 msgr2=0x7f48ec16ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 0x7f48ec16ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 -- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 msgr2=0x7f48ec0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 0x7f48ec0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f0dd3700 1 -- 172.21.15.79:0/3717337523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009a20 con 0x7f48ec0c92a0 2023-10-14T18:45:21.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f48f15d4700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 0x7f48ec0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:21.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390012790 con 0x7fd39815db70 2023-10-14T18:45:21.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3981576a0 con 0x7fd39815db70 2023-10-14T18:45:21.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e8801a400 con 0x7f7e980ac1a0 2023-10-14T18:45:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f7e8dffb700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 0x7f7e7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9804c3c0 con 0x7f7e980ac1a0 2023-10-14T18:45:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd078003030 con 0x7fd08015e5a0 2023-10-14T18:45:21.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd066ffd700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 0x7fd06c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd078084590 con 0x7fd08015e5a0 2023-10-14T18:45:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48f0dd3700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 0x7f48ec0af6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c560 tx=0x7f48e0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e88083e30 con 0x7f7e980ac1a0 2023-10-14T18:45:21.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f4df3540700 1 -- 172.21.15.79:0/1400979880 shutdown_connections 2023-10-14T18:45:21.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f4df3540700 1 --2- 172.21.15.79:0/1400979880 >> v2:172.21.15.79:3300/0 conn(0x7f4dec0afc20 0x7f4dec0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f4df3540700 1 --2- 172.21.15.79:0/1400979880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec0af6e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f4df3540700 1 -- 172.21.15.79:0/1400979880 >> 172.21.15.79:0/1400979880 conn(0x7f4dec070700 msgr2=0x7f4dec070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00335a0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7fd07effd700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 0x7fd06c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f9d3016f700 1 -- 172.21.15.79:0/3725428965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 msgr2=0x7f9d280bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7f9d3016f700 1 --2- 172.21.15.79:0/3725428965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280bfd40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d2806ebb0 tx=0x7f9d20009780 comp rx=0 tx=0).stop 2023-10-14T18:45:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec0afd30 con 0x7f48ec0c92a0 2023-10-14T18:45:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec0c6850 con 0x7f48ec0c92a0 2023-10-14T18:45:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7fb66b7fe700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb678085b70 con 0x7fb68406f260 2023-10-14T18:45:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7fb6837fe700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359004c3c0 con 0x7f359006d2e0 2023-10-14T18:45:21.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f9d3016f700 1 -- 172.21.15.79:0/3725428965 shutdown_connections 2023-10-14T18:45:21.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f9d3016f700 1 --2- 172.21.15.79:0/3725428965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280bfd40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f9d3016f700 1 --2- 172.21.15.79:0/3725428965 >> v2:172.21.15.144:3300/0 conn(0x7f9d2806f1a0 0x7f9d280ac1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f9d3016f700 1 --2- 172.21.15.79:0/3725428965 >> v2:172.21.15.79:3300/0 conn(0x7f9d2806d4c0 0x7f9d2806ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f9d3016f700 1 -- 172.21.15.79:0/3725428965 >> 172.21.15.79:0/3725428965 conn(0x7f9d28067660 msgr2=0x7f9d28067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0033700 con 0x7f48ec0c92a0 2023-10-14T18:45:21.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0033ac0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.117+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980b0dc0 con 0x7fd39815db70 2023-10-14T18:45:21.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.118+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390012b10 con 0x7fd39815db70 2023-10-14T18:45:21.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7f9d3016f700 1 -- 172.21.15.79:0/3725428965 shutdown_connections 2023-10-14T18:45:21.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7f9d3016f700 1 -- 172.21.15.79:0/3725428965 wait complete. 2023-10-14T18:45:21.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7f4df3540700 1 -- 172.21.15.79:0/1400979880 shutdown_connections 2023-10-14T18:45:21.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7f4df3540700 1 -- 172.21.15.79:0/1400979880 wait complete. 2023-10-14T18:45:21.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7fd07effd700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 0x7fd06c069460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd070009e40 tx=0x7fd070008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7f7e9d930700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 0x7f7e7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7fb6837fe700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb674009b40 tx=0x7fb6740090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.119+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c0052b0 con 0x7fd39815db70 2023-10-14T18:45:21.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f7e9d930700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 0x7f7e7c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e94003080 tx=0x7f7e94016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc0052b0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48e003e460 con 0x7f48ec0c92a0 2023-10-14T18:45:21.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f48e8ff9700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 0x7f48d80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f9d3016f700 1 Processor -- start 2023-10-14T18:45:21.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f9d3016f700 1 -- start start 2023-10-14T18:45:21.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48e00a5fb0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f4df3540700 1 Processor -- start 2023-10-14T18:45:21.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f48ebfff700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 0x7f48d80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.120+0000 7f4df3540700 1 -- start start 2023-10-14T18:45:21.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f48ebfff700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 0x7f48d80694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48ec158bf0 tx=0x7f48e4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 0x7f4dec0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 0x7f4dec16e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1508e0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0ad080 con 0x7f4dec0afc20 2023-10-14T18:45:21.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f4df3540700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0ac470 con 0x7f4dec0bfbe0 2023-10-14T18:45:21.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2806d4c0 0x7f9d2815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c0dc0 con 0x7f9d2806f1a0 2023-10-14T18:45:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c30f0 con 0x7f9d2806d4c0 2023-10-14T18:45:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.121+0000 7f9d3016f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d280c0490 con 0x7f9d280bf970 2023-10-14T18:45:21.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df12dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 0x7f4dec0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59584/0 (socket says 172.21.15.79:59584) 2023-10-14T18:45:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 -- 172.21.15.79:0/2849542724 learned_addr learned my addr 172.21.15.79:0/2849542724 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df0adb700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 0x7f4dec16e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59598/0 (socket says 172.21.15.79:59598) 2023-10-14T18:45:21.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 -- 172.21.15.79:0/2414409232 learned_addr learned my addr 172.21.15.79:0/2414409232 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:21.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2806d4c0 0x7f9d2815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2e70c700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 -- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 msgr2=0x7f9d280c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 -- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2806d4c0 msgr2=0x7f9d2815bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2806d4c0 0x7f9d2815bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 -- 172.21.15.79:0/2414409232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240094f0 con 0x7f9d2806f1a0 2023-10-14T18:45:21.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 -- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 msgr2=0x7f4dec16e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 0x7f4dec16e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 -- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 msgr2=0x7f4dec0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 0x7f4dec0abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 -- 172.21.15.79:0/2849542724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc009420 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0800acff0 con 0x7fd08015e5a0 2023-10-14T18:45:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df12dc700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 0x7f4dec0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:21.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df0adb700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 0x7f4dec16e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f9d2d70a700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b810 tx=0x7f9d18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.122+0000 7f4df1add700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4de800d8c0 tx=0x7f4de8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.123+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f358001b3b0 con 0x7f359006d2e0 2023-10-14T18:45:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.123+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb678052d40 con 0x7fb68406f260 2023-10-14T18:45:21.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7f3585ffb700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 0x7f35740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd390003030 con 0x7fd39815db70 2023-10-14T18:45:21.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3580083b80 con 0x7f359006d2e0 2023-10-14T18:45:21.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7f359513f700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 0x7f35740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7fd3867fc700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 0x7fd3780694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd390084b40 con 0x7fd39815db70 2023-10-14T18:45:21.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.124+0000 7fd39659c700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 0x7fd3780694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f359513f700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 0x7f35740693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35900b29c0 tx=0x7f358c01c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7fd39659c700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 0x7fd3780694b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006fd0 tx=0x7fd38c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80125f0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800f510 con 0x7f9d2806f1a0 2023-10-14T18:45:21.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec0ac750 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8012770 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d20009a20 con 0x7f9d2806f1a0 2023-10-14T18:45:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800f690 con 0x7f9d2806f1a0 2023-10-14T18:45:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8012b30 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.126+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec0acd10 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.125+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800fa50 con 0x7f9d2806f1a0 2023-10-14T18:45:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.126+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d280c0a50 con 0x7f9d2806f1a0 2023-10-14T18:45:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.127+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48e00732a0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.127+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec0ad210 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.127+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2804c3c0 con 0x7f9d2806f1a0 2023-10-14T18:45:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.128+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e88054bb0 con 0x7f7e980ac1a0 2023-10-14T18:45:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.128+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3580050e70 con 0x7f359006d2e0 2023-10-14T18:45:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.129+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4de801e460 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.129+0000 7f4de17fa700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 0x7f4dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.129+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4de8085550 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.129+0000 7f4df12dc700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 0x7f4dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.130+0000 7f4df12dc700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 0x7f4dd00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007fd0 tx=0x7f4de4000f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.132+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd390051f10 con 0x7fd39815db70 2023-10-14T18:45:21.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.140+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d18024430 con 0x7f9d2806f1a0 2023-10-14T18:45:21.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.140+0000 7f9d1dffb700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 0x7f9d0c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:21.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.140+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d18084c90 con 0x7f9d2806f1a0 2023-10-14T18:45:21.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.140+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 0x7f9d0c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:21.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.141+0000 7f9d2df0b700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 0x7f9d0c069460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009fd0 tx=0x7f9d20019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.141+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de80562b0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.148+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d18051f60 con 0x7f9d2806f1a0 2023-10-14T18:45:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.500+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd0800acff0 con 0x7fd08015e5a0 2023-10-14T18:45:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.500+0000 7fd066ffd700 1 -- 172.21.15.79:0/1133192361 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0800acff0 con 0x7fd08015e5a0 2023-10-14T18:45:21.504 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 msgr2=0x7fd06c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 0x7fd06c069460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd070009e40 tx=0x7fd070008040 comp rx=0 tx=0).stop 2023-10-14T18:45:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 msgr2=0x7fd080160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 0x7fd080160ad0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c960 tx=0x7fd078001710 comp rx=0 tx=0).stop 2023-10-14T18:45:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 shutdown_connections 2023-10-14T18:45:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd06c066fb0 0x7fd06c069460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd08015e5a0 0x7fd080160ad0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd0800a7da0 0x7fd0801569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 --2- 172.21.15.79:0/1133192361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08015e1d0 0x7fd08015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.504+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 >> 172.21.15.79:0/1133192361 conn(0x7fd0800cd1e0 msgr2=0x7fd08006a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.505+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 shutdown_connections 2023-10-14T18:45:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.505+0000 7fd0858b7700 1 -- 172.21.15.79:0/1133192361 wait complete. 2023-10-14T18:45:21.514 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.510+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6840c5cf0 con 0x7fb68406f260 2023-10-14T18:45:21.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.512+0000 7fb66b7fe700 1 -- 172.21.15.79:0/411674384 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb678015020 con 0x7fb68406f260 2023-10-14T18:45:21.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.514+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 msgr2=0x7fb6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.514+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 0x7fb6700693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb674009b40 tx=0x7fb6740090f0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.514+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 msgr2=0x7fb684145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.514+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb6780090b0 tx=0x7fb678017000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 shutdown_connections 2023-10-14T18:45:21.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb670066f30 0x7fb6700693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6840c9580 0x7fb6840c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb68406ee90 0x7fb68415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 --2- 172.21.15.79:0/411674384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb68406f260 0x7fb684145c10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 >> 172.21.15.79:0/411674384 conn(0x7fb684070700 msgr2=0x7fb684159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 shutdown_connections 2023-10-14T18:45:21.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7fb68a21b700 1 -- 172.21.15.79:0/411674384 wait complete. 2023-10-14T18:45:21.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.515+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48cc005830 con 0x7f48ec0c92a0 2023-10-14T18:45:21.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.516+0000 7f48e8ff9700 1 -- 172.21.15.79:0/3717337523 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48e00768c0 con 0x7f48ec0c92a0 2023-10-14T18:45:21.519 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 msgr2=0x7f48d80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 0x7f48d80694b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48ec158bf0 tx=0x7f48e4019000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 msgr2=0x7f48ec0af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 0x7f48ec0af6c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c560 tx=0x7f48e0007d50 comp rx=0 tx=0).stop 2023-10-14T18:45:21.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 shutdown_connections 2023-10-14T18:45:21.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48d8067000 0x7f48d80694b0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48ec158bf0 tx=0x7f48e4019000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48ec15a370 0x7f48ec0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48ec0c92a0 0x7f48ec0af6c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 --2- 172.21.15.79:0/3717337523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48ec159fa0 0x7f48ec16ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.518+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 >> 172.21.15.79:0/3717337523 conn(0x7f48ec067660 msgr2=0x7f48ec1580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.519+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7e980c5bc0 con 0x7f7e980ac1a0 2023-10-14T18:45:21.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.519+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 shutdown_connections 2023-10-14T18:45:21.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.519+0000 7f48f3037700 1 -- 172.21.15.79:0/3717337523 wait complete. 2023-10-14T18:45:21.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.519+0000 7f7e8dffb700 1 -- 172.21.15.79:0/3864558214 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e88054740 con 0x7f7e980ac1a0 2023-10-14T18:45:21.526 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.519+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd37c005830 con 0x7fd39815db70 2023-10-14T18:45:21.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.520+0000 7fd3867fc700 1 -- 172.21.15.79:0/2977531555 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd390055530 con 0x7fd39815db70 2023-10-14T18:45:21.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.521+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4dec04c3c0 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.521+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f35901565e0 con 0x7f359006d2e0 2023-10-14T18:45:21.528 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.529 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.521+0000 7f4de17fa700 1 -- 172.21.15.79:0/2849542724 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4de8055e40 con 0x7f4dec0cd3a0 2023-10-14T18:45:21.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.521+0000 7f3585ffb700 1 -- 172.21.15.79:0/599495463 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35901565e0 con 0x7f359006d2e0 2023-10-14T18:45:21.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 msgr2=0x7fd3780694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 0x7fd3780694b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006fd0 tx=0x7fd38c008040 comp rx=0 tx=0).stop 2023-10-14T18:45:21.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 msgr2=0x7fd3980c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c820 tx=0x7fd390001630 comp rx=0 tx=0).stop 2023-10-14T18:45:21.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 shutdown_connections 2023-10-14T18:45:21.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd378067000 0x7fd3780694b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd39815db70 0x7fd3980c4eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3980cbfd0 0x7fd3980c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 --2- 172.21.15.79:0/2977531555 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd398159dd0 0x7fd398157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 >> 172.21.15.79:0/2977531555 conn(0x7fd3980cd1e0 msgr2=0x7fd3981582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 shutdown_connections 2023-10-14T18:45:21.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7fd39ca35700 1 -- 172.21.15.79:0/2977531555 wait complete. 2023-10-14T18:45:21.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 msgr2=0x7f4dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 0x7f4dd00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007fd0 tx=0x7f4de4000f40 comp rx=0 tx=0).stop 2023-10-14T18:45:21.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 msgr2=0x7f4dec171fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4de800d8c0 tx=0x7f4de8008040 comp rx=0 tx=0).stop 2023-10-14T18:45:21.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 shutdown_connections 2023-10-14T18:45:21.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dd0066f30 0x7f4dd00693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4dec0cd3a0 0x7f4dec171fb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec0afc20 0x7f4dec0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 --2- 172.21.15.79:0/2849542724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dec0bfbe0 0x7f4dec16e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.524+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 >> 172.21.15.79:0/2849542724 conn(0x7f4dec070700 msgr2=0x7f4dec0c0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.525+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 shutdown_connections 2023-10-14T18:45:21.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.525+0000 7f4df3540700 1 -- 172.21.15.79:0/2849542724 wait complete. 2023-10-14T18:45:21.536 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-14T18:45:21.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 msgr2=0x7f7e7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 0x7f7e7c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e94003080 tx=0x7f7e94016000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 msgr2=0x7f7e980afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 0x7f7e980afd20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800b5e0 tx=0x7f7e880090f0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 shutdown_connections 2023-10-14T18:45:21.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e7c066f30 0x7f7e7c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e980bf970 0x7f7e980b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9806d4c0 0x7f7e980c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 --2- 172.21.15.79:0/3864558214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e980ac1a0 0x7f7e980afd20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 >> 172.21.15.79:0/3864558214 conn(0x7f7e98067660 msgr2=0x7f7e980ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.526+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 shutdown_connections 2023-10-14T18:45:21.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f7e9fb94700 1 -- 172.21.15.79:0/3864558214 wait complete. 2023-10-14T18:45:21.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 msgr2=0x7f35740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 0x7f35740693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f35900b29c0 tx=0x7f358c01c000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 msgr2=0x7f35900c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 0x7f35900c48f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f358000c510 tx=0x7f3580007ec0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 shutdown_connections 2023-10-14T18:45:21.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3574066f30 0x7f35740693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35900c75c0 0x7f35900c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f359006d2e0 0x7f35900c48f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 --2- 172.21.15.79:0/599495463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f359006d6b0 0x7f35900c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 >> 172.21.15.79:0/599495463 conn(0x7f3590070700 msgr2=0x7f3590158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 shutdown_connections 2023-10-14T18:45:21.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.527+0000 7f3597ba4700 1 -- 172.21.15.79:0/599495463 wait complete. 2023-10-14T18:45:21.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-14T18:45:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.541+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9d280c0f00 con 0x7f9d2806f1a0 2023-10-14T18:45:21.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.544+0000 7f9d1dffb700 1 -- 172.21.15.79:0/2414409232 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d18055580 con 0x7f9d2806f1a0 2023-10-14T18:45:21.546 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2023-10-14T18:45:21.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-14T18:45:21.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 msgr2=0x7f9d0c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 0x7f9d0c069460 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009fd0 tx=0x7f9d20019000 comp rx=0 tx=0).stop 2023-10-14T18:45:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 msgr2=0x7f9d280b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b810 tx=0x7f9d18009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 shutdown_connections 2023-10-14T18:45:21.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d0c066fb0 0x7f9d0c069460 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d280bf970 0x7f9d280c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2806d4c0 0x7f9d2815bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 --2- 172.21.15.79:0/2414409232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d2806f1a0 0x7f9d280b0a70 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b810 tx=0x7f9d18009250 comp rx=0 tx=0).stop 2023-10-14T18:45:21.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 >> 172.21.15.79:0/2414409232 conn(0x7f9d28067660 msgr2=0x7f9d28067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:21.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-14T18:45:21.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 shutdown_connections 2023-10-14T18:45:21.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:21.548+0000 7f9d3016f700 1 -- 172.21.15.79:0/2414409232 wait complete. 2023-10-14T18:45:21.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-10-14T18:45:21.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-14T18:45:21.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-14T18:45:21.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T18:45:22.538 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T18:45:22.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T18:45:22.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T18:45:22.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T18:45:22.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T18:45:22.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T18:45:22.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T18:45:22.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T18:45:22.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.710+0000 7f21ed89a700 1 Processor -- start 2023-10-14T18:45:22.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.710+0000 7f21ed89a700 1 -- start start 2023-10-14T18:45:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21ed89a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21ed89a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21e80ccec0 0x7f21e80afe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21ed89a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e80c6eb0 con 0x7f21e80ccaf0 2023-10-14T18:45:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21ed89a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80b1270 con 0x7f21e80ccec0 2023-10-14T18:45:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21ed89a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80b0390 con 0x7f21e8088ac0 2023-10-14T18:45:22.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.711+0000 7f21e67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55172/0 (socket says 172.21.15.79:55172) 2023-10-14T18:45:22.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 -- 172.21.15.79:0/4200626607 learned_addr learned my addr 172.21.15.79:0/4200626607 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 -- 172.21.15.79:0/4200626607 >> v2:172.21.15.79:3300/0 conn(0x7f21e80ccec0 msgr2=0x7f21e80afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 --2- 172.21.15.79:0/4200626607 >> v2:172.21.15.79:3300/0 conn(0x7f21e80ccec0 0x7f21e80afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 -- 172.21.15.79:0/4200626607 >> v1:172.21.15.79:6789/0 conn(0x7f21e80ccaf0 legacy=0x7f21e80883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 -- 172.21.15.79:0/4200626607 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80b0660 con 0x7f21e8088ac0 2023-10-14T18:45:22.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e67fc700 1 --2- 172.21.15.79:0/4200626607 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21d8008ad0 tx=0x7f21d80083f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa16dc1ffd7d86d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.712+0000 7f21e5ffb700 1 -- 172.21.15.79:0/4200626607 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8010070 con 0x7f21e8088ac0 2023-10-14T18:45:22.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.713+0000 7f21e5ffb700 1 -- 172.21.15.79:0/4200626607 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d800da40 con 0x7f21e8088ac0 2023-10-14T18:45:22.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.713+0000 7f21e5ffb700 1 -- 172.21.15.79:0/4200626607 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d800de00 con 0x7f21e8088ac0 2023-10-14T18:45:22.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.713+0000 7f21ed89a700 1 -- 172.21.15.79:0/4200626607 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 msgr2=0x7f21e80af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.713+0000 7f21ed89a700 1 --2- 172.21.15.79:0/4200626607 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21d8008ad0 tx=0x7f21d80083f0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.714+0000 7f21ed89a700 1 -- 172.21.15.79:0/4200626607 shutdown_connections 2023-10-14T18:45:22.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.714+0000 7f21ed89a700 1 --2- 172.21.15.79:0/4200626607 >> v2:172.21.15.79:3300/0 conn(0x7f21e80ccec0 0x7f21e80afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.714+0000 7f21ed89a700 1 --2- 172.21.15.79:0/4200626607 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e8088ac0 0x7f21e80af910 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21d8008ad0 tx=0x7f21d80083f0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.714+0000 7f21ed89a700 1 -- 172.21.15.79:0/4200626607 >> 172.21.15.79:0/4200626607 conn(0x7f21e8070700 msgr2=0x7f21e8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.715+0000 7f21ed89a700 1 -- 172.21.15.79:0/4200626607 shutdown_connections 2023-10-14T18:45:22.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.715+0000 7f21ed89a700 1 -- 172.21.15.79:0/4200626607 wait complete. 2023-10-14T18:45:22.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.717+0000 7f21ed89a700 1 Processor -- start 2023-10-14T18:45:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.717+0000 7f21ed89a700 1 -- start start 2023-10-14T18:45:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21e80ccaf0 0x7f21e8169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e80c47b0 0x7f21e8173780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8174ca0 con 0x7f21e80ccaf0 2023-10-14T18:45:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c4cb0 con 0x7f21e80c47b0 2023-10-14T18:45:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.718+0000 7f21ed89a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e816b420 con 0x7f21e80ccec0 2023-10-14T18:45:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55188/0 (socket says 172.21.15.79:55188) 2023-10-14T18:45:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 -- 172.21.15.79:0/1676847430 learned_addr learned my addr 172.21.15.79:0/1676847430 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 -- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e80c47b0 msgr2=0x7f21e8173780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e80c47b0 0x7f21e8173780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 -- 172.21.15.79:0/1676847430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21e80ccaf0 msgr2=0x7f21e8169910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21e80ccaf0 0x7f21e8169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.719+0000 7f21e67fc700 1 -- 172.21.15.79:0/1676847430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8008690 con 0x7f21e80ccec0 2023-10-14T18:45:22.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21e67fc700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21d8002000 tx=0x7f21d801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8000d10 con 0x7f21e80ccec0 2023-10-14T18:45:22.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d801f3f0 con 0x7f21e80ccec0 2023-10-14T18:45:22.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d801f7b0 con 0x7f21e80ccec0 2023-10-14T18:45:22.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e816b700 con 0x7f21e80ccec0 2023-10-14T18:45:22.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.720+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8169e50 con 0x7f21e80ccec0 2023-10-14T18:45:22.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.723+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c80052b0 con 0x7f21e80ccec0 2023-10-14T18:45:22.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.724+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21d801d040 con 0x7f21e80ccec0 2023-10-14T18:45:22.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.725+0000 7f21ceffd700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 0x7f21d0069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.725+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21d8085400 con 0x7f21e80ccec0 2023-10-14T18:45:22.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.725+0000 7f21e6ffd700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 0x7f21d0069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.726+0000 7f21e6ffd700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 0x7f21d0069650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21e000ad10 tx=0x7f21e0009370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.730+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21d8052710 con 0x7f21e80ccec0 2023-10-14T18:45:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.777+0000 7f99fbecb700 1 Processor -- start 2023-10-14T18:45:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.777+0000 7f657d581700 1 Processor -- start 2023-10-14T18:45:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.777+0000 7f99fbecb700 1 -- start start 2023-10-14T18:45:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f657d581700 1 -- start start 2023-10-14T18:45:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99fbecb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99f4156ea0 0x7f99f40c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99fbecb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f40c42b0 con 0x7f99f406e2b0 2023-10-14T18:45:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99fbecb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f40c36a0 con 0x7f99f4157270 2023-10-14T18:45:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99fbecb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f406fac0 con 0x7f99f4156ea0 2023-10-14T18:45:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99f9c67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99f4156ea0 0x7f99f40c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99f9c67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99f4156ea0 0x7f99f40c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59628/0 (socket says 172.21.15.79:59628) 2023-10-14T18:45:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.778+0000 7f99f9c67700 1 -- 172.21.15.79:0/2373886611 learned_addr learned my addr 172.21.15.79:0/2373886611 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f99f9c67700 1 -- 172.21.15.79:0/2373886611 >> v1:172.21.15.144:6789/0 conn(0x7f99f4157270 legacy=0x7f99f406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f99f9c67700 1 -- 172.21.15.79:0/2373886611 >> v1:172.21.15.79:6789/0 conn(0x7f99f406e2b0 legacy=0x7f99f406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f99f9c67700 1 -- 172.21.15.79:0/2373886611 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40c3980 con 0x7f99f4156ea0 2023-10-14T18:45:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f12ab888700 1 Processor -- start 2023-10-14T18:45:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f99f9c67700 1 --2- 172.21.15.79:0/2373886611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f4156ea0 0x7f99f40c30c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99e400df20 tx=0x7f99e400d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3206c37debfeb309 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f657d581700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 0x7f6578165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f657d581700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65780ab5c0 con 0x7f65780ccf10 2023-10-14T18:45:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f657d581700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65780aa9b0 con 0x7f657815e9b0 2023-10-14T18:45:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f657d581700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780aac90 con 0x7f657806f1c0 2023-10-14T18:45:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f6576ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65780ccf10 0x7f65780c77d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45562/0 (socket says 172.21.15.79:45562) 2023-10-14T18:45:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f6576ffd700 1 -- 172.21.15.79:0/1726787893 learned_addr learned my addr 172.21.15.79:0/1726787893 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f65777fe700 1 --2- 172.21.15.79:0/1726787893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 0x7f6578165030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f6575ffb700 1 -- 172.21.15.79:0/1726787893 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094803907 0 0) 0x7f65780ab5c0 con 0x7f65780ccf10 2023-10-14T18:45:22.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f6575ffb700 1 -- 172.21.15.79:0/1726787893 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6560003570 con 0x7f65780ccf10 2023-10-14T18:45:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f12ab888700 1 -- start start 2023-10-14T18:45:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f65777fe700 1 -- 172.21.15.79:0/1726787893 >> v1:172.21.15.144:6789/0 conn(0x7f657815e9b0 legacy=0x7f657806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.779+0000 7f65777fe700 1 -- 172.21.15.79:0/1726787893 >> v1:172.21.15.79:6789/0 conn(0x7f65780ccf10 legacy=0x7f65780c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f65777fe700 1 -- 172.21.15.79:0/1726787893 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780aaf70 con 0x7f657806f1c0 2023-10-14T18:45:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f99f8c65700 1 -- 172.21.15.79:0/2373886611 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4012070 con 0x7f99f4156ea0 2023-10-14T18:45:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f65777fe700 1 --2- 172.21.15.79:0/1726787893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 0x7f6578165030 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6570009e90 tx=0x7f6570009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90dac733532f4f84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f99f8c65700 1 -- 172.21.15.79:0/2373886611 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400fa00 con 0x7f99f4156ea0 2023-10-14T18:45:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7fc36defc700 1 Processor -- start 2023-10-14T18:45:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7fc36defc700 1 -- start start 2023-10-14T18:45:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.780+0000 7f12ab888700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12ab888700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12a406f1c0 0x7f12a406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12ab888700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40ab5c0 con 0x7f12a415e9b0 2023-10-14T18:45:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12ab888700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40aa9b0 con 0x7f12a406f1c0 2023-10-14T18:45:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12ab888700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40aac90 con 0x7f12a40ccf10 2023-10-14T18:45:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55200/0 (socket says 172.21.15.79:55200) 2023-10-14T18:45:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 -- 172.21.15.79:0/558514780 learned_addr learned my addr 172.21.15.79:0/558514780 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 -- 172.21.15.79:0/558514780 >> v2:172.21.15.144:3300/0 conn(0x7f12a406f1c0 msgr2=0x7f12a406d3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T18:45:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 --2- 172.21.15.79:0/558514780 >> v2:172.21.15.144:3300/0 conn(0x7f12a406f1c0 0x7f12a406d3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 -- 172.21.15.79:0/558514780 >> v1:172.21.15.79:6789/0 conn(0x7f12a415e9b0 legacy=0x7f12a406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 -- 172.21.15.79:0/558514780 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40aaf70 con 0x7f12a40ccf10 2023-10-14T18:45:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f12a9624700 1 --2- 172.21.15.79:0/558514780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12a00099b0 tx=0x7f12a0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7e9fcf3e63cb86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f129bfff700 1 -- 172.21.15.79:0/558514780 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000b860 con 0x7f12a40ccf10 2023-10-14T18:45:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f129bfff700 1 -- 172.21.15.79:0/558514780 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a000b9c0 con 0x7f12a40ccf10 2023-10-14T18:45:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f129bfff700 1 -- 172.21.15.79:0/558514780 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000bd60 con 0x7f12a40ccf10 2023-10-14T18:45:22.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f99f8c65700 1 -- 172.21.15.79:0/2373886611 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400aea0 con 0x7f99f4156ea0 2023-10-14T18:45:22.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f99fbecb700 1 -- 172.21.15.79:0/2373886611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f4156ea0 msgr2=0x7f99f40c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f99fbecb700 1 --2- 172.21.15.79:0/2373886611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f4156ea0 0x7f99f40c30c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99e400df20 tx=0x7f99e400d840 comp rx=0 tx=0).stop 2023-10-14T18:45:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f6575ffb700 1 -- 172.21.15.79:0/1726787893 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000e070 con 0x7f657806f1c0 2023-10-14T18:45:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f6575ffb700 1 -- 172.21.15.79:0/1726787893 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657000bc80 con 0x7f657806f1c0 2023-10-14T18:45:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.781+0000 7f6575ffb700 1 -- 172.21.15.79:0/1726787893 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570012430 con 0x7f657806f1c0 2023-10-14T18:45:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f657d581700 1 -- 172.21.15.79:0/1726787893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 msgr2=0x7f6578165030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f657d581700 1 --2- 172.21.15.79:0/1726787893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 0x7f6578165030 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6570009e90 tx=0x7f6570009780 comp rx=0 tx=0).stop 2023-10-14T18:45:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f99fbecb700 1 -- 172.21.15.79:0/2373886611 shutdown_connections 2023-10-14T18:45:22.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f99fbecb700 1 --2- 172.21.15.79:0/2373886611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f4156ea0 0x7f99f40c30c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f99fbecb700 1 -- 172.21.15.79:0/2373886611 >> 172.21.15.79:0/2373886611 conn(0x7f99f40ca4f0 msgr2=0x7f99f40ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f12ab888700 1 -- 172.21.15.79:0/558514780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 msgr2=0x7f12a40c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f12ab888700 1 --2- 172.21.15.79:0/558514780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f12a00099b0 tx=0x7f12a0009250 comp rx=0 tx=0).stop 2023-10-14T18:45:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7fc36defc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 0x7fc36806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7fc36defc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 0x7fc3680c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7fc36defc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36806f320 con 0x7fc3680c7a30 2023-10-14T18:45:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7fc36defc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36806e530 con 0x7fc3680ccd70 2023-10-14T18:45:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7fc36defc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36806e710 con 0x7fc3680cc9a0 2023-10-14T18:45:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f99fbecb700 1 -- 172.21.15.79:0/2373886611 shutdown_connections 2023-10-14T18:45:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f99fbecb700 1 -- 172.21.15.79:0/2373886611 wait complete. 2023-10-14T18:45:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f12ab888700 1 -- 172.21.15.79:0/558514780 shutdown_connections 2023-10-14T18:45:22.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.782+0000 7f12ab888700 1 --2- 172.21.15.79:0/558514780 >> v2:172.21.15.144:3300/0 conn(0x7f12a406f1c0 0x7f12a406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f12ab888700 1 --2- 172.21.15.79:0/558514780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a40ccf10 0x7f12a40c77d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f12ab888700 1 -- 172.21.15.79:0/558514780 >> 172.21.15.79:0/558514780 conn(0x7f12a4070700 msgr2=0x7f12a4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f12ab888700 1 -- 172.21.15.79:0/558514780 shutdown_connections 2023-10-14T18:45:22.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f12ab888700 1 -- 172.21.15.79:0/558514780 wait complete. 2023-10-14T18:45:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f657d581700 1 -- 172.21.15.79:0/1726787893 shutdown_connections 2023-10-14T18:45:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f657d581700 1 --2- 172.21.15.79:0/1726787893 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f657806f1c0 0x7f6578165030 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f657d581700 1 -- 172.21.15.79:0/1726787893 >> 172.21.15.79:0/1726787893 conn(0x7f6578070700 msgr2=0x7f6578070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7fc366ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 0x7fc3680c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7fc366ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 0x7fc3680c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59644/0 (socket says 172.21.15.79:59644) 2023-10-14T18:45:22.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7fc366ffd700 1 -- 172.21.15.79:0/3958571391 learned_addr learned my addr 172.21.15.79:0/3958571391 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f657d581700 1 -- 172.21.15.79:0/1726787893 shutdown_connections 2023-10-14T18:45:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f6b04c43700 1 Processor -- start 2023-10-14T18:45:22.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7f6b04c43700 1 -- start start 2023-10-14T18:45:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.783+0000 7fc3677fe700 1 --2- 172.21.15.79:0/3958571391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 0x7fc36806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f657d581700 1 -- 172.21.15.79:0/1726787893 wait complete. 2023-10-14T18:45:22.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f12ab888700 1 Processor -- start 2023-10-14T18:45:22.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f99fbecb700 1 Processor -- start 2023-10-14T18:45:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6b04c43700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b000bfbe0 0x7f6b000ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6b04c43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b000afdf0 0x7f6b000b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6b04c43700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b000cd620 con 0x7f6b000cd1d0 2023-10-14T18:45:22.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6b04c43700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0015e9c0 con 0x7f6b000afdf0 2023-10-14T18:45:22.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6b04c43700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000b0380 con 0x7f6b000bfbe0 2023-10-14T18:45:22.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6afdd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6b000cd1d0 0x7f6b000af6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45592/0 (socket says 172.21.15.79:45592) 2023-10-14T18:45:22.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f6afdd9b700 1 -- 172.21.15.79:0/1650044712 learned_addr learned my addr 172.21.15.79:0/1650044712 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:22.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 --2- 172.21.15.79:0/1650044712 >> v2:172.21.15.144:3300/0 conn(0x7f6b000bfbe0 0x7f6b000ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 -- 172.21.15.79:0/1650044712 >> v2:172.21.15.79:3300/0 conn(0x7f6b000afdf0 msgr2=0x7f6b000b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 --2- 172.21.15.79:0/1650044712 >> v2:172.21.15.79:3300/0 conn(0x7f6b000afdf0 0x7f6b000b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 -- 172.21.15.79:0/1650044712 >> v1:172.21.15.79:6789/0 conn(0x7f6b000cd1d0 legacy=0x7f6b000af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 -- 172.21.15.79:0/1650044712 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000b0660 con 0x7f6b000bfbe0 2023-10-14T18:45:22.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f12ab888700 1 -- start start 2023-10-14T18:45:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f657d581700 1 Processor -- start 2023-10-14T18:45:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7f6afe59c700 1 --2- 172.21.15.79:0/1650044712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000bfbe0 0x7f6b000ccc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b00069480 tx=0x7f6af8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18147c69f1968efe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3677fe700 1 -- 172.21.15.79:0/3958571391 >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 msgr2=0x7fc3680c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3677fe700 1 --2- 172.21.15.79:0/3958571391 >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 0x7fc3680c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3677fe700 1 -- 172.21.15.79:0/3958571391 >> v1:172.21.15.144:6789/0 conn(0x7fc3680c7a30 legacy=0x7fc36815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3677fe700 1 -- 172.21.15.79:0/3958571391 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36806e9f0 con 0x7fc3680cc9a0 2023-10-14T18:45:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3677fe700 1 --2- 172.21.15.79:0/3958571391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 0x7fc36806dff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0098e0 tx=0x7fc35c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce1cf236647773a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3667fc700 1 -- 172.21.15.79:0/3958571391 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c012770 con 0x7fc3680cc9a0 2023-10-14T18:45:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3667fc700 1 -- 172.21.15.79:0/3958571391 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c0128f0 con 0x7fc3680cc9a0 2023-10-14T18:45:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7fc3667fc700 1 -- 172.21.15.79:0/3958571391 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c012cb0 con 0x7fc3680cc9a0 2023-10-14T18:45:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7fc36defc700 1 -- 172.21.15.79:0/3958571391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 msgr2=0x7fc36806dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.785+0000 7fc36defc700 1 --2- 172.21.15.79:0/3958571391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 0x7fc36806dff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0098e0 tx=0x7fc35c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f657d581700 1 -- start start 2023-10-14T18:45:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.784+0000 7f99fbecb700 1 -- start start 2023-10-14T18:45:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 0x7f99f40c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 0x7f99f4147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99f4157270 0x7f99f40aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40c5800 con 0x7f99f406e2b0 2023-10-14T18:45:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f414f210 con 0x7f99f4156ea0 2023-10-14T18:45:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99fbecb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40b0450 con 0x7f99f4157270 2023-10-14T18:45:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9c67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 0x7f99f40c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9c67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 0x7f99f40c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59666/0 (socket says 172.21.15.79:59666) 2023-10-14T18:45:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9c67700 1 -- 172.21.15.79:0/6608436 learned_addr learned my addr 172.21.15.79:0/6608436 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 0x7f99f4147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 -- 172.21.15.79:0/3958571391 shutdown_connections 2023-10-14T18:45:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 --2- 172.21.15.79:0/3958571391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680cc9a0 0x7fc36806dff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 --2- 172.21.15.79:0/3958571391 >> v2:172.21.15.79:3300/0 conn(0x7fc3680ccd70 0x7fc3680c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 -- 172.21.15.79:0/3958571391 >> 172.21.15.79:0/3958571391 conn(0x7fc3680cd1e0 msgr2=0x7fc3680cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 -- 172.21.15.79:0/3958571391 shutdown_connections 2023-10-14T18:45:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7fc36defc700 1 -- 172.21.15.79:0/3958571391 wait complete. 2023-10-14T18:45:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f6afd59a700 1 -- 172.21.15.79:0/1650044712 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800e070 con 0x7f6b000bfbe0 2023-10-14T18:45:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65780ccf10 0x7f657815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657815e9b0 0x7f657814ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b07c0 con 0x7f657806f1c0 2023-10-14T18:45:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657815c9c0 con 0x7f657815e9b0 2023-10-14T18:45:22.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f657d581700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657815cca0 con 0x7f65780ccf10 2023-10-14T18:45:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 -- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99f4157270 msgr2=0x7f99f40aec70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99f4157270 0x7f99f40aec70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 -- 172.21.15.79:0/6608436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 msgr2=0x7f99f40c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 0x7f99f40c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 -- 172.21.15.79:0/6608436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e400dae0 con 0x7f99f4156ea0 2023-10-14T18:45:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f99f9466700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 0x7f99f4147540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99f000b4c0 tx=0x7f99f0009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000f510 con 0x7f99f4156ea0 2023-10-14T18:45:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000f690 con 0x7f99f4156ea0 2023-10-14T18:45:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000fa50 con 0x7f99f4156ea0 2023-10-14T18:45:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 0x7f12a40b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 0x7f12a40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a415c9a0 con 0x7f12a415e9b0 2023-10-14T18:45:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c0370 con 0x7f12a40ccf10 2023-10-14T18:45:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12ab888700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c3600 con 0x7f12a406f1c0 2023-10-14T18:45:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12a9624700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59676/0 (socket says 172.21.15.79:59676) 2023-10-14T18:45:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 -- 172.21.15.79:0/611723581 learned_addr learned my addr 172.21.15.79:0/611723581 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f40b01b0 con 0x7f99f4156ea0 2023-10-14T18:45:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12a9624700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55248/0 (socket says 172.21.15.79:55248) 2023-10-14T18:45:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12a9624700 1 -- 172.21.15.79:0/1533547269 learned_addr learned my addr 172.21.15.79:0/1533547269 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f12a9e25700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 0x7f12a40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f65777fe700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657815e9b0 0x7f657814ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 -- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65780ccf10 msgr2=0x7f657815ad70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65780ccf10 0x7f657815ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 -- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657815e9b0 msgr2=0x7f657814ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657815e9b0 0x7f657814ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6576ffd700 1 -- 172.21.15.79:0/611723581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570009a20 con 0x7f657806f1c0 2023-10-14T18:45:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f12a9624700 1 -- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 msgr2=0x7f12a40b0b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T18:45:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f6576ffd700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c7c0 tx=0x7f656c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c005b30 con 0x7f657806f1c0 2023-10-14T18:45:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c005c90 con 0x7f657806f1c0 2023-10-14T18:45:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c007320 con 0x7f657806f1c0 2023-10-14T18:45:22.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657815cf80 con 0x7f657806f1c0 2023-10-14T18:45:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657815d260 con 0x7f657806f1c0 2023-10-14T18:45:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f6afd59a700 1 -- 172.21.15.79:0/1650044712 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800bb30 con 0x7f6b000bfbe0 2023-10-14T18:45:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.786+0000 7f6afd59a700 1 -- 172.21.15.79:0/1650044712 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8012430 con 0x7f6b000bfbe0 2023-10-14T18:45:22.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6b04c43700 1 -- 172.21.15.79:0/1650044712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000bfbe0 msgr2=0x7f6b000ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f6b04c43700 1 --2- 172.21.15.79:0/1650044712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000bfbe0 0x7f6b000ccc90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b00069480 tx=0x7f6af8009780 comp rx=0 tx=0).stop 2023-10-14T18:45:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7fc36defc700 1 Processor -- start 2023-10-14T18:45:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7fc36defc700 1 -- start start 2023-10-14T18:45:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.787+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f414eea0 con 0x7f99f4156ea0 2023-10-14T18:45:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.788+0000 7f6b04c43700 1 -- 172.21.15.79:0/1650044712 shutdown_connections 2023-10-14T18:45:22.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f6b04c43700 1 --2- 172.21.15.79:0/1650044712 >> v2:172.21.15.79:3300/0 conn(0x7f6b000afdf0 0x7f6b000b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f6b04c43700 1 --2- 172.21.15.79:0/1650044712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000bfbe0 0x7f6b000ccc90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f6b04c43700 1 -- 172.21.15.79:0/1650044712 >> 172.21.15.79:0/1650044712 conn(0x7f6b00070700 msgr2=0x7f6b00070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f414f3a0 con 0x7f99f4156ea0 2023-10-14T18:45:22.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f6b04c43700 1 -- 172.21.15.79:0/1650044712 shutdown_connections 2023-10-14T18:45:22.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f6b04c43700 1 -- 172.21.15.79:0/1650044712 wait complete. 2023-10-14T18:45:22.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f12a8e23700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 0x7f12a40b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 0x7fc3680b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680cc9a0 0x7fc368156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 0x7fc368156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680b1380 con 0x7fc3680c7a30 2023-10-14T18:45:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c5030 con 0x7fc3680cc9a0 2023-10-14T18:45:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc36defc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c4790 con 0x7fc3680ccd70 2023-10-14T18:45:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc366ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680cc9a0 0x7fc368156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc367fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 0x7fc368156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc367fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 0x7fc368156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55250/0 (socket says 172.21.15.79:55250) 2023-10-14T18:45:22.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7fc367fff700 1 -- 172.21.15.79:0/657504882 learned_addr learned my addr 172.21.15.79:0/657504882 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f295fa9f700 1 Processor -- start 2023-10-14T18:45:22.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 0x7fc3680b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 -- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 msgr2=0x7fc368156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 0x7fc368156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 -- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680cc9a0 msgr2=0x7fc368156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680cc9a0 0x7fc368156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 -- 172.21.15.79:0/657504882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c009420 con 0x7fc3680c7a30 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7fc3677fe700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 0x7fc3680b1810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc35c019000 tx=0x7fc35c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00bce0 con 0x7fc3680c7a30 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c00be40 con 0x7fc3680c7a30 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680c4a70 con 0x7fc3680c7a30 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c010680 con 0x7fc3680c7a30 2023-10-14T18:45:22.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680b2be0 con 0x7fc3680c7a30 2023-10-14T18:45:22.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7f295fa9f700 1 -- start start 2023-10-14T18:45:22.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295fa9f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f295806d2e0 0x7f29580c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295fa9f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d6b0 0x7f29580c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295fa9f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29580c8760 con 0x7f2958155b60 2023-10-14T18:45:22.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295fa9f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580c7930 con 0x7f295806d2e0 2023-10-14T18:45:22.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295fa9f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580af6e0 con 0x7f295806d6b0 2023-10-14T18:45:22.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295d83b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f295806d2e0 0x7f29580c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295d83b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f295806d2e0 0x7f29580c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55464/0 (socket says 172.21.15.79:55464) 2023-10-14T18:45:22.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295d83b700 1 -- 172.21.15.79:0/1172726708 learned_addr learned my addr 172.21.15.79:0/1172726708 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f295d03a700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d6b0 0x7f29580c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65580052b0 con 0x7f657806f1c0 2023-10-14T18:45:22.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f295d83b700 1 -- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d6b0 msgr2=0x7f29580c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f295d83b700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d6b0 0x7f29580c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f295d83b700 1 -- 172.21.15.79:0/1172726708 >> v1:172.21.15.144:6789/0 conn(0x7f2958155b60 legacy=0x7f2958155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f295d83b700 1 -- 172.21.15.79:0/1172726708 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580c7b50 con 0x7f295806d2e0 2023-10-14T18:45:22.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f295d83b700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d2e0 0x7f29580c6eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29540089b0 tx=0x7f29540082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af10a85520f6e855 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f656c01b3b0 con 0x7f657806f1c0 2023-10-14T18:45:22.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.789+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99f001a400 con 0x7f99f4156ea0 2023-10-14T18:45:22.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7f99e9ffb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 0x7f99e0069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99f0083dd0 con 0x7f99f4156ea0 2023-10-14T18:45:22.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.790+0000 7f6b04c43700 1 Processor -- start 2023-10-14T18:45:22.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.791+0000 7f6b04c43700 1 -- start start 2023-10-14T18:45:22.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 0x7f6b000c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b000cd1d0 0x7f6b000c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000bffb0 con 0x7f6b000bfbe0 2023-10-14T18:45:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000c2fe0 con 0x7f6b000afdf0 2023-10-14T18:45:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6b04c43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0015df30 con 0x7f6b000cd1d0 2023-10-14T18:45:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afdd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 0x7f6b000c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afdd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59696/0 (socket says 172.21.15.79:59696) 2023-10-14T18:45:22.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afdd9b700 1 -- 172.21.15.79:0/2056717147 learned_addr learned my addr 172.21.15.79:0/2056717147 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f655effd700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 0x7f6564069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f12a9624700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 0x7f12a40b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f12a9624700 1 -- 172.21.15.79:0/1533547269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 msgr2=0x7f12a40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f12a9624700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 0x7f12a40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f12a9624700 1 -- 172.21.15.79:0/1533547269 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00094f0 con 0x7f12a406f1c0 2023-10-14T18:45:22.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f12a9e25700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 0x7f12a40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:22.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 -- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b000cd1d0 msgr2=0x7f6b000c2aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:22.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b000cd1d0 0x7f6b000c2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 -- 172.21.15.79:0/2056717147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 msgr2=0x7f6b000c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f6afe59c700 1 -- 172.21.15.79:0/2056717147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8009a20 con 0x7f6b000afdf0 2023-10-14T18:45:22.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.792+0000 7f99f9c67700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 0x7f99e0069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f12a8e23700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 0x7f12a40b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f6afdd9b700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:22.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f656c083ac0 con 0x7f657806f1c0 2023-10-14T18:45:22.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f12a9624700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009290 tx=0x7f12a0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f6afe59c700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 0x7f6b000c7850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6af8015000 tx=0x7f6af8018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f65767fc700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 0x7f6564069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36804c3c0 con 0x7fc3680c7a30 2023-10-14T18:45:22.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0024440 con 0x7f12a406f1c0 2023-10-14T18:45:22.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40c0610 con 0x7f12a406f1c0 2023-10-14T18:45:22.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc35c010a30 con 0x7fc3680c7a30 2023-10-14T18:45:22.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40c0bd0 con 0x7f12a406f1c0 2023-10-14T18:45:22.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7f99f9c67700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 0x7f99e0069610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99e400d880 tx=0x7f99e401b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.793+0000 7fc34f7fe700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 0x7fc3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.794+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc35c016070 con 0x7fc3680c7a30 2023-10-14T18:45:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.794+0000 7fc366ffd700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 0x7fc3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.794+0000 7f65767fc700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 0x7f6564069460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6568001050 tx=0x7f6568007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.794+0000 7fc366ffd700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 0x7fc3540693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc358006d40 tx=0x7fc358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.794+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40c6f40 con 0x7f12a406f1c0 2023-10-14T18:45:22.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a00245a0 con 0x7f12a406f1c0 2023-10-14T18:45:22.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a0024920 con 0x7f12a406f1c0 2023-10-14T18:45:22.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f295c839700 1 -- 172.21.15.79:0/1172726708 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954010070 con 0x7f295806d2e0 2023-10-14T18:45:22.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f295c839700 1 -- 172.21.15.79:0/1172726708 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400da80 con 0x7f295806d2e0 2023-10-14T18:45:22.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f295c839700 1 -- 172.21.15.79:0/1172726708 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400de20 con 0x7f295806d2e0 2023-10-14T18:45:22.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f00511a0 con 0x7f99f4156ea0 2023-10-14T18:45:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8001010 con 0x7f6b000afdf0 2023-10-14T18:45:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af801e430 con 0x7f6b000afdf0 2023-10-14T18:45:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af801e7f0 con 0x7f6b000afdf0 2023-10-14T18:45:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b000c8340 con 0x7f6b000afdf0 2023-10-14T18:45:22.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.795+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b000c0190 con 0x7f6b000afdf0 2023-10-14T18:45:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.796+0000 7f295fa9f700 1 -- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d2e0 msgr2=0x7f29580c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.796+0000 7f295fa9f700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d2e0 0x7f29580c6eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29540089b0 tx=0x7f29540082d0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12a001a420 con 0x7f12a406f1c0 2023-10-14T18:45:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 -- 172.21.15.79:0/1172726708 shutdown_connections 2023-10-14T18:45:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d2e0 0x7f29580c6eb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 --2- 172.21.15.79:0/1172726708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d6b0 0x7f29580c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 -- 172.21.15.79:0/1172726708 >> 172.21.15.79:0/1172726708 conn(0x7f2958070700 msgr2=0x7f2958070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 -- 172.21.15.79:0/1172726708 shutdown_connections 2023-10-14T18:45:22.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f12997fa700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12a0086b60 con 0x7f12a406f1c0 2023-10-14T18:45:22.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.797+0000 7f295fa9f700 1 -- 172.21.15.79:0/1172726708 wait complete. 2023-10-14T18:45:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f12a8e23700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f12a8e23700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b17f0 tx=0x7f1294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6af801ec20 con 0x7f6b000afdf0 2023-10-14T18:45:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f6aee7fc700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 0x7f6ae00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6af8086720 con 0x7f6b000afdf0 2023-10-14T18:45:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.798+0000 7f6afdd9b700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 0x7f6ae00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.799+0000 7f295fa9f700 1 Processor -- start 2023-10-14T18:45:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.799+0000 7f6afdd9b700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 0x7f6ae00694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c95c0 tx=0x7f6af4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.799+0000 7f295fa9f700 1 -- start start 2023-10-14T18:45:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 0x7f29580b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2958155b60 0x7f29581551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c4090 con 0x7f2958155b60 2023-10-14T18:45:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c4370 con 0x7f295806d6b0 2023-10-14T18:45:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295fa9f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c4650 con 0x7f295806d2e0 2023-10-14T18:45:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295d03a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 0x7f29580b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295d83b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295d83b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55270/0 (socket says 172.21.15.79:55270) 2023-10-14T18:45:22.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295d83b700 1 -- 172.21.15.79:0/3293917812 learned_addr learned my addr 172.21.15.79:0/3293917812 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f295d03a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 0x7f29580b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55474/0 (socket says 172.21.15.79:55474) 2023-10-14T18:45:22.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.800+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0004c3c0 con 0x7f6b000afdf0 2023-10-14T18:45:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 -- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 msgr2=0x7f29580b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 0x7f29580b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 -- 172.21.15.79:0/3293917812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2958155b60 msgr2=0x7f29581551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2958155b60 0x7f29581551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 -- 172.21.15.79:0/3293917812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954008570 con 0x7f295806d2e0 2023-10-14T18:45:22.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a0053d70 con 0x7f12a406f1c0 2023-10-14T18:45:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295d83b700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2954008310 tx=0x7f295401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954016a70 con 0x7f295806d2e0 2023-10-14T18:45:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2954016bd0 con 0x7f295806d2e0 2023-10-14T18:45:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29580c4930 con 0x7f295806d2e0 2023-10-14T18:45:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400b0c0 con 0x7f295806d2e0 2023-10-14T18:45:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f656c085e60 con 0x7f657806f1c0 2023-10-14T18:45:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.801+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29580c3920 con 0x7f295806d2e0 2023-10-14T18:45:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.803+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295804c3c0 con 0x7f295806d2e0 2023-10-14T18:45:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.803+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f295400b4f0 con 0x7f295806d2e0 2023-10-14T18:45:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f294dffb700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 0x7f293c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc35c0531e0 con 0x7fc3680c7a30 2023-10-14T18:45:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2954085d20 con 0x7f295806d2e0 2023-10-14T18:45:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f295d03a700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 0x7f293c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.805+0000 7f295d03a700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 0x7f293c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29580ab2c0 tx=0x7f295000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.805+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6af80539f0 con 0x7f6b000afdf0 2023-10-14T18:45:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.808+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2954052f90 con 0x7f295806d2e0 2023-10-14T18:45:22.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.803+0000 7f3dac3a3700 1 Processor -- start 2023-10-14T18:45:22.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.803+0000 7f3dac3a3700 1 -- start start 2023-10-14T18:45:22.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3dac3a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 0x7f3da40883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3dac3a3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3da40b0020 0x7f3da40888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3dac3a3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da40c6eb0 con 0x7f3da40ccec0 2023-10-14T18:45:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3dac3a3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da4088e30 con 0x7f3da40ccaf0 2023-10-14T18:45:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3dac3a3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40b1270 con 0x7f3da40b0020 2023-10-14T18:45:22.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3da993e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3da40ccec0 0x7f3da40af910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45594/0 (socket says 172.21.15.79:45594) 2023-10-14T18:45:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3da993e700 1 -- 172.21.15.79:0/2623338179 learned_addr learned my addr 172.21.15.79:0/2623338179 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3daa13f700 1 --2- 172.21.15.79:0/2623338179 >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 0x7f3da40883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.804+0000 7f3daa940700 1 --2- 172.21.15.79:0/2623338179 >> v2:172.21.15.144:3300/0 conn(0x7f3da40b0020 0x7f3da40888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.805+0000 7f3da913d700 1 -- 172.21.15.79:0/2623338179 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359259447 0 0) 0x7f3da40c6eb0 con 0x7f3da40ccec0 2023-10-14T18:45:22.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3da913d700 1 -- 172.21.15.79:0/2623338179 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d90004680 con 0x7f3da40ccec0 2023-10-14T18:45:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3daa940700 1 -- 172.21.15.79:0/2623338179 >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 msgr2=0x7f3da40883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3daa940700 1 --2- 172.21.15.79:0/2623338179 >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 0x7f3da40883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3daa940700 1 -- 172.21.15.79:0/2623338179 >> v1:172.21.15.79:6789/0 conn(0x7f3da40ccec0 legacy=0x7f3da40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3daa940700 1 -- 172.21.15.79:0/2623338179 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40b0410 con 0x7f3da40b0020 2023-10-14T18:45:22.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.822+0000 7f3daa940700 1 --2- 172.21.15.79:0/2623338179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40b0020 0x7f3da40888f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3da406c1f0 tx=0x7f3d9c007760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864e8ea105b5be7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.830+0000 7f3daa13f700 1 --2- 172.21.15.79:0/2623338179 >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 0x7f3da40883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.832+0000 7f3da913d700 1 -- 172.21.15.79:0/2623338179 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00bb60 con 0x7f3da40b0020 2023-10-14T18:45:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.832+0000 7f3da913d700 1 -- 172.21.15.79:0/2623338179 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00bcc0 con 0x7f3da40b0020 2023-10-14T18:45:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.832+0000 7f3da913d700 1 -- 172.21.15.79:0/2623338179 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c017750 con 0x7f3da40b0020 2023-10-14T18:45:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 -- 172.21.15.79:0/2623338179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40b0020 msgr2=0x7f3da40888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/2623338179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40b0020 0x7f3da40888f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3da406c1f0 tx=0x7f3d9c007760 comp rx=0 tx=0).stop 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 -- 172.21.15.79:0/2623338179 shutdown_connections 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/2623338179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40b0020 0x7f3da40888f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/2623338179 >> v2:172.21.15.79:3300/0 conn(0x7f3da40ccaf0 0x7f3da40883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.833+0000 7f3dac3a3700 1 -- 172.21.15.79:0/2623338179 >> 172.21.15.79:0/2623338179 conn(0x7f3da4070700 msgr2=0x7f3da4070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:22.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.834+0000 7f3dac3a3700 1 -- 172.21.15.79:0/2623338179 shutdown_connections 2023-10-14T18:45:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.834+0000 7f3dac3a3700 1 -- 172.21.15.79:0/2623338179 wait complete. 2023-10-14T18:45:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.835+0000 7f3dac3a3700 1 Processor -- start 2023-10-14T18:45:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.836+0000 7f3dac3a3700 1 -- start start 2023-10-14T18:45:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3da40b0020 0x7f3da417f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40ccec0 0x7f3da40bb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da417f550 con 0x7f3da40ccaf0 2023-10-14T18:45:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40bcc50 con 0x7f3da40ccec0 2023-10-14T18:45:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3dac3a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40c6bc0 con 0x7f3da40b0020 2023-10-14T18:45:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3da993e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3da993e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59726/0 (socket says 172.21.15.79:59726) 2023-10-14T18:45:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.837+0000 7f3da993e700 1 -- 172.21.15.79:0/3657187816 learned_addr learned my addr 172.21.15.79:0/3657187816 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 -- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3da40b0020 msgr2=0x7f3da417f010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:45:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3da40b0020 0x7f3da417f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 -- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40ccec0 msgr2=0x7f3da40bb9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T18:45:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40ccec0 0x7f3da40bb9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 -- 172.21.15.79:0/3657187816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c007a00 con 0x7f3da40ccaf0 2023-10-14T18:45:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.838+0000 7f3da993e700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400c580 tx=0x7f3d94007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.839+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94005b30 con 0x7f3da40ccaf0 2023-10-14T18:45:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.839+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94005cb0 con 0x7f3da40ccaf0 2023-10-14T18:45:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.839+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94007320 con 0x7f3da40ccaf0 2023-10-14T18:45:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.839+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da40bc040 con 0x7f3da40ccaf0 2023-10-14T18:45:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.839+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da40bc600 con 0x7f3da40ccaf0 2023-10-14T18:45:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.841+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d94007690 con 0x7f3da40ccaf0 2023-10-14T18:45:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.842+0000 7f3d9a7fc700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 0x7f3d900699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.842+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d94083aa0 con 0x7f3da40ccaf0 2023-10-14T18:45:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.843+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da404c3c0 con 0x7f3da40ccaf0 2023-10-14T18:45:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.852+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d94050cf0 con 0x7f3da40ccaf0 2023-10-14T18:45:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.854+0000 7f3daa13f700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 0x7f3d900699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:22.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:22.906+0000 7f3daa13f700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 0x7f3d900699c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3da0007aa0 tx=0x7f3da0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.113+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21c8005560 con 0x7f21e80ccec0 2023-10-14T18:45:23.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.113+0000 7f21ceffd700 1 -- 172.21.15.79:0/1676847430 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21d8008070 con 0x7f21e80ccec0 2023-10-14T18:45:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 msgr2=0x7f21d0069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 0x7f21d0069650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21e000ad10 tx=0x7f21e0009370 comp rx=0 tx=0).stop 2023-10-14T18:45:23.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 msgr2=0x7f21e8173240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21d8002000 tx=0x7f21d801b000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 shutdown_connections 2023-10-14T18:45:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21d00671a0 0x7f21d0069650 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e80c47b0 0x7f21e8173780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21e80ccaf0 0x7f21e8169910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 --2- 172.21.15.79:0/1676847430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21e80ccec0 0x7f21e8173240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 >> 172.21.15.79:0/1676847430 conn(0x7f21e8070700 msgr2=0x7f21e81752c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 shutdown_connections 2023-10-14T18:45:23.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.117+0000 7f21ed89a700 1 -- 172.21.15.79:0/1676847430 wait complete. 2023-10-14T18:45:23.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-14T18:45:23.136 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.162+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f12a404c3c0 con 0x7f12a406f1c0 2023-10-14T18:45:23.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.163+0000 7f12997fa700 1 -- 172.21.15.79:0/1533547269 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12a0057390 con 0x7f12a406f1c0 2023-10-14T18:45:23.165 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.165+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 msgr2=0x7f12880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.165+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b17f0 tx=0x7f1294009040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.165+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 msgr2=0x7f12a40c30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.165+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009290 tx=0x7f12a0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 shutdown_connections 2023-10-14T18:45:23.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a415e9b0 0x7f12a40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12a406f1c0 0x7f12a40c30c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 --2- 172.21.15.79:0/1533547269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12a40ccf10 0x7f12a40b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 >> 172.21.15.79:0/1533547269 conn(0x7f12a4070700 msgr2=0x7f12a40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 shutdown_connections 2023-10-14T18:45:23.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.166+0000 7f12ab888700 1 -- 172.21.15.79:0/1533547269 wait complete. 2023-10-14T18:45:23.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-14T18:45:23.180 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.179+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc36806ecd0 con 0x7fc3680c7a30 2023-10-14T18:45:23.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.179+0000 7fc34f7fe700 1 -- 172.21.15.79:0/657504882 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc35c056800 con 0x7fc3680c7a30 2023-10-14T18:45:23.182 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.180+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99f404c3c0 con 0x7f99f4156ea0 2023-10-14T18:45:23.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.181+0000 7f99e9ffb700 1 -- 172.21.15.79:0/6608436 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99f00547c0 con 0x7f99f4156ea0 2023-10-14T18:45:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 msgr2=0x7fc3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 0x7fc3540693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc358006d40 tx=0x7fc358008040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 msgr2=0x7fc3680b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 0x7fc3680b1810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc35c019000 tx=0x7fc35c01a000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 msgr2=0x7f99e0069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 0x7f99e0069610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99e400d880 tx=0x7f99e401b000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 msgr2=0x7f99f4147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.183+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 0x7f99f4147540 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99f000b4c0 tx=0x7f99f0009060 comp rx=0 tx=0).stop 2023-10-14T18:45:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 shutdown_connections 2023-10-14T18:45:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc354066f30 0x7fc3540693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3680ccd70 0x7fc368156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3680c7a30 0x7fc3680b1810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 --2- 172.21.15.79:0/657504882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680cc9a0 0x7fc368156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 >> 172.21.15.79:0/657504882 conn(0x7fc3680cd1e0 msgr2=0x7fc3680c3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 shutdown_connections 2023-10-14T18:45:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.184+0000 7fc36defc700 1 -- 172.21.15.79:0/657504882 wait complete. 2023-10-14T18:45:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 shutdown_connections 2023-10-14T18:45:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99e0067160 0x7f99e0069610 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99f4157270 0x7f99f40aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99f406e2b0 0x7f99f40c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 --2- 172.21.15.79:0/6608436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99f4156ea0 0x7f99f4147540 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 >> 172.21.15.79:0/6608436 conn(0x7f99f40ca4f0 msgr2=0x7f99f4063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 shutdown_connections 2023-10-14T18:45:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.185+0000 7f99fbecb700 1 -- 172.21.15.79:0/6608436 wait complete. 2023-10-14T18:45:23.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.192+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b000c87e0 con 0x7f6b000afdf0 2023-10-14T18:45:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.192+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6558005560 con 0x7f657806f1c0 2023-10-14T18:45:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.192+0000 7f6aee7fc700 1 -- 172.21.15.79:0/2056717147 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6af8057010 con 0x7f6b000afdf0 2023-10-14T18:45:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.192+0000 7f655effd700 1 -- 172.21.15.79:0/611723581 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f656c017020 con 0x7f657806f1c0 2023-10-14T18:45:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 msgr2=0x7f6564069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 0x7f6564069460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6568001050 tx=0x7f6568007aa0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 msgr2=0x7f657806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c7c0 tx=0x7f656c007e00 comp rx=0 tx=0).stop 2023-10-14T18:45:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 msgr2=0x7f6ae00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 0x7f6ae00694b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c95c0 tx=0x7f6af4009040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 msgr2=0x7f6b000c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.196+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 0x7f6b000c7850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6af8015000 tx=0x7f6af8018000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 shutdown_connections 2023-10-14T18:45:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066fb0 0x7f6564069460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f657815e9b0 0x7f657814ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f657806f1c0 0x7f657806e940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 --2- 172.21.15.79:0/611723581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65780ccf10 0x7f657815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 >> 172.21.15.79:0/611723581 conn(0x7f6578070700 msgr2=0x7f6578063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 shutdown_connections 2023-10-14T18:45:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ae0067000 0x7f6ae00694b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b000cd1d0 0x7f6b000c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b000afdf0 0x7f6b000c7850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 --2- 172.21.15.79:0/2056717147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b000bfbe0 0x7f6b000c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 >> 172.21.15.79:0/2056717147 conn(0x7f6b00070700 msgr2=0x7f6b000c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 shutdown_connections 2023-10-14T18:45:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f6b04c43700 1 -- 172.21.15.79:0/2056717147 wait complete. 2023-10-14T18:45:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 shutdown_connections 2023-10-14T18:45:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f657d581700 1 -- 172.21.15.79:0/611723581 wait complete. 2023-10-14T18:45:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f29580c7e30 con 0x7f295806d2e0 2023-10-14T18:45:23.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.197+0000 7f294dffb700 1 -- 172.21.15.79:0/3293917812 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29540565b0 con 0x7f295806d2e0 2023-10-14T18:45:23.204 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-14T18:45:23.206 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.201+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 msgr2=0x7f293c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.201+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 0x7f293c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29580ab2c0 tx=0x7f295000b040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.201+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 msgr2=0x7f29580c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.201+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2954008310 tx=0x7f295401c000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 shutdown_connections 2023-10-14T18:45:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f293c066f30 0x7f293c0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2958155b60 0x7f29581551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295806d2e0 0x7f29580c5130 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2954008310 tx=0x7f295401c000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 --2- 172.21.15.79:0/3293917812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f295806d6b0 0x7f29580b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.202+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 >> 172.21.15.79:0/3293917812 conn(0x7f2958070700 msgr2=0x7f29580c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-14T18:45:23.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.203+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 shutdown_connections 2023-10-14T18:45:23.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.203+0000 7f295fa9f700 1 -- 172.21.15.79:0/3293917812 wait complete. 2023-10-14T18:45:23.210 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-10-14T18:45:23.215 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-14T18:45:23.219 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-14T18:45:23.220 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.221+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3da40b0660 con 0x7f3da40ccaf0 2023-10-14T18:45:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.222+0000 7f3d9a7fc700 1 -- 172.21.15.79:0/3657187816 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d94017020 con 0x7f3da40ccaf0 2023-10-14T18:45:23.224 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2023-10-14T18:45:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 msgr2=0x7f3d900699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 0x7f3d900699c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3da0007aa0 tx=0x7f3da0008040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 msgr2=0x7f3da40bb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400c580 tx=0x7f3d94007df0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 shutdown_connections 2023-10-14T18:45:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d90067510 0x7f3d900699c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da40ccec0 0x7f3da40bb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3da40b0020 0x7f3da417f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 --2- 172.21.15.79:0/3657187816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3da40ccaf0 0x7f3da40bb460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 >> 172.21.15.79:0/3657187816 conn(0x7f3da4070700 msgr2=0x7f3da40c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 shutdown_connections 2023-10-14T18:45:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.224+0000 7f3dac3a3700 1 -- 172.21.15.79:0/3657187816 wait complete. 2023-10-14T18:45:23.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-14T18:45:23.238 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:23.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T18:45:23.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:23.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 Processor -- start 2023-10-14T18:45:23.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 -- start start 2023-10-14T18:45:23.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99a8157870 0x7f99a815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a8157c40 0x7f99a8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a815cbb0 con 0x7f99a815a620 2023-10-14T18:45:23.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a815bfa0 con 0x7f99a8157870 2023-10-14T18:45:23.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.390+0000 7f99ad039700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a815c280 con 0x7f99a8157c40 2023-10-14T18:45:23.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99a8157870 0x7f99a815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99a815a620 0x7f99a815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45608/0 (socket says 172.21.15.79:45608) 2023-10-14T18:45:23.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a659c700 1 -- 172.21.15.79:0/3611590319 learned_addr learned my addr 172.21.15.79:0/3611590319 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:23.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99a8157870 0x7f99a815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59732/0 (socket says 172.21.15.79:59732) 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 -- 172.21.15.79:0/3611590319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a8157c40 msgr2=0x7f99a8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/3611590319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a8157c40 0x7f99a8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 -- 172.21.15.79:0/3611590319 >> v1:172.21.15.79:6789/0 conn(0x7f99a815a620 legacy=0x7f99a815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a5d9b700 1 -- 172.21.15.79:0/3611590319 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503171045 0 0) 0x7f99a815cbb0 con 0x7f99a815a620 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 -- 172.21.15.79:0/3611590319 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a815c560 con 0x7f99a8157870 2023-10-14T18:45:23.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/3611590319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157870 0x7f99a815b6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99980098e0 tx=0x7f99980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe817a19d324167 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a5d9b700 1 -- 172.21.15.79:0/3611590319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998009e80 con 0x7f99a8157870 2023-10-14T18:45:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a5d9b700 1 -- 172.21.15.79:0/3611590319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800b860 con 0x7f99a8157870 2023-10-14T18:45:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.391+0000 7f99a5d9b700 1 -- 172.21.15.79:0/3611590319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800bbe0 con 0x7f99a8157870 2023-10-14T18:45:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 -- 172.21.15.79:0/3611590319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157870 msgr2=0x7f99a815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 --2- 172.21.15.79:0/3611590319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157870 0x7f99a815b6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99980098e0 tx=0x7f99980091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 -- 172.21.15.79:0/3611590319 shutdown_connections 2023-10-14T18:45:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 --2- 172.21.15.79:0/3611590319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a8157c40 0x7f99a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 --2- 172.21.15.79:0/3611590319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157870 0x7f99a815b6a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 -- 172.21.15.79:0/3611590319 >> 172.21.15.79:0/3611590319 conn(0x7f99a8068ce0 msgr2=0x7f99a80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 -- 172.21.15.79:0/3611590319 shutdown_connections 2023-10-14T18:45:23.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.392+0000 7f99ad039700 1 -- 172.21.15.79:0/3611590319 wait complete. 2023-10-14T18:45:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.393+0000 7f99ad039700 1 Processor -- start 2023-10-14T18:45:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.393+0000 7f99ad039700 1 -- start start 2023-10-14T18:45:23.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 0x7f99a8150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 0x7f99a814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8153010 con 0x7f99a8157c40 2023-10-14T18:45:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8152440 con 0x7f99a8157870 2023-10-14T18:45:23.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81526e0 con 0x7f99a815a620 2023-10-14T18:45:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59738/0 (socket says 172.21.15.79:59738) 2023-10-14T18:45:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 -- 172.21.15.79:0/405432703 learned_addr learned my addr 172.21.15.79:0/405432703 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 0x7f99a8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a759e700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 0x7f99a814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 -- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 msgr2=0x7f99a814d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 0x7f99a814d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 -- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 msgr2=0x7f99a8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 0x7f99a8150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 -- 172.21.15.79:0/405432703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009420 con 0x7f99a8157c40 2023-10-14T18:45:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 0x7f99a8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a759e700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 0x7f99a814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99a659c700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c5e0 tx=0x7f999c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c005b30 con 0x7f99a8157c40 2023-10-14T18:45:23.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c005c90 con 0x7f99a8157c40 2023-10-14T18:45:23.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a81529c0 con 0x7f99a8157c40 2023-10-14T18:45:23.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.394+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c007300 con 0x7f99a8157c40 2023-10-14T18:45:23.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.395+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a8150a70 con 0x7f99a8157c40 2023-10-14T18:45:23.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.395+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a804c3c0 con 0x7f99a8157c40 2023-10-14T18:45:23.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.396+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f999c0076b0 con 0x7f99a8157c40 2023-10-14T18:45:23.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.396+0000 7f998effd700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.396+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f999c083a60 con 0x7f99a8157c40 2023-10-14T18:45:23.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.396+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.397+0000 7f99a6d9d700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99980091e0 tx=0x7f9998017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.400+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f999c050cd0 con 0x7f99a8157c40 2023-10-14T18:45:23.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.583+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99a8153150 con 0x7f9994066f30 2023-10-14T18:45:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.591+0000 7f998effd700 1 -- 172.21.15.79:0/405432703 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7f99a8153150 con 0x7f9994066f30 2023-10-14T18:45:23.595 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:23.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 msgr2=0x7f99940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99980091e0 tx=0x7f9998017000 comp rx=0 tx=0).stop 2023-10-14T18:45:23.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 msgr2=0x7f99a814cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c5e0 tx=0x7f999c000fe0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 shutdown_connections 2023-10-14T18:45:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99a815a620 0x7f99a814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99a8157870 0x7f99a8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 --2- 172.21.15.79:0/405432703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99a8157c40 0x7f99a814cc60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 >> 172.21.15.79:0/405432703 conn(0x7f99a8068ce0 msgr2=0x7f99a80b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 shutdown_connections 2023-10-14T18:45:23.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.594+0000 7f99ad039700 1 -- 172.21.15.79:0/405432703 wait complete. 2023-10-14T18:45:23.600 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:23.607 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T18:45:22.337209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.843624"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505788+0000","last_change":"2023-10-14T18:45:10.504806+0000","last_active":"2023-10-14T18:45:10.505788+0000","last_peered":"2023-10-14T18:45:10.505788+0000","last_clean":"2023-10-14T18:45:10.505788+0000","last_became_active":"2023-10-14T18:45:10.504592+0000","last_became_peered":"2023-10-14T18:45:10.504592+0000","last_unstale":"2023-10-14T18:45:10.505788+0000","last_undegraded":"2023-10-14T18:45:10.505788+0000","last_fullsized":"2023-10-14T18:45:10.505788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501740+0000","last_change":"2023-10-14T18:45:10.501684+0000","last_active":"2023-10-14T18:45:10.501740+0000","last_peered":"2023-10-14T18:45:10.501740+0000","last_clean":"2023-10-14T18:45:10.501740+0000","last_became_active":"2023-10-14T18:45:10.501468+0000","last_became_peered":"2023-10-14T18:45:10.501468+0000","last_unstale":"2023-10-14T18:45:10.501740+0000","last_undegraded":"2023-10-14T18:45:10.501740+0000","last_fullsized":"2023-10-14T18:45:10.501740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501737+0000","last_change":"2023-10-14T18:45:10.501682+0000","last_active":"2023-10-14T18:45:10.501737+0000","last_peered":"2023-10-14T18:45:10.501737+0000","last_clean":"2023-10-14T18:45:10.501737+0000","last_became_active":"2023-10-14T18:45:10.501209+0000","last_became_peered":"2023-10-14T18:45:10.501209+0000","last_unstale":"2023-10-14T18:45:10.501737+0000","last_undegraded":"2023-10-14T18:45:10.501737+0000","last_fullsized":"2023-10-14T18:45:10.501737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510790+0000","last_change":"2023-10-14T18:45:10.508252+0000","last_active":"2023-10-14T18:45:10.510790+0000","last_peered":"2023-10-14T18:45:10.510790+0000","last_clean":"2023-10-14T18:45:10.510790+0000","last_became_active":"2023-10-14T18:45:10.506413+0000","last_became_peered":"2023-10-14T18:45:10.506413+0000","last_unstale":"2023-10-14T18:45:10.510790+0000","last_undegraded":"2023-10-14T18:45:10.510790+0000","last_fullsized":"2023-10-14T18:45:10.510790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502782+0000","last_change":"2023-10-14T18:45:10.502278+0000","last_active":"2023-10-14T18:45:10.502782+0000","last_peered":"2023-10-14T18:45:10.502782+0000","last_clean":"2023-10-14T18:45:10.502782+0000","last_became_active":"2023-10-14T18:45:10.502034+0000","last_became_peered":"2023-10-14T18:45:10.502034+0000","last_unstale":"2023-10-14T18:45:10.502782+0000","last_undegraded":"2023-10-14T18:45:10.502782+0000","last_fullsized":"2023-10-14T18:45:10.502782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511005+0000","last_change":"2023-10-14T18:45:10.510963+0000","last_active":"2023-10-14T18:45:10.511005+0000","last_peered":"2023-10-14T18:45:10.511005+0000","last_clean":"2023-10-14T18:45:10.511005+0000","last_became_active":"2023-10-14T18:45:10.509764+0000","last_became_peered":"2023-10-14T18:45:10.509764+0000","last_unstale":"2023-10-14T18:45:10.511005+0000","last_undegraded":"2023-10-14T18:45:10.511005+0000","last_fullsized":"2023-10-14T18:45:10.511005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499650+0000","last_change":"2023-10-14T18:45:10.499583+0000","last_active":"2023-10-14T18:45:10.499650+0000","last_peered":"2023-10-14T18:45:10.499650+0000","last_clean":"2023-10-14T18:45:10.499650+0000","last_became_active":"2023-10-14T18:45:10.499349+0000","last_became_peered":"2023-10-14T18:45:10.499349+0000","last_unstale":"2023-10-14T18:45:10.499650+0000","last_undegraded":"2023-10-14T18:45:10.499650+0000","last_fullsized":"2023-10-14T18:45:10.499650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502699+0000","last_change":"2023-10-14T18:45:10.502642+0000","last_active":"2023-10-14T18:45:10.502699+0000","last_peered":"2023-10-14T18:45:10.502699+0000","last_clean":"2023-10-14T18:45:10.502699+0000","last_became_active":"2023-10-14T18:45:10.502429+0000","last_became_peered":"2023-10-14T18:45:10.502429+0000","last_unstale":"2023-10-14T18:45:10.502699+0000","last_undegraded":"2023-10-14T18:45:10.502699+0000","last_fullsized":"2023-10-14T18:45:10.502699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508406+0000","last_change":"2023-10-14T18:45:10.507819+0000","last_active":"2023-10-14T18:45:10.508406+0000","last_peered":"2023-10-14T18:45:10.508406+0000","last_clean":"2023-10-14T18:45:10.508406+0000","last_became_active":"2023-10-14T18:45:10.506697+0000","last_became_peered":"2023-10-14T18:45:10.506697+0000","last_unstale":"2023-10-14T18:45:10.508406+0000","last_undegraded":"2023-10-14T18:45:10.508406+0000","last_fullsized":"2023-10-14T18:45:10.508406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:15.231896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503640+0000","last_change":"2023-10-14T18:45:10.503569+0000","last_active":"2023-10-14T18:45:10.503640+0000","last_peered":"2023-10-14T18:45:10.503640+0000","last_clean":"2023-10-14T18:45:10.503640+0000","last_became_active":"2023-10-14T18:45:10.503321+0000","last_became_peered":"2023-10-14T18:45:10.503321+0000","last_unstale":"2023-10-14T18:45:10.503640+0000","last_undegraded":"2023-10-14T18:45:10.503640+0000","last_fullsized":"2023-10-14T18:45:10.503640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.510687+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.510465+0000","last_became_peered":"2023-10-14T18:45:10.510465+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509012+0000","last_change":"2023-10-14T18:45:10.508916+0000","last_active":"2023-10-14T18:45:10.509012+0000","last_peered":"2023-10-14T18:45:10.509012+0000","last_clean":"2023-10-14T18:45:10.509012+0000","last_became_active":"2023-10-14T18:45:10.508688+0000","last_became_peered":"2023-10-14T18:45:10.508688+0000","last_unstale":"2023-10-14T18:45:10.509012+0000","last_undegraded":"2023-10-14T18:45:10.509012+0000","last_fullsized":"2023-10-14T18:45:10.509012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:53.054157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501887+0000","last_change":"2023-10-14T18:45:10.499725+0000","last_active":"2023-10-14T18:45:10.501887+0000","last_peered":"2023-10-14T18:45:10.501887+0000","last_clean":"2023-10-14T18:45:10.501887+0000","last_became_active":"2023-10-14T18:45:10.499536+0000","last_became_peered":"2023-10-14T18:45:10.499536+0000","last_unstale":"2023-10-14T18:45:10.501887+0000","last_undegraded":"2023-10-14T18:45:10.501887+0000","last_fullsized":"2023-10-14T18:45:10.501887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500498+0000","last_change":"2023-10-14T18:45:10.500406+0000","last_active":"2023-10-14T18:45:10.500498+0000","last_peered":"2023-10-14T18:45:10.500498+0000","last_clean":"2023-10-14T18:45:10.500498+0000","last_became_active":"2023-10-14T18:45:10.500169+0000","last_became_peered":"2023-10-14T18:45:10.500169+0000","last_unstale":"2023-10-14T18:45:10.500498+0000","last_undegraded":"2023-10-14T18:45:10.500498+0000","last_fullsized":"2023-10-14T18:45:10.500498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509572+0000","last_change":"2023-10-14T18:45:10.509512+0000","last_active":"2023-10-14T18:45:10.509572+0000","last_peered":"2023-10-14T18:45:10.509572+0000","last_clean":"2023-10-14T18:45:10.509572+0000","last_became_active":"2023-10-14T18:45:10.509284+0000","last_became_peered":"2023-10-14T18:45:10.509284+0000","last_unstale":"2023-10-14T18:45:10.509572+0000","last_undegraded":"2023-10-14T18:45:10.509572+0000","last_fullsized":"2023-10-14T18:45:10.509572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510815+0000","last_change":"2023-10-14T18:45:10.510079+0000","last_active":"2023-10-14T18:45:10.510815+0000","last_peered":"2023-10-14T18:45:10.510815+0000","last_clean":"2023-10-14T18:45:10.510815+0000","last_became_active":"2023-10-14T18:45:10.506192+0000","last_became_peered":"2023-10-14T18:45:10.506192+0000","last_unstale":"2023-10-14T18:45:10.510815+0000","last_undegraded":"2023-10-14T18:45:10.510815+0000","last_fullsized":"2023-10-14T18:45:10.510815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512268+0000","last_change":"2023-10-14T18:45:10.512204+0000","last_active":"2023-10-14T18:45:10.512268+0000","last_peered":"2023-10-14T18:45:10.512268+0000","last_clean":"2023-10-14T18:45:10.512268+0000","last_became_active":"2023-10-14T18:45:10.511231+0000","last_became_peered":"2023-10-14T18:45:10.511231+0000","last_unstale":"2023-10-14T18:45:10.512268+0000","last_undegraded":"2023-10-14T18:45:10.512268+0000","last_fullsized":"2023-10-14T18:45:10.512268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500876+0000","last_change":"2023-10-14T18:45:10.500810+0000","last_active":"2023-10-14T18:45:10.500876+0000","last_peered":"2023-10-14T18:45:10.500876+0000","last_clean":"2023-10-14T18:45:10.500876+0000","last_became_active":"2023-10-14T18:45:10.500601+0000","last_became_peered":"2023-10-14T18:45:10.500601+0000","last_unstale":"2023-10-14T18:45:10.500876+0000","last_undegraded":"2023-10-14T18:45:10.500876+0000","last_fullsized":"2023-10-14T18:45:10.500876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508428+0000","last_change":"2023-10-14T18:45:10.508118+0000","last_active":"2023-10-14T18:45:10.508428+0000","last_peered":"2023-10-14T18:45:10.508428+0000","last_clean":"2023-10-14T18:45:10.508428+0000","last_became_active":"2023-10-14T18:45:10.507261+0000","last_became_peered":"2023-10-14T18:45:10.507261+0000","last_unstale":"2023-10-14T18:45:10.508428+0000","last_undegraded":"2023-10-14T18:45:10.508428+0000","last_fullsized":"2023-10-14T18:45:10.508428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:43.467593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516240+0000","last_change":"2023-10-14T18:45:09.502434+0000","last_active":"2023-10-14T18:45:10.516240+0000","last_peered":"2023-10-14T18:45:10.516240+0000","last_clean":"2023-10-14T18:45:10.516240+0000","last_became_active":"2023-10-14T18:45:09.502209+0000","last_became_peered":"2023-10-14T18:45:09.502209+0000","last_unstale":"2023-10-14T18:45:10.516240+0000","last_undegraded":"2023-10-14T18:45:10.516240+0000","last_fullsized":"2023-10-14T18:45:10.516240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502473+0000","last_change":"2023-10-14T18:45:10.502419+0000","last_active":"2023-10-14T18:45:10.502473+0000","last_peered":"2023-10-14T18:45:10.502473+0000","last_clean":"2023-10-14T18:45:10.502473+0000","last_became_active":"2023-10-14T18:45:10.502191+0000","last_became_peered":"2023-10-14T18:45:10.502191+0000","last_unstale":"2023-10-14T18:45:10.502473+0000","last_undegraded":"2023-10-14T18:45:10.502473+0000","last_fullsized":"2023-10-14T18:45:10.502473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518917+0000","last_change":"2023-10-14T18:45:09.495053+0000","last_active":"2023-10-14T18:45:10.518917+0000","last_peered":"2023-10-14T18:45:10.518917+0000","last_clean":"2023-10-14T18:45:10.518917+0000","last_became_active":"2023-10-14T18:45:09.494826+0000","last_became_peered":"2023-10-14T18:45:09.494826+0000","last_unstale":"2023-10-14T18:45:10.518917+0000","last_undegraded":"2023-10-14T18:45:10.518917+0000","last_fullsized":"2023-10-14T18:45:10.518917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501605+0000","last_change":"2023-10-14T18:45:10.501557+0000","last_active":"2023-10-14T18:45:10.501605+0000","last_peered":"2023-10-14T18:45:10.501605+0000","last_clean":"2023-10-14T18:45:10.501605+0000","last_became_active":"2023-10-14T18:45:10.500923+0000","last_became_peered":"2023-10-14T18:45:10.500923+0000","last_unstale":"2023-10-14T18:45:10.501605+0000","last_undegraded":"2023-10-14T18:45:10.501605+0000","last_fullsized":"2023-10-14T18:45:10.501605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516200+0000","last_change":"2023-10-14T18:45:09.505639+0000","last_active":"2023-10-14T18:45:10.516200+0000","last_peered":"2023-10-14T18:45:10.516200+0000","last_clean":"2023-10-14T18:45:10.516200+0000","last_became_active":"2023-10-14T18:45:09.505410+0000","last_became_peered":"2023-10-14T18:45:09.505410+0000","last_unstale":"2023-10-14T18:45:10.516200+0000","last_undegraded":"2023-10-14T18:45:10.516200+0000","last_fullsized":"2023-10-14T18:45:10.516200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511210+0000","last_change":"2023-10-14T18:45:10.511079+0000","last_active":"2023-10-14T18:45:10.511210+0000","last_peered":"2023-10-14T18:45:10.511210+0000","last_clean":"2023-10-14T18:45:10.511210+0000","last_became_active":"2023-10-14T18:45:10.510806+0000","last_became_peered":"2023-10-14T18:45:10.510806+0000","last_unstale":"2023-10-14T18:45:10.511210+0000","last_undegraded":"2023-10-14T18:45:10.511210+0000","last_fullsized":"2023-10-14T18:45:10.511210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515405+0000","last_change":"2023-10-14T18:45:09.504487+0000","last_active":"2023-10-14T18:45:10.515405+0000","last_peered":"2023-10-14T18:45:10.515405+0000","last_clean":"2023-10-14T18:45:10.515405+0000","last_became_active":"2023-10-14T18:45:09.504255+0000","last_became_peered":"2023-10-14T18:45:09.504255+0000","last_unstale":"2023-10-14T18:45:10.515405+0000","last_undegraded":"2023-10-14T18:45:10.515405+0000","last_fullsized":"2023-10-14T18:45:10.515405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:56.816202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511025+0000","last_change":"2023-10-14T18:45:10.510969+0000","last_active":"2023-10-14T18:45:10.511025+0000","last_peered":"2023-10-14T18:45:10.511025+0000","last_clean":"2023-10-14T18:45:10.511025+0000","last_became_active":"2023-10-14T18:45:10.510799+0000","last_became_peered":"2023-10-14T18:45:10.510799+0000","last_unstale":"2023-10-14T18:45:10.511025+0000","last_undegraded":"2023-10-14T18:45:10.511025+0000","last_fullsized":"2023-10-14T18:45:10.511025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518837+0000","last_change":"2023-10-14T18:45:09.500085+0000","last_active":"2023-10-14T18:45:10.518837+0000","last_peered":"2023-10-14T18:45:10.518837+0000","last_clean":"2023-10-14T18:45:10.518837+0000","last_became_active":"2023-10-14T18:45:09.499843+0000","last_became_peered":"2023-10-14T18:45:09.499843+0000","last_unstale":"2023-10-14T18:45:10.518837+0000","last_undegraded":"2023-10-14T18:45:10.518837+0000","last_fullsized":"2023-10-14T18:45:10.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503509+0000","last_change":"2023-10-14T18:45:10.503087+0000","last_active":"2023-10-14T18:45:10.503509+0000","last_peered":"2023-10-14T18:45:10.503509+0000","last_clean":"2023-10-14T18:45:10.503509+0000","last_became_active":"2023-10-14T18:45:10.502874+0000","last_became_peered":"2023-10-14T18:45:10.502874+0000","last_unstale":"2023-10-14T18:45:10.503509+0000","last_undegraded":"2023-10-14T18:45:10.503509+0000","last_fullsized":"2023-10-14T18:45:10.503509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:44.694101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516052+0000","last_change":"2023-10-14T18:45:09.500407+0000","last_active":"2023-10-14T18:45:10.516052+0000","last_peered":"2023-10-14T18:45:10.516052+0000","last_clean":"2023-10-14T18:45:10.516052+0000","last_became_active":"2023-10-14T18:45:09.500159+0000","last_became_peered":"2023-10-14T18:45:09.500159+0000","last_unstale":"2023-10-14T18:45:10.516052+0000","last_undegraded":"2023-10-14T18:45:10.516052+0000","last_fullsized":"2023-10-14T18:45:10.516052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503008+0000","last_change":"2023-10-14T18:45:10.502958+0000","last_active":"2023-10-14T18:45:10.503008+0000","last_peered":"2023-10-14T18:45:10.503008+0000","last_clean":"2023-10-14T18:45:10.503008+0000","last_became_active":"2023-10-14T18:45:10.502750+0000","last_became_peered":"2023-10-14T18:45:10.502750+0000","last_unstale":"2023-10-14T18:45:10.503008+0000","last_undegraded":"2023-10-14T18:45:10.503008+0000","last_fullsized":"2023-10-14T18:45:10.503008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:08.710513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493584+0000","last_change":"2023-10-14T18:45:09.500758+0000","last_active":"2023-10-14T18:45:10.493584+0000","last_peered":"2023-10-14T18:45:10.493584+0000","last_clean":"2023-10-14T18:45:10.493584+0000","last_became_active":"2023-10-14T18:45:09.500521+0000","last_became_peered":"2023-10-14T18:45:09.500521+0000","last_unstale":"2023-10-14T18:45:10.493584+0000","last_undegraded":"2023-10-14T18:45:10.493584+0000","last_fullsized":"2023-10-14T18:45:10.493584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495482+0000","last_change":"2023-10-14T18:45:10.495391+0000","last_active":"2023-10-14T18:45:10.495482+0000","last_peered":"2023-10-14T18:45:10.495482+0000","last_clean":"2023-10-14T18:45:10.495482+0000","last_became_active":"2023-10-14T18:45:10.495163+0000","last_became_peered":"2023-10-14T18:45:10.495163+0000","last_unstale":"2023-10-14T18:45:10.495482+0000","last_undegraded":"2023-10-14T18:45:10.495482+0000","last_fullsized":"2023-10-14T18:45:10.495482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499343+0000","last_change":"2023-10-14T18:45:09.504439+0000","last_active":"2023-10-14T18:45:10.499343+0000","last_peered":"2023-10-14T18:45:10.499343+0000","last_clean":"2023-10-14T18:45:10.499343+0000","last_became_active":"2023-10-14T18:45:09.503977+0000","last_became_peered":"2023-10-14T18:45:09.503977+0000","last_unstale":"2023-10-14T18:45:10.499343+0000","last_undegraded":"2023-10-14T18:45:10.499343+0000","last_fullsized":"2023-10-14T18:45:10.499343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500472+0000","last_change":"2023-10-14T18:45:10.500298+0000","last_active":"2023-10-14T18:45:10.500472+0000","last_peered":"2023-10-14T18:45:10.500472+0000","last_clean":"2023-10-14T18:45:10.500472+0000","last_became_active":"2023-10-14T18:45:10.500086+0000","last_became_peered":"2023-10-14T18:45:10.500086+0000","last_unstale":"2023-10-14T18:45:10.500472+0000","last_undegraded":"2023-10-14T18:45:10.500472+0000","last_fullsized":"2023-10-14T18:45:10.500472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498655+0000","last_change":"2023-10-14T18:45:09.503955+0000","last_active":"2023-10-14T18:45:10.498655+0000","last_peered":"2023-10-14T18:45:10.498655+0000","last_clean":"2023-10-14T18:45:10.498655+0000","last_became_active":"2023-10-14T18:45:09.503727+0000","last_became_peered":"2023-10-14T18:45:09.503727+0000","last_unstale":"2023-10-14T18:45:10.498655+0000","last_undegraded":"2023-10-14T18:45:10.498655+0000","last_fullsized":"2023-10-14T18:45:10.498655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502492+0000","last_change":"2023-10-14T18:45:10.502425+0000","last_active":"2023-10-14T18:45:10.502492+0000","last_peered":"2023-10-14T18:45:10.502492+0000","last_clean":"2023-10-14T18:45:10.502492+0000","last_became_active":"2023-10-14T18:45:10.502206+0000","last_became_peered":"2023-10-14T18:45:10.502206+0000","last_unstale":"2023-10-14T18:45:10.502492+0000","last_undegraded":"2023-10-14T18:45:10.502492+0000","last_fullsized":"2023-10-14T18:45:10.502492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500075+0000","last_change":"2023-10-14T18:45:09.505574+0000","last_active":"2023-10-14T18:45:10.500075+0000","last_peered":"2023-10-14T18:45:10.500075+0000","last_clean":"2023-10-14T18:45:10.500075+0000","last_became_active":"2023-10-14T18:45:09.504963+0000","last_became_peered":"2023-10-14T18:45:09.504963+0000","last_unstale":"2023-10-14T18:45:10.500075+0000","last_undegraded":"2023-10-14T18:45:10.500075+0000","last_fullsized":"2023-10-14T18:45:10.500075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507028+0000","last_change":"2023-10-14T18:45:10.506952+0000","last_active":"2023-10-14T18:45:10.507028+0000","last_peered":"2023-10-14T18:45:10.507028+0000","last_clean":"2023-10-14T18:45:10.507028+0000","last_became_active":"2023-10-14T18:45:10.506621+0000","last_became_peered":"2023-10-14T18:45:10.506621+0000","last_unstale":"2023-10-14T18:45:10.507028+0000","last_undegraded":"2023-10-14T18:45:10.507028+0000","last_fullsized":"2023-10-14T18:45:10.507028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515309+0000","last_change":"2023-10-14T18:45:09.501054+0000","last_active":"2023-10-14T18:45:10.515309+0000","last_peered":"2023-10-14T18:45:10.515309+0000","last_clean":"2023-10-14T18:45:10.515309+0000","last_became_active":"2023-10-14T18:45:09.500522+0000","last_became_peered":"2023-10-14T18:45:09.500522+0000","last_unstale":"2023-10-14T18:45:10.515309+0000","last_undegraded":"2023-10-14T18:45:10.515309+0000","last_fullsized":"2023-10-14T18:45:10.515309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507400+0000","last_change":"2023-10-14T18:45:10.507329+0000","last_active":"2023-10-14T18:45:10.507400+0000","last_peered":"2023-10-14T18:45:10.507400+0000","last_clean":"2023-10-14T18:45:10.507400+0000","last_became_active":"2023-10-14T18:45:10.507042+0000","last_became_peered":"2023-10-14T18:45:10.507042+0000","last_unstale":"2023-10-14T18:45:10.507400+0000","last_undegraded":"2023-10-14T18:45:10.507400+0000","last_fullsized":"2023-10-14T18:45:10.507400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.519581+0000","last_change":"2023-10-14T18:45:09.502428+0000","last_active":"2023-10-14T18:45:10.519581+0000","last_peered":"2023-10-14T18:45:10.519581+0000","last_clean":"2023-10-14T18:45:10.519581+0000","last_became_active":"2023-10-14T18:45:09.502204+0000","last_became_peered":"2023-10-14T18:45:09.502204+0000","last_unstale":"2023-10-14T18:45:10.519581+0000","last_undegraded":"2023-10-14T18:45:10.519581+0000","last_fullsized":"2023-10-14T18:45:10.519581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505808+0000","last_change":"2023-10-14T18:45:10.505484+0000","last_active":"2023-10-14T18:45:10.505808+0000","last_peered":"2023-10-14T18:45:10.505808+0000","last_clean":"2023-10-14T18:45:10.505808+0000","last_became_active":"2023-10-14T18:45:10.505215+0000","last_became_peered":"2023-10-14T18:45:10.505215+0000","last_unstale":"2023-10-14T18:45:10.505808+0000","last_undegraded":"2023-10-14T18:45:10.505808+0000","last_fullsized":"2023-10-14T18:45:10.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516904+0000","last_change":"2023-10-14T18:45:09.500718+0000","last_active":"2023-10-14T18:45:10.516904+0000","last_peered":"2023-10-14T18:45:10.516904+0000","last_clean":"2023-10-14T18:45:10.516904+0000","last_became_active":"2023-10-14T18:45:09.500458+0000","last_became_peered":"2023-10-14T18:45:09.500458+0000","last_unstale":"2023-10-14T18:45:10.516904+0000","last_undegraded":"2023-10-14T18:45:10.516904+0000","last_fullsized":"2023-10-14T18:45:10.516904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496812+0000","last_change":"2023-10-14T18:45:10.496651+0000","last_active":"2023-10-14T18:45:10.496812+0000","last_peered":"2023-10-14T18:45:10.496812+0000","last_clean":"2023-10-14T18:45:10.496812+0000","last_became_active":"2023-10-14T18:45:10.496150+0000","last_became_peered":"2023-10-14T18:45:10.496150+0000","last_unstale":"2023-10-14T18:45:10.496812+0000","last_undegraded":"2023-10-14T18:45:10.496812+0000","last_fullsized":"2023-10-14T18:45:10.496812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500483+0000","last_change":"2023-10-14T18:45:09.503379+0000","last_active":"2023-10-14T18:45:10.500483+0000","last_peered":"2023-10-14T18:45:10.500483+0000","last_clean":"2023-10-14T18:45:10.500483+0000","last_became_active":"2023-10-14T18:45:09.503137+0000","last_became_peered":"2023-10-14T18:45:09.503137+0000","last_unstale":"2023-10-14T18:45:10.500483+0000","last_undegraded":"2023-10-14T18:45:10.500483+0000","last_fullsized":"2023-10-14T18:45:10.500483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510222+0000","last_change":"2023-10-14T18:45:10.509982+0000","last_active":"2023-10-14T18:45:10.510222+0000","last_peered":"2023-10-14T18:45:10.510222+0000","last_clean":"2023-10-14T18:45:10.510222+0000","last_became_active":"2023-10-14T18:45:10.509462+0000","last_became_peered":"2023-10-14T18:45:10.509462+0000","last_unstale":"2023-10-14T18:45:10.510222+0000","last_undegraded":"2023-10-14T18:45:10.510222+0000","last_fullsized":"2023-10-14T18:45:10.510222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498432+0000","last_change":"2023-10-14T18:45:09.502982+0000","last_active":"2023-10-14T18:45:10.498432+0000","last_peered":"2023-10-14T18:45:10.498432+0000","last_clean":"2023-10-14T18:45:10.498432+0000","last_became_active":"2023-10-14T18:45:09.499379+0000","last_became_peered":"2023-10-14T18:45:09.499379+0000","last_unstale":"2023-10-14T18:45:10.498432+0000","last_undegraded":"2023-10-14T18:45:10.498432+0000","last_fullsized":"2023-10-14T18:45:10.498432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505816+0000","last_change":"2023-10-14T18:45:10.504993+0000","last_active":"2023-10-14T18:45:10.505816+0000","last_peered":"2023-10-14T18:45:10.505816+0000","last_clean":"2023-10-14T18:45:10.505816+0000","last_became_active":"2023-10-14T18:45:10.504493+0000","last_became_peered":"2023-10-14T18:45:10.504493+0000","last_unstale":"2023-10-14T18:45:10.505816+0000","last_undegraded":"2023-10-14T18:45:10.505816+0000","last_fullsized":"2023-10-14T18:45:10.505816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516768+0000","last_change":"2023-10-14T18:45:09.498248+0000","last_active":"2023-10-14T18:45:10.516768+0000","last_peered":"2023-10-14T18:45:10.516768+0000","last_clean":"2023-10-14T18:45:10.516768+0000","last_became_active":"2023-10-14T18:45:09.498027+0000","last_became_peered":"2023-10-14T18:45:09.498027+0000","last_unstale":"2023-10-14T18:45:10.516768+0000","last_undegraded":"2023-10-14T18:45:10.516768+0000","last_fullsized":"2023-10-14T18:45:10.516768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503199+0000","last_change":"2023-10-14T18:45:10.503098+0000","last_active":"2023-10-14T18:45:10.503199+0000","last_peered":"2023-10-14T18:45:10.503199+0000","last_clean":"2023-10-14T18:45:10.503199+0000","last_became_active":"2023-10-14T18:45:10.502805+0000","last_became_peered":"2023-10-14T18:45:10.502805+0000","last_unstale":"2023-10-14T18:45:10.503199+0000","last_undegraded":"2023-10-14T18:45:10.503199+0000","last_fullsized":"2023-10-14T18:45:10.503199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515581+0000","last_change":"2023-10-14T18:45:09.500202+0000","last_active":"2023-10-14T18:45:10.515581+0000","last_peered":"2023-10-14T18:45:10.515581+0000","last_clean":"2023-10-14T18:45:10.515581+0000","last_became_active":"2023-10-14T18:45:09.499922+0000","last_became_peered":"2023-10-14T18:45:09.499922+0000","last_unstale":"2023-10-14T18:45:10.515581+0000","last_undegraded":"2023-10-14T18:45:10.515581+0000","last_fullsized":"2023-10-14T18:45:10.515581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510239+0000","last_change":"2023-10-14T18:45:10.510150+0000","last_active":"2023-10-14T18:45:10.510239+0000","last_peered":"2023-10-14T18:45:10.510239+0000","last_clean":"2023-10-14T18:45:10.510239+0000","last_became_active":"2023-10-14T18:45:10.509761+0000","last_became_peered":"2023-10-14T18:45:10.509761+0000","last_unstale":"2023-10-14T18:45:10.510239+0000","last_undegraded":"2023-10-14T18:45:10.510239+0000","last_fullsized":"2023-10-14T18:45:10.510239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497491+0000","last_change":"2023-10-14T18:45:09.496779+0000","last_active":"2023-10-14T18:45:10.497491+0000","last_peered":"2023-10-14T18:45:10.497491+0000","last_clean":"2023-10-14T18:45:10.497491+0000","last_became_active":"2023-10-14T18:45:09.495762+0000","last_became_peered":"2023-10-14T18:45:09.495762+0000","last_unstale":"2023-10-14T18:45:10.497491+0000","last_undegraded":"2023-10-14T18:45:10.497491+0000","last_fullsized":"2023-10-14T18:45:10.497491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.507894+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.506095+0000","last_became_peered":"2023-10-14T18:45:10.506095+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500192+0000","last_change":"2023-10-14T18:45:09.502756+0000","last_active":"2023-10-14T18:45:10.500192+0000","last_peered":"2023-10-14T18:45:10.500192+0000","last_clean":"2023-10-14T18:45:10.500192+0000","last_became_active":"2023-10-14T18:45:09.502106+0000","last_became_peered":"2023-10-14T18:45:09.502106+0000","last_unstale":"2023-10-14T18:45:10.500192+0000","last_undegraded":"2023-10-14T18:45:10.500192+0000","last_fullsized":"2023-10-14T18:45:10.500192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503488+0000","last_change":"2023-10-14T18:45:10.502149+0000","last_active":"2023-10-14T18:45:10.503488+0000","last_peered":"2023-10-14T18:45:10.503488+0000","last_clean":"2023-10-14T18:45:10.503488+0000","last_became_active":"2023-10-14T18:45:10.501936+0000","last_became_peered":"2023-10-14T18:45:10.501936+0000","last_unstale":"2023-10-14T18:45:10.503488+0000","last_undegraded":"2023-10-14T18:45:10.503488+0000","last_fullsized":"2023-10-14T18:45:10.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:42.510534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499404+0000","last_change":"2023-10-14T18:45:10.499352+0000","last_active":"2023-10-14T18:45:10.499404+0000","last_peered":"2023-10-14T18:45:10.499404+0000","last_clean":"2023-10-14T18:45:10.499404+0000","last_became_active":"2023-10-14T18:45:10.499125+0000","last_became_peered":"2023-10-14T18:45:10.499125+0000","last_unstale":"2023-10-14T18:45:10.499404+0000","last_undegraded":"2023-10-14T18:45:10.499404+0000","last_fullsized":"2023-10-14T18:45:10.499404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497717+0000","last_change":"2023-10-14T18:45:09.499972+0000","last_active":"2023-10-14T18:45:10.497717+0000","last_peered":"2023-10-14T18:45:10.497717+0000","last_clean":"2023-10-14T18:45:10.497717+0000","last_became_active":"2023-10-14T18:45:09.499750+0000","last_became_peered":"2023-10-14T18:45:09.499750+0000","last_unstale":"2023-10-14T18:45:10.497717+0000","last_undegraded":"2023-10-14T18:45:10.497717+0000","last_fullsized":"2023-10-14T18:45:10.497717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502621+0000","last_change":"2023-10-14T18:45:10.502562+0000","last_active":"2023-10-14T18:45:10.502621+0000","last_peered":"2023-10-14T18:45:10.502621+0000","last_clean":"2023-10-14T18:45:10.502621+0000","last_became_active":"2023-10-14T18:45:10.502354+0000","last_became_peered":"2023-10-14T18:45:10.502354+0000","last_unstale":"2023-10-14T18:45:10.502621+0000","last_undegraded":"2023-10-14T18:45:10.502621+0000","last_fullsized":"2023-10-14T18:45:10.502621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500588+0000","last_change":"2023-10-14T18:45:09.502815+0000","last_active":"2023-10-14T18:45:10.500588+0000","last_peered":"2023-10-14T18:45:10.500588+0000","last_clean":"2023-10-14T18:45:10.500588+0000","last_became_active":"2023-10-14T18:45:09.502586+0000","last_became_peered":"2023-10-14T18:45:09.502586+0000","last_unstale":"2023-10-14T18:45:10.500588+0000","last_undegraded":"2023-10-14T18:45:10.500588+0000","last_fullsized":"2023-10-14T18:45:10.500588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494733+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:10.494733+0000","last_peered":"2023-10-14T18:45:10.494733+0000","last_clean":"2023-10-14T18:45:10.494733+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:10.494733+0000","last_undegraded":"2023-10-14T18:45:10.494733+0000","last_fullsized":"2023-10-14T18:45:10.494733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506423+0000","last_change":"2023-10-14T18:45:10.506374+0000","last_active":"2023-10-14T18:45:10.506423+0000","last_peered":"2023-10-14T18:45:10.506423+0000","last_clean":"2023-10-14T18:45:10.506423+0000","last_became_active":"2023-10-14T18:45:10.506224+0000","last_became_peered":"2023-10-14T18:45:10.506224+0000","last_unstale":"2023-10-14T18:45:10.506423+0000","last_undegraded":"2023-10-14T18:45:10.506423+0000","last_fullsized":"2023-10-14T18:45:10.506423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493318+0000","last_change":"2023-10-14T18:45:09.504373+0000","last_active":"2023-10-14T18:45:10.493318+0000","last_peered":"2023-10-14T18:45:10.493318+0000","last_clean":"2023-10-14T18:45:10.493318+0000","last_became_active":"2023-10-14T18:45:09.504143+0000","last_became_peered":"2023-10-14T18:45:09.504143+0000","last_unstale":"2023-10-14T18:45:10.493318+0000","last_undegraded":"2023-10-14T18:45:10.493318+0000","last_fullsized":"2023-10-14T18:45:10.493318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493501+0000","last_change":"2023-10-14T18:45:09.506472+0000","last_active":"2023-10-14T18:45:10.493501+0000","last_peered":"2023-10-14T18:45:10.493501+0000","last_clean":"2023-10-14T18:45:10.493501+0000","last_became_active":"2023-10-14T18:45:09.506235+0000","last_became_peered":"2023-10-14T18:45:09.506235+0000","last_unstale":"2023-10-14T18:45:10.493501+0000","last_undegraded":"2023-10-14T18:45:10.493501+0000","last_fullsized":"2023-10-14T18:45:10.493501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499447+0000","last_change":"2023-10-14T18:45:10.499346+0000","last_active":"2023-10-14T18:45:10.499447+0000","last_peered":"2023-10-14T18:45:10.499447+0000","last_clean":"2023-10-14T18:45:10.499447+0000","last_became_active":"2023-10-14T18:45:10.499148+0000","last_became_peered":"2023-10-14T18:45:10.499148+0000","last_unstale":"2023-10-14T18:45:10.499447+0000","last_undegraded":"2023-10-14T18:45:10.499447+0000","last_fullsized":"2023-10-14T18:45:10.499447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T18:45:11.541163+0000","last_change":"2023-10-14T18:45:09.501194+0000","last_active":"2023-10-14T18:45:11.541163+0000","last_peered":"2023-10-14T18:45:11.541163+0000","last_clean":"2023-10-14T18:45:11.541163+0000","last_became_active":"2023-10-14T18:45:09.500823+0000","last_became_peered":"2023-10-14T18:45:09.500823+0000","last_unstale":"2023-10-14T18:45:11.541163+0000","last_undegraded":"2023-10-14T18:45:11.541163+0000","last_fullsized":"2023-10-14T18:45:11.541163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501838+0000","last_change":"2023-10-14T18:45:10.499131+0000","last_active":"2023-10-14T18:45:10.501838+0000","last_peered":"2023-10-14T18:45:10.501838+0000","last_clean":"2023-10-14T18:45:10.501838+0000","last_became_active":"2023-10-14T18:45:10.498855+0000","last_became_peered":"2023-10-14T18:45:10.498855+0000","last_unstale":"2023-10-14T18:45:10.501838+0000","last_undegraded":"2023-10-14T18:45:10.501838+0000","last_fullsized":"2023-10-14T18:45:10.501838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515364+0000","last_change":"2023-10-14T18:45:09.503127+0000","last_active":"2023-10-14T18:45:10.515364+0000","last_peered":"2023-10-14T18:45:10.515364+0000","last_clean":"2023-10-14T18:45:10.515364+0000","last_became_active":"2023-10-14T18:45:09.499701+0000","last_became_peered":"2023-10-14T18:45:09.499701+0000","last_unstale":"2023-10-14T18:45:10.515364+0000","last_undegraded":"2023-10-14T18:45:10.515364+0000","last_fullsized":"2023-10-14T18:45:10.515364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501481+0000","last_change":"2023-10-14T18:45:10.501420+0000","last_active":"2023-10-14T18:45:10.501481+0000","last_peered":"2023-10-14T18:45:10.501481+0000","last_clean":"2023-10-14T18:45:10.501481+0000","last_became_active":"2023-10-14T18:45:10.500635+0000","last_became_peered":"2023-10-14T18:45:10.500635+0000","last_unstale":"2023-10-14T18:45:10.501481+0000","last_undegraded":"2023-10-14T18:45:10.501481+0000","last_fullsized":"2023-10-14T18:45:10.501481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494616+0000","last_change":"2023-10-14T18:45:09.506431+0000","last_active":"2023-10-14T18:45:10.494616+0000","last_peered":"2023-10-14T18:45:10.494616+0000","last_clean":"2023-10-14T18:45:10.494616+0000","last_became_active":"2023-10-14T18:45:09.506187+0000","last_became_peered":"2023-10-14T18:45:09.506187+0000","last_unstale":"2023-10-14T18:45:10.494616+0000","last_undegraded":"2023-10-14T18:45:10.494616+0000","last_fullsized":"2023-10-14T18:45:10.494616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:17.117466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512381+0000","last_change":"2023-10-14T18:45:10.510948+0000","last_active":"2023-10-14T18:45:10.512381+0000","last_peered":"2023-10-14T18:45:10.512381+0000","last_clean":"2023-10-14T18:45:10.512381+0000","last_became_active":"2023-10-14T18:45:10.510290+0000","last_became_peered":"2023-10-14T18:45:10.510290+0000","last_unstale":"2023-10-14T18:45:10.512381+0000","last_undegraded":"2023-10-14T18:45:10.512381+0000","last_fullsized":"2023-10-14T18:45:10.512381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:36.074105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497573+0000","last_change":"2023-10-14T18:45:09.502242+0000","last_active":"2023-10-14T18:45:10.497573+0000","last_peered":"2023-10-14T18:45:10.497573+0000","last_clean":"2023-10-14T18:45:10.497573+0000","last_became_active":"2023-10-14T18:45:09.501997+0000","last_became_peered":"2023-10-14T18:45:09.501997+0000","last_unstale":"2023-10-14T18:45:10.497573+0000","last_undegraded":"2023-10-14T18:45:10.497573+0000","last_fullsized":"2023-10-14T18:45:10.497573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501857+0000","last_change":"2023-10-14T18:45:10.499268+0000","last_active":"2023-10-14T18:45:10.501857+0000","last_peered":"2023-10-14T18:45:10.501857+0000","last_clean":"2023-10-14T18:45:10.501857+0000","last_became_active":"2023-10-14T18:45:10.498937+0000","last_became_peered":"2023-10-14T18:45:10.498937+0000","last_unstale":"2023-10-14T18:45:10.501857+0000","last_undegraded":"2023-10-14T18:45:10.501857+0000","last_fullsized":"2023-10-14T18:45:10.501857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497497+0000","last_change":"2023-10-14T18:45:09.493047+0000","last_active":"2023-10-14T18:45:10.497497+0000","last_peered":"2023-10-14T18:45:10.497497+0000","last_clean":"2023-10-14T18:45:10.497497+0000","last_became_active":"2023-10-14T18:45:09.492815+0000","last_became_peered":"2023-10-14T18:45:09.492815+0000","last_unstale":"2023-10-14T18:45:10.497497+0000","last_undegraded":"2023-10-14T18:45:10.497497+0000","last_fullsized":"2023-10-14T18:45:10.497497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496137+0000","last_change":"2023-10-14T18:45:10.496060+0000","last_active":"2023-10-14T18:45:10.496137+0000","last_peered":"2023-10-14T18:45:10.496137+0000","last_clean":"2023-10-14T18:45:10.496137+0000","last_became_active":"2023-10-14T18:45:10.495823+0000","last_became_peered":"2023-10-14T18:45:10.495823+0000","last_unstale":"2023-10-14T18:45:10.496137+0000","last_undegraded":"2023-10-14T18:45:10.496137+0000","last_fullsized":"2023-10-14T18:45:10.496137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514544+0000","last_change":"2023-10-14T18:45:09.504130+0000","last_active":"2023-10-14T18:45:10.514544+0000","last_peered":"2023-10-14T18:45:10.514544+0000","last_clean":"2023-10-14T18:45:10.514544+0000","last_became_active":"2023-10-14T18:45:09.503874+0000","last_became_peered":"2023-10-14T18:45:09.503874+0000","last_unstale":"2023-10-14T18:45:10.514544+0000","last_undegraded":"2023-10-14T18:45:10.514544+0000","last_fullsized":"2023-10-14T18:45:10.514544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509075+0000","last_change":"2023-10-14T18:45:10.509017+0000","last_active":"2023-10-14T18:45:10.509075+0000","last_peered":"2023-10-14T18:45:10.509075+0000","last_clean":"2023-10-14T18:45:10.509075+0000","last_became_active":"2023-10-14T18:45:10.508852+0000","last_became_peered":"2023-10-14T18:45:10.508852+0000","last_unstale":"2023-10-14T18:45:10.509075+0000","last_undegraded":"2023-10-14T18:45:10.509075+0000","last_fullsized":"2023-10-14T18:45:10.509075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495578+0000","last_change":"2023-10-14T18:45:09.501600+0000","last_active":"2023-10-14T18:45:10.495578+0000","last_peered":"2023-10-14T18:45:10.495578+0000","last_clean":"2023-10-14T18:45:10.495578+0000","last_became_active":"2023-10-14T18:45:09.501418+0000","last_became_peered":"2023-10-14T18:45:09.501418+0000","last_unstale":"2023-10-14T18:45:10.495578+0000","last_undegraded":"2023-10-14T18:45:10.495578+0000","last_fullsized":"2023-10-14T18:45:10.495578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502764+0000","last_change":"2023-10-14T18:45:10.502085+0000","last_active":"2023-10-14T18:45:10.502764+0000","last_peered":"2023-10-14T18:45:10.502764+0000","last_clean":"2023-10-14T18:45:10.502764+0000","last_became_active":"2023-10-14T18:45:10.501863+0000","last_became_peered":"2023-10-14T18:45:10.501863+0000","last_unstale":"2023-10-14T18:45:10.502764+0000","last_undegraded":"2023-10-14T18:45:10.502764+0000","last_fullsized":"2023-10-14T18:45:10.502764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514342+0000","last_change":"2023-10-14T18:45:09.497704+0000","last_active":"2023-10-14T18:45:10.514342+0000","last_peered":"2023-10-14T18:45:10.514342+0000","last_clean":"2023-10-14T18:45:10.514342+0000","last_became_active":"2023-10-14T18:45:09.497481+0000","last_became_peered":"2023-10-14T18:45:09.497481+0000","last_unstale":"2023-10-14T18:45:10.514342+0000","last_undegraded":"2023-10-14T18:45:10.514342+0000","last_fullsized":"2023-10-14T18:45:10.514342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511729+0000","last_change":"2023-10-14T18:45:10.511661+0000","last_active":"2023-10-14T18:45:10.511729+0000","last_peered":"2023-10-14T18:45:10.511729+0000","last_clean":"2023-10-14T18:45:10.511729+0000","last_became_active":"2023-10-14T18:45:10.507807+0000","last_became_peered":"2023-10-14T18:45:10.507807+0000","last_unstale":"2023-10-14T18:45:10.511729+0000","last_undegraded":"2023-10-14T18:45:10.511729+0000","last_fullsized":"2023-10-14T18:45:10.511729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515251+0000","last_change":"2023-10-14T18:45:09.496750+0000","last_active":"2023-10-14T18:45:10.515251+0000","last_peered":"2023-10-14T18:45:10.515251+0000","last_clean":"2023-10-14T18:45:10.515251+0000","last_became_active":"2023-10-14T18:45:09.496512+0000","last_became_peered":"2023-10-14T18:45:09.496512+0000","last_unstale":"2023-10-14T18:45:10.515251+0000","last_undegraded":"2023-10-14T18:45:10.515251+0000","last_fullsized":"2023-10-14T18:45:10.515251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508444+0000","last_change":"2023-10-14T18:45:10.508346+0000","last_active":"2023-10-14T18:45:10.508444+0000","last_peered":"2023-10-14T18:45:10.508444+0000","last_clean":"2023-10-14T18:45:10.508444+0000","last_became_active":"2023-10-14T18:45:10.507586+0000","last_became_peered":"2023-10-14T18:45:10.507586+0000","last_unstale":"2023-10-14T18:45:10.508444+0000","last_undegraded":"2023-10-14T18:45:10.508444+0000","last_fullsized":"2023-10-14T18:45:10.508444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499036+0000","last_change":"2023-10-14T18:45:10.498971+0000","last_active":"2023-10-14T18:45:10.499036+0000","last_peered":"2023-10-14T18:45:10.499036+0000","last_clean":"2023-10-14T18:45:10.499036+0000","last_became_active":"2023-10-14T18:45:10.498667+0000","last_became_peered":"2023-10-14T18:45:10.498667+0000","last_unstale":"2023-10-14T18:45:10.499036+0000","last_undegraded":"2023-10-14T18:45:10.499036+0000","last_fullsized":"2023-10-14T18:45:10.499036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507241+0000","last_change":"2023-10-14T18:45:10.507172+0000","last_active":"2023-10-14T18:45:10.507241+0000","last_peered":"2023-10-14T18:45:10.507241+0000","last_clean":"2023-10-14T18:45:10.507241+0000","last_became_active":"2023-10-14T18:45:10.506991+0000","last_became_peered":"2023-10-14T18:45:10.506991+0000","last_unstale":"2023-10-14T18:45:10.507241+0000","last_undegraded":"2023-10-14T18:45:10.507241+0000","last_fullsized":"2023-10-14T18:45:10.507241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.504549+0000","last_change":"2023-10-14T18:45:10.504274+0000","last_active":"2023-10-14T18:45:10.504549+0000","last_peered":"2023-10-14T18:45:10.504549+0000","last_clean":"2023-10-14T18:45:10.504549+0000","last_became_active":"2023-10-14T18:45:10.504016+0000","last_became_peered":"2023-10-14T18:45:10.504016+0000","last_unstale":"2023-10-14T18:45:10.504549+0000","last_undegraded":"2023-10-14T18:45:10.504549+0000","last_fullsized":"2023-10-14T18:45:10.504549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494756+0000","last_change":"2023-10-14T18:45:10.494605+0000","last_active":"2023-10-14T18:45:10.494756+0000","last_peered":"2023-10-14T18:45:10.494756+0000","last_clean":"2023-10-14T18:45:10.494756+0000","last_became_active":"2023-10-14T18:45:10.494395+0000","last_became_peered":"2023-10-14T18:45:10.494395+0000","last_unstale":"2023-10-14T18:45:10.494756+0000","last_undegraded":"2023-10-14T18:45:10.494756+0000","last_fullsized":"2023-10-14T18:45:10.494756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.133322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505981+0000","last_change":"2023-10-14T18:45:10.505899+0000","last_active":"2023-10-14T18:45:10.505981+0000","last_peered":"2023-10-14T18:45:10.505981+0000","last_clean":"2023-10-14T18:45:10.505981+0000","last_became_active":"2023-10-14T18:45:10.505342+0000","last_became_peered":"2023-10-14T18:45:10.505342+0000","last_unstale":"2023-10-14T18:45:10.505981+0000","last_undegraded":"2023-10-14T18:45:10.505981+0000","last_fullsized":"2023-10-14T18:45:10.505981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499958+0000","last_change":"2023-10-14T18:45:10.499873+0000","last_active":"2023-10-14T18:45:10.499958+0000","last_peered":"2023-10-14T18:45:10.499958+0000","last_clean":"2023-10-14T18:45:10.499958+0000","last_became_active":"2023-10-14T18:45:10.499655+0000","last_became_peered":"2023-10-14T18:45:10.499655+0000","last_unstale":"2023-10-14T18:45:10.499958+0000","last_undegraded":"2023-10-14T18:45:10.499958+0000","last_fullsized":"2023-10-14T18:45:10.499958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505832+0000","last_change":"2023-10-14T18:45:10.505751+0000","last_active":"2023-10-14T18:45:10.505832+0000","last_peered":"2023-10-14T18:45:10.505832+0000","last_clean":"2023-10-14T18:45:10.505832+0000","last_became_active":"2023-10-14T18:45:10.505332+0000","last_became_peered":"2023-10-14T18:45:10.505332+0000","last_unstale":"2023-10-14T18:45:10.505832+0000","last_undegraded":"2023-10-14T18:45:10.505832+0000","last_fullsized":"2023-10-14T18:45:10.505832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509361+0000","last_change":"2023-10-14T18:45:10.509310+0000","last_active":"2023-10-14T18:45:10.509361+0000","last_peered":"2023-10-14T18:45:10.509361+0000","last_clean":"2023-10-14T18:45:10.509361+0000","last_became_active":"2023-10-14T18:45:10.509153+0000","last_became_peered":"2023-10-14T18:45:10.509153+0000","last_unstale":"2023-10-14T18:45:10.509361+0000","last_undegraded":"2023-10-14T18:45:10.509361+0000","last_fullsized":"2023-10-14T18:45:10.509361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510739+0000","last_change":"2023-10-14T18:45:10.507728+0000","last_active":"2023-10-14T18:45:10.510739+0000","last_peered":"2023-10-14T18:45:10.510739+0000","last_clean":"2023-10-14T18:45:10.510739+0000","last_became_active":"2023-10-14T18:45:10.505783+0000","last_became_peered":"2023-10-14T18:45:10.505783+0000","last_unstale":"2023-10-14T18:45:10.510739+0000","last_undegraded":"2023-10-14T18:45:10.510739+0000","last_fullsized":"2023-10-14T18:45:10.510739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506116+0000","last_change":"2023-10-14T18:45:10.506057+0000","last_active":"2023-10-14T18:45:10.506116+0000","last_peered":"2023-10-14T18:45:10.506116+0000","last_clean":"2023-10-14T18:45:10.506116+0000","last_became_active":"2023-10-14T18:45:10.505663+0000","last_became_peered":"2023-10-14T18:45:10.505663+0000","last_unstale":"2023-10-14T18:45:10.506116+0000","last_undegraded":"2023-10-14T18:45:10.506116+0000","last_fullsized":"2023-10-14T18:45:10.506116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512020+0000","last_change":"2023-10-14T18:45:10.511962+0000","last_active":"2023-10-14T18:45:10.512020+0000","last_peered":"2023-10-14T18:45:10.512020+0000","last_clean":"2023-10-14T18:45:10.512020+0000","last_became_active":"2023-10-14T18:45:10.508326+0000","last_became_peered":"2023-10-14T18:45:10.508326+0000","last_unstale":"2023-10-14T18:45:10.512020+0000","last_undegraded":"2023-10-14T18:45:10.512020+0000","last_fullsized":"2023-10-14T18:45:10.512020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496888+0000","last_change":"2023-10-14T18:45:10.496788+0000","last_active":"2023-10-14T18:45:10.496888+0000","last_peered":"2023-10-14T18:45:10.496888+0000","last_clean":"2023-10-14T18:45:10.496888+0000","last_became_active":"2023-10-14T18:45:10.496408+0000","last_became_peered":"2023-10-14T18:45:10.496408+0000","last_unstale":"2023-10-14T18:45:10.496888+0000","last_undegraded":"2023-10-14T18:45:10.496888+0000","last_fullsized":"2023-10-14T18:45:10.496888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511125+0000","last_change":"2023-10-14T18:45:10.511064+0000","last_active":"2023-10-14T18:45:10.511125+0000","last_peered":"2023-10-14T18:45:10.511125+0000","last_clean":"2023-10-14T18:45:10.511125+0000","last_became_active":"2023-10-14T18:45:10.510838+0000","last_became_peered":"2023-10-14T18:45:10.510838+0000","last_unstale":"2023-10-14T18:45:10.511125+0000","last_undegraded":"2023-10-14T18:45:10.511125+0000","last_fullsized":"2023-10-14T18:45:10.511125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:52:17.664748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:23.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:45:23.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.760+0000 7f69ff59e700 1 Processor -- start 2023-10-14T18:45:23.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.760+0000 7f69ff59e700 1 -- start start 2023-10-14T18:45:23.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69ff59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a0006e0d0 0x7f6a0006a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69ff59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a0006a620 0x7f6a00067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69ff59e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0006aa60 con 0x7f6a001568e0 2023-10-14T18:45:23.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69ff59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0006e690 con 0x7f6a0006a620 2023-10-14T18:45:23.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69ff59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0006e970 con 0x7f6a0006e0d0 2023-10-14T18:45:23.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fe59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a001568e0 0x7f6a0015afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45610/0 (socket says 172.21.15.79:45610) 2023-10-14T18:45:23.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fe59c700 1 -- 172.21.15.79:0/2734700342 learned_addr learned my addr 172.21.15.79:0/2734700342 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:23.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 --2- 172.21.15.79:0/2734700342 >> v2:172.21.15.79:3300/0 conn(0x7f6a0006a620 0x7f6a00067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fdd9b700 1 --2- 172.21.15.79:0/2734700342 >> v2:172.21.15.144:3300/0 conn(0x7f6a0006e0d0 0x7f6a0006a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fd59a700 1 -- 172.21.15.79:0/2734700342 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828900978 0 0) 0x7f6a0006aa60 con 0x7f6a001568e0 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fd59a700 1 -- 172.21.15.79:0/2734700342 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e8003570 con 0x7f6a001568e0 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 -- 172.21.15.79:0/2734700342 >> v2:172.21.15.144:3300/0 conn(0x7f6a0006e0d0 msgr2=0x7f6a0006a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 --2- 172.21.15.79:0/2734700342 >> v2:172.21.15.144:3300/0 conn(0x7f6a0006e0d0 0x7f6a0006a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 -- 172.21.15.79:0/2734700342 >> v1:172.21.15.79:6789/0 conn(0x7f6a001568e0 legacy=0x7f6a0015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 -- 172.21.15.79:0/2734700342 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0006ec50 con 0x7f6a0006a620 2023-10-14T18:45:23.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fed9d700 1 --2- 172.21.15.79:0/2734700342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a00067a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a000cd6a0 tx=0x7f69f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81abbe4d5e08b9cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.761+0000 7f69fd59a700 1 -- 172.21.15.79:0/2734700342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011630 con 0x7f6a0006a620 2023-10-14T18:45:23.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69fd59a700 1 -- 172.21.15.79:0/2734700342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f00117b0 con 0x7f6a0006a620 2023-10-14T18:45:23.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69fd59a700 1 -- 172.21.15.79:0/2734700342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0011b70 con 0x7f6a0006a620 2023-10-14T18:45:23.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 -- 172.21.15.79:0/2734700342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 msgr2=0x7f6a00067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 --2- 172.21.15.79:0/2734700342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a00067a20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a000cd6a0 tx=0x7f69f00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 -- 172.21.15.79:0/2734700342 shutdown_connections 2023-10-14T18:45:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 --2- 172.21.15.79:0/2734700342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a00067a20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 --2- 172.21.15.79:0/2734700342 >> v2:172.21.15.144:3300/0 conn(0x7f6a0006e0d0 0x7f6a0006a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 -- 172.21.15.79:0/2734700342 >> 172.21.15.79:0/2734700342 conn(0x7f6a000cd970 msgr2=0x7f6a000cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 -- 172.21.15.79:0/2734700342 shutdown_connections 2023-10-14T18:45:23.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.762+0000 7f69ff59e700 1 -- 172.21.15.79:0/2734700342 wait complete. 2023-10-14T18:45:23.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.763+0000 7f69ff59e700 1 Processor -- start 2023-10-14T18:45:23.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.763+0000 7f69ff59e700 1 -- start start 2023-10-14T18:45:23.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 0x7f6a00067a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a001568e0 0x7f6a00067f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a001494c0 con 0x7f6a0006a620 2023-10-14T18:45:23.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0014dea0 con 0x7f6a0006e0d0 2023-10-14T18:45:23.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69ff59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0014e180 con 0x7f6a001568e0 2023-10-14T18:45:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59754/0 (socket says 172.21.15.79:59754) 2023-10-14T18:45:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 -- 172.21.15.79:0/3724896937 learned_addr learned my addr 172.21.15.79:0/3724896937 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fdd9b700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 0x7f6a00067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fed9d700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a001568e0 0x7f6a00067f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 -- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a001568e0 msgr2=0x7f6a00067f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a001568e0 0x7f6a00067f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 -- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 msgr2=0x7f6a00067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 0x7f6a00067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 -- 172.21.15.79:0/3724896937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0009420 con 0x7f6a0006a620 2023-10-14T18:45:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fdd9b700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 0x7f6a00067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.764+0000 7f69fe59c700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69f800cc40 tx=0x7f69f8001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.765+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800a9c0 con 0x7f6a0006a620 2023-10-14T18:45:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.765+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800ab40 con 0x7f6a0006a620 2023-10-14T18:45:23.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.765+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0014e460 con 0x7f6a0006a620 2023-10-14T18:45:23.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.765+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80070f0 con 0x7f6a0006a620 2023-10-14T18:45:23.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.765+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0014eaa0 con 0x7f6a0006a620 2023-10-14T18:45:23.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.766+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00152f60 con 0x7f6a0006a620 2023-10-14T18:45:23.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.766+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69f8007520 con 0x7f6a0006a620 2023-10-14T18:45:23.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.766+0000 7f69ee7fc700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.766+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69f80849b0 con 0x7f6a0006a620 2023-10-14T18:45:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.767+0000 7f69fdd9b700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.767+0000 7f69fdd9b700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 0x7f69e00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a001517e0 tx=0x7f69f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:23.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.770+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69f8051ca0 con 0x7f6a0006a620 2023-10-14T18:45:23.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.949+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a0014ec30 con 0x7f69e0066f30 2023-10-14T18:45:23.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.957+0000 7f69ee7fc700 1 -- 172.21.15.79:0/3724896937 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7f6a0014ec30 con 0x7f69e0066f30 2023-10-14T18:45:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 msgr2=0x7f69e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 0x7f69e00693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a001517e0 tx=0x7f69f4008040 comp rx=0 tx=0).stop 2023-10-14T18:45:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 msgr2=0x7f6a001487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:23.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69f800cc40 tx=0x7f69f8001a70 comp rx=0 tx=0).stop 2023-10-14T18:45:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 shutdown_connections 2023-10-14T18:45:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69e0066f30 0x7f69e00693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a001568e0 0x7f6a00067f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a0006a620 0x7f6a001487e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 --2- 172.21.15.79:0/3724896937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a0006e0d0 0x7f6a00067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:23.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 >> 172.21.15.79:0/3724896937 conn(0x7f6a000cd970 msgr2=0x7f6a00157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:23.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 shutdown_connections 2023-10-14T18:45:23.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:23.959+0000 7f69ff59e700 1 -- 172.21.15.79:0/3724896937 wait complete. 2023-10-14T18:45:23.965 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:45:23.972 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T18:45:22.337209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560792,"statfs":{"total":1600000000,"available":1598251711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.843624"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505788+0000","last_change":"2023-10-14T18:45:10.504806+0000","last_active":"2023-10-14T18:45:10.505788+0000","last_peered":"2023-10-14T18:45:10.505788+0000","last_clean":"2023-10-14T18:45:10.505788+0000","last_became_active":"2023-10-14T18:45:10.504592+0000","last_became_peered":"2023-10-14T18:45:10.504592+0000","last_unstale":"2023-10-14T18:45:10.505788+0000","last_undegraded":"2023-10-14T18:45:10.505788+0000","last_fullsized":"2023-10-14T18:45:10.505788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501740+0000","last_change":"2023-10-14T18:45:10.501684+0000","last_active":"2023-10-14T18:45:10.501740+0000","last_peered":"2023-10-14T18:45:10.501740+0000","last_clean":"2023-10-14T18:45:10.501740+0000","last_became_active":"2023-10-14T18:45:10.501468+0000","last_became_peered":"2023-10-14T18:45:10.501468+0000","last_unstale":"2023-10-14T18:45:10.501740+0000","last_undegraded":"2023-10-14T18:45:10.501740+0000","last_fullsized":"2023-10-14T18:45:10.501740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501737+0000","last_change":"2023-10-14T18:45:10.501682+0000","last_active":"2023-10-14T18:45:10.501737+0000","last_peered":"2023-10-14T18:45:10.501737+0000","last_clean":"2023-10-14T18:45:10.501737+0000","last_became_active":"2023-10-14T18:45:10.501209+0000","last_became_peered":"2023-10-14T18:45:10.501209+0000","last_unstale":"2023-10-14T18:45:10.501737+0000","last_undegraded":"2023-10-14T18:45:10.501737+0000","last_fullsized":"2023-10-14T18:45:10.501737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510790+0000","last_change":"2023-10-14T18:45:10.508252+0000","last_active":"2023-10-14T18:45:10.510790+0000","last_peered":"2023-10-14T18:45:10.510790+0000","last_clean":"2023-10-14T18:45:10.510790+0000","last_became_active":"2023-10-14T18:45:10.506413+0000","last_became_peered":"2023-10-14T18:45:10.506413+0000","last_unstale":"2023-10-14T18:45:10.510790+0000","last_undegraded":"2023-10-14T18:45:10.510790+0000","last_fullsized":"2023-10-14T18:45:10.510790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502782+0000","last_change":"2023-10-14T18:45:10.502278+0000","last_active":"2023-10-14T18:45:10.502782+0000","last_peered":"2023-10-14T18:45:10.502782+0000","last_clean":"2023-10-14T18:45:10.502782+0000","last_became_active":"2023-10-14T18:45:10.502034+0000","last_became_peered":"2023-10-14T18:45:10.502034+0000","last_unstale":"2023-10-14T18:45:10.502782+0000","last_undegraded":"2023-10-14T18:45:10.502782+0000","last_fullsized":"2023-10-14T18:45:10.502782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:39.359663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511005+0000","last_change":"2023-10-14T18:45:10.510963+0000","last_active":"2023-10-14T18:45:10.511005+0000","last_peered":"2023-10-14T18:45:10.511005+0000","last_clean":"2023-10-14T18:45:10.511005+0000","last_became_active":"2023-10-14T18:45:10.509764+0000","last_became_peered":"2023-10-14T18:45:10.509764+0000","last_unstale":"2023-10-14T18:45:10.511005+0000","last_undegraded":"2023-10-14T18:45:10.511005+0000","last_fullsized":"2023-10-14T18:45:10.511005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499650+0000","last_change":"2023-10-14T18:45:10.499583+0000","last_active":"2023-10-14T18:45:10.499650+0000","last_peered":"2023-10-14T18:45:10.499650+0000","last_clean":"2023-10-14T18:45:10.499650+0000","last_became_active":"2023-10-14T18:45:10.499349+0000","last_became_peered":"2023-10-14T18:45:10.499349+0000","last_unstale":"2023-10-14T18:45:10.499650+0000","last_undegraded":"2023-10-14T18:45:10.499650+0000","last_fullsized":"2023-10-14T18:45:10.499650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502699+0000","last_change":"2023-10-14T18:45:10.502642+0000","last_active":"2023-10-14T18:45:10.502699+0000","last_peered":"2023-10-14T18:45:10.502699+0000","last_clean":"2023-10-14T18:45:10.502699+0000","last_became_active":"2023-10-14T18:45:10.502429+0000","last_became_peered":"2023-10-14T18:45:10.502429+0000","last_unstale":"2023-10-14T18:45:10.502699+0000","last_undegraded":"2023-10-14T18:45:10.502699+0000","last_fullsized":"2023-10-14T18:45:10.502699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508406+0000","last_change":"2023-10-14T18:45:10.507819+0000","last_active":"2023-10-14T18:45:10.508406+0000","last_peered":"2023-10-14T18:45:10.508406+0000","last_clean":"2023-10-14T18:45:10.508406+0000","last_became_active":"2023-10-14T18:45:10.506697+0000","last_became_peered":"2023-10-14T18:45:10.506697+0000","last_unstale":"2023-10-14T18:45:10.508406+0000","last_undegraded":"2023-10-14T18:45:10.508406+0000","last_fullsized":"2023-10-14T18:45:10.508406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:04:15.231896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503640+0000","last_change":"2023-10-14T18:45:10.503569+0000","last_active":"2023-10-14T18:45:10.503640+0000","last_peered":"2023-10-14T18:45:10.503640+0000","last_clean":"2023-10-14T18:45:10.503640+0000","last_became_active":"2023-10-14T18:45:10.503321+0000","last_became_peered":"2023-10-14T18:45:10.503321+0000","last_unstale":"2023-10-14T18:45:10.503640+0000","last_undegraded":"2023-10-14T18:45:10.503640+0000","last_fullsized":"2023-10-14T18:45:10.503640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.510687+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.510465+0000","last_became_peered":"2023-10-14T18:45:10.510465+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509012+0000","last_change":"2023-10-14T18:45:10.508916+0000","last_active":"2023-10-14T18:45:10.509012+0000","last_peered":"2023-10-14T18:45:10.509012+0000","last_clean":"2023-10-14T18:45:10.509012+0000","last_became_active":"2023-10-14T18:45:10.508688+0000","last_became_peered":"2023-10-14T18:45:10.508688+0000","last_unstale":"2023-10-14T18:45:10.509012+0000","last_undegraded":"2023-10-14T18:45:10.509012+0000","last_fullsized":"2023-10-14T18:45:10.509012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:53.054157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501887+0000","last_change":"2023-10-14T18:45:10.499725+0000","last_active":"2023-10-14T18:45:10.501887+0000","last_peered":"2023-10-14T18:45:10.501887+0000","last_clean":"2023-10-14T18:45:10.501887+0000","last_became_active":"2023-10-14T18:45:10.499536+0000","last_became_peered":"2023-10-14T18:45:10.499536+0000","last_unstale":"2023-10-14T18:45:10.501887+0000","last_undegraded":"2023-10-14T18:45:10.501887+0000","last_fullsized":"2023-10-14T18:45:10.501887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500498+0000","last_change":"2023-10-14T18:45:10.500406+0000","last_active":"2023-10-14T18:45:10.500498+0000","last_peered":"2023-10-14T18:45:10.500498+0000","last_clean":"2023-10-14T18:45:10.500498+0000","last_became_active":"2023-10-14T18:45:10.500169+0000","last_became_peered":"2023-10-14T18:45:10.500169+0000","last_unstale":"2023-10-14T18:45:10.500498+0000","last_undegraded":"2023-10-14T18:45:10.500498+0000","last_fullsized":"2023-10-14T18:45:10.500498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509572+0000","last_change":"2023-10-14T18:45:10.509512+0000","last_active":"2023-10-14T18:45:10.509572+0000","last_peered":"2023-10-14T18:45:10.509572+0000","last_clean":"2023-10-14T18:45:10.509572+0000","last_became_active":"2023-10-14T18:45:10.509284+0000","last_became_peered":"2023-10-14T18:45:10.509284+0000","last_unstale":"2023-10-14T18:45:10.509572+0000","last_undegraded":"2023-10-14T18:45:10.509572+0000","last_fullsized":"2023-10-14T18:45:10.509572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510815+0000","last_change":"2023-10-14T18:45:10.510079+0000","last_active":"2023-10-14T18:45:10.510815+0000","last_peered":"2023-10-14T18:45:10.510815+0000","last_clean":"2023-10-14T18:45:10.510815+0000","last_became_active":"2023-10-14T18:45:10.506192+0000","last_became_peered":"2023-10-14T18:45:10.506192+0000","last_unstale":"2023-10-14T18:45:10.510815+0000","last_undegraded":"2023-10-14T18:45:10.510815+0000","last_fullsized":"2023-10-14T18:45:10.510815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512268+0000","last_change":"2023-10-14T18:45:10.512204+0000","last_active":"2023-10-14T18:45:10.512268+0000","last_peered":"2023-10-14T18:45:10.512268+0000","last_clean":"2023-10-14T18:45:10.512268+0000","last_became_active":"2023-10-14T18:45:10.511231+0000","last_became_peered":"2023-10-14T18:45:10.511231+0000","last_unstale":"2023-10-14T18:45:10.512268+0000","last_undegraded":"2023-10-14T18:45:10.512268+0000","last_fullsized":"2023-10-14T18:45:10.512268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:31.815296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500876+0000","last_change":"2023-10-14T18:45:10.500810+0000","last_active":"2023-10-14T18:45:10.500876+0000","last_peered":"2023-10-14T18:45:10.500876+0000","last_clean":"2023-10-14T18:45:10.500876+0000","last_became_active":"2023-10-14T18:45:10.500601+0000","last_became_peered":"2023-10-14T18:45:10.500601+0000","last_unstale":"2023-10-14T18:45:10.500876+0000","last_undegraded":"2023-10-14T18:45:10.500876+0000","last_fullsized":"2023-10-14T18:45:10.500876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508428+0000","last_change":"2023-10-14T18:45:10.508118+0000","last_active":"2023-10-14T18:45:10.508428+0000","last_peered":"2023-10-14T18:45:10.508428+0000","last_clean":"2023-10-14T18:45:10.508428+0000","last_became_active":"2023-10-14T18:45:10.507261+0000","last_became_peered":"2023-10-14T18:45:10.507261+0000","last_unstale":"2023-10-14T18:45:10.508428+0000","last_undegraded":"2023-10-14T18:45:10.508428+0000","last_fullsized":"2023-10-14T18:45:10.508428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:12:43.467593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516240+0000","last_change":"2023-10-14T18:45:09.502434+0000","last_active":"2023-10-14T18:45:10.516240+0000","last_peered":"2023-10-14T18:45:10.516240+0000","last_clean":"2023-10-14T18:45:10.516240+0000","last_became_active":"2023-10-14T18:45:09.502209+0000","last_became_peered":"2023-10-14T18:45:09.502209+0000","last_unstale":"2023-10-14T18:45:10.516240+0000","last_undegraded":"2023-10-14T18:45:10.516240+0000","last_fullsized":"2023-10-14T18:45:10.516240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502473+0000","last_change":"2023-10-14T18:45:10.502419+0000","last_active":"2023-10-14T18:45:10.502473+0000","last_peered":"2023-10-14T18:45:10.502473+0000","last_clean":"2023-10-14T18:45:10.502473+0000","last_became_active":"2023-10-14T18:45:10.502191+0000","last_became_peered":"2023-10-14T18:45:10.502191+0000","last_unstale":"2023-10-14T18:45:10.502473+0000","last_undegraded":"2023-10-14T18:45:10.502473+0000","last_fullsized":"2023-10-14T18:45:10.502473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518917+0000","last_change":"2023-10-14T18:45:09.495053+0000","last_active":"2023-10-14T18:45:10.518917+0000","last_peered":"2023-10-14T18:45:10.518917+0000","last_clean":"2023-10-14T18:45:10.518917+0000","last_became_active":"2023-10-14T18:45:09.494826+0000","last_became_peered":"2023-10-14T18:45:09.494826+0000","last_unstale":"2023-10-14T18:45:10.518917+0000","last_undegraded":"2023-10-14T18:45:10.518917+0000","last_fullsized":"2023-10-14T18:45:10.518917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501605+0000","last_change":"2023-10-14T18:45:10.501557+0000","last_active":"2023-10-14T18:45:10.501605+0000","last_peered":"2023-10-14T18:45:10.501605+0000","last_clean":"2023-10-14T18:45:10.501605+0000","last_became_active":"2023-10-14T18:45:10.500923+0000","last_became_peered":"2023-10-14T18:45:10.500923+0000","last_unstale":"2023-10-14T18:45:10.501605+0000","last_undegraded":"2023-10-14T18:45:10.501605+0000","last_fullsized":"2023-10-14T18:45:10.501605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516200+0000","last_change":"2023-10-14T18:45:09.505639+0000","last_active":"2023-10-14T18:45:10.516200+0000","last_peered":"2023-10-14T18:45:10.516200+0000","last_clean":"2023-10-14T18:45:10.516200+0000","last_became_active":"2023-10-14T18:45:09.505410+0000","last_became_peered":"2023-10-14T18:45:09.505410+0000","last_unstale":"2023-10-14T18:45:10.516200+0000","last_undegraded":"2023-10-14T18:45:10.516200+0000","last_fullsized":"2023-10-14T18:45:10.516200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511210+0000","last_change":"2023-10-14T18:45:10.511079+0000","last_active":"2023-10-14T18:45:10.511210+0000","last_peered":"2023-10-14T18:45:10.511210+0000","last_clean":"2023-10-14T18:45:10.511210+0000","last_became_active":"2023-10-14T18:45:10.510806+0000","last_became_peered":"2023-10-14T18:45:10.510806+0000","last_unstale":"2023-10-14T18:45:10.511210+0000","last_undegraded":"2023-10-14T18:45:10.511210+0000","last_fullsized":"2023-10-14T18:45:10.511210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515405+0000","last_change":"2023-10-14T18:45:09.504487+0000","last_active":"2023-10-14T18:45:10.515405+0000","last_peered":"2023-10-14T18:45:10.515405+0000","last_clean":"2023-10-14T18:45:10.515405+0000","last_became_active":"2023-10-14T18:45:09.504255+0000","last_became_peered":"2023-10-14T18:45:09.504255+0000","last_unstale":"2023-10-14T18:45:10.515405+0000","last_undegraded":"2023-10-14T18:45:10.515405+0000","last_fullsized":"2023-10-14T18:45:10.515405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:56.816202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511025+0000","last_change":"2023-10-14T18:45:10.510969+0000","last_active":"2023-10-14T18:45:10.511025+0000","last_peered":"2023-10-14T18:45:10.511025+0000","last_clean":"2023-10-14T18:45:10.511025+0000","last_became_active":"2023-10-14T18:45:10.510799+0000","last_became_peered":"2023-10-14T18:45:10.510799+0000","last_unstale":"2023-10-14T18:45:10.511025+0000","last_undegraded":"2023-10-14T18:45:10.511025+0000","last_fullsized":"2023-10-14T18:45:10.511025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.518837+0000","last_change":"2023-10-14T18:45:09.500085+0000","last_active":"2023-10-14T18:45:10.518837+0000","last_peered":"2023-10-14T18:45:10.518837+0000","last_clean":"2023-10-14T18:45:10.518837+0000","last_became_active":"2023-10-14T18:45:09.499843+0000","last_became_peered":"2023-10-14T18:45:09.499843+0000","last_unstale":"2023-10-14T18:45:10.518837+0000","last_undegraded":"2023-10-14T18:45:10.518837+0000","last_fullsized":"2023-10-14T18:45:10.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:10.939928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503509+0000","last_change":"2023-10-14T18:45:10.503087+0000","last_active":"2023-10-14T18:45:10.503509+0000","last_peered":"2023-10-14T18:45:10.503509+0000","last_clean":"2023-10-14T18:45:10.503509+0000","last_became_active":"2023-10-14T18:45:10.502874+0000","last_became_peered":"2023-10-14T18:45:10.502874+0000","last_unstale":"2023-10-14T18:45:10.503509+0000","last_undegraded":"2023-10-14T18:45:10.503509+0000","last_fullsized":"2023-10-14T18:45:10.503509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:44.694101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516052+0000","last_change":"2023-10-14T18:45:09.500407+0000","last_active":"2023-10-14T18:45:10.516052+0000","last_peered":"2023-10-14T18:45:10.516052+0000","last_clean":"2023-10-14T18:45:10.516052+0000","last_became_active":"2023-10-14T18:45:09.500159+0000","last_became_peered":"2023-10-14T18:45:09.500159+0000","last_unstale":"2023-10-14T18:45:10.516052+0000","last_undegraded":"2023-10-14T18:45:10.516052+0000","last_fullsized":"2023-10-14T18:45:10.516052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503008+0000","last_change":"2023-10-14T18:45:10.502958+0000","last_active":"2023-10-14T18:45:10.503008+0000","last_peered":"2023-10-14T18:45:10.503008+0000","last_clean":"2023-10-14T18:45:10.503008+0000","last_became_active":"2023-10-14T18:45:10.502750+0000","last_became_peered":"2023-10-14T18:45:10.502750+0000","last_unstale":"2023-10-14T18:45:10.503008+0000","last_undegraded":"2023-10-14T18:45:10.503008+0000","last_fullsized":"2023-10-14T18:45:10.503008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:50:08.710513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493584+0000","last_change":"2023-10-14T18:45:09.500758+0000","last_active":"2023-10-14T18:45:10.493584+0000","last_peered":"2023-10-14T18:45:10.493584+0000","last_clean":"2023-10-14T18:45:10.493584+0000","last_became_active":"2023-10-14T18:45:09.500521+0000","last_became_peered":"2023-10-14T18:45:09.500521+0000","last_unstale":"2023-10-14T18:45:10.493584+0000","last_undegraded":"2023-10-14T18:45:10.493584+0000","last_fullsized":"2023-10-14T18:45:10.493584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495482+0000","last_change":"2023-10-14T18:45:10.495391+0000","last_active":"2023-10-14T18:45:10.495482+0000","last_peered":"2023-10-14T18:45:10.495482+0000","last_clean":"2023-10-14T18:45:10.495482+0000","last_became_active":"2023-10-14T18:45:10.495163+0000","last_became_peered":"2023-10-14T18:45:10.495163+0000","last_unstale":"2023-10-14T18:45:10.495482+0000","last_undegraded":"2023-10-14T18:45:10.495482+0000","last_fullsized":"2023-10-14T18:45:10.495482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:36:26.910386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499343+0000","last_change":"2023-10-14T18:45:09.504439+0000","last_active":"2023-10-14T18:45:10.499343+0000","last_peered":"2023-10-14T18:45:10.499343+0000","last_clean":"2023-10-14T18:45:10.499343+0000","last_became_active":"2023-10-14T18:45:09.503977+0000","last_became_peered":"2023-10-14T18:45:09.503977+0000","last_unstale":"2023-10-14T18:45:10.499343+0000","last_undegraded":"2023-10-14T18:45:10.499343+0000","last_fullsized":"2023-10-14T18:45:10.499343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500472+0000","last_change":"2023-10-14T18:45:10.500298+0000","last_active":"2023-10-14T18:45:10.500472+0000","last_peered":"2023-10-14T18:45:10.500472+0000","last_clean":"2023-10-14T18:45:10.500472+0000","last_became_active":"2023-10-14T18:45:10.500086+0000","last_became_peered":"2023-10-14T18:45:10.500086+0000","last_unstale":"2023-10-14T18:45:10.500472+0000","last_undegraded":"2023-10-14T18:45:10.500472+0000","last_fullsized":"2023-10-14T18:45:10.500472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498655+0000","last_change":"2023-10-14T18:45:09.503955+0000","last_active":"2023-10-14T18:45:10.498655+0000","last_peered":"2023-10-14T18:45:10.498655+0000","last_clean":"2023-10-14T18:45:10.498655+0000","last_became_active":"2023-10-14T18:45:09.503727+0000","last_became_peered":"2023-10-14T18:45:09.503727+0000","last_unstale":"2023-10-14T18:45:10.498655+0000","last_undegraded":"2023-10-14T18:45:10.498655+0000","last_fullsized":"2023-10-14T18:45:10.498655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502492+0000","last_change":"2023-10-14T18:45:10.502425+0000","last_active":"2023-10-14T18:45:10.502492+0000","last_peered":"2023-10-14T18:45:10.502492+0000","last_clean":"2023-10-14T18:45:10.502492+0000","last_became_active":"2023-10-14T18:45:10.502206+0000","last_became_peered":"2023-10-14T18:45:10.502206+0000","last_unstale":"2023-10-14T18:45:10.502492+0000","last_undegraded":"2023-10-14T18:45:10.502492+0000","last_fullsized":"2023-10-14T18:45:10.502492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500075+0000","last_change":"2023-10-14T18:45:09.505574+0000","last_active":"2023-10-14T18:45:10.500075+0000","last_peered":"2023-10-14T18:45:10.500075+0000","last_clean":"2023-10-14T18:45:10.500075+0000","last_became_active":"2023-10-14T18:45:09.504963+0000","last_became_peered":"2023-10-14T18:45:09.504963+0000","last_unstale":"2023-10-14T18:45:10.500075+0000","last_undegraded":"2023-10-14T18:45:10.500075+0000","last_fullsized":"2023-10-14T18:45:10.500075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507028+0000","last_change":"2023-10-14T18:45:10.506952+0000","last_active":"2023-10-14T18:45:10.507028+0000","last_peered":"2023-10-14T18:45:10.507028+0000","last_clean":"2023-10-14T18:45:10.507028+0000","last_became_active":"2023-10-14T18:45:10.506621+0000","last_became_peered":"2023-10-14T18:45:10.506621+0000","last_unstale":"2023-10-14T18:45:10.507028+0000","last_undegraded":"2023-10-14T18:45:10.507028+0000","last_fullsized":"2023-10-14T18:45:10.507028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515309+0000","last_change":"2023-10-14T18:45:09.501054+0000","last_active":"2023-10-14T18:45:10.515309+0000","last_peered":"2023-10-14T18:45:10.515309+0000","last_clean":"2023-10-14T18:45:10.515309+0000","last_became_active":"2023-10-14T18:45:09.500522+0000","last_became_peered":"2023-10-14T18:45:09.500522+0000","last_unstale":"2023-10-14T18:45:10.515309+0000","last_undegraded":"2023-10-14T18:45:10.515309+0000","last_fullsized":"2023-10-14T18:45:10.515309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507400+0000","last_change":"2023-10-14T18:45:10.507329+0000","last_active":"2023-10-14T18:45:10.507400+0000","last_peered":"2023-10-14T18:45:10.507400+0000","last_clean":"2023-10-14T18:45:10.507400+0000","last_became_active":"2023-10-14T18:45:10.507042+0000","last_became_peered":"2023-10-14T18:45:10.507042+0000","last_unstale":"2023-10-14T18:45:10.507400+0000","last_undegraded":"2023-10-14T18:45:10.507400+0000","last_fullsized":"2023-10-14T18:45:10.507400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:18.121655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.519581+0000","last_change":"2023-10-14T18:45:09.502428+0000","last_active":"2023-10-14T18:45:10.519581+0000","last_peered":"2023-10-14T18:45:10.519581+0000","last_clean":"2023-10-14T18:45:10.519581+0000","last_became_active":"2023-10-14T18:45:09.502204+0000","last_became_peered":"2023-10-14T18:45:09.502204+0000","last_unstale":"2023-10-14T18:45:10.519581+0000","last_undegraded":"2023-10-14T18:45:10.519581+0000","last_fullsized":"2023-10-14T18:45:10.519581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505808+0000","last_change":"2023-10-14T18:45:10.505484+0000","last_active":"2023-10-14T18:45:10.505808+0000","last_peered":"2023-10-14T18:45:10.505808+0000","last_clean":"2023-10-14T18:45:10.505808+0000","last_became_active":"2023-10-14T18:45:10.505215+0000","last_became_peered":"2023-10-14T18:45:10.505215+0000","last_unstale":"2023-10-14T18:45:10.505808+0000","last_undegraded":"2023-10-14T18:45:10.505808+0000","last_fullsized":"2023-10-14T18:45:10.505808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:40.067838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516904+0000","last_change":"2023-10-14T18:45:09.500718+0000","last_active":"2023-10-14T18:45:10.516904+0000","last_peered":"2023-10-14T18:45:10.516904+0000","last_clean":"2023-10-14T18:45:10.516904+0000","last_became_active":"2023-10-14T18:45:09.500458+0000","last_became_peered":"2023-10-14T18:45:09.500458+0000","last_unstale":"2023-10-14T18:45:10.516904+0000","last_undegraded":"2023-10-14T18:45:10.516904+0000","last_fullsized":"2023-10-14T18:45:10.516904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:30.706155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496812+0000","last_change":"2023-10-14T18:45:10.496651+0000","last_active":"2023-10-14T18:45:10.496812+0000","last_peered":"2023-10-14T18:45:10.496812+0000","last_clean":"2023-10-14T18:45:10.496812+0000","last_became_active":"2023-10-14T18:45:10.496150+0000","last_became_peered":"2023-10-14T18:45:10.496150+0000","last_unstale":"2023-10-14T18:45:10.496812+0000","last_undegraded":"2023-10-14T18:45:10.496812+0000","last_fullsized":"2023-10-14T18:45:10.496812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500483+0000","last_change":"2023-10-14T18:45:09.503379+0000","last_active":"2023-10-14T18:45:10.500483+0000","last_peered":"2023-10-14T18:45:10.500483+0000","last_clean":"2023-10-14T18:45:10.500483+0000","last_became_active":"2023-10-14T18:45:09.503137+0000","last_became_peered":"2023-10-14T18:45:09.503137+0000","last_unstale":"2023-10-14T18:45:10.500483+0000","last_undegraded":"2023-10-14T18:45:10.500483+0000","last_fullsized":"2023-10-14T18:45:10.500483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510222+0000","last_change":"2023-10-14T18:45:10.509982+0000","last_active":"2023-10-14T18:45:10.510222+0000","last_peered":"2023-10-14T18:45:10.510222+0000","last_clean":"2023-10-14T18:45:10.510222+0000","last_became_active":"2023-10-14T18:45:10.509462+0000","last_became_peered":"2023-10-14T18:45:10.509462+0000","last_unstale":"2023-10-14T18:45:10.510222+0000","last_undegraded":"2023-10-14T18:45:10.510222+0000","last_fullsized":"2023-10-14T18:45:10.510222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.498432+0000","last_change":"2023-10-14T18:45:09.502982+0000","last_active":"2023-10-14T18:45:10.498432+0000","last_peered":"2023-10-14T18:45:10.498432+0000","last_clean":"2023-10-14T18:45:10.498432+0000","last_became_active":"2023-10-14T18:45:09.499379+0000","last_became_peered":"2023-10-14T18:45:09.499379+0000","last_unstale":"2023-10-14T18:45:10.498432+0000","last_undegraded":"2023-10-14T18:45:10.498432+0000","last_fullsized":"2023-10-14T18:45:10.498432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505816+0000","last_change":"2023-10-14T18:45:10.504993+0000","last_active":"2023-10-14T18:45:10.505816+0000","last_peered":"2023-10-14T18:45:10.505816+0000","last_clean":"2023-10-14T18:45:10.505816+0000","last_became_active":"2023-10-14T18:45:10.504493+0000","last_became_peered":"2023-10-14T18:45:10.504493+0000","last_unstale":"2023-10-14T18:45:10.505816+0000","last_undegraded":"2023-10-14T18:45:10.505816+0000","last_fullsized":"2023-10-14T18:45:10.505816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.516768+0000","last_change":"2023-10-14T18:45:09.498248+0000","last_active":"2023-10-14T18:45:10.516768+0000","last_peered":"2023-10-14T18:45:10.516768+0000","last_clean":"2023-10-14T18:45:10.516768+0000","last_became_active":"2023-10-14T18:45:09.498027+0000","last_became_peered":"2023-10-14T18:45:09.498027+0000","last_unstale":"2023-10-14T18:45:10.516768+0000","last_undegraded":"2023-10-14T18:45:10.516768+0000","last_fullsized":"2023-10-14T18:45:10.516768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503199+0000","last_change":"2023-10-14T18:45:10.503098+0000","last_active":"2023-10-14T18:45:10.503199+0000","last_peered":"2023-10-14T18:45:10.503199+0000","last_clean":"2023-10-14T18:45:10.503199+0000","last_became_active":"2023-10-14T18:45:10.502805+0000","last_became_peered":"2023-10-14T18:45:10.502805+0000","last_unstale":"2023-10-14T18:45:10.503199+0000","last_undegraded":"2023-10-14T18:45:10.503199+0000","last_fullsized":"2023-10-14T18:45:10.503199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515581+0000","last_change":"2023-10-14T18:45:09.500202+0000","last_active":"2023-10-14T18:45:10.515581+0000","last_peered":"2023-10-14T18:45:10.515581+0000","last_clean":"2023-10-14T18:45:10.515581+0000","last_became_active":"2023-10-14T18:45:09.499922+0000","last_became_peered":"2023-10-14T18:45:09.499922+0000","last_unstale":"2023-10-14T18:45:10.515581+0000","last_undegraded":"2023-10-14T18:45:10.515581+0000","last_fullsized":"2023-10-14T18:45:10.515581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.053271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510239+0000","last_change":"2023-10-14T18:45:10.510150+0000","last_active":"2023-10-14T18:45:10.510239+0000","last_peered":"2023-10-14T18:45:10.510239+0000","last_clean":"2023-10-14T18:45:10.510239+0000","last_became_active":"2023-10-14T18:45:10.509761+0000","last_became_peered":"2023-10-14T18:45:10.509761+0000","last_unstale":"2023-10-14T18:45:10.510239+0000","last_undegraded":"2023-10-14T18:45:10.510239+0000","last_fullsized":"2023-10-14T18:45:10.510239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497491+0000","last_change":"2023-10-14T18:45:09.496779+0000","last_active":"2023-10-14T18:45:10.497491+0000","last_peered":"2023-10-14T18:45:10.497491+0000","last_clean":"2023-10-14T18:45:10.497491+0000","last_became_active":"2023-10-14T18:45:09.495762+0000","last_became_peered":"2023-10-14T18:45:09.495762+0000","last_unstale":"2023-10-14T18:45:10.497491+0000","last_undegraded":"2023-10-14T18:45:10.497491+0000","last_fullsized":"2023-10-14T18:45:10.497491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:23:15.199210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510760+0000","last_change":"2023-10-14T18:45:10.507894+0000","last_active":"2023-10-14T18:45:10.510760+0000","last_peered":"2023-10-14T18:45:10.510760+0000","last_clean":"2023-10-14T18:45:10.510760+0000","last_became_active":"2023-10-14T18:45:10.506095+0000","last_became_peered":"2023-10-14T18:45:10.506095+0000","last_unstale":"2023-10-14T18:45:10.510760+0000","last_undegraded":"2023-10-14T18:45:10.510760+0000","last_fullsized":"2023-10-14T18:45:10.510760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:39.266452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500192+0000","last_change":"2023-10-14T18:45:09.502756+0000","last_active":"2023-10-14T18:45:10.500192+0000","last_peered":"2023-10-14T18:45:10.500192+0000","last_clean":"2023-10-14T18:45:10.500192+0000","last_became_active":"2023-10-14T18:45:09.502106+0000","last_became_peered":"2023-10-14T18:45:09.502106+0000","last_unstale":"2023-10-14T18:45:10.500192+0000","last_undegraded":"2023-10-14T18:45:10.500192+0000","last_fullsized":"2023-10-14T18:45:10.500192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.503488+0000","last_change":"2023-10-14T18:45:10.502149+0000","last_active":"2023-10-14T18:45:10.503488+0000","last_peered":"2023-10-14T18:45:10.503488+0000","last_clean":"2023-10-14T18:45:10.503488+0000","last_became_active":"2023-10-14T18:45:10.501936+0000","last_became_peered":"2023-10-14T18:45:10.501936+0000","last_unstale":"2023-10-14T18:45:10.503488+0000","last_undegraded":"2023-10-14T18:45:10.503488+0000","last_fullsized":"2023-10-14T18:45:10.503488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:42.510534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499404+0000","last_change":"2023-10-14T18:45:10.499352+0000","last_active":"2023-10-14T18:45:10.499404+0000","last_peered":"2023-10-14T18:45:10.499404+0000","last_clean":"2023-10-14T18:45:10.499404+0000","last_became_active":"2023-10-14T18:45:10.499125+0000","last_became_peered":"2023-10-14T18:45:10.499125+0000","last_unstale":"2023-10-14T18:45:10.499404+0000","last_undegraded":"2023-10-14T18:45:10.499404+0000","last_fullsized":"2023-10-14T18:45:10.499404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497717+0000","last_change":"2023-10-14T18:45:09.499972+0000","last_active":"2023-10-14T18:45:10.497717+0000","last_peered":"2023-10-14T18:45:10.497717+0000","last_clean":"2023-10-14T18:45:10.497717+0000","last_became_active":"2023-10-14T18:45:09.499750+0000","last_became_peered":"2023-10-14T18:45:09.499750+0000","last_unstale":"2023-10-14T18:45:10.497717+0000","last_undegraded":"2023-10-14T18:45:10.497717+0000","last_fullsized":"2023-10-14T18:45:10.497717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:12:12.589548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502621+0000","last_change":"2023-10-14T18:45:10.502562+0000","last_active":"2023-10-14T18:45:10.502621+0000","last_peered":"2023-10-14T18:45:10.502621+0000","last_clean":"2023-10-14T18:45:10.502621+0000","last_became_active":"2023-10-14T18:45:10.502354+0000","last_became_peered":"2023-10-14T18:45:10.502354+0000","last_unstale":"2023-10-14T18:45:10.502621+0000","last_undegraded":"2023-10-14T18:45:10.502621+0000","last_fullsized":"2023-10-14T18:45:10.502621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:03.123936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.500588+0000","last_change":"2023-10-14T18:45:09.502815+0000","last_active":"2023-10-14T18:45:10.500588+0000","last_peered":"2023-10-14T18:45:10.500588+0000","last_clean":"2023-10-14T18:45:10.500588+0000","last_became_active":"2023-10-14T18:45:09.502586+0000","last_became_peered":"2023-10-14T18:45:09.502586+0000","last_unstale":"2023-10-14T18:45:10.500588+0000","last_undegraded":"2023-10-14T18:45:10.500588+0000","last_fullsized":"2023-10-14T18:45:10.500588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494733+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:10.494733+0000","last_peered":"2023-10-14T18:45:10.494733+0000","last_clean":"2023-10-14T18:45:10.494733+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:10.494733+0000","last_undegraded":"2023-10-14T18:45:10.494733+0000","last_fullsized":"2023-10-14T18:45:10.494733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506423+0000","last_change":"2023-10-14T18:45:10.506374+0000","last_active":"2023-10-14T18:45:10.506423+0000","last_peered":"2023-10-14T18:45:10.506423+0000","last_clean":"2023-10-14T18:45:10.506423+0000","last_became_active":"2023-10-14T18:45:10.506224+0000","last_became_peered":"2023-10-14T18:45:10.506224+0000","last_unstale":"2023-10-14T18:45:10.506423+0000","last_undegraded":"2023-10-14T18:45:10.506423+0000","last_fullsized":"2023-10-14T18:45:10.506423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493318+0000","last_change":"2023-10-14T18:45:09.504373+0000","last_active":"2023-10-14T18:45:10.493318+0000","last_peered":"2023-10-14T18:45:10.493318+0000","last_clean":"2023-10-14T18:45:10.493318+0000","last_became_active":"2023-10-14T18:45:09.504143+0000","last_became_peered":"2023-10-14T18:45:09.504143+0000","last_unstale":"2023-10-14T18:45:10.493318+0000","last_undegraded":"2023-10-14T18:45:10.493318+0000","last_fullsized":"2023-10-14T18:45:10.493318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.493501+0000","last_change":"2023-10-14T18:45:09.506472+0000","last_active":"2023-10-14T18:45:10.493501+0000","last_peered":"2023-10-14T18:45:10.493501+0000","last_clean":"2023-10-14T18:45:10.493501+0000","last_became_active":"2023-10-14T18:45:09.506235+0000","last_became_peered":"2023-10-14T18:45:09.506235+0000","last_unstale":"2023-10-14T18:45:10.493501+0000","last_undegraded":"2023-10-14T18:45:10.493501+0000","last_fullsized":"2023-10-14T18:45:10.493501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:41.506345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499447+0000","last_change":"2023-10-14T18:45:10.499346+0000","last_active":"2023-10-14T18:45:10.499447+0000","last_peered":"2023-10-14T18:45:10.499447+0000","last_clean":"2023-10-14T18:45:10.499447+0000","last_became_active":"2023-10-14T18:45:10.499148+0000","last_became_peered":"2023-10-14T18:45:10.499148+0000","last_unstale":"2023-10-14T18:45:10.499447+0000","last_undegraded":"2023-10-14T18:45:10.499447+0000","last_fullsized":"2023-10-14T18:45:10.499447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T18:45:11.541163+0000","last_change":"2023-10-14T18:45:09.501194+0000","last_active":"2023-10-14T18:45:11.541163+0000","last_peered":"2023-10-14T18:45:11.541163+0000","last_clean":"2023-10-14T18:45:11.541163+0000","last_became_active":"2023-10-14T18:45:09.500823+0000","last_became_peered":"2023-10-14T18:45:09.500823+0000","last_unstale":"2023-10-14T18:45:11.541163+0000","last_undegraded":"2023-10-14T18:45:11.541163+0000","last_fullsized":"2023-10-14T18:45:11.541163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501838+0000","last_change":"2023-10-14T18:45:10.499131+0000","last_active":"2023-10-14T18:45:10.501838+0000","last_peered":"2023-10-14T18:45:10.501838+0000","last_clean":"2023-10-14T18:45:10.501838+0000","last_became_active":"2023-10-14T18:45:10.498855+0000","last_became_peered":"2023-10-14T18:45:10.498855+0000","last_unstale":"2023-10-14T18:45:10.501838+0000","last_undegraded":"2023-10-14T18:45:10.501838+0000","last_fullsized":"2023-10-14T18:45:10.501838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515364+0000","last_change":"2023-10-14T18:45:09.503127+0000","last_active":"2023-10-14T18:45:10.515364+0000","last_peered":"2023-10-14T18:45:10.515364+0000","last_clean":"2023-10-14T18:45:10.515364+0000","last_became_active":"2023-10-14T18:45:09.499701+0000","last_became_peered":"2023-10-14T18:45:09.499701+0000","last_unstale":"2023-10-14T18:45:10.515364+0000","last_undegraded":"2023-10-14T18:45:10.515364+0000","last_fullsized":"2023-10-14T18:45:10.515364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501481+0000","last_change":"2023-10-14T18:45:10.501420+0000","last_active":"2023-10-14T18:45:10.501481+0000","last_peered":"2023-10-14T18:45:10.501481+0000","last_clean":"2023-10-14T18:45:10.501481+0000","last_became_active":"2023-10-14T18:45:10.500635+0000","last_became_peered":"2023-10-14T18:45:10.500635+0000","last_unstale":"2023-10-14T18:45:10.501481+0000","last_undegraded":"2023-10-14T18:45:10.501481+0000","last_fullsized":"2023-10-14T18:45:10.501481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494616+0000","last_change":"2023-10-14T18:45:09.506431+0000","last_active":"2023-10-14T18:45:10.494616+0000","last_peered":"2023-10-14T18:45:10.494616+0000","last_clean":"2023-10-14T18:45:10.494616+0000","last_became_active":"2023-10-14T18:45:09.506187+0000","last_became_peered":"2023-10-14T18:45:09.506187+0000","last_unstale":"2023-10-14T18:45:10.494616+0000","last_undegraded":"2023-10-14T18:45:10.494616+0000","last_fullsized":"2023-10-14T18:45:10.494616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:17.117466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512381+0000","last_change":"2023-10-14T18:45:10.510948+0000","last_active":"2023-10-14T18:45:10.512381+0000","last_peered":"2023-10-14T18:45:10.512381+0000","last_clean":"2023-10-14T18:45:10.512381+0000","last_became_active":"2023-10-14T18:45:10.510290+0000","last_became_peered":"2023-10-14T18:45:10.510290+0000","last_unstale":"2023-10-14T18:45:10.512381+0000","last_undegraded":"2023-10-14T18:45:10.512381+0000","last_fullsized":"2023-10-14T18:45:10.512381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:36.074105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497573+0000","last_change":"2023-10-14T18:45:09.502242+0000","last_active":"2023-10-14T18:45:10.497573+0000","last_peered":"2023-10-14T18:45:10.497573+0000","last_clean":"2023-10-14T18:45:10.497573+0000","last_became_active":"2023-10-14T18:45:09.501997+0000","last_became_peered":"2023-10-14T18:45:09.501997+0000","last_unstale":"2023-10-14T18:45:10.497573+0000","last_undegraded":"2023-10-14T18:45:10.497573+0000","last_fullsized":"2023-10-14T18:45:10.497573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:35.069916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.501857+0000","last_change":"2023-10-14T18:45:10.499268+0000","last_active":"2023-10-14T18:45:10.501857+0000","last_peered":"2023-10-14T18:45:10.501857+0000","last_clean":"2023-10-14T18:45:10.501857+0000","last_became_active":"2023-10-14T18:45:10.498937+0000","last_became_peered":"2023-10-14T18:45:10.498937+0000","last_unstale":"2023-10-14T18:45:10.501857+0000","last_undegraded":"2023-10-14T18:45:10.501857+0000","last_fullsized":"2023-10-14T18:45:10.501857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.497497+0000","last_change":"2023-10-14T18:45:09.493047+0000","last_active":"2023-10-14T18:45:10.497497+0000","last_peered":"2023-10-14T18:45:10.497497+0000","last_clean":"2023-10-14T18:45:10.497497+0000","last_became_active":"2023-10-14T18:45:09.492815+0000","last_became_peered":"2023-10-14T18:45:09.492815+0000","last_unstale":"2023-10-14T18:45:10.497497+0000","last_undegraded":"2023-10-14T18:45:10.497497+0000","last_fullsized":"2023-10-14T18:45:10.497497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496137+0000","last_change":"2023-10-14T18:45:10.496060+0000","last_active":"2023-10-14T18:45:10.496137+0000","last_peered":"2023-10-14T18:45:10.496137+0000","last_clean":"2023-10-14T18:45:10.496137+0000","last_became_active":"2023-10-14T18:45:10.495823+0000","last_became_peered":"2023-10-14T18:45:10.495823+0000","last_unstale":"2023-10-14T18:45:10.496137+0000","last_undegraded":"2023-10-14T18:45:10.496137+0000","last_fullsized":"2023-10-14T18:45:10.496137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:41.087086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514544+0000","last_change":"2023-10-14T18:45:09.504130+0000","last_active":"2023-10-14T18:45:10.514544+0000","last_peered":"2023-10-14T18:45:10.514544+0000","last_clean":"2023-10-14T18:45:10.514544+0000","last_became_active":"2023-10-14T18:45:09.503874+0000","last_became_peered":"2023-10-14T18:45:09.503874+0000","last_unstale":"2023-10-14T18:45:10.514544+0000","last_undegraded":"2023-10-14T18:45:10.514544+0000","last_fullsized":"2023-10-14T18:45:10.514544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:43.689912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509075+0000","last_change":"2023-10-14T18:45:10.509017+0000","last_active":"2023-10-14T18:45:10.509075+0000","last_peered":"2023-10-14T18:45:10.509075+0000","last_clean":"2023-10-14T18:45:10.509075+0000","last_became_active":"2023-10-14T18:45:10.508852+0000","last_became_peered":"2023-10-14T18:45:10.508852+0000","last_unstale":"2023-10-14T18:45:10.509075+0000","last_undegraded":"2023-10-14T18:45:10.509075+0000","last_fullsized":"2023-10-14T18:45:10.509075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:56.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.495578+0000","last_change":"2023-10-14T18:45:09.501600+0000","last_active":"2023-10-14T18:45:10.495578+0000","last_peered":"2023-10-14T18:45:10.495578+0000","last_clean":"2023-10-14T18:45:10.495578+0000","last_became_active":"2023-10-14T18:45:09.501418+0000","last_became_peered":"2023-10-14T18:45:09.501418+0000","last_unstale":"2023-10-14T18:45:10.495578+0000","last_undegraded":"2023-10-14T18:45:10.495578+0000","last_fullsized":"2023-10-14T18:45:10.495578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:19:48.378201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.502764+0000","last_change":"2023-10-14T18:45:10.502085+0000","last_active":"2023-10-14T18:45:10.502764+0000","last_peered":"2023-10-14T18:45:10.502764+0000","last_clean":"2023-10-14T18:45:10.502764+0000","last_became_active":"2023-10-14T18:45:10.501863+0000","last_became_peered":"2023-10-14T18:45:10.501863+0000","last_unstale":"2023-10-14T18:45:10.502764+0000","last_undegraded":"2023-10-14T18:45:10.502764+0000","last_fullsized":"2023-10-14T18:45:10.502764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:35.335333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.514342+0000","last_change":"2023-10-14T18:45:09.497704+0000","last_active":"2023-10-14T18:45:10.514342+0000","last_peered":"2023-10-14T18:45:10.514342+0000","last_clean":"2023-10-14T18:45:10.514342+0000","last_became_active":"2023-10-14T18:45:09.497481+0000","last_became_peered":"2023-10-14T18:45:09.497481+0000","last_unstale":"2023-10-14T18:45:10.514342+0000","last_undegraded":"2023-10-14T18:45:10.514342+0000","last_fullsized":"2023-10-14T18:45:10.514342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:52.049968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511729+0000","last_change":"2023-10-14T18:45:10.511661+0000","last_active":"2023-10-14T18:45:10.511729+0000","last_peered":"2023-10-14T18:45:10.511729+0000","last_clean":"2023-10-14T18:45:10.511729+0000","last_became_active":"2023-10-14T18:45:10.507807+0000","last_became_peered":"2023-10-14T18:45:10.507807+0000","last_unstale":"2023-10-14T18:45:10.511729+0000","last_undegraded":"2023-10-14T18:45:10.511729+0000","last_fullsized":"2023-10-14T18:45:10.511729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:25.788030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.515251+0000","last_change":"2023-10-14T18:45:09.496750+0000","last_active":"2023-10-14T18:45:10.515251+0000","last_peered":"2023-10-14T18:45:10.515251+0000","last_clean":"2023-10-14T18:45:10.515251+0000","last_became_active":"2023-10-14T18:45:09.496512+0000","last_became_peered":"2023-10-14T18:45:09.496512+0000","last_unstale":"2023-10-14T18:45:10.515251+0000","last_undegraded":"2023-10-14T18:45:10.515251+0000","last_fullsized":"2023-10-14T18:45:10.515251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:08.481618+0000","last_clean_scrub_stamp":"2023-10-14T18:45:08.481618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:32:18.988117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.508444+0000","last_change":"2023-10-14T18:45:10.508346+0000","last_active":"2023-10-14T18:45:10.508444+0000","last_peered":"2023-10-14T18:45:10.508444+0000","last_clean":"2023-10-14T18:45:10.508444+0000","last_became_active":"2023-10-14T18:45:10.507586+0000","last_became_peered":"2023-10-14T18:45:10.507586+0000","last_unstale":"2023-10-14T18:45:10.508444+0000","last_undegraded":"2023-10-14T18:45:10.508444+0000","last_fullsized":"2023-10-14T18:45:10.508444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:41.724741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499036+0000","last_change":"2023-10-14T18:45:10.498971+0000","last_active":"2023-10-14T18:45:10.499036+0000","last_peered":"2023-10-14T18:45:10.499036+0000","last_clean":"2023-10-14T18:45:10.499036+0000","last_became_active":"2023-10-14T18:45:10.498667+0000","last_became_peered":"2023-10-14T18:45:10.498667+0000","last_unstale":"2023-10-14T18:45:10.499036+0000","last_undegraded":"2023-10-14T18:45:10.499036+0000","last_fullsized":"2023-10-14T18:45:10.499036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.507241+0000","last_change":"2023-10-14T18:45:10.507172+0000","last_active":"2023-10-14T18:45:10.507241+0000","last_peered":"2023-10-14T18:45:10.507241+0000","last_clean":"2023-10-14T18:45:10.507241+0000","last_became_active":"2023-10-14T18:45:10.506991+0000","last_became_peered":"2023-10-14T18:45:10.506991+0000","last_unstale":"2023-10-14T18:45:10.507241+0000","last_undegraded":"2023-10-14T18:45:10.507241+0000","last_fullsized":"2023-10-14T18:45:10.507241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:14:57.820391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.504549+0000","last_change":"2023-10-14T18:45:10.504274+0000","last_active":"2023-10-14T18:45:10.504549+0000","last_peered":"2023-10-14T18:45:10.504549+0000","last_clean":"2023-10-14T18:45:10.504549+0000","last_became_active":"2023-10-14T18:45:10.504016+0000","last_became_peered":"2023-10-14T18:45:10.504016+0000","last_unstale":"2023-10-14T18:45:10.504549+0000","last_undegraded":"2023-10-14T18:45:10.504549+0000","last_fullsized":"2023-10-14T18:45:10.504549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:19.397957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.494756+0000","last_change":"2023-10-14T18:45:10.494605+0000","last_active":"2023-10-14T18:45:10.494756+0000","last_peered":"2023-10-14T18:45:10.494756+0000","last_clean":"2023-10-14T18:45:10.494756+0000","last_became_active":"2023-10-14T18:45:10.494395+0000","last_became_peered":"2023-10-14T18:45:10.494395+0000","last_unstale":"2023-10-14T18:45:10.494756+0000","last_undegraded":"2023-10-14T18:45:10.494756+0000","last_fullsized":"2023-10-14T18:45:10.494756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.133322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505981+0000","last_change":"2023-10-14T18:45:10.505899+0000","last_active":"2023-10-14T18:45:10.505981+0000","last_peered":"2023-10-14T18:45:10.505981+0000","last_clean":"2023-10-14T18:45:10.505981+0000","last_became_active":"2023-10-14T18:45:10.505342+0000","last_became_peered":"2023-10-14T18:45:10.505342+0000","last_unstale":"2023-10-14T18:45:10.505981+0000","last_undegraded":"2023-10-14T18:45:10.505981+0000","last_fullsized":"2023-10-14T18:45:10.505981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.499958+0000","last_change":"2023-10-14T18:45:10.499873+0000","last_active":"2023-10-14T18:45:10.499958+0000","last_peered":"2023-10-14T18:45:10.499958+0000","last_clean":"2023-10-14T18:45:10.499958+0000","last_became_active":"2023-10-14T18:45:10.499655+0000","last_became_peered":"2023-10-14T18:45:10.499655+0000","last_unstale":"2023-10-14T18:45:10.499958+0000","last_undegraded":"2023-10-14T18:45:10.499958+0000","last_fullsized":"2023-10-14T18:45:10.499958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:21:44.853906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.505832+0000","last_change":"2023-10-14T18:45:10.505751+0000","last_active":"2023-10-14T18:45:10.505832+0000","last_peered":"2023-10-14T18:45:10.505832+0000","last_clean":"2023-10-14T18:45:10.505832+0000","last_became_active":"2023-10-14T18:45:10.505332+0000","last_became_peered":"2023-10-14T18:45:10.505332+0000","last_unstale":"2023-10-14T18:45:10.505832+0000","last_undegraded":"2023-10-14T18:45:10.505832+0000","last_fullsized":"2023-10-14T18:45:10.505832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:00.600530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.509361+0000","last_change":"2023-10-14T18:45:10.509310+0000","last_active":"2023-10-14T18:45:10.509361+0000","last_peered":"2023-10-14T18:45:10.509361+0000","last_clean":"2023-10-14T18:45:10.509361+0000","last_became_active":"2023-10-14T18:45:10.509153+0000","last_became_peered":"2023-10-14T18:45:10.509153+0000","last_unstale":"2023-10-14T18:45:10.509361+0000","last_undegraded":"2023-10-14T18:45:10.509361+0000","last_fullsized":"2023-10-14T18:45:10.509361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:24:42.258070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.510739+0000","last_change":"2023-10-14T18:45:10.507728+0000","last_active":"2023-10-14T18:45:10.510739+0000","last_peered":"2023-10-14T18:45:10.510739+0000","last_clean":"2023-10-14T18:45:10.510739+0000","last_became_active":"2023-10-14T18:45:10.505783+0000","last_became_peered":"2023-10-14T18:45:10.505783+0000","last_unstale":"2023-10-14T18:45:10.510739+0000","last_undegraded":"2023-10-14T18:45:10.510739+0000","last_fullsized":"2023-10-14T18:45:10.510739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:13.110816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.506116+0000","last_change":"2023-10-14T18:45:10.506057+0000","last_active":"2023-10-14T18:45:10.506116+0000","last_peered":"2023-10-14T18:45:10.506116+0000","last_clean":"2023-10-14T18:45:10.506116+0000","last_became_active":"2023-10-14T18:45:10.505663+0000","last_became_peered":"2023-10-14T18:45:10.505663+0000","last_unstale":"2023-10-14T18:45:10.506116+0000","last_undegraded":"2023-10-14T18:45:10.506116+0000","last_fullsized":"2023-10-14T18:45:10.506116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.512020+0000","last_change":"2023-10-14T18:45:10.511962+0000","last_active":"2023-10-14T18:45:10.512020+0000","last_peered":"2023-10-14T18:45:10.512020+0000","last_clean":"2023-10-14T18:45:10.512020+0000","last_became_active":"2023-10-14T18:45:10.508326+0000","last_became_peered":"2023-10-14T18:45:10.508326+0000","last_unstale":"2023-10-14T18:45:10.512020+0000","last_undegraded":"2023-10-14T18:45:10.512020+0000","last_fullsized":"2023-10-14T18:45:10.512020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:12.053498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.496888+0000","last_change":"2023-10-14T18:45:10.496788+0000","last_active":"2023-10-14T18:45:10.496888+0000","last_peered":"2023-10-14T18:45:10.496888+0000","last_clean":"2023-10-14T18:45:10.496888+0000","last_became_active":"2023-10-14T18:45:10.496408+0000","last_became_peered":"2023-10-14T18:45:10.496408+0000","last_unstale":"2023-10-14T18:45:10.496888+0000","last_undegraded":"2023-10-14T18:45:10.496888+0000","last_fullsized":"2023-10-14T18:45:10.496888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:19.164846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-14T18:45:10.511125+0000","last_change":"2023-10-14T18:45:10.511064+0000","last_active":"2023-10-14T18:45:10.511125+0000","last_peered":"2023-10-14T18:45:10.511125+0000","last_clean":"2023-10-14T18:45:10.511125+0000","last_became_active":"2023-10-14T18:45:10.510838+0000","last_became_peered":"2023-10-14T18:45:10.510838+0000","last_unstale":"2023-10-14T18:45:10.511125+0000","last_undegraded":"2023-10-14T18:45:10.511125+0000","last_fullsized":"2023-10-14T18:45:10.511125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:09.485807+0000","last_clean_scrub_stamp":"2023-10-14T18:45:09.485807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:52:17.664748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194667,"statfs":{"total":200000000,"available":199339539,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]}],"pool_statfs":[]}} 2023-10-14T18:45:23.978 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T18:45:23.978 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T18:45:23.978 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T18:45:23.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T18:45:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.123+0000 7ff021195700 1 Processor -- start 2023-10-14T18:45:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.123+0000 7ff021195700 1 -- start start 2023-10-14T18:45:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff021195700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff021195700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff01c15aff0 0x7ff01c070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff021195700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c067660 con 0x7ff01c15a6e0 2023-10-14T18:45:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff021195700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c15b460 con 0x7ff01c15aff0 2023-10-14T18:45:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff021195700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0684c0 con 0x7ff01c06f630 2023-10-14T18:45:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01a59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff01c15aff0 0x7ff01c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff01c15aff0 0x7ff01c070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55522/0 (socket says 172.21.15.79:55522) 2023-10-14T18:45:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01a59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55320/0 (socket says 172.21.15.79:55320) 2023-10-14T18:45:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01b59e700 1 -- 172.21.15.79:0/1496746553 learned_addr learned my addr 172.21.15.79:0/1496746553 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.124+0000 7ff01ad9d700 1 --1- 172.21.15.79:0/1496746553 >> v1:172.21.15.144:6789/0 conn(0x7ff01c15a6e0 0x7ff01c068950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:48452/0 (socket says 172.21.15.79:48452) 2023-10-14T18:45:24.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01b59e700 1 -- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 msgr2=0x7ff01c15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01b59e700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01b59e700 1 -- 172.21.15.79:0/1496746553 >> v1:172.21.15.144:6789/0 conn(0x7ff01c15a6e0 legacy=0x7ff01c068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01b59e700 1 -- 172.21.15.79:0/1496746553 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0678b0 con 0x7ff01c15aff0 2023-10-14T18:45:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff019d9b700 1 -- 172.21.15.79:0/1496746553 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170070876 0 0) 0x7ff01c067660 con 0x7ff01c15a6e0 2023-10-14T18:45:24.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01a59c700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff01b59e700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c15aff0 0x7ff01c070700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0140099b0 tx=0x7ff014009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8c465e1c922796 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff019d9b700 1 -- 172.21.15.79:0/1496746553 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014009ea0 con 0x7ff01c15aff0 2023-10-14T18:45:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff019d9b700 1 -- 172.21.15.79:0/1496746553 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400b860 con 0x7ff01c15aff0 2023-10-14T18:45:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff019d9b700 1 -- 172.21.15.79:0/1496746553 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400bc00 con 0x7ff01c15aff0 2023-10-14T18:45:24.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff021195700 1 -- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c15aff0 msgr2=0x7ff01c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.125+0000 7ff021195700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c15aff0 0x7ff01c070700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0140099b0 tx=0x7ff014009250 comp rx=0 tx=0).stop 2023-10-14T18:45:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 -- 172.21.15.79:0/1496746553 shutdown_connections 2023-10-14T18:45:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c15aff0 0x7ff01c070700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 --2- 172.21.15.79:0/1496746553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c06f630 0x7ff01c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 -- 172.21.15.79:0/1496746553 >> 172.21.15.79:0/1496746553 conn(0x7ff01c06a250 msgr2=0x7ff01c06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 -- 172.21.15.79:0/1496746553 shutdown_connections 2023-10-14T18:45:24.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.126+0000 7ff021195700 1 -- 172.21.15.79:0/1496746553 wait complete. 2023-10-14T18:45:24.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.127+0000 7ff021195700 1 Processor -- start 2023-10-14T18:45:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.127+0000 7ff021195700 1 -- start start 2023-10-14T18:45:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.127+0000 7ff021195700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 0x7ff01c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.127+0000 7ff021195700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 0x7ff01c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b0900 con 0x7ff01c15aff0 2023-10-14T18:45:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159a90 con 0x7ff01c06f630 2023-10-14T18:45:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159d70 con 0x7ff01c15a6e0 2023-10-14T18:45:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59768/0 (socket says 172.21.15.79:59768) 2023-10-14T18:45:24.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 -- 172.21.15.79:0/1911772506 learned_addr learned my addr 172.21.15.79:0/1911772506 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01ad9d700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 0x7ff01c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01a59c700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 0x7ff01c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 -- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 msgr2=0x7ff01c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 0x7ff01c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 -- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 msgr2=0x7ff01c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 0x7ff01c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 -- 172.21.15.79:0/1911772506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010009420 con 0x7ff01c15aff0 2023-10-14T18:45:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01ad9d700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 0x7ff01c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01a59c700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 0x7ff01c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff01b59e700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0cd7e0 tx=0x7ff014017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400bba0 con 0x7ff01c15aff0 2023-10-14T18:45:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff014025420 con 0x7ff01c15aff0 2023-10-14T18:45:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0140094f0 con 0x7ff01c15aff0 2023-10-14T18:45:24.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0140257e0 con 0x7ff01c15aff0 2023-10-14T18:45:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.128+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c15a330 con 0x7ff01c15aff0 2023-10-14T18:45:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.129+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c0b0a70 con 0x7ff01c15aff0 2023-10-14T18:45:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.129+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff014023070 con 0x7ff01c15aff0 2023-10-14T18:45:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.130+0000 7ff002ffd700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.130+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0140861b0 con 0x7ff01c15aff0 2023-10-14T18:45:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.130+0000 7ff01ad9d700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.130+0000 7ff01ad9d700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 0x7ff0080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff00c001ff0 tx=0x7ff00c005c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.134+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff01c0b0a70 con 0x7ff01c15aff0 2023-10-14T18:45:24.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.357+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff01c0b0a70 con 0x7ff01c15aff0 2023-10-14T18:45:24.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.358+0000 7ff002ffd700 1 -- 172.21.15.79:0/1911772506 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff01c0b0a70 con 0x7ff01c15aff0 2023-10-14T18:45:24.360 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:24.360 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T18:45:24.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 msgr2=0x7ff0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 0x7ff0080693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff00c001ff0 tx=0x7ff00c005c70 comp rx=0 tx=0).stop 2023-10-14T18:45:24.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 msgr2=0x7ff01c15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0cd7e0 tx=0x7ff014017000 comp rx=0 tx=0).stop 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 shutdown_connections 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff008066f30 0x7ff0080693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff01c15aff0 0x7ff01c15cc60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff01c06f630 0x7ff01c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 --2- 172.21.15.79:0/1911772506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff01c15a6e0 0x7ff01c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 >> 172.21.15.79:0/1911772506 conn(0x7ff01c06a250 msgr2=0x7ff01c0cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:24.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 shutdown_connections 2023-10-14T18:45:24.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.360+0000 7ff021195700 1 -- 172.21.15.79:0/1911772506 wait complete. 2023-10-14T18:45:24.373 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T18:45:24.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.487+0000 7ff7448ad700 1 Processor -- start 2023-10-14T18:45:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.487+0000 7ff7448ad700 1 -- start start 2023-10-14T18:45:24.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff7448ad700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff740157870 0x7ff74015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff7448ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff740158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff7448ad700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74015cbb0 con 0x7ff74015a620 2023-10-14T18:45:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff7448ad700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74015bfa0 con 0x7ff740157870 2023-10-14T18:45:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff7448ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015c280 con 0x7ff740157c40 2023-10-14T18:45:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff74015a620 0x7ff74015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45620/0 (socket says 172.21.15.79:45620) 2023-10-14T18:45:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73dd9b700 1 -- 172.21.15.79:0/2707137330 learned_addr learned my addr 172.21.15.79:0/2707137330 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff740158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73e59c700 1 --2- 172.21.15.79:0/2707137330 >> v2:172.21.15.144:3300/0 conn(0x7ff740157870 0x7ff74015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242370093 0 0) 0x7ff74015cbb0 con 0x7ff74015a620 2023-10-14T18:45:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff728003570 con 0x7ff74015a620 2023-10-14T18:45:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162258934 0 0) 0x7ff728003570 con 0x7ff74015a620 2023-10-14T18:45:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 msgr2=0x7ff740158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff740158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 >> v2:172.21.15.144:3300/0 conn(0x7ff740157870 msgr2=0x7ff74015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 --2- 172.21.15.79:0/2707137330 >> v2:172.21.15.144:3300/0 conn(0x7ff740157870 0x7ff74015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74015c560 con 0x7ff74015a620 2023-10-14T18:45:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff734001470 con 0x7ff74015a620 2023-10-14T18:45:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 >> v1:172.21.15.79:6789/0 conn(0x7ff74015a620 legacy=0x7ff74015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff728003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728003fe0 0x7ff728004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015bfa0 con 0x7ff728004d50 2023-10-14T18:45:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015c280 con 0x7ff728003fe0 2023-10-14T18:45:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72800ba90 con 0x7ff740157c40 2023-10-14T18:45:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73e59c700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff728003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.488+0000 7ff73dd9b700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728003fe0 0x7ff728004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 -- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 msgr2=0x7ff728003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff740157c40 0x7ff728003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 -- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728003fe0 msgr2=0x7ff728004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff728003fe0 0x7ff728004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 -- 172.21.15.79:0/2707137330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728003570 con 0x7ff728004d50 2023-10-14T18:45:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7280051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7401580c0 tx=0x7ff73800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbb724639a97b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73800ea30 con 0x7ff728004d50 2023-10-14T18:45:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800f040 con 0x7ff728004d50 2023-10-14T18:45:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73d59a700 1 -- 172.21.15.79:0/2707137330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73800ede0 con 0x7ff728004d50 2023-10-14T18:45:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff7448ad700 1 -- 172.21.15.79:0/2707137330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 msgr2=0x7ff7280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff7448ad700 1 --2- 172.21.15.79:0/2707137330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7280051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7401580c0 tx=0x7ff73800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff73ed9d700 1 -- 172.21.15.79:0/2707137330 reap_dead start 2023-10-14T18:45:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff7448ad700 1 -- 172.21.15.79:0/2707137330 shutdown_connections 2023-10-14T18:45:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.489+0000 7ff7448ad700 1 -- 172.21.15.79:0/2707137330 >> 172.21.15.79:0/2707137330 conn(0x7ff740068ce0 msgr2=0x7ff7400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.490+0000 7ff7448ad700 1 -- 172.21.15.79:0/2707137330 shutdown_connections 2023-10-14T18:45:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.490+0000 7ff7448ad700 1 -- 172.21.15.79:0/2707137330 wait complete. 2023-10-14T18:45:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 Processor -- start 2023-10-14T18:45:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 -- start start 2023-10-14T18:45:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff74014ceb0 0x7ff7401504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 0x7ff74014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff740153210 con 0x7ff728004d50 2023-10-14T18:45:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff740152600 con 0x7ff7401509f0 2023-10-14T18:45:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff7448ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7401528e0 con 0x7ff74014ceb0 2023-10-14T18:45:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff73e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff73e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59778/0 (socket says 172.21.15.79:59778) 2023-10-14T18:45:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.491+0000 7ff73e59c700 1 -- 172.21.15.79:0/272241147 learned_addr learned my addr 172.21.15.79:0/272241147 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 0x7ff74014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73dd9b700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff74014ceb0 0x7ff7401504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 -- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff74014ceb0 msgr2=0x7ff7401504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff74014ceb0 0x7ff7401504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 -- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 msgr2=0x7ff74014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 0x7ff74014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 -- 172.21.15.79:0/272241147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740152bc0 con 0x7ff728004d50 2023-10-14T18:45:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73ed9d700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 0x7ff74014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff73e59c700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff730006ac0 tx=0x7ff7300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000fa10 con 0x7ff728004d50 2023-10-14T18:45:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000fb70 con 0x7ff728004d50 2023-10-14T18:45:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff740152ea0 con 0x7ff728004d50 2023-10-14T18:45:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730014440 con 0x7ff728004d50 2023-10-14T18:45:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.492+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff740152160 con 0x7ff728004d50 2023-10-14T18:45:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.493+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74004c3c0 con 0x7ff728004d50 2023-10-14T18:45:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.493+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff730014830 con 0x7ff728004d50 2023-10-14T18:45:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.494+0000 7ff72e7fc700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.494+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff730018030 con 0x7ff728004d50 2023-10-14T18:45:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.494+0000 7ff73dd9b700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.494+0000 7ff73dd9b700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 0x7ff7200693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff734001d20 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.498+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff730052280 con 0x7ff728004d50 2023-10-14T18:45:24.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.682+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff74015c840 con 0x7ff728004d50 2023-10-14T18:45:24.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.683+0000 7ff72e7fc700 1 -- 172.21.15.79:0/272241147 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff730022090 con 0x7ff728004d50 2023-10-14T18:45:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:24.685 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:24.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 msgr2=0x7ff7200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 0x7ff7200693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff734001d20 tx=0x7ff734009040 comp rx=0 tx=0).stop 2023-10-14T18:45:24.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 msgr2=0x7ff7401536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff730006ac0 tx=0x7ff7300091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 shutdown_connections 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff720066f30 0x7ff7200693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7401509f0 0x7ff74014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff728004d50 0x7ff7401536a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 --2- 172.21.15.79:0/272241147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff74014ceb0 0x7ff7401504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 >> 172.21.15.79:0/272241147 conn(0x7ff740068ce0 msgr2=0x7ff7400b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:24.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 shutdown_connections 2023-10-14T18:45:24.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.685+0000 7ff7448ad700 1 -- 172.21.15.79:0/272241147 wait complete. 2023-10-14T18:45:24.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:24.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:24.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.816+0000 7f70d10aa700 1 Processor -- start 2023-10-14T18:45:24.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.816+0000 7f70d10aa700 1 -- start start 2023-10-14T18:45:24.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70d10aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70cc15a290 0x7f70cc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70d10aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 0x7f70cc0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70d10aa700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0b0790 con 0x7f70cc159ec0 2023-10-14T18:45:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70d10aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc06af60 con 0x7f70cc15a290 2023-10-14T18:45:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70d10aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0ce1f0 con 0x7f70cc06aae0 2023-10-14T18:45:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70cad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f70cc159ec0 0x7f70cc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45630/0 (socket says 172.21.15.79:45630) 2023-10-14T18:45:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70cad9d700 1 -- 172.21.15.79:0/2051567485 learned_addr learned my addr 172.21.15.79:0/2051567485 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70c259c700 1 --2- 172.21.15.79:0/2051567485 >> v2:172.21.15.144:3300/0 conn(0x7f70cc15a290 0x7f70cc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70cb59e700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 0x7f70cc0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847536633 0 0) 0x7f70cc0b0790 con 0x7f70cc159ec0 2023-10-14T18:45:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.817+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003570 con 0x7f70cc159ec0 2023-10-14T18:45:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828814599 0 0) 0x7f70b8003570 con 0x7f70cc159ec0 2023-10-14T18:45:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70c259c700 1 -- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 msgr2=0x7f70cc0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70c259c700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 0x7f70cc0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70c259c700 1 -- 172.21.15.79:0/2051567485 >> v1:172.21.15.79:6789/0 conn(0x7f70cc159ec0 legacy=0x7f70cc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70c259c700 1 -- 172.21.15.79:0/2051567485 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0b0b20 con 0x7f70cc15a290 2023-10-14T18:45:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70cb59e700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 0x7f70cc0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70c259c700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc15a290 0x7f70cc06a5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098e0 tx=0x7f70b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1240b2ca625c341 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc001470 con 0x7f70cc15a290 2023-10-14T18:45:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4011420 con 0x7f70cc15a290 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70ca59c700 1 -- 172.21.15.79:0/2051567485 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40117c0 con 0x7f70cc15a290 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70d10aa700 1 -- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc15a290 msgr2=0x7f70cc06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.818+0000 7f70d10aa700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc15a290 0x7f70cc06a5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70b40098e0 tx=0x7f70b40091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 -- 172.21.15.79:0/2051567485 shutdown_connections 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc06aae0 0x7f70cc0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 --2- 172.21.15.79:0/2051567485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc15a290 0x7f70cc06a5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 -- 172.21.15.79:0/2051567485 >> 172.21.15.79:0/2051567485 conn(0x7f70cc0d1880 msgr2=0x7f70cc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:24.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 -- 172.21.15.79:0/2051567485 shutdown_connections 2023-10-14T18:45:24.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.819+0000 7f70d10aa700 1 -- 172.21.15.79:0/2051567485 wait complete. 2023-10-14T18:45:24.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.820+0000 7f70d10aa700 1 Processor -- start 2023-10-14T18:45:24.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.820+0000 7f70d10aa700 1 -- start start 2023-10-14T18:45:24.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.820+0000 7f70d10aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.820+0000 7f70d10aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc159ec0 0x7f70cc15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.820+0000 7f70d10aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 0x7f70cc15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70d10aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0b6440 con 0x7f70cc06aae0 2023-10-14T18:45:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70d10aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c8700 con 0x7f70cc159ec0 2023-10-14T18:45:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70d10aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0c89e0 con 0x7f70cc15a290 2023-10-14T18:45:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59780/0 (socket says 172.21.15.79:59780) 2023-10-14T18:45:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 -- 172.21.15.79:0/1996739945 learned_addr learned my addr 172.21.15.79:0/1996739945 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:24.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70c259c700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc159ec0 0x7f70cc15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cb59e700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 0x7f70cc15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 -- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 msgr2=0x7f70cc15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 0x7f70cc15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 -- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc159ec0 msgr2=0x7f70cc15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc159ec0 0x7f70cc15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 -- 172.21.15.79:0/1996739945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009a20 con 0x7f70cc06aae0 2023-10-14T18:45:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cb59e700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 0x7f70cc15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70cad9d700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00cb90 tx=0x7f70bc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc007360 con 0x7f70cc06aae0 2023-10-14T18:45:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc0074e0 con 0x7f70cc06aae0 2023-10-14T18:45:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b4009420 con 0x7f70cc06aae0 2023-10-14T18:45:24.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc004830 con 0x7f70cc06aae0 2023-10-14T18:45:24.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.821+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc0c8fa0 con 0x7f70cc06aae0 2023-10-14T18:45:24.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.822+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc04c3c0 con 0x7f70cc06aae0 2023-10-14T18:45:24.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.822+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70bc004ba0 con 0x7f70cc06aae0 2023-10-14T18:45:24.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.823+0000 7f70c37fe700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 0x7f70ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.823+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70bc083e90 con 0x7f70cc06aae0 2023-10-14T18:45:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.823+0000 7f70c259c700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 0x7f70ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.823+0000 7f70c259c700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 0x7f70ac0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70b40093f0 tx=0x7f70b4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:24.827+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70bc051180 con 0x7f70cc06aae0 2023-10-14T18:45:25.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.009+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70cc0b04b0 con 0x7f70cc06aae0 2023-10-14T18:45:25.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.009+0000 7f70c37fe700 1 -- 172.21.15.79:0/1996739945 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70bc018020 con 0x7f70cc06aae0 2023-10-14T18:45:25.011 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:25.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 msgr2=0x7f70ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 0x7f70ac0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70b40093f0 tx=0x7f70b4016000 comp rx=0 tx=0).stop 2023-10-14T18:45:25.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 msgr2=0x7f70cc1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00cb90 tx=0x7f70bc001b50 comp rx=0 tx=0).stop 2023-10-14T18:45:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 shutdown_connections 2023-10-14T18:45:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70ac066f30 0x7f70ac0693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70cc15a290 0x7f70cc15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70cc06aae0 0x7f70cc1553d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 --2- 172.21.15.79:0/1996739945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc159ec0 0x7f70cc15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 >> 172.21.15.79:0/1996739945 conn(0x7f70cc0d1880 msgr2=0x7f70cc1574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 shutdown_connections 2023-10-14T18:45:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.011+0000 7f70d10aa700 1 -- 172.21.15.79:0/1996739945 wait complete. 2023-10-14T18:45:25.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:25.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.140+0000 7f32e56b2700 1 Processor -- start 2023-10-14T18:45:25.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.140+0000 7f32e56b2700 1 -- start start 2023-10-14T18:45:25.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32e56b2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32e015a290 0x7f32e006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32e56b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32e56b2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e00b0790 con 0x7f32e0159ec0 2023-10-14T18:45:25.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32e56b2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e006af60 con 0x7f32e015a290 2023-10-14T18:45:25.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32e56b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00ce1f0 con 0x7f32e006aae0 2023-10-14T18:45:25.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32deffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32e0159ec0 0x7f32e00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45638/0 (socket says 172.21.15.79:45638) 2023-10-14T18:45:25.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32deffd700 1 -- 172.21.15.79:0/2774515172 learned_addr learned my addr 172.21.15.79:0/2774515172 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:25.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 --2- 172.21.15.79:0/2774515172 >> v2:172.21.15.79:3300/0 conn(0x7f32e015a290 0x7f32e006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32ddffb700 1 -- 172.21.15.79:0/2774515172 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337077146 0 0) 0x7f32e00b0790 con 0x7f32e0159ec0 2023-10-14T18:45:25.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32df7fe700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32ddffb700 1 -- 172.21.15.79:0/2774515172 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32cc003570 con 0x7f32e0159ec0 2023-10-14T18:45:25.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 -- 172.21.15.79:0/2774515172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 msgr2=0x7f32e00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:25.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 -- 172.21.15.79:0/2774515172 >> v1:172.21.15.79:6789/0 conn(0x7f32e0159ec0 legacy=0x7f32e00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 -- 172.21.15.79:0/2774515172 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e00b0b20 con 0x7f32e015a290 2023-10-14T18:45:25.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32de7fc700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e006a5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32c80098e0 tx=0x7f32c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cd5efe3afc25a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32ddffb700 1 -- 172.21.15.79:0/2774515172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800b640 con 0x7f32e015a290 2023-10-14T18:45:25.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32ddffb700 1 -- 172.21.15.79:0/2774515172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800b7a0 con 0x7f32e015a290 2023-10-14T18:45:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.141+0000 7f32ddffb700 1 -- 172.21.15.79:0/2774515172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800bb40 con 0x7f32e015a290 2023-10-14T18:45:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 -- 172.21.15.79:0/2774515172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 msgr2=0x7f32e006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e006a5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32c80098e0 tx=0x7f32c80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 -- 172.21.15.79:0/2774515172 shutdown_connections 2023-10-14T18:45:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 --2- 172.21.15.79:0/2774515172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e006a5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 -- 172.21.15.79:0/2774515172 >> 172.21.15.79:0/2774515172 conn(0x7f32e00d1880 msgr2=0x7f32e00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 -- 172.21.15.79:0/2774515172 shutdown_connections 2023-10-14T18:45:25.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.142+0000 7f32e56b2700 1 -- 172.21.15.79:0/2774515172 wait complete. 2023-10-14T18:45:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.143+0000 7f32e56b2700 1 Processor -- start 2023-10-14T18:45:25.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.143+0000 7f32e56b2700 1 -- start start 2023-10-14T18:45:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e0150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 0x7f32e00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e014f230 con 0x7f32e015a290 2023-10-14T18:45:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01529f0 con 0x7f32e0159ec0 2023-10-14T18:45:25.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32e56b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0153330 con 0x7f32e006aae0 2023-10-14T18:45:25.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59798/0 (socket says 172.21.15.79:59798) 2023-10-14T18:45:25.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 -- 172.21.15.79:0/3187187669 learned_addr learned my addr 172.21.15.79:0/3187187669 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:25.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32de7fc700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 0x7f32e00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32deffd700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e0150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 -- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 msgr2=0x7f32e0150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e0150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 -- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 msgr2=0x7f32e00b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 0x7f32e00b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 -- 172.21.15.79:0/3187187669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8009420 con 0x7f32e015a290 2023-10-14T18:45:25.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32de7fc700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 0x7f32e00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:25.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32deffd700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e0150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:25.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32df7fe700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32d000d890 tx=0x7f32d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.144+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00125f0 con 0x7f32e015a290 2023-10-14T18:45:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.145+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0012770 con 0x7f32e015a290 2023-10-14T18:45:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.145+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e0153610 con 0x7f32e015a290 2023-10-14T18:45:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.145+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0012b30 con 0x7f32e015a290 2023-10-14T18:45:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.145+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e0153bd0 con 0x7f32e015a290 2023-10-14T18:45:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.145+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e004c3c0 con 0x7f32e015a290 2023-10-14T18:45:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.146+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32d001e460 con 0x7f32e015a290 2023-10-14T18:45:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.146+0000 7f32d6ffd700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.146+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32d0084c90 con 0x7f32e015a290 2023-10-14T18:45:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.147+0000 7f32deffd700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.147+0000 7f32deffd700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 0x7f32c00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005c50 tx=0x7f32d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.150+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32d0051f00 con 0x7f32e015a290 2023-10-14T18:45:25.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.333+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32e014f370 con 0x7f32e015a290 2023-10-14T18:45:25.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.334+0000 7f32d6ffd700 1 -- 172.21.15.79:0/3187187669 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32d0055520 con 0x7f32e015a290 2023-10-14T18:45:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:25.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 msgr2=0x7f32c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 0x7f32c00693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005c50 tx=0x7f32d8009040 comp rx=0 tx=0).stop 2023-10-14T18:45:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 msgr2=0x7f32e01551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32d000d890 tx=0x7f32d0008040 comp rx=0 tx=0).stop 2023-10-14T18:45:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 shutdown_connections 2023-10-14T18:45:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32c0066f30 0x7f32c00693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32e015a290 0x7f32e01551e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32e006aae0 0x7f32e0150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 --2- 172.21.15.79:0/3187187669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32e0159ec0 0x7f32e00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 >> 172.21.15.79:0/3187187669 conn(0x7f32e00d1880 msgr2=0x7f32e00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 shutdown_connections 2023-10-14T18:45:25.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.336+0000 7f32e56b2700 1 -- 172.21.15.79:0/3187187669 wait complete. 2023-10-14T18:45:25.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:25.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.465+0000 7f3fa8bdf700 1 Processor -- start 2023-10-14T18:45:25.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.465+0000 7f3fa8bdf700 1 -- start start 2023-10-14T18:45:25.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa8bdf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fa40c8220 0x7f3fa40c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa8bdf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 0x7f3fa40afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa8bdf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa406ef20 con 0x7f3fa40678b0 2023-10-14T18:45:25.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa8bdf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa406fac0 con 0x7f3fa40c8220 2023-10-14T18:45:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa8bdf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa406e310 con 0x7f3fa4067c80 2023-10-14T18:45:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3f99d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fa40c8220 0x7f3fa40c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3f99d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3fa40c8220 0x7f3fa40c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59804/0 (socket says 172.21.15.79:59804) 2023-10-14T18:45:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3f99d9b700 1 -- 172.21.15.79:0/2057745703 learned_addr learned my addr 172.21.15.79:0/2057745703 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:25.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3fa2d9d700 1 --2- 172.21.15.79:0/2057745703 >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 0x7f3fa40afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.466+0000 7f3f99d9b700 1 -- 172.21.15.79:0/2057745703 >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 msgr2=0x7f3fa40afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3f99d9b700 1 --2- 172.21.15.79:0/2057745703 >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 0x7f3fa40afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3f99d9b700 1 -- 172.21.15.79:0/2057745703 >> v1:172.21.15.144:6789/0 conn(0x7f3fa40678b0 legacy=0x7f3fa406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3f99d9b700 1 -- 172.21.15.79:0/2057745703 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa406e5f0 con 0x7f3fa40c8220 2023-10-14T18:45:25.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa2d9d700 1 --2- 172.21.15.79:0/2057745703 >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 0x7f3fa40afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3f99d9b700 1 --2- 172.21.15.79:0/2057745703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa40c9100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fa415ba90 tx=0x7f3f8c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66338356e71aeb94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa1d9b700 1 -- 172.21.15.79:0/2057745703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005c10 con 0x7f3fa40c8220 2023-10-14T18:45:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa1d9b700 1 -- 172.21.15.79:0/2057745703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c005d70 con 0x7f3fa40c8220 2023-10-14T18:45:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa1d9b700 1 -- 172.21.15.79:0/2057745703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00b840 con 0x7f3fa40c8220 2023-10-14T18:45:25.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/2057745703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 msgr2=0x7f3fa40c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/2057745703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa40c9100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fa415ba90 tx=0x7f3f8c009220 comp rx=0 tx=0).stop 2023-10-14T18:45:25.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/2057745703 shutdown_connections 2023-10-14T18:45:25.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/2057745703 >> v2:172.21.15.144:3300/0 conn(0x7f3fa4067c80 0x7f3fa40afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/2057745703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa40c9100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/2057745703 >> 172.21.15.79:0/2057745703 conn(0x7f3fa40ce540 msgr2=0x7f3fa40ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/2057745703 shutdown_connections 2023-10-14T18:45:25.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.467+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/2057745703 wait complete. 2023-10-14T18:45:25.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 Processor -- start 2023-10-14T18:45:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 -- start start 2023-10-14T18:45:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 0x7f3fa414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa4067c80 0x7f3fa40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa414f4e0 con 0x7f3fa40c8220 2023-10-14T18:45:25.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40ae800 con 0x7f3fa40678b0 2023-10-14T18:45:25.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa8bdf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40aeae0 con 0x7f3fa4067c80 2023-10-14T18:45:25.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59818/0 (socket says 172.21.15.79:59818) 2023-10-14T18:45:25.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.469+0000 7f3fa2d9d700 1 -- 172.21.15.79:0/3385895208 learned_addr learned my addr 172.21.15.79:0/3385895208 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa259c700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 0x7f3fa414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 -- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa4067c80 msgr2=0x7f3fa40b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3f99d9b700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa4067c80 0x7f3fa40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa4067c80 0x7f3fa40b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 -- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 msgr2=0x7f3fa414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 0x7f3fa414efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 -- 172.21.15.79:0/3385895208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c009480 con 0x7f3fa40c8220 2023-10-14T18:45:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa259c700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 0x7f3fa414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa2d9d700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00a380 tx=0x7f3f9c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00ae10 con 0x7f3fa40c8220 2023-10-14T18:45:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00d650 con 0x7f3fa40c8220 2023-10-14T18:45:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40aedc0 con 0x7f3fa40c8220 2023-10-14T18:45:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00da10 con 0x7f3fa40c8220 2023-10-14T18:45:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.470+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa40af380 con 0x7f3fa40c8220 2023-10-14T18:45:25.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.471+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40af570 con 0x7f3fa40c8220 2023-10-14T18:45:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.472+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f9c01e3b0 con 0x7f3fa40c8220 2023-10-14T18:45:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.472+0000 7f3f9affd700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.472+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f9c0853b0 con 0x7f3fa40c8220 2023-10-14T18:45:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.473+0000 7f3fa259c700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.473+0000 7f3fa259c700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f940028b0 tx=0x7f3f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.476+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f9c052600 con 0x7f3fa40c8220 2023-10-14T18:45:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.660+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fa404c3c0 con 0x7f3fa40c8220 2023-10-14T18:45:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.660+0000 7f3f9affd700 1 -- 172.21.15.79:0/3385895208 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f9c01a020 con 0x7f3fa40c8220 2023-10-14T18:45:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.662+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 msgr2=0x7f3f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.662+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f940028b0 tx=0x7f3f94009040 comp rx=0 tx=0).stop 2023-10-14T18:45:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.662+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 msgr2=0x7f3fa415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.662+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00a380 tx=0x7f3f9c007900 comp rx=0 tx=0).stop 2023-10-14T18:45:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 shutdown_connections 2023-10-14T18:45:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fa40c8220 0x7f3fa415a8a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fa40678b0 0x7f3fa414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 --2- 172.21.15.79:0/3385895208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fa4067c80 0x7f3fa40b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 >> 172.21.15.79:0/3385895208 conn(0x7f3fa40ce540 msgr2=0x7f3fa40cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 shutdown_connections 2023-10-14T18:45:25.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.663+0000 7f3fa8bdf700 1 -- 172.21.15.79:0/3385895208 wait complete. 2023-10-14T18:45:25.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.788+0000 7fc3a81fb700 1 Processor -- start 2023-10-14T18:45:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.788+0000 7fc3a81fb700 1 -- start start 2023-10-14T18:45:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a81fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a01577d0 0x7fc3a00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a81fb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3a0157ba0 0x7fc3a006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a81fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a015c360 con 0x7fc3a015b0d0 2023-10-14T18:45:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a81fb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a015b790 con 0x7fc3a0157ba0 2023-10-14T18:45:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a81fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015d800 con 0x7fc3a01577d0 2023-10-14T18:45:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a5796700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3a0157ba0 0x7fc3a006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a6798700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc3a015b0d0 0x7fc3a015da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45640/0 (socket says 172.21.15.79:45640) 2023-10-14T18:45:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.789+0000 7fc3a6798700 1 -- 172.21.15.79:0/305289229 learned_addr learned my addr 172.21.15.79:0/305289229 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5796700 1 -- 172.21.15.79:0/305289229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a01577d0 msgr2=0x7fc3a00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5f97700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a01577d0 0x7fc3a00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a4f95700 1 -- 172.21.15.79:0/305289229 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678604352 0 0) 0x7fc3a015c360 con 0x7fc3a015b0d0 2023-10-14T18:45:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5796700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a01577d0 0x7fc3a00cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5796700 1 -- 172.21.15.79:0/305289229 >> v1:172.21.15.79:6789/0 conn(0x7fc3a015b0d0 legacy=0x7fc3a015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5796700 1 -- 172.21.15.79:0/305289229 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a015ba30 con 0x7fc3a0157ba0 2023-10-14T18:45:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a5796700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a006a520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc3900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01906deb5c3a03b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a4f95700 1 -- 172.21.15.79:0/305289229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390009e80 con 0x7fc3a0157ba0 2023-10-14T18:45:25.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a4f95700 1 -- 172.21.15.79:0/305289229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39000b860 con 0x7fc3a0157ba0 2023-10-14T18:45:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a4f95700 1 -- 172.21.15.79:0/305289229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000bbe0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 -- 172.21.15.79:0/305289229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 msgr2=0x7fc3a006a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a006a520 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098e0 tx=0x7fc3900091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 -- 172.21.15.79:0/305289229 shutdown_connections 2023-10-14T18:45:25.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a01577d0 0x7fc3a00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/305289229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a006a520 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.790+0000 7fc3a81fb700 1 -- 172.21.15.79:0/305289229 >> 172.21.15.79:0/305289229 conn(0x7fc3a0068ce0 msgr2=0x7fc3a00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.791+0000 7fc3a81fb700 1 -- 172.21.15.79:0/305289229 shutdown_connections 2023-10-14T18:45:25.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.791+0000 7fc3a81fb700 1 -- 172.21.15.79:0/305289229 wait complete. 2023-10-14T18:45:25.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 Processor -- start 2023-10-14T18:45:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 -- start start 2023-10-14T18:45:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a01577d0 0x7fc3a0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a015b0d0 0x7fc3a00d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a016b750 con 0x7fc3a0157ba0 2023-10-14T18:45:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0152a80 con 0x7fc3a01577d0 2023-10-14T18:45:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a81fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01524e0 con 0x7fc3a015b0d0 2023-10-14T18:45:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a5796700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a5796700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59832/0 (socket says 172.21.15.79:59832) 2023-10-14T18:45:25.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.792+0000 7fc3a5796700 1 -- 172.21.15.79:0/3623405734 learned_addr learned my addr 172.21.15.79:0/3623405734 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:25.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 -- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a015b0d0 msgr2=0x7fc3a00d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a015b0d0 0x7fc3a00d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 -- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a01577d0 msgr2=0x7fc3a0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:25.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a01577d0 0x7fc3a0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:25.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 -- 172.21.15.79:0/3623405734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390009420 con 0x7fc3a0157ba0 2023-10-14T18:45:25.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a5796700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006b580 tx=0x7fc390017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000bbe0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc390011420 con 0x7fc3a0157ba0 2023-10-14T18:45:25.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a016abd0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900117c0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.793+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a016b190 con 0x7fc3a0157ba0 2023-10-14T18:45:25.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.794+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a004c3c0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.794+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc390011bb0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.795+0000 7fc395ffb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:25.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.795+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc390085db0 con 0x7fc3a0157ba0 2023-10-14T18:45:25.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.795+0000 7fc3a5f97700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:25.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.796+0000 7fc3a5f97700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 0x7fc3840693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b1a90 tx=0x7fc39c0073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:25.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:25.799+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc390053020 con 0x7fc3a0157ba0 2023-10-14T18:45:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.023+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3a0069b30 con 0x7fc3a0157ba0 2023-10-14T18:45:26.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.024+0000 7fc395ffb700 1 -- 172.21.15.79:0/3623405734 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fc390011e60 con 0x7fc3a0157ba0 2023-10-14T18:45:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:26.026 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:26.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 msgr2=0x7fc3840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 0x7fc3840693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b1a90 tx=0x7fc39c0073a0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 msgr2=0x7fc3a00b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc3a006b580 tx=0x7fc390017000 comp rx=0 tx=0).stop 2023-10-14T18:45:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 shutdown_connections 2023-10-14T18:45:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc384066f30 0x7fc3840693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3a015b0d0 0x7fc3a00d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a01577d0 0x7fc3a0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 --2- 172.21.15.79:0/3623405734 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a0157ba0 0x7fc3a00b05c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 >> 172.21.15.79:0/3623405734 conn(0x7fc3a0068ce0 msgr2=0x7fc3a00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 shutdown_connections 2023-10-14T18:45:26.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.026+0000 7fc3a81fb700 1 -- 172.21.15.79:0/3623405734 wait complete. 2023-10-14T18:45:26.033 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:26.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.154+0000 7f7e72245700 1 Processor -- start 2023-10-14T18:45:26.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.154+0000 7f7e72245700 1 -- start start 2023-10-14T18:45:26.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e72245700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e6c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e72245700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e6c157c40 0x7f7e6c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e72245700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c15cbb0 con 0x7f7e6c15a620 2023-10-14T18:45:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e72245700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c15bfa0 con 0x7f7e6c157c40 2023-10-14T18:45:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e72245700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15c280 con 0x7f7e6c157870 2023-10-14T18:45:26.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e6c15a620 0x7f7e6c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45646/0 (socket says 172.21.15.79:45646) 2023-10-14T18:45:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6affd700 1 -- 172.21.15.79:0/2712396324 learned_addr learned my addr 172.21.15.79:0/2712396324 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6b7fe700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e6c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2712396324 >> v2:172.21.15.144:3300/0 conn(0x7f7e6c157c40 0x7f7e6c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183879309 0 0) 0x7f7e6c15cbb0 con 0x7f7e6c15a620 2023-10-14T18:45:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.155+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e54003570 con 0x7f7e6c15a620 2023-10-14T18:45:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446695267 0 0) 0x7f7e54003570 con 0x7f7e6c15a620 2023-10-14T18:45:26.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 msgr2=0x7f7e6c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e6c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 >> v2:172.21.15.144:3300/0 conn(0x7f7e6c157c40 msgr2=0x7f7e6c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 --2- 172.21.15.79:0/2712396324 >> v2:172.21.15.144:3300/0 conn(0x7f7e6c157c40 0x7f7e6c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c15c560 con 0x7f7e6c15a620 2023-10-14T18:45:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7e60001470 con 0x7f7e6c15a620 2023-10-14T18:45:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 >> v1:172.21.15.79:6789/0 conn(0x7f7e6c15a620 legacy=0x7f7e6c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e54003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e54003fe0 0x7f7e54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e54004d50 0x7f7e540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15bfa0 con 0x7f7e54004d50 2023-10-14T18:45:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c15c280 con 0x7f7e54003fe0 2023-10-14T18:45:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5400ba90 con 0x7f7e6c157870 2023-10-14T18:45:26.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e54004d50 0x7f7e540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6b7fe700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e54003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6affd700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e54003fe0 0x7f7e54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 msgr2=0x7f7e54003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c157870 0x7f7e54003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e54003fe0 msgr2=0x7f7e54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e54003fe0 0x7f7e54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2712396324 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54003570 con 0x7f7e54004d50 2023-10-14T18:45:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6affd700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e54003fe0 0x7f7e54004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e54004d50 0x7f7e540051c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009c00 tx=0x7f7e640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9507a01a7b243b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400e6b0 con 0x7f7e54004d50 2023-10-14T18:45:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400e810 con 0x7f7e54004d50 2023-10-14T18:45:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.156+0000 7f7e6a7fc700 1 -- 172.21.15.79:0/2712396324 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ebd0 con 0x7f7e54004d50 2023-10-14T18:45:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 -- 172.21.15.79:0/2712396324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e54004d50 msgr2=0x7f7e540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 --2- 172.21.15.79:0/2712396324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e54004d50 0x7f7e540051c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009c00 tx=0x7f7e640091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2712396324 reap_dead start 2023-10-14T18:45:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 -- 172.21.15.79:0/2712396324 shutdown_connections 2023-10-14T18:45:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 -- 172.21.15.79:0/2712396324 >> 172.21.15.79:0/2712396324 conn(0x7f7e6c068ce0 msgr2=0x7f7e6c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 -- 172.21.15.79:0/2712396324 shutdown_connections 2023-10-14T18:45:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.157+0000 7f7e72245700 1 -- 172.21.15.79:0/2712396324 wait complete. 2023-10-14T18:45:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.158+0000 7f7e72245700 1 Processor -- start 2023-10-14T18:45:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.158+0000 7f7e72245700 1 -- start start 2023-10-14T18:45:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e6c1543e0 0x7f7e6c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 0x7f7e6c0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c16d840 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0d1600 con 0x7f7e6c1543e0 2023-10-14T18:45:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e72245700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c160b00 con 0x7f7e6c1547b0 2023-10-14T18:45:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59860/0 (socket says 172.21.15.79:59860) 2023-10-14T18:45:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2110039917 learned_addr learned my addr 172.21.15.79:0/2110039917 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6affd700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 0x7f7e6c0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6b7fe700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e6c1543e0 0x7f7e6c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 msgr2=0x7f7e6c0c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 0x7f7e6c0c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e6c1543e0 msgr2=0x7f7e6c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e6c1543e0 0x7f7e6c15f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 -- 172.21.15.79:0/2110039917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c15fef0 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6affd700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 0x7f7e6c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.159+0000 7f7e6bfff700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e4b0 tx=0x7f7e6401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64022070 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400eb90 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c1601d0 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400e6b0 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c160790 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.160+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c04c3c0 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.161+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e64027940 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.161+0000 7f7e537fe700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.161+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e64000e40 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.161+0000 7f7e6b7fe700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.162+0000 7f7e6b7fe700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 0x7f7e580693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0cfa00 tx=0x7f7e5c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.165+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e64053170 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.349+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e6c15c840 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.350+0000 7f7e537fe700 1 -- 172.21.15.79:0/2110039917 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7e64056790 con 0x7f7e6c0d0c40 2023-10-14T18:45:26.352 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:26.352 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 msgr2=0x7f7e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 0x7f7e580693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0cfa00 tx=0x7f7e5c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 msgr2=0x7f7e6c0d10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400e4b0 tx=0x7f7e6401a000 comp rx=0 tx=0).stop 2023-10-14T18:45:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 shutdown_connections 2023-10-14T18:45:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e58066f30 0x7f7e580693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e6c0d0c40 0x7f7e6c0d10c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e6c1543e0 0x7f7e6c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 --2- 172.21.15.79:0/2110039917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e6c1547b0 0x7f7e6c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 >> 172.21.15.79:0/2110039917 conn(0x7f7e6c068ce0 msgr2=0x7f7e6c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 shutdown_connections 2023-10-14T18:45:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.352+0000 7f7e72245700 1 -- 172.21.15.79:0/2110039917 wait complete. 2023-10-14T18:45:26.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:26.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:26.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 Processor -- start 2023-10-14T18:45:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 -- start start 2023-10-14T18:45:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3154070950 0x7f3154068880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3154070d20 0x7f3154159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315415e760 con 0x7f3154159e40 2023-10-14T18:45:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315415a2c0 con 0x7f3154070d20 2023-10-14T18:45:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.482+0000 7f3159088700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315415db50 con 0x7f3154070950 2023-10-14T18:45:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3154070d20 0x7f3154159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315359e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3154159e40 0x7f3154067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45658/0 (socket says 172.21.15.79:45658) 2023-10-14T18:45:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3154070d20 0x7f3154159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59872/0 (socket says 172.21.15.79:59872) 2023-10-14T18:45:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315359e700 1 -- 172.21.15.79:0/1415151560 learned_addr learned my addr 172.21.15.79:0/1415151560 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f3152d9d700 1 --2- 172.21.15.79:0/1415151560 >> v2:172.21.15.144:3300/0 conn(0x7f3154070950 0x7f3154068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 -- 172.21.15.79:0/1415151560 >> v2:172.21.15.144:3300/0 conn(0x7f3154070950 msgr2=0x7f3154068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 --2- 172.21.15.79:0/1415151560 >> v2:172.21.15.144:3300/0 conn(0x7f3154070950 0x7f3154068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 -- 172.21.15.79:0/1415151560 >> v1:172.21.15.79:6789/0 conn(0x7f3154159e40 legacy=0x7f3154067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 -- 172.21.15.79:0/1415151560 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315415de30 con 0x7f3154070d20 2023-10-14T18:45:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f3151d9b700 1 -- 172.21.15.79:0/1415151560 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642711585 0 0) 0x7f315415e760 con 0x7f3154159e40 2023-10-14T18:45:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f315259c700 1 --2- 172.21.15.79:0/1415151560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154070d20 0x7f3154159900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31480098e0 tx=0x7f31480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c696a343fd1a59d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f3151d9b700 1 -- 172.21.15.79:0/1415151560 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148009e80 con 0x7f3154070d20 2023-10-14T18:45:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f3151d9b700 1 -- 172.21.15.79:0/1415151560 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800b820 con 0x7f3154070d20 2023-10-14T18:45:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.483+0000 7f3151d9b700 1 -- 172.21.15.79:0/1415151560 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800bba0 con 0x7f3154070d20 2023-10-14T18:45:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 -- 172.21.15.79:0/1415151560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154070d20 msgr2=0x7f3154159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 --2- 172.21.15.79:0/1415151560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154070d20 0x7f3154159900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31480098e0 tx=0x7f31480091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 -- 172.21.15.79:0/1415151560 shutdown_connections 2023-10-14T18:45:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 --2- 172.21.15.79:0/1415151560 >> v2:172.21.15.144:3300/0 conn(0x7f3154070950 0x7f3154068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 --2- 172.21.15.79:0/1415151560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154070d20 0x7f3154159900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 -- 172.21.15.79:0/1415151560 >> 172.21.15.79:0/1415151560 conn(0x7f31540ce4d0 msgr2=0x7f31540ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 -- 172.21.15.79:0/1415151560 shutdown_connections 2023-10-14T18:45:26.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.484+0000 7f3159088700 1 -- 172.21.15.79:0/1415151560 wait complete. 2023-10-14T18:45:26.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.485+0000 7f3159088700 1 Processor -- start 2023-10-14T18:45:26.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.485+0000 7f3159088700 1 -- start start 2023-10-14T18:45:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3154070950 0x7f31540aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3154070d20 0x7f3154159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415d240 con 0x7f3154159e40 2023-10-14T18:45:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415aec0 con 0x7f3154070950 2023-10-14T18:45:26.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315415c5c0 con 0x7f3154070d20 2023-10-14T18:45:26.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59882/0 (socket says 172.21.15.79:59882) 2023-10-14T18:45:26.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 -- 172.21.15.79:0/1916737987 learned_addr learned my addr 172.21.15.79:0/1916737987 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:26.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3152d9d700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3154070950 0x7f31540aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315259c700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3154070d20 0x7f3154159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 -- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3154070d20 msgr2=0x7f3154159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3154070d20 0x7f3154159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 -- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3154070950 msgr2=0x7f31540aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3154070950 0x7f31540aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 -- 172.21.15.79:0/1916737987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148009420 con 0x7f3154159e40 2023-10-14T18:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f315359e700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f314c00cbf0 tx=0x7f314c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00a8b0 con 0x7f3154159e40 2023-10-14T18:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00aa10 con 0x7f3154159e40 2023-10-14T18:45:26.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315415c900 con 0x7f3154159e40 2023-10-14T18:45:26.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00add0 con 0x7f3154159e40 2023-10-14T18:45:26.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.486+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315415c290 con 0x7f3154159e40 2023-10-14T18:45:26.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.487+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315404c3c0 con 0x7f3154159e40 2023-10-14T18:45:26.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.488+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f314c007300 con 0x7f3154159e40 2023-10-14T18:45:26.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.488+0000 7f313affd700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.488+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f314c0847a0 con 0x7f3154159e40 2023-10-14T18:45:26.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.488+0000 7f3152d9d700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.489+0000 7f3152d9d700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 0x7f31400693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.492+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f314c051a90 con 0x7f3154159e40 2023-10-14T18:45:26.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.680+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f315415e110 con 0x7f3154159e40 2023-10-14T18:45:26.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.680+0000 7f313affd700 1 -- 172.21.15.79:0/1916737987 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f314c0550b0 con 0x7f3154159e40 2023-10-14T18:45:26.683 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:26.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 msgr2=0x7f31400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 0x7f31400693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).stop 2023-10-14T18:45:26.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 msgr2=0x7f3154155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f314c00cbf0 tx=0x7f314c0019b0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 shutdown_connections 2023-10-14T18:45:26.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3154159e40 0x7f3154155630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3154070950 0x7f31540aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 --2- 172.21.15.79:0/1916737987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3154070d20 0x7f3154159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.682+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 >> 172.21.15.79:0/1916737987 conn(0x7f31540ce4d0 msgr2=0x7f31540cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.683+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 shutdown_connections 2023-10-14T18:45:26.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.683+0000 7f3159088700 1 -- 172.21.15.79:0/1916737987 wait complete. 2023-10-14T18:45:26.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.810+0000 7f4703238700 1 Processor -- start 2023-10-14T18:45:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.810+0000 7f4703238700 1 -- start start 2023-10-14T18:45:26.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f4703238700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46fc155700 0x7f46fc06c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f4703238700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46fc15c450 0x7f46fc06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f4703238700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc159210 con 0x7f46fc158240 2023-10-14T18:45:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f4703238700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc158f30 con 0x7f46fc15c450 2023-10-14T18:45:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f4703238700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46fc15b970 con 0x7f46fc155700 2023-10-14T18:45:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f46fbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46fc15c450 0x7f46fc06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f46fbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46fc15c450 0x7f46fc06c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59894/0 (socket says 172.21.15.79:59894) 2023-10-14T18:45:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.811+0000 7f46fbfff700 1 -- 172.21.15.79:0/2572043615 learned_addr learned my addr 172.21.15.79:0/2572043615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4700fd4700 1 --2- 172.21.15.79:0/2572043615 >> v2:172.21.15.144:3300/0 conn(0x7f46fc155700 0x7f46fc06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fbfff700 1 -- 172.21.15.79:0/2572043615 >> v2:172.21.15.144:3300/0 conn(0x7f46fc155700 msgr2=0x7f46fc06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fbfff700 1 --2- 172.21.15.79:0/2572043615 >> v2:172.21.15.144:3300/0 conn(0x7f46fc155700 0x7f46fc06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fbfff700 1 -- 172.21.15.79:0/2572043615 >> v1:172.21.15.144:6789/0 conn(0x7f46fc158240 legacy=0x7f46fc1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fbfff700 1 -- 172.21.15.79:0/2572043615 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc15bc50 con 0x7f46fc15c450 2023-10-14T18:45:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fbfff700 1 --2- 172.21.15.79:0/2572043615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc15c450 0x7f46fc06c8c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06e0c0 tx=0x7f46ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a206ac52408f4f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fb7fe700 1 -- 172.21.15.79:0/2572043615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00b820 con 0x7f46fc15c450 2023-10-14T18:45:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fb7fe700 1 -- 172.21.15.79:0/2572043615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec00b980 con 0x7f46fc15c450 2023-10-14T18:45:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f46fb7fe700 1 -- 172.21.15.79:0/2572043615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00bd20 con 0x7f46fc15c450 2023-10-14T18:45:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 -- 172.21.15.79:0/2572043615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc15c450 msgr2=0x7f46fc06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 --2- 172.21.15.79:0/2572043615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc15c450 0x7f46fc06c8c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06e0c0 tx=0x7f46ec009250 comp rx=0 tx=0).stop 2023-10-14T18:45:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 -- 172.21.15.79:0/2572043615 shutdown_connections 2023-10-14T18:45:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 --2- 172.21.15.79:0/2572043615 >> v2:172.21.15.144:3300/0 conn(0x7f46fc155700 0x7f46fc06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 --2- 172.21.15.79:0/2572043615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc15c450 0x7f46fc06c8c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.812+0000 7f4703238700 1 -- 172.21.15.79:0/2572043615 >> 172.21.15.79:0/2572043615 conn(0x7f46fc0cb030 msgr2=0x7f46fc06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.813+0000 7f4703238700 1 -- 172.21.15.79:0/2572043615 shutdown_connections 2023-10-14T18:45:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.813+0000 7f4703238700 1 -- 172.21.15.79:0/2572043615 wait complete. 2023-10-14T18:45:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 Processor -- start 2023-10-14T18:45:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 -- start start 2023-10-14T18:45:26.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46fc155700 0x7f46fc0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46fc158240 0x7f46fc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc153b00 con 0x7f46fc153140 2023-10-14T18:45:26.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0cd480 con 0x7f46fc158240 2023-10-14T18:45:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.814+0000 7f4703238700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0cd1a0 con 0x7f46fc155700 2023-10-14T18:45:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59904/0 (socket says 172.21.15.79:59904) 2023-10-14T18:45:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 -- 172.21.15.79:0/4033234279 learned_addr learned my addr 172.21.15.79:0/4033234279 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:26.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f46fbfff700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46fc158240 0x7f46fc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f4700fd4700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46fc155700 0x7f46fc0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 -- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46fc155700 msgr2=0x7f46fc0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46fc155700 0x7f46fc0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 -- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46fc158240 msgr2=0x7f46fc151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46fc158240 0x7f46fc151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 -- 172.21.15.79:0/4033234279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0094f0 con 0x7f46fc153140 2023-10-14T18:45:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f47017d5700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b4e0 tx=0x7f46e4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400f510 con 0x7f46fc153140 2023-10-14T18:45:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400f670 con 0x7f46fc153140 2023-10-14T18:45:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc0b0a20 con 0x7f46fc153140 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400fa30 con 0x7f46fc153140 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.815+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc0b0fe0 con 0x7f46fc153140 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.816+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc0b1200 con 0x7f46fc153140 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.817+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e401a400 con 0x7f46fc153140 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.817+0000 7f46f8ff9700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.817+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46e4083f00 con 0x7f46fc153140 2023-10-14T18:45:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.817+0000 7f4700fd4700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.818+0000 7f4700fd4700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 0x7f46dc0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009fd0 tx=0x7f46f4009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:26.821+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46e40511f0 con 0x7f46fc153140 2023-10-14T18:45:27.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.000+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46fc04c3c0 con 0x7f46fc153140 2023-10-14T18:45:27.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.000+0000 7f46f8ff9700 1 -- 172.21.15.79:0/4033234279 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46e4054810 con 0x7f46fc153140 2023-10-14T18:45:27.003 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 msgr2=0x7f46dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 0x7f46dc0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009fd0 tx=0x7f46f4009880 comp rx=0 tx=0).stop 2023-10-14T18:45:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 msgr2=0x7f46fc1535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b4e0 tx=0x7f46e4006f90 comp rx=0 tx=0).stop 2023-10-14T18:45:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 shutdown_connections 2023-10-14T18:45:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46dc066f30 0x7f46dc0693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46fc153140 0x7f46fc1535c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46fc155700 0x7f46fc0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 --2- 172.21.15.79:0/4033234279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46fc158240 0x7f46fc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 >> 172.21.15.79:0/4033234279 conn(0x7f46fc0cb030 msgr2=0x7f46fc0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 shutdown_connections 2023-10-14T18:45:27.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.002+0000 7f4703238700 1 -- 172.21.15.79:0/4033234279 wait complete. 2023-10-14T18:45:27.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.131+0000 7f6bb7f59700 1 Processor -- start 2023-10-14T18:45:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.131+0000 7f6bb7f59700 1 -- start start 2023-10-14T18:45:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bb0159ec0 0x7f6bb00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb015a290 0x7f6bb00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bb006a5a0 0x7f6bb006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb006af60 con 0x7f6bb0159ec0 2023-10-14T18:45:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb00b0790 con 0x7f6bb006a5a0 2023-10-14T18:45:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb7f59700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00ce1f0 con 0x7f6bb015a290 2023-10-14T18:45:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb5cf5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bb0159ec0 0x7f6bb00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb5cf5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6bb0159ec0 0x7f6bb00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59908/0 (socket says 172.21.15.79:59908) 2023-10-14T18:45:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb5cf5700 1 -- 172.21.15.79:0/118550927 learned_addr learned my addr 172.21.15.79:0/118550927 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.132+0000 7f6bb54f4700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb015a290 0x7f6bb00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb64f6700 1 --2- 172.21.15.79:0/118550927 >> v2:172.21.15.144:3300/0 conn(0x7f6bb006a5a0 0x7f6bb006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 -- 172.21.15.79:0/118550927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb015a290 msgr2=0x7f6bb00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb015a290 0x7f6bb00afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 -- 172.21.15.79:0/118550927 >> v2:172.21.15.144:3300/0 conn(0x7f6bb006a5a0 msgr2=0x7f6bb006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/118550927 >> v2:172.21.15.144:3300/0 conn(0x7f6bb006a5a0 0x7f6bb006aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 -- 172.21.15.79:0/118550927 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00b0b20 con 0x7f6bb0159ec0 2023-10-14T18:45:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb0159ec0 0x7f6bb00af940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b03c0 tx=0x7f6bac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9cb9214c0c78e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb4cf3700 1 -- 172.21.15.79:0/118550927 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00b860 con 0x7f6bb0159ec0 2023-10-14T18:45:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb4cf3700 1 -- 172.21.15.79:0/118550927 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00b9c0 con 0x7f6bb0159ec0 2023-10-14T18:45:27.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb4cf3700 1 -- 172.21.15.79:0/118550927 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00bd60 con 0x7f6bb0159ec0 2023-10-14T18:45:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 -- 172.21.15.79:0/118550927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb0159ec0 msgr2=0x7f6bb00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb0159ec0 0x7f6bb00af940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b03c0 tx=0x7f6bac009250 comp rx=0 tx=0).stop 2023-10-14T18:45:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 -- 172.21.15.79:0/118550927 shutdown_connections 2023-10-14T18:45:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/118550927 >> v2:172.21.15.144:3300/0 conn(0x7f6bb006a5a0 0x7f6bb006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb0159ec0 0x7f6bb00af940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/118550927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb015a290 0x7f6bb00afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 -- 172.21.15.79:0/118550927 >> 172.21.15.79:0/118550927 conn(0x7f6bb00d1880 msgr2=0x7f6bb00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.133+0000 7f6bb7f59700 1 -- 172.21.15.79:0/118550927 shutdown_connections 2023-10-14T18:45:27.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.134+0000 7f6bb7f59700 1 -- 172.21.15.79:0/118550927 wait complete. 2023-10-14T18:45:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 Processor -- start 2023-10-14T18:45:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 -- start start 2023-10-14T18:45:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 0x7f6bb015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb0159ec0 0x7f6bb016d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015a680 con 0x7f6bb015a290 2023-10-14T18:45:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015abd0 con 0x7f6bb006a5a0 2023-10-14T18:45:27.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb7f59700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00ca810 con 0x7f6bb0159ec0 2023-10-14T18:45:27.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb64f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb64f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59924/0 (socket says 172.21.15.79:59924) 2023-10-14T18:45:27.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.135+0000 7f6bb64f6700 1 -- 172.21.15.79:0/3418594176 learned_addr learned my addr 172.21.15.79:0/3418594176 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:27.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 0x7f6bb015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb54f4700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb0159ec0 0x7f6bb016d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 -- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb0159ec0 msgr2=0x7f6bb016d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb0159ec0 0x7f6bb016d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 -- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 msgr2=0x7f6bb015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 0x7f6bb015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 -- 172.21.15.79:0/3418594176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0094f0 con 0x7f6bb015a290 2023-10-14T18:45:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 0x7f6bb015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb64f6700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009fa0 tx=0x7f6ba8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800ed20 con 0x7f6bb015a290 2023-10-14T18:45:27.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba800ee80 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8014670 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb00caaf0 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.136+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb00b3e10 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.137+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb015ad60 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.137+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ba8014a20 con 0x7f6bb015a290 2023-10-14T18:45:27.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.138+0000 7f6ba5ffb700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.138+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ba8084d00 con 0x7f6bb015a290 2023-10-14T18:45:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.138+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.138+0000 7f6bb5cf5700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 0x7f6b940693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b03c0 tx=0x7f6bac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.142+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ba8051ed0 con 0x7f6bb015a290 2023-10-14T18:45:27.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.323+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6bb004c3c0 con 0x7f6bb015a290 2023-10-14T18:45:27.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.323+0000 7f6ba5ffb700 1 -- 172.21.15.79:0/3418594176 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ba8009990 con 0x7f6bb015a290 2023-10-14T18:45:27.325 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:27.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 msgr2=0x7f6b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 0x7f6b940693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b03c0 tx=0x7f6bac017000 comp rx=0 tx=0).stop 2023-10-14T18:45:27.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 msgr2=0x7f6bb016d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009fa0 tx=0x7f6ba8009900 comp rx=0 tx=0).stop 2023-10-14T18:45:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 shutdown_connections 2023-10-14T18:45:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b94066f30 0x7f6b940693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6bb015a290 0x7f6bb016d580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bb006a5a0 0x7f6bb015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 --2- 172.21.15.79:0/3418594176 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6bb0159ec0 0x7f6bb016d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 >> 172.21.15.79:0/3418594176 conn(0x7f6bb00d1880 msgr2=0x7f6bb0153150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 shutdown_connections 2023-10-14T18:45:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.325+0000 7f6bb7f59700 1 -- 172.21.15.79:0/3418594176 wait complete. 2023-10-14T18:45:27.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.450+0000 7fa432eb7700 1 Processor -- start 2023-10-14T18:45:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.450+0000 7fa432eb7700 1 -- start start 2023-10-14T18:45:27.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa432eb7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa42c152010 0x7fa42c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa432eb7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa42c1523e0 0x7fa42c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa432eb7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c06c010 con 0x7fa42c158e50 2023-10-14T18:45:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa432eb7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c06bd10 con 0x7fa42c1523e0 2023-10-14T18:45:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa432eb7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c15c060 con 0x7fa42c152010 2023-10-14T18:45:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa42bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa42c1523e0 0x7fa42c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa431454700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa42c158e50 0x7fa42c0cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45672/0 (socket says 172.21.15.79:45672) 2023-10-14T18:45:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa431454700 1 -- 172.21.15.79:0/4057874299 learned_addr learned my addr 172.21.15.79:0/4057874299 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.451+0000 7fa430c53700 1 --2- 172.21.15.79:0/4057874299 >> v2:172.21.15.144:3300/0 conn(0x7fa42c152010 0x7fa42c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42bfff700 1 -- 172.21.15.79:0/4057874299 >> v2:172.21.15.144:3300/0 conn(0x7fa42c152010 msgr2=0x7fa42c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42bfff700 1 --2- 172.21.15.79:0/4057874299 >> v2:172.21.15.144:3300/0 conn(0x7fa42c152010 0x7fa42c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42bfff700 1 -- 172.21.15.79:0/4057874299 >> v1:172.21.15.79:6789/0 conn(0x7fa42c158e50 legacy=0x7fa42c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42bfff700 1 -- 172.21.15.79:0/4057874299 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c15c340 con 0x7fa42c1523e0 2023-10-14T18:45:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42b7fe700 1 -- 172.21.15.79:0/4057874299 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414044840 0 0) 0x7fa42c06c010 con 0x7fa42c158e50 2023-10-14T18:45:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42bfff700 1 --2- 172.21.15.79:0/4057874299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c1523e0 0x7fa42c06c4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cc680 tx=0x7fa4200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb0c2217e7210ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42b7fe700 1 -- 172.21.15.79:0/4057874299 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420011630 con 0x7fa42c1523e0 2023-10-14T18:45:27.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42b7fe700 1 -- 172.21.15.79:0/4057874299 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420011790 con 0x7fa42c1523e0 2023-10-14T18:45:27.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa42b7fe700 1 -- 172.21.15.79:0/4057874299 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420011b30 con 0x7fa42c1523e0 2023-10-14T18:45:27.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa432eb7700 1 -- 172.21.15.79:0/4057874299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c1523e0 msgr2=0x7fa42c06c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.452+0000 7fa432eb7700 1 --2- 172.21.15.79:0/4057874299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c1523e0 0x7fa42c06c4a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0cc680 tx=0x7fa4200091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 -- 172.21.15.79:0/4057874299 shutdown_connections 2023-10-14T18:45:27.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 --2- 172.21.15.79:0/4057874299 >> v2:172.21.15.144:3300/0 conn(0x7fa42c152010 0x7fa42c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 --2- 172.21.15.79:0/4057874299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c1523e0 0x7fa42c06c4a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 -- 172.21.15.79:0/4057874299 >> 172.21.15.79:0/4057874299 conn(0x7fa42c069870 msgr2=0x7fa42c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 -- 172.21.15.79:0/4057874299 shutdown_connections 2023-10-14T18:45:27.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.453+0000 7fa432eb7700 1 -- 172.21.15.79:0/4057874299 wait complete. 2023-10-14T18:45:27.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 Processor -- start 2023-10-14T18:45:27.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 -- start start 2023-10-14T18:45:27.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 0x7fa42c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa42c158e50 0x7fa42c14c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c15d570 con 0x7fa42c152010 2023-10-14T18:45:27.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.454+0000 7fa432eb7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0b1980 con 0x7fa42c1523e0 2023-10-14T18:45:27.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa432eb7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0b1c60 con 0x7fa42c158e50 2023-10-14T18:45:27.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59952/0 (socket says 172.21.15.79:59952) 2023-10-14T18:45:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 -- 172.21.15.79:0/3937631053 learned_addr learned my addr 172.21.15.79:0/3937631053 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa42bfff700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 0x7fa42c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 -- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa42c158e50 msgr2=0x7fa42c14c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa42c158e50 0x7fa42c14c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 -- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 msgr2=0x7fa42c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 0x7fa42c15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 -- 172.21.15.79:0/3937631053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009420 con 0x7fa42c152010 2023-10-14T18:45:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa42bfff700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 0x7fa42c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa430c53700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009e50 tx=0x7fa41c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00cc20 con 0x7fa42c152010 2023-10-14T18:45:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c00f040 con 0x7fa42c152010 2023-10-14T18:45:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c014480 con 0x7fa42c152010 2023-10-14T18:45:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0b3640 con 0x7fa42c152010 2023-10-14T18:45:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.455+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c14e980 con 0x7fa42c152010 2023-10-14T18:45:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.456+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c0b39b0 con 0x7fa42c152010 2023-10-14T18:45:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.456+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa41c0147f0 con 0x7fa42c152010 2023-10-14T18:45:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.457+0000 7fa428ff9700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.457+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa41c085240 con 0x7fa42c152010 2023-10-14T18:45:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.457+0000 7fa42bfff700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.457+0000 7fa42bfff700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 0x7fa4180693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa420003080 tx=0x7fa420017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.461+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa41c0524b0 con 0x7fa42c152010 2023-10-14T18:45:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.692+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42c0b34a0 con 0x7fa42c152010 2023-10-14T18:45:27.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.693+0000 7fa428ff9700 1 -- 172.21.15.79:0/3937631053 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fa42c0b34a0 con 0x7fa42c152010 2023-10-14T18:45:27.695 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:27.695 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:27.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 msgr2=0x7fa4180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 0x7fa4180693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa420003080 tx=0x7fa420017000 comp rx=0 tx=0).stop 2023-10-14T18:45:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 msgr2=0x7fa42c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009e50 tx=0x7fa41c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:27.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 shutdown_connections 2023-10-14T18:45:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa418066f30 0x7fa4180693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa42c158e50 0x7fa42c14c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa42c152010 0x7fa42c0c5bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 --2- 172.21.15.79:0/3937631053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa42c1523e0 0x7fa42c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 >> 172.21.15.79:0/3937631053 conn(0x7fa42c069870 msgr2=0x7fa42c0cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 shutdown_connections 2023-10-14T18:45:27.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.695+0000 7fa432eb7700 1 -- 172.21.15.79:0/3937631053 wait complete. 2023-10-14T18:45:27.700 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:27.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:27.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.821+0000 7fb57bcb6700 1 Processor -- start 2023-10-14T18:45:27.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.821+0000 7fb57bcb6700 1 -- start start 2023-10-14T18:45:27.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57bcb6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57bcb6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57bcb6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57415cbb0 con 0x7fb574157870 2023-10-14T18:45:27.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57bcb6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57415bdb0 con 0x7fb57415a620 2023-10-14T18:45:27.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57bcb6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57415bfa0 con 0x7fb57415d580 2023-10-14T18:45:27.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57a253700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb579251700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57a253700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:55512/0 (socket says 172.21.15.79:55512) 2023-10-14T18:45:27.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb579251700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55716/0 (socket says 172.21.15.79:55716) 2023-10-14T18:45:27.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb57a253700 1 -- 172.21.15.79:0/3895512123 learned_addr learned my addr 172.21.15.79:0/3895512123 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:27.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.822+0000 7fb579a52700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb574157870 0x7fb57415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:48474/0 (socket says 172.21.15.79:48474) 2023-10-14T18:45:27.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb57a253700 1 -- 172.21.15.79:0/3895512123 >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 msgr2=0x7fb57415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:27.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb57a253700 1 --2- 172.21.15.79:0/3895512123 >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb57a253700 1 -- 172.21.15.79:0/3895512123 >> v1:172.21.15.144:6789/0 conn(0x7fb574157870 legacy=0x7fb57415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb57a253700 1 -- 172.21.15.79:0/3895512123 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57415c280 con 0x7fb57415d580 2023-10-14T18:45:27.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb579251700 1 --2- 172.21.15.79:0/3895512123 >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:27.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb57a253700 1 --2- 172.21.15.79:0/3895512123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009f20 tx=0x7fb56c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43edb3ae45a94692 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb578a50700 1 -- 172.21.15.79:0/3895512123 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00e070 con 0x7fb57415d580 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb578a50700 1 -- 172.21.15.79:0/3895512123 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c00b9d0 con 0x7fb57415d580 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.823+0000 7fb578a50700 1 -- 172.21.15.79:0/3895512123 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0092e0 con 0x7fb57415d580 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 -- 172.21.15.79:0/3895512123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 msgr2=0x7fb574158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/3895512123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009f20 tx=0x7fb56c009840 comp rx=0 tx=0).stop 2023-10-14T18:45:27.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 -- 172.21.15.79:0/3895512123 shutdown_connections 2023-10-14T18:45:27.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/3895512123 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415d580 0x7fb574158110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/3895512123 >> v2:172.21.15.144:3300/0 conn(0x7fb57415a620 0x7fb57415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 -- 172.21.15.79:0/3895512123 >> 172.21.15.79:0/3895512123 conn(0x7fb574068ce0 msgr2=0x7fb5740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:27.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 -- 172.21.15.79:0/3895512123 shutdown_connections 2023-10-14T18:45:27.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.824+0000 7fb57bcb6700 1 -- 172.21.15.79:0/3895512123 wait complete. 2023-10-14T18:45:27.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 Processor -- start 2023-10-14T18:45:27.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 -- start start 2023-10-14T18:45:27.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb574157870 0x7fb574151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415a620 0x7fb5740b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57416eea0 con 0x7fb57415d580 2023-10-14T18:45:27.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57416e320 con 0x7fb574157870 2023-10-14T18:45:27.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.825+0000 7fb57bcb6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57416e600 con 0x7fb57415a620 2023-10-14T18:45:27.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59958/0 (socket says 172.21.15.79:59958) 2023-10-14T18:45:27.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 -- 172.21.15.79:0/1030777286 learned_addr learned my addr 172.21.15.79:0/1030777286 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:27.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb579a52700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb574157870 0x7fb574151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb579251700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415a620 0x7fb5740b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 -- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415a620 msgr2=0x7fb5740b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415a620 0x7fb5740b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 -- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb574157870 msgr2=0x7fb574151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:27.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb574157870 0x7fb574151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 -- 172.21.15.79:0/1030777286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009420 con 0x7fb57415d580 2023-10-14T18:45:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57a253700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb57415c0e0 tx=0x7fb56c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c007ac0 con 0x7fb57415d580 2023-10-14T18:45:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c007c20 con 0x7fb57415d580 2023-10-14T18:45:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c01d420 con 0x7fb57415d580 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c009ae0 con 0x7fb57415d580 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.826+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57416ebc0 con 0x7fb57415d580 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.827+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57404c3c0 con 0x7fb57415d580 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.828+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb56c003040 con 0x7fb57415d580 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.828+0000 7fb569ffb700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 0x7fb5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:27.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.828+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb56c085bb0 con 0x7fb57415d580 2023-10-14T18:45:27.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.828+0000 7fb579a52700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 0x7fb5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:27.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.829+0000 7fb579a52700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 0x7fb5580693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb570004fd0 tx=0x7fb570007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:27.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:27.833+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb56c052ed0 con 0x7fb57415d580 2023-10-14T18:45:28.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.015+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb57415c560 con 0x7fb57415d580 2023-10-14T18:45:28.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.016+0000 7fb569ffb700 1 -- 172.21.15.79:0/1030777286 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb56c0564f0 con 0x7fb57415d580 2023-10-14T18:45:28.017 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:28.018 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:28.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 msgr2=0x7fb5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 0x7fb5580693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb570004fd0 tx=0x7fb570007eb0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 msgr2=0x7fb5741540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb57415c0e0 tx=0x7fb56c018000 comp rx=0 tx=0).stop 2023-10-14T18:45:28.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 shutdown_connections 2023-10-14T18:45:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb558066f30 0x7fb5580693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb57415d580 0x7fb5741540e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb574157870 0x7fb574151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 --2- 172.21.15.79:0/1030777286 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb57415a620 0x7fb5740b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 >> 172.21.15.79:0/1030777286 conn(0x7fb574068ce0 msgr2=0x7fb574155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 shutdown_connections 2023-10-14T18:45:28.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.018+0000 7fb57bcb6700 1 -- 172.21.15.79:0/1030777286 wait complete. 2023-10-14T18:45:28.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.143+0000 7fc7b4a7c700 1 Processor -- start 2023-10-14T18:45:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.143+0000 7fc7b4a7c700 1 -- start start 2023-10-14T18:45:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7b4a7c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7b0157870 0x7fc7b015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7b4a7c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7b015a620 0x7fc7b015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7b4a7c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b015cbb0 con 0x7fc7b015d580 2023-10-14T18:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7b4a7c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b015bfa0 con 0x7fc7b0157870 2023-10-14T18:45:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7b4a7c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b015c280 con 0x7fc7b015a620 2023-10-14T18:45:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7b0157870 0x7fc7b015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7b0157870 0x7fc7b015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59966/0 (socket says 172.21.15.79:59966) 2023-10-14T18:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3231791646 learned_addr learned my addr 172.21.15.79:0/3231791646 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7add9b700 1 --2- 172.21.15.79:0/3231791646 >> v2:172.21.15.144:3300/0 conn(0x7fc7b015a620 0x7fc7b015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3231791646 >> v2:172.21.15.144:3300/0 conn(0x7fc7b015a620 msgr2=0x7fc7b015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 --2- 172.21.15.79:0/3231791646 >> v2:172.21.15.144:3300/0 conn(0x7fc7b015a620 0x7fc7b015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3231791646 >> v1:172.21.15.144:6789/0 conn(0x7fc7b015d580 legacy=0x7fc7b0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.144+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3231791646 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b015c560 con 0x7fc7b0157870 2023-10-14T18:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7ae59c700 1 --2- 172.21.15.79:0/3231791646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b015b6a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7b015cb20 tx=0x7fc7a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9ef43048ea3423 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7ad59a700 1 -- 172.21.15.79:0/3231791646 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0009e70 con 0x7fc7b0157870 2023-10-14T18:45:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7ad59a700 1 -- 172.21.15.79:0/3231791646 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a000b860 con 0x7fc7b0157870 2023-10-14T18:45:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7ad59a700 1 -- 172.21.15.79:0/3231791646 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a000bc00 con 0x7fc7b0157870 2023-10-14T18:45:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3231791646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 msgr2=0x7fc7b015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3231791646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b015b6a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7b015cb20 tx=0x7fc7a0009250 comp rx=0 tx=0).stop 2023-10-14T18:45:28.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3231791646 shutdown_connections 2023-10-14T18:45:28.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3231791646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b015b6a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3231791646 >> v2:172.21.15.144:3300/0 conn(0x7fc7b015a620 0x7fc7b015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3231791646 >> 172.21.15.79:0/3231791646 conn(0x7fc7b0068ce0 msgr2=0x7fc7b00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3231791646 shutdown_connections 2023-10-14T18:45:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.145+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3231791646 wait complete. 2023-10-14T18:45:28.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.146+0000 7fc7b4a7c700 1 Processor -- start 2023-10-14T18:45:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.146+0000 7fc7b4a7c700 1 -- start start 2023-10-14T18:45:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 0x7fc7b015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 0x7fc7b0149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b016eb30 con 0x7fc7b0157870 2023-10-14T18:45:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b015f470 con 0x7fc7b015d580 2023-10-14T18:45:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7b4a7c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b016dd70 con 0x7fc7b015a620 2023-10-14T18:45:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59982/0 (socket says 172.21.15.79:59982) 2023-10-14T18:45:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3599678247 learned_addr learned my addr 172.21.15.79:0/3599678247 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7aed9d700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 0x7fc7b0149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7add9b700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 0x7fc7b015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 msgr2=0x7fc7b015ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 0x7fc7b015ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 msgr2=0x7fc7b0149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 0x7fc7b0149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7ae59c700 1 -- 172.21.15.79:0/3599678247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a00094f0 con 0x7fc7b0157870 2023-10-14T18:45:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7aed9d700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 0x7fc7b0149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.147+0000 7fc7add9b700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 0x7fc7b015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc7ae59c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc7b006b530 tx=0x7fc7a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0011420 con 0x7fc7b0157870 2023-10-14T18:45:28.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0011580 con 0x7fc7b0157870 2023-10-14T18:45:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0011940 con 0x7fc7b0157870 2023-10-14T18:45:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b016e050 con 0x7fc7b0157870 2023-10-14T18:45:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.148+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b016e610 con 0x7fc7b0157870 2023-10-14T18:45:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.149+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b016e830 con 0x7fc7b0157870 2023-10-14T18:45:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.149+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7a002c3b0 con 0x7fc7b0157870 2023-10-14T18:45:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.149+0000 7fc79e7fc700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.149+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7a0085c80 con 0x7fc7b0157870 2023-10-14T18:45:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.150+0000 7fc7add9b700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.150+0000 7fc7add9b700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0150730 tx=0x7fc7a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.154+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7a0052e50 con 0x7fc7b0157870 2023-10-14T18:45:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.378+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7b004c3c0 con 0x7fc7b0157870 2023-10-14T18:45:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.379+0000 7fc79e7fc700 1 -- 172.21.15.79:0/3599678247 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fc7a0015090 con 0x7fc7b0157870 2023-10-14T18:45:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:28.381 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:28.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 msgr2=0x7fc7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 0x7fc7900693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0150730 tx=0x7fc7a4008040 comp rx=0 tx=0).stop 2023-10-14T18:45:28.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 msgr2=0x7fc7b0149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc7b006b530 tx=0x7fc7a0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:28.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 shutdown_connections 2023-10-14T18:45:28.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc790066f30 0x7fc7900693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7b015d580 0x7fc7b0149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7b0157870 0x7fc7b0149970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 --2- 172.21.15.79:0/3599678247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7b015a620 0x7fc7b015ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 >> 172.21.15.79:0/3599678247 conn(0x7fc7b0068ce0 msgr2=0x7fc7b0158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.380+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 shutdown_connections 2023-10-14T18:45:28.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.381+0000 7fc7b4a7c700 1 -- 172.21.15.79:0/3599678247 wait complete. 2023-10-14T18:45:28.385 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:28.796 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:45:09.872765+0000', 'modified': '2023-10-14T18:45:13.515360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/4045595129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 4045595129}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 4045595129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:45:28.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:45:28.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T18:45:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.912+0000 7fb6eb253700 1 Processor -- start 2023-10-14T18:45:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.912+0000 7fb6eb253700 1 -- start start 2023-10-14T18:45:28.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6eb253700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e41523e0 0x7fb6e406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6eb253700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6e4158e50 0x7fb6e40cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6eb253700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e406c010 con 0x7fb6e4152010 2023-10-14T18:45:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6eb253700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e406bd10 con 0x7fb6e4158e50 2023-10-14T18:45:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6eb253700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e415c060 con 0x7fb6e41523e0 2023-10-14T18:45:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6e4158e50 0x7fb6e40cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb6e4158e50 0x7fb6e40cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60044/0 (socket says 172.21.15.79:60044) 2023-10-14T18:45:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2854950929 learned_addr learned my addr 172.21.15.79:0/2854950929 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2854950929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e41523e0 msgr2=0x7fb6e406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e41523e0 0x7fb6e406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e41523e0 0x7fb6e406c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2854950929 >> v1:172.21.15.144:6789/0 conn(0x7fb6e4152010 legacy=0x7fb6e415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.913+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2854950929 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e415c340 con 0x7fb6e4158e50 2023-10-14T18:45:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e4158e50 0x7fb6e40cdf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0099b0 tx=0x7fb6dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f598f1e8c203f669 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6e37fe700 1 -- 172.21.15.79:0/2854950929 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00b820 con 0x7fb6e4158e50 2023-10-14T18:45:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6e37fe700 1 -- 172.21.15.79:0/2854950929 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00b980 con 0x7fb6e4158e50 2023-10-14T18:45:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6e37fe700 1 -- 172.21.15.79:0/2854950929 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00bd20 con 0x7fb6e4158e50 2023-10-14T18:45:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 -- 172.21.15.79:0/2854950929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e4158e50 msgr2=0x7fb6e40cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e4158e50 0x7fb6e40cdf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0099b0 tx=0x7fb6dc009250 comp rx=0 tx=0).stop 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 -- 172.21.15.79:0/2854950929 shutdown_connections 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e4158e50 0x7fb6e40cdf30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2854950929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e41523e0 0x7fb6e406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 -- 172.21.15.79:0/2854950929 >> 172.21.15.79:0/2854950929 conn(0x7fb6e4069870 msgr2=0x7fb6e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 -- 172.21.15.79:0/2854950929 shutdown_connections 2023-10-14T18:45:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.914+0000 7fb6eb253700 1 -- 172.21.15.79:0/2854950929 wait complete. 2023-10-14T18:45:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.915+0000 7fb6eb253700 1 Processor -- start 2023-10-14T18:45:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 -- start start 2023-10-14T18:45:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 0x7fb6e414f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e4158e50 0x7fb6e41498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40c3d00 con 0x7fb6e41523e0 2023-10-14T18:45:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e414ea50 con 0x7fb6e4152010 2023-10-14T18:45:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6eb253700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e4149df0 con 0x7fb6e4158e50 2023-10-14T18:45:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60052/0 (socket says 172.21.15.79:60052) 2023-10-14T18:45:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2724764139 learned_addr learned my addr 172.21.15.79:0/2724764139 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 0x7fb6e414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.916+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e4158e50 0x7fb6e41498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e4158e50 msgr2=0x7fb6e41498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e4158e50 0x7fb6e41498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 msgr2=0x7fb6e414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 0x7fb6e414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2724764139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0094f0 con 0x7fb6e41523e0 2023-10-14T18:45:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 0x7fb6e414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800c880 tx=0x7fb6d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e0ff9700 1 -- 172.21.15.79:0/2724764139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8011600 con 0x7fb6e41523e0 2023-10-14T18:45:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e0ff9700 1 -- 172.21.15.79:0/2724764139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8011760 con 0x7fb6e41523e0 2023-10-14T18:45:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6e0ff9700 1 -- 172.21.15.79:0/2724764139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8011b20 con 0x7fb6e41523e0 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e414acf0 con 0x7fb6e41523e0 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.917+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e414b2b0 con 0x7fb6e41523e0 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.918+0000 7fb6e0ff9700 1 -- 172.21.15.79:0/2724764139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6d80223a0 con 0x7fb6e41523e0 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.919+0000 7fb6e0ff9700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.919+0000 7fb6e0ff9700 1 -- 172.21.15.79:0/2724764139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6d80845e0 con 0x7fb6e41523e0 2023-10-14T18:45:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.919+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.919+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 0x7fb6d00693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4001370 tx=0x7fb6d4009680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 Processor -- start 2023-10-14T18:45:28.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 -- start start 2023-10-14T18:45:28.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e04dd00 0x55637e02ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637df5aa70 con 0x55637e02cf60 2023-10-14T18:45:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637df58270 con 0x55637e04dd00 2023-10-14T18:45:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.921+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55637df54060 con 0x55637e003a50 2023-10-14T18:45:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60060/0 (socket says 172.21.15.79:60060) 2023-10-14T18:45:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 -- 172.21.15.79:0/1634055026 learned_addr learned my addr 172.21.15.79:0/1634055026 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e04dd00 0x55637e02ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 -- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 msgr2=0x55637e003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 -- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e04dd00 msgr2=0x55637e02ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e04dd00 0x55637e02ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 -- 172.21.15.79:0/1634055026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55637ddee270 con 0x55637e02cf60 2023-10-14T18:45:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00b3c0 tx=0x7fb6dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe54267594055720 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6c9ffb700 1 -- 172.21.15.79:0/1634055026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00bc40 con 0x55637e02cf60 2023-10-14T18:45:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6c9ffb700 1 -- 172.21.15.79:0/1634055026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00bda0 con 0x55637e02cf60 2023-10-14T18:45:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.922+0000 7fb6c9ffb700 1 -- 172.21.15.79:0/1634055026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011880 con 0x55637e02cf60 2023-10-14T18:45:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- 172.21.15.79:0/1634055026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 msgr2=0x55637dfffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00b3c0 tx=0x7fb6dc016000 comp rx=0 tx=0).stop 2023-10-14T18:45:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- 172.21.15.79:0/1634055026 shutdown_connections 2023-10-14T18:45:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637dfffcf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/1634055026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e04dd00 0x55637e02ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- 172.21.15.79:0/1634055026 >> 172.21.15.79:0/1634055026 conn(0x55637e005370 msgr2=0x55637e005740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- 172.21.15.79:0/1634055026 shutdown_connections 2023-10-14T18:45:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- 172.21.15.79:0/1634055026 wait complete. 2023-10-14T18:45:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.923+0000 7fb6f454cb80 1 -- start start 2023-10-14T18:45:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 Processor -- start 2023-10-14T18:45:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e003a50 0x55637e04c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e02cf60 0x55637e043e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637deff890 con 0x55637e04dd00 2023-10-14T18:45:28.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637df1aea0 con 0x55637e003a50 2023-10-14T18:45:28.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55637ddd6e30 con 0x55637e02cf60 2023-10-14T18:45:28.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6f454cb80 10 client.0 _ll_register_callbacks cb 0x55637dfc7110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:45:28.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6e97f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6e97f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60068/0 (socket says 172.21.15.79:60068) 2023-10-14T18:45:28.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.924+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2396390193 learned_addr learned my addr 172.21.15.79:0/2396390193 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e003a50 0x55637e04c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e02cf60 0x55637e043e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e02cf60 msgr2=0x55637e043e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e02cf60 0x55637e043e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e003a50 msgr2=0x55637e04c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e003a50 0x55637e04c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 -- 172.21.15.79:0/2396390193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e415c340 con 0x55637e04dd00 2023-10-14T18:45:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0094c0 tx=0x7fb6dc01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b18428c7f11e207 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:45:28.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011e40 con 0x55637e04dd00 2023-10-14T18:45:28.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6dc011630 con 0x55637e04dd00 2023-10-14T18:45:28.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55637dff8b70 con 0x55637e04dd00 2023-10-14T18:45:28.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6dc0117f0 con 0x55637e04dd00 2023-10-14T18:45:28.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55637dd90fe0 con 0x55637e04dd00 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55637dff8b70 con 0x55637e04dd00 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb6dc018070 con 0x55637e04dd00 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T18:45:28.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 20 client.4659 populate_metadata read hostname 'smithi079' 2023-10-14T18:45:28.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e047280 0x55637e047650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 4 client.4659 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:45:28.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.925+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 --> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55637dfd5aa0 con 0x55637e047280 2023-10-14T18:45:28.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.926+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e047280 0x55637e047650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.926+0000 7fb6c2ffd700 10 client.4659 ms_handle_connect on v2:172.21.15.144:6835/4045595129 2023-10-14T18:45:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.926+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e047280 0x55637e047650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc68f56bcbf055bc server_cookie=3d7ee1f0b44c650b in_seq=0 out_seq=0 2023-10-14T18:45:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2396390193 <== mds.0 v2:172.21.15.144:6835/4045595129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55637dfd5aa0 con 0x55637e047280 2023-10-14T18:45:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6c2ffd700 10 client.4659 handle_command_reply: tid=0 2023-10-14T18:45:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 client.4659 shutdown 2023-10-14T18:45:28.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 msgr2=0x55637e0443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0094c0 tx=0x7fb6dc01f040 comp rx=0 tx=0).stop 2023-10-14T18:45:28.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 shutdown_connections 2023-10-14T18:45:28.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e047280 0x55637e047650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e04dd00 0x55637e0443b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e003a50 0x55637e04c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6c2ffd700 0 client.4659 ms_handle_reset on v2:172.21.15.144:6835/4045595129 2023-10-14T18:45:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2396390193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e02cf60 0x55637e043e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 >> 172.21.15.79:0/2396390193 conn(0x55637e005370 msgr2=0x55637e049550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 shutdown_connections 2023-10-14T18:45:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2396390193 wait complete. 2023-10-14T18:45:28.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.927+0000 7fb6f454cb80 20 client.4659 trim_cache size 0 max 16384 2023-10-14T18:45:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.944+0000 7fb6f454cb80 1 Processor -- start 2023-10-14T18:45:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.944+0000 7fb6f454cb80 1 -- start start 2023-10-14T18:45:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e063c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e0338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637e001bd0 con 0x55637e02cf60 2023-10-14T18:45:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637e02c4e0 con 0x55637e047280 2023-10-14T18:45:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55637e0633c0 con 0x55637e003a50 2023-10-14T18:45:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60070/0 (socket says 172.21.15.79:60070) 2023-10-14T18:45:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 -- 172.21.15.79:0/806535195 learned_addr learned my addr 172.21.15.79:0/806535195 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 -- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 msgr2=0x55637e063c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e0338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e063c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e063c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 -- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 msgr2=0x55637e0338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e0338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 -- 172.21.15.79:0/806535195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55637df22780 con 0x55637e02cf60 2023-10-14T18:45:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80554a0 tx=0x7fb6d8013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f7fad1e90b5349 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6ca7fc700 1 -- 172.21.15.79:0/806535195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8055590 con 0x55637e02cf60 2023-10-14T18:45:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6ca7fc700 1 -- 172.21.15.79:0/806535195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d806b070 con 0x55637e02cf60 2023-10-14T18:45:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.945+0000 7fb6ca7fc700 1 -- 172.21.15.79:0/806535195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8058760 con 0x55637e02cf60 2023-10-14T18:45:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- 172.21.15.79:0/806535195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 msgr2=0x55637e033360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80554a0 tx=0x7fb6d8013040 comp rx=0 tx=0).stop 2023-10-14T18:45:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- 172.21.15.79:0/806535195 shutdown_connections 2023-10-14T18:45:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e0338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e063c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/806535195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e033360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- 172.21.15.79:0/806535195 >> 172.21.15.79:0/806535195 conn(0x55637e005370 msgr2=0x55637e048870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- 172.21.15.79:0/806535195 shutdown_connections 2023-10-14T18:45:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- 172.21.15.79:0/806535195 wait complete. 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.946+0000 7fb6f454cb80 1 -- start start 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 Processor -- start 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e043e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637e026270 con 0x55637e02cf60 2023-10-14T18:45:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55637e0a9260 con 0x55637e047280 2023-10-14T18:45:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55637e0260b0 con 0x55637e003a50 2023-10-14T18:45:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6f454cb80 10 client.0 _ll_register_callbacks cb 0x55637dfc7110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:45:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60076/0 (socket says 172.21.15.79:60076) 2023-10-14T18:45:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2890463643 learned_addr learned my addr 172.21.15.79:0/2890463643 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6e97f0700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e043e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.947+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 msgr2=0x55637e0a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e0a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 msgr2=0x55637e043e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e043e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 -- 172.21.15.79:0/2890463643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e414b2b0 con 0x55637e02cf60 2023-10-14T18:45:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e3fff700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8055dc0 tx=0x7fb6d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5421404555b2ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:45:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8055510 con 0x55637e02cf60 2023-10-14T18:45:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6d8054a00 con 0x55637e02cf60 2023-10-14T18:45:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6dc00bda0 con 0x55637e02cf60 2023-10-14T18:45:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6d805c020 con 0x55637e02cf60 2023-10-14T18:45:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 10 client.4665 fetch_fsmap learned FSMap version 8 2023-10-14T18:45:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55637df09470 con 0x55637e02cf60 2023-10-14T18:45:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc00bda0 con 0x55637e02cf60 2023-10-14T18:45:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb6d8071030 con 0x55637e02cf60 2023-10-14T18:45:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T18:45:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 20 client.4665 populate_metadata read hostname 'smithi079' 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e04dd00 0x55637e0a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 4 client.4665 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 --> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55637def6e00 con 0x55637e04dd00 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.948+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e04dd00 0x55637e0a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6e8fef700 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e04dd00 0x55637e0a8380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bf2c88110cc0e9 server_cookie=d2d186032827ae9a in_seq=0 out_seq=0 2023-10-14T18:45:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6c2ffd700 10 client.4665 ms_handle_connect on v2:172.21.15.144:6835/4045595129 2023-10-14T18:45:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6c2ffd700 1 -- 172.21.15.79:0/2890463643 <== mds.0 v2:172.21.15.144:6835/4045595129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55637def6e00 con 0x55637e04dd00 2023-10-14T18:45:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6c2ffd700 10 client.4665 handle_command_reply: tid=0 2023-10-14T18:45:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 client.4665 shutdown 2023-10-14T18:45:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 msgr2=0x55637e043910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8055dc0 tx=0x7fb6d8015000 comp rx=0 tx=0).stop 2023-10-14T18:45:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 shutdown_connections 2023-10-14T18:45:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:6835/4045595129,v1:172.21.15.144:6837/4045595129] conn(0x55637e04dd00 0x55637e0a8380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55637e047280 0x55637e043e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6c2ffd700 0 client.4665 ms_handle_reset on v2:172.21.15.144:6835/4045595129 2023-10-14T18:45:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55637e003a50 0x55637e0a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 --2- 172.21.15.79:0/2890463643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55637e02cf60 0x55637e043910 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 >> 172.21.15.79:0/2890463643 conn(0x55637e005370 msgr2=0x55637e04c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 shutdown_connections 2023-10-14T18:45:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 1 -- 172.21.15.79:0/2890463643 wait complete. 2023-10-14T18:45:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.949+0000 7fb6f454cb80 20 client.4665 trim_cache size 0 max 16384 2023-10-14T18:45:28.975 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:45:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:45:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:45:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4279, 2023-10-14T18:45:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:45:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:45:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:45:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 18.447730073999999, 2023-10-14T18:45:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 8, 2023-10-14T18:45:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 20, 2023-10-14T18:45:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 20, 2023-10-14T18:45:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 25.339798944000002 2023-10-14T18:45:28.977 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:45:28.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 msgr2=0x7fb6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 0x7fb6d00693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4001370 tx=0x7fb6d4009680 comp rx=0 tx=0).stop 2023-10-14T18:45:28.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 msgr2=0x7fb6e414e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800c880 tx=0x7fb6d8008040 comp rx=0 tx=0).stop 2023-10-14T18:45:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 shutdown_connections 2023-10-14T18:45:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb6d0066f30 0x7fb6d00693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb6e4158e50 0x7fb6e41498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6e4152010 0x7fb6e414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 --2- 172.21.15.79:0/2724764139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6e41523e0 0x7fb6e414e510 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 >> 172.21.15.79:0/2724764139 conn(0x7fb6e4069870 msgr2=0x7fb6e414cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 shutdown_connections 2023-10-14T18:45:28.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:28.950+0000 7fb6eb253700 1 -- 172.21.15.79:0/2724764139 wait complete. 2023-10-14T18:45:28.982 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T18:45:29.003 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T18:45:29.003 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T18:45:29.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.004 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:45:29.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-14T18:45:29.085 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2023-10-14T18:45:29.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:45:29.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.087 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:45:29.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-14T18:45:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2023-10-14T18:45:29.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:45:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.208 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:45:29.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-14T18:45:29.297 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-14T18:45:29.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:45:29.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.300 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:45:29.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-14T18:45:29.424 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-14T18:45:29.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:45:29.426 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-14T18:45:29.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:45:29.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.540+0000 7f7643fff700 1 Processor -- start 2023-10-14T18:45:29.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.540+0000 7f7643fff700 1 -- start start 2023-10-14T18:45:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f7643fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f764406ee60 0x7f76440aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f7643fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764406d3e0 con 0x7f76440abb20 2023-10-14T18:45:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f7643fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76440aee10 con 0x7f76440ac690 2023-10-14T18:45:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f7643fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76440aebf0 con 0x7f764406ee60 2023-10-14T18:45:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f763a7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f76440abb20 0x7f7644155eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52314/0 (socket says 172.21.15.79:52314) 2023-10-14T18:45:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f763a7fc700 1 -- 172.21.15.79:0/1517954488 learned_addr learned my addr 172.21.15.79:0/1517954488 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888390247 0 0) 0x7f764406d3e0 con 0x7f76440abb20 2023-10-14T18:45:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f76437fe700 1 --2- 172.21.15.79:0/1517954488 >> v2:172.21.15.144:3300/0 conn(0x7f764406ee60 0x7f76440aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.541+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7630003570 con 0x7f76440abb20 2023-10-14T18:45:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232384627 0 0) 0x7f7630003570 con 0x7f76440abb20 2023-10-14T18:45:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 >> v2:172.21.15.144:3300/0 conn(0x7f764406ee60 msgr2=0x7f76440aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 --2- 172.21.15.79:0/1517954488 >> v2:172.21.15.144:3300/0 conn(0x7f764406ee60 0x7f76440aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 >> v1:172.21.15.144:6789/0 conn(0x7f76440ac690 legacy=0x7f76440ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764406d650 con 0x7f76440abb20 2023-10-14T18:45:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f762c001470 con 0x7f76440abb20 2023-10-14T18:45:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 >> v1:172.21.15.79:6789/0 conn(0x7f76440abb20 legacy=0x7f7644155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 0x7f7630003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7630004810 0x7f7630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76300051c0 0x7f763000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76440aebf0 con 0x7f7630003a60 2023-10-14T18:45:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763000c160 con 0x7f76300051c0 2023-10-14T18:45:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763000c320 con 0x7f7630004810 2023-10-14T18:45:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 0x7f7630003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76437fe700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76300051c0 0x7f763000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f763a7fc700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7630004810 0x7f7630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 -- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7630004810 msgr2=0x7f7630004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7630004810 0x7f7630004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 -- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76300051c0 msgr2=0x7f763000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76300051c0 0x7f763000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76437fe700 1 -- 172.21.15.79:0/1517954488 reap_dead start 2023-10-14T18:45:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 -- 172.21.15.79:0/1517954488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630003570 con 0x7f7630003a60 2023-10-14T18:45:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 0x7f7630003e70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76340018b0 tx=0x7f7634007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880385d99e85546e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634013770 con 0x7f7630003a60 2023-10-14T18:45:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340138f0 con 0x7f7630003a60 2023-10-14T18:45:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.542+0000 7f76427fc700 1 -- 172.21.15.79:0/1517954488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634013aa0 con 0x7f7630003a60 2023-10-14T18:45:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 -- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 msgr2=0x7f7630003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 0x7f7630003e70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76340018b0 tx=0x7f7634007d30 comp rx=0 tx=0).stop 2023-10-14T18:45:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 -- 172.21.15.79:0/1517954488 shutdown_connections 2023-10-14T18:45:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 --2- 172.21.15.79:0/1517954488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7630003a60 0x7f7630003e70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 -- 172.21.15.79:0/1517954488 >> 172.21.15.79:0/1517954488 conn(0x7f76440680e0 msgr2=0x7f76440cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 -- 172.21.15.79:0/1517954488 shutdown_connections 2023-10-14T18:45:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.543+0000 7f7643fff700 1 -- 172.21.15.79:0/1517954488 wait complete. 2023-10-14T18:45:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.544+0000 7f7643fff700 1 Processor -- start 2023-10-14T18:45:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.544+0000 7f7643fff700 1 -- start start 2023-10-14T18:45:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7630003a60 0x7f7644158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7644169140 0x7f76441695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76440a8090 con 0x7f7644169af0 2023-10-14T18:45:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644151e80 con 0x7f7630003a60 2023-10-14T18:45:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7643fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76440a7c00 con 0x7f7644169140 2023-10-14T18:45:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60100/0 (socket says 172.21.15.79:60100) 2023-10-14T18:45:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 -- 172.21.15.79:0/1012379748 learned_addr learned my addr 172.21.15.79:0/1012379748 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7630003a60 0x7f7644158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f763a7fc700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7644169140 0x7f76441695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 -- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7644169140 msgr2=0x7f76441695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7644169140 0x7f76441695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 -- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7630003a60 msgr2=0x7f7644158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7630003a60 0x7f7644158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 -- 172.21.15.79:0/1012379748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644169f70 con 0x7f7644169af0 2023-10-14T18:45:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f76437fe700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f763c0094d0 tx=0x7f763c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.545+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00e040 con 0x7f7644169af0 2023-10-14T18:45:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.546+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c00f040 con 0x7f7644169af0 2023-10-14T18:45:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.546+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76440a6ff0 con 0x7f7644169af0 2023-10-14T18:45:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.546+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00fda0 con 0x7f7644169af0 2023-10-14T18:45:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.546+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76440a75b0 con 0x7f7644169af0 2023-10-14T18:45:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.547+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76440a7d70 con 0x7f7644169af0 2023-10-14T18:45:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.547+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f763c015640 con 0x7f7644169af0 2023-10-14T18:45:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.547+0000 7f763b7fe700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.547+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f763c084c40 con 0x7f7644169af0 2023-10-14T18:45:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.547+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:29.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.548+0000 7f7642ffd700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 0x7f76240693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7634001010 tx=0x7f7634019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:29.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.551+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f763c051eb0 con 0x7f7644169af0 2023-10-14T18:45:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.776+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f764404bb80 con 0x7f7644169af0 2023-10-14T18:45:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.776+0000 7f763b7fe700 1 -- 172.21.15.79:0/1012379748 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f763c0554d0 con 0x7f7644169af0 2023-10-14T18:45:29.777 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:45:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 msgr2=0x7f76240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 0x7f76240693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7634001010 tx=0x7f7634019000 comp rx=0 tx=0).stop 2023-10-14T18:45:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 msgr2=0x7f7644165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f763c0094d0 tx=0x7f763c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 shutdown_connections 2023-10-14T18:45:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7624066f30 0x7f76240693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7644169af0 0x7f7644165380 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7630003a60 0x7f7644158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 --2- 172.21.15.79:0/1012379748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7644169140 0x7f76441695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:29.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 >> 172.21.15.79:0/1012379748 conn(0x7f76440680e0 msgr2=0x7f7644153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:29.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 shutdown_connections 2023-10-14T18:45:29.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:29.778+0000 7f7643fff700 1 -- 172.21.15.79:0/1012379748 wait complete. 2023-10-14T18:45:29.792 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T18:45:29.793 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:45:29.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:45:29.793 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:45:29.794 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:45:29.794 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T18:45:29.794 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T18:45:29.795 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:45:29.795 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:45:29.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.796 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:45:29.811 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:29.811 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:29.812 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:29.812 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:45:29.813 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:29.813 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:45:29.813 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:29.814 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:45:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:29.814 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:45:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42504sec preferred_lft 42504sec 2023-10-14T18:45:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:45:29.815 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:29.816 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T18:45:29.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.816 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:29.817 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:29.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2023-10-14T18:45:29.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2023-10-14T18:45:29.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2023-10-14T18:45:29.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T18:45:29.818 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:29.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:29.973 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:45:30.012 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:45:30.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.014 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:45:30.085 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:45:30.086 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:45:30.086 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:45:30.086 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:45:30.086 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:45:30.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.087 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:30.088 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:30.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:45:30.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:45:30.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:45:30.089 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:30.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.322 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:45:30.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.338 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-10-14T18:45:30.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.392 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:30.392 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:30.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:45:30.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T18:45:30.393 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:30.481 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T18:45:30.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.482 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:30.482 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:30.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T18:45:30.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T18:45:30.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T18:45:30.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T18:45:30.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T18:45:30.484 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:30.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:30.672 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:30.673 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:30.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:45:30.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T18:45:30.674 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:30.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:30.766 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:45:30.780 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:45:30.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:30.781 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:45:30.834 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:45:30.835 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:45:30.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:45:30.920 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:45:30.920 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:45:30.920 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:45:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:45:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:30.998 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:31.019 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:45:31.019 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:45:31.020 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:31.020 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:31.020 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:31.020 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:45:31.020 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:45:31.021 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:45:31.022 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:45:31.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:45:31.048 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-14T18:45:31.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:45:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.202+0000 7f6a807e6700 1 Processor -- start 2023-10-14T18:45:31.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.202+0000 7f6a807e6700 1 -- start start 2023-10-14T18:45:31.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.202+0000 7f6a807e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a78070950 0x7f6a78068890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.202+0000 7f6a807e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 0x7f6a78142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a807e6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a78143530 0x7f6a780cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a807e6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780677f0 con 0x7f6a78070950 2023-10-14T18:45:31.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a807e6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a78067ad0 con 0x7f6a78143530 2023-10-14T18:45:31.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a807e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a78067db0 con 0x7f6a78070d20 2023-10-14T18:45:31.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a78070950 0x7f6a78068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6a78070950 0x7f6a78068890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60116/0 (socket says 172.21.15.79:60116) 2023-10-14T18:45:31.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 -- 172.21.15.79:0/3178450762 learned_addr learned my addr 172.21.15.79:0/3178450762 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:31.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7dd81700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 0x7f6a78142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7ed83700 1 --2- 172.21.15.79:0/3178450762 >> v2:172.21.15.144:3300/0 conn(0x7f6a78143530 0x7f6a780cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 -- 172.21.15.79:0/3178450762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 msgr2=0x7f6a78142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:31.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 0x7f6a78142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 -- 172.21.15.79:0/3178450762 >> v2:172.21.15.144:3300/0 conn(0x7f6a78143530 msgr2=0x7f6a780cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 --2- 172.21.15.79:0/3178450762 >> v2:172.21.15.144:3300/0 conn(0x7f6a78143530 0x7f6a780cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 -- 172.21.15.79:0/3178450762 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a78068090 con 0x7f6a78070950 2023-10-14T18:45:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7dd81700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 0x7f6a78142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:31.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7e582700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78070950 0x7f6a78068890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ce780 tx=0x7f6a68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805b3e8a4b630118 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:31.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7d580700 1 -- 172.21.15.79:0/3178450762 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e070 con 0x7f6a78070950 2023-10-14T18:45:31.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7d580700 1 -- 172.21.15.79:0/3178450762 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800ba50 con 0x7f6a78070950 2023-10-14T18:45:31.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.203+0000 7f6a7d580700 1 -- 172.21.15.79:0/3178450762 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680092e0 con 0x7f6a78070950 2023-10-14T18:45:31.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 -- 172.21.15.79:0/3178450762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78070950 msgr2=0x7f6a78068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:31.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78070950 0x7f6a78068890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ce780 tx=0x7f6a68009840 comp rx=0 tx=0).stop 2023-10-14T18:45:31.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 -- 172.21.15.79:0/3178450762 shutdown_connections 2023-10-14T18:45:31.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 --2- 172.21.15.79:0/3178450762 >> v2:172.21.15.144:3300/0 conn(0x7f6a78143530 0x7f6a780cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78070950 0x7f6a78068890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 --2- 172.21.15.79:0/3178450762 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070d20 0x7f6a78142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 -- 172.21.15.79:0/3178450762 >> 172.21.15.79:0/3178450762 conn(0x7f6a7806ad20 msgr2=0x7f6a780cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:31.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 -- 172.21.15.79:0/3178450762 shutdown_connections 2023-10-14T18:45:31.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.204+0000 7f6a807e6700 1 -- 172.21.15.79:0/3178450762 wait complete. 2023-10-14T18:45:31.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.205+0000 7f6a807e6700 1 Processor -- start 2023-10-14T18:45:31.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.205+0000 7f6a807e6700 1 -- start start 2023-10-14T18:45:31.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070950 0x7f6a781396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a78070d20 0x7f6a7815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7816b350 con 0x7f6a78143530 2023-10-14T18:45:31.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7815aba0 con 0x7f6a78070d20 2023-10-14T18:45:31.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a807e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7815ae80 con 0x7f6a78070950 2023-10-14T18:45:31.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7e582700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070950 0x7f6a781396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60118/0 (socket says 172.21.15.79:60118) 2023-10-14T18:45:31.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 -- 172.21.15.79:0/1220687561 learned_addr learned my addr 172.21.15.79:0/1220687561 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:31.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7dd81700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a78070d20 0x7f6a7815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 -- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070950 msgr2=0x7f6a781396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:31.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070950 0x7f6a781396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 -- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a78070d20 msgr2=0x7f6a7815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:31.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a78070d20 0x7f6a7815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 -- 172.21.15.79:0/1220687561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009ae0 con 0x7f6a78143530 2023-10-14T18:45:31.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a7ed83700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000c880 tx=0x7f6a70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:31.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.206+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70011600 con 0x7f6a78143530 2023-10-14T18:45:31.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.207+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70011760 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.207+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7815b160 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.207+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a70011b00 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.207+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7815fbd0 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.207+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7804c3c0 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.208+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a700193f0 con 0x7f6a78143530 2023-10-14T18:45:31.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.208+0000 7f6a767fc700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:31.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.208+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a700846d0 con 0x7f6a78143530 2023-10-14T18:45:31.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.208+0000 7f6a7e582700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:31.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.209+0000 7f6a7e582700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009880 tx=0x7f6a68018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:31.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.212+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a700519f0 con 0x7f6a78143530 2023-10-14T18:45:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.437+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a78068370 con 0x7f6a78143530 2023-10-14T18:45:31.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.437+0000 7f6a767fc700 1 -- 172.21.15.79:0/1220687561 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a70055010 con 0x7f6a78143530 2023-10-14T18:45:31.438 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:45:31.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 msgr2=0x7f6a640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:31.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009880 tx=0x7f6a68018000 comp rx=0 tx=0).stop 2023-10-14T18:45:31.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 msgr2=0x7f6a7816ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:31.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000c880 tx=0x7f6a70008040 comp rx=0 tx=0).stop 2023-10-14T18:45:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 shutdown_connections 2023-10-14T18:45:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a78143530 0x7f6a7816ae10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a78070950 0x7f6a781396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 --2- 172.21.15.79:0/1220687561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a78070d20 0x7f6a7815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 >> 172.21.15.79:0/1220687561 conn(0x7f6a7806ad20 msgr2=0x7f6a780c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 shutdown_connections 2023-10-14T18:45:31.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:31.439+0000 7f6a807e6700 1 -- 172.21.15.79:0/1220687561 wait complete. 2023-10-14T18:45:31.451 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T18:45:31.452 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:45:31.452 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:45:31.452 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T18:45:31.452 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T18:45:31.453 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T18:45:31.453 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T18:45:31.453 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:45:31.453 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T18:45:31.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.454 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:45:31.469 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.471 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:45:31.472 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:45:31.472 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:31.473 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:45:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:45:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42503sec preferred_lft 42503sec 2023-10-14T18:45:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:45:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.474 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:45:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link tentative 2023-10-14T18:45:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.475 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:45:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:45:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link tentative 2023-10-14T18:45:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.477 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:45:31.532 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:45:31.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.533 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:45:31.590 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:45:31.591 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:45:31.591 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:45:31.591 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:45:31.591 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:45:31.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.592 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:31.592 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:31.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:45:31.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:45:31.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:45:31.593 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:31.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.690 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:45:31.705 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:45:31.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.706 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-10-14T18:45:31.760 INFO:teuthology.orchestra.run.smithi079.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T18:45:31.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.761 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:31.761 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:31.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:45:31.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T18:45:31.762 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:31.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T18:45:31.880 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:31.880 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:31.880 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.881 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:45:31.881 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 42:cc:07:01:95:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T18:45:31.882 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T18:45:31.882 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.882 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::40cc:7ff:fe01:95d3/64 scope link 2023-10-14T18:45:31.882 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T18:45:31.977 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:31.977 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:31.978 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.978 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:45:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 42:cc:07:01:95:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T18:45:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T18:45:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::40cc:7ff:fe01:95d3/64 scope link 2023-10-14T18:45:31.979 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:31.993 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T18:45:31.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:31.995 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:31.995 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:31.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T18:45:31.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T18:45:31.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T18:45:31.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T18:45:31.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T18:45:31.997 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:32.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:32.201 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:45:32.202 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:45:32.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.1 up 2023-10-14T18:45:32.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T18:45:32.203 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:45:32.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:32.283 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T18:45:32.298 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T18:45:32.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:32.299 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T18:45:32.352 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:45:32.353 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:45:32.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T18:45:32.432 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T18:45:32.432 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T18:45:32.432 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:32.441 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T18:45:32.441 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T18:45:32.441 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:32.442 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:32.442 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:32.462 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-14T18:45:32.463 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-14T18:45:32.463 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:45:32.463 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:32.463 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:32.463 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:45:32.464 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:45:32.464 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:45:32.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:45:32.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:32.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T18:45:32.530 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-14T18:45:32.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:45:32.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.684+0000 7f4fd3ac0700 1 Processor -- start 2023-10-14T18:45:32.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.684+0000 7f4fd3ac0700 1 -- start start 2023-10-14T18:45:32.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd3ac0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4fcc157870 0x7f4fcc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd3ac0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc15cbb0 con 0x7f4fcc15a620 2023-10-14T18:45:32.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd3ac0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc15bfa0 con 0x7f4fcc157c40 2023-10-14T18:45:32.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd3ac0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc15c280 con 0x7f4fcc157870 2023-10-14T18:45:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd105b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4fcc15a620 0x7f4fcc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52320/0 (socket says 172.21.15.79:52320) 2023-10-14T18:45:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd105b700 1 -- 172.21.15.79:0/774674187 learned_addr learned my addr 172.21.15.79:0/774674187 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd185c700 1 --2- 172.21.15.79:0/774674187 >> v2:172.21.15.144:3300/0 conn(0x7f4fcc157870 0x7f4fcc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122841320 0 0) 0x7f4fcc15cbb0 con 0x7f4fcc15a620 2023-10-14T18:45:32.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb8003570 con 0x7f4fcc15a620 2023-10-14T18:45:32.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683149749 0 0) 0x7f4fb8003570 con 0x7f4fcc15a620 2023-10-14T18:45:32.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 >> v2:172.21.15.144:3300/0 conn(0x7f4fcc157870 msgr2=0x7f4fcc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:32.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 --2- 172.21.15.79:0/774674187 >> v2:172.21.15.144:3300/0 conn(0x7f4fcc157870 0x7f4fcc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 >> v1:172.21.15.144:6789/0 conn(0x7f4fcc157c40 legacy=0x7f4fcc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc15c560 con 0x7f4fcc15a620 2023-10-14T18:45:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4fbc001470 con 0x7f4fcc15a620 2023-10-14T18:45:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 >> v1:172.21.15.79:6789/0 conn(0x7f4fcc15a620 legacy=0x7f4fcc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.685+0000 7f4fd085a700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8003a60 0x7f4fb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 0x7f4fb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80051c0 0x7f4fb800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc15c280 con 0x7f4fb8004810 2023-10-14T18:45:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb800c160 con 0x7f4fb80051c0 2023-10-14T18:45:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb800c320 con 0x7f4fb8003a60 2023-10-14T18:45:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 0x7f4fb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd205d700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80051c0 0x7f4fb800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd185c700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8003a60 0x7f4fb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 -- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8003a60 msgr2=0x7f4fb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8003a60 0x7f4fb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 -- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80051c0 msgr2=0x7f4fb800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fb80051c0 0x7f4fb800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd205d700 1 -- 172.21.15.79:0/774674187 reap_dead start 2023-10-14T18:45:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 -- 172.21.15.79:0/774674187 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8003570 con 0x7f4fb8004810 2023-10-14T18:45:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd185c700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8003a60 0x7f4fb8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd105b700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 0x7f4fb8004c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c390 tx=0x7f4fbc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b78ccbe41b10866 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:32.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00cc60 con 0x7f4fb8004810 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00cdc0 con 0x7f4fb8004810 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.686+0000 7f4fd085a700 1 -- 172.21.15.79:0/774674187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc005b50 con 0x7f4fb8004810 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 msgr2=0x7f4fb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 0x7f4fb8004c80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00c390 tx=0x7f4fbc001e50 comp rx=0 tx=0).stop 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/774674187 shutdown_connections 2023-10-14T18:45:32.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/774674187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fb8004810 0x7f4fb8004c80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/774674187 >> 172.21.15.79:0/774674187 conn(0x7f4fcc068ce0 msgr2=0x7f4fcc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:32.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/774674187 shutdown_connections 2023-10-14T18:45:32.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.687+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/774674187 wait complete. 2023-10-14T18:45:32.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.688+0000 7f4fd3ac0700 1 Processor -- start 2023-10-14T18:45:32.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.688+0000 7f4fd3ac0700 1 -- start start 2023-10-14T18:45:32.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.688+0000 7f4fd3ac0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8004810 0x7f4fcc14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fcc143ba0 0x7f4fcc14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc151750 con 0x7f4fcc143730 2023-10-14T18:45:32.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc150770 con 0x7f4fcc143ba0 2023-10-14T18:45:32.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc150a50 con 0x7f4fb8004810 2023-10-14T18:45:32.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60140/0 (socket says 172.21.15.79:60140) 2023-10-14T18:45:32.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 -- 172.21.15.79:0/4098912993 learned_addr learned my addr 172.21.15.79:0/4098912993 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:32.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd185c700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8004810 0x7f4fcc14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd205d700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fcc143ba0 0x7f4fcc14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 -- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8004810 msgr2=0x7f4fcc14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8004810 0x7f4fcc14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 -- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fcc143ba0 msgr2=0x7f4fcc14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fcc143ba0 0x7f4fcc14fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 -- 172.21.15.79:0/4098912993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc150d30 con 0x7f4fcc143730 2023-10-14T18:45:32.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd105b700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c130 tx=0x7f4fbc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:32.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc001430 con 0x7f4fcc143730 2023-10-14T18:45:32.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0070d0 con 0x7f4fcc143730 2023-10-14T18:45:32.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc1519a0 con 0x7f4fcc143730 2023-10-14T18:45:32.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc007490 con 0x7f4fcc143730 2023-10-14T18:45:32.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.689+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc150140 con 0x7f4fcc143730 2023-10-14T18:45:32.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.690+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc151d10 con 0x7f4fcc143730 2023-10-14T18:45:32.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.691+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fbc0273b0 con 0x7f4fcc143730 2023-10-14T18:45:32.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.691+0000 7f4fc1ffb700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 0x7f4fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:32.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.691+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fbc084ef0 con 0x7f4fcc143730 2023-10-14T18:45:32.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.691+0000 7f4fd185c700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 0x7f4fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:32.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.692+0000 7f4fd185c700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 0x7f4fb00693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc04d1b0 tx=0x7f4fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:32.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.696+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fbc052160 con 0x7f4fcc143730 2023-10-14T18:45:32.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.919+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4fcc04c3c0 con 0x7f4fcc143730 2023-10-14T18:45:32.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.919+0000 7f4fc1ffb700 1 -- 172.21.15.79:0/4098912993 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4fbc017070 con 0x7f4fcc143730 2023-10-14T18:45:32.920 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:45:32.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 msgr2=0x7f4fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 0x7f4fb00693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc04d1b0 tx=0x7f4fc4008040 comp rx=0 tx=0).stop 2023-10-14T18:45:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 msgr2=0x7f4fcc14f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c130 tx=0x7f4fbc015000 comp rx=0 tx=0).stop 2023-10-14T18:45:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 shutdown_connections 2023-10-14T18:45:32.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fb0066f30 0x7f4fb00693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fcc143ba0 0x7f4fcc14fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fb8004810 0x7f4fcc14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 --2- 172.21.15.79:0/4098912993 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fcc143730 0x7f4fcc14f6c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.921+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 >> 172.21.15.79:0/4098912993 conn(0x7f4fcc068ce0 msgr2=0x7f4fcc15aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.922+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 shutdown_connections 2023-10-14T18:45:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:32.922+0000 7f4fd3ac0700 1 -- 172.21.15.79:0/4098912993 wait complete. 2023-10-14T18:45:32.934 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T18:45:32.934 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:45:32.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:45:32.935 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:45:32.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:45:32.935 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T18:45:32.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T18:45:32.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:45:32.936 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:45:32.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:32.937 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:45:32.953 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:32.953 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:32.954 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:32.954 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:45:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:32.955 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:45:32.955 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:32.956 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:45:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:32.956 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:45:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42493sec preferred_lft 42493sec 2023-10-14T18:45:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:45:32.957 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:32.957 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T18:45:32.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:32.958 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:32.958 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:32.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2023-10-14T18:45:32.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2023-10-14T18:45:32.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2023-10-14T18:45:32.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T18:45:32.960 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:33.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.110 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:45:33.150 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:45:33.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.152 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:45:33.218 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:45:33.219 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:45:33.219 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:45:33.219 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:45:33.219 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:45:33.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.220 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:33.220 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:33.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:45:33.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:45:33.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:45:33.222 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:33.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.479 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:45:33.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.494 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-10-14T18:45:33.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.548 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:33.549 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:33.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:45:33.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T18:45:33.549 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:33.639 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T18:45:33.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.640 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:33.640 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T18:45:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T18:45:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T18:45:33.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T18:45:33.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T18:45:33.642 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:33.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:33.827 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:33.827 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:33.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:45:33.828 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T18:45:33.828 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:33.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:33.920 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:45:33.934 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:45:33.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:33.935 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:45:33.989 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:45:33.989 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:45:33.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:45:34.080 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:45:34.081 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:45:34.081 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:34.166 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:45:34.166 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:45:34.166 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:34.167 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:34.167 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:34.187 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:45:34.187 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:45:34.188 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:34.188 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:34.188 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:34.188 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:45:34.188 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:45:34.189 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:45:34.189 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:45:34.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.190 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:45:34.214 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-14T18:45:34.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:45:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.328+0000 7f31a24f5700 1 Processor -- start 2023-10-14T18:45:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 -- start start 2023-10-14T18:45:34.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f319c069a30 0x7f319c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f319c0c76b0 0x7f319c0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0a9d30 con 0x7f319c155f40 2023-10-14T18:45:34.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0aab70 con 0x7f319c069a30 2023-10-14T18:45:34.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.329+0000 7f31a24f5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0a9f60 con 0x7f319c0c76b0 2023-10-14T18:45:34.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f319c069a30 0x7f319c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a14f3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f319c155f40 0x7f319c069320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52324/0 (socket says 172.21.15.79:52324) 2023-10-14T18:45:34.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a14f3700 1 -- 172.21.15.79:0/2738678673 learned_addr learned my addr 172.21.15.79:0/2738678673 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:34.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a1cf4700 1 --2- 172.21.15.79:0/2738678673 >> v2:172.21.15.144:3300/0 conn(0x7f319c0c76b0 0x7f319c0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 -- 172.21.15.79:0/2738678673 >> v2:172.21.15.144:3300/0 conn(0x7f319c0c76b0 msgr2=0x7f319c0cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 --2- 172.21.15.79:0/2738678673 >> v2:172.21.15.144:3300/0 conn(0x7f319c0c76b0 0x7f319c0cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 -- 172.21.15.79:0/2738678673 >> v1:172.21.15.79:6789/0 conn(0x7f319c155f40 legacy=0x7f319c069320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 -- 172.21.15.79:0/2738678673 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0aa240 con 0x7f319c069a30 2023-10-14T18:45:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f319bfff700 1 -- 172.21.15.79:0/2738678673 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511883741 0 0) 0x7f319c0a9d30 con 0x7f319c155f40 2023-10-14T18:45:34.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f31a0cf2700 1 --2- 172.21.15.79:0/2738678673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c0cbf60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f319c0ce140 tx=0x7f319000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce31c0cf100f0cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f319bfff700 1 -- 172.21.15.79:0/2738678673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000dc00 con 0x7f319c069a30 2023-10-14T18:45:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f319bfff700 1 -- 172.21.15.79:0/2738678673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000dd60 con 0x7f319c069a30 2023-10-14T18:45:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.330+0000 7f319bfff700 1 -- 172.21.15.79:0/2738678673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900196b0 con 0x7f319c069a30 2023-10-14T18:45:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 -- 172.21.15.79:0/2738678673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 msgr2=0x7f319c0cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 --2- 172.21.15.79:0/2738678673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c0cbf60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f319c0ce140 tx=0x7f319000b430 comp rx=0 tx=0).stop 2023-10-14T18:45:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 -- 172.21.15.79:0/2738678673 shutdown_connections 2023-10-14T18:45:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 --2- 172.21.15.79:0/2738678673 >> v2:172.21.15.144:3300/0 conn(0x7f319c0c76b0 0x7f319c0cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 --2- 172.21.15.79:0/2738678673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c0cbf60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 -- 172.21.15.79:0/2738678673 >> 172.21.15.79:0/2738678673 conn(0x7f319c0cd070 msgr2=0x7f319c0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:34.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 -- 172.21.15.79:0/2738678673 shutdown_connections 2023-10-14T18:45:34.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.331+0000 7f31a24f5700 1 -- 172.21.15.79:0/2738678673 wait complete. 2023-10-14T18:45:34.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.332+0000 7f31a24f5700 1 Processor -- start 2023-10-14T18:45:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.332+0000 7f31a24f5700 1 -- start start 2023-10-14T18:45:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f319c0c76b0 0x7f319c0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f319c155f40 0x7f319c16ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c151f70 con 0x7f319c069a30 2023-10-14T18:45:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0c8040 con 0x7f319c155f40 2023-10-14T18:45:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a24f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c16e980 con 0x7f319c0c76b0 2023-10-14T18:45:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60158/0 (socket says 172.21.15.79:60158) 2023-10-14T18:45:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 -- 172.21.15.79:0/3794069345 learned_addr learned my addr 172.21.15.79:0/3794069345 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a1cf4700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f319c155f40 0x7f319c16ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a0cf2700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f319c0c76b0 0x7f319c0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 -- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f319c0c76b0 msgr2=0x7f319c0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f319c0c76b0 0x7f319c0c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 -- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f319c155f40 msgr2=0x7f319c16ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f319c155f40 0x7f319c16ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.333+0000 7f31a14f3700 1 -- 172.21.15.79:0/3794069345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319000b6d0 con 0x7f319c069a30 2023-10-14T18:45:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31a14f3700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f318c00cca0 tx=0x7f318c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00a8d0 con 0x7f319c069a30 2023-10-14T18:45:34.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c00aa30 con 0x7f319c069a30 2023-10-14T18:45:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c00adb0 con 0x7f319c069a30 2023-10-14T18:45:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c16e670 con 0x7f319c069a30 2023-10-14T18:45:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.334+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c0c8510 con 0x7f319c069a30 2023-10-14T18:45:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.335+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c06c790 con 0x7f319c069a30 2023-10-14T18:45:34.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.335+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f318c007300 con 0x7f319c069a30 2023-10-14T18:45:34.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.335+0000 7f31997fa700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 0x7f31880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:34.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.336+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f318c0847d0 con 0x7f319c069a30 2023-10-14T18:45:34.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.336+0000 7f31a0cf2700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 0x7f31880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:34.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.336+0000 7f31a0cf2700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 0x7f31880693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f319c069e30 tx=0x7f319001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:34.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.340+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f318c051ac0 con 0x7f319c069a30 2023-10-14T18:45:34.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.568+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f319c0aa520 con 0x7f319c069a30 2023-10-14T18:45:34.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.568+0000 7f31997fa700 1 -- 172.21.15.79:0/3794069345 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f318c0550e0 con 0x7f319c069a30 2023-10-14T18:45:34.569 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:45:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 msgr2=0x7f31880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 0x7f31880693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f319c069e30 tx=0x7f319001b000 comp rx=0 tx=0).stop 2023-10-14T18:45:34.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 msgr2=0x7f319c154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:34.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f318c00cca0 tx=0x7f318c001a30 comp rx=0 tx=0).stop 2023-10-14T18:45:34.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 shutdown_connections 2023-10-14T18:45:34.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3188066f30 0x7f31880693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f319c155f40 0x7f319c16ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f319c069a30 0x7f319c154970 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 --2- 172.21.15.79:0/3794069345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f319c0c76b0 0x7f319c0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 >> 172.21.15.79:0/3794069345 conn(0x7f319c0cd070 msgr2=0x7f319c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 shutdown_connections 2023-10-14T18:45:34.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:34.570+0000 7f31a24f5700 1 -- 172.21.15.79:0/3794069345 wait complete. 2023-10-14T18:45:34.583 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T18:45:34.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:45:34.583 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:45:34.584 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T18:45:34.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T18:45:34.584 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T18:45:34.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T18:45:34.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:45:34.585 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T18:45:34.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.585 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:45:34.601 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:34.601 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:34.602 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:34.602 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.602 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:34.602 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.603 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:34.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:34.603 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:45:34.603 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:34.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:34.604 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:45:34.604 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:45:34.604 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:34.604 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:45:34.604 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:34.605 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:45:34.605 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-10-14T18:45:34.605 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:45:34.605 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.605 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:34.606 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:45:34.606 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:45:34.606 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.606 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link tentative 2023-10-14T18:45:34.607 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.607 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:45:34.607 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:45:34.607 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link tentative 2023-10-14T18:45:34.607 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:34.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.608 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:45:34.665 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:45:34.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.667 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:45:34.723 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:45:34.723 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:45:34.723 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:45:34.723 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:45:34.724 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:45:34.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.724 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:34.725 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:34.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:45:34.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:45:34.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:45:34.726 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:34.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.823 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:45:34.837 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:45:34.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.838 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2023-10-14T18:45:34.892 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T18:45:34.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.893 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:34.893 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:34.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:45:34.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T18:45:34.894 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:34.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:34.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T18:45:35.019 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:35.020 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:35.020 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:35.020 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.020 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:35.021 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.021 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:45:35.021 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:0b:84:63:6f:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T18:45:35.021 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T18:45:35.022 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.022 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f00b:84ff:fe63:6fa2/64 scope link tentative 2023-10-14T18:45:35.022 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:35.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T18:45:35.111 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:45:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:45:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:45:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:45:35.112 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.113 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:45:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether f2:0b:84:63:6f:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T18:45:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T18:45:35.113 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::f00b:84ff:fe63:6fa2/64 scope link tentative 2023-10-14T18:45:35.114 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:45:35.120 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T18:45:35.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:35.121 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:35.121 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:35.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T18:45:35.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T18:45:35.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T18:45:35.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T18:45:35.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T18:45:35.123 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:35.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:35.346 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:45:35.346 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:45:35.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2023-10-14T18:45:35.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T18:45:35.347 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:45:35.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:35.427 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T18:45:35.442 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T18:45:35.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:45:35.442 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T18:45:35.495 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:45:35.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:45:35.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T18:45:35.575 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T18:45:35.575 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T18:45:35.575 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:35.584 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T18:45:35.585 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T18:45:35.585 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:35.585 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:35.585 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:35.606 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-14T18:45:35.606 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-14T18:45:35.606 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:45:35.606 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:45:35.607 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:45:35.607 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:45:35.607 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:45:35.607 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:45:35.608 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:45:35.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:35.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T18:45:35.673 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T18:45:35.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:35.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.807+0000 7f41ef41f700 1 Processor -- start 2023-10-14T18:45:35.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.807+0000 7f41ef41f700 1 -- start start 2023-10-14T18:45:35.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ef41f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41e8157870 0x7f41e815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ef41f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ef41f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e815cbb0 con 0x7f41e815d580 2023-10-14T18:45:35.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ef41f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e815bfa0 con 0x7f41e8157870 2023-10-14T18:45:35.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ef41f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e815c280 con 0x7f41e815a620 2023-10-14T18:45:35.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ed1bb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f41e8157870 0x7f41e815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ed9bc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41e815d580 0x7f41e8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52326/0 (socket says 172.21.15.79:52326) 2023-10-14T18:45:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ed9bc700 1 -- 172.21.15.79:0/3613748108 learned_addr learned my addr 172.21.15.79:0/3613748108 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.808+0000 7f41ec9ba700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ed1bb700 1 -- 172.21.15.79:0/3613748108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 msgr2=0x7f41e815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ed1bb700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ed1bb700 1 -- 172.21.15.79:0/3613748108 >> v1:172.21.15.79:6789/0 conn(0x7f41e815d580 legacy=0x7f41e8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:35.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41dffff700 1 -- 172.21.15.79:0/3613748108 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728491320 0 0) 0x7f41e815cbb0 con 0x7f41e815d580 2023-10-14T18:45:35.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ed1bb700 1 -- 172.21.15.79:0/3613748108 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e815c560 con 0x7f41e8157870 2023-10-14T18:45:35.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ed1bb700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e8157870 0x7f41e815b6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009e60 tx=0x7f41e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23539c82ff42ee67 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:35.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41dffff700 1 -- 172.21.15.79:0/3613748108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400e070 con 0x7f41e8157870 2023-10-14T18:45:35.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41dffff700 1 -- 172.21.15.79:0/3613748108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400bb60 con 0x7f41e8157870 2023-10-14T18:45:35.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41dffff700 1 -- 172.21.15.79:0/3613748108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4012430 con 0x7f41e8157870 2023-10-14T18:45:35.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 -- 172.21.15.79:0/3613748108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e8157870 msgr2=0x7f41e815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:35.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e8157870 0x7f41e815b6a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009e60 tx=0x7f41e4009780 comp rx=0 tx=0).stop 2023-10-14T18:45:35.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 -- 172.21.15.79:0/3613748108 shutdown_connections 2023-10-14T18:45:35.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e8157870 0x7f41e815b6a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:35.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 --2- 172.21.15.79:0/3613748108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:35.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.809+0000 7f41ef41f700 1 -- 172.21.15.79:0/3613748108 >> 172.21.15.79:0/3613748108 conn(0x7f41e8068ce0 msgr2=0x7f41e80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:35.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.810+0000 7f41ef41f700 1 -- 172.21.15.79:0/3613748108 shutdown_connections 2023-10-14T18:45:35.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.810+0000 7f41ef41f700 1 -- 172.21.15.79:0/3613748108 wait complete. 2023-10-14T18:45:35.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 Processor -- start 2023-10-14T18:45:35.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 -- start start 2023-10-14T18:45:35.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8157870 0x7f41e80b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e8151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8152d40 con 0x7f41e815d580 2023-10-14T18:45:35.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8151eb0 con 0x7f41e8157870 2023-10-14T18:45:35.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.811+0000 7f41ef41f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81531d0 con 0x7f41e815a620 2023-10-14T18:45:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60168/0 (socket says 172.21.15.79:60168) 2023-10-14T18:45:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 -- 172.21.15.79:0/2550769228 learned_addr learned my addr 172.21.15.79:0/2550769228 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ec9ba700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed1bb700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8157870 0x7f41e80b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 -- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 msgr2=0x7f41e8151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e8151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 -- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8157870 msgr2=0x7f41e80b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8157870 0x7f41e80b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 -- 172.21.15.79:0/2550769228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009a20 con 0x7f41e815d580 2023-10-14T18:45:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ed9bc700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c530 tx=0x7f41e0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000cea0 con 0x7f41e815d580 2023-10-14T18:45:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0005b30 con 0x7f41e815d580 2023-10-14T18:45:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e8152130 con 0x7f41e815d580 2023-10-14T18:45:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e00070d0 con 0x7f41e815d580 2023-10-14T18:45:35.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.812+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e81526f0 con 0x7f41e815d580 2023-10-14T18:45:35.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.813+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8152ef0 con 0x7f41e815d580 2023-10-14T18:45:35.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.814+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41e0007500 con 0x7f41e815d580 2023-10-14T18:45:35.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.814+0000 7f41dd7fa700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:35.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.814+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41e0083890 con 0x7f41e815d580 2023-10-14T18:45:35.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.814+0000 7f41ed1bb700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:35.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.815+0000 7f41ed1bb700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 0x7f41cc0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41e40097c0 tx=0x7f41e4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:35.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:35.818+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41e8152ef0 con 0x7f41e815d580 2023-10-14T18:45:36.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.004+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41e8152ef0 con 0x7f41e815d580 2023-10-14T18:45:36.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.005+0000 7f41dd7fa700 1 -- 172.21.15.79:0/2550769228 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f41e8152ef0 con 0x7f41e815d580 2023-10-14T18:45:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:36.006 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 msgr2=0x7f41cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 0x7f41cc0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41e40097c0 tx=0x7f41e4019000 comp rx=0 tx=0).stop 2023-10-14T18:45:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 msgr2=0x7f41e814c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f41e000c530 tx=0x7f41e0007f60 comp rx=0 tx=0).stop 2023-10-14T18:45:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 shutdown_connections 2023-10-14T18:45:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f41cc066f30 0x7f41cc0693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41e815d580 0x7f41e814c850 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8157870 0x7f41e80b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 --2- 172.21.15.79:0/2550769228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e815a620 0x7f41e8151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 >> 172.21.15.79:0/2550769228 conn(0x7f41e8068ce0 msgr2=0x7f41e815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 shutdown_connections 2023-10-14T18:45:36.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.007+0000 7f41ef41f700 1 -- 172.21.15.79:0/2550769228 wait complete. 2023-10-14T18:45:36.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:36.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:36.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.135+0000 7f287e4ff700 1 Processor -- start 2023-10-14T18:45:36.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.136+0000 7f287e4ff700 1 -- start start 2023-10-14T18:45:36.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.136+0000 7f287e4ff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28780c9320 0x7f287815e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.136+0000 7f287e4ff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780ccde0 con 0x7f287815f3b0 2023-10-14T18:45:36.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.136+0000 7f287e4ff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780cc7d0 con 0x7f287815e0a0 2023-10-14T18:45:36.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f287e4ff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28780cd980 con 0x7f28780c9320 2023-10-14T18:45:36.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28780c9320 0x7f287815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f28780c9320 0x7f287815e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60178/0 (socket says 172.21.15.79:60178) 2023-10-14T18:45:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f287ca9c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f287815f3b0 0x7f2878067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52328/0 (socket says 172.21.15.79:52328) 2023-10-14T18:45:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 -- 172.21.15.79:0/2567622687 learned_addr learned my addr 172.21.15.79:0/2567622687 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 -- 172.21.15.79:0/2567622687 >> v1:172.21.15.144:6789/0 conn(0x7f287815e0a0 legacy=0x7f28780cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 -- 172.21.15.79:0/2567622687 >> v1:172.21.15.79:6789/0 conn(0x7f287815f3b0 legacy=0x7f2878067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 -- 172.21.15.79:0/2567622687 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780ce320 con 0x7f28780c9320 2023-10-14T18:45:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f2876ffd700 1 -- 172.21.15.79:0/2567622687 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249685811 0 0) 0x7f28780ccde0 con 0x7f287815f3b0 2023-10-14T18:45:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f28777fe700 1 --2- 172.21.15.79:0/2567622687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28780c9320 0x7f287815e470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28680099b0 tx=0x7f2868009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3cb7da19a4638b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f2876ffd700 1 -- 172.21.15.79:0/2567622687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800b820 con 0x7f28780c9320 2023-10-14T18:45:36.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f2876ffd700 1 -- 172.21.15.79:0/2567622687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800b980 con 0x7f28780c9320 2023-10-14T18:45:36.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.137+0000 7f2876ffd700 1 -- 172.21.15.79:0/2567622687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800bd20 con 0x7f28780c9320 2023-10-14T18:45:36.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 -- 172.21.15.79:0/2567622687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28780c9320 msgr2=0x7f287815e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 --2- 172.21.15.79:0/2567622687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28780c9320 0x7f287815e470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28680099b0 tx=0x7f2868009250 comp rx=0 tx=0).stop 2023-10-14T18:45:36.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 -- 172.21.15.79:0/2567622687 shutdown_connections 2023-10-14T18:45:36.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 --2- 172.21.15.79:0/2567622687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28780c9320 0x7f287815e470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 -- 172.21.15.79:0/2567622687 >> 172.21.15.79:0/2567622687 conn(0x7f2878069870 msgr2=0x7f2878069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 -- 172.21.15.79:0/2567622687 shutdown_connections 2023-10-14T18:45:36.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.138+0000 7f287e4ff700 1 -- 172.21.15.79:0/2567622687 wait complete. 2023-10-14T18:45:36.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.139+0000 7f287e4ff700 1 Processor -- start 2023-10-14T18:45:36.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.139+0000 7f287e4ff700 1 -- start start 2023-10-14T18:45:36.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28780c9320 0x7f2878159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f287815e0a0 0x7f287816e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287815fe40 con 0x7f287815f3b0 2023-10-14T18:45:36.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28780c5430 con 0x7f28780c9320 2023-10-14T18:45:36.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287816f530 con 0x7f287815e0a0 2023-10-14T18:45:36.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60192/0 (socket says 172.21.15.79:60192) 2023-10-14T18:45:36.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 -- 172.21.15.79:0/3427870953 learned_addr learned my addr 172.21.15.79:0/3427870953 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f28777fe700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f287815e0a0 0x7f287816e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f2877fff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28780c9320 0x7f2878159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 -- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f287815e0a0 msgr2=0x7f287816e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f287815e0a0 0x7f287816e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 -- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28780c9320 msgr2=0x7f2878159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28780c9320 0x7f2878159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 -- 172.21.15.79:0/3427870953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680094f0 con 0x7f287815f3b0 2023-10-14T18:45:36.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287ca9c700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f287000ccf0 tx=0x7f2870001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870005df0 con 0x7f287815f3b0 2023-10-14T18:45:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000a5f0 con 0x7f287815f3b0 2023-10-14T18:45:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.140+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287816ec90 con 0x7f287815f3b0 2023-10-14T18:45:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.141+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000a9b0 con 0x7f287815f3b0 2023-10-14T18:45:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.141+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287816f250 con 0x7f287815f3b0 2023-10-14T18:45:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.142+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287815ffb0 con 0x7f287815f3b0 2023-10-14T18:45:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.142+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28700070f0 con 0x7f287815f3b0 2023-10-14T18:45:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.142+0000 7f285ffff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.142+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2870084590 con 0x7f287815f3b0 2023-10-14T18:45:36.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.142+0000 7f2877fff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.143+0000 7f2877fff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f286c003a30 tx=0x7f286c007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.146+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28700518b0 con 0x7f287815f3b0 2023-10-14T18:45:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.327+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f287804c3c0 con 0x7f287815f3b0 2023-10-14T18:45:36.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.328+0000 7f285ffff700 1 -- 172.21.15.79:0/3427870953 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2870054ed0 con 0x7f287815f3b0 2023-10-14T18:45:36.329 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 msgr2=0x7f28640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f286c003a30 tx=0x7f286c007ea0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 msgr2=0x7f287814cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f287000ccf0 tx=0x7f2870001a70 comp rx=0 tx=0).stop 2023-10-14T18:45:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 shutdown_connections 2023-10-14T18:45:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f287815f3b0 0x7f287814cd90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28780c9320 0x7f2878159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 --2- 172.21.15.79:0/3427870953 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f287815e0a0 0x7f287816e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.329+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 >> 172.21.15.79:0/3427870953 conn(0x7f2878069870 msgr2=0x7f28780c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.330+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 shutdown_connections 2023-10-14T18:45:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.330+0000 7f287e4ff700 1 -- 172.21.15.79:0/3427870953 wait complete. 2023-10-14T18:45:36.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:36.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.458+0000 7f9cbd726700 1 Processor -- start 2023-10-14T18:45:36.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 -- start start 2023-10-14T18:45:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9cb806aae0 0x7f9cb80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80b0790 con 0x7f9cb8159ec0 2023-10-14T18:45:36.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb806af60 con 0x7f9cb806aae0 2023-10-14T18:45:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.459+0000 7f9cbd726700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80ce1f0 con 0x7f9cb815a290 2023-10-14T18:45:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb77fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9cb806aae0 0x7f9cb80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:54876/0 (socket says 172.21.15.79:54876) 2023-10-14T18:45:36.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb6ffd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9cb8159ec0 0x7f9cb80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:53958/0 (socket says 172.21.15.79:53958) 2023-10-14T18:45:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 -- 172.21.15.79:0/2000986189 learned_addr learned my addr 172.21.15.79:0/2000986189 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 -- 172.21.15.79:0/2000986189 >> v2:172.21.15.144:3300/0 conn(0x7f9cb806aae0 msgr2=0x7f9cb80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 --2- 172.21.15.79:0/2000986189 >> v2:172.21.15.144:3300/0 conn(0x7f9cb806aae0 0x7f9cb80cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 -- 172.21.15.79:0/2000986189 >> v1:172.21.15.144:6789/0 conn(0x7f9cb8159ec0 legacy=0x7f9cb80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 -- 172.21.15.79:0/2000986189 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80b0b20 con 0x7f9cb815a290 2023-10-14T18:45:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb67fc700 1 --2- 172.21.15.79:0/2000986189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00099b0 tx=0x7f9ca0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e27dbe97d0e458c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb5ffb700 1 -- 172.21.15.79:0/2000986189 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0009ea0 con 0x7f9cb815a290 2023-10-14T18:45:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.460+0000 7f9cb5ffb700 1 -- 172.21.15.79:0/2000986189 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca000b860 con 0x7f9cb815a290 2023-10-14T18:45:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cb5ffb700 1 -- 172.21.15.79:0/2000986189 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000bc00 con 0x7f9cb815a290 2023-10-14T18:45:36.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 -- 172.21.15.79:0/2000986189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 msgr2=0x7f9cb806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 --2- 172.21.15.79:0/2000986189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00099b0 tx=0x7f9ca0009250 comp rx=0 tx=0).stop 2023-10-14T18:45:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 -- 172.21.15.79:0/2000986189 shutdown_connections 2023-10-14T18:45:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 --2- 172.21.15.79:0/2000986189 >> v2:172.21.15.144:3300/0 conn(0x7f9cb806aae0 0x7f9cb80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 --2- 172.21.15.79:0/2000986189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb806a5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 -- 172.21.15.79:0/2000986189 >> 172.21.15.79:0/2000986189 conn(0x7f9cb80d1880 msgr2=0x7f9cb80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 -- 172.21.15.79:0/2000986189 shutdown_connections 2023-10-14T18:45:36.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.461+0000 7f9cbd726700 1 -- 172.21.15.79:0/2000986189 wait complete. 2023-10-14T18:45:36.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.462+0000 7f9cbd726700 1 Processor -- start 2023-10-14T18:45:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.462+0000 7f9cbd726700 1 -- start start 2023-10-14T18:45:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb806aae0 0x7f9cb80cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80c8640 con 0x7f9cb8159ec0 2023-10-14T18:45:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b4ab0 con 0x7f9cb806aae0 2023-10-14T18:45:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cbd726700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b4620 con 0x7f9cb815a290 2023-10-14T18:45:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60202/0 (socket says 172.21.15.79:60202) 2023-10-14T18:45:36.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb806aae0 0x7f9cb80cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 -- 172.21.15.79:0/1531320815 learned_addr learned my addr 172.21.15.79:0/1531320815 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 -- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 msgr2=0x7f9cb80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb80aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 -- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb806aae0 msgr2=0x7f9cb80cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb806aae0 0x7f9cb80cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb67fc700 1 -- 172.21.15.79:0/1531320815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00094f0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.463+0000 7f9cb77fe700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb80aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9cb67fc700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006fd0 tx=0x7f9ca0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0000d10 con 0x7f9cb8159ec0 2023-10-14T18:45:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca000bbe0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb80c83a0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011690 con 0x7f9cb8159ec0 2023-10-14T18:45:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.464+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb80b3fd0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.465+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb804c3c0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.465+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ca0011a00 con 0x7f9cb8159ec0 2023-10-14T18:45:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.466+0000 7f9caeffd700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.466+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ca0085b70 con 0x7f9cb8159ec0 2023-10-14T18:45:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.466+0000 7f9cb6ffd700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.466+0000 7f9cb6ffd700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80020c0 tx=0x7f9ca8001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.470+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca0052de0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.652+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cb80b4760 con 0x7f9cb8159ec0 2023-10-14T18:45:36.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.652+0000 7f9caeffd700 1 -- 172.21.15.79:0/1531320815 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ca0011cb0 con 0x7f9cb8159ec0 2023-10-14T18:45:36.653 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:36.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.654+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 msgr2=0x7f9c980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.654+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 0x7f9c980693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80020c0 tx=0x7f9ca8001ad0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.654+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 msgr2=0x7f9cb80c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.654+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0006fd0 tx=0x7f9ca0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:36.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 shutdown_connections 2023-10-14T18:45:36.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9c98066f30 0x7f9c980693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9cb815a290 0x7f9cb80aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb806aae0 0x7f9cb80cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 --2- 172.21.15.79:0/1531320815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cb8159ec0 0x7f9cb80c7e60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 >> 172.21.15.79:0/1531320815 conn(0x7f9cb80d1880 msgr2=0x7f9cb80b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 shutdown_connections 2023-10-14T18:45:36.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.655+0000 7f9cbd726700 1 -- 172.21.15.79:0/1531320815 wait complete. 2023-10-14T18:45:36.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.783+0000 7f6e46e3c700 1 Processor -- start 2023-10-14T18:45:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.783+0000 7f6e46e3c700 1 -- start start 2023-10-14T18:45:36.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e40159ec0 0x7f6e400af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e4015a290 0x7f6e400afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4006a5a0 0x7f6e4006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4006af60 con 0x7f6e4015a290 2023-10-14T18:45:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e400b0790 con 0x7f6e40159ec0 2023-10-14T18:45:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e46e3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400ce1f0 con 0x7f6e4006a5a0 2023-10-14T18:45:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e4015a290 0x7f6e400afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6e4015a290 0x7f6e400afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60214/0 (socket says 172.21.15.79:60214) 2023-10-14T18:45:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 -- 172.21.15.79:0/3512107863 learned_addr learned my addr 172.21.15.79:0/3512107863 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e453d9700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4006a5a0 0x7f6e4006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e44bd8700 1 --2- 172.21.15.79:0/3512107863 >> v2:172.21.15.144:3300/0 conn(0x7f6e40159ec0 0x7f6e400af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 -- 172.21.15.79:0/3512107863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4006a5a0 msgr2=0x7f6e4006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4006a5a0 0x7f6e4006aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 -- 172.21.15.79:0/3512107863 >> v2:172.21.15.144:3300/0 conn(0x7f6e40159ec0 msgr2=0x7f6e400af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.784+0000 7f6e37fff700 1 --2- 172.21.15.79:0/3512107863 >> v2:172.21.15.144:3300/0 conn(0x7f6e40159ec0 0x7f6e400af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e37fff700 1 -- 172.21.15.79:0/3512107863 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e400b0b20 con 0x7f6e4015a290 2023-10-14T18:45:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e37fff700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4015a290 0x7f6e400afe80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e400898e0 tx=0x7f6e30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f02afb516e8d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e377fe700 1 -- 172.21.15.79:0/3512107863 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000b860 con 0x7f6e4015a290 2023-10-14T18:45:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e377fe700 1 -- 172.21.15.79:0/3512107863 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000b9c0 con 0x7f6e4015a290 2023-10-14T18:45:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e377fe700 1 -- 172.21.15.79:0/3512107863 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000bd60 con 0x7f6e4015a290 2023-10-14T18:45:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 -- 172.21.15.79:0/3512107863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4015a290 msgr2=0x7f6e400afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4015a290 0x7f6e400afe80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e400898e0 tx=0x7f6e30009250 comp rx=0 tx=0).stop 2023-10-14T18:45:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 -- 172.21.15.79:0/3512107863 shutdown_connections 2023-10-14T18:45:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4006a5a0 0x7f6e4006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/3512107863 >> v2:172.21.15.144:3300/0 conn(0x7f6e40159ec0 0x7f6e400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/3512107863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e4015a290 0x7f6e400afe80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.785+0000 7f6e46e3c700 1 -- 172.21.15.79:0/3512107863 >> 172.21.15.79:0/3512107863 conn(0x7f6e400d1880 msgr2=0x7f6e400cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.786+0000 7f6e46e3c700 1 -- 172.21.15.79:0/3512107863 shutdown_connections 2023-10-14T18:45:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.786+0000 7f6e46e3c700 1 -- 172.21.15.79:0/3512107863 wait complete. 2023-10-14T18:45:36.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 Processor -- start 2023-10-14T18:45:36.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 -- start start 2023-10-14T18:45:36.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4006a5a0 0x7f6e4015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4015a290 0x7f6e4016d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.787+0000 7f6e46e3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e400b6a70 con 0x7f6e40159ec0 2023-10-14T18:45:36.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e46e3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4015e8d0 con 0x7f6e4006a5a0 2023-10-14T18:45:36.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e46e3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4015dcc0 con 0x7f6e4015a290 2023-10-14T18:45:36.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60224/0 (socket says 172.21.15.79:60224) 2023-10-14T18:45:36.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 -- 172.21.15.79:0/141230507 learned_addr learned my addr 172.21.15.79:0/141230507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:36.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e44bd8700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4006a5a0 0x7f6e4015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e453d9700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4015a290 0x7f6e4016d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 -- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4015a290 msgr2=0x7f6e4016d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4015a290 0x7f6e4016d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 -- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4006a5a0 msgr2=0x7f6e4015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4006a5a0 0x7f6e4015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 -- 172.21.15.79:0/141230507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300094f0 con 0x7f6e40159ec0 2023-10-14T18:45:36.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e37fff700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e40071eb0 tx=0x7f6e30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30011e40 con 0x7f6e40159ec0 2023-10-14T18:45:36.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3001a450 con 0x7f6e40159ec0 2023-10-14T18:45:36.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4015dfa0 con 0x7f6e40159ec0 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3001a810 con 0x7f6e40159ec0 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.788+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4015e560 con 0x7f6e40159ec0 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.789+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4004c3c0 con 0x7f6e40159ec0 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.790+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e3001abc0 con 0x7f6e40159ec0 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.790+0000 7f6e34ff9700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:36.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.790+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e30086030 con 0x7f6e40159ec0 2023-10-14T18:45:36.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.790+0000 7f6e44bd8700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:36.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.790+0000 7f6e44bd8700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 0x7f6e2c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009fd0 tx=0x7f6e3c009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:36.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.794+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e300532a0 con 0x7f6e40159ec0 2023-10-14T18:45:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.975+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e4015ea10 con 0x7f6e40159ec0 2023-10-14T18:45:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.976+0000 7f6e34ff9700 1 -- 172.21.15.79:0/141230507 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e300568c0 con 0x7f6e40159ec0 2023-10-14T18:45:36.977 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:36.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 msgr2=0x7f6e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 0x7f6e2c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009fd0 tx=0x7f6e3c009880 comp rx=0 tx=0).stop 2023-10-14T18:45:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 msgr2=0x7f6e4015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e40071eb0 tx=0x7f6e30017000 comp rx=0 tx=0).stop 2023-10-14T18:45:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 shutdown_connections 2023-10-14T18:45:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e2c066f30 0x7f6e2c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e4015a290 0x7f6e4016d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e4006a5a0 0x7f6e4015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 --2- 172.21.15.79:0/141230507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e40159ec0 0x7f6e4015cec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 >> 172.21.15.79:0/141230507 conn(0x7f6e400d1880 msgr2=0x7f6e400cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 shutdown_connections 2023-10-14T18:45:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:36.978+0000 7f6e46e3c700 1 -- 172.21.15.79:0/141230507 wait complete. 2023-10-14T18:45:36.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:37.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.104+0000 7f0fe1675700 1 Processor -- start 2023-10-14T18:45:37.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.104+0000 7f0fe1675700 1 -- start start 2023-10-14T18:45:37.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fe1675700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fe1675700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 0x7f0fdc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fe1675700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc15db80 con 0x7f0fdc0b1610 2023-10-14T18:45:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fe1675700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc15e800 con 0x7f0fdc15a1e0 2023-10-14T18:45:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fe1675700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc15de60 con 0x7f0fdc159e10 2023-10-14T18:45:37.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fda7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 0x7f0fdc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fdaffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:54912/0 (socket says 172.21.15.79:54912) 2023-10-14T18:45:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fda7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 0x7f0fdc0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:34922/0 (socket says 172.21.15.79:34922) 2023-10-14T18:45:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fdaffd700 1 -- 172.21.15.79:0/794149779 learned_addr learned my addr 172.21.15.79:0/794149779 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.105+0000 7f0fdb7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0fdc0b1610 0x7f0fdc0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:53972/0 (socket says 172.21.15.79:53972) 2023-10-14T18:45:37.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fdaffd700 1 -- 172.21.15.79:0/794149779 >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 msgr2=0x7f0fdc0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:37.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/794149779 >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 0x7f0fdc0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fdaffd700 1 -- 172.21.15.79:0/794149779 >> v1:172.21.15.144:6789/0 conn(0x7f0fdc0b1610 legacy=0x7f0fdc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fdaffd700 1 -- 172.21.15.79:0/794149779 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc15e140 con 0x7f0fdc159e10 2023-10-14T18:45:37.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/794149779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0099b0 tx=0x7f0fcc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6086b934d7b911ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fd9ffb700 1 -- 172.21.15.79:0/794149779 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc009ea0 con 0x7f0fdc159e10 2023-10-14T18:45:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fd9ffb700 1 -- 172.21.15.79:0/794149779 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc00b860 con 0x7f0fdc159e10 2023-10-14T18:45:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.106+0000 7f0fd9ffb700 1 -- 172.21.15.79:0/794149779 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00bc00 con 0x7f0fdc159e10 2023-10-14T18:45:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 -- 172.21.15.79:0/794149779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 msgr2=0x7f0fdc0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 --2- 172.21.15.79:0/794149779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0099b0 tx=0x7f0fcc009250 comp rx=0 tx=0).stop 2023-10-14T18:45:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 -- 172.21.15.79:0/794149779 shutdown_connections 2023-10-14T18:45:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 --2- 172.21.15.79:0/794149779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc159e10 0x7f0fdc0b2d20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 --2- 172.21.15.79:0/794149779 >> v2:172.21.15.144:3300/0 conn(0x7f0fdc15a1e0 0x7f0fdc0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 -- 172.21.15.79:0/794149779 >> 172.21.15.79:0/794149779 conn(0x7f0fdc067660 msgr2=0x7f0fdc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 -- 172.21.15.79:0/794149779 shutdown_connections 2023-10-14T18:45:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.107+0000 7f0fe1675700 1 -- 172.21.15.79:0/794149779 wait complete. 2023-10-14T18:45:37.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.108+0000 7f0fe1675700 1 Processor -- start 2023-10-14T18:45:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.108+0000 7f0fe1675700 1 -- start start 2023-10-14T18:45:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 0x7f0fdc156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc15a1e0 0x7f0fdc15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0d11c0 con 0x7f0fdc159e10 2023-10-14T18:45:37.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc1573f0 con 0x7f0fdc0b1610 2023-10-14T18:45:37.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0d1650 con 0x7f0fdc15a1e0 2023-10-14T18:45:37.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60226/0 (socket says 172.21.15.79:60226) 2023-10-14T18:45:37.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 -- 172.21.15.79:0/260272421 learned_addr learned my addr 172.21.15.79:0/260272421 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 0x7f0fdc156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fdb7fe700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc15a1e0 0x7f0fdc15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 -- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc15a1e0 msgr2=0x7f0fdc15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc15a1e0 0x7f0fdc15ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 -- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 msgr2=0x7f0fdc156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 0x7f0fdc156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 -- 172.21.15.79:0/260272421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0094f0 con 0x7f0fdc159e10 2023-10-14T18:45:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 0x7f0fdc156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fda7fc700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e960 tx=0x7f0fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000c850 con 0x7f0fdc159e10 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd000c9b0 con 0x7f0fdc159e10 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc156ea0 con 0x7f0fdc159e10 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000cd50 con 0x7f0fdc159e10 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.109+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc0d0890 con 0x7f0fdc159e10 2023-10-14T18:45:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.110+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0d1370 con 0x7f0fdc159e10 2023-10-14T18:45:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.111+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fd0013680 con 0x7f0fdc159e10 2023-10-14T18:45:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.111+0000 7f0fc2ffd700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 0x7f0fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.111+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fd0084760 con 0x7f0fdc159e10 2023-10-14T18:45:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.111+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 0x7f0fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.112+0000 7f0fdaffd700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 0x7f0fc80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0099b0 tx=0x7f0fcc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.115+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fdc0d1370 con 0x7f0fdc159e10 2023-10-14T18:45:37.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.298+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fdc0d1370 con 0x7f0fdc159e10 2023-10-14T18:45:37.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.299+0000 7f0fc2ffd700 1 -- 172.21.15.79:0/260272421 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0fdc0d1370 con 0x7f0fdc159e10 2023-10-14T18:45:37.301 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:37.301 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 msgr2=0x7f0fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 0x7f0fc80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0099b0 tx=0x7f0fcc017000 comp rx=0 tx=0).stop 2023-10-14T18:45:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 msgr2=0x7f0fdc15c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e960 tx=0x7f0fd00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 shutdown_connections 2023-10-14T18:45:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0fc8066f30 0x7f0fc80693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fdc15a1e0 0x7f0fdc15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fdc0b1610 0x7f0fdc156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 --2- 172.21.15.79:0/260272421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fdc159e10 0x7f0fdc15c500 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 >> 172.21.15.79:0/260272421 conn(0x7f0fdc067660 msgr2=0x7f0fdc0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 shutdown_connections 2023-10-14T18:45:37.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.301+0000 7f0fe1675700 1 -- 172.21.15.79:0/260272421 wait complete. 2023-10-14T18:45:37.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:37.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.433+0000 7fc02441c700 1 Processor -- start 2023-10-14T18:45:37.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.433+0000 7fc02441c700 1 -- start start 2023-10-14T18:45:37.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc02441c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc02441c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc01c0d1470 0x7fc01c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc02441c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c1513f0 con 0x7fc01c0b6760 2023-10-14T18:45:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc02441c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c15e7a0 con 0x7fc01c0d1470 2023-10-14T18:45:37.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc02441c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15db20 con 0x7fc01c0cd300 2023-10-14T18:45:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc0221b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.434+0000 7fc0219b7700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc01c0b6760 0x7fc01c0d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:53978/0 (socket says 172.21.15.79:53978) 2023-10-14T18:45:37.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:54926/0 (socket says 172.21.15.79:54926) 2023-10-14T18:45:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0219b7700 1 -- 172.21.15.79:0/1922108788 learned_addr learned my addr 172.21.15.79:0/1922108788 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0229b9700 1 --2- 172.21.15.79:0/1922108788 >> v2:172.21.15.144:3300/0 conn(0x7fc01c0d1470 0x7fc01c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 -- 172.21.15.79:0/1922108788 >> v2:172.21.15.144:3300/0 conn(0x7fc01c0d1470 msgr2=0x7fc01c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 --2- 172.21.15.79:0/1922108788 >> v2:172.21.15.144:3300/0 conn(0x7fc01c0d1470 0x7fc01c0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 -- 172.21.15.79:0/1922108788 >> v1:172.21.15.144:6789/0 conn(0x7fc01c0b6760 legacy=0x7fc01c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 -- 172.21.15.79:0/1922108788 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c15de00 con 0x7fc01c0cd300 2023-10-14T18:45:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0221b8700 1 --2- 172.21.15.79:0/1922108788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e60 tx=0x7fc018009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=342d06cd1f7f9713 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0211b6700 1 -- 172.21.15.79:0/1922108788 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800e070 con 0x7fc01c0cd300 2023-10-14T18:45:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0211b6700 1 -- 172.21.15.79:0/1922108788 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800bb60 con 0x7fc01c0cd300 2023-10-14T18:45:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.435+0000 7fc0211b6700 1 -- 172.21.15.79:0/1922108788 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018012430 con 0x7fc01c0cd300 2023-10-14T18:45:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 -- 172.21.15.79:0/1922108788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 msgr2=0x7fc01c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 --2- 172.21.15.79:0/1922108788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e60 tx=0x7fc018009780 comp rx=0 tx=0).stop 2023-10-14T18:45:37.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 -- 172.21.15.79:0/1922108788 shutdown_connections 2023-10-14T18:45:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 --2- 172.21.15.79:0/1922108788 >> v2:172.21.15.144:3300/0 conn(0x7fc01c0d1470 0x7fc01c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 --2- 172.21.15.79:0/1922108788 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0cd300 0x7fc01c15afb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 -- 172.21.15.79:0/1922108788 >> 172.21.15.79:0/1922108788 conn(0x7fc01c068d90 msgr2=0x7fc01c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 -- 172.21.15.79:0/1922108788 shutdown_connections 2023-10-14T18:45:37.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.436+0000 7fc02441c700 1 -- 172.21.15.79:0/1922108788 wait complete. 2023-10-14T18:45:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.437+0000 7fc02441c700 1 Processor -- start 2023-10-14T18:45:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.437+0000 7fc02441c700 1 -- start start 2023-10-14T18:45:37.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc01c0cd300 0x7fc01c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0d1470 0x7fc01c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c14f230 con 0x7fc01c0b6760 2023-10-14T18:45:37.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c8f00 con 0x7fc01c0cd300 2023-10-14T18:45:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc02441c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c75d0 con 0x7fc01c0d1470 2023-10-14T18:45:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60232/0 (socket says 172.21.15.79:60232) 2023-10-14T18:45:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 -- 172.21.15.79:0/1700397780 learned_addr learned my addr 172.21.15.79:0/1700397780 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:37.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0219b7700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc01c0cd300 0x7fc01c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0229b9700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0d1470 0x7fc01c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 -- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0d1470 msgr2=0x7fc01c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0d1470 0x7fc01c0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 -- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc01c0cd300 msgr2=0x7fc01c0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc01c0cd300 0x7fc01c0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 -- 172.21.15.79:0/1700397780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc018009a20 con 0x7fc01c0b6760 2023-10-14T18:45:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0221b8700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0180097c0 tx=0x7fc018019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.438+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018012c40 con 0x7fc01c0b6760 2023-10-14T18:45:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.439+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018012dc0 con 0x7fc01c0b6760 2023-10-14T18:45:37.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.439+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0c66e0 con 0x7fc01c0b6760 2023-10-14T18:45:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.439+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0180276c0 con 0x7fc01c0b6760 2023-10-14T18:45:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.439+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0c9150 con 0x7fc01c0b6760 2023-10-14T18:45:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.440+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c04c3c0 con 0x7fc01c0b6760 2023-10-14T18:45:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.440+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc018024070 con 0x7fc01c0b6760 2023-10-14T18:45:37.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.440+0000 7fc0127fc700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.440+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0180869e0 con 0x7fc01c0b6760 2023-10-14T18:45:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.440+0000 7fc0219b7700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.441+0000 7fc0219b7700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 0x7fc0000693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0cccd0 tx=0x7fc00c007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.444+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc018053c50 con 0x7fc01c0b6760 2023-10-14T18:45:37.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.627+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc01c0b4010 con 0x7fc01c0b6760 2023-10-14T18:45:37.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.627+0000 7fc0127fc700 1 -- 172.21.15.79:0/1700397780 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc018057270 con 0x7fc01c0b6760 2023-10-14T18:45:37.629 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 msgr2=0x7fc0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 0x7fc0000693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0cccd0 tx=0x7fc00c007ed0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 msgr2=0x7fc01c16cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0180097c0 tx=0x7fc018019000 comp rx=0 tx=0).stop 2023-10-14T18:45:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 shutdown_connections 2023-10-14T18:45:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc000066f30 0x7fc0000693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc01c0d1470 0x7fc01c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc01c0b6760 0x7fc01c16cfb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 --2- 172.21.15.79:0/1700397780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc01c0cd300 0x7fc01c0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 >> 172.21.15.79:0/1700397780 conn(0x7fc01c068d90 msgr2=0x7fc01c0b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 shutdown_connections 2023-10-14T18:45:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.630+0000 7fc02441c700 1 -- 172.21.15.79:0/1700397780 wait complete. 2023-10-14T18:45:37.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.759+0000 7f1f9fc87700 1 Processor -- start 2023-10-14T18:45:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.759+0000 7f1f9fc87700 1 -- start start 2023-10-14T18:45:37.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9fc87700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9fc87700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 0x7f1f980cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9fc87700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f980b0790 con 0x7f1f98159ec0 2023-10-14T18:45:37.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9fc87700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9806af60 con 0x7f1f9806aae0 2023-10-14T18:45:37.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9fc87700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ce1f0 con 0x7f1f9815a290 2023-10-14T18:45:37.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9d222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9e224700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 0x7f1f980cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9d222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:54948/0 (socket says 172.21.15.79:54948) 2023-10-14T18:45:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9e224700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 0x7f1f980cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:34942/0 (socket says 172.21.15.79:34942) 2023-10-14T18:45:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.760+0000 7f1f9d222700 1 -- 172.21.15.79:0/2564131913 learned_addr learned my addr 172.21.15.79:0/2564131913 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:37.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9d222700 1 -- 172.21.15.79:0/2564131913 >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 msgr2=0x7f1f980cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9d222700 1 --2- 172.21.15.79:0/2564131913 >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 0x7f1f980cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9d222700 1 -- 172.21.15.79:0/2564131913 >> v1:172.21.15.144:6789/0 conn(0x7f1f98159ec0 legacy=0x7f1f980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9d222700 1 -- 172.21.15.79:0/2564131913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980b0b20 con 0x7f1f9815a290 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9d222700 1 --2- 172.21.15.79:0/2564131913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1140ab451456244b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9ca21700 1 -- 172.21.15.79:0/2564131913 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88009ea0 con 0x7f1f9815a290 2023-10-14T18:45:37.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9ca21700 1 -- 172.21.15.79:0/2564131913 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800b860 con 0x7f1f9815a290 2023-10-14T18:45:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9ca21700 1 -- 172.21.15.79:0/2564131913 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800bc00 con 0x7f1f9815a290 2023-10-14T18:45:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9fc87700 1 -- 172.21.15.79:0/2564131913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 msgr2=0x7f1f9806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.761+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/2564131913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88009250 comp rx=0 tx=0).stop 2023-10-14T18:45:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 -- 172.21.15.79:0/2564131913 shutdown_connections 2023-10-14T18:45:37.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/2564131913 >> v2:172.21.15.144:3300/0 conn(0x7f1f9806aae0 0x7f1f980cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/2564131913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f9815a290 0x7f1f9806a5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 -- 172.21.15.79:0/2564131913 >> 172.21.15.79:0/2564131913 conn(0x7f1f980d1880 msgr2=0x7f1f980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 -- 172.21.15.79:0/2564131913 shutdown_connections 2023-10-14T18:45:37.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.762+0000 7f1f9fc87700 1 -- 172.21.15.79:0/2564131913 wait complete. 2023-10-14T18:45:37.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 Processor -- start 2023-10-14T18:45:37.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 -- start start 2023-10-14T18:45:37.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f98159ec0 0x7f1f980c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f9815a290 0x7f1f980aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980c8640 con 0x7f1f9806aae0 2023-10-14T18:45:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980b4ab0 con 0x7f1f9815a290 2023-10-14T18:45:37.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9fc87700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980b4620 con 0x7f1f98159ec0 2023-10-14T18:45:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.763+0000 7f1f9da23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60246/0 (socket says 172.21.15.79:60246) 2023-10-14T18:45:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 -- 172.21.15.79:0/1635783964 learned_addr learned my addr 172.21.15.79:0/1635783964 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9e224700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f9815a290 0x7f1f980aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9d222700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f98159ec0 0x7f1f980c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 -- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f98159ec0 msgr2=0x7f1f980c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f98159ec0 0x7f1f980c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 -- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f9815a290 msgr2=0x7f1f980aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f9815a290 0x7f1f980aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 -- 172.21.15.79:0/1635783964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f880094f0 con 0x7f1f9806aae0 2023-10-14T18:45:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9da23700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c5c0 tx=0x7f1f9400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94011590 con 0x7f1f9806aae0 2023-10-14T18:45:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f94011710 con 0x7f1f9806aae0 2023-10-14T18:45:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f980c83a0 con 0x7f1f9806aae0 2023-10-14T18:45:37.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94011ad0 con 0x7f1f9806aae0 2023-10-14T18:45:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.764+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980b3fd0 con 0x7f1f9806aae0 2023-10-14T18:45:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.765+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804c3c0 con 0x7f1f9806aae0 2023-10-14T18:45:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.766+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f9401b3b0 con 0x7f1f9806aae0 2023-10-14T18:45:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.766+0000 7f1f8dffb700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 0x7f1f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:37.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.766+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f940839a0 con 0x7f1f9806aae0 2023-10-14T18:45:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.766+0000 7f1f9d222700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 0x7f1f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.767+0000 7f1f9d222700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 0x7f1f7c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:37.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.770+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f94050c10 con 0x7f1f9806aae0 2023-10-14T18:45:37.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.951+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f980b04b0 con 0x7f1f9806aae0 2023-10-14T18:45:37.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.951+0000 7f1f8dffb700 1 -- 172.21.15.79:0/1635783964 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f94017020 con 0x7f1f9806aae0 2023-10-14T18:45:37.952 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 msgr2=0x7f1f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 0x7f1f7c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1f880099b0 tx=0x7f1f88017000 comp rx=0 tx=0).stop 2023-10-14T18:45:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 msgr2=0x7f1f980cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:37.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c5c0 tx=0x7f1f9400c980 comp rx=0 tx=0).stop 2023-10-14T18:45:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 shutdown_connections 2023-10-14T18:45:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f7c066f30 0x7f1f7c0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f9815a290 0x7f1f980aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f9806aae0 0x7f1f980cacf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 --2- 172.21.15.79:0/1635783964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f98159ec0 0x7f1f980c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 >> 172.21.15.79:0/1635783964 conn(0x7f1f980d1880 msgr2=0x7f1f980b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 shutdown_connections 2023-10-14T18:45:37.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:37.953+0000 7f1f9fc87700 1 -- 172.21.15.79:0/1635783964 wait complete. 2023-10-14T18:45:37.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.082+0000 7fe7c67f4700 1 Processor -- start 2023-10-14T18:45:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.082+0000 7fe7c67f4700 1 -- start start 2023-10-14T18:45:38.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c67f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7c0159e80 0x7fe7c00b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c67f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7c00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c67f4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c00b6b10 con 0x7fe7c00aada0 2023-10-14T18:45:38.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c67f4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00b50a0 con 0x7fe7c0159e80 2023-10-14T18:45:38.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c67f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00b0e70 con 0x7fe7c00b1300 2023-10-14T18:45:38.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c4ff1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7c00aada0 0x7fe7c00ab240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52344/0 (socket says 172.21.15.79:52344) 2023-10-14T18:45:38.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c4ff1700 1 -- 172.21.15.79:0/735983387 learned_addr learned my addr 172.21.15.79:0/735983387 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:38.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c57f2700 1 --2- 172.21.15.79:0/735983387 >> v2:172.21.15.144:3300/0 conn(0x7fe7c0159e80 0x7fe7c00b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7c5ff3700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7c00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266720732 0 0) 0x7fe7c00b6b10 con 0x7fe7c00aada0 2023-10-14T18:45:38.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7ac003570 con 0x7fe7c00aada0 2023-10-14T18:45:38.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003118031 0 0) 0x7fe7ac003570 con 0x7fe7c00aada0 2023-10-14T18:45:38.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 msgr2=0x7fe7c00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7c00b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 >> v2:172.21.15.144:3300/0 conn(0x7fe7c0159e80 msgr2=0x7fe7c00b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 --2- 172.21.15.79:0/735983387 >> v2:172.21.15.144:3300/0 conn(0x7fe7c0159e80 0x7fe7c00b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00b52c0 con 0x7fe7c00aada0 2023-10-14T18:45:38.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe7b0001470 con 0x7fe7c00aada0 2023-10-14T18:45:38.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 >> v1:172.21.15.79:6789/0 conn(0x7fe7c00aada0 legacy=0x7fe7c00ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7ac003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac003fe0 0x7fe7ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac004d50 0x7fe7ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00b50a0 con 0x7fe7ac003fe0 2023-10-14T18:45:38.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00b0e70 con 0x7fe7ac004d50 2023-10-14T18:45:38.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.083+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac00ba90 con 0x7fe7c00b1300 2023-10-14T18:45:38.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac003fe0 0x7fe7ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c57f2700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7ac003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c5ff3700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac004d50 0x7fe7ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 -- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 msgr2=0x7fe7ac003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c00b1300 0x7fe7ac003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 -- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac004d50 msgr2=0x7fe7ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac004d50 0x7fe7ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 -- 172.21.15.79:0/735983387 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac003570 con 0x7fe7ac003fe0 2023-10-14T18:45:38.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7c4ff1700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac003fe0 0x7fe7ac004810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c3c0 tx=0x7fe7c00b0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69662274bb294788 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000cc30 con 0x7fe7ac003fe0 2023-10-14T18:45:38.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000cd90 con 0x7fe7ac003fe0 2023-10-14T18:45:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.084+0000 7fe7b7fff700 1 -- 172.21.15.79:0/735983387 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0005b70 con 0x7fe7ac003fe0 2023-10-14T18:45:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 -- 172.21.15.79:0/735983387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac003fe0 msgr2=0x7fe7ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/735983387 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7ac003fe0 0x7fe7ac004810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c3c0 tx=0x7fe7c00b0de0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c5ff3700 1 -- 172.21.15.79:0/735983387 reap_dead start 2023-10-14T18:45:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 -- 172.21.15.79:0/735983387 shutdown_connections 2023-10-14T18:45:38.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 -- 172.21.15.79:0/735983387 >> 172.21.15.79:0/735983387 conn(0x7fe7c0099f50 msgr2=0x7fe7c0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 -- 172.21.15.79:0/735983387 shutdown_connections 2023-10-14T18:45:38.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.085+0000 7fe7c67f4700 1 -- 172.21.15.79:0/735983387 wait complete. 2023-10-14T18:45:38.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.086+0000 7fe7c67f4700 1 Processor -- start 2023-10-14T18:45:38.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.086+0000 7fe7c67f4700 1 -- start start 2023-10-14T18:45:38.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac003fe0 0x7fe7c01537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c0154770 0x7fe7c0156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0157f80 con 0x7fe7c0154be0 2023-10-14T18:45:38.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0158de0 con 0x7fe7ac003fe0 2023-10-14T18:45:38.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c0156e90 con 0x7fe7c0154770 2023-10-14T18:45:38.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60266/0 (socket says 172.21.15.79:60266) 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 -- 172.21.15.79:0/3764788350 learned_addr learned my addr 172.21.15.79:0/3764788350 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c4ff1700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c0154770 0x7fe7c0156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c57f2700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac003fe0 0x7fe7c01537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 -- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c0154770 msgr2=0x7fe7c0156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c0154770 0x7fe7c0156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 -- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac003fe0 msgr2=0x7fe7c01537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac003fe0 0x7fe7c01537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 -- 172.21.15.79:0/3764788350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0154000 con 0x7fe7c0154be0 2023-10-14T18:45:38.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c5ff3700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80094d0 tx=0x7fe7b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800e040 con 0x7fe7c0154be0 2023-10-14T18:45:38.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b800f040 con 0x7fe7c0154be0 2023-10-14T18:45:38.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c01581d0 con 0x7fe7c0154be0 2023-10-14T18:45:38.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.087+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800fda0 con 0x7fe7c0154be0 2023-10-14T18:45:38.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.088+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c0158790 con 0x7fe7c0154be0 2023-10-14T18:45:38.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.088+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0089110 con 0x7fe7c0154be0 2023-10-14T18:45:38.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.089+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7b8015640 con 0x7fe7c0154be0 2023-10-14T18:45:38.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.089+0000 7fe7b57fa700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 0x7fe7a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.089+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7b8084bf0 con 0x7fe7c0154be0 2023-10-14T18:45:38.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.089+0000 7fe7c57f2700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 0x7fe7a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.090+0000 7fe7c57f2700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 0x7fe7a4069410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc006f00 tx=0x7fe7bc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.093+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7b8051dc0 con 0x7fe7c0154be0 2023-10-14T18:45:38.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.275+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7c00711f0 con 0x7fe7c0154be0 2023-10-14T18:45:38.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.275+0000 7fe7b57fa700 1 -- 172.21.15.79:0/3764788350 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7c00711f0 con 0x7fe7c0154be0 2023-10-14T18:45:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:38.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 msgr2=0x7fe7a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 0x7fe7a4069410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc006f00 tx=0x7fe7bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 msgr2=0x7fe7c0156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80094d0 tx=0x7fe7b800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 shutdown_connections 2023-10-14T18:45:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7a4066f60 0x7fe7a4069410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c0154be0 0x7fe7c0156950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7ac003fe0 0x7fe7c01537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 --2- 172.21.15.79:0/3764788350 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7c0154770 0x7fe7c0156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 >> 172.21.15.79:0/3764788350 conn(0x7fe7c0099f50 msgr2=0x7fe7c00b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 shutdown_connections 2023-10-14T18:45:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.277+0000 7fe7c67f4700 1 -- 172.21.15.79:0/3764788350 wait complete. 2023-10-14T18:45:38.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.404+0000 7f7c49471700 1 Processor -- start 2023-10-14T18:45:38.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.404+0000 7f7c49471700 1 -- start start 2023-10-14T18:45:38.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c49471700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cd6e0 0x7f7c440cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c49471700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c440cdab0 0x7f7c4415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c49471700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440cb7c0 con 0x7f7c4415dda0 2023-10-14T18:45:38.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c49471700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4415e850 con 0x7f7c440cdab0 2023-10-14T18:45:38.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c49471700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440cd030 con 0x7f7c440cd6e0 2023-10-14T18:45:38.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c437fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c440cdab0 0x7f7c4415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cd6e0 0x7f7c440cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c437fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c440cdab0 0x7f7c4415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55034/0 (socket says 172.21.15.79:55034) 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.405+0000 7f7c437fe700 1 -- 172.21.15.79:0/2529700941 learned_addr learned my addr 172.21.15.79:0/2529700941 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c437fe700 1 -- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cd6e0 msgr2=0x7f7c440cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c437fe700 1 --2- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cd6e0 0x7f7c440cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c437fe700 1 -- 172.21.15.79:0/2529700941 >> v1:172.21.15.144:6789/0 conn(0x7f7c4415dda0 legacy=0x7f7c4415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c437fe700 1 -- 172.21.15.79:0/2529700941 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4415e290 con 0x7f7c440cdab0 2023-10-14T18:45:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c437fe700 1 --2- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c440cdab0 0x7f7c4415d860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c380099b0 tx=0x7f7c38009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f3c394578e3ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c42ffd700 1 -- 172.21.15.79:0/2529700941 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38009ea0 con 0x7f7c440cdab0 2023-10-14T18:45:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c42ffd700 1 -- 172.21.15.79:0/2529700941 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800b860 con 0x7f7c440cdab0 2023-10-14T18:45:38.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.406+0000 7f7c42ffd700 1 -- 172.21.15.79:0/2529700941 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800bc00 con 0x7f7c440cdab0 2023-10-14T18:45:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 -- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c440cdab0 msgr2=0x7f7c4415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 --2- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c440cdab0 0x7f7c4415d860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c380099b0 tx=0x7f7c38009250 comp rx=0 tx=0).stop 2023-10-14T18:45:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 -- 172.21.15.79:0/2529700941 shutdown_connections 2023-10-14T18:45:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 --2- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cd6e0 0x7f7c440cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 --2- 172.21.15.79:0/2529700941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c440cdab0 0x7f7c4415d860 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 -- 172.21.15.79:0/2529700941 >> 172.21.15.79:0/2529700941 conn(0x7f7c44067660 msgr2=0x7f7c44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 -- 172.21.15.79:0/2529700941 shutdown_connections 2023-10-14T18:45:38.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.407+0000 7f7c49471700 1 -- 172.21.15.79:0/2529700941 wait complete. 2023-10-14T18:45:38.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.408+0000 7f7c49471700 1 Processor -- start 2023-10-14T18:45:38.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.408+0000 7f7c49471700 1 -- start start 2023-10-14T18:45:38.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cdab0 0x7f7c440c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4415dda0 0x7f7c440b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4414d250 con 0x7f7c440cd6e0 2023-10-14T18:45:38.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440b46c0 con 0x7f7c4415dda0 2023-10-14T18:45:38.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440b3ab0 con 0x7f7c440cdab0 2023-10-14T18:45:38.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42076/0 (socket says 172.21.15.79:42076) 2023-10-14T18:45:38.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 -- 172.21.15.79:0/1104064032 learned_addr learned my addr 172.21.15.79:0/1104064032 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:38.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c437fe700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cdab0 0x7f7c440c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c48c70700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4415dda0 0x7f7c440b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 -- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cdab0 msgr2=0x7f7c440c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cdab0 0x7f7c440c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 -- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4415dda0 msgr2=0x7f7c440b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4415dda0 0x7f7c440b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 -- 172.21.15.79:0/1104064032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380094f0 con 0x7f7c440cd6e0 2023-10-14T18:45:38.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c43fff700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ec80 tx=0x7f7c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400c850 con 0x7f7c440cd6e0 2023-10-14T18:45:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400c9b0 con 0x7f7c440cd6e0 2023-10-14T18:45:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400cd50 con 0x7f7c440cd6e0 2023-10-14T18:45:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c440b3d90 con 0x7f7c440cd6e0 2023-10-14T18:45:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.409+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440b4350 con 0x7f7c440cd6e0 2023-10-14T18:45:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.410+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440b49a0 con 0x7f7c440cd6e0 2023-10-14T18:45:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.411+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c34013680 con 0x7f7c440cd6e0 2023-10-14T18:45:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.411+0000 7f7c2bfff700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 0x7f7c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.411+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c34084750 con 0x7f7c440cd6e0 2023-10-14T18:45:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.411+0000 7f7c437fe700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 0x7f7c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.412+0000 7f7c437fe700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 0x7f7c300693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c380099b0 tx=0x7f7c38017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.415+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c340519c0 con 0x7f7c440cd6e0 2023-10-14T18:45:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.600+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c4415e570 con 0x7f7c440cd6e0 2023-10-14T18:45:38.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.601+0000 7f7c2bfff700 1 -- 172.21.15.79:0/1104064032 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7c34054fe0 con 0x7f7c440cd6e0 2023-10-14T18:45:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:38.602 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:38.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 msgr2=0x7f7c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 0x7f7c300693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c380099b0 tx=0x7f7c38017000 comp rx=0 tx=0).stop 2023-10-14T18:45:38.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 msgr2=0x7f7c440c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ec80 tx=0x7f7c340091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 shutdown_connections 2023-10-14T18:45:38.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7c30066f30 0x7f7c300693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c4415dda0 0x7f7c440b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c440cd6e0 0x7f7c440c9fd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 --2- 172.21.15.79:0/1104064032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c440cdab0 0x7f7c440c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 >> 172.21.15.79:0/1104064032 conn(0x7f7c44067660 msgr2=0x7f7c440c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 shutdown_connections 2023-10-14T18:45:38.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.603+0000 7f7c49471700 1 -- 172.21.15.79:0/1104064032 wait complete. 2023-10-14T18:45:38.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:38.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.733+0000 7f1fbcf96700 1 Processor -- start 2023-10-14T18:45:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.733+0000 7f1fbcf96700 1 -- start start 2023-10-14T18:45:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fbcf96700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fb80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fbcf96700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80b0790 con 0x7f1fb815a290 2023-10-14T18:45:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fbcf96700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80ce1f0 con 0x7f1fb806acb0 2023-10-14T18:45:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fbcf96700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80b0b20 con 0x7f1fb8159ec0 2023-10-14T18:45:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fadd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1fb815a290 0x7f1fb806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50026/0 (socket says 172.21.15.79:50026) 2023-10-14T18:45:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fadd9b700 1 -- 172.21.15.79:0/1299406696 learned_addr learned my addr 172.21.15.79:0/1299406696 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fb659c700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fb80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781933983 0 0) 0x7f1fb80b0790 con 0x7f1fb815a290 2023-10-14T18:45:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.734+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa4003570 con 0x7f1fb815a290 2023-10-14T18:45:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547247715 0 0) 0x7f1fa4003570 con 0x7f1fb815a290 2023-10-14T18:45:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 msgr2=0x7f1fb80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fb80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 >> v1:172.21.15.144:6789/0 conn(0x7f1fb806acb0 legacy=0x7f1fb80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80b04b0 con 0x7f1fb815a290 2023-10-14T18:45:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1fa0001470 con 0x7f1fb815a290 2023-10-14T18:45:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 >> v1:172.21.15.79:6789/0 conn(0x7f1fb815a290 legacy=0x7f1fb806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fa4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fa4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fa4004d50 0x7f1fa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80b0b20 con 0x7f1fa4003fd0 2023-10-14T18:45:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400bb40 con 0x7f1fa4004d50 2023-10-14T18:45:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400bd00 con 0x7f1fb8159ec0 2023-10-14T18:45:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fa4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb659c700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fa4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb6d9d700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fa4004d50 0x7f1fa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 -- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 msgr2=0x7f1fa4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb8159ec0 0x7f1fa4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 -- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fa4004d50 msgr2=0x7f1fa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fa4004d50 0x7f1fa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 -- 172.21.15.79:0/1299406696 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4003570 con 0x7f1fa4003fd0 2023-10-14T18:45:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fa4004810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c2d0 tx=0x7f1fa0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff2ec2eab16d29c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000cbc0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000cd20 con 0x7f1fa4003fd0 2023-10-14T18:45:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.735+0000 7f1fb5d9b700 1 -- 172.21.15.79:0/1299406696 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005b70 con 0x7f1fa4003fd0 2023-10-14T18:45:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1299406696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 msgr2=0x7f1fa4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1299406696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fa4004810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c2d0 tx=0x7f1fa0001df0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fb6d9d700 1 -- 172.21.15.79:0/1299406696 reap_dead start 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1299406696 shutdown_connections 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1299406696 >> 172.21.15.79:0/1299406696 conn(0x7f1fb80d1880 msgr2=0x7f1fb80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1299406696 shutdown_connections 2023-10-14T18:45:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.736+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1299406696 wait complete. 2023-10-14T18:45:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.737+0000 7f1fbcf96700 1 Processor -- start 2023-10-14T18:45:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.737+0000 7f1fbcf96700 1 -- start start 2023-10-14T18:45:38.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb81594a0 0x7f1fb80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb80b2b10 0x7f1fb80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80b34c0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80c9300 con 0x7f1fb80b2b10 2023-10-14T18:45:38.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fbcf96700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb80c86f0 con 0x7f1fb81594a0 2023-10-14T18:45:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42102/0 (socket says 172.21.15.79:42102) 2023-10-14T18:45:38.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 -- 172.21.15.79:0/1320679009 learned_addr learned my addr 172.21.15.79:0/1320679009 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:38.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb81594a0 0x7f1fb80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb6d9d700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb80b2b10 0x7f1fb80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 -- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb81594a0 msgr2=0x7f1fb80c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb81594a0 0x7f1fb80c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 -- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb80b2b10 msgr2=0x7f1fb80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb80b2b10 0x7f1fb80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 -- 172.21.15.79:0/1320679009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80c89d0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.738+0000 7f1fb659c700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8011d40 tx=0x7f1fa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800fa10 con 0x7f1fa4003fd0 2023-10-14T18:45:38.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800fb70 con 0x7f1fa4003fd0 2023-10-14T18:45:38.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb80c8cb0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8014440 con 0x7f1fa4003fd0 2023-10-14T18:45:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb8148d00 con 0x7f1fa4003fd0 2023-10-14T18:45:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.739+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb804c3c0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.740+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fa8014870 con 0x7f1fa4003fd0 2023-10-14T18:45:38.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.740+0000 7f1faeffd700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.740+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fa8018030 con 0x7f1fa4003fd0 2023-10-14T18:45:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.740+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.741+0000 7f1fadd9b700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 0x7f1f980693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0008fd0 tx=0x7f1fa0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.744+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fa8052240 con 0x7f1fa4003fd0 2023-10-14T18:45:38.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:38.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:38.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.929+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fb80ceab0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.929+0000 7f1faeffd700 1 -- 172.21.15.79:0/1320679009 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fa80220a0 con 0x7f1fa4003fd0 2023-10-14T18:45:38.931 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:38.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 msgr2=0x7f1f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 0x7f1f980693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0008fd0 tx=0x7f1fa0015000 comp rx=0 tx=0).stop 2023-10-14T18:45:38.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 msgr2=0x7f1fb81487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:38.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8011d40 tx=0x7f1fa80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 shutdown_connections 2023-10-14T18:45:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f98066f30 0x7f1f980693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb80b2b10 0x7f1fb80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fa4003fd0 0x7f1fb81487c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 --2- 172.21.15.79:0/1320679009 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb81594a0 0x7f1fb80c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 >> 172.21.15.79:0/1320679009 conn(0x7f1fb80d1880 msgr2=0x7f1fb80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 shutdown_connections 2023-10-14T18:45:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:38.932+0000 7f1fbcf96700 1 -- 172.21.15.79:0/1320679009 wait complete. 2023-10-14T18:45:38.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:39.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.100+0000 7f3fe3d97700 1 Processor -- start 2023-10-14T18:45:39.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.100+0000 7f3fe3d97700 1 -- start start 2023-10-14T18:45:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe3d97700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fdc15a290 0x7f3fdc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe3d97700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fdc0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe3d97700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc0b0790 con 0x7f3fdc159ec0 2023-10-14T18:45:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe3d97700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc06af60 con 0x7f3fdc15a290 2023-10-14T18:45:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe3d97700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0ce1f0 con 0x7f3fdc06aae0 2023-10-14T18:45:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe1b33700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3fdc159ec0 0x7f3fdc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50034/0 (socket says 172.21.15.79:50034) 2023-10-14T18:45:39.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe1b33700 1 -- 172.21.15.79:0/1445789911 learned_addr learned my addr 172.21.15.79:0/1445789911 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:39.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe2334700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fdc0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1445789911 >> v2:172.21.15.144:3300/0 conn(0x7f3fdc15a290 0x7f3fdc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966446788 0 0) 0x7f3fdc0b0790 con 0x7f3fdc159ec0 2023-10-14T18:45:39.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc8003570 con 0x7f3fdc159ec0 2023-10-14T18:45:39.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343458318 0 0) 0x7f3fc8003570 con 0x7f3fdc159ec0 2023-10-14T18:45:39.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 msgr2=0x7f3fdc0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fdc0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 >> v2:172.21.15.144:3300/0 conn(0x7f3fdc15a290 msgr2=0x7f3fdc06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 --2- 172.21.15.79:0/1445789911 >> v2:172.21.15.144:3300/0 conn(0x7f3fdc15a290 0x7f3fdc06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc0b0b20 con 0x7f3fdc159ec0 2023-10-14T18:45:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f3fd8001470 con 0x7f3fdc159ec0 2023-10-14T18:45:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 >> v1:172.21.15.79:6789/0 conn(0x7f3fdc159ec0 legacy=0x7f3fdc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc8003a60 0x7f3fc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc8004810 0x7f3fc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc06af60 con 0x7f3fc8004810 2023-10-14T18:45:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0ce1f0 con 0x7f3fc8003a60 2023-10-14T18:45:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc800ba60 con 0x7f3fdc06aae0 2023-10-14T18:45:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.101+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc8004810 0x7f3fc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1b33700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc8003a60 0x7f3fc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe2334700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 -- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 msgr2=0x7f3fc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fdc06aae0 0x7f3fc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 -- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc8003a60 msgr2=0x7f3fc8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc8003a60 0x7f3fc8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 -- 172.21.15.79:0/1445789911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8003570 con 0x7f3fc8004810 2023-10-14T18:45:39.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1b33700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc8003a60 0x7f3fc8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:39.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc8004810 0x7f3fc8004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009c30 tx=0x7f3fcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f4842e00541859 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00e710 con 0x7f3fc8004810 2023-10-14T18:45:39.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc00e870 con 0x7f3fc8004810 2023-10-14T18:45:39.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe0b31700 1 -- 172.21.15.79:0/1445789911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00ec30 con 0x7f3fc8004810 2023-10-14T18:45:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1445789911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc8004810 msgr2=0x7f3fc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1445789911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fc8004810 0x7f3fc8004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009c30 tx=0x7f3fcc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.102+0000 7f3fe2334700 1 -- 172.21.15.79:0/1445789911 reap_dead start 2023-10-14T18:45:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.103+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1445789911 shutdown_connections 2023-10-14T18:45:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.103+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1445789911 >> 172.21.15.79:0/1445789911 conn(0x7f3fdc0d1880 msgr2=0x7f3fdc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.103+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1445789911 shutdown_connections 2023-10-14T18:45:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.103+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1445789911 wait complete. 2023-10-14T18:45:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 Processor -- start 2023-10-14T18:45:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 -- start start 2023-10-14T18:45:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc8004810 0x7f3fdc1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 0x7f3fdc15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0caa40 con 0x7f3fdc15f240 2023-10-14T18:45:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc1572e0 con 0x7f3fdc157770 2023-10-14T18:45:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.104+0000 7f3fe3d97700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc156470 con 0x7f3fc8004810 2023-10-14T18:45:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42106/0 (socket says 172.21.15.79:42106) 2023-10-14T18:45:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 -- 172.21.15.79:0/1609446231 learned_addr learned my addr 172.21.15.79:0/1609446231 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe1b33700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc8004810 0x7f3fdc1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 0x7f3fdc15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 -- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc8004810 msgr2=0x7f3fdc1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc8004810 0x7f3fdc1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 -- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 msgr2=0x7f3fdc15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 0x7f3fdc15ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 -- 172.21.15.79:0/1609446231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc155ef0 con 0x7f3fdc15f240 2023-10-14T18:45:39.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe1332700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 0x7f3fdc15ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe2334700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc089010 tx=0x7f3fd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400e070 con 0x7f3fdc15f240 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4011c30 con 0x7f3fdc15f240 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc1566d0 con 0x7f3fdc15f240 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4016470 con 0x7f3fdc15f240 2023-10-14T18:45:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.105+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc156c90 con 0x7f3fdc15f240 2023-10-14T18:45:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.106+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc04c3c0 con 0x7f3fdc15f240 2023-10-14T18:45:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.107+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd4016860 con 0x7f3fdc15f240 2023-10-14T18:45:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.107+0000 7f3fd1ffb700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 0x7f3fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.107+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fd4085150 con 0x7f3fdc15f240 2023-10-14T18:45:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.107+0000 7f3fe1b33700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 0x7f3fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.108+0000 7f3fe1b33700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 0x7f3fc00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80015e0 tx=0x7f3fd8007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.111+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd40523c0 con 0x7f3fdc15f240 2023-10-14T18:45:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.293+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3fdc157470 con 0x7f3fdc15f240 2023-10-14T18:45:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.294+0000 7f3fd1ffb700 1 -- 172.21.15.79:0/1609446231 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3fd40559e0 con 0x7f3fdc15f240 2023-10-14T18:45:39.295 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:39.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 msgr2=0x7f3fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 0x7f3fc00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80015e0 tx=0x7f3fd8007040 comp rx=0 tx=0).stop 2023-10-14T18:45:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 msgr2=0x7f3fdc0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc089010 tx=0x7f3fd400b040 comp rx=0 tx=0).stop 2023-10-14T18:45:39.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 shutdown_connections 2023-10-14T18:45:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3fc0066f30 0x7f3fc00693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3fdc15f240 0x7f3fdc0b17b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3fc8004810 0x7f3fdc1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 --2- 172.21.15.79:0/1609446231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fdc157770 0x7f3fdc15ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 >> 172.21.15.79:0/1609446231 conn(0x7f3fdc0d1880 msgr2=0x7f3fdc0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 shutdown_connections 2023-10-14T18:45:39.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.296+0000 7f3fe3d97700 1 -- 172.21.15.79:0/1609446231 wait complete. 2023-10-14T18:45:39.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:39.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.424+0000 7ff5afbb2700 1 Processor -- start 2023-10-14T18:45:39.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 -- start start 2023-10-14T18:45:39.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5a815a290 0x7ff5a806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a806aae0 0x7ff5a80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a80b0790 con 0x7ff5a8159ec0 2023-10-14T18:45:39.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a806af60 con 0x7ff5a815a290 2023-10-14T18:45:39.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.425+0000 7ff5afbb2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80ce1f0 con 0x7ff5a806aae0 2023-10-14T18:45:39.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad94e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5a8159ec0 0x7ff5a80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54072/0 (socket says 172.21.15.79:54072) 2023-10-14T18:45:39.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad94e700 1 -- 172.21.15.79:0/2217517920 learned_addr learned my addr 172.21.15.79:0/2217517920 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:39.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2217517920 >> v2:172.21.15.144:3300/0 conn(0x7ff5a815a290 0x7ff5a806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ae14f700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a806aae0 0x7ff5a80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 -- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a806aae0 msgr2=0x7ff5a80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a806aae0 0x7ff5a80cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 -- 172.21.15.79:0/2217517920 >> v1:172.21.15.144:6789/0 conn(0x7ff5a8159ec0 legacy=0x7ff5a80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 -- 172.21.15.79:0/2217517920 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80b0b20 con 0x7ff5a815a290 2023-10-14T18:45:39.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a806a5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0098e0 tx=0x7ff59c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97edf7eab0a95251 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ac94c700 1 -- 172.21.15.79:0/2217517920 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00b640 con 0x7ff5a815a290 2023-10-14T18:45:39.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ac94c700 1 -- 172.21.15.79:0/2217517920 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c00b7a0 con 0x7ff5a815a290 2023-10-14T18:45:39.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.426+0000 7ff5ac94c700 1 -- 172.21.15.79:0/2217517920 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00bb40 con 0x7ff5a815a290 2023-10-14T18:45:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 msgr2=0x7ff5a806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a806a5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0098e0 tx=0x7ff59c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2217517920 shutdown_connections 2023-10-14T18:45:39.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a806aae0 0x7ff5a80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2217517920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a806a5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2217517920 >> 172.21.15.79:0/2217517920 conn(0x7ff5a80d1880 msgr2=0x7ff5a80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2217517920 shutdown_connections 2023-10-14T18:45:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.427+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2217517920 wait complete. 2023-10-14T18:45:39.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.428+0000 7ff5afbb2700 1 Processor -- start 2023-10-14T18:45:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.428+0000 7ff5afbb2700 1 -- start start 2023-10-14T18:45:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a8159ec0 0x7ff5a80c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a8156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80b47c0 con 0x7ff5a806aae0 2023-10-14T18:45:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cb3c0 con 0x7ff5a815a290 2023-10-14T18:45:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a80cb6a0 con 0x7ff5a8159ec0 2023-10-14T18:45:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42118/0 (socket says 172.21.15.79:42118) 2023-10-14T18:45:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 -- 172.21.15.79:0/2770125193 learned_addr learned my addr 172.21.15.79:0/2770125193 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ae14f700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a8159ec0 0x7ff5a80c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 -- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a8159ec0 msgr2=0x7ff5a80c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a8159ec0 0x7ff5a80c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 -- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 msgr2=0x7ff5a8156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a8156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 -- 172.21.15.79:0/2770125193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009420 con 0x7ff5a806aae0 2023-10-14T18:45:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5ad94e700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cd30 tx=0x7ff598001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800ce30 con 0x7ff5a806aae0 2023-10-14T18:45:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598004bb0 con 0x7ff5a806aae0 2023-10-14T18:45:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a80cb980 con 0x7ff5a806aae0 2023-10-14T18:45:39.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.429+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800aac0 con 0x7ff5a806aae0 2023-10-14T18:45:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.430+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a8152fd0 con 0x7ff5a806aae0 2023-10-14T18:45:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.430+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80b4c50 con 0x7ff5a806aae0 2023-10-14T18:45:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.431+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5980070f0 con 0x7ff5a806aae0 2023-10-14T18:45:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.431+0000 7ff5a5ffb700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 0x7ff5940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.431+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff598084160 con 0x7ff5a806aae0 2023-10-14T18:45:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.431+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 0x7ff5940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.432+0000 7ff5ad14d700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 0x7ff5940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0093f0 tx=0x7ff59c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.435+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5a80b4c50 con 0x7ff5a806aae0 2023-10-14T18:45:39.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.617+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5a80b4c50 con 0x7ff5a806aae0 2023-10-14T18:45:39.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.617+0000 7ff5a5ffb700 1 -- 172.21.15.79:0/2770125193 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5a80b4c50 con 0x7ff5a806aae0 2023-10-14T18:45:39.618 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 msgr2=0x7ff5940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 0x7ff5940693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0093f0 tx=0x7ff59c017000 comp rx=0 tx=0).stop 2023-10-14T18:45:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 msgr2=0x7ff5a8152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cd30 tx=0x7ff598001ad0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 shutdown_connections 2023-10-14T18:45:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff594066f30 0x7ff5940693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5a815a290 0x7ff5a8156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5a806aae0 0x7ff5a8152a90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 --2- 172.21.15.79:0/2770125193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5a8159ec0 0x7ff5a80c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 >> 172.21.15.79:0/2770125193 conn(0x7ff5a80d1880 msgr2=0x7ff5a8155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 shutdown_connections 2023-10-14T18:45:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.619+0000 7ff5afbb2700 1 -- 172.21.15.79:0/2770125193 wait complete. 2023-10-14T18:45:39.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.746+0000 7f961759e700 1 Processor -- start 2023-10-14T18:45:39.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.746+0000 7f961759e700 1 -- start start 2023-10-14T18:45:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96180aa440 0x7f9618161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961759e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180ab590 con 0x7f9618156860 2023-10-14T18:45:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9618063df0 con 0x7f96180cc460 2023-10-14T18:45:39.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961806fb20 con 0x7f96180aa440 2023-10-14T18:45:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9618156860 0x7f96180cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50036/0 (socket says 172.21.15.79:50036) 2023-10-14T18:45:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.747+0000 7f961659c700 1 -- 172.21.15.79:0/3294095477 learned_addr learned my addr 172.21.15.79:0/3294095477 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276349472 0 0) 0x7f96180ab590 con 0x7f9618156860 2023-10-14T18:45:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f9616d9d700 1 --2- 172.21.15.79:0/3294095477 >> v2:172.21.15.144:3300/0 conn(0x7f96180aa440 0x7f9618161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9600003570 con 0x7f9618156860 2023-10-14T18:45:39.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275444599 0 0) 0x7f9600003570 con 0x7f9618156860 2023-10-14T18:45:39.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 >> v2:172.21.15.144:3300/0 conn(0x7f96180aa440 msgr2=0x7f9618161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 --2- 172.21.15.79:0/3294095477 >> v2:172.21.15.144:3300/0 conn(0x7f96180aa440 0x7f9618161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 >> v1:172.21.15.144:6789/0 conn(0x7f96180cc460 legacy=0x7f96180a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180aa980 con 0x7f9618156860 2023-10-14T18:45:39.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f96080017f0 con 0x7f9618156860 2023-10-14T18:45:39.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 >> v1:172.21.15.79:6789/0 conn(0x7f9618156860 legacy=0x7f96180cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 0x7f9600003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600004810 0x7f9600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96000051c0 0x7f960000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961806fb20 con 0x7f9600003a60 2023-10-14T18:45:39.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960000c160 con 0x7f96000051c0 2023-10-14T18:45:39.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960000c320 con 0x7f9600004810 2023-10-14T18:45:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 0x7f9600003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f9616d9d700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96000051c0 0x7f960000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f9615d9b700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600004810 0x7f9600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 -- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600004810 msgr2=0x7f9600004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600004810 0x7f9600004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 -- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96000051c0 msgr2=0x7f960000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96000051c0 0x7f960000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f9616d9d700 1 -- 172.21.15.79:0/3294095477 reap_dead start 2023-10-14T18:45:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.748+0000 7f961659c700 1 -- 172.21.15.79:0/3294095477 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600003570 con 0x7f9600003a60 2023-10-14T18:45:39.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961659c700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 0x7f9600003e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f960800a930 tx=0x7f96080021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97ea3176c12f6c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080070d0 con 0x7f9600003a60 2023-10-14T18:45:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608007230 con 0x7f9600003a60 2023-10-14T18:45:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961559a700 1 -- 172.21.15.79:0/3294095477 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080075d0 con 0x7f9600003a60 2023-10-14T18:45:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 -- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 msgr2=0x7f9600003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 0x7f9600003e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f960800a930 tx=0x7f96080021d0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 -- 172.21.15.79:0/3294095477 shutdown_connections 2023-10-14T18:45:39.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 --2- 172.21.15.79:0/3294095477 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9600003a60 0x7f9600003e70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 -- 172.21.15.79:0/3294095477 >> 172.21.15.79:0/3294095477 conn(0x7f96180cd070 msgr2=0x7f96180cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 -- 172.21.15.79:0/3294095477 shutdown_connections 2023-10-14T18:45:39.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.749+0000 7f961759e700 1 -- 172.21.15.79:0/3294095477 wait complete. 2023-10-14T18:45:39.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.750+0000 7f961759e700 1 Processor -- start 2023-10-14T18:45:39.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.750+0000 7f961759e700 1 -- start start 2023-10-14T18:45:39.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600003a60 0x7f9618167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 0x7f961816a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618098670 con 0x7f96180b1a40 2023-10-14T18:45:39.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618097aa0 con 0x7f96180b0b70 2023-10-14T18:45:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618097d40 con 0x7f9600003a60 2023-10-14T18:45:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42122/0 (socket says 172.21.15.79:42122) 2023-10-14T18:45:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 -- 172.21.15.79:0/1564605097 learned_addr learned my addr 172.21.15.79:0/1564605097 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f961659c700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600003a60 0x7f9618167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9615d9b700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 0x7f961816a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 -- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600003a60 msgr2=0x7f9618167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600003a60 0x7f9618167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 -- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 msgr2=0x7f961816a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 0x7f961816a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9616d9d700 1 -- 172.21.15.79:0/1564605097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618098020 con 0x7f96180b1a40 2023-10-14T18:45:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.751+0000 7f9615d9b700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 0x7f961816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f9616d9d700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96180cd020 tx=0x7f9610008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100146f0 con 0x7f96180b1a40 2023-10-14T18:45:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9610014870 con 0x7f96180b1a40 2023-10-14T18:45:39.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610014c30 con 0x7f96180b1a40 2023-10-14T18:45:39.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9618098300 con 0x7f96180b1a40 2023-10-14T18:45:39.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.752+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180b1ea0 con 0x7f96180b1a40 2023-10-14T18:45:39.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.753+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96180b2120 con 0x7f96180b1a40 2023-10-14T18:45:39.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.753+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f961001b350 con 0x7f96180b1a40 2023-10-14T18:45:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.753+0000 7f96067fc700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 0x7f95f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.754+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9610086280 con 0x7f96180b1a40 2023-10-14T18:45:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.754+0000 7f961659c700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 0x7f95f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.754+0000 7f961659c700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 0x7f95f80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f960800a3f0 tx=0x7f9608013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.758+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96100534f0 con 0x7f96180b1a40 2023-10-14T18:45:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.940+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96180987b0 con 0x7f96180b1a40 2023-10-14T18:45:39.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.941+0000 7f96067fc700 1 -- 172.21.15.79:0/1564605097 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9610056b10 con 0x7f96180b1a40 2023-10-14T18:45:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:39.942 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 msgr2=0x7f95f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 0x7f95f80693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f960800a3f0 tx=0x7f9608013000 comp rx=0 tx=0).stop 2023-10-14T18:45:39.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 msgr2=0x7f96180ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96180cd020 tx=0x7f9610008040 comp rx=0 tx=0).stop 2023-10-14T18:45:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 shutdown_connections 2023-10-14T18:45:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95f8066f30 0x7f95f80693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96180b1a40 0x7f96180ada70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9600003a60 0x7f9618167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 --2- 172.21.15.79:0/1564605097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96180b0b70 0x7f961816a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 >> 172.21.15.79:0/1564605097 conn(0x7f96180cd070 msgr2=0x7f96180695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 shutdown_connections 2023-10-14T18:45:39.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:39.943+0000 7f961759e700 1 -- 172.21.15.79:0/1564605097 wait complete. 2023-10-14T18:45:39.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:39.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:40.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.073+0000 7f04aec3a700 1 Processor -- start 2023-10-14T18:45:40.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.073+0000 7f04aec3a700 1 -- start start 2023-10-14T18:45:40.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04aec3a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04a8159c30 0x7f04a80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04aec3a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a8070d30 con 0x7f04a806ecc0 2023-10-14T18:45:40.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04aec3a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a8070700 con 0x7f04a806ca90 2023-10-14T18:45:40.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04aec3a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a806f710 con 0x7f04a8159c30 2023-10-14T18:45:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04ac9d6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04a8159c30 0x7f04a80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04a7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f04a806ecc0 0x7f04a806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50038/0 (socket says 172.21.15.79:50038) 2023-10-14T18:45:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04ac9d6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04a8159c30 0x7f04a80711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42134/0 (socket says 172.21.15.79:42134) 2023-10-14T18:45:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.074+0000 7f04a7fff700 1 -- 172.21.15.79:0/1455527060 learned_addr learned my addr 172.21.15.79:0/1455527060 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04ac9d6700 1 -- 172.21.15.79:0/1455527060 >> v1:172.21.15.144:6789/0 conn(0x7f04a806ca90 legacy=0x7f04a815a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04a77fe700 1 -- 172.21.15.79:0/1455527060 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455965340 0 0) 0x7f04a8070d30 con 0x7f04a806ecc0 2023-10-14T18:45:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04ac9d6700 1 -- 172.21.15.79:0/1455527060 >> v1:172.21.15.79:6789/0 conn(0x7f04a806ecc0 legacy=0x7f04a806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04ac9d6700 1 -- 172.21.15.79:0/1455527060 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a806f9f0 con 0x7f04a8159c30 2023-10-14T18:45:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04ac9d6700 1 --2- 172.21.15.79:0/1455527060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a8159c30 0x7f04a80711c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009e90 tx=0x7f04a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a90904aa7dfcac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04a77fe700 1 -- 172.21.15.79:0/1455527060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000e070 con 0x7f04a8159c30 2023-10-14T18:45:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04a77fe700 1 -- 172.21.15.79:0/1455527060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000bbb0 con 0x7f04a8159c30 2023-10-14T18:45:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.075+0000 7f04a77fe700 1 -- 172.21.15.79:0/1455527060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0012430 con 0x7f04a8159c30 2023-10-14T18:45:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 -- 172.21.15.79:0/1455527060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a8159c30 msgr2=0x7f04a80711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 --2- 172.21.15.79:0/1455527060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a8159c30 0x7f04a80711c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009e90 tx=0x7f04a0009780 comp rx=0 tx=0).stop 2023-10-14T18:45:40.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 -- 172.21.15.79:0/1455527060 shutdown_connections 2023-10-14T18:45:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 --2- 172.21.15.79:0/1455527060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a8159c30 0x7f04a80711c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 -- 172.21.15.79:0/1455527060 >> 172.21.15.79:0/1455527060 conn(0x7f04a80cb030 msgr2=0x7f04a806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 -- 172.21.15.79:0/1455527060 shutdown_connections 2023-10-14T18:45:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.076+0000 7f04aec3a700 1 -- 172.21.15.79:0/1455527060 wait complete. 2023-10-14T18:45:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.077+0000 7f04aec3a700 1 Processor -- start 2023-10-14T18:45:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.077+0000 7f04aec3a700 1 -- start start 2023-10-14T18:45:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.077+0000 7f04aec3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04a806ecc0 0x7f04a80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04a8159c30 0x7f04a80af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b1a40 con 0x7f04a806ca90 2023-10-14T18:45:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a816b250 con 0x7f04a8159c30 2023-10-14T18:45:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80b1070 con 0x7f04a806ecc0 2023-10-14T18:45:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42138/0 (socket says 172.21.15.79:42138) 2023-10-14T18:45:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 -- 172.21.15.79:0/3438674356 learned_addr learned my addr 172.21.15.79:0/3438674356 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04a7fff700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04a806ecc0 0x7f04a80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ad1d7700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04a8159c30 0x7f04a80af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 -- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04a806ecc0 msgr2=0x7f04a80b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04a806ecc0 0x7f04a80b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 -- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04a8159c30 msgr2=0x7f04a80af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04a8159c30 0x7f04a80af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 -- 172.21.15.79:0/3438674356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0009a20 con 0x7f04a806ca90 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04ac9d6700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097c0 tx=0x7f04a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0012e60 con 0x7f04a806ca90 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a001d640 con 0x7f04a806ca90 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a80b3960 con 0x7f04a806ca90 2023-10-14T18:45:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a001da00 con 0x7f04a806ca90 2023-10-14T18:45:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.078+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a80b0a20 con 0x7f04a806ca90 2023-10-14T18:45:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.079+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a804c3c0 con 0x7f04a806ca90 2023-10-14T18:45:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.080+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04a0024070 con 0x7f04a806ca90 2023-10-14T18:45:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.080+0000 7f04a4ff9700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.080+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04a0086e10 con 0x7f04a806ca90 2023-10-14T18:45:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.080+0000 7f04a7fff700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.081+0000 7f04a7fff700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 0x7f04880693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a8167e70 tx=0x7f0498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.084+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04a0054130 con 0x7f04a806ca90 2023-10-14T18:45:40.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.265+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04a80709c0 con 0x7f04a806ca90 2023-10-14T18:45:40.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.265+0000 7f04a4ff9700 1 -- 172.21.15.79:0/3438674356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04a001ddb0 con 0x7f04a806ca90 2023-10-14T18:45:40.267 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:40.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 msgr2=0x7f04880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 0x7f04880693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a8167e70 tx=0x7f0498009040 comp rx=0 tx=0).stop 2023-10-14T18:45:40.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 msgr2=0x7f04a80b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097c0 tx=0x7f04a0018000 comp rx=0 tx=0).stop 2023-10-14T18:45:40.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 shutdown_connections 2023-10-14T18:45:40.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0488066f30 0x7f04880693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04a8159c30 0x7f04a80af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04a806ca90 0x7f04a80b1500 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 --2- 172.21.15.79:0/3438674356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04a806ecc0 0x7f04a80b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 >> 172.21.15.79:0/3438674356 conn(0x7f04a80cb030 msgr2=0x7f04a80aae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 shutdown_connections 2023-10-14T18:45:40.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.267+0000 7f04aec3a700 1 -- 172.21.15.79:0/3438674356 wait complete. 2023-10-14T18:45:40.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:40.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.397+0000 7f73bae3c700 1 Processor -- start 2023-10-14T18:45:40.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.397+0000 7f73bae3c700 1 -- start start 2023-10-14T18:45:40.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73bae3c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f73b40cce30 0x7f73b415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73bae3c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 0x7f73b40b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73bae3c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b40b4d70 con 0x7f73b40b6580 2023-10-14T18:45:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73bae3c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b40cd8d0 con 0x7f73b40cce30 2023-10-14T18:45:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73bae3c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b40b4440 con 0x7f73b406aa00 2023-10-14T18:45:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9e3a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f73b40cce30 0x7f73b415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9639700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f73b40b6580 0x7f73b406a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50054/0 (socket says 172.21.15.79:50054) 2023-10-14T18:45:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9639700 1 -- 172.21.15.79:0/3359655446 learned_addr learned my addr 172.21.15.79:0/3359655446 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73ba63b700 1 --2- 172.21.15.79:0/3359655446 >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 0x7f73b40b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3359655446 >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 msgr2=0x7f73b40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9e3a700 1 --2- 172.21.15.79:0/3359655446 >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 0x7f73b40b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b8e38700 1 -- 172.21.15.79:0/3359655446 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120278334 0 0) 0x7f73b40b4d70 con 0x7f73b40b6580 2023-10-14T18:45:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3359655446 >> v1:172.21.15.79:6789/0 conn(0x7f73b40b6580 legacy=0x7f73b406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3359655446 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b40b4720 con 0x7f73b40cce30 2023-10-14T18:45:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.398+0000 7f73ba63b700 1 --2- 172.21.15.79:0/3359655446 >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 0x7f73b40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73b9e3a700 1 --2- 172.21.15.79:0/3359655446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b40cce30 0x7f73b415aca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73b40b4ce0 tx=0x7f73a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc1455bd45debe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73b8e38700 1 -- 172.21.15.79:0/3359655446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400e070 con 0x7f73b40cce30 2023-10-14T18:45:40.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73b8e38700 1 -- 172.21.15.79:0/3359655446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a400bc30 con 0x7f73b40cce30 2023-10-14T18:45:40.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73b8e38700 1 -- 172.21.15.79:0/3359655446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4012430 con 0x7f73b40cce30 2023-10-14T18:45:40.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 -- 172.21.15.79:0/3359655446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b40cce30 msgr2=0x7f73b415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3359655446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b40cce30 0x7f73b415aca0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f73b40b4ce0 tx=0x7f73a4009780 comp rx=0 tx=0).stop 2023-10-14T18:45:40.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 -- 172.21.15.79:0/3359655446 shutdown_connections 2023-10-14T18:45:40.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3359655446 >> v2:172.21.15.144:3300/0 conn(0x7f73b406aa00 0x7f73b40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3359655446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b40cce30 0x7f73b415aca0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 -- 172.21.15.79:0/3359655446 >> 172.21.15.79:0/3359655446 conn(0x7f73b4068cb0 msgr2=0x7f73b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 -- 172.21.15.79:0/3359655446 shutdown_connections 2023-10-14T18:45:40.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.399+0000 7f73bae3c700 1 -- 172.21.15.79:0/3359655446 wait complete. 2023-10-14T18:45:40.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.400+0000 7f73bae3c700 1 Processor -- start 2023-10-14T18:45:40.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.400+0000 7f73bae3c700 1 -- start start 2023-10-14T18:45:40.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b40b6580 0x7f73b4150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b40cce30 0x7f73b4150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b41522d0 con 0x7f73b406aa00 2023-10-14T18:45:40.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4155270 con 0x7f73b40b6580 2023-10-14T18:45:40.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73bae3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4155550 con 0x7f73b40cce30 2023-10-14T18:45:40.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42152/0 (socket says 172.21.15.79:42152) 2023-10-14T18:45:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3065467448 learned_addr learned my addr 172.21.15.79:0/3065467448 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b40cce30 msgr2=0x7f73b4150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b40cce30 0x7f73b4150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b40b6580 msgr2=0x7f73b4150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b40b6580 0x7f73b4150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.401+0000 7f73b9e3a700 1 -- 172.21.15.79:0/3065467448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4009a20 con 0x7f73b406aa00 2023-10-14T18:45:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73b9e3a700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73a40099f0 tx=0x7f73a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4001090 con 0x7f73b406aa00 2023-10-14T18:45:40.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a401d630 con 0x7f73b406aa00 2023-10-14T18:45:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b4155830 con 0x7f73b406aa00 2023-10-14T18:45:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a401d9f0 con 0x7f73b406aa00 2023-10-14T18:45:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.402+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b40b2f40 con 0x7f73b406aa00 2023-10-14T18:45:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.403+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b41520a0 con 0x7f73b406aa00 2023-10-14T18:45:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.403+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73a4024070 con 0x7f73b406aa00 2023-10-14T18:45:40.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.404+0000 7f73b1ffb700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 0x7f73a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.404+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73a4086c40 con 0x7f73b406aa00 2023-10-14T18:45:40.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.404+0000 7f73b9639700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 0x7f73a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.405+0000 7f73b9639700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 0x7f73a00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73a80011e0 tx=0x7f73a80079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.408+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73b41520a0 con 0x7f73b406aa00 2023-10-14T18:45:40.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.589+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73b41520a0 con 0x7f73b406aa00 2023-10-14T18:45:40.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.589+0000 7f73b1ffb700 1 -- 172.21.15.79:0/3065467448 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73b41520a0 con 0x7f73b406aa00 2023-10-14T18:45:40.590 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:40.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 msgr2=0x7f73a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 0x7f73a00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f73a80011e0 tx=0x7f73a80079d0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 msgr2=0x7f73b4154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f73a40099f0 tx=0x7f73a4019000 comp rx=0 tx=0).stop 2023-10-14T18:45:40.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 shutdown_connections 2023-10-14T18:45:40.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73a0066f30 0x7f73a00693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73b40cce30 0x7f73b4150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b406aa00 0x7f73b4154890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 --2- 172.21.15.79:0/3065467448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73b40b6580 0x7f73b4150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 >> 172.21.15.79:0/3065467448 conn(0x7f73b4068cb0 msgr2=0x7f73b4158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 shutdown_connections 2023-10-14T18:45:40.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.591+0000 7f73bae3c700 1 -- 172.21.15.79:0/3065467448 wait complete. 2023-10-14T18:45:40.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:40.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.722+0000 7fa921f76700 1 Processor -- start 2023-10-14T18:45:40.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.722+0000 7fa921f76700 1 -- start start 2023-10-14T18:45:40.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.722+0000 7fa921f76700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91c15a290 0x7fa91c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.722+0000 7fa921f76700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 0x7fa91c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa921f76700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91c0b0790 con 0x7fa91c159ec0 2023-10-14T18:45:40.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa921f76700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c06af20 con 0x7fa91c15a290 2023-10-14T18:45:40.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa921f76700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0ce1f0 con 0x7fa91c06aae0 2023-10-14T18:45:40.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91c15a290 0x7fa91c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa91c15a290 0x7fa91c06a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42154/0 (socket says 172.21.15.79:42154) 2023-10-14T18:45:40.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa91c159ec0 0x7fa91c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50070/0 (socket says 172.21.15.79:50070) 2023-10-14T18:45:40.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 -- 172.21.15.79:0/463171178 learned_addr learned my addr 172.21.15.79:0/463171178 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:40.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 -- 172.21.15.79:0/463171178 >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 msgr2=0x7fa91c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:40.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91bfff700 1 --2- 172.21.15.79:0/463171178 >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 0x7fa91c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 --2- 172.21.15.79:0/463171178 >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 0x7fa91c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91affd700 1 -- 172.21.15.79:0/463171178 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496360227 0 0) 0x7fa91c0b0790 con 0x7fa91c159ec0 2023-10-14T18:45:40.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 -- 172.21.15.79:0/463171178 >> v1:172.21.15.79:6789/0 conn(0x7fa91c159ec0 legacy=0x7fa91c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 -- 172.21.15.79:0/463171178 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0b0b20 con 0x7fa91c15a290 2023-10-14T18:45:40.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91bfff700 1 --2- 172.21.15.79:0/463171178 >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 0x7fa91c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa912ffd700 1 --2- 172.21.15.79:0/463171178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c06a5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0711f0 tx=0x7fa904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15da9328aa7cdcec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91affd700 1 -- 172.21.15.79:0/463171178 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400b860 con 0x7fa91c15a290 2023-10-14T18:45:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91affd700 1 -- 172.21.15.79:0/463171178 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400b9c0 con 0x7fa91c15a290 2023-10-14T18:45:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.723+0000 7fa91affd700 1 -- 172.21.15.79:0/463171178 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400bd60 con 0x7fa91c15a290 2023-10-14T18:45:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 -- 172.21.15.79:0/463171178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 msgr2=0x7fa91c06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 --2- 172.21.15.79:0/463171178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c06a5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0711f0 tx=0x7fa904009250 comp rx=0 tx=0).stop 2023-10-14T18:45:40.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 -- 172.21.15.79:0/463171178 shutdown_connections 2023-10-14T18:45:40.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 --2- 172.21.15.79:0/463171178 >> v2:172.21.15.144:3300/0 conn(0x7fa91c06aae0 0x7fa91c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 --2- 172.21.15.79:0/463171178 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c06a5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 -- 172.21.15.79:0/463171178 >> 172.21.15.79:0/463171178 conn(0x7fa91c0d1880 msgr2=0x7fa91c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 -- 172.21.15.79:0/463171178 shutdown_connections 2023-10-14T18:45:40.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.724+0000 7fa921f76700 1 -- 172.21.15.79:0/463171178 wait complete. 2023-10-14T18:45:40.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.725+0000 7fa921f76700 1 Processor -- start 2023-10-14T18:45:40.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.725+0000 7fa921f76700 1 -- start start 2023-10-14T18:45:40.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91c06aae0 0x7fa91c1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa91c159ec0 0x7fa91c16d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b50f0 con 0x7fa91c15a290 2023-10-14T18:45:40.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b53d0 con 0x7fa91c06aae0 2023-10-14T18:45:40.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0b56b0 con 0x7fa91c159ec0 2023-10-14T18:45:40.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42158/0 (socket says 172.21.15.79:42158) 2023-10-14T18:45:40.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 -- 172.21.15.79:0/2971462799 learned_addr learned my addr 172.21.15.79:0/2971462799 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:40.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91b7fe700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91c06aae0 0x7fa91c1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa912ffd700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa91c159ec0 0x7fa91c16d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 -- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa91c159ec0 msgr2=0x7fa91c16d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa91c159ec0 0x7fa91c16d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 -- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91c06aae0 msgr2=0x7fa91c1480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91c06aae0 0x7fa91c1480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 -- 172.21.15.79:0/2971462799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040094f0 con 0x7fa91c15a290 2023-10-14T18:45:40.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa91bfff700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa91400a380 tx=0x7fa914007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400ae10 con 0x7fa91c15a290 2023-10-14T18:45:40.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400d650 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400da10 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.726+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c0b5990 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.727+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c0b44c0 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.728+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c04c3c0 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.728+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa91401e3b0 con 0x7fa91c15a290 2023-10-14T18:45:40.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.728+0000 7fa913fff700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:40.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.728+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa914084e80 con 0x7fa91c15a290 2023-10-14T18:45:40.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.729+0000 7fa91b7fe700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:40.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.729+0000 7fa91b7fe700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 0x7fa9000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0011e0 tx=0x7fa90c007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:40.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.732+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9140520f0 con 0x7fa91c15a290 2023-10-14T18:45:40.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.915+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa91c0b04b0 con 0x7fa91c15a290 2023-10-14T18:45:40.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.915+0000 7fa913fff700 1 -- 172.21.15.79:0/2971462799 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa91401a020 con 0x7fa91c15a290 2023-10-14T18:45:40.916 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 msgr2=0x7fa9000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 0x7fa9000693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0011e0 tx=0x7fa90c007bf0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 msgr2=0x7fa91c16da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa91400a380 tx=0x7fa914007900 comp rx=0 tx=0).stop 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 shutdown_connections 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa900066f30 0x7fa9000693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa91c15a290 0x7fa91c16da20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91c06aae0 0x7fa91c1480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 --2- 172.21.15.79:0/2971462799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa91c159ec0 0x7fa91c16d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 >> 172.21.15.79:0/2971462799 conn(0x7fa91c0d1880 msgr2=0x7fa91c158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 shutdown_connections 2023-10-14T18:45:40.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:40.917+0000 7fa921f76700 1 -- 172.21.15.79:0/2971462799 wait complete. 2023-10-14T18:45:40.962 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-14T18:45:40.964 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-14T18:45:40.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-14T18:45:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.079+0000 7efe48b2c700 1 Processor -- start 2023-10-14T18:45:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.079+0000 7efe48b2c700 1 -- start start 2023-10-14T18:45:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe48b2c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe44159e10 0x7efe440b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe48b2c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe4415a1e0 0x7efe440b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe48b2c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4415db80 con 0x7efe440b1610 2023-10-14T18:45:41.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe48b2c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4415e800 con 0x7efe4415a1e0 2023-10-14T18:45:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe48b2c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4415de60 con 0x7efe44159e10 2023-10-14T18:45:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe41d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe4415a1e0 0x7efe440b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe41d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe4415a1e0 0x7efe440b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42166/0 (socket says 172.21.15.79:42166) 2023-10-14T18:45:41.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.080+0000 7efe41d9b700 1 -- 172.21.15.79:0/4058819244 learned_addr learned my addr 172.21.15.79:0/4058819244 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe4259c700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe44159e10 0x7efe440b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe41d9b700 1 -- 172.21.15.79:0/4058819244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe44159e10 msgr2=0x7efe440b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe41d9b700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe44159e10 0x7efe440b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe41d9b700 1 -- 172.21.15.79:0/4058819244 >> v1:172.21.15.144:6789/0 conn(0x7efe440b1610 legacy=0x7efe440cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:41.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe41d9b700 1 -- 172.21.15.79:0/4058819244 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4415e140 con 0x7efe4415a1e0 2023-10-14T18:45:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe41d9b700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4415a1e0 0x7efe440b3260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe440d0ca0 tx=0x7efe38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecb00bb881034a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe4159a700 1 -- 172.21.15.79:0/4058819244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800b820 con 0x7efe4415a1e0 2023-10-14T18:45:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe4159a700 1 -- 172.21.15.79:0/4058819244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800b980 con 0x7efe4415a1e0 2023-10-14T18:45:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe4159a700 1 -- 172.21.15.79:0/4058819244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800bd20 con 0x7efe4415a1e0 2023-10-14T18:45:41.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe48b2c700 1 -- 172.21.15.79:0/4058819244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4415a1e0 msgr2=0x7efe440b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.081+0000 7efe48b2c700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4415a1e0 0x7efe440b3260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efe440d0ca0 tx=0x7efe38009250 comp rx=0 tx=0).stop 2023-10-14T18:45:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 -- 172.21.15.79:0/4058819244 shutdown_connections 2023-10-14T18:45:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe44159e10 0x7efe440b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 --2- 172.21.15.79:0/4058819244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe4415a1e0 0x7efe440b3260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 -- 172.21.15.79:0/4058819244 >> 172.21.15.79:0/4058819244 conn(0x7efe44067660 msgr2=0x7efe44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:41.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 -- 172.21.15.79:0/4058819244 shutdown_connections 2023-10-14T18:45:41.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.082+0000 7efe48b2c700 1 -- 172.21.15.79:0/4058819244 wait complete. 2023-10-14T18:45:41.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 Processor -- start 2023-10-14T18:45:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 -- start start 2023-10-14T18:45:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe440b1610 0x7efe44156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe4415a1e0 0x7efe440c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4415b5a0 con 0x7efe44159e10 2023-10-14T18:45:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4415b880 con 0x7efe440b1610 2023-10-14T18:45:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe48b2c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe440ca5b0 con 0x7efe4415a1e0 2023-10-14T18:45:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe41d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe41d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42182/0 (socket says 172.21.15.79:42182) 2023-10-14T18:45:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.083+0000 7efe41d9b700 1 -- 172.21.15.79:0/2699286873 learned_addr learned my addr 172.21.15.79:0/2699286873 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe42d9d700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe4415a1e0 0x7efe440c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe4259c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe440b1610 0x7efe44156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 -- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe4415a1e0 msgr2=0x7efe440c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe4415a1e0 0x7efe440c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 -- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe440b1610 msgr2=0x7efe44156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe440b1610 0x7efe44156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 -- 172.21.15.79:0/2699286873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380094f0 con 0x7efe44159e10 2023-10-14T18:45:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe41d9b700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe38006fd0 tx=0x7efe38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3801a420 con 0x7efe44159e10 2023-10-14T18:45:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3801a580 con 0x7efe44159e10 2023-10-14T18:45:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe440ca890 con 0x7efe44159e10 2023-10-14T18:45:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3801a940 con 0x7efe44159e10 2023-10-14T18:45:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.084+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe441569a0 con 0x7efe44159e10 2023-10-14T18:45:41.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.085+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4404c3c0 con 0x7efe44159e10 2023-10-14T18:45:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.085+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe3801ad30 con 0x7efe44159e10 2023-10-14T18:45:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.086+0000 7efe327fc700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 0x7efe240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.086+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe38085ee0 con 0x7efe44159e10 2023-10-14T18:45:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.086+0000 7efe4259c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 0x7efe240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.086+0000 7efe4259c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 0x7efe240693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efe440c98f0 tx=0x7efe340097c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.090+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe38053150 con 0x7efe44159e10 2023-10-14T18:45:41.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.347+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7efe4415b9c0 con 0x7efe44159e10 2023-10-14T18:45:41.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.598+0000 7efe327fc700 1 -- 172.21.15.79:0/2699286873 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v47) v1 ==== 133+0+0 (secure 0 0 0) 0x7efe38056770 con 0x7efe44159e10 2023-10-14T18:45:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 msgr2=0x7efe240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 0x7efe240693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efe440c98f0 tx=0x7efe340097c0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 msgr2=0x7efe440c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe38006fd0 tx=0x7efe38017000 comp rx=0 tx=0).stop 2023-10-14T18:45:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 shutdown_connections 2023-10-14T18:45:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efe24066f30 0x7efe240693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe4415a1e0 0x7efe440c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe440b1610 0x7efe44156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 --2- 172.21.15.79:0/2699286873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe44159e10 0x7efe440c9c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 >> 172.21.15.79:0/2699286873 conn(0x7efe44067660 msgr2=0x7efe441572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:41.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 shutdown_connections 2023-10-14T18:45:41.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.600+0000 7efe48b2c700 1 -- 172.21.15.79:0/2699286873 wait complete. 2023-10-14T18:45:41.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-14T18:45:41.742 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_objectstore":"memstore"} 2023-10-14T18:45:41.743 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-14T18:45:41.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:45:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.859+0000 7fe4bf0da700 1 Processor -- start 2023-10-14T18:45:41.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.859+0000 7fe4bf0da700 1 -- start start 2023-10-14T18:45:41.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bf0da700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe4b815a290 0x7fe4b806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bf0da700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4b806aae0 0x7fe4b80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bf0da700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80b0790 con 0x7fe4b8159ec0 2023-10-14T18:45:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bf0da700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b806af20 con 0x7fe4b815a290 2023-10-14T18:45:41.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bf0da700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b80ce1f0 con 0x7fe4b806aae0 2023-10-14T18:45:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4affff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe4b815a290 0x7fe4b806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bce76700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe4b8159ec0 0x7fe4b80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50080/0 (socket says 172.21.15.79:50080) 2023-10-14T18:45:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bce76700 1 -- 172.21.15.79:0/1102202108 learned_addr learned my addr 172.21.15.79:0/1102202108 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4bd677700 1 --2- 172.21.15.79:0/1102202108 >> v2:172.21.15.144:3300/0 conn(0x7fe4b806aae0 0x7fe4b80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4affff700 1 -- 172.21.15.79:0/1102202108 >> v2:172.21.15.144:3300/0 conn(0x7fe4b806aae0 msgr2=0x7fe4b80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4affff700 1 --2- 172.21.15.79:0/1102202108 >> v2:172.21.15.144:3300/0 conn(0x7fe4b806aae0 0x7fe4b80cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4affff700 1 -- 172.21.15.79:0/1102202108 >> v1:172.21.15.79:6789/0 conn(0x7fe4b8159ec0 legacy=0x7fe4b80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.860+0000 7fe4af7fe700 1 -- 172.21.15.79:0/1102202108 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344168968 0 0) 0x7fe4b80b0790 con 0x7fe4b8159ec0 2023-10-14T18:45:41.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4affff700 1 -- 172.21.15.79:0/1102202108 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80b0b20 con 0x7fe4b815a290 2023-10-14T18:45:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4affff700 1 --2- 172.21.15.79:0/1102202108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b815a290 0x7fe4b806a5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80711f0 tx=0x7fe4a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7cc6d953d52619 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4af7fe700 1 -- 172.21.15.79:0/1102202108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8011630 con 0x7fe4b815a290 2023-10-14T18:45:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4af7fe700 1 -- 172.21.15.79:0/1102202108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8011790 con 0x7fe4b815a290 2023-10-14T18:45:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4af7fe700 1 -- 172.21.15.79:0/1102202108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8011b30 con 0x7fe4b815a290 2023-10-14T18:45:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 -- 172.21.15.79:0/1102202108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b815a290 msgr2=0x7fe4b806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/1102202108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b815a290 0x7fe4b806a5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80711f0 tx=0x7fe4a80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 -- 172.21.15.79:0/1102202108 shutdown_connections 2023-10-14T18:45:41.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/1102202108 >> v2:172.21.15.144:3300/0 conn(0x7fe4b806aae0 0x7fe4b80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/1102202108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b815a290 0x7fe4b806a5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 -- 172.21.15.79:0/1102202108 >> 172.21.15.79:0/1102202108 conn(0x7fe4b80d1880 msgr2=0x7fe4b80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 -- 172.21.15.79:0/1102202108 shutdown_connections 2023-10-14T18:45:41.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.861+0000 7fe4bf0da700 1 -- 172.21.15.79:0/1102202108 wait complete. 2023-10-14T18:45:41.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.862+0000 7fe4bf0da700 1 Processor -- start 2023-10-14T18:45:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 -- start start 2023-10-14T18:45:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4b806aae0 0x7fe4b8141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4b815a290 0x7fe4b80c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80b52d0 con 0x7fe4b8159ec0 2023-10-14T18:45:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815d000 con 0x7fe4b806aae0 2023-10-14T18:45:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4bf0da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80b4cc0 con 0x7fe4b815a290 2023-10-14T18:45:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4affff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4affff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42198/0 (socket says 172.21.15.79:42198) 2023-10-14T18:45:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.863+0000 7fe4affff700 1 -- 172.21.15.79:0/4192802826 learned_addr learned my addr 172.21.15.79:0/4192802826 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4bce76700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4b806aae0 0x7fe4b8141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4bd677700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4b815a290 0x7fe4b80c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 -- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4b815a290 msgr2=0x7fe4b80c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4b815a290 0x7fe4b80c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 -- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4b806aae0 msgr2=0x7fe4b8141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4b806aae0 0x7fe4b8141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:41.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 -- 172.21.15.79:0/4192802826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009420 con 0x7fe4b8159ec0 2023-10-14T18:45:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4affff700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8071eb0 tx=0x7fe4a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8011b10 con 0x7fe4b8159ec0 2023-10-14T18:45:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a8000cc0 con 0x7fe4b8159ec0 2023-10-14T18:45:41.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8023600 con 0x7fe4b8159ec0 2023-10-14T18:45:41.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b815cd20 con 0x7fe4b8159ec0 2023-10-14T18:45:41.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.864+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b815c000 con 0x7fe4b8159ec0 2023-10-14T18:45:41.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.865+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b80b3470 con 0x7fe4b8159ec0 2023-10-14T18:45:41.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.865+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4a80193b0 con 0x7fe4b8159ec0 2023-10-14T18:45:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.866+0000 7fe4acff9700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 0x7fe4a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.866+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4a8085960 con 0x7fe4b8159ec0 2023-10-14T18:45:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.866+0000 7fe4bce76700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 0x7fe4a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:41.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.866+0000 7fe4bce76700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 0x7fe4a40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4002230 tx=0x7fe4b4001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:41.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:41.870+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4a8052bd0 con 0x7fe4b8159ec0 2023-10-14T18:45:42.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.054+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe4b804c3c0 con 0x7fe4b8159ec0 2023-10-14T18:45:42.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.058+0000 7fe4acff9700 1 -- 172.21.15.79:0/4192802826 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe4a80280c0 con 0x7fe4b8159ec0 2023-10-14T18:45:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 msgr2=0x7fe4a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 0x7fe4a40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4002230 tx=0x7fe4b4001a20 comp rx=0 tx=0).stop 2023-10-14T18:45:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 msgr2=0x7fe4b80c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8071eb0 tx=0x7fe4a8017000 comp rx=0 tx=0).stop 2023-10-14T18:45:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 shutdown_connections 2023-10-14T18:45:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe4a4066f30 0x7fe4a40693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4b815a290 0x7fe4b80c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4b806aae0 0x7fe4b8141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 --2- 172.21.15.79:0/4192802826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe4b8159ec0 0x7fe4b80c7e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 >> 172.21.15.79:0/4192802826 conn(0x7fe4b80d1880 msgr2=0x7fe4b81574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 shutdown_connections 2023-10-14T18:45:42.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.060+0000 7fe4bf0da700 1 -- 172.21.15.79:0/4192802826 wait complete. 2023-10-14T18:45:42.072 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:45:42.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:45:42.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:45:42.160 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:45:42.161 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:45:42.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:45:42.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T18:45:42.194 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:45:42.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:42.195 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:45:42.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:45:42.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:45:42.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T18:45:42.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:45:42.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:42.286 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:45:42.341 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T18:45:42.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:45:42.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T18:45:42.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:45:42.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:42.379 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T18:45:42.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T18:45:42.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:45:42.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T18:45:42.472 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:45:42.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:45:42.473 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T18:45:42.529 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:45:42.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.645+0000 7fdcbdbce700 1 Processor -- start 2023-10-14T18:45:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.645+0000 7fdcbdbce700 1 -- start start 2023-10-14T18:45:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcbdbce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 0x7fdcb8157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcbdbce700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdcb8069de0 0x7fdcb8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcbdbce700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb8069060 con 0x7fdcb80c9930 2023-10-14T18:45:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcbdbce700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb8069300 con 0x7fdcb8069de0 2023-10-14T18:45:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcbdbce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80695e0 con 0x7fdcb80c9560 2023-10-14T18:45:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcb6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdcb8069de0 0x7fdcb8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcb7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdcb80c9930 0x7fdcb815bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50094/0 (socket says 172.21.15.79:50094) 2023-10-14T18:45:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.646+0000 7fdcb7fff700 1 -- 172.21.15.79:0/1718177141 learned_addr learned my addr 172.21.15.79:0/1718177141 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb77fe700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 0x7fdcb8157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb6ffd700 1 -- 172.21.15.79:0/1718177141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 msgr2=0x7fdcb8157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb6ffd700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 0x7fdcb8157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb6ffd700 1 -- 172.21.15.79:0/1718177141 >> v1:172.21.15.79:6789/0 conn(0x7fdcb80c9930 legacy=0x7fdcb815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb6ffd700 1 -- 172.21.15.79:0/1718177141 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80698c0 con 0x7fdcb8069de0 2023-10-14T18:45:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb67fc700 1 -- 172.21.15.79:0/1718177141 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915308432 0 0) 0x7fdcb8069060 con 0x7fdcb80c9930 2023-10-14T18:45:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb77fe700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 0x7fdcb8157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb6ffd700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb8069de0 0x7fdcb8157f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0098e0 tx=0x7fdcac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1745b4056802d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb67fc700 1 -- 172.21.15.79:0/1718177141 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac009e80 con 0x7fdcb8069de0 2023-10-14T18:45:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb67fc700 1 -- 172.21.15.79:0/1718177141 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00b860 con 0x7fdcb8069de0 2023-10-14T18:45:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.647+0000 7fdcb67fc700 1 -- 172.21.15.79:0/1718177141 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00bbe0 con 0x7fdcb8069de0 2023-10-14T18:45:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 -- 172.21.15.79:0/1718177141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb8069de0 msgr2=0x7fdcb8157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb8069de0 0x7fdcb8157f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0098e0 tx=0x7fdcac0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 -- 172.21.15.79:0/1718177141 shutdown_connections 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb80c9560 0x7fdcb8157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/1718177141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb8069de0 0x7fdcb8157f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 -- 172.21.15.79:0/1718177141 >> 172.21.15.79:0/1718177141 conn(0x7fdcb8067660 msgr2=0x7fdcb8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 -- 172.21.15.79:0/1718177141 shutdown_connections 2023-10-14T18:45:42.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.648+0000 7fdcbdbce700 1 -- 172.21.15.79:0/1718177141 wait complete. 2023-10-14T18:45:42.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.649+0000 7fdcbdbce700 1 Processor -- start 2023-10-14T18:45:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.649+0000 7fdcbdbce700 1 -- start start 2023-10-14T18:45:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb8069de0 0x7fdcb8145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 0x7fdcb80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c5330 con 0x7fdcb80c9930 2023-10-14T18:45:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80c0370 con 0x7fdcb80c9560 2023-10-14T18:45:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb81692b0 con 0x7fdcb8069de0 2023-10-14T18:45:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42216/0 (socket says 172.21.15.79:42216) 2023-10-14T18:45:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 -- 172.21.15.79:0/2032872606 learned_addr learned my addr 172.21.15.79:0/2032872606 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb6ffd700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 0x7fdcb80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb77fe700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb8069de0 0x7fdcb8145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 -- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb8069de0 msgr2=0x7fdcb8145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb8069de0 0x7fdcb8145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 -- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 msgr2=0x7fdcb80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 0x7fdcb80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 -- 172.21.15.79:0/2032872606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac009420 con 0x7fdcb80c9930 2023-10-14T18:45:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb6ffd700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 0x7fdcb80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcb7fff700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c530 tx=0x7fdcb0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:42.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0005b30 con 0x7fdcb80c9930 2023-10-14T18:45:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb0005c90 con 0x7fdcb80c9930 2023-10-14T18:45:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb80c1b40 con 0x7fdcb80c9930 2023-10-14T18:45:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0007320 con 0x7fdcb80c9930 2023-10-14T18:45:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.650+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb8168980 con 0x7fdcb80c9930 2023-10-14T18:45:42.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.651+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb804c3c0 con 0x7fdcb80c9930 2023-10-14T18:45:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.652+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcb001b3b0 con 0x7fdcb80c9930 2023-10-14T18:45:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.652+0000 7fdc9f7fe700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 0x7fdca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.652+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdcb0083a50 con 0x7fdcb80c9930 2023-10-14T18:45:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.652+0000 7fdcb77fe700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 0x7fdca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:42.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.653+0000 7fdcb77fe700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 0x7fdca40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdca80076a0 tx=0x7fdca80098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:42.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.656+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcb0050cc0 con 0x7fdcb80c9930 2023-10-14T18:45:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.881+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcb81693f0 con 0x7fdcb80c9930 2023-10-14T18:45:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.881+0000 7fdc9f7fe700 1 -- 172.21.15.79:0/2032872606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fdcb0017090 con 0x7fdcb80c9930 2023-10-14T18:45:42.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:42.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 msgr2=0x7fdca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 0x7fdca40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdca80076a0 tx=0x7fdca80098f0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 msgr2=0x7fdcb80cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000c530 tx=0x7fdcb0007f90 comp rx=0 tx=0).stop 2023-10-14T18:45:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 shutdown_connections 2023-10-14T18:45:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca4066f30 0x7fdca40693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcb80c9930 0x7fdcb80cbeb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcb8069de0 0x7fdcb8145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 --2- 172.21.15.79:0/2032872606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcb80c9560 0x7fdcb80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 >> 172.21.15.79:0/2032872606 conn(0x7fdcb8067660 msgr2=0x7fdcb8156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 shutdown_connections 2023-10-14T18:45:42.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:42.883+0000 7fdcbdbce700 1 -- 172.21.15.79:0/2032872606 wait complete. 2023-10-14T18:45:42.887 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:42.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:43.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.010+0000 7fcaf5803700 1 Processor -- start 2023-10-14T18:45:43.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.010+0000 7fcaf5803700 1 -- start start 2023-10-14T18:45:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.010+0000 7fcaf5803700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcaf01579d0 0x7fcaf00ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.010+0000 7fcaf5803700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcaf00aeaa0 0x7fcaf00aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaf5803700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf00afbc0 con 0x7fcaf006ea40 2023-10-14T18:45:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaf5803700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00ac9b0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaf5803700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00af600 con 0x7fcaf01579d0 2023-10-14T18:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcaf00aeaa0 0x7fcaf00aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaef7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcaf006ea40 0x7fcaf006ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50108/0 (socket says 172.21.15.79:50108) 2023-10-14T18:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaef7fe700 1 -- 172.21.15.79:0/1141535833 learned_addr learned my addr 172.21.15.79:0/1141535833 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaeeffd700 1 --2- 172.21.15.79:0/1141535833 >> v2:172.21.15.144:3300/0 conn(0x7fcaf01579d0 0x7fcaf00ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 -- 172.21.15.79:0/1141535833 >> v2:172.21.15.144:3300/0 conn(0x7fcaf01579d0 msgr2=0x7fcaf00ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 --2- 172.21.15.79:0/1141535833 >> v2:172.21.15.144:3300/0 conn(0x7fcaf01579d0 0x7fcaf00ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 -- 172.21.15.79:0/1141535833 >> v1:172.21.15.79:6789/0 conn(0x7fcaf006ea40 legacy=0x7fcaf006ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaee7fc700 1 -- 172.21.15.79:0/1141535833 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458866970 0 0) 0x7fcae8001490 con 0x7fcaf006ea40 2023-10-14T18:45:43.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 -- 172.21.15.79:0/1141535833 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00af8e0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcae67fc700 1 --2- 172.21.15.79:0/1141535833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00aef10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0069000 tx=0x7fcad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a80af4582e49e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaee7fc700 1 -- 172.21.15.79:0/1141535833 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800b6b0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaee7fc700 1 -- 172.21.15.79:0/1141535833 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800b810 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.011+0000 7fcaee7fc700 1 -- 172.21.15.79:0/1141535833 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800bbb0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 -- 172.21.15.79:0/1141535833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 msgr2=0x7fcaf00aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 --2- 172.21.15.79:0/1141535833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00aef10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0069000 tx=0x7fcad80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 -- 172.21.15.79:0/1141535833 shutdown_connections 2023-10-14T18:45:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 --2- 172.21.15.79:0/1141535833 >> v2:172.21.15.144:3300/0 conn(0x7fcaf01579d0 0x7fcaf00ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 --2- 172.21.15.79:0/1141535833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00aef10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 -- 172.21.15.79:0/1141535833 >> 172.21.15.79:0/1141535833 conn(0x7fcaf00cd270 msgr2=0x7fcaf00cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 -- 172.21.15.79:0/1141535833 shutdown_connections 2023-10-14T18:45:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.012+0000 7fcaf5803700 1 -- 172.21.15.79:0/1141535833 wait complete. 2023-10-14T18:45:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.013+0000 7fcaf5803700 1 Processor -- start 2023-10-14T18:45:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.013+0000 7fcaf5803700 1 -- start start 2023-10-14T18:45:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 0x7fcaf00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcaf01579d0 0x7fcaf00c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00b2ec0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00b01a0 con 0x7fcaf006ea40 2023-10-14T18:45:43.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaf5803700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00ccc80 con 0x7fcaf01579d0 2023-10-14T18:45:43.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42230/0 (socket says 172.21.15.79:42230) 2023-10-14T18:45:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 -- 172.21.15.79:0/815893467 learned_addr learned my addr 172.21.15.79:0/815893467 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaeeffd700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 0x7fcaf00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaef7fe700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcaf01579d0 0x7fcaf00c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 -- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcaf01579d0 msgr2=0x7fcaf00c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcaf01579d0 0x7fcaf00c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 -- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 msgr2=0x7fcaf00c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 0x7fcaf00c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 -- 172.21.15.79:0/815893467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009420 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcaeeffd700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 0x7fcaf00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:43.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.014+0000 7fcae67fc700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0071200 tx=0x7fcad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011420 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8011580 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf00b03f0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011940 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf00b09b0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.015+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf006c6b0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.016+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcad8011cf0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.016+0000 7fcae77fe700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 0x7fcad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.016+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcad8085f60 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.017+0000 7fcaeeffd700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 0x7fcad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.017+0000 7fcaeeffd700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 0x7fcad00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcae0006fd0 tx=0x7fcae0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.021+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcad80531d0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.205+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaf004bb80 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.206+0000 7fcae77fe700 1 -- 172.21.15.79:0/815893467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcad80567f0 con 0x7fcaf00aeaa0 2023-10-14T18:45:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:43.207 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:43.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.207+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 msgr2=0x7fcad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.207+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 0x7fcad00693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcae0006fd0 tx=0x7fcae0008040 comp rx=0 tx=0).stop 2023-10-14T18:45:43.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.207+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 msgr2=0x7fcaf00c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.207+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0071200 tx=0x7fcad8017000 comp rx=0 tx=0).stop 2023-10-14T18:45:43.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 shutdown_connections 2023-10-14T18:45:43.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcad0066f30 0x7fcad00693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcaf01579d0 0x7fcaf00c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcaf006ea40 0x7fcaf00c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 --2- 172.21.15.79:0/815893467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaf00aeaa0 0x7fcaf00c7930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 >> 172.21.15.79:0/815893467 conn(0x7fcaf00cd270 msgr2=0x7fcaf015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 shutdown_connections 2023-10-14T18:45:43.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.208+0000 7fcaf5803700 1 -- 172.21.15.79:0/815893467 wait complete. 2023-10-14T18:45:43.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:08.220687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:08.836877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:45:43.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:43.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.338+0000 7f09993c4700 1 Processor -- start 2023-10-14T18:45:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.338+0000 7f09993c4700 1 -- start start 2023-10-14T18:45:43.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09993c4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f099415a290 0x7f099406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09993c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f09940cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09993c4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940b0790 con 0x7f0994159ec0 2023-10-14T18:45:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09993c4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099406af60 con 0x7f099415a290 2023-10-14T18:45:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09993c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940ce1f0 con 0x7f099406aae0 2023-10-14T18:45:43.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0992ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0994159ec0 0x7f09940af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50122/0 (socket says 172.21.15.79:50122) 2023-10-14T18:45:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0992ffd700 1 -- 172.21.15.79:0/998169436 learned_addr learned my addr 172.21.15.79:0/998169436 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332535012 0 0) 0x7f09940b0790 con 0x7f0994159ec0 2023-10-14T18:45:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09927fc700 1 --2- 172.21.15.79:0/998169436 >> v2:172.21.15.144:3300/0 conn(0x7f099415a290 0x7f099406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c003570 con 0x7f0994159ec0 2023-10-14T18:45:43.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f09937fe700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f09940cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736817225 0 0) 0x7f097c003570 con 0x7f0994159ec0 2023-10-14T18:45:43.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 msgr2=0x7f09940cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f09940cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 >> v2:172.21.15.144:3300/0 conn(0x7f099415a290 msgr2=0x7f099406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 --2- 172.21.15.79:0/998169436 >> v2:172.21.15.144:3300/0 conn(0x7f099415a290 0x7f099406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940b0b20 con 0x7f0994159ec0 2023-10-14T18:45:43.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f098c001470 con 0x7f0994159ec0 2023-10-14T18:45:43.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 >> v1:172.21.15.79:6789/0 conn(0x7f0994159ec0 legacy=0x7f09940af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f097c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f097c003fe0 0x7f097c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f097c004d50 0x7f097c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099406af60 con 0x7f097c004d50 2023-10-14T18:45:43.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940ce1f0 con 0x7f097c003fe0 2023-10-14T18:45:43.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.339+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c00ba90 con 0x7f099406aae0 2023-10-14T18:45:43.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f097c004d50 0x7f097c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f0992ffd700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f097c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09927fc700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f097c003fe0 0x7f097c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 -- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 msgr2=0x7f097c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099406aae0 0x7f097c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 -- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f097c003fe0 msgr2=0x7f097c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f097c003fe0 0x7f097c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 -- 172.21.15.79:0/998169436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c003570 con 0x7f097c004d50 2023-10-14T18:45:43.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f097c004d50 0x7f097c0051c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0984009c00 tx=0x7f09840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7458d8ef18dd11b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400e6b0 con 0x7f097c004d50 2023-10-14T18:45:43.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400e810 con 0x7f097c004d50 2023-10-14T18:45:43.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f0991ffb700 1 -- 172.21.15.79:0/998169436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400ebd0 con 0x7f097c004d50 2023-10-14T18:45:43.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09993c4700 1 -- 172.21.15.79:0/998169436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f097c004d50 msgr2=0x7f097c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09993c4700 1 --2- 172.21.15.79:0/998169436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f097c004d50 0x7f097c0051c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0984009c00 tx=0x7f09840091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.340+0000 7f09937fe700 1 -- 172.21.15.79:0/998169436 reap_dead start 2023-10-14T18:45:43.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.341+0000 7f09993c4700 1 -- 172.21.15.79:0/998169436 shutdown_connections 2023-10-14T18:45:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.341+0000 7f09993c4700 1 -- 172.21.15.79:0/998169436 >> 172.21.15.79:0/998169436 conn(0x7f09940d1880 msgr2=0x7f09940cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.341+0000 7f09993c4700 1 -- 172.21.15.79:0/998169436 shutdown_connections 2023-10-14T18:45:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.341+0000 7f09993c4700 1 -- 172.21.15.79:0/998169436 wait complete. 2023-10-14T18:45:43.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 Processor -- start 2023-10-14T18:45:43.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 -- start start 2023-10-14T18:45:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09941554c0 0x7f099415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099415add0 0x7f09940c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099415b240 con 0x7f09940c9d50 2023-10-14T18:45:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b0160 con 0x7f09941554c0 2023-10-14T18:45:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.342+0000 7f09993c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b4d30 con 0x7f099415add0 2023-10-14T18:45:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42246/0 (socket says 172.21.15.79:42246) 2023-10-14T18:45:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 -- 172.21.15.79:0/1011777064 learned_addr learned my addr 172.21.15.79:0/1011777064 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09927fc700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099415add0 0x7f09940c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f0992ffd700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09941554c0 0x7f099415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 -- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099415add0 msgr2=0x7f09940c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099415add0 0x7f09940c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 -- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09941554c0 msgr2=0x7f099415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09941554c0 0x7f099415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 -- 172.21.15.79:0/1011777064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994155e60 con 0x7f09940c9d50 2023-10-14T18:45:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09937fe700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f097c004730 tx=0x7f098401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984022070 con 0x7f09940c9d50 2023-10-14T18:45:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400eb90 con 0x7f09940c9d50 2023-10-14T18:45:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09940ca1a0 con 0x7f09940c9d50 2023-10-14T18:45:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098400e6b0 con 0x7f09940c9d50 2023-10-14T18:45:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.343+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940ca420 con 0x7f09940c9d50 2023-10-14T18:45:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.344+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09940b4ec0 con 0x7f09940c9d50 2023-10-14T18:45:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.344+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f098401c450 con 0x7f09940c9d50 2023-10-14T18:45:43.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.345+0000 7f097affd700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.345+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0984000e40 con 0x7f09940c9d50 2023-10-14T18:45:43.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.345+0000 7f0992ffd700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.346+0000 7f0992ffd700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 0x7f09800693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f098c0079e0 tx=0x7f098c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.349+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0984053260 con 0x7f09940c9d50 2023-10-14T18:45:43.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.528+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f099415b1a0 con 0x7f09940c9d50 2023-10-14T18:45:43.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.529+0000 7f097affd700 1 -- 172.21.15.79:0/1011777064 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0984056880 con 0x7f09940c9d50 2023-10-14T18:45:43.530 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 msgr2=0x7f09800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 0x7f09800693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f098c0079e0 tx=0x7f098c009040 comp rx=0 tx=0).stop 2023-10-14T18:45:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 msgr2=0x7f09940b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f097c004730 tx=0x7f098401a000 comp rx=0 tx=0).stop 2023-10-14T18:45:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 shutdown_connections 2023-10-14T18:45:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0980066f30 0x7f09800693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09940c9d50 0x7f09940b51c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09941554c0 0x7f099415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 --2- 172.21.15.79:0/1011777064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f099415add0 0x7f09940c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 >> 172.21.15.79:0/1011777064 conn(0x7f09940d1880 msgr2=0x7f0994157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 shutdown_connections 2023-10-14T18:45:43.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.531+0000 7f09993c4700 1 -- 172.21.15.79:0/1011777064 wait complete. 2023-10-14T18:45:43.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:45:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.660+0000 7f4f528ba700 1 Processor -- start 2023-10-14T18:45:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.660+0000 7f4f528ba700 1 -- start start 2023-10-14T18:45:43.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f528ba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f4c159ec0 0x7f4f4c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f528ba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0b0790 con 0x7f4f4c06acb0 2023-10-14T18:45:43.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f528ba700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c0ce1f0 con 0x7f4f4c15a290 2023-10-14T18:45:43.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f528ba700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b0b20 con 0x7f4f4c159ec0 2023-10-14T18:45:43.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f50e57700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4f4c06acb0 0x7f4f4c0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50130/0 (socket says 172.21.15.79:50130) 2023-10-14T18:45:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f50e57700 1 -- 172.21.15.79:0/3185917537 learned_addr learned my addr 172.21.15.79:0/3185917537 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3185917537 >> v2:172.21.15.144:3300/0 conn(0x7f4f4c159ec0 0x7f4f4c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.661+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579716005 0 0) 0x7f4f4c0b0790 con 0x7f4f4c06acb0 2023-10-14T18:45:43.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f34003570 con 0x7f4f4c06acb0 2023-10-14T18:45:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199521387 0 0) 0x7f4f34003570 con 0x7f4f4c06acb0 2023-10-14T18:45:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 >> v2:172.21.15.144:3300/0 conn(0x7f4f4c159ec0 msgr2=0x7f4f4c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 --2- 172.21.15.79:0/3185917537 >> v2:172.21.15.144:3300/0 conn(0x7f4f4c159ec0 0x7f4f4c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 >> v1:172.21.15.144:6789/0 conn(0x7f4f4c15a290 legacy=0x7f4f4c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0b04b0 con 0x7f4f4c06acb0 2023-10-14T18:45:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4f440017f0 con 0x7f4f4c06acb0 2023-10-14T18:45:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 >> v1:172.21.15.79:6789/0 conn(0x7f4f4c06acb0 legacy=0x7f4f4c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 0x7f4f34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34004810 0x7f4f34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f340051c0 0x7f4f3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b0b20 con 0x7f4f34003a60 2023-10-14T18:45:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3400c160 con 0x7f4f34004810 2023-10-14T18:45:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3400c320 con 0x7f4f340051c0 2023-10-14T18:45:43.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 0x7f4f34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f50e57700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f340051c0 0x7f4f3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4b7fe700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34004810 0x7f4f34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 -- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f340051c0 msgr2=0x7f4f3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f340051c0 0x7f4f3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 -- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34004810 msgr2=0x7f4f34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34004810 0x7f4f34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 -- 172.21.15.79:0/3185917537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34003570 con 0x7f4f34003a60 2023-10-14T18:45:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f50e57700 1 -- 172.21.15.79:0/3185917537 reap_dead start 2023-10-14T18:45:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 0x7f4f34003e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009c00 tx=0x7f4f3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be05d6816a77160a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.662+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00e710 con 0x7f4f34003a60 2023-10-14T18:45:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00e870 con 0x7f4f34003a60 2023-10-14T18:45:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f4affd700 1 -- 172.21.15.79:0/3185917537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00ec30 con 0x7f4f34003a60 2023-10-14T18:45:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 -- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 msgr2=0x7f4f34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 0x7f4f34003e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009c00 tx=0x7f4f3c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 -- 172.21.15.79:0/3185917537 shutdown_connections 2023-10-14T18:45:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3185917537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f34003a60 0x7f4f34003e70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 -- 172.21.15.79:0/3185917537 >> 172.21.15.79:0/3185917537 conn(0x7f4f4c0d1880 msgr2=0x7f4f4c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 -- 172.21.15.79:0/3185917537 shutdown_connections 2023-10-14T18:45:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.663+0000 7f4f528ba700 1 -- 172.21.15.79:0/3185917537 wait complete. 2023-10-14T18:45:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.664+0000 7f4f528ba700 1 Processor -- start 2023-10-14T18:45:43.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.664+0000 7f4f528ba700 1 -- start start 2023-10-14T18:45:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34003a60 0x7f4f4c16a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f4c157db0 0x7f4f4c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b6880 con 0x7f4f4c157940 2023-10-14T18:45:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c95d0 con 0x7f4f34003a60 2023-10-14T18:45:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f528ba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0c98b0 con 0x7f4f4c157db0 2023-10-14T18:45:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42270/0 (socket says 172.21.15.79:42270) 2023-10-14T18:45:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 -- 172.21.15.79:0/3741892413 learned_addr learned my addr 172.21.15.79:0/3741892413 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f50e57700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f4c157db0 0x7f4f4c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34003a60 0x7f4f4c16a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 -- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f4c157db0 msgr2=0x7f4f4c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f4c157db0 0x7f4f4c0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 -- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34003a60 msgr2=0x7f4f4c16a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34003a60 0x7f4f4c16a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.665+0000 7f4f4b7fe700 1 -- 172.21.15.79:0/3741892413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0c9b90 con 0x7f4f4c157940 2023-10-14T18:45:43.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f4b7fe700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f400078a0 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40012660 con 0x7f4f4c157940 2023-10-14T18:45:43.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400127c0 con 0x7f4f4c157940 2023-10-14T18:45:43.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c0b4d50 con 0x7f4f4c157940 2023-10-14T18:45:43.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40012b80 con 0x7f4f4c157940 2023-10-14T18:45:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.666+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c0b6300 con 0x7f4f4c157940 2023-10-14T18:45:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.667+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c0c9f00 con 0x7f4f4c157940 2023-10-14T18:45:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.667+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f4001d460 con 0x7f4f4c157940 2023-10-14T18:45:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.668+0000 7f4f33fff700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 0x7f4f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.668+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f400845a0 con 0x7f4f4c157940 2023-10-14T18:45:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.668+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 0x7f4f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.668+0000 7f4f4bfff700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 0x7f4f380693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0091e0 tx=0x7f4f3c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.672+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f40051810 con 0x7f4f4c157940 2023-10-14T18:45:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.851+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f4c04c3c0 con 0x7f4f4c157940 2023-10-14T18:45:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.852+0000 7f4f33fff700 1 -- 172.21.15.79:0/3741892413 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f40054e30 con 0x7f4f4c157940 2023-10-14T18:45:43.853 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:45:43.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 msgr2=0x7f4f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 0x7f4f380693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0091e0 tx=0x7f4f3c01a000 comp rx=0 tx=0).stop 2023-10-14T18:45:43.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 msgr2=0x7f4f4c0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f400078a0 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 shutdown_connections 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f38066f30 0x7f4f380693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f4c157db0 0x7f4f4c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f34003a60 0x7f4f4c16a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 --2- 172.21.15.79:0/3741892413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f4c157940 0x7f4f4c0b5dc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 >> 172.21.15.79:0/3741892413 conn(0x7f4f4c0d1880 msgr2=0x7f4f4c0cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 shutdown_connections 2023-10-14T18:45:43.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.854+0000 7f4f528ba700 1 -- 172.21.15.79:0/3741892413 wait complete. 2023-10-14T18:45:43.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:45:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.982+0000 7f6b7ed83700 1 Processor -- start 2023-10-14T18:45:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.982+0000 7f6b7ed83700 1 -- start start 2023-10-14T18:45:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7ed83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b78159ec0 0x7f6b780af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7ed83700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b7806acb0 0x7f6b780afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7ed83700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780b0790 con 0x7f6b7815a290 2023-10-14T18:45:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7ed83700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780ce1f0 con 0x7f6b78159ec0 2023-10-14T18:45:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7ed83700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780b0b20 con 0x7f6b7806acb0 2023-10-14T18:45:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b78159ec0 0x7f6b780af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b78159ec0 0x7f6b780af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42274/0 (socket says 172.21.15.79:42274) 2023-10-14T18:45:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/3264864793 learned_addr learned my addr 172.21.15.79:0/3264864793 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/3264864793 >> v2:172.21.15.144:3300/0 conn(0x7f6b7806acb0 msgr2=0x7f6b780afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 --2- 172.21.15.79:0/3264864793 >> v2:172.21.15.144:3300/0 conn(0x7f6b7806acb0 0x7f6b780afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/3264864793 >> v1:172.21.15.144:6789/0 conn(0x7f6b7815a290 legacy=0x7f6b7806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/3264864793 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780b04b0 con 0x7f6b78159ec0 2023-10-14T18:45:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b7cb1f700 1 --2- 172.21.15.79:0/3264864793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b78159ec0 0x7f6b780af940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b780711f0 tx=0x7f6b68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce978ac543e8d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.983+0000 7f6b777fe700 1 -- 172.21.15.79:0/3264864793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800b820 con 0x7f6b78159ec0 2023-10-14T18:45:43.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b777fe700 1 -- 172.21.15.79:0/3264864793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6800b980 con 0x7f6b78159ec0 2023-10-14T18:45:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b777fe700 1 -- 172.21.15.79:0/3264864793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800bd20 con 0x7f6b78159ec0 2023-10-14T18:45:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 -- 172.21.15.79:0/3264864793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b78159ec0 msgr2=0x7f6b780af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/3264864793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b78159ec0 0x7f6b780af940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b780711f0 tx=0x7f6b68009250 comp rx=0 tx=0).stop 2023-10-14T18:45:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 -- 172.21.15.79:0/3264864793 shutdown_connections 2023-10-14T18:45:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/3264864793 >> v2:172.21.15.144:3300/0 conn(0x7f6b7806acb0 0x7f6b780afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/3264864793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b78159ec0 0x7f6b780af940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 -- 172.21.15.79:0/3264864793 >> 172.21.15.79:0/3264864793 conn(0x7f6b780d1880 msgr2=0x7f6b780cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 -- 172.21.15.79:0/3264864793 shutdown_connections 2023-10-14T18:45:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.984+0000 7f6b7ed83700 1 -- 172.21.15.79:0/3264864793 wait complete. 2023-10-14T18:45:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.985+0000 7f6b7ed83700 1 Processor -- start 2023-10-14T18:45:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.985+0000 7f6b7ed83700 1 -- start start 2023-10-14T18:45:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b78159ec0 0x7f6b7816aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 0x7f6b7816afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7816b630 con 0x7f6b7806acb0 2023-10-14T18:45:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7816b910 con 0x7f6b78159ec0 2023-10-14T18:45:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7ed83700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7816bc60 con 0x7f6b7815a290 2023-10-14T18:45:43.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7cb1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7cb1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42290/0 (socket says 172.21.15.79:42290) 2023-10-14T18:45:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/510990985 learned_addr learned my addr 172.21.15.79:0/510990985 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b77fff700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b78159ec0 0x7f6b7816aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7d320700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 0x7f6b7816afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:43.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 msgr2=0x7f6b7816afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.986+0000 7f6b7cb1f700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 0x7f6b7816afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b78159ec0 msgr2=0x7f6b7816aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:43.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7cb1f700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b78159ec0 0x7f6b7816aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:43.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7cb1f700 1 -- 172.21.15.79:0/510990985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094f0 con 0x7f6b7806acb0 2023-10-14T18:45:43.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7d320700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 0x7f6b7816afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:43.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7cb1f700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009290 tx=0x7f6b68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:43.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68026480 con 0x7f6b7806acb0 2023-10-14T18:45:43.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6801f070 con 0x7f6b7806acb0 2023-10-14T18:45:43.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7816bf40 con 0x7f6b7806acb0 2023-10-14T18:45:43.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68026850 con 0x7f6b7806acb0 2023-10-14T18:45:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.987+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b780cb670 con 0x7f6b7806acb0 2023-10-14T18:45:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.988+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7804c3c0 con 0x7f6b7806acb0 2023-10-14T18:45:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.988+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b6801a440 con 0x7f6b7806acb0 2023-10-14T18:45:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.989+0000 7f6b74ff9700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.989+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b68021070 con 0x7f6b7806acb0 2023-10-14T18:45:44.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.989+0000 7f6b77fff700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.989+0000 7f6b77fff700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 0x7f6b640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b780aff30 tx=0x7f6b6c009780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:43.993+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b68053910 con 0x7f6b7806acb0 2023-10-14T18:45:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.174+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b780ceab0 con 0x7f6b7806acb0 2023-10-14T18:45:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.175+0000 7f6b74ff9700 1 -- 172.21.15.79:0/510990985 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b68056f30 con 0x7f6b7806acb0 2023-10-14T18:45:44.176 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:45:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 msgr2=0x7f6b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 0x7f6b640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b780aff30 tx=0x7f6b6c009780 comp rx=0 tx=0).stop 2023-10-14T18:45:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 msgr2=0x7f6b780ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009290 tx=0x7f6b68016000 comp rx=0 tx=0).stop 2023-10-14T18:45:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 shutdown_connections 2023-10-14T18:45:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6b64066f30 0x7f6b640693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6b7815a290 0x7f6b7816afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b7806acb0 0x7f6b780ca200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 --2- 172.21.15.79:0/510990985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b78159ec0 0x7f6b7816aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 >> 172.21.15.79:0/510990985 conn(0x7f6b780d1880 msgr2=0x7f6b780b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 shutdown_connections 2023-10-14T18:45:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.177+0000 7f6b7ed83700 1 -- 172.21.15.79:0/510990985 wait complete. 2023-10-14T18:45:44.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:44.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 Processor -- start 2023-10-14T18:45:44.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 -- start start 2023-10-14T18:45:44.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 0x7f9d6c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c15cbb0 con 0x7f9d6c15a620 2023-10-14T18:45:44.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6c15bfa0 con 0x7f9d6c157870 2023-10-14T18:45:44.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.303+0000 7f9d71364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c15c280 con 0x7f9d6c157c40 2023-10-14T18:45:44.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6affd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 0x7f9d6c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:50690/0 (socket says 172.21.15.79:50690) 2023-10-14T18:45:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 -- 172.21.15.79:0/708960606 learned_addr learned my addr 172.21.15.79:0/708960606 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6a7fc700 1 --1- 172.21.15.79:0/708960606 >> v1:172.21.15.144:6789/0 conn(0x7f9d6c15a620 0x7f9d6c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54120/0 (socket says 172.21.15.79:54120) 2023-10-14T18:45:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 -- 172.21.15.79:0/708960606 >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 msgr2=0x7f9d6c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:44.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 --2- 172.21.15.79:0/708960606 >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 0x7f9d6c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 -- 172.21.15.79:0/708960606 >> v1:172.21.15.144:6789/0 conn(0x7f9d6c15a620 legacy=0x7f9d6c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 -- 172.21.15.79:0/708960606 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c15c560 con 0x7f9d6c157c40 2023-10-14T18:45:44.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6affd700 1 --2- 172.21.15.79:0/708960606 >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 0x7f9d6c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:44.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d6b7fe700 1 --2- 172.21.15.79:0/708960606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d640099b0 tx=0x7f9d64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c9b73e07170a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.304+0000 7f9d69ffb700 1 -- 172.21.15.79:0/708960606 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64009ea0 con 0x7f9d6c157c40 2023-10-14T18:45:44.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d69ffb700 1 -- 172.21.15.79:0/708960606 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6400b860 con 0x7f9d6c157c40 2023-10-14T18:45:44.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d69ffb700 1 -- 172.21.15.79:0/708960606 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400bc00 con 0x7f9d6c157c40 2023-10-14T18:45:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 -- 172.21.15.79:0/708960606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 msgr2=0x7f9d6c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 --2- 172.21.15.79:0/708960606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d640099b0 tx=0x7f9d64009250 comp rx=0 tx=0).stop 2023-10-14T18:45:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 -- 172.21.15.79:0/708960606 shutdown_connections 2023-10-14T18:45:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 --2- 172.21.15.79:0/708960606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157c40 0x7f9d6c158110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 --2- 172.21.15.79:0/708960606 >> v2:172.21.15.144:3300/0 conn(0x7f9d6c157870 0x7f9d6c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 -- 172.21.15.79:0/708960606 >> 172.21.15.79:0/708960606 conn(0x7f9d6c068ce0 msgr2=0x7f9d6c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 -- 172.21.15.79:0/708960606 shutdown_connections 2023-10-14T18:45:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.305+0000 7f9d71364700 1 -- 172.21.15.79:0/708960606 wait complete. 2023-10-14T18:45:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.306+0000 7f9d71364700 1 Processor -- start 2023-10-14T18:45:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.306+0000 7f9d71364700 1 -- start start 2023-10-14T18:45:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157870 0x7f9d6c153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d6c15a620 0x7f9d6c14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14d670 con 0x7f9d6c157c40 2023-10-14T18:45:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c12a160 con 0x7f9d6c15a620 2023-10-14T18:45:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d71364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c1505f0 con 0x7f9d6c157870 2023-10-14T18:45:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42292/0 (socket says 172.21.15.79:42292) 2023-10-14T18:45:44.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 -- 172.21.15.79:0/2786031084 learned_addr learned my addr 172.21.15.79:0/2786031084 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:44.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6affd700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157870 0x7f9d6c153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6b7fe700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d6c15a620 0x7f9d6c14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 -- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157870 msgr2=0x7f9d6c153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157870 0x7f9d6c153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 -- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d6c15a620 msgr2=0x7f9d6c14f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d6c15a620 0x7f9d6c14f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.307+0000 7f9d6a7fc700 1 -- 172.21.15.79:0/2786031084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c009a20 con 0x7f9d6c157c40 2023-10-14T18:45:44.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d6a7fc700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001eb0 tx=0x7f9d54007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54005a70 con 0x7f9d6c157c40 2023-10-14T18:45:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54005bd0 con 0x7f9d6c157c40 2023-10-14T18:45:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540070d0 con 0x7f9d6c157c40 2023-10-14T18:45:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640094f0 con 0x7f9d6c157c40 2023-10-14T18:45:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.308+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c150bb0 con 0x7f9d6c157c40 2023-10-14T18:45:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.309+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c04c3c0 con 0x7f9d6c157c40 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.309+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d54007480 con 0x7f9d6c157c40 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.309+0000 7f9d62ffd700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 0x7f9d4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.310+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d54083870 con 0x7f9d6c157c40 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.310+0000 7f9d6affd700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 0x7f9d4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.310+0000 7f9d6affd700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 0x7f9d4c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009fd0 tx=0x7f9d5c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.314+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d54050ae0 con 0x7f9d6c157c40 2023-10-14T18:45:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.536+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d6c15c840 con 0x7f9d6c157c40 2023-10-14T18:45:44.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.537+0000 7f9d62ffd700 1 -- 172.21.15.79:0/2786031084 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f9d54017020 con 0x7f9d6c157c40 2023-10-14T18:45:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:44.538 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 msgr2=0x7f9d4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 0x7f9d4c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009fd0 tx=0x7f9d5c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 msgr2=0x7f9d6c0b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001eb0 tx=0x7f9d54007f40 comp rx=0 tx=0).stop 2023-10-14T18:45:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 shutdown_connections 2023-10-14T18:45:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d4c066f30 0x7f9d4c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d6c15a620 0x7f9d6c14f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d6c157870 0x7f9d6c153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 --2- 172.21.15.79:0/2786031084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d6c157c40 0x7f9d6c0b2780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 >> 172.21.15.79:0/2786031084 conn(0x7f9d6c068ce0 msgr2=0x7f9d6c0b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:44.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 shutdown_connections 2023-10-14T18:45:44.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.539+0000 7f9d71364700 1 -- 172.21.15.79:0/2786031084 wait complete. 2023-10-14T18:45:44.543 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:44.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.667+0000 7f5749f49700 1 Processor -- start 2023-10-14T18:45:44.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.667+0000 7f5749f49700 1 -- start start 2023-10-14T18:45:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5749f49700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57440c9320 0x7f57440a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5749f49700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57440c96f0 0x7f57440aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5749f49700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440b0790 con 0x7f57440b0c20 2023-10-14T18:45:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5749f49700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440a7df0 con 0x7f57440c9320 2023-10-14T18:45:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5749f49700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440c9b40 con 0x7f57440c96f0 2023-10-14T18:45:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f57440c9320 0x7f57440a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f573affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f57440b0c20 0x7f574415c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50142/0 (socket says 172.21.15.79:50142) 2023-10-14T18:45:44.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f573affd700 1 -- 172.21.15.79:0/2718605193 learned_addr learned my addr 172.21.15.79:0/2718605193 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:44.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5743fff700 1 --2- 172.21.15.79:0/2718605193 >> v2:172.21.15.144:3300/0 conn(0x7f57440c96f0 0x7f57440aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 -- 172.21.15.79:0/2718605193 >> v2:172.21.15.144:3300/0 conn(0x7f57440c96f0 msgr2=0x7f57440aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:44.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 --2- 172.21.15.79:0/2718605193 >> v2:172.21.15.144:3300/0 conn(0x7f57440c96f0 0x7f57440aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 -- 172.21.15.79:0/2718605193 >> v1:172.21.15.79:6789/0 conn(0x7f57440b0c20 legacy=0x7f574415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 -- 172.21.15.79:0/2718605193 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440a7b10 con 0x7f57440c9320 2023-10-14T18:45:44.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f57437fe700 1 --2- 172.21.15.79:0/2718605193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f57440a7480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57440ccc30 tx=0x7f57340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1dd3a599ee840c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.668+0000 7f5742ffd700 1 -- 172.21.15.79:0/2718605193 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400b6b0 con 0x7f57440c9320 2023-10-14T18:45:44.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5742ffd700 1 -- 172.21.15.79:0/2718605193 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400b810 con 0x7f57440c9320 2023-10-14T18:45:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5742ffd700 1 -- 172.21.15.79:0/2718605193 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400bbb0 con 0x7f57440c9320 2023-10-14T18:45:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 -- 172.21.15.79:0/2718605193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 msgr2=0x7f57440a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 --2- 172.21.15.79:0/2718605193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f57440a7480 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57440ccc30 tx=0x7f57340091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 -- 172.21.15.79:0/2718605193 shutdown_connections 2023-10-14T18:45:44.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 --2- 172.21.15.79:0/2718605193 >> v2:172.21.15.144:3300/0 conn(0x7f57440c96f0 0x7f57440aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 --2- 172.21.15.79:0/2718605193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f57440a7480 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 -- 172.21.15.79:0/2718605193 >> 172.21.15.79:0/2718605193 conn(0x7f57440cd1e0 msgr2=0x7f57440cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 -- 172.21.15.79:0/2718605193 shutdown_connections 2023-10-14T18:45:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.669+0000 7f5749f49700 1 -- 172.21.15.79:0/2718605193 wait complete. 2023-10-14T18:45:44.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.670+0000 7f5749f49700 1 Processor -- start 2023-10-14T18:45:44.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.670+0000 7f5749f49700 1 -- start start 2023-10-14T18:45:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57440b0c20 0x7f5744154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 0x7f574415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574415b280 con 0x7f57440c9320 2023-10-14T18:45:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744158540 con 0x7f57440b0c20 2023-10-14T18:45:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5749f49700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744158820 con 0x7f57440c96f0 2023-10-14T18:45:44.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42306/0 (socket says 172.21.15.79:42306) 2023-10-14T18:45:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 -- 172.21.15.79:0/3100484629 learned_addr learned my addr 172.21.15.79:0/3100484629 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f57437fe700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57440b0c20 0x7f5744154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5743fff700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 0x7f574415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 -- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 msgr2=0x7f574415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 0x7f574415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 -- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57440b0c20 msgr2=0x7f5744154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57440b0c20 0x7f5744154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f573affd700 1 -- 172.21.15.79:0/3100484629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734009420 con 0x7f57440c9320 2023-10-14T18:45:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.671+0000 7f5743fff700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 0x7f574415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f573affd700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c590 tx=0x7f572c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c005b30 con 0x7f57440c9320 2023-10-14T18:45:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c005cb0 con 0x7f57440c9320 2023-10-14T18:45:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5744158b00 con 0x7f57440c9320 2023-10-14T18:45:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c007320 con 0x7f57440c9320 2023-10-14T18:45:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.672+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57441688d0 con 0x7f57440c9320 2023-10-14T18:45:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.673+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744159020 con 0x7f57440c9320 2023-10-14T18:45:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.673+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f572c01b3b0 con 0x7f57440c9320 2023-10-14T18:45:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.674+0000 7f573bfff700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.674+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f572c0839b0 con 0x7f57440c9320 2023-10-14T18:45:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.674+0000 7f57437fe700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.674+0000 7f57437fe700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f57340093f0 tx=0x7f5734017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.678+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5744159020 con 0x7f57440c9320 2023-10-14T18:45:44.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.864+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5744159020 con 0x7f57440c9320 2023-10-14T18:45:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.865+0000 7f573bfff700 1 -- 172.21.15.79:0/3100484629 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5744159020 con 0x7f57440c9320 2023-10-14T18:45:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:44.866 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 msgr2=0x7f57240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 0x7f57240693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f57340093f0 tx=0x7f5734017000 comp rx=0 tx=0).stop 2023-10-14T18:45:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 msgr2=0x7f5744168390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c590 tx=0x7f572c001020 comp rx=0 tx=0).stop 2023-10-14T18:45:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 shutdown_connections 2023-10-14T18:45:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5724066f30 0x7f57240693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57440c96f0 0x7f574415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57440b0c20 0x7f5744154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 --2- 172.21.15.79:0/3100484629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57440c9320 0x7f5744168390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 >> 172.21.15.79:0/3100484629 conn(0x7f57440cd1e0 msgr2=0x7f574406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 shutdown_connections 2023-10-14T18:45:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.867+0000 7f5749f49700 1 -- 172.21.15.79:0/3100484629 wait complete. 2023-10-14T18:45:44.880 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:45:44.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:44.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.994+0000 7f04d450a700 1 Processor -- start 2023-10-14T18:45:44.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.994+0000 7f04d450a700 1 -- start start 2023-10-14T18:45:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d450a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04cc15a620 0x7f04cc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d450a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d450a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc15cbb0 con 0x7f04cc157870 2023-10-14T18:45:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d450a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc15bdb0 con 0x7f04cc15a620 2023-10-14T18:45:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d450a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc15bfa0 con 0x7f04cc15d580 2023-10-14T18:45:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d1aa5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04cc15a620 0x7f04cc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d22a6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f04cc157870 0x7f04cc15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50154/0 (socket says 172.21.15.79:50154) 2023-10-14T18:45:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d22a6700 1 -- 172.21.15.79:0/1289726031 learned_addr learned my addr 172.21.15.79:0/1289726031 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.995+0000 7f04d2aa7700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d1aa5700 1 -- 172.21.15.79:0/1289726031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 msgr2=0x7f04cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d1aa5700 1 -- 172.21.15.79:0/1289726031 >> v1:172.21.15.79:6789/0 conn(0x7f04cc157870 legacy=0x7f04cc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d12a4700 1 -- 172.21.15.79:0/1289726031 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724950435 0 0) 0x7f04cc15cbb0 con 0x7f04cc157870 2023-10-14T18:45:45.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d1aa5700 1 -- 172.21.15.79:0/1289726031 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc15c280 con 0x7f04cc15a620 2023-10-14T18:45:45.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc15a620 0x7f04cc15d040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04c00098e0 tx=0x7f04c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180aea6f891f2d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d12a4700 1 -- 172.21.15.79:0/1289726031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0009e80 con 0x7f04cc15a620 2023-10-14T18:45:45.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d12a4700 1 -- 172.21.15.79:0/1289726031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000b860 con 0x7f04cc15a620 2023-10-14T18:45:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d12a4700 1 -- 172.21.15.79:0/1289726031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000bbe0 con 0x7f04cc15a620 2023-10-14T18:45:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 -- 172.21.15.79:0/1289726031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc15a620 msgr2=0x7f04cc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc15a620 0x7f04cc15d040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04c00098e0 tx=0x7f04c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 -- 172.21.15.79:0/1289726031 shutdown_connections 2023-10-14T18:45:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 --2- 172.21.15.79:0/1289726031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc15a620 0x7f04cc15d040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 -- 172.21.15.79:0/1289726031 >> 172.21.15.79:0/1289726031 conn(0x7f04cc068ce0 msgr2=0x7f04cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 -- 172.21.15.79:0/1289726031 shutdown_connections 2023-10-14T18:45:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.996+0000 7f04d450a700 1 -- 172.21.15.79:0/1289726031 wait complete. 2023-10-14T18:45:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.997+0000 7f04d450a700 1 Processor -- start 2023-10-14T18:45:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 -- start start 2023-10-14T18:45:45.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 0x7f04cc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc15e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b23f0 con 0x7f04cc157870 2023-10-14T18:45:45.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b26d0 con 0x7f04cc15a620 2023-10-14T18:45:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d450a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0b29b0 con 0x7f04cc15d580 2023-10-14T18:45:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d22a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d22a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42334/0 (socket says 172.21.15.79:42334) 2023-10-14T18:45:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d22a6700 1 -- 172.21.15.79:0/4097053398 learned_addr learned my addr 172.21.15.79:0/4097053398 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:45.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.998+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 0x7f04cc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d2aa7700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc15e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 -- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 msgr2=0x7f04cc15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc15e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 -- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 msgr2=0x7f04cc0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 0x7f04cc0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 -- 172.21.15.79:0/4097053398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009420 con 0x7f04cc157870 2023-10-14T18:45:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 0x7f04cc0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d2aa7700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc15e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:45.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d22a6700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00cd80 tx=0x7f04bc001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00ab10 con 0x7f04cc157870 2023-10-14T18:45:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00ac70 con 0x7f04cc157870 2023-10-14T18:45:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0b2c90 con 0x7f04cc157870 2023-10-14T18:45:45.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc0070f0 con 0x7f04cc157870 2023-10-14T18:45:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:44.999+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0b15c0 con 0x7f04cc157870 2023-10-14T18:45:45.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.000+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc14ef70 con 0x7f04cc157870 2023-10-14T18:45:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.000+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04bc0074e0 con 0x7f04cc157870 2023-10-14T18:45:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.000+0000 7f04ca7fc700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.001+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04bc084a50 con 0x7f04cc157870 2023-10-14T18:45:45.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.001+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.001+0000 7f04d1aa5700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04cc15aa20 tx=0x7f04c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.005+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04cc14ef70 con 0x7f04cc157870 2023-10-14T18:45:45.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.230+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04cc14ef70 con 0x7f04cc157870 2023-10-14T18:45:45.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.230+0000 7f04ca7fc700 1 -- 172.21.15.79:0/4097053398 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f04cc14ef70 con 0x7f04cc157870 2023-10-14T18:45:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:45.231 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:45.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 msgr2=0x7f04b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04cc15aa20 tx=0x7f04c0017000 comp rx=0 tx=0).stop 2023-10-14T18:45:45.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 msgr2=0x7f04cc151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00cd80 tx=0x7f04bc001ae0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 shutdown_connections 2023-10-14T18:45:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04cc15d580 0x7f04cc15e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04cc157870 0x7f04cc151450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 --2- 172.21.15.79:0/4097053398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04cc15a620 0x7f04cc0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 >> 172.21.15.79:0/4097053398 conn(0x7f04cc068ce0 msgr2=0x7f04cc159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 shutdown_connections 2023-10-14T18:45:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.232+0000 7f04d450a700 1 -- 172.21.15.79:0/4097053398 wait complete. 2023-10-14T18:45:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:45.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:45:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.359+0000 7f5b69fc6700 1 Processor -- start 2023-10-14T18:45:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.359+0000 7f5b69fc6700 1 -- start start 2023-10-14T18:45:45.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b64157870 0x7f5b6415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b6415a620 0x7f5b6415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b6415d580 0x7f5b64158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6415cbb0 con 0x7f5b64157870 2023-10-14T18:45:45.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6415bfa0 con 0x7f5b6415a620 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b69fc6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6415c280 con 0x7f5b6415d580 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b637fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b64157870 0x7f5b6415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b637fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b64157870 0x7f5b6415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42346/0 (socket says 172.21.15.79:42346) 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b637fe700 1 -- 172.21.15.79:0/75167748 learned_addr learned my addr 172.21.15.79:0/75167748 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b62ffd700 1 --2- 172.21.15.79:0/75167748 >> v2:172.21.15.144:3300/0 conn(0x7f5b6415a620 0x7f5b6415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.360+0000 7f5b63fff700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b6415d580 0x7f5b64158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 -- 172.21.15.79:0/75167748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b6415d580 msgr2=0x7f5b64158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b6415d580 0x7f5b64158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 -- 172.21.15.79:0/75167748 >> v2:172.21.15.144:3300/0 conn(0x7f5b6415a620 msgr2=0x7f5b6415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 --2- 172.21.15.79:0/75167748 >> v2:172.21.15.144:3300/0 conn(0x7f5b6415a620 0x7f5b6415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 -- 172.21.15.79:0/75167748 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6415c560 con 0x7f5b64157870 2023-10-14T18:45:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b637fe700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b64157870 0x7f5b6415b6a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b6415cb20 tx=0x7f5b54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f479ab556ddc141f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b627fc700 1 -- 172.21.15.79:0/75167748 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400e070 con 0x7f5b64157870 2023-10-14T18:45:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b627fc700 1 -- 172.21.15.79:0/75167748 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5400ba20 con 0x7f5b64157870 2023-10-14T18:45:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b627fc700 1 -- 172.21.15.79:0/75167748 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540092e0 con 0x7f5b64157870 2023-10-14T18:45:45.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 -- 172.21.15.79:0/75167748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b64157870 msgr2=0x7f5b6415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b64157870 0x7f5b6415b6a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b6415cb20 tx=0x7f5b54009840 comp rx=0 tx=0).stop 2023-10-14T18:45:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 -- 172.21.15.79:0/75167748 shutdown_connections 2023-10-14T18:45:45.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b6415d580 0x7f5b64158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/75167748 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b64157870 0x7f5b6415b6a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/75167748 >> v2:172.21.15.144:3300/0 conn(0x7f5b6415a620 0x7f5b6415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.361+0000 7f5b69fc6700 1 -- 172.21.15.79:0/75167748 >> 172.21.15.79:0/75167748 conn(0x7f5b64068ce0 msgr2=0x7f5b640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.362+0000 7f5b69fc6700 1 -- 172.21.15.79:0/75167748 shutdown_connections 2023-10-14T18:45:45.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.362+0000 7f5b69fc6700 1 -- 172.21.15.79:0/75167748 wait complete. 2023-10-14T18:45:45.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 Processor -- start 2023-10-14T18:45:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 -- start start 2023-10-14T18:45:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b64157870 0x7f5b6415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b6415d580 0x7f5b641498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64144830 con 0x7f5b6415a620 2023-10-14T18:45:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640d0ab0 con 0x7f5b6415d580 2023-10-14T18:45:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.363+0000 7f5b69fc6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b640d0d90 con 0x7f5b64157870 2023-10-14T18:45:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42360/0 (socket says 172.21.15.79:42360) 2023-10-14T18:45:45.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 -- 172.21.15.79:0/2116802095 learned_addr learned my addr 172.21.15.79:0/2116802095 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b63fff700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b6415d580 0x7f5b641498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b637fe700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b64157870 0x7f5b6415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 -- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b64157870 msgr2=0x7f5b6415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b64157870 0x7f5b6415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 -- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b6415d580 msgr2=0x7f5b641498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b6415d580 0x7f5b641498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 -- 172.21.15.79:0/2116802095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009ae0 con 0x7f5b6415a620 2023-10-14T18:45:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b62ffd700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ec50 tx=0x7f5b580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800c850 con 0x7f5b6415a620 2023-10-14T18:45:45.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800c9b0 con 0x7f5b6415a620 2023-10-14T18:45:45.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800cd70 con 0x7f5b6415a620 2023-10-14T18:45:45.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b640d1070 con 0x7f5b6415a620 2023-10-14T18:45:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.364+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b641444d0 con 0x7f5b6415a620 2023-10-14T18:45:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.365+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6415daa0 con 0x7f5b6415a620 2023-10-14T18:45:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.365+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b58013680 con 0x7f5b6415a620 2023-10-14T18:45:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.366+0000 7f5b4b7fe700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.366+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b580847e0 con 0x7f5b6415a620 2023-10-14T18:45:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.366+0000 7f5b637fe700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.367+0000 7f5b637fe700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 0x7f5b500693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009880 tx=0x7f5b54018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.370+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b6415daa0 con 0x7f5b6415a620 2023-10-14T18:45:45.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.593+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b6415daa0 con 0x7f5b6415a620 2023-10-14T18:45:45.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.594+0000 7f5b4b7fe700 1 -- 172.21.15.79:0/2116802095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f5b6415daa0 con 0x7f5b6415a620 2023-10-14T18:45:45.595 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:45.596 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2875718190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2875718190},{"type":"v1","addr":"172.21.15.79:6834","nonce":2875718190}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/2993952356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2993952356},{"type":"v1","addr":"172.21.15.79:6835","nonce":2993952356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2324057366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2324057366},{"type":"v1","addr":"172.21.15.144:6836","nonce":2324057366}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:09.872765+0000","modified":"2023-10-14T18:45:13.515360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/4045595129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":4045595129},{"type":"v1","addr":"172.21.15.144:6837","nonce":4045595129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-14T18:45:45.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.595+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 msgr2=0x7f5b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.595+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 0x7f5b500693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009880 tx=0x7f5b54018000 comp rx=0 tx=0).stop 2023-10-14T18:45:45.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.595+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 msgr2=0x7f5b64149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.595+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ec50 tx=0x7f5b580091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 shutdown_connections 2023-10-14T18:45:45.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b50066f30 0x7f5b500693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b6415d580 0x7f5b641498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b64157870 0x7f5b6415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 --2- 172.21.15.79:0/2116802095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b6415a620 0x7f5b64149380 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 >> 172.21.15.79:0/2116802095 conn(0x7f5b64068ce0 msgr2=0x7f5b64159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 shutdown_connections 2023-10-14T18:45:45.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.596+0000 7f5b69fc6700 1 -- 172.21.15.79:0/2116802095 wait complete. 2023-10-14T18:45:45.602 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 8 2023-10-14T18:45:45.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:45.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.724+0000 7f5836664700 1 Processor -- start 2023-10-14T18:45:45.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.725+0000 7f5836664700 1 -- start start 2023-10-14T18:45:45.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.725+0000 7f5836664700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f5830156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.725+0000 7f5836664700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5830157c30 con 0x7f583006da90 2023-10-14T18:45:45.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.725+0000 7f5836664700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58301584f0 con 0x7f5830156570 2023-10-14T18:45:45.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.725+0000 7f5836664700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830157670 con 0x7f583015a330 2023-10-14T18:45:45.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f5834c01700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f583006da90 0x7f5830156e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50160/0 (socket says 172.21.15.79:50160) 2023-10-14T18:45:45.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f5834c01700 1 -- 172.21.15.79:0/3676324619 learned_addr learned my addr 172.21.15.79:0/3676324619 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:45.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f5827fff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f5830156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39018288 0 0) 0x7f5830157c30 con 0x7f583006da90 2023-10-14T18:45:45.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f581c003570 con 0x7f583006da90 2023-10-14T18:45:45.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243531191 0 0) 0x7f58301584f0 con 0x7f5830156570 2023-10-14T18:45:45.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830157c30 con 0x7f5830156570 2023-10-14T18:45:45.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371358259 0 0) 0x7f581c003570 con 0x7f583006da90 2023-10-14T18:45:45.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 msgr2=0x7f5830156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f5830156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 >> v1:172.21.15.144:6789/0 conn(0x7f5830156570 legacy=0x7f583006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830157950 con 0x7f583006da90 2023-10-14T18:45:45.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f58280017f0 con 0x7f583006da90 2023-10-14T18:45:45.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 >> v1:172.21.15.79:6789/0 conn(0x7f583006da90 legacy=0x7f5830156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f581c003c20 0x7f581c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f581c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f581c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830157670 con 0x7f581c004810 2023-10-14T18:45:45.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c00bbf0 con 0x7f581c003c20 2023-10-14T18:45:45.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c00bdb0 con 0x7f583015a330 2023-10-14T18:45:45.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f5827fff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f581c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f582ffff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f581c003c20 0x7f581c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.726+0000 7f5834c01700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f581c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 -- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 msgr2=0x7f581c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583015a330 0x7f581c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 -- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f581c003c20 msgr2=0x7f581c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f581c003c20 0x7f581c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 -- 172.21.15.79:0/3676324619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c003570 con 0x7f581c004810 2023-10-14T18:45:45.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5827fff700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f581c004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5818006f00 tx=0x7f581800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eff8e58bbb91f5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800fa00 con 0x7f581c004810 2023-10-14T18:45:45.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800fb60 con 0x7f581c004810 2023-10-14T18:45:45.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f582f7fe700 1 -- 172.21.15.79:0/3676324619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800fd10 con 0x7f581c004810 2023-10-14T18:45:45.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5836664700 1 -- 172.21.15.79:0/3676324619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 msgr2=0x7f581c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5836664700 1 --2- 172.21.15.79:0/3676324619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f581c004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5818006f00 tx=0x7f581800a330 comp rx=0 tx=0).stop 2023-10-14T18:45:45.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.727+0000 7f5834c01700 1 -- 172.21.15.79:0/3676324619 reap_dead start 2023-10-14T18:45:45.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.728+0000 7f5836664700 1 -- 172.21.15.79:0/3676324619 shutdown_connections 2023-10-14T18:45:45.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.728+0000 7f5836664700 1 -- 172.21.15.79:0/3676324619 >> 172.21.15.79:0/3676324619 conn(0x7f5830067660 msgr2=0x7f5830067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.728+0000 7f5836664700 1 -- 172.21.15.79:0/3676324619 shutdown_connections 2023-10-14T18:45:45.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.728+0000 7f5836664700 1 -- 172.21.15.79:0/3676324619 wait complete. 2023-10-14T18:45:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 Processor -- start 2023-10-14T18:45:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 -- start start 2023-10-14T18:45:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583016b600 0x7f58300c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f583016ba70 0x7f583016a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830169360 con 0x7f581c004810 2023-10-14T18:45:45.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830169640 con 0x7f583016ba70 2023-10-14T18:45:45.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f5836664700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830169920 con 0x7f583016b600 2023-10-14T18:45:45.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f582ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f582ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42390/0 (socket says 172.21.15.79:42390) 2023-10-14T18:45:45.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.729+0000 7f582ffff700 1 -- 172.21.15.79:0/2074924068 learned_addr learned my addr 172.21.15.79:0/2074924068 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:45.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f5834c01700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f583016ba70 0x7f583016a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f5827fff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583016b600 0x7f58300c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 -- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583016b600 msgr2=0x7f58300c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583016b600 0x7f58300c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 -- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f583016ba70 msgr2=0x7f583016a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f583016ba70 0x7f583016a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 -- 172.21.15.79:0/2074924068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830169c00 con 0x7f581c004810 2023-10-14T18:45:45.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582ffff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5820002c00 tx=0x7f5820007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000f9a0 con 0x7f581c004810 2023-10-14T18:45:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000fb00 con 0x7f581c004810 2023-10-14T18:45:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5830169ee0 con 0x7f581c004810 2023-10-14T18:45:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000fec0 con 0x7f581c004810 2023-10-14T18:45:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.730+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58300c4f90 con 0x7f581c004810 2023-10-14T18:45:45.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.731+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583016a0d0 con 0x7f581c004810 2023-10-14T18:45:45.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.731+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5820006a30 con 0x7f581c004810 2023-10-14T18:45:45.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.732+0000 7f582cff9700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 0x7f58100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:45.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.732+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58200848e0 con 0x7f581c004810 2023-10-14T18:45:45.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.732+0000 7f5827fff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 0x7f58100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.732+0000 7f5827fff700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 0x7f58100693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f581800a370 tx=0x7f581801d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.736+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5820051b50 con 0x7f581c004810 2023-10-14T18:45:45.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.917+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f583004c3c0 con 0x7f581c004810 2023-10-14T18:45:45.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.918+0000 7f582cff9700 1 -- 172.21.15.79:0/2074924068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5820055170 con 0x7f581c004810 2023-10-14T18:45:45.919 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:45.919 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:11.491478+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:08.220687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:08.836877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:45.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 msgr2=0x7f58100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 0x7f58100693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f581800a370 tx=0x7f581801d000 comp rx=0 tx=0).stop 2023-10-14T18:45:45.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 msgr2=0x7f58301659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:45.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5820002c00 tx=0x7f5820007d30 comp rx=0 tx=0).stop 2023-10-14T18:45:45.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 shutdown_connections 2023-10-14T18:45:45.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5810066f30 0x7f58100693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f583016ba70 0x7f583016a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f581c004810 0x7f58301659f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 --2- 172.21.15.79:0/2074924068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f583016b600 0x7f58300c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 >> 172.21.15.79:0/2074924068 conn(0x7f5830067660 msgr2=0x7f5830155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 shutdown_connections 2023-10-14T18:45:45.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:45.920+0000 7f5836664700 1 -- 172.21.15.79:0/2074924068 wait complete. 2023-10-14T18:45:45.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:45:46.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.047+0000 7ff50a4d1700 1 Processor -- start 2023-10-14T18:45:46.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.047+0000 7ff50a4d1700 1 -- start start 2023-10-14T18:45:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff50a4d1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff50415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff50a4d1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50415cbb0 con 0x7ff504157c40 2023-10-14T18:45:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff50a4d1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50415bfa0 con 0x7ff50415a620 2023-10-14T18:45:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff50a4d1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415c280 con 0x7ff504157870 2023-10-14T18:45:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff508a6e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff504157c40 0x7ff504158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:50176/0 (socket says 172.21.15.79:50176) 2023-10-14T18:45:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff508a6e700 1 -- 172.21.15.79:0/4112881156 learned_addr learned my addr 172.21.15.79:0/4112881156 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:46.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761505479 0 0) 0x7ff50415cbb0 con 0x7ff504157c40 2023-10-14T18:45:46.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0003570 con 0x7ff504157c40 2023-10-14T18:45:46.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff503fff700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff50415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206464537 0 0) 0x7ff4f0003570 con 0x7ff504157c40 2023-10-14T18:45:46.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 msgr2=0x7ff50415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:46.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff50415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 >> v1:172.21.15.144:6789/0 conn(0x7ff50415a620 legacy=0x7ff50415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50415c560 con 0x7ff504157c40 2023-10-14T18:45:46.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff4fc0017f0 con 0x7ff504157c40 2023-10-14T18:45:46.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 >> v1:172.21.15.79:6789/0 conn(0x7ff504157c40 legacy=0x7ff504158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0003a90 0x7ff4f0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff4f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f0004d50 0x7ff4f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415c280 con 0x7ff4f0004d50 2023-10-14T18:45:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f000bb10 con 0x7ff4f0003a90 2023-10-14T18:45:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.048+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f000bcd0 con 0x7ff504157870 2023-10-14T18:45:46.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f0004d50 0x7ff4f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff503fff700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0003a90 0x7ff4f0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff5037fe700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff4f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 -- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 msgr2=0x7ff4f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:46.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff4f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 -- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0003a90 msgr2=0x7ff4f0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0003a90 0x7ff4f0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 -- 172.21.15.79:0/4112881156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0003570 con 0x7ff4f0004d50 2023-10-14T18:45:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff5037fe700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff504157870 0x7ff4f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:46.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff508a6e700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f0004d50 0x7ff4f00051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00a8d0 tx=0x7ff4fc002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86f97ba0ae967da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0070d0 con 0x7ff4f0004d50 2023-10-14T18:45:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc007230 con 0x7ff4f0004d50 2023-10-14T18:45:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.049+0000 7ff502ffd700 1 -- 172.21.15.79:0/4112881156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0075f0 con 0x7ff4f0004d50 2023-10-14T18:45:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 -- 172.21.15.79:0/4112881156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f0004d50 msgr2=0x7ff4f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/4112881156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4f0004d50 0x7ff4f00051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00a8d0 tx=0x7ff4fc002170 comp rx=0 tx=0).stop 2023-10-14T18:45:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff508a6e700 1 -- 172.21.15.79:0/4112881156 reap_dead start 2023-10-14T18:45:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 -- 172.21.15.79:0/4112881156 shutdown_connections 2023-10-14T18:45:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 -- 172.21.15.79:0/4112881156 >> 172.21.15.79:0/4112881156 conn(0x7ff504068ce0 msgr2=0x7ff5040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 -- 172.21.15.79:0/4112881156 shutdown_connections 2023-10-14T18:45:46.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.050+0000 7ff50a4d1700 1 -- 172.21.15.79:0/4112881156 wait complete. 2023-10-14T18:45:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.051+0000 7ff50a4d1700 1 Processor -- start 2023-10-14T18:45:46.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.051+0000 7ff50a4d1700 1 -- start start 2023-10-14T18:45:46.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 0x7ff50414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5040b24b0 0x7ff504150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50414e560 con 0x7ff5040b2920 2023-10-14T18:45:46.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50412a720 con 0x7ff4f0004d50 2023-10-14T18:45:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040b2ee0 con 0x7ff5040b24b0 2023-10-14T18:45:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42404/0 (socket says 172.21.15.79:42404) 2023-10-14T18:45:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 -- 172.21.15.79:0/1492889594 learned_addr learned my addr 172.21.15.79:0/1492889594 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:46.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff503fff700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 0x7ff50414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff5037fe700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5040b24b0 0x7ff504150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 -- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5040b24b0 msgr2=0x7ff504150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5040b24b0 0x7ff504150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 -- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 msgr2=0x7ff50414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 0x7ff50414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 -- 172.21.15.79:0/1492889594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504129df0 con 0x7ff5040b2920 2023-10-14T18:45:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff503fff700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 0x7ff50414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff508a6e700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0004770 tx=0x7ff4fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc023070 con 0x7ff5040b2920 2023-10-14T18:45:46.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc007b40 con 0x7ff5040b2920 2023-10-14T18:45:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50412a0d0 con 0x7ff5040b2920 2023-10-14T18:45:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc01e430 con 0x7ff5040b2920 2023-10-14T18:45:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.052+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5040b17a0 con 0x7ff5040b2920 2023-10-14T18:45:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.053+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50404c3c0 con 0x7ff5040b2920 2023-10-14T18:45:46.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.054+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4fc01e800 con 0x7ff5040b2920 2023-10-14T18:45:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.054+0000 7ff4fbfff700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 0x7ff4e40693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.054+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4fc086580 con 0x7ff5040b2920 2023-10-14T18:45:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.054+0000 7ff503fff700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 0x7ff4e40693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.055+0000 7ff503fff700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 0x7ff4e40693d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4006f00 tx=0x7ff4f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.058+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4fc0537f0 con 0x7ff5040b2920 2023-10-14T18:45:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.286+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff50415c840 con 0x7ff5040b2920 2023-10-14T18:45:46.287 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:45:46.286+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:45:46.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.290+0000 7ff4fbfff700 1 -- 172.21.15.79:0/1492889594 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff4fc056e10 con 0x7ff5040b2920 2023-10-14T18:45:46.291 INFO:tasks.ceph.mds.b.smithi144.stderr: -2809> 2023-10-14T18:45:03.608+0000 7f2cda4fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T18:45:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.292+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 msgr2=0x7ff4e40693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.292+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 0x7ff4e40693d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4006f00 tx=0x7ff4f4008040 comp rx=0 tx=0).stop 2023-10-14T18:45:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.292+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 msgr2=0x7ff504151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.292+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0004770 tx=0x7ff4fc016000 comp rx=0 tx=0).stop 2023-10-14T18:45:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 shutdown_connections 2023-10-14T18:45:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff4e4066f20 0x7ff4e40693d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5040b2920 0x7ff504151410 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4f0004d50 0x7ff50414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 --2- 172.21.15.79:0/1492889594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5040b24b0 0x7ff504150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 >> 172.21.15.79:0/1492889594 conn(0x7ff504068ce0 msgr2=0x7ff5040d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 shutdown_connections 2023-10-14T18:45:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.293+0000 7ff50a4d1700 1 -- 172.21.15.79:0/1492889594 wait complete. 2023-10-14T18:45:46.296 INFO:tasks.ceph.mds.b.smithi144.stderr: -1631> 2023-10-14T18:45:14.621+0000 7f2cd44f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:45:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:45:46.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:45:46.316 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:45:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.420+0000 7fcd74db0700 1 Processor -- start 2023-10-14T18:45:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.420+0000 7fcd74db0700 1 -- start start 2023-10-14T18:45:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd74db0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 0x7fcd700af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd74db0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd74db0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd700b0790 con 0x7fcd7015a290 2023-10-14T18:45:46.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd74db0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd700ce1f0 con 0x7fcd7006acb0 2023-10-14T18:45:46.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd74db0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700b0b20 con 0x7fcd70159ec0 2023-10-14T18:45:46.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd6ed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd6e59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 0x7fcd700af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd6ed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:55408/0 (socket says 172.21.15.79:55408) 2023-10-14T18:45:46.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.421+0000 7fcd6ed9d700 1 -- 172.21.15.79:0/2746180819 learned_addr learned my addr 172.21.15.79:0/2746180819 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:46.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6e59c700 1 -- 172.21.15.79:0/2746180819 >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 msgr2=0x7fcd700afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:46.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6e59c700 1 --2- 172.21.15.79:0/2746180819 >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6e59c700 1 -- 172.21.15.79:0/2746180819 >> v1:172.21.15.144:6789/0 conn(0x7fcd7015a290 legacy=0x7fcd7006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6e59c700 1 -- 172.21.15.79:0/2746180819 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700b04b0 con 0x7fcd70159ec0 2023-10-14T18:45:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6ed9d700 1 --2- 172.21.15.79:0/2746180819 >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6e59c700 1 --2- 172.21.15.79:0/2746180819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 0x7fcd700af940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd600098e0 tx=0x7fcd600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=128810667bb985ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6dd9b700 1 -- 172.21.15.79:0/2746180819 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000b640 con 0x7fcd70159ec0 2023-10-14T18:45:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6dd9b700 1 -- 172.21.15.79:0/2746180819 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6000b7a0 con 0x7fcd70159ec0 2023-10-14T18:45:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd6dd9b700 1 -- 172.21.15.79:0/2746180819 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000bb40 con 0x7fcd70159ec0 2023-10-14T18:45:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd74db0700 1 -- 172.21.15.79:0/2746180819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 msgr2=0x7fcd700af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.422+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2746180819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 0x7fcd700af940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd600098e0 tx=0x7fcd600091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 -- 172.21.15.79:0/2746180819 shutdown_connections 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2746180819 >> v2:172.21.15.144:3300/0 conn(0x7fcd7006acb0 0x7fcd700afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2746180819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd70159ec0 0x7fcd700af940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 -- 172.21.15.79:0/2746180819 >> 172.21.15.79:0/2746180819 conn(0x7fcd700d1880 msgr2=0x7fcd700cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 -- 172.21.15.79:0/2746180819 shutdown_connections 2023-10-14T18:45:46.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.423+0000 7fcd74db0700 1 -- 172.21.15.79:0/2746180819 wait complete. 2023-10-14T18:45:46.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 Processor -- start 2023-10-14T18:45:46.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 -- start start 2023-10-14T18:45:46.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7006acb0 0x7fcd70152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd70159ec0 0x7fcd700cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700cb160 con 0x7fcd7015a290 2023-10-14T18:45:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700ca790 con 0x7fcd70159ec0 2023-10-14T18:45:46.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.424+0000 7fcd74db0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700b4220 con 0x7fcd7006acb0 2023-10-14T18:45:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42418/0 (socket says 172.21.15.79:42418) 2023-10-14T18:45:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 -- 172.21.15.79:0/2103914356 learned_addr learned my addr 172.21.15.79:0/2103914356 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6e59c700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7006acb0 0x7fcd70152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd65d9b700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd70159ec0 0x7fcd700cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 -- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7006acb0 msgr2=0x7fcd70152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7006acb0 0x7fcd70152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 -- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd70159ec0 msgr2=0x7fcd700cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:46.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd70159ec0 0x7fcd700cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:46.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 -- 172.21.15.79:0/2103914356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009ae0 con 0x7fcd7015a290 2023-10-14T18:45:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd6ed9d700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009fc0 tx=0x7fcd6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800c960 con 0x7fcd7015a290 2023-10-14T18:45:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800f040 con 0x7fcd7015a290 2023-10-14T18:45:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800cd30 con 0x7fcd7015a290 2023-10-14T18:45:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd60009420 con 0x7fcd7015a290 2023-10-14T18:45:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.425+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd700c9e60 con 0x7fcd7015a290 2023-10-14T18:45:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.426+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd700ca940 con 0x7fcd7015a290 2023-10-14T18:45:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.427+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd68014650 con 0x7fcd7015a290 2023-10-14T18:45:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.427+0000 7fcd66ffd700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:46.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.427+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fcd68084c90 con 0x7fcd7015a290 2023-10-14T18:45:46.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.427+0000 7fcd6e59c700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:46.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.428+0000 7fcd6e59c700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 0x7fcd500693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd600093f0 tx=0x7fcd60017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:46.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.431+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd700ca940 con 0x7fcd7015a290 2023-10-14T18:45:46.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:46.656+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcd7004c420 con 0x7fcd7015a290 2023-10-14T18:45:47.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.293+0000 7fcd66ffd700 1 -- 172.21.15.79:0/2103914356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd68051eb0 con 0x7fcd7015a290 2023-10-14T18:45:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 msgr2=0x7fcd500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 0x7fcd500693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd600093f0 tx=0x7fcd60017000 comp rx=0 tx=0).stop 2023-10-14T18:45:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 msgr2=0x7fcd700b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009fc0 tx=0x7fcd6800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 shutdown_connections 2023-10-14T18:45:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd50066f30 0x7fcd500693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd7015a290 0x7fcd700b3ce0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd7006acb0 0x7fcd70152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 --2- 172.21.15.79:0/2103914356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd70159ec0 0x7fcd700cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 >> 172.21.15.79:0/2103914356 conn(0x7fcd700d1880 msgr2=0x7fcd700b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 shutdown_connections 2023-10-14T18:45:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.296+0000 7fcd74db0700 1 -- 172.21.15.79:0/2103914356 wait complete. 2023-10-14T18:45:47.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:45:47.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.429+0000 7f4d15320700 1 Processor -- start 2023-10-14T18:45:47.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.429+0000 7f4d15320700 1 -- start start 2023-10-14T18:45:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d15320700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 0x7f4d100d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d15320700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 0x7f4d100af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d15320700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100b49c0 con 0x7f4d10159ee0 2023-10-14T18:45:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d15320700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100ce530 con 0x7f4d1015a2b0 2023-10-14T18:45:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d15320700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100d14f0 con 0x7f4d100d10a0 2023-10-14T18:45:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d07fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 0x7f4d100d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 0x7f4d100af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0effd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4d10159ee0 0x7f4d1015e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54138/0 (socket says 172.21.15.79:54138) 2023-10-14T18:45:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0effd700 1 -- 172.21.15.79:0/1828618290 learned_addr learned my addr 172.21.15.79:0/1828618290 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 -- 172.21.15.79:0/1828618290 >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 msgr2=0x7f4d100d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 --2- 172.21.15.79:0/1828618290 >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 0x7f4d100d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 -- 172.21.15.79:0/1828618290 >> v1:172.21.15.144:6789/0 conn(0x7f4d10159ee0 legacy=0x7f4d1015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 -- 172.21.15.79:0/1828618290 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100b3db0 con 0x7f4d100d10a0 2023-10-14T18:45:47.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d07fff700 1 --2- 172.21.15.79:0/1828618290 >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 0x7f4d100d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:47.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0f7fe700 1 --2- 172.21.15.79:0/1828618290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 0x7f4d100af510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009e60 tx=0x7f4d08009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c29128dd85e28098 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:47.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0e7fc700 1 -- 172.21.15.79:0/1828618290 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800e070 con 0x7f4d100d10a0 2023-10-14T18:45:47.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.430+0000 7f4d0e7fc700 1 -- 172.21.15.79:0/1828618290 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800bb60 con 0x7f4d100d10a0 2023-10-14T18:45:47.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d0e7fc700 1 -- 172.21.15.79:0/1828618290 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08012430 con 0x7f4d100d10a0 2023-10-14T18:45:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 -- 172.21.15.79:0/1828618290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 msgr2=0x7f4d100af510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 --2- 172.21.15.79:0/1828618290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 0x7f4d100af510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009e60 tx=0x7f4d08009780 comp rx=0 tx=0).stop 2023-10-14T18:45:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 -- 172.21.15.79:0/1828618290 shutdown_connections 2023-10-14T18:45:47.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 --2- 172.21.15.79:0/1828618290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d100d10a0 0x7f4d100af510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 --2- 172.21.15.79:0/1828618290 >> v2:172.21.15.144:3300/0 conn(0x7f4d1015a2b0 0x7f4d100d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 -- 172.21.15.79:0/1828618290 >> 172.21.15.79:0/1828618290 conn(0x7f4d10067660 msgr2=0x7f4d10067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 -- 172.21.15.79:0/1828618290 shutdown_connections 2023-10-14T18:45:47.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.431+0000 7f4d15320700 1 -- 172.21.15.79:0/1828618290 wait complete. 2023-10-14T18:45:47.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.432+0000 7f4d15320700 1 Processor -- start 2023-10-14T18:45:47.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.432+0000 7f4d15320700 1 -- start start 2023-10-14T18:45:47.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d100d10a0 0x7f4d100a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d1015a2b0 0x7f4d1016aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100a8b20 con 0x7f4d10159ee0 2023-10-14T18:45:47.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1015c8b0 con 0x7f4d100d10a0 2023-10-14T18:45:47.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d15320700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1015b060 con 0x7f4d1015a2b0 2023-10-14T18:45:47.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42424/0 (socket says 172.21.15.79:42424) 2023-10-14T18:45:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 -- 172.21.15.79:0/3454670264 learned_addr learned my addr 172.21.15.79:0/3454670264 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d0effd700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d100d10a0 0x7f4d100a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d0f7fe700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d1015a2b0 0x7f4d1016aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 -- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d1015a2b0 msgr2=0x7f4d1016aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d1015a2b0 0x7f4d1016aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 -- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d100d10a0 msgr2=0x7f4d100a85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:47.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d100d10a0 0x7f4d100a85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:47.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 -- 172.21.15.79:0/3454670264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8009420 con 0x7f4d10159ee0 2023-10-14T18:45:47.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d07fff700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800ec80 tx=0x7f4cf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.433+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800c850 con 0x7f4d10159ee0 2023-10-14T18:45:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.434+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800c9b0 con 0x7f4d10159ee0 2023-10-14T18:45:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.434+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800cd30 con 0x7f4d10159ee0 2023-10-14T18:45:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.434+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08009a20 con 0x7f4d10159ee0 2023-10-14T18:45:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.434+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1015b620 con 0x7f4d10159ee0 2023-10-14T18:45:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.434+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1015c390 con 0x7f4d10159ee0 2023-10-14T18:45:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.435+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cf8013680 con 0x7f4d10159ee0 2023-10-14T18:45:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.435+0000 7f4d06ffd700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 0x7f4cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.435+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4cf8084b90 con 0x7f4d10159ee0 2023-10-14T18:45:47.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.435+0000 7f4d0effd700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 0x7f4cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.436+0000 7f4d0effd700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 0x7f4cf00693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007130 tx=0x7f4d00007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:47.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.439+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cf8051d10 con 0x7f4d10159ee0 2023-10-14T18:45:47.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:47.623+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d1004c3c0 con 0x7f4d10159ee0 2023-10-14T18:45:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.617+0000 7f4d06ffd700 1 -- 172.21.15.79:0/3454670264 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4cf80170d0 con 0x7f4d10159ee0 2023-10-14T18:45:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 msgr2=0x7f4cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 0x7f4cf00693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007130 tx=0x7f4d00007eb0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 msgr2=0x7f4d1015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800ec80 tx=0x7f4cf80091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 shutdown_connections 2023-10-14T18:45:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4cf0066f30 0x7f4cf00693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d1015a2b0 0x7f4d1016aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d100d10a0 0x7f4d100a85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 --2- 172.21.15.79:0/3454670264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d10159ee0 0x7f4d1015a6a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 >> 172.21.15.79:0/3454670264 conn(0x7f4d10067660 msgr2=0x7f4d100d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 shutdown_connections 2023-10-14T18:45:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.620+0000 7f4d15320700 1 -- 172.21.15.79:0/3454670264 wait complete. 2023-10-14T18:45:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:45:48.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:45:48.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.758+0000 7fbaa70ef700 1 Processor -- start 2023-10-14T18:45:48.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.758+0000 7fbaa70ef700 1 -- start start 2023-10-14T18:45:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa70ef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa0159ef0 0x7fbaa015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa70ef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa00b46f0 0x7fbaa00b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa70ef700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00b5070 con 0x7fbaa00b6a10 2023-10-14T18:45:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa70ef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b17b0 con 0x7fbaa0159ef0 2023-10-14T18:45:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa70ef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00b1a60 con 0x7fbaa00b46f0 2023-10-14T18:45:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa0159ef0 0x7fbaa015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbaa0159ef0 0x7fbaa015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39468/0 (socket says 172.21.15.79:39468) 2023-10-14T18:45:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 -- 172.21.15.79:0/974424154 learned_addr learned my addr 172.21.15.79:0/974424154 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 -- 172.21.15.79:0/974424154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa00b46f0 msgr2=0x7fbaa00b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa568c700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa00b46f0 0x7fbaa00b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa00b46f0 0x7fbaa00b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 -- 172.21.15.79:0/974424154 >> v1:172.21.15.144:6789/0 conn(0x7fbaa00b6a10 legacy=0x7fbaa00b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 -- 172.21.15.79:0/974424154 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00b1d40 con 0x7fbaa0159ef0 2023-10-14T18:45:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fbaa4e8b700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa0159ef0 0x7fbaa015a2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fba98009990 tx=0x7fba98009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759a0c0fd2b83fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fba9f7fe700 1 -- 172.21.15.79:0/974424154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98005c10 con 0x7fbaa0159ef0 2023-10-14T18:45:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fba9f7fe700 1 -- 172.21.15.79:0/974424154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba98005d70 con 0x7fbaa0159ef0 2023-10-14T18:45:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.759+0000 7fba9f7fe700 1 -- 172.21.15.79:0/974424154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800b840 con 0x7fbaa0159ef0 2023-10-14T18:45:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 -- 172.21.15.79:0/974424154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa0159ef0 msgr2=0x7fbaa015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa0159ef0 0x7fbaa015a2c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fba98009990 tx=0x7fba98009220 comp rx=0 tx=0).stop 2023-10-14T18:45:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 -- 172.21.15.79:0/974424154 shutdown_connections 2023-10-14T18:45:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa00b46f0 0x7fbaa00b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/974424154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa0159ef0 0x7fbaa015a2c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 -- 172.21.15.79:0/974424154 >> 172.21.15.79:0/974424154 conn(0x7fbaa009a0a0 msgr2=0x7fbaa0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 -- 172.21.15.79:0/974424154 shutdown_connections 2023-10-14T18:45:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.760+0000 7fbaa70ef700 1 -- 172.21.15.79:0/974424154 wait complete. 2023-10-14T18:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.761+0000 7fbaa70ef700 1 Processor -- start 2023-10-14T18:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.761+0000 7fbaa70ef700 1 -- start start 2023-10-14T18:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa00b46f0 0x7fbaa014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0159ef0 0x7fbaa0151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0156690 con 0x7fbaa00b6a10 2023-10-14T18:45:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0150b50 con 0x7fbaa00b46f0 2023-10-14T18:45:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa70ef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0150e30 con 0x7fbaa0159ef0 2023-10-14T18:45:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39482/0 (socket says 172.21.15.79:39482) 2023-10-14T18:45:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 -- 172.21.15.79:0/2275830308 learned_addr learned my addr 172.21.15.79:0/2275830308 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa4e8b700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa00b46f0 0x7fbaa014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fbaa568c700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0159ef0 0x7fbaa0151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 -- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0159ef0 msgr2=0x7fbaa0151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0159ef0 0x7fbaa0151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 -- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa00b46f0 msgr2=0x7fbaa014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa00b46f0 0x7fbaa014d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 -- 172.21.15.79:0/2275830308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98009480 con 0x7fbaa00b6a10 2023-10-14T18:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.762+0000 7fba9ffff700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c910 tx=0x7fba90002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:48.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.763+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90012630 con 0x7fbaa00b6a10 2023-10-14T18:45:48.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.763+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba900127b0 con 0x7fbaa00b6a10 2023-10-14T18:45:48.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.763+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90012b70 con 0x7fbaa00b6a10 2023-10-14T18:45:48.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.763+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa0151110 con 0x7fbaa00b6a10 2023-10-14T18:45:48.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.763+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa01507b0 con 0x7fbaa00b6a10 2023-10-14T18:45:48.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.764+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa0156800 con 0x7fbaa00b6a10 2023-10-14T18:45:48.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.764+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba9001b400 con 0x7fbaa00b6a10 2023-10-14T18:45:48.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.764+0000 7fba9cff9700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:48.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.764+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fba900846a0 con 0x7fbaa00b6a10 2023-10-14T18:45:48.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.764+0000 7fbaa4e8b700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:48.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.765+0000 7fbaa4e8b700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 0x7fba800693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba98003080 tx=0x7fba98015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:48.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.769+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaa0156800 con 0x7fbaa00b6a10 2023-10-14T18:45:48.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:48.953+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbaa01567d0 con 0x7fbaa00b6a10 2023-10-14T18:45:49.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.620+0000 7fba9cff9700 1 -- 172.21.15.79:0/2275830308 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fba90051a70 con 0x7fbaa00b6a10 2023-10-14T18:45:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 msgr2=0x7fba800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 0x7fba800693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba98003080 tx=0x7fba98015000 comp rx=0 tx=0).stop 2023-10-14T18:45:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 msgr2=0x7fbaa01526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c910 tx=0x7fba90002720 comp rx=0 tx=0).stop 2023-10-14T18:45:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 shutdown_connections 2023-10-14T18:45:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba80066f30 0x7fba800693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbaa0159ef0 0x7fbaa0151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbaa00b46f0 0x7fbaa014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 --2- 172.21.15.79:0/2275830308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbaa00b6a10 0x7fbaa01526f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 >> 172.21.15.79:0/2275830308 conn(0x7fbaa009a0a0 msgr2=0x7fbaa015b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 shutdown_connections 2023-10-14T18:45:49.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.623+0000 7fbaa70ef700 1 -- 172.21.15.79:0/2275830308 wait complete. 2023-10-14T18:45:49.627 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:45:49.637 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:45:49.638 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:45:49.638 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:45:49.638 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:45:49.639 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:45:49.639 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:45:49.640 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:45:49.640 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:45:49.641 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:45:49.641 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:45:49.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:45:49.642 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:45:49.642 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:45:49.642 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:45:49.643 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:45:49.643 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:45:49.647 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:45:49.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:45:49.649 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:45:49.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:45:49.652 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:45:49.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:45:49.653 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:45:49.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:45:49.690 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:45:49.691 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:49.692 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:45:49.692 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:49.694 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:45:49.695 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:49.698 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:45:49.698 DEBUG:teuthology.parallel:result is None 2023-10-14T18:45:49.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:45:49.766 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:45:49.767 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:45:49.775 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:45:49.775 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:45:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.822+0000 7f6222e67700 1 Processor -- start 2023-10-14T18:45:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.822+0000 7f6222e67700 1 -- start start 2023-10-14T18:45:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222e67700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c159da0 0x7f621c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222e67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f621c15a170 0x7f621c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222e67700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621c15ea70 con 0x7f621c069040 2023-10-14T18:45:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222e67700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621c0694e0 con 0x7f621c15a170 2023-10-14T18:45:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222e67700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0b3990 con 0x7f621c159da0 2023-10-14T18:45:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f621c15a170 0x7f621c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222666700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f621c069040 0x7f621c0af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58944/0 (socket says 172.21.15.79:58944) 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6222666700 1 -- 172.21.15.79:0/1112867470 learned_addr learned my addr 172.21.15.79:0/1112867470 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 -- 172.21.15.79:0/1112867470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c159da0 msgr2=0x7f621c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 --2- 172.21.15.79:0/1112867470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c159da0 0x7f621c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 -- 172.21.15.79:0/1112867470 >> v1:172.21.15.79:6789/0 conn(0x7f621c069040 legacy=0x7f621c0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 -- 172.21.15.79:0/1112867470 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0b0b70 con 0x7f621c15a170 2023-10-14T18:45:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6220e63700 1 -- 172.21.15.79:0/1112867470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186690309 0 0) 0x7f621c15ea70 con 0x7f621c069040 2023-10-14T18:45:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.823+0000 7f6221664700 1 --2- 172.21.15.79:0/1112867470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c15a170 0x7f621c068b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62100098e0 tx=0x7f62100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2de40d7cf6fb90b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6220e63700 1 -- 172.21.15.79:0/1112867470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210009e80 con 0x7f621c15a170 2023-10-14T18:45:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6220e63700 1 -- 172.21.15.79:0/1112867470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621000b860 con 0x7f621c15a170 2023-10-14T18:45:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6220e63700 1 -- 172.21.15.79:0/1112867470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000bbe0 con 0x7f621c15a170 2023-10-14T18:45:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 -- 172.21.15.79:0/1112867470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c15a170 msgr2=0x7f621c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 --2- 172.21.15.79:0/1112867470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c15a170 0x7f621c068b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f62100098e0 tx=0x7f62100091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 -- 172.21.15.79:0/1112867470 shutdown_connections 2023-10-14T18:45:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 --2- 172.21.15.79:0/1112867470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c159da0 0x7f621c0b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 --2- 172.21.15.79:0/1112867470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c15a170 0x7f621c068b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 -- 172.21.15.79:0/1112867470 >> 172.21.15.79:0/1112867470 conn(0x7f621c0d0bc0 msgr2=0x7f621c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 -- 172.21.15.79:0/1112867470 shutdown_connections 2023-10-14T18:45:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.824+0000 7f6222e67700 1 -- 172.21.15.79:0/1112867470 wait complete. 2023-10-14T18:45:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.825+0000 7f6222e67700 1 Processor -- start 2023-10-14T18:45:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.825+0000 7f6222e67700 1 -- start start 2023-10-14T18:45:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621c069040 0x7f621c146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c15a170 0x7f621c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1584f0 con 0x7f621c159da0 2023-10-14T18:45:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c15aea0 con 0x7f621c069040 2023-10-14T18:45:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222e67700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c0caef0 con 0x7f621c15a170 2023-10-14T18:45:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39526/0 (socket says 172.21.15.79:39526) 2023-10-14T18:45:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 -- 172.21.15.79:0/1446691570 learned_addr learned my addr 172.21.15.79:0/1446691570 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221e65700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621c069040 0x7f621c146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6222666700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c15a170 0x7f621c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 -- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c15a170 msgr2=0x7f621c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c15a170 0x7f621c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 -- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621c069040 msgr2=0x7f621c146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621c069040 0x7f621c146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.826+0000 7f6221664700 1 -- 172.21.15.79:0/1446691570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009420 con 0x7f621c159da0 2023-10-14T18:45:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6221664700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f621000b3c0 tx=0x7f6210017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000bbe0 con 0x7f621c159da0 2023-10-14T18:45:49.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210011420 con 0x7f621c159da0 2023-10-14T18:45:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c15b160 con 0x7f621c159da0 2023-10-14T18:45:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100117e0 con 0x7f621c159da0 2023-10-14T18:45:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.827+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c15b720 con 0x7f621c159da0 2023-10-14T18:45:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.828+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621c089480 con 0x7f621c159da0 2023-10-14T18:45:49.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.828+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6210011c10 con 0x7f621c159da0 2023-10-14T18:45:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.829+0000 7f6219ffb700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.829+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6210085bb0 con 0x7f621c159da0 2023-10-14T18:45:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.829+0000 7f6221e65700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:49.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.829+0000 7f6221e65700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6214009bf0 tx=0x7f62140091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:49.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:49.833+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6210053080 con 0x7f621c159da0 2023-10-14T18:45:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.028+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f621c15def0 con 0x7f621c159da0 2023-10-14T18:45:50.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.638+0000 7f6219ffb700 1 -- 172.21.15.79:0/1446691570 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f62100566a0 con 0x7f621c159da0 2023-10-14T18:45:50.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 msgr2=0x7f62080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 0x7f62080693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6214009bf0 tx=0x7f62140091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 msgr2=0x7f621c0ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f621000b3c0 tx=0x7f6210017000 comp rx=0 tx=0).stop 2023-10-14T18:45:50.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 shutdown_connections 2023-10-14T18:45:50.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6208066f30 0x7f62080693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f621c15a170 0x7f621c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f621c069040 0x7f621c146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 --2- 172.21.15.79:0/1446691570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f621c159da0 0x7f621c0ca6c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 >> 172.21.15.79:0/1446691570 conn(0x7f621c0d0bc0 msgr2=0x7f621c0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:50.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 shutdown_connections 2023-10-14T18:45:50.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.641+0000 7f6222e67700 1 -- 172.21.15.79:0/1446691570 wait complete. 2023-10-14T18:45:50.645 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:45:50.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:45:50.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.769+0000 7fc75ca70700 1 Processor -- start 2023-10-14T18:45:50.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.769+0000 7fc75ca70700 1 -- start start 2023-10-14T18:45:50.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc75ca70700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7580cdab0 0x7fc75815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc75ca70700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc75815dda0 0x7fc75815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc75ca70700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580cb7c0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc75ca70700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75815e850 con 0x7fc75815dda0 2023-10-14T18:45:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc75ca70700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7580cc360 con 0x7fc7580cdab0 2023-10-14T18:45:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc75815dda0 0x7fc75815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc75815dda0 0x7fc75815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39538/0 (socket says 172.21.15.79:39538) 2023-10-14T18:45:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 -- 172.21.15.79:0/464170640 learned_addr learned my addr 172.21.15.79:0/464170640 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc74effd700 1 --2- 172.21.15.79:0/464170640 >> v2:172.21.15.144:3300/0 conn(0x7fc7580cdab0 0x7fc75815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 -- 172.21.15.79:0/464170640 >> v2:172.21.15.144:3300/0 conn(0x7fc7580cdab0 msgr2=0x7fc75815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 --2- 172.21.15.79:0/464170640 >> v2:172.21.15.144:3300/0 conn(0x7fc7580cdab0 0x7fc75815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 -- 172.21.15.79:0/464170640 >> v1:172.21.15.144:6789/0 conn(0x7fc7580cd6e0 legacy=0x7fc7580cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 -- 172.21.15.79:0/464170640 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75815e290 con 0x7fc75815dda0 2023-10-14T18:45:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.770+0000 7fc757fff700 1 --2- 172.21.15.79:0/464170640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75815dda0 0x7fc75815cbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7580b6c70 tx=0x7fc750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942d9b1a2b8f870d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc756ffd700 1 -- 172.21.15.79:0/464170640 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75000e070 con 0x7fc75815dda0 2023-10-14T18:45:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc756ffd700 1 -- 172.21.15.79:0/464170640 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75000ba50 con 0x7fc75815dda0 2023-10-14T18:45:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc756ffd700 1 -- 172.21.15.79:0/464170640 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7500092e0 con 0x7fc75815dda0 2023-10-14T18:45:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 -- 172.21.15.79:0/464170640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75815dda0 msgr2=0x7fc75815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 --2- 172.21.15.79:0/464170640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75815dda0 0x7fc75815cbd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7580b6c70 tx=0x7fc750009840 comp rx=0 tx=0).stop 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 -- 172.21.15.79:0/464170640 shutdown_connections 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 --2- 172.21.15.79:0/464170640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc75815dda0 0x7fc75815cbd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 --2- 172.21.15.79:0/464170640 >> v2:172.21.15.144:3300/0 conn(0x7fc7580cdab0 0x7fc75815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 -- 172.21.15.79:0/464170640 >> 172.21.15.79:0/464170640 conn(0x7fc758067660 msgr2=0x7fc758067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 -- 172.21.15.79:0/464170640 shutdown_connections 2023-10-14T18:45:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.771+0000 7fc75ca70700 1 -- 172.21.15.79:0/464170640 wait complete. 2023-10-14T18:45:50.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.772+0000 7fc75ca70700 1 Processor -- start 2023-10-14T18:45:50.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.772+0000 7fc75ca70700 1 -- start start 2023-10-14T18:45:50.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7580cdab0 0x7fc7580b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 0x7fc7580b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580b6160 con 0x7fc7580cd6e0 2023-10-14T18:45:50.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581539c0 con 0x7fc7580cdab0 2023-10-14T18:45:50.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc75ca70700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580b5550 con 0x7fc75815dda0 2023-10-14T18:45:50.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc7577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc7577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39544/0 (socket says 172.21.15.79:39544) 2023-10-14T18:45:50.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc7577fe700 1 -- 172.21.15.79:0/2555992764 learned_addr learned my addr 172.21.15.79:0/2555992764 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:50.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc74effd700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7580cdab0 0x7fc7580b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.773+0000 7fc757fff700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 0x7fc7580b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 -- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 msgr2=0x7fc7580b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 0x7fc7580b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 -- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7580cdab0 msgr2=0x7fc7580b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:50.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7580cdab0 0x7fc7580b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:50.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 -- 172.21.15.79:0/2555992764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750009ae0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc757fff700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 0x7fc7580b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc7577fe700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c590 tx=0x7fc74800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011590 con 0x7fc7580cd6e0 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748011710 con 0x7fc7580cd6e0 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748011ad0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580b5830 con 0x7fc7580cd6e0 2023-10-14T18:45:50.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.774+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7580b5df0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.775+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc758089280 con 0x7fc7580cd6e0 2023-10-14T18:45:50.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.775+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc74801b3b0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.775+0000 7fc74ffff700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:50.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.776+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc7480837b0 con 0x7fc7580cd6e0 2023-10-14T18:45:50.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.776+0000 7fc74effd700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:50.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.776+0000 7fc74effd700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc75815da60 tx=0x7fc740008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:50.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:50.780+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc748050cd0 con 0x7fc7580cd6e0 2023-10-14T18:45:51.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.036+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc75804bb80 con 0x7fc7580cd6e0 2023-10-14T18:45:51.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.037+0000 7fc74ffff700 1 -- 172.21.15.79:0/2555992764 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc748017020 con 0x7fc7580cd6e0 2023-10-14T18:45:51.038 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:51.038 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:45:51.038 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:45:51.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.039 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:45:51.039 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:45:51.039 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:45:51.040 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:45:51.040 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.041 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.042 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:45:51.042 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:45:51.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.043 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:45:51.043 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:45:51.043 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.043 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.044 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:45:51.044 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:45:51.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:45:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:45:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.045 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:45:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:45:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:45:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:45:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.047 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.049 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:45:51.049 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:45:51.049 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.050 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.050 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.052 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:45:51.052 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:45:51.052 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.053 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.054 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:45:51.054 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:45:51.054 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.056 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:45:51.056 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:45:51.056 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.057 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:45:51.058 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:45:51.058 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.059 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:45:51.059 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:45:51.060 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:45:51.060 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:45:51.060 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:45:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:45:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.062 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.062 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:45:51.062 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:45:51.062 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:45:51.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.063 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:45:51.063 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:45:51.063 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:45:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:45:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.065 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.066 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:45:51.066 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:45:51.066 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:45:51.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.067 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:45:51.067 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:45:51.067 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.067 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:45:51.068 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:45:51.068 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:45:51.068 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:45:51.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.069 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:45:51.069 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:45:51.069 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.069 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:45:51.070 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:45:51.070 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:45:51.070 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.071 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mds", 2023-10-14T18:45:51.071 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4SplhJzAKhAAs27jY+CvZ5KLb77oEq5ouw==", 2023-10-14T18:45:51.071 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.071 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T18:45:51.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.072 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T18:45:51.072 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4Spll6XAKhAAGZFjGxgNasPDcUEY9izv7A==", 2023-10-14T18:45:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T18:45:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.074 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-osd", 2023-10-14T18:45:51.074 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4SpliK7AKhAA42rL8l6zWi0zCzXPEv9hJA==", 2023-10-14T18:45:51.074 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.074 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T18:45:51.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.075 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T18:45:51.075 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4SplP7fAKhAAYizgvLlbStnQzqLkmZmwTA==", 2023-10-14T18:45:51.075 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.076 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T18:45:51.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.076 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T18:45:51.077 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4Spl5r7AKhAAs0NKBFxplXZpqSJR9YlOag==", 2023-10-14T18:45:51.077 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.077 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T18:45:51.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.078 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T18:45:51.078 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCk4SplusbAKhAApmFIoSVJdFbzvo/5KVIAtw==", 2023-10-14T18:45:51.078 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.078 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:45:51.079 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.080 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:45:51.080 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:45:51.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:45:51.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:51.081 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:45:51.081 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:45:51.081 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:45:51.081 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:45:51.082 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:45:51.082 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:45:51.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:51.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:45:51.083 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:45:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 msgr2=0x7fc7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 0x7fc7380693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc75815da60 tx=0x7fc740008040 comp rx=0 tx=0).stop 2023-10-14T18:45:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 msgr2=0x7fc75814c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c590 tx=0x7fc74800c8a0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 shutdown_connections 2023-10-14T18:45:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc738066f30 0x7fc7380693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc75815dda0 0x7fc7580b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7580cd6e0 0x7fc75814c9f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 --2- 172.21.15.79:0/2555992764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7580cdab0 0x7fc7580b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 >> 172.21.15.79:0/2555992764 conn(0x7fc758067660 msgr2=0x7fc758156850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 shutdown_connections 2023-10-14T18:45:51.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.039+0000 7fc75ca70700 1 -- 172.21.15.79:0/2555992764 wait complete. 2023-10-14T18:45:51.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T18:45:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.201+0000 7fd18c74d700 1 Processor -- start 2023-10-14T18:45:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.201+0000 7fd18c74d700 1 -- start start 2023-10-14T18:45:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18c74d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd18415a620 0x7fd18415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18c74d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd18415d580 0x7fd184158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18c74d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18415cbb0 con 0x7fd184157870 2023-10-14T18:45:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18c74d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18415bdb0 con 0x7fd18415d580 2023-10-14T18:45:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18c74d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18415bfa0 con 0x7fd18415a620 2023-10-14T18:45:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18acea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd18415d580 0x7fd184158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18acea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd18415d580 0x7fd184158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39554/0 (socket says 172.21.15.79:39554) 2023-10-14T18:45:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd18acea700 1 -- 172.21.15.79:0/3668716612 learned_addr learned my addr 172.21.15.79:0/3668716612 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.202+0000 7fd189ce8700 1 --2- 172.21.15.79:0/3668716612 >> v2:172.21.15.144:3300/0 conn(0x7fd18415a620 0x7fd18415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18acea700 1 -- 172.21.15.79:0/3668716612 >> v2:172.21.15.144:3300/0 conn(0x7fd18415a620 msgr2=0x7fd18415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18acea700 1 --2- 172.21.15.79:0/3668716612 >> v2:172.21.15.144:3300/0 conn(0x7fd18415a620 0x7fd18415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18acea700 1 -- 172.21.15.79:0/3668716612 >> v1:172.21.15.144:6789/0 conn(0x7fd184157870 legacy=0x7fd18415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18acea700 1 -- 172.21.15.79:0/3668716612 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18415c280 con 0x7fd18415d580 2023-10-14T18:45:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18acea700 1 --2- 172.21.15.79:0/3668716612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415d580 0x7fd184158110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd18415cb20 tx=0x7fd17c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc63b7e6bbf1d054 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd1894e7700 1 -- 172.21.15.79:0/3668716612 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c009e70 con 0x7fd18415d580 2023-10-14T18:45:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd1894e7700 1 -- 172.21.15.79:0/3668716612 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00b860 con 0x7fd18415d580 2023-10-14T18:45:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd1894e7700 1 -- 172.21.15.79:0/3668716612 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00bc00 con 0x7fd18415d580 2023-10-14T18:45:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 -- 172.21.15.79:0/3668716612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415d580 msgr2=0x7fd184158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 --2- 172.21.15.79:0/3668716612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415d580 0x7fd184158110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd18415cb20 tx=0x7fd17c009250 comp rx=0 tx=0).stop 2023-10-14T18:45:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 -- 172.21.15.79:0/3668716612 shutdown_connections 2023-10-14T18:45:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 --2- 172.21.15.79:0/3668716612 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415d580 0x7fd184158110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 --2- 172.21.15.79:0/3668716612 >> v2:172.21.15.144:3300/0 conn(0x7fd18415a620 0x7fd18415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 -- 172.21.15.79:0/3668716612 >> 172.21.15.79:0/3668716612 conn(0x7fd184068ce0 msgr2=0x7fd1840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 -- 172.21.15.79:0/3668716612 shutdown_connections 2023-10-14T18:45:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.203+0000 7fd18c74d700 1 -- 172.21.15.79:0/3668716612 wait complete. 2023-10-14T18:45:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.204+0000 7fd18c74d700 1 Processor -- start 2023-10-14T18:45:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.204+0000 7fd18c74d700 1 -- start start 2023-10-14T18:45:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd184157870 0x7fd1840d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd18415d580 0x7fd1840b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18414d360 con 0x7fd18415a620 2023-10-14T18:45:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840b36e0 con 0x7fd18415d580 2023-10-14T18:45:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18c74d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840d01d0 con 0x7fd184157870 2023-10-14T18:45:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd189ce8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd189ce8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39570/0 (socket says 172.21.15.79:39570) 2023-10-14T18:45:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd189ce8700 1 -- 172.21.15.79:0/828316093 learned_addr learned my addr 172.21.15.79:0/828316093 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18acea700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd18415d580 0x7fd1840b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.205+0000 7fd18a4e9700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd184157870 0x7fd1840d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 -- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd184157870 msgr2=0x7fd1840d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd184157870 0x7fd1840d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 -- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd18415d580 msgr2=0x7fd1840b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd18415d580 0x7fd1840b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 -- 172.21.15.79:0/828316093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0094f0 con 0x7fd18415a620 2023-10-14T18:45:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd189ce8700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd17400ec50 tx=0x7fd1740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17400c9d0 con 0x7fd18415a620 2023-10-14T18:45:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17400cb30 con 0x7fd18415a620 2023-10-14T18:45:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1840b3160 con 0x7fd18415a620 2023-10-14T18:45:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174013470 con 0x7fd18415a620 2023-10-14T18:45:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.206+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1840cfb70 con 0x7fd18415a620 2023-10-14T18:45:51.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.207+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd184063820 con 0x7fd18415a620 2023-10-14T18:45:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.207+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd174013860 con 0x7fd18415a620 2023-10-14T18:45:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.207+0000 7fd17a7fc700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.208+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd1740845b0 con 0x7fd18415a620 2023-10-14T18:45:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.208+0000 7fd18a4e9700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.208+0000 7fd18a4e9700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 0x7fd1680693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd180007fd0 tx=0x7fd180009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.212+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd174051ad0 con 0x7fd18415a620 2023-10-14T18:45:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.469+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd18404c3c0 con 0x7fd18415a620 2023-10-14T18:45:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.473+0000 7fd17a7fc700 1 -- 172.21.15.79:0/828316093 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1740550f0 con 0x7fd18415a620 2023-10-14T18:45:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 msgr2=0x7fd1680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 0x7fd1680693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd180007fd0 tx=0x7fd180009040 comp rx=0 tx=0).stop 2023-10-14T18:45:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 msgr2=0x7fd1840b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd17400ec50 tx=0x7fd1740091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 shutdown_connections 2023-10-14T18:45:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd168066f30 0x7fd1680693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd18415d580 0x7fd1840b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd184157870 0x7fd1840d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 --2- 172.21.15.79:0/828316093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18415a620 0x7fd1840b2880 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.475+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 >> 172.21.15.79:0/828316093 conn(0x7fd184068ce0 msgr2=0x7fd184155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.476+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 shutdown_connections 2023-10-14T18:45:51.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.476+0000 7fd18c74d700 1 -- 172.21.15.79:0/828316093 wait complete. 2023-10-14T18:45:51.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T18:45:51.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.602+0000 7f42cec65700 1 Processor -- start 2023-10-14T18:45:51.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.602+0000 7f42cec65700 1 -- start start 2023-10-14T18:45:51.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42cec65700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42c8157870 0x7f42c815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42cec65700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c815cbb0 con 0x7f42c815a620 2023-10-14T18:45:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42cec65700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c815bfa0 con 0x7f42c8157c40 2023-10-14T18:45:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42cec65700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c815c280 con 0x7f42c8157870 2023-10-14T18:45:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42c815a620 0x7f42c815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58960/0 (socket says 172.21.15.79:58960) 2023-10-14T18:45:51.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c7fff700 1 -- 172.21.15.79:0/3536445672 learned_addr learned my addr 172.21.15.79:0/3536445672 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273247371 0 0) 0x7f42c815cbb0 con 0x7f42c815a620 2023-10-14T18:45:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42cca01700 1 --2- 172.21.15.79:0/3536445672 >> v2:172.21.15.144:3300/0 conn(0x7f42c8157870 0x7f42c815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0003570 con 0x7f42c815a620 2023-10-14T18:45:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994317913 0 0) 0x7f42b0003570 con 0x7f42c815a620 2023-10-14T18:45:51.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 >> v2:172.21.15.144:3300/0 conn(0x7f42c8157870 msgr2=0x7f42c815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 --2- 172.21.15.79:0/3536445672 >> v2:172.21.15.144:3300/0 conn(0x7f42c8157870 0x7f42c815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 >> v1:172.21.15.144:6789/0 conn(0x7f42c8157c40 legacy=0x7f42c8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c815c560 con 0x7f42c815a620 2023-10-14T18:45:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f42bc001470 con 0x7f42c815a620 2023-10-14T18:45:51.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 >> v1:172.21.15.79:6789/0 conn(0x7f42c815a620 legacy=0x7f42c815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.603+0000 7f42c77fe700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0003a60 0x7f42b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 0x7f42b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b00051c0 0x7f42b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815c280 con 0x7f42b0004810 2023-10-14T18:45:51.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b000c160 con 0x7f42b0003a60 2023-10-14T18:45:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b000c320 con 0x7f42b00051c0 2023-10-14T18:45:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 0x7f42b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42cca01700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0003a60 0x7f42b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42cd202700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b00051c0 0x7f42b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 -- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b00051c0 msgr2=0x7f42b000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42b00051c0 0x7f42b000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 -- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0003a60 msgr2=0x7f42b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0003a60 0x7f42b0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 -- 172.21.15.79:0/3536445672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0003570 con 0x7f42b0004810 2023-10-14T18:45:51.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42cd202700 1 -- 172.21.15.79:0/3536445672 reap_dead start 2023-10-14T18:45:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42cca01700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0003a60 0x7f42b0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 0x7f42b0004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c390 tx=0x7f42bc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9178e0c2e7f7e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00cc60 con 0x7f42b0004810 2023-10-14T18:45:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00cdc0 con 0x7f42b0004810 2023-10-14T18:45:51.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.604+0000 7f42c77fe700 1 -- 172.21.15.79:0/3536445672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc005b50 con 0x7f42b0004810 2023-10-14T18:45:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 -- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 msgr2=0x7f42b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 0x7f42b0004c80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00c390 tx=0x7f42bc001e50 comp rx=0 tx=0).stop 2023-10-14T18:45:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 -- 172.21.15.79:0/3536445672 shutdown_connections 2023-10-14T18:45:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 --2- 172.21.15.79:0/3536445672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b0004810 0x7f42b0004c80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 -- 172.21.15.79:0/3536445672 >> 172.21.15.79:0/3536445672 conn(0x7f42c8068ce0 msgr2=0x7f42c80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 -- 172.21.15.79:0/3536445672 shutdown_connections 2023-10-14T18:45:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.605+0000 7f42cec65700 1 -- 172.21.15.79:0/3536445672 wait complete. 2023-10-14T18:45:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.606+0000 7f42cec65700 1 Processor -- start 2023-10-14T18:45:51.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.606+0000 7f42cec65700 1 -- start start 2023-10-14T18:45:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0004810 0x7f42c813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 0x7f42c814dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8151d60 con 0x7f42c814f510 2023-10-14T18:45:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8153650 con 0x7f42b0004810 2023-10-14T18:45:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c814cdb0 con 0x7f42c814f0a0 2023-10-14T18:45:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39592/0 (socket says 172.21.15.79:39592) 2023-10-14T18:45:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 -- 172.21.15.79:0/3018044587 learned_addr learned my addr 172.21.15.79:0/3018044587 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 0x7f42c814dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 -- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 msgr2=0x7f42c814dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cca01700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0004810 0x7f42c813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 0x7f42c814dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 -- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0004810 msgr2=0x7f42c813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0004810 0x7f42c813d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 -- 172.21.15.79:0/3018044587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c814e850 con 0x7f42c814f510 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42c7fff700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 0x7f42c814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cd202700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42c80b3830 tx=0x7f42c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000ee60 con 0x7f42c814f510 2023-10-14T18:45:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0012590 con 0x7f42c814f510 2023-10-14T18:45:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0012950 con 0x7f42c814f510 2023-10-14T18:45:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.607+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c814eb30 con 0x7f42c814f510 2023-10-14T18:45:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.608+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c81532e0 con 0x7f42c814f510 2023-10-14T18:45:51.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.608+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c8153140 con 0x7f42c814f510 2023-10-14T18:45:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.609+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42c0012d40 con 0x7f42c814f510 2023-10-14T18:45:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.609+0000 7f42c4ff9700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.609+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f42c0084080 con 0x7f42c814f510 2023-10-14T18:45:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.609+0000 7f42cca01700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:51.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.610+0000 7f42cca01700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 0x7f42b40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42c8156de0 tx=0x7f42b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:51.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.613+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42c8153140 con 0x7f42c814f510 2023-10-14T18:45:51.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.869+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f42c8153140 con 0x7f42c814f510 2023-10-14T18:45:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.872+0000 7f42c4ff9700 1 -- 172.21.15.79:0/3018044587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f42c8153140 con 0x7f42c814f510 2023-10-14T18:45:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 msgr2=0x7f42b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 0x7f42b40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f42c8156de0 tx=0x7f42b800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 msgr2=0x7f42c814e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42c80b3830 tx=0x7f42c0009040 comp rx=0 tx=0).stop 2023-10-14T18:45:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 shutdown_connections 2023-10-14T18:45:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.874+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b4066f30 0x7f42b40693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42c814f510 0x7f42c814e1b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0004810 0x7f42c813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 --2- 172.21.15.79:0/3018044587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42c814f0a0 0x7f42c814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 >> 172.21.15.79:0/3018044587 conn(0x7f42c8068ce0 msgr2=0x7f42c814d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 shutdown_connections 2023-10-14T18:45:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:51.875+0000 7f42cec65700 1 -- 172.21.15.79:0/3018044587 wait complete. 2023-10-14T18:45:51.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T18:45:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.001+0000 7fe5590ec700 1 Processor -- start 2023-10-14T18:45:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.001+0000 7fe5590ec700 1 -- start start 2023-10-14T18:45:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe5590ec700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe55415a620 0x7fe55415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe5590ec700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe55415d580 0x7fe554158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe5590ec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55415cbb0 con 0x7fe554157870 2023-10-14T18:45:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe5590ec700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55415bdb0 con 0x7fe55415a620 2023-10-14T18:45:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe5590ec700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55415bfa0 con 0x7fe55415d580 2023-10-14T18:45:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe55415a620 0x7fe55415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe552d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe554157870 0x7fe55415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58962/0 (socket says 172.21.15.79:58962) 2023-10-14T18:45:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe552d9d700 1 -- 172.21.15.79:0/2131644969 learned_addr learned my addr 172.21.15.79:0/2131644969 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:52.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe55359e700 1 --2- 172.21.15.79:0/2131644969 >> v2:172.21.15.144:3300/0 conn(0x7fe55415d580 0x7fe554158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 -- 172.21.15.79:0/2131644969 >> v2:172.21.15.144:3300/0 conn(0x7fe55415d580 msgr2=0x7fe554158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 --2- 172.21.15.79:0/2131644969 >> v2:172.21.15.144:3300/0 conn(0x7fe55415d580 0x7fe554158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 -- 172.21.15.79:0/2131644969 >> v1:172.21.15.79:6789/0 conn(0x7fe554157870 legacy=0x7fe55415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe55259c700 1 -- 172.21.15.79:0/2131644969 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406397776 0 0) 0x7fe55415cbb0 con 0x7fe554157870 2023-10-14T18:45:52.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 -- 172.21.15.79:0/2131644969 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55415c280 con 0x7fe55415a620 2023-10-14T18:45:52.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe54bfff700 1 --2- 172.21.15.79:0/2131644969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe55415a620 0x7fe55415d040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe55406b4e0 tx=0x7fe53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c7312e39bf5aef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe55259c700 1 -- 172.21.15.79:0/2131644969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00b6b0 con 0x7fe55415a620 2023-10-14T18:45:52.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe55259c700 1 -- 172.21.15.79:0/2131644969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00b810 con 0x7fe55415a620 2023-10-14T18:45:52.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.002+0000 7fe55259c700 1 -- 172.21.15.79:0/2131644969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00bbb0 con 0x7fe55415a620 2023-10-14T18:45:52.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 -- 172.21.15.79:0/2131644969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe55415a620 msgr2=0x7fe55415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 --2- 172.21.15.79:0/2131644969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe55415a620 0x7fe55415d040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe55406b4e0 tx=0x7fe53c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 -- 172.21.15.79:0/2131644969 shutdown_connections 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 --2- 172.21.15.79:0/2131644969 >> v2:172.21.15.144:3300/0 conn(0x7fe55415d580 0x7fe554158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 --2- 172.21.15.79:0/2131644969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe55415a620 0x7fe55415d040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 -- 172.21.15.79:0/2131644969 >> 172.21.15.79:0/2131644969 conn(0x7fe554068ce0 msgr2=0x7fe5540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:52.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 -- 172.21.15.79:0/2131644969 shutdown_connections 2023-10-14T18:45:52.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.003+0000 7fe5590ec700 1 -- 172.21.15.79:0/2131644969 wait complete. 2023-10-14T18:45:52.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.004+0000 7fe5590ec700 1 Processor -- start 2023-10-14T18:45:52.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.004+0000 7fe5590ec700 1 -- start start 2023-10-14T18:45:52.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe55415a620 0x7fe5540d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe55415d580 0x7fe5540d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540d1690 con 0x7fe554157870 2023-10-14T18:45:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55416e4f0 con 0x7fe55415d580 2023-10-14T18:45:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540d10e0 con 0x7fe55415a620 2023-10-14T18:45:52.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39614/0 (socket says 172.21.15.79:39614) 2023-10-14T18:45:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 -- 172.21.15.79:0/633525023 learned_addr learned my addr 172.21.15.79:0/633525023 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe55359e700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe55415d580 0x7fe5540d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 -- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe55415a620 msgr2=0x7fe5540d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe54bfff700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe55415a620 0x7fe5540d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe55415a620 0x7fe5540d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 -- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe55415d580 msgr2=0x7fe5540d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe55415d580 0x7fe5540d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 -- 172.21.15.79:0/633525023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009420 con 0x7fe554157870 2023-10-14T18:45:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe552d9d700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7e0 tx=0x7fe544007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544005b30 con 0x7fe554157870 2023-10-14T18:45:52.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544005c90 con 0x7fe554157870 2023-10-14T18:45:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5540d13b0 con 0x7fe554157870 2023-10-14T18:45:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544007300 con 0x7fe554157870 2023-10-14T18:45:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.005+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55416e180 con 0x7fe554157870 2023-10-14T18:45:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.006+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55404c3c0 con 0x7fe554157870 2023-10-14T18:45:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.007+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5440076b0 con 0x7fe554157870 2023-10-14T18:45:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.007+0000 7fe54affd700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.007+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe544083c80 con 0x7fe554157870 2023-10-14T18:45:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.007+0000 7fe54bfff700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.008+0000 7fe54bfff700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 0x7fe5340693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe55415aa20 tx=0x7fe53c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.011+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5440512c0 con 0x7fe554157870 2023-10-14T18:45:52.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.266+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe55415c560 con 0x7fe554157870 2023-10-14T18:45:52.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.271+0000 7fe54affd700 1 -- 172.21.15.79:0/633525023 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5440548e0 con 0x7fe554157870 2023-10-14T18:45:52.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 msgr2=0x7fe5340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 0x7fe5340693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe55415aa20 tx=0x7fe53c017000 comp rx=0 tx=0).stop 2023-10-14T18:45:52.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 msgr2=0x7fe554151e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7e0 tx=0x7fe544007df0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 shutdown_connections 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe534066f30 0x7fe5340693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe55415d580 0x7fe5540d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe554157870 0x7fe554151e70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 --2- 172.21.15.79:0/633525023 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe55415a620 0x7fe5540d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 >> 172.21.15.79:0/633525023 conn(0x7fe554068ce0 msgr2=0x7fe554159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:52.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 shutdown_connections 2023-10-14T18:45:52.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.273+0000 7fe5590ec700 1 -- 172.21.15.79:0/633525023 wait complete. 2023-10-14T18:45:52.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T18:45:52.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.400+0000 7f946a6c2700 1 Processor -- start 2023-10-14T18:45:52.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 -- start start 2023-10-14T18:45:52.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9464070e10 0x7f946406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f946406e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9464068a90 con 0x7f946415b340 2023-10-14T18:45:52.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94640ca330 con 0x7f9464070e10 2023-10-14T18:45:52.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.401+0000 7f946a6c2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946415ca70 con 0x7f94640cb000 2023-10-14T18:45:52.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9463fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f946415b340 0x7f9464070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58968/0 (socket says 172.21.15.79:58968) 2023-10-14T18:45:52.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9463fff700 1 -- 172.21.15.79:0/238194537 learned_addr learned my addr 172.21.15.79:0/238194537 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:52.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f94637fe700 1 --2- 172.21.15.79:0/238194537 >> v2:172.21.15.144:3300/0 conn(0x7f9464070e10 0x7f946406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9468c5f700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f946406e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337755898 0 0) 0x7f9464068a90 con 0x7f946415b340 2023-10-14T18:45:52.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f944c003570 con 0x7f946415b340 2023-10-14T18:45:52.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537808966 0 0) 0x7f944c003570 con 0x7f946415b340 2023-10-14T18:45:52.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 msgr2=0x7f946406e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f946406e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 >> v2:172.21.15.144:3300/0 conn(0x7f9464070e10 msgr2=0x7f946406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 --2- 172.21.15.79:0/238194537 >> v2:172.21.15.144:3300/0 conn(0x7f9464070e10 0x7f946406e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464068f20 con 0x7f946415b340 2023-10-14T18:45:52.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f9454001470 con 0x7f946415b340 2023-10-14T18:45:52.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 >> v1:172.21.15.79:6789/0 conn(0x7f946415b340 legacy=0x7f9464070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f944c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f944c003fe0 0x7f944c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f944c004d50 0x7f944c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946415ca70 con 0x7f944c003fe0 2023-10-14T18:45:52.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c00ba60 con 0x7f944c004d50 2023-10-14T18:45:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c00bbd0 con 0x7f94640cb000 2023-10-14T18:45:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f94637fe700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f944c003fe0 0x7f944c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9463fff700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f944c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.402+0000 7f9468c5f700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f944c004d50 0x7f944c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 -- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 msgr2=0x7f944c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94640cb000 0x7f944c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 -- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f944c004d50 msgr2=0x7f944c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f944c004d50 0x7f944c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 -- 172.21.15.79:0/238194537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c003570 con 0x7f944c003fe0 2023-10-14T18:45:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f94637fe700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f944c003fe0 0x7f944c004810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f946406f740 tx=0x7f94580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6c20b577ffb850 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800e680 con 0x7f944c003fe0 2023-10-14T18:45:52.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800e7e0 con 0x7f944c003fe0 2023-10-14T18:45:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f9462ffd700 1 -- 172.21.15.79:0/238194537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800eba0 con 0x7f944c003fe0 2023-10-14T18:45:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 -- 172.21.15.79:0/238194537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f944c003fe0 msgr2=0x7f944c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 --2- 172.21.15.79:0/238194537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f944c003fe0 0x7f944c004810 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f946406f740 tx=0x7f94580091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f9468c5f700 1 -- 172.21.15.79:0/238194537 reap_dead start 2023-10-14T18:45:52.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 -- 172.21.15.79:0/238194537 shutdown_connections 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 -- 172.21.15.79:0/238194537 >> 172.21.15.79:0/238194537 conn(0x7f94640ca4f0 msgr2=0x7f94640ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 -- 172.21.15.79:0/238194537 shutdown_connections 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.403+0000 7f946a6c2700 1 -- 172.21.15.79:0/238194537 wait complete. 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.404+0000 7f946a6c2700 1 Processor -- start 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 -- start start 2023-10-14T18:45:52.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f944c003fe0 0x7f94640c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9464140c00 0x7f9464141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c7070 con 0x7f946415cd60 2023-10-14T18:45:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946415d710 con 0x7f9464140c00 2023-10-14T18:45:52.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f946a6c2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94641415c0 con 0x7f944c003fe0 2023-10-14T18:45:52.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f94637fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f94637fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39640/0 (socket says 172.21.15.79:39640) 2023-10-14T18:45:52.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.405+0000 7f94637fe700 1 -- 172.21.15.79:0/2679108910 learned_addr learned my addr 172.21.15.79:0/2679108910 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:52.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f9463fff700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f944c003fe0 0x7f94640c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 -- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f944c003fe0 msgr2=0x7f94640c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f944c003fe0 0x7f94640c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 -- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9464140c00 msgr2=0x7f9464141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9464140c00 0x7f9464141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 -- 172.21.15.79:0/2679108910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946415d940 con 0x7f946415cd60 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f94637fe700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f944c004730 tx=0x7f945801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458022070 con 0x7f946415cd60 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800e950 con 0x7f946415cd60 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946415dc20 con 0x7f946415cd60 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945801c450 con 0x7f946415cd60 2023-10-14T18:45:52.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.406+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946415e1e0 con 0x7f946415cd60 2023-10-14T18:45:52.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.407+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946404c3c0 con 0x7f946415cd60 2023-10-14T18:45:52.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.407+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f945801c8a0 con 0x7f946415cd60 2023-10-14T18:45:52.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.408+0000 7f944bfff700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.408+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f94580859b0 con 0x7f946415cd60 2023-10-14T18:45:52.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.408+0000 7f9463fff700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.408+0000 7f9463fff700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 0x7f94500693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9454000e10 tx=0x7f9454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.412+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94580530a0 con 0x7f946415cd60 2023-10-14T18:45:52.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.667+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9464070bf0 con 0x7f946415cd60 2023-10-14T18:45:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.672+0000 7f944bfff700 1 -- 172.21.15.79:0/2679108910 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f945802b0a0 con 0x7f946415cd60 2023-10-14T18:45:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.674+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 msgr2=0x7f94500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 0x7f94500693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9454000e10 tx=0x7f9454009040 comp rx=0 tx=0).stop 2023-10-14T18:45:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 msgr2=0x7f946415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f944c004730 tx=0x7f945801a000 comp rx=0 tx=0).stop 2023-10-14T18:45:52.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 shutdown_connections 2023-10-14T18:45:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9450066f30 0x7f94500693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9464140c00 0x7f9464141080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f944c003fe0 0x7f94640c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 --2- 172.21.15.79:0/2679108910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f946415cd60 0x7f946415d1d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 >> 172.21.15.79:0/2679108910 conn(0x7f94640ca4f0 msgr2=0x7f94640cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 shutdown_connections 2023-10-14T18:45:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.675+0000 7f946a6c2700 1 -- 172.21.15.79:0/2679108910 wait complete. 2023-10-14T18:45:52.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T18:45:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.802+0000 7f5641bd8700 1 Processor -- start 2023-10-14T18:45:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.802+0000 7f5641bd8700 1 -- start start 2023-10-14T18:45:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f5641bd8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f563c15a170 0x7f563c068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f5641bd8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f563c069040 0x7f563c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f5641bd8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0694a0 con 0x7f563c159da0 2023-10-14T18:45:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f5641bd8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0b34b0 con 0x7f563c15a170 2023-10-14T18:45:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f5641bd8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c15ea70 con 0x7f563c069040 2023-10-14T18:45:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f563bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f563c15a170 0x7f563c068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f563bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f563c15a170 0x7f563c068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39644/0 (socket says 172.21.15.79:39644) 2023-10-14T18:45:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f563bfff700 1 -- 172.21.15.79:0/1604433064 learned_addr learned my addr 172.21.15.79:0/1604433064 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.803+0000 7f56413d7700 1 --2- 172.21.15.79:0/1604433064 >> v2:172.21.15.144:3300/0 conn(0x7f563c069040 0x7f563c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563bfff700 1 -- 172.21.15.79:0/1604433064 >> v2:172.21.15.144:3300/0 conn(0x7f563c069040 msgr2=0x7f563c0af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563bfff700 1 --2- 172.21.15.79:0/1604433064 >> v2:172.21.15.144:3300/0 conn(0x7f563c069040 0x7f563c0af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563bfff700 1 -- 172.21.15.79:0/1604433064 >> v1:172.21.15.144:6789/0 conn(0x7f563c159da0 legacy=0x7f563c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563bfff700 1 -- 172.21.15.79:0/1604433064 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0b3990 con 0x7f563c15a170 2023-10-14T18:45:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563bfff700 1 --2- 172.21.15.79:0/1604433064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c15a170 0x7f563c068b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f563c069740 tx=0x7f5630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1f54a79360e080 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563b7fe700 1 -- 172.21.15.79:0/1604433064 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630009e70 con 0x7f563c15a170 2023-10-14T18:45:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563b7fe700 1 -- 172.21.15.79:0/1604433064 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000b860 con 0x7f563c15a170 2023-10-14T18:45:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f563b7fe700 1 -- 172.21.15.79:0/1604433064 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000bc20 con 0x7f563c15a170 2023-10-14T18:45:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 -- 172.21.15.79:0/1604433064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c15a170 msgr2=0x7f563c068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 --2- 172.21.15.79:0/1604433064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c15a170 0x7f563c068b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f563c069740 tx=0x7f5630009250 comp rx=0 tx=0).stop 2023-10-14T18:45:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 -- 172.21.15.79:0/1604433064 shutdown_connections 2023-10-14T18:45:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 --2- 172.21.15.79:0/1604433064 >> v2:172.21.15.144:3300/0 conn(0x7f563c069040 0x7f563c0af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 --2- 172.21.15.79:0/1604433064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c15a170 0x7f563c068b00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 -- 172.21.15.79:0/1604433064 >> 172.21.15.79:0/1604433064 conn(0x7f563c0d0bc0 msgr2=0x7f563c0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 -- 172.21.15.79:0/1604433064 shutdown_connections 2023-10-14T18:45:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.804+0000 7f5641bd8700 1 -- 172.21.15.79:0/1604433064 wait complete. 2023-10-14T18:45:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.805+0000 7f5641bd8700 1 Processor -- start 2023-10-14T18:45:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 -- start start 2023-10-14T18:45:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 0x7f563c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563c15a170 0x7f563c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c8dc0 con 0x7f563c159da0 2023-10-14T18:45:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c81b0 con 0x7f563c069040 2023-10-14T18:45:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f5641bd8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c0c8490 con 0x7f563c15a170 2023-10-14T18:45:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.806+0000 7f563bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39646/0 (socket says 172.21.15.79:39646) 2023-10-14T18:45:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 -- 172.21.15.79:0/3764267664 learned_addr learned my addr 172.21.15.79:0/3764267664 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5640bd6700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 0x7f563c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f56413d7700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563c15a170 0x7f563c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 -- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563c15a170 msgr2=0x7f563c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563c15a170 0x7f563c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 -- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 msgr2=0x7f563c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 0x7f563c0c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 -- 172.21.15.79:0/3764267664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300094f0 con 0x7f563c159da0 2023-10-14T18:45:52.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5640bd6700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 0x7f563c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f563bfff700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f563c06b5c0 tx=0x7f5630017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563001f070 con 0x7f563c159da0 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630000bc0 con 0x7f563c159da0 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000bc20 con 0x7f563c159da0 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0c8770 con 0x7f563c159da0 2023-10-14T18:45:52.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.807+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c15ce30 con 0x7f563c159da0 2023-10-14T18:45:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.808+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c0c79a0 con 0x7f563c159da0 2023-10-14T18:45:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.808+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5630023070 con 0x7f563c159da0 2023-10-14T18:45:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.809+0000 7f5638ff9700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 0x7f56280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.809+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f56300854b0 con 0x7f563c159da0 2023-10-14T18:45:52.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.809+0000 7f5640bd6700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 0x7f56280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.809+0000 7f5640bd6700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 0x7f56280693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:52.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:52.813+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5630052ab0 con 0x7f563c159da0 2023-10-14T18:45:53.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.069+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f563c0b6030 con 0x7f563c159da0 2023-10-14T18:45:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.075+0000 7f5638ff9700 1 -- 172.21.15.79:0/3764267664 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5630009300 con 0x7f563c159da0 2023-10-14T18:45:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 msgr2=0x7f56280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 0x7f56280693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f562c007fd0 tx=0x7f562c009040 comp rx=0 tx=0).stop 2023-10-14T18:45:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 msgr2=0x7f563c15c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f563c06b5c0 tx=0x7f5630017000 comp rx=0 tx=0).stop 2023-10-14T18:45:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 shutdown_connections 2023-10-14T18:45:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5628066f30 0x7f56280693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f563c15a170 0x7f563c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563c069040 0x7f563c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 --2- 172.21.15.79:0/3764267664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f563c159da0 0x7f563c15c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 >> 172.21.15.79:0/3764267664 conn(0x7f563c0d0bc0 msgr2=0x7f563c0cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 shutdown_connections 2023-10-14T18:45:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.077+0000 7f5641bd8700 1 -- 172.21.15.79:0/3764267664 wait complete. 2023-10-14T18:45:53.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T18:45:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.203+0000 7fabd6547700 1 Processor -- start 2023-10-14T18:45:53.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.203+0000 7fabd6547700 1 -- start start 2023-10-14T18:45:53.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd6547700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fabd0159da0 0x7fabd00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd6547700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabd015a170 0x7fabd0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd6547700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00694a0 con 0x7fabd0069040 2023-10-14T18:45:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd6547700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd015ea70 con 0x7fabd015a170 2023-10-14T18:45:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd6547700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00b3990 con 0x7fabd0159da0 2023-10-14T18:45:53.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabd015a170 0x7fabd0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabd015a170 0x7fabd0068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39656/0 (socket says 172.21.15.79:39656) 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 -- 172.21.15.79:0/754892240 learned_addr learned my addr 172.21.15.79:0/754892240 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 -- 172.21.15.79:0/754892240 >> v2:172.21.15.144:3300/0 conn(0x7fabd0159da0 msgr2=0x7fabd00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 --2- 172.21.15.79:0/754892240 >> v2:172.21.15.144:3300/0 conn(0x7fabd0159da0 0x7fabd00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 -- 172.21.15.79:0/754892240 >> v1:172.21.15.144:6789/0 conn(0x7fabd0069040 legacy=0x7fabd00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.204+0000 7fabd4d44700 1 -- 172.21.15.79:0/754892240 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00b0b70 con 0x7fabd015a170 2023-10-14T18:45:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd4d44700 1 --2- 172.21.15.79:0/754892240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd0068b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabd006b290 tx=0x7fabc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ec89959ec8971d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabc7fff700 1 -- 172.21.15.79:0/754892240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000b820 con 0x7fabd015a170 2023-10-14T18:45:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabc7fff700 1 -- 172.21.15.79:0/754892240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc000b980 con 0x7fabd015a170 2023-10-14T18:45:53.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabc7fff700 1 -- 172.21.15.79:0/754892240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000bd40 con 0x7fabd015a170 2023-10-14T18:45:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 -- 172.21.15.79:0/754892240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 msgr2=0x7fabd0068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 --2- 172.21.15.79:0/754892240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd0068b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fabd006b290 tx=0x7fabc0009250 comp rx=0 tx=0).stop 2023-10-14T18:45:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 -- 172.21.15.79:0/754892240 shutdown_connections 2023-10-14T18:45:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 --2- 172.21.15.79:0/754892240 >> v2:172.21.15.144:3300/0 conn(0x7fabd0159da0 0x7fabd00b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 --2- 172.21.15.79:0/754892240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd0068b00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 -- 172.21.15.79:0/754892240 >> 172.21.15.79:0/754892240 conn(0x7fabd00d0bc0 msgr2=0x7fabd00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 -- 172.21.15.79:0/754892240 shutdown_connections 2023-10-14T18:45:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.205+0000 7fabd6547700 1 -- 172.21.15.79:0/754892240 wait complete. 2023-10-14T18:45:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.206+0000 7fabd6547700 1 Processor -- start 2023-10-14T18:45:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.206+0000 7fabd6547700 1 -- start start 2023-10-14T18:45:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabd0069040 0x7fabd0157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fabd0159da0 0x7fabd00c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c46c0 con 0x7fabd015a170 2023-10-14T18:45:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c49a0 con 0x7fabd0069040 2023-10-14T18:45:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd6547700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c4c80 con 0x7fabd0159da0 2023-10-14T18:45:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd5d46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd5d46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39660/0 (socket says 172.21.15.79:39660) 2023-10-14T18:45:53.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.207+0000 7fabd5d46700 1 -- 172.21.15.79:0/4211031582 learned_addr learned my addr 172.21.15.79:0/4211031582 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd4d44700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fabd0159da0 0x7fabd00c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5545700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabd0069040 0x7fabd0157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 -- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fabd0159da0 msgr2=0x7fabd00c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fabd0159da0 0x7fabd00c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 -- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabd0069040 msgr2=0x7fabd0157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabd0069040 0x7fabd0157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 -- 172.21.15.79:0/4211031582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00094f0 con 0x7fabd015a170 2023-10-14T18:45:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd5d46700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabc800b5e0 tx=0x7fabc8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800f510 con 0x7fabd015a170 2023-10-14T18:45:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800f690 con 0x7fabd015a170 2023-10-14T18:45:53.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd00c4f60 con 0x7fabd015a170 2023-10-14T18:45:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800fa50 con 0x7fabd015a170 2023-10-14T18:45:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.208+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd00ce0a0 con 0x7fabd015a170 2023-10-14T18:45:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.209+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd0089480 con 0x7fabd015a170 2023-10-14T18:45:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.209+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fabc801a400 con 0x7fabd015a170 2023-10-14T18:45:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.210+0000 7fabc57fa700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 0x7fabb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.210+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fabc8083c60 con 0x7fabd015a170 2023-10-14T18:45:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.210+0000 7fabd5545700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 0x7fabb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.210+0000 7fabd5545700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 0x7fabb40693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fabcc007f30 tx=0x7fabcc007420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.214+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fabc80512a0 con 0x7fabd015a170 2023-10-14T18:45:53.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.469+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fabd015def0 con 0x7fabd015a170 2023-10-14T18:45:53.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.473+0000 7fabc57fa700 1 -- 172.21.15.79:0/4211031582 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fabc80548c0 con 0x7fabd015a170 2023-10-14T18:45:53.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 msgr2=0x7fabb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 0x7fabb40693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fabcc007f30 tx=0x7fabcc007420 comp rx=0 tx=0).stop 2023-10-14T18:45:53.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 msgr2=0x7fabd00c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fabc800b5e0 tx=0x7fabc8009120 comp rx=0 tx=0).stop 2023-10-14T18:45:53.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 shutdown_connections 2023-10-14T18:45:53.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabb4066f30 0x7fabb40693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabd015a170 0x7fabd00c9d20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabd0069040 0x7fabd0157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 --2- 172.21.15.79:0/4211031582 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fabd0159da0 0x7fabd00c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 >> 172.21.15.79:0/4211031582 conn(0x7fabd00d0bc0 msgr2=0x7fabd0158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 shutdown_connections 2023-10-14T18:45:53.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.475+0000 7fabd6547700 1 -- 172.21.15.79:0/4211031582 wait complete. 2023-10-14T18:45:53.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:53.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.601+0000 7fc5fa29c700 1 Processor -- start 2023-10-14T18:45:53.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.601+0000 7fc5fa29c700 1 -- start start 2023-10-14T18:45:53.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5fa29c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f406f1c0 0x7fc5f4161e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5fa29c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5f4164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5fa29c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f40b26d0 con 0x7fc5f40a79f0 2023-10-14T18:45:53.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5fa29c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40aeab0 con 0x7fc5f406f1c0 2023-10-14T18:45:53.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5fa29c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b2b60 con 0x7fc5f40b15e0 2023-10-14T18:45:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5f3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc5f40a79f0 0x7fc5f406eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58984/0 (socket says 172.21.15.79:58984) 2023-10-14T18:45:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.602+0000 7fc5f3fff700 1 -- 172.21.15.79:0/2974658429 learned_addr learned my addr 172.21.15.79:0/2974658429 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453259839 0 0) 0x7fc5f40b26d0 con 0x7fc5f40a79f0 2023-10-14T18:45:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/2974658429 >> v2:172.21.15.144:3300/0 conn(0x7fc5f406f1c0 0x7fc5f4161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5dc003570 con 0x7fc5f40a79f0 2023-10-14T18:45:53.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5f4164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431434229 0 0) 0x7fc5dc003570 con 0x7fc5f40a79f0 2023-10-14T18:45:53.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 msgr2=0x7fc5f4164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5f4164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 >> v2:172.21.15.144:3300/0 conn(0x7fc5f406f1c0 msgr2=0x7fc5f4161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 --2- 172.21.15.79:0/2974658429 >> v2:172.21.15.144:3300/0 conn(0x7fc5f406f1c0 0x7fc5f4161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40b1ac0 con 0x7fc5f40a79f0 2023-10-14T18:45:53.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc5e4001470 con 0x7fc5f40a79f0 2023-10-14T18:45:53.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 >> v1:172.21.15.79:6789/0 conn(0x7fc5f40a79f0 legacy=0x7fc5f406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5dc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5dc003fe0 0x7fc5dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc004d50 0x7fc5dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40aeab0 con 0x7fc5dc004d50 2023-10-14T18:45:53.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b2b60 con 0x7fc5dc003fe0 2023-10-14T18:45:53.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc00bb40 con 0x7fc5f40b15e0 2023-10-14T18:45:53.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/2974658429 >> v2:172.21.15.144:3300/0 conn(0x7fc5f406f1c0 0x7fc5f4161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:53.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc004d50 0x7fc5dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f3fff700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5dc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5dc003fe0 0x7fc5dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 -- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 msgr2=0x7fc5dc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f40b15e0 0x7fc5dc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 -- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5dc003fe0 msgr2=0x7fc5dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5dc003fe0 0x7fc5dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f8839700 1 -- 172.21.15.79:0/2974658429 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc003570 con 0x7fc5dc004d50 2023-10-14T18:45:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.603+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5dc003fe0 0x7fc5dc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5f8839700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc004d50 0x7fc5dc0051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0094d0 tx=0x7fc5ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c1e2e9d72c8f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00ea00 con 0x7fc5dc004d50 2023-10-14T18:45:53.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec00f040 con 0x7fc5dc004d50 2023-10-14T18:45:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5f2ffd700 1 -- 172.21.15.79:0/2974658429 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00ed90 con 0x7fc5dc004d50 2023-10-14T18:45:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 -- 172.21.15.79:0/2974658429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc004d50 msgr2=0x7fc5dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/2974658429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5dc004d50 0x7fc5dc0051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0094d0 tx=0x7fc5ec00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5f8839700 1 -- 172.21.15.79:0/2974658429 reap_dead start 2023-10-14T18:45:53.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 -- 172.21.15.79:0/2974658429 shutdown_connections 2023-10-14T18:45:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 -- 172.21.15.79:0/2974658429 >> 172.21.15.79:0/2974658429 conn(0x7fc5f40cd1e0 msgr2=0x7fc5f40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 -- 172.21.15.79:0/2974658429 shutdown_connections 2023-10-14T18:45:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.604+0000 7fc5fa29c700 1 -- 172.21.15.79:0/2974658429 wait complete. 2023-10-14T18:45:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.605+0000 7fc5fa29c700 1 Processor -- start 2023-10-14T18:45:53.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 -- start start 2023-10-14T18:45:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 0x7fc5f40c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f409acf0 0x7fc5f415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f409a860 con 0x7fc5f4146a70 2023-10-14T18:45:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4099c50 con 0x7fc5f409acf0 2023-10-14T18:45:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5fa29c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4099f30 con 0x7fc5f4146e40 2023-10-14T18:45:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39682/0 (socket says 172.21.15.79:39682) 2023-10-14T18:45:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.606+0000 7fc5f3fff700 1 -- 172.21.15.79:0/3001968271 learned_addr learned my addr 172.21.15.79:0/3001968271 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 0x7fc5f40c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f8839700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f409acf0 0x7fc5f415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 -- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 msgr2=0x7fc5f40c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 0x7fc5f40c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 -- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f409acf0 msgr2=0x7fc5f415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f409acf0 0x7fc5f415cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 -- 172.21.15.79:0/3001968271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f409a210 con 0x7fc5f4146a70 2023-10-14T18:45:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 0x7fc5f40c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5f3fff700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40079e0 tx=0x7fc5e4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4018030 con 0x7fc5f4146a70 2023-10-14T18:45:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e400f8a0 con 0x7fc5f4146a70 2023-10-14T18:45:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f409a4f0 con 0x7fc5f4146a70 2023-10-14T18:45:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e400fc40 con 0x7fc5f4146a70 2023-10-14T18:45:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.607+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f415d2d0 con 0x7fc5f4146a70 2023-10-14T18:45:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.608+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f409ab40 con 0x7fc5f4146a70 2023-10-14T18:45:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.608+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5e401b070 con 0x7fc5f4146a70 2023-10-14T18:45:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.609+0000 7fc5dbfff700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 0x7fc5e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.609+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc5e4019070 con 0x7fc5f4146a70 2023-10-14T18:45:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.609+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 0x7fc5e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.609+0000 7fc5f37fe700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 0x7fc5e00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006f00 tx=0x7fc5e800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.613+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5e4051800 con 0x7fc5f4146a70 2023-10-14T18:45:53.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.796+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5f404c3c0 con 0x7fc5f4146a70 2023-10-14T18:45:53.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.796+0000 7fc5dbfff700 1 -- 172.21.15.79:0/3001968271 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fc5e4054e20 con 0x7fc5f4146a70 2023-10-14T18:45:53.797 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:53.798 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:50.650658+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:53.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.798+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 msgr2=0x7fc5e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.798+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 0x7fc5e00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8006f00 tx=0x7fc5e800b040 comp rx=0 tx=0).stop 2023-10-14T18:45:53.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.798+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 msgr2=0x7fc5f40c2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.798+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40079e0 tx=0x7fc5e4001e90 comp rx=0 tx=0).stop 2023-10-14T18:45:53.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 shutdown_connections 2023-10-14T18:45:53.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e0066f30 0x7fc5e00693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f409acf0 0x7fc5f415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f4146a70 0x7fc5f40c2990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 --2- 172.21.15.79:0/3001968271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f4146e40 0x7fc5f40c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 >> 172.21.15.79:0/3001968271 conn(0x7fc5f40cd1e0 msgr2=0x7fc5f40aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 shutdown_connections 2023-10-14T18:45:53.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.799+0000 7fc5fa29c700 1 -- 172.21.15.79:0/3001968271 wait complete. 2023-10-14T18:45:53.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:45:53.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:45:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.927+0000 7f4950fb5700 1 Processor -- start 2023-10-14T18:45:53.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.927+0000 7f4950fb5700 1 -- start start 2023-10-14T18:45:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f4950fb5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 0x7f494c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f4950fb5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0b0790 con 0x7f494c159ec0 2023-10-14T18:45:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f4950fb5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0ce1f0 con 0x7f494c06aae0 2023-10-14T18:45:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f4950fb5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c06af60 con 0x7f494c15a290 2023-10-14T18:45:53.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f494a59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f494c159ec0 0x7f494c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58994/0 (socket says 172.21.15.79:58994) 2023-10-14T18:45:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f494a59c700 1 -- 172.21.15.79:0/2215590880 learned_addr learned my addr 172.21.15.79:0/2215590880 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f4949d9b700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 0x7f494c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195107724 0 0) 0x7f494c0b0790 con 0x7f494c159ec0 2023-10-14T18:45:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.928+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4934003570 con 0x7f494c159ec0 2023-10-14T18:45:53.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1134663591 0 0) 0x7f4934003570 con 0x7f494c159ec0 2023-10-14T18:45:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 msgr2=0x7f494c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 0x7f494c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 >> v1:172.21.15.144:6789/0 conn(0x7f494c06aae0 legacy=0x7f494c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0b0b20 con 0x7f494c159ec0 2023-10-14T18:45:53.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f493c0017f0 con 0x7f494c159ec0 2023-10-14T18:45:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 >> v1:172.21.15.79:6789/0 conn(0x7f494c159ec0 legacy=0x7f494c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4934003a90 0x7f4934003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f4934004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 0x7f49340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c06af60 con 0x7f4934004810 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493400bb10 con 0x7f4934003a90 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493400bcd0 con 0x7f494c15a290 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f4934004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494a59c700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4934003a90 0x7f4934003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 -- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 msgr2=0x7f49340051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T18:45:53.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c15a290 0x7f49340051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 -- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4934003a90 msgr2=0x7f4934003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4934003a90 0x7f4934003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 -- 172.21.15.79:0/2215590880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934003570 con 0x7f4934004810 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494a59c700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4934003a90 0x7f4934003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f4949d9b700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f4934004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4940009c00 tx=0x7f49400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d32a3dfbabc14a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000e710 con 0x7f4934004810 2023-10-14T18:45:53.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000e870 con 0x7f4934004810 2023-10-14T18:45:53.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.929+0000 7f494959a700 1 -- 172.21.15.79:0/2215590880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000ec30 con 0x7f4934004810 2023-10-14T18:45:53.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 -- 172.21.15.79:0/2215590880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 msgr2=0x7f4934004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 --2- 172.21.15.79:0/2215590880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f4934004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4940009c00 tx=0x7f49400091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f494ad9d700 1 -- 172.21.15.79:0/2215590880 reap_dead start 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 -- 172.21.15.79:0/2215590880 shutdown_connections 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 -- 172.21.15.79:0/2215590880 >> 172.21.15.79:0/2215590880 conn(0x7f494c0d1880 msgr2=0x7f494c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 -- 172.21.15.79:0/2215590880 shutdown_connections 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.930+0000 7f4950fb5700 1 -- 172.21.15.79:0/2215590880 wait complete. 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.931+0000 7f4950fb5700 1 Processor -- start 2023-10-14T18:45:53.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.931+0000 7f4950fb5700 1 -- start start 2023-10-14T18:45:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c0c9670 0x7f494c0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f494c0caf70 0x7f494c148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0caae0 con 0x7f4934004810 2023-10-14T18:45:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c9ed0 con 0x7f494c0caf70 2023-10-14T18:45:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4950fb5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0ca1b0 con 0x7f494c0c9670 2023-10-14T18:45:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39696/0 (socket says 172.21.15.79:39696) 2023-10-14T18:45:53.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 -- 172.21.15.79:0/3104273403 learned_addr learned my addr 172.21.15.79:0/3104273403 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f4949d9b700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c0c9670 0x7f494c0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 -- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c0c9670 msgr2=0x7f494c0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c0c9670 0x7f494c0afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 -- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f494c0caf70 msgr2=0x7f494c148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f494c0caf70 0x7f494c148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:53.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 -- 172.21.15.79:0/3104273403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0ca490 con 0x7f4934004810 2023-10-14T18:45:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f494a59c700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f493c002250 tx=0x7f493c001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.932+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00eda0 con 0x7f4934004810 2023-10-14T18:45:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.933+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c013420 con 0x7f4934004810 2023-10-14T18:45:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.933+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c0137c0 con 0x7f4934004810 2023-10-14T18:45:53.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.933+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0ca770 con 0x7f4934004810 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.933+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0c9ae0 con 0x7f4934004810 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.933+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c0cadc0 con 0x7f4934004810 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.934+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f493c013bb0 con 0x7f4934004810 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.934+0000 7f493a7fc700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.935+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f493c084b20 con 0x7f4934004810 2023-10-14T18:45:53.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.935+0000 7f4949d9b700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:53.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.935+0000 7f4949d9b700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49400091e0 tx=0x7f494001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:53.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:53.939+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f493c0520e0 con 0x7f4934004810 2023-10-14T18:45:54.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.118+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f494c04c3c0 con 0x7f4934004810 2023-10-14T18:45:54.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.118+0000 7f493a7fc700 1 -- 172.21.15.79:0/3104273403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f493c055700 con 0x7f4934004810 2023-10-14T18:45:54.120 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:45:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 msgr2=0x7f492c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 0x7f492c0693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49400091e0 tx=0x7f494001a000 comp rx=0 tx=0).stop 2023-10-14T18:45:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 msgr2=0x7f494c0a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f493c002250 tx=0x7f493c001870 comp rx=0 tx=0).stop 2023-10-14T18:45:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 shutdown_connections 2023-10-14T18:45:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f492c066f30 0x7f492c0693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f494c0caf70 0x7f494c148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4934004810 0x7f494c0a7bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 --2- 172.21.15.79:0/3104273403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f494c0c9670 0x7f494c0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 >> 172.21.15.79:0/3104273403 conn(0x7f494c0d1880 msgr2=0x7f494c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 shutdown_connections 2023-10-14T18:45:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.120+0000 7f4950fb5700 1 -- 172.21.15.79:0/3104273403 wait complete. 2023-10-14T18:45:54.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:45:54.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.248+0000 7f7d91b32700 1 Processor -- start 2023-10-14T18:45:54.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.248+0000 7f7d91b32700 1 -- start start 2023-10-14T18:45:54.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.248+0000 7f7d91b32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d8c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d91b32700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7d8c157c40 0x7f7d8c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d91b32700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c15cbb0 con 0x7f7d8c15a620 2023-10-14T18:45:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d91b32700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c15bfa0 con 0x7f7d8c157c40 2023-10-14T18:45:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d91b32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c15c280 con 0x7f7d8c157870 2023-10-14T18:45:54.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7d8c15a620 0x7f7d8c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59010/0 (socket says 172.21.15.79:59010) 2023-10-14T18:45:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8affd700 1 -- 172.21.15.79:0/2383741793 learned_addr learned my addr 172.21.15.79:0/2383741793 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047437975 0 0) 0x7f7d8c15cbb0 con 0x7f7d8c15a620 2023-10-14T18:45:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d8c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d78003570 con 0x7f7d8c15a620 2023-10-14T18:45:54.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8bfff700 1 --2- 172.21.15.79:0/2383741793 >> v2:172.21.15.144:3300/0 conn(0x7f7d8c157c40 0x7f7d8c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2781012082 0 0) 0x7f7d78003570 con 0x7f7d8c15a620 2023-10-14T18:45:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 msgr2=0x7f7d8c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d8c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 >> v2:172.21.15.144:3300/0 conn(0x7f7d8c157c40 msgr2=0x7f7d8c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 --2- 172.21.15.79:0/2383741793 >> v2:172.21.15.144:3300/0 conn(0x7f7d8c157c40 0x7f7d8c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c15c560 con 0x7f7d8c15a620 2023-10-14T18:45:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d8c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8bfff700 1 --2- 172.21.15.79:0/2383741793 >> v2:172.21.15.144:3300/0 conn(0x7f7d8c157c40 0x7f7d8c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7d74001470 con 0x7f7d8c15a620 2023-10-14T18:45:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 >> v1:172.21.15.79:6789/0 conn(0x7f7d8c15a620 legacy=0x7f7d8c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d78004d50 0x7f7d780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c15bfa0 con 0x7f7d78003a60 2023-10-14T18:45:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c15c280 con 0x7f7d78004d50 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7800bb60 con 0x7f7d8c157870 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.249+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8affd700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8bfff700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d78004d50 0x7f7d780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 msgr2=0x7f7d78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:54.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c157870 0x7f7d78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d78004d50 msgr2=0x7f7d780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d78004d50 0x7f7d780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/2383741793 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78003570 con 0x7f7d78003a60 2023-10-14T18:45:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d78003e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d84007580 tx=0x7f7d840097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854f1079fe4b858d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84009ae0 con 0x7f7d78003a60 2023-10-14T18:45:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84007dd0 con 0x7f7d78003a60 2023-10-14T18:45:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.250+0000 7f7d8a7fc700 1 -- 172.21.15.79:0/2383741793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84014630 con 0x7f7d78003a60 2023-10-14T18:45:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 -- 172.21.15.79:0/2383741793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 msgr2=0x7f7d78003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 --2- 172.21.15.79:0/2383741793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d78003e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d84007580 tx=0x7f7d840097d0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d8bfff700 1 -- 172.21.15.79:0/2383741793 reap_dead start 2023-10-14T18:45:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 -- 172.21.15.79:0/2383741793 shutdown_connections 2023-10-14T18:45:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 -- 172.21.15.79:0/2383741793 >> 172.21.15.79:0/2383741793 conn(0x7f7d8c068ce0 msgr2=0x7f7d8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 -- 172.21.15.79:0/2383741793 shutdown_connections 2023-10-14T18:45:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.251+0000 7f7d91b32700 1 -- 172.21.15.79:0/2383741793 wait complete. 2023-10-14T18:45:54.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.252+0000 7f7d91b32700 1 Processor -- start 2023-10-14T18:45:54.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.252+0000 7f7d91b32700 1 -- start start 2023-10-14T18:45:54.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.252+0000 7f7d91b32700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 0x7f7d8c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 0x7f7d8c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c154400 con 0x7f7d78003a60 2023-10-14T18:45:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14f810 con 0x7f7d8c14d150 2023-10-14T18:45:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14faf0 con 0x7f7d8c14f380 2023-10-14T18:45:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39712/0 (socket says 172.21.15.79:39712) 2023-10-14T18:45:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/215707839 learned_addr learned my addr 172.21.15.79:0/215707839 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:54.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8affd700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 0x7f7d8c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8bfff700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 0x7f7d8c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 msgr2=0x7f7d8c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 0x7f7d8c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 msgr2=0x7f7d8c151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 0x7f7d8c151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 -- 172.21.15.79:0/215707839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c14fdd0 con 0x7f7d78003a60 2023-10-14T18:45:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8bfff700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 0x7f7d8c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:54.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8affd700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 0x7f7d8c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:54.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d8b7fe700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d78004760 tx=0x7f7d84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8401e620 con 0x7f7d78003a60 2023-10-14T18:45:54.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8401e7a0 con 0x7f7d78003a60 2023-10-14T18:45:54.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8401ebe0 con 0x7f7d78003a60 2023-10-14T18:45:54.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c1500b0 con 0x7f7d78003a60 2023-10-14T18:45:54.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.253+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c14d5b0 con 0x7f7d78003a60 2023-10-14T18:45:54.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.254+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c150550 con 0x7f7d78003a60 2023-10-14T18:45:54.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.254+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d84003050 con 0x7f7d78003a60 2023-10-14T18:45:54.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.255+0000 7f7d837fe700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.255+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7d84086360 con 0x7f7d78003a60 2023-10-14T18:45:54.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.255+0000 7f7d8affd700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.256+0000 7f7d8affd700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 0x7f7d6c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d74001d20 tx=0x7f7d74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.259+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d84053920 con 0x7f7d78003a60 2023-10-14T18:45:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.446+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7d8c04c3c0 con 0x7f7d78003a60 2023-10-14T18:45:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.446+0000 7f7d837fe700 1 -- 172.21.15.79:0/215707839 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7d84056f40 con 0x7f7d78003a60 2023-10-14T18:45:54.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:54.447 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:45:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:45:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:45:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:45:54.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:45:54.449 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:45:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 msgr2=0x7f7d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 0x7f7d6c0693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d74001d20 tx=0x7f7d74009040 comp rx=0 tx=0).stop 2023-10-14T18:45:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 msgr2=0x7f7d8c1508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7d78004760 tx=0x7f7d84018000 comp rx=0 tx=0).stop 2023-10-14T18:45:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 shutdown_connections 2023-10-14T18:45:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7d6c066f30 0x7f7d6c0693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d8c14d150 0x7f7d8c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d78003a60 0x7f7d8c1508b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 --2- 172.21.15.79:0/215707839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7d8c14f380 0x7f7d8c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 >> 172.21.15.79:0/215707839 conn(0x7f7d8c068ce0 msgr2=0x7f7d8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 shutdown_connections 2023-10-14T18:45:54.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.448+0000 7f7d91b32700 1 -- 172.21.15.79:0/215707839 wait complete. 2023-10-14T18:45:54.460 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:45:54.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:45:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.578+0000 7f693b59e700 1 Processor -- start 2023-10-14T18:45:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.578+0000 7f693b59e700 1 -- start start 2023-10-14T18:45:54.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 0x7f693c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693b59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f693c0ce810 0x7f693c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693b59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0cd4c0 con 0x7f693c0cc940 2023-10-14T18:45:54.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693b59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0b3f40 con 0x7f693c0ce810 2023-10-14T18:45:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0cbb80 con 0x7f693c15d240 2023-10-14T18:45:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f693c0ce810 0x7f693c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693a59c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 0x7f693c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f693c0ce810 0x7f693c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39728/0 (socket says 172.21.15.79:39728) 2023-10-14T18:45:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f6939d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f693c0cc940 0x7f693c0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:57496/0 (socket says 172.21.15.79:57496) 2023-10-14T18:45:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.579+0000 7f693ad9d700 1 -- 172.21.15.79:0/1430498681 learned_addr learned my addr 172.21.15.79:0/1430498681 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:54.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693ad9d700 1 -- 172.21.15.79:0/1430498681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 msgr2=0x7f693c0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:54.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693ad9d700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 0x7f693c0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693ad9d700 1 -- 172.21.15.79:0/1430498681 >> v1:172.21.15.144:6789/0 conn(0x7f693c0cc940 legacy=0x7f693c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693959a700 1 -- 172.21.15.79:0/1430498681 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672001256 0 0) 0x7f693c0cd4c0 con 0x7f693c0cc940 2023-10-14T18:45:54.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693ad9d700 1 -- 172.21.15.79:0/1430498681 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0cbe60 con 0x7f693c0ce810 2023-10-14T18:45:54.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693a59c700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 0x7f693c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:54.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693ad9d700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0ce810 0x7f693c0cec90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69340099b0 tx=0x7f6934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dee94a41d1f0cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693959a700 1 -- 172.21.15.79:0/1430498681 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934009ea0 con 0x7f693c0ce810 2023-10-14T18:45:54.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693959a700 1 -- 172.21.15.79:0/1430498681 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693400b860 con 0x7f693c0ce810 2023-10-14T18:45:54.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693959a700 1 -- 172.21.15.79:0/1430498681 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693400bc00 con 0x7f693c0ce810 2023-10-14T18:45:54.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 -- 172.21.15.79:0/1430498681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0ce810 msgr2=0x7f693c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0ce810 0x7f693c0cec90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f69340099b0 tx=0x7f6934009250 comp rx=0 tx=0).stop 2023-10-14T18:45:54.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 -- 172.21.15.79:0/1430498681 shutdown_connections 2023-10-14T18:45:54.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0ce810 0x7f693c0cec90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 --2- 172.21.15.79:0/1430498681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c15d240 0x7f693c0b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 -- 172.21.15.79:0/1430498681 >> 172.21.15.79:0/1430498681 conn(0x7f693c067e40 msgr2=0x7f693c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:54.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 -- 172.21.15.79:0/1430498681 shutdown_connections 2023-10-14T18:45:54.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.580+0000 7f693b59e700 1 -- 172.21.15.79:0/1430498681 wait complete. 2023-10-14T18:45:54.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.581+0000 7f693b59e700 1 Processor -- start 2023-10-14T18:45:54.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 -- start start 2023-10-14T18:45:54.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c0ce810 0x7f693c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c15d240 0x7f693c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0c8020 con 0x7f693c0cc940 2023-10-14T18:45:54.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c159c50 con 0x7f693c15d240 2023-10-14T18:45:54.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c15a7d0 con 0x7f693c0ce810 2023-10-14T18:45:54.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39734/0 (socket says 172.21.15.79:39734) 2023-10-14T18:45:54.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.582+0000 7f693a59c700 1 -- 172.21.15.79:0/2529951659 learned_addr learned my addr 172.21.15.79:0/2529951659 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:54.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f6939d9b700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c0ce810 0x7f693c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693ad9d700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c15d240 0x7f693c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 -- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c0ce810 msgr2=0x7f693c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c0ce810 0x7f693c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 -- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c15d240 msgr2=0x7f693c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:54.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c15d240 0x7f693c0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 -- 172.21.15.79:0/2529951659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c009a20 con 0x7f693c0cc940 2023-10-14T18:45:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693a59c700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c220 tx=0x7f692c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c00ce60 con 0x7f693c0cc940 2023-10-14T18:45:54.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00f040 con 0x7f693c0cc940 2023-10-14T18:45:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69340094f0 con 0x7f693c0cc940 2023-10-14T18:45:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c014690 con 0x7f693c0cc940 2023-10-14T18:45:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.583+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c15a180 con 0x7f693c0cc940 2023-10-14T18:45:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.584+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c15aab0 con 0x7f693c0cc940 2023-10-14T18:45:54.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.584+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f692c014a00 con 0x7f693c0cc940 2023-10-14T18:45:54.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.585+0000 7f69327fc700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 0x7f691c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:54.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.585+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f692c085210 con 0x7f693c0cc940 2023-10-14T18:45:54.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.585+0000 7f6939d9b700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 0x7f691c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:54.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.585+0000 7f6939d9b700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 0x7f691c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6924007fd0 tx=0x7f6924007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:54.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.589+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f692c056260 con 0x7f693c0cc940 2023-10-14T18:45:54.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:54.773+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f693c06ac60 con 0x7f693c0cc940 2023-10-14T18:45:55.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.661+0000 7f69327fc700 1 -- 172.21.15.79:0/2529951659 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f692c014cb0 con 0x7f693c0cc940 2023-10-14T18:45:55.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 msgr2=0x7f691c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:55.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 0x7f691c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6924007fd0 tx=0x7f6924007e10 comp rx=0 tx=0).stop 2023-10-14T18:45:55.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 msgr2=0x7f693c1432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:55.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f692c00c220 tx=0x7f692c00b040 comp rx=0 tx=0).stop 2023-10-14T18:45:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 shutdown_connections 2023-10-14T18:45:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f691c066f30 0x7f691c0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c15d240 0x7f693c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f693c0cc940 0x7f693c1432c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 --2- 172.21.15.79:0/2529951659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f693c0ce810 0x7f693c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.665+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 >> 172.21.15.79:0/2529951659 conn(0x7f693c067e40 msgr2=0x7f693c0691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.666+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 shutdown_connections 2023-10-14T18:45:55.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.666+0000 7f693b59e700 1 -- 172.21.15.79:0/2529951659 wait complete. 2023-10-14T18:45:55.670 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:45:55.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:45:55.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.805+0000 7f3523273700 1 Processor -- start 2023-10-14T18:45:55.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.805+0000 7f3523273700 1 -- start start 2023-10-14T18:45:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f351c1542a0 0x7f351c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f351c0cd630 0x7f351c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c06a830 0x7f351c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c15b2e0 con 0x7f351c1542a0 2023-10-14T18:45:55.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c06b0a0 con 0x7f351c0cd630 2023-10-14T18:45:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3523273700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c06ac30 con 0x7f351c06a830 2023-10-14T18:45:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f351c1542a0 0x7f351c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f351c1542a0 0x7f351c0b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39742/0 (socket says 172.21.15.79:39742) 2023-10-14T18:45:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 -- 172.21.15.79:0/3864738375 learned_addr learned my addr 172.21.15.79:0/3864738375 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3521a70700 1 --2- 172.21.15.79:0/3864738375 >> v2:172.21.15.144:3300/0 conn(0x7f351c0cd630 0x7f351c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522a72700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c06a830 0x7f351c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 -- 172.21.15.79:0/3864738375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c06a830 msgr2=0x7f351c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c06a830 0x7f351c15d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 -- 172.21.15.79:0/3864738375 >> v2:172.21.15.144:3300/0 conn(0x7f351c0cd630 msgr2=0x7f351c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:55.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 --2- 172.21.15.79:0/3864738375 >> v2:172.21.15.144:3300/0 conn(0x7f351c0cd630 0x7f351c06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 -- 172.21.15.79:0/3864738375 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c15ad20 con 0x7f351c1542a0 2023-10-14T18:45:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f3522271700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b65a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f351c15b620 tx=0x7f3518009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313663cd0ecc7cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f352126f700 1 -- 172.21.15.79:0/3864738375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518005c10 con 0x7f351c1542a0 2023-10-14T18:45:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f352126f700 1 -- 172.21.15.79:0/3864738375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518005d70 con 0x7f351c1542a0 2023-10-14T18:45:55.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.806+0000 7f352126f700 1 -- 172.21.15.79:0/3864738375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800b880 con 0x7f351c1542a0 2023-10-14T18:45:55.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 -- 172.21.15.79:0/3864738375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 msgr2=0x7f351c0b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:55.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b65a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f351c15b620 tx=0x7f3518009220 comp rx=0 tx=0).stop 2023-10-14T18:45:55.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 -- 172.21.15.79:0/3864738375 shutdown_connections 2023-10-14T18:45:55.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c06a830 0x7f351c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 --2- 172.21.15.79:0/3864738375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b65a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 --2- 172.21.15.79:0/3864738375 >> v2:172.21.15.144:3300/0 conn(0x7f351c0cd630 0x7f351c06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 -- 172.21.15.79:0/3864738375 >> 172.21.15.79:0/3864738375 conn(0x7f351c068cb0 msgr2=0x7f351c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:55.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 -- 172.21.15.79:0/3864738375 shutdown_connections 2023-10-14T18:45:55.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.807+0000 7f3523273700 1 -- 172.21.15.79:0/3864738375 wait complete. 2023-10-14T18:45:55.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.808+0000 7f3523273700 1 Processor -- start 2023-10-14T18:45:55.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.808+0000 7f3523273700 1 -- start start 2023-10-14T18:45:55.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351c06a830 0x7f351c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c0cd630 0x7f351c1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c153be0 con 0x7f351c1542a0 2023-10-14T18:45:55.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c16b060 con 0x7f351c06a830 2023-10-14T18:45:55.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c5f10 con 0x7f351c0cd630 2023-10-14T18:45:55.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39754/0 (socket says 172.21.15.79:39754) 2023-10-14T18:45:55.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 -- 172.21.15.79:0/1615223162 learned_addr learned my addr 172.21.15.79:0/1615223162 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:55.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522271700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351c06a830 0x7f351c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3521a70700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c0cd630 0x7f351c1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 -- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c0cd630 msgr2=0x7f351c1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:55.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c0cd630 0x7f351c1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 -- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351c06a830 msgr2=0x7f351c0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:55.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351c06a830 0x7f351c0c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 -- 172.21.15.79:0/1615223162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518009480 con 0x7f351c1542a0 2023-10-14T18:45:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3522a72700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f351400ceb0 tx=0x7f3514007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400ad90 con 0x7f351c1542a0 2023-10-14T18:45:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514016430 con 0x7f351c1542a0 2023-10-14T18:45:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c16a4e0 con 0x7f351c1542a0 2023-10-14T18:45:55.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.809+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140167d0 con 0x7f351c1542a0 2023-10-14T18:45:55.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.810+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c16ad80 con 0x7f351c1542a0 2023-10-14T18:45:55.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.810+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c16d8c0 con 0x7f351c1542a0 2023-10-14T18:45:55.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.811+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3514003020 con 0x7f351c1542a0 2023-10-14T18:45:55.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.811+0000 7f35127fc700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:55.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.812+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3514012070 con 0x7f351c1542a0 2023-10-14T18:45:55.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.812+0000 7f3522271700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:55.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.812+0000 7f3522271700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 0x7f35000693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f351c15d5c0 tx=0x7f3518016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:55.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.816+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3514052520 con 0x7f351c1542a0 2023-10-14T18:45:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:55.999+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f351c15d610 con 0x7f351c1542a0 2023-10-14T18:45:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.672+0000 7f35127fc700 1 -- 172.21.15.79:0/1615223162 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f351405b020 con 0x7f351c1542a0 2023-10-14T18:45:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 msgr2=0x7f35000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 0x7f35000693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f351c15d5c0 tx=0x7f3518016000 comp rx=0 tx=0).stop 2023-10-14T18:45:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 msgr2=0x7f351c0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f351400ceb0 tx=0x7f3514007870 comp rx=0 tx=0).stop 2023-10-14T18:45:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 shutdown_connections 2023-10-14T18:45:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3500066f30 0x7f35000693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351c1542a0 0x7f351c0b1630 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f351c06a830 0x7f351c0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 --2- 172.21.15.79:0/1615223162 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f351c0cd630 0x7f351c1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 >> 172.21.15.79:0/1615223162 conn(0x7f351c068cb0 msgr2=0x7f351c0b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 shutdown_connections 2023-10-14T18:45:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.679+0000 7f3523273700 1 -- 172.21.15.79:0/1615223162 wait complete. 2023-10-14T18:45:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:45:56.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:45:56.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.810+0000 7f30ec676700 1 Processor -- start 2023-10-14T18:45:56.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.810+0000 7f30ec676700 1 -- start start 2023-10-14T18:45:56.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30e415a290 0x7f30e40afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30e406a5a0 0x7f30e406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e406af60 con 0x7f30e406a5a0 2023-10-14T18:45:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e40b0790 con 0x7f30e415a290 2023-10-14T18:45:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ec676700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40ce1f0 con 0x7f30e4159ec0 2023-10-14T18:45:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30e406a5a0 0x7f30e406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30e406a5a0 0x7f30e406aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39766/0 (socket says 172.21.15.79:39766) 2023-10-14T18:45:56.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 -- 172.21.15.79:0/1350615832 learned_addr learned my addr 172.21.15.79:0/1350615832 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:56.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30e9c11700 1 --2- 172.21.15.79:0/1350615832 >> v2:172.21.15.144:3300/0 conn(0x7f30e415a290 0x7f30e40afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30ea412700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 -- 172.21.15.79:0/1350615832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 msgr2=0x7f30e40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 -- 172.21.15.79:0/1350615832 >> v2:172.21.15.144:3300/0 conn(0x7f30e415a290 msgr2=0x7f30e40afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 --2- 172.21.15.79:0/1350615832 >> v2:172.21.15.144:3300/0 conn(0x7f30e415a290 0x7f30e40afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.811+0000 7f30eac13700 1 -- 172.21.15.79:0/1350615832 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40b0b20 con 0x7f30e406a5a0 2023-10-14T18:45:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30eac13700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e406aa20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f30e4088fc0 tx=0x7f30dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67191ec728046c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:56.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30e9410700 1 -- 172.21.15.79:0/1350615832 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00b860 con 0x7f30e406a5a0 2023-10-14T18:45:56.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30e9410700 1 -- 172.21.15.79:0/1350615832 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00b9c0 con 0x7f30e406a5a0 2023-10-14T18:45:56.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30e9410700 1 -- 172.21.15.79:0/1350615832 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00bd60 con 0x7f30e406a5a0 2023-10-14T18:45:56.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 -- 172.21.15.79:0/1350615832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 msgr2=0x7f30e406aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:56.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e406aa20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f30e4088fc0 tx=0x7f30dc009250 comp rx=0 tx=0).stop 2023-10-14T18:45:56.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 -- 172.21.15.79:0/1350615832 shutdown_connections 2023-10-14T18:45:56.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e40af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 --2- 172.21.15.79:0/1350615832 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e406aa20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 --2- 172.21.15.79:0/1350615832 >> v2:172.21.15.144:3300/0 conn(0x7f30e415a290 0x7f30e40afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 -- 172.21.15.79:0/1350615832 >> 172.21.15.79:0/1350615832 conn(0x7f30e40d1880 msgr2=0x7f30e40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:56.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 -- 172.21.15.79:0/1350615832 shutdown_connections 2023-10-14T18:45:56.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.812+0000 7f30ec676700 1 -- 172.21.15.79:0/1350615832 wait complete. 2023-10-14T18:45:56.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.813+0000 7f30ec676700 1 Processor -- start 2023-10-14T18:45:56.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.813+0000 7f30ec676700 1 -- start start 2023-10-14T18:45:56.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e4151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30e415a290 0x7f30e4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4151490 con 0x7f30e406a5a0 2023-10-14T18:45:56.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4156e10 con 0x7f30e415a290 2023-10-14T18:45:56.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ec676700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e40b3e10 con 0x7f30e4159ec0 2023-10-14T18:45:56.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ea412700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ea412700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39778/0 (socket says 172.21.15.79:39778) 2023-10-14T18:45:56.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30ea412700 1 -- 172.21.15.79:0/2886260214 learned_addr learned my addr 172.21.15.79:0/2886260214 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:56.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30e9c11700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e4151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.814+0000 7f30eac13700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30e415a290 0x7f30e4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 -- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 msgr2=0x7f30e4151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:56.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e4151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 -- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30e415a290 msgr2=0x7f30e4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:56.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30e415a290 0x7f30e4151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:56.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 -- 172.21.15.79:0/2886260214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0094f0 con 0x7f30e406a5a0 2023-10-14T18:45:56.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ea412700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30e000cfc0 tx=0x7f30e00078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:56.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0016430 con 0x7f30e406a5a0 2023-10-14T18:45:56.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0016590 con 0x7f30e406a5a0 2023-10-14T18:45:56.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4156200 con 0x7f30e406a5a0 2023-10-14T18:45:56.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0016930 con 0x7f30e406a5a0 2023-10-14T18:45:56.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.815+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e41567c0 con 0x7f30e406a5a0 2023-10-14T18:45:56.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.816+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e404c3c0 con 0x7f30e406a5a0 2023-10-14T18:45:56.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.816+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30e0003020 con 0x7f30e406a5a0 2023-10-14T18:45:56.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.817+0000 7f30da7fc700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:56.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.817+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f30e0012070 con 0x7f30e406a5a0 2023-10-14T18:45:56.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.817+0000 7f30e9c11700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:56.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.817+0000 7f30e9c11700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 0x7f30c80693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30d4006fd0 tx=0x7f30d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:56.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:56.821+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30e00526f0 con 0x7f30e406a5a0 2023-10-14T18:45:57.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.044+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f30e40b04b0 con 0x7f30e406a5a0 2023-10-14T18:45:57.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.670+0000 7f30da7fc700 1 -- 172.21.15.79:0/2886260214 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f30e0055d10 con 0x7f30e406a5a0 2023-10-14T18:45:57.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 msgr2=0x7f30c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 0x7f30c80693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30d4006fd0 tx=0x7f30d4008040 comp rx=0 tx=0).stop 2023-10-14T18:45:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 msgr2=0x7f30e41572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30e000cfc0 tx=0x7f30e00078b0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 shutdown_connections 2023-10-14T18:45:57.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30e415a290 0x7f30e4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30e406a5a0 0x7f30e41572a0 secure :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30e000cfc0 tx=0x7f30e00078b0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 --2- 172.21.15.79:0/2886260214 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30e4159ec0 0x7f30e4151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 >> 172.21.15.79:0/2886260214 conn(0x7f30e40d1880 msgr2=0x7f30e40c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:57.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 shutdown_connections 2023-10-14T18:45:57.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.674+0000 7f30ec676700 1 -- 172.21.15.79:0/2886260214 wait complete. 2023-10-14T18:45:57.677 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T18:45:57.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:57.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.802+0000 7f97837db700 1 Processor -- start 2023-10-14T18:45:57.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.802+0000 7f97837db700 1 -- start start 2023-10-14T18:45:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.803+0000 7f97837db700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.803+0000 7f97837db700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 0x7f977c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.803+0000 7f97837db700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977c0c5d80 con 0x7f977c0d1c30 2023-10-14T18:45:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.803+0000 7f97837db700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c068470 con 0x7f977c15a2b0 2023-10-14T18:45:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.803+0000 7f97837db700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c6060 con 0x7f977c0cfe20 2023-10-14T18:45:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 0x7f977c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781577700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781577700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:33912/0 (socket says 172.21.15.79:33912) 2023-10-14T18:45:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781577700 1 -- 172.21.15.79:0/402804220 learned_addr learned my addr 172.21.15.79:0/402804220 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9780d76700 1 --1- 172.21.15.79:0/402804220 >> v1:172.21.15.144:6789/0 conn(0x7f977c0d1c30 0x7f977c0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:57500/0 (socket says 172.21.15.79:57500) 2023-10-14T18:45:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 -- 172.21.15.79:0/402804220 >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 msgr2=0x7f977c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:57.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 --2- 172.21.15.79:0/402804220 >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 -- 172.21.15.79:0/402804220 >> v1:172.21.15.144:6789/0 conn(0x7f977c0d1c30 legacy=0x7f977c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 -- 172.21.15.79:0/402804220 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0c6340 con 0x7f977c0cfe20 2023-10-14T18:45:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781577700 1 --2- 172.21.15.79:0/402804220 >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:45:57.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9781d78700 1 --2- 172.21.15.79:0/402804220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 0x7f977c0ccdd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9774009e60 tx=0x7f9774009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e848c184602c231 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9773fff700 1 -- 172.21.15.79:0/402804220 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400e070 con 0x7f977c0cfe20 2023-10-14T18:45:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9773fff700 1 -- 172.21.15.79:0/402804220 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400bb60 con 0x7f977c0cfe20 2023-10-14T18:45:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.804+0000 7f9773fff700 1 -- 172.21.15.79:0/402804220 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774012430 con 0x7f977c0cfe20 2023-10-14T18:45:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 -- 172.21.15.79:0/402804220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 msgr2=0x7f977c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 --2- 172.21.15.79:0/402804220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 0x7f977c0ccdd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9774009e60 tx=0x7f9774009780 comp rx=0 tx=0).stop 2023-10-14T18:45:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 -- 172.21.15.79:0/402804220 shutdown_connections 2023-10-14T18:45:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 --2- 172.21.15.79:0/402804220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c0cfe20 0x7f977c0ccdd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 --2- 172.21.15.79:0/402804220 >> v2:172.21.15.144:3300/0 conn(0x7f977c15a2b0 0x7f977c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 -- 172.21.15.79:0/402804220 >> 172.21.15.79:0/402804220 conn(0x7f977c067e40 msgr2=0x7f977c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:57.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 -- 172.21.15.79:0/402804220 shutdown_connections 2023-10-14T18:45:57.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.805+0000 7f97837db700 1 -- 172.21.15.79:0/402804220 wait complete. 2023-10-14T18:45:57.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.806+0000 7f97837db700 1 Processor -- start 2023-10-14T18:45:57.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.806+0000 7f97837db700 1 -- start start 2023-10-14T18:45:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 0x7f977c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c15a2b0 0x7f977c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c15ddf0 con 0x7f977c0d1c30 2023-10-14T18:45:57.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c156000 con 0x7f977c0cfe20 2023-10-14T18:45:57.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f97837db700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c15d550 con 0x7f977c15a2b0 2023-10-14T18:45:57.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39782/0 (socket says 172.21.15.79:39782) 2023-10-14T18:45:57.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 -- 172.21.15.79:0/4130488099 learned_addr learned my addr 172.21.15.79:0/4130488099 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:57.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9781577700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 0x7f977c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9781d78700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c15a2b0 0x7f977c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 -- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c15a2b0 msgr2=0x7f977c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c15a2b0 0x7f977c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 -- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 msgr2=0x7f977c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:57.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 0x7f977c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:57.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9780d76700 1 -- 172.21.15.79:0/4130488099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009480 con 0x7f977c0d1c30 2023-10-14T18:45:57.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.807+0000 7f9781577700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 0x7f977c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:57.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f9780d76700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f976c001eb0 tx=0x7f976c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:57.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c005a70 con 0x7f977c0d1c30 2023-10-14T18:45:57.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c005bf0 con 0x7f977c0d1c30 2023-10-14T18:45:57.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9774009a20 con 0x7f977c0d1c30 2023-10-14T18:45:57.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0070d0 con 0x7f977c0d1c30 2023-10-14T18:45:57.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.808+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c15db10 con 0x7f977c0d1c30 2023-10-14T18:45:57.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.809+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c04c3c0 con 0x7f977c0d1c30 2023-10-14T18:45:57.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.809+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f976c007480 con 0x7f977c0d1c30 2023-10-14T18:45:57.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.809+0000 7f97717fa700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:57.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.809+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f976c083960 con 0x7f977c0d1c30 2023-10-14T18:45:57.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.810+0000 7f9781577700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:57.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.810+0000 7f9781577700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 0x7f97600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9778006ce0 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:57.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.814+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f976c050bd0 con 0x7f977c0d1c30 2023-10-14T18:45:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.997+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f977c064a00 con 0x7f977c0d1c30 2023-10-14T18:45:57.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:57.998+0000 7f97717fa700 1 -- 172.21.15.79:0/4130488099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f976c017020 con 0x7f977c0d1c30 2023-10-14T18:45:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:57.999 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:57.046085+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:58.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 msgr2=0x7f97600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 0x7f97600693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9778006ce0 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-10-14T18:45:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 msgr2=0x7f977c155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f976c001eb0 tx=0x7f976c007f40 comp rx=0 tx=0).stop 2023-10-14T18:45:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 shutdown_connections 2023-10-14T18:45:58.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9760066f30 0x7f97600693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f977c15a2b0 0x7f977c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f977c0cfe20 0x7f977c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 --2- 172.21.15.79:0/4130488099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f977c0d1c30 0x7f977c155ac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 >> 172.21.15.79:0/4130488099 conn(0x7f977c067e40 msgr2=0x7f977c0c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 shutdown_connections 2023-10-14T18:45:58.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.001+0000 7f97837db700 1 -- 172.21.15.79:0/4130488099 wait complete. 2023-10-14T18:45:58.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:45:58.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.126+0000 7f8cb5852700 1 Processor -- start 2023-10-14T18:45:58.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.126+0000 7f8cb5852700 1 -- start start 2023-10-14T18:45:58.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cb5852700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 0x7f8cb015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cb5852700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8cb015a620 0x7f8cb015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cb5852700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb015cbb0 con 0x7f8cb015d580 2023-10-14T18:45:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cb5852700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb015bfa0 con 0x7f8cb015a620 2023-10-14T18:45:58.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cb5852700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015c280 con 0x7f8cb0157870 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cae7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8cb015a620 0x7f8cb015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cae7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8cb015a620 0x7f8cb015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39794/0 (socket says 172.21.15.79:39794) 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.127+0000 7f8cae7fc700 1 -- 172.21.15.79:0/1109820633 learned_addr learned my addr 172.21.15.79:0/1109820633 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8caeffd700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 0x7f8cb015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cae7fc700 1 -- 172.21.15.79:0/1109820633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 msgr2=0x7f8cb015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:58.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 0x7f8cb015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cae7fc700 1 -- 172.21.15.79:0/1109820633 >> v1:172.21.15.144:6789/0 conn(0x7f8cb015d580 legacy=0x7f8cb0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cae7fc700 1 -- 172.21.15.79:0/1109820633 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb015c560 con 0x7f8cb015a620 2023-10-14T18:45:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8caeffd700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 0x7f8cb015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:58.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb015a620 0x7f8cb015d040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c980099b0 tx=0x7f8c98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c56daa20316d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cadffb700 1 -- 172.21.15.79:0/1109820633 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800b860 con 0x7f8cb015a620 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cadffb700 1 -- 172.21.15.79:0/1109820633 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800b9c0 con 0x7f8cb015a620 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cadffb700 1 -- 172.21.15.79:0/1109820633 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bd60 con 0x7f8cb015a620 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cb5852700 1 -- 172.21.15.79:0/1109820633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb015a620 msgr2=0x7f8cb015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.128+0000 7f8cb5852700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb015a620 0x7f8cb015d040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c980099b0 tx=0x7f8c98009250 comp rx=0 tx=0).stop 2023-10-14T18:45:58.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 -- 172.21.15.79:0/1109820633 shutdown_connections 2023-10-14T18:45:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb0157870 0x7f8cb015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 --2- 172.21.15.79:0/1109820633 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb015a620 0x7f8cb015d040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 -- 172.21.15.79:0/1109820633 >> 172.21.15.79:0/1109820633 conn(0x7f8cb0068ce0 msgr2=0x7f8cb00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:58.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 -- 172.21.15.79:0/1109820633 shutdown_connections 2023-10-14T18:45:58.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.129+0000 7f8cb5852700 1 -- 172.21.15.79:0/1109820633 wait complete. 2023-10-14T18:45:58.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.130+0000 7f8cb5852700 1 Processor -- start 2023-10-14T18:45:58.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.130+0000 7f8cb5852700 1 -- start start 2023-10-14T18:45:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.130+0000 7f8cb5852700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.130+0000 7f8cb5852700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 0x7f8cb0153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb015d580 0x7f8cb0154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015e340 con 0x7f8cb0157870 2023-10-14T18:45:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00cf8b0 con 0x7f8cb015d580 2023-10-14T18:45:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00cf580 con 0x7f8cb015a620 2023-10-14T18:45:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39800/0 (socket says 172.21.15.79:39800) 2023-10-14T18:45:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 -- 172.21.15.79:0/3002582043 learned_addr learned my addr 172.21.15.79:0/3002582043 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caf7fe700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb015d580 0x7f8cb0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 0x7f8cb0153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 -- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 msgr2=0x7f8cb0153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 0x7f8cb0153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 -- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb015d580 msgr2=0x7f8cb0154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb015d580 0x7f8cb0154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 -- 172.21.15.79:0/3002582043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980094f0 con 0x7f8cb0157870 2023-10-14T18:45:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 0x7f8cb0153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:45:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8caeffd700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d1d0 tx=0x7f8ca0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000ddc0 con 0x7f8cb0157870 2023-10-14T18:45:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000f040 con 0x7f8cb0157870 2023-10-14T18:45:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0015670 con 0x7f8cb0157870 2023-10-14T18:45:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb014adb0 con 0x7f8cb0157870 2023-10-14T18:45:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.131+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb0154730 con 0x7f8cb0157870 2023-10-14T18:45:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.132+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb0154d00 con 0x7f8cb0157870 2023-10-14T18:45:58.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.133+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ca0015a60 con 0x7f8cb0157870 2023-10-14T18:45:58.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.133+0000 7f8ca6ffd700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.133+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ca0084960 con 0x7f8cb0157870 2023-10-14T18:45:58.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.133+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.134+0000 7f8cae7fc700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 0x7f8c900693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c980099b0 tx=0x7f8c98017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.137+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ca004e5a0 con 0x7f8cb0157870 2023-10-14T18:45:58.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.322+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb004c3c0 con 0x7f8cb0157870 2023-10-14T18:45:58.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.322+0000 7f8ca6ffd700 1 -- 172.21.15.79:0/3002582043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f8ca001a090 con 0x7f8cb0157870 2023-10-14T18:45:58.323 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:45:58.323 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:57.046085+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:45:58.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 msgr2=0x7f8c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 0x7f8c900693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c980099b0 tx=0x7f8c98017000 comp rx=0 tx=0).stop 2023-10-14T18:45:58.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 msgr2=0x7f8cb00b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d1d0 tx=0x7f8ca0009a90 comp rx=0 tx=0).stop 2023-10-14T18:45:58.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 shutdown_connections 2023-10-14T18:45:58.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cb015d580 0x7f8cb0154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cb0157870 0x7f8cb00b2b60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 --2- 172.21.15.79:0/3002582043 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8cb015a620 0x7f8cb0153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 >> 172.21.15.79:0/3002582043 conn(0x7f8cb0068ce0 msgr2=0x7f8cb014fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:58.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 shutdown_connections 2023-10-14T18:45:58.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.325+0000 7f8cb5852700 1 -- 172.21.15.79:0/3002582043 wait complete. 2023-10-14T18:45:58.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:45:58.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.454+0000 7fd2c4933700 1 Processor -- start 2023-10-14T18:45:58.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.454+0000 7fd2c4933700 1 -- start start 2023-10-14T18:45:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2c4933700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2c015a290 0x7fd2c006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2c4933700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00b0790 con 0x7fd2c006aae0 2023-10-14T18:45:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2c4933700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c006af20 con 0x7fd2c0159ec0 2023-10-14T18:45:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2c4933700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00ce1f0 con 0x7fd2c015a290 2023-10-14T18:45:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2c015a290 0x7fd2c006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bed9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd2c006aae0 0x7fd2c00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45112/0 (socket says 172.21.15.79:45112) 2023-10-14T18:45:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bed9d700 1 -- 172.21.15.79:0/3271720968 learned_addr learned my addr 172.21.15.79:0/3271720968 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bdd9b700 1 -- 172.21.15.79:0/3271720968 >> v1:172.21.15.144:6789/0 conn(0x7fd2c0159ec0 legacy=0x7fd2c00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bdd9b700 1 -- 172.21.15.79:0/3271720968 >> v1:172.21.15.79:6789/0 conn(0x7fd2c006aae0 legacy=0x7fd2c00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bd59a700 1 -- 172.21.15.79:0/3271720968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844208692 0 0) 0x7fd2c00b0790 con 0x7fd2c006aae0 2023-10-14T18:45:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bdd9b700 1 -- 172.21.15.79:0/3271720968 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c00b0b20 con 0x7fd2c015a290 2023-10-14T18:45:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.455+0000 7fd2bdd9b700 1 --2- 172.21.15.79:0/3271720968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c015a290 0x7fd2c006a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40098e0 tx=0x7fd2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f2bd2dbcfcb087 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2bd59a700 1 -- 172.21.15.79:0/3271720968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4009e80 con 0x7fd2c015a290 2023-10-14T18:45:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2bd59a700 1 -- 172.21.15.79:0/3271720968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400b860 con 0x7fd2c015a290 2023-10-14T18:45:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2bd59a700 1 -- 172.21.15.79:0/3271720968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400bbe0 con 0x7fd2c015a290 2023-10-14T18:45:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 -- 172.21.15.79:0/3271720968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c015a290 msgr2=0x7fd2c006a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3271720968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c015a290 0x7fd2c006a5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40098e0 tx=0x7fd2b40091a0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 -- 172.21.15.79:0/3271720968 shutdown_connections 2023-10-14T18:45:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3271720968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c015a290 0x7fd2c006a5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 -- 172.21.15.79:0/3271720968 >> 172.21.15.79:0/3271720968 conn(0x7fd2c00d1880 msgr2=0x7fd2c00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 -- 172.21.15.79:0/3271720968 shutdown_connections 2023-10-14T18:45:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.456+0000 7fd2c4933700 1 -- 172.21.15.79:0/3271720968 wait complete. 2023-10-14T18:45:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.457+0000 7fd2c4933700 1 Processor -- start 2023-10-14T18:45:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.457+0000 7fd2c4933700 1 -- start start 2023-10-14T18:45:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c0159ec0 0x7fd2c0153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c015a290 0x7fd2c00cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0151eb0 con 0x7fd2c006aae0 2023-10-14T18:45:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0154110 con 0x7fd2c0159ec0 2023-10-14T18:45:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2c4933700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c00cbcb0 con 0x7fd2c015a290 2023-10-14T18:45:58.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40126/0 (socket says 172.21.15.79:40126) 2023-10-14T18:45:58.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 -- 172.21.15.79:0/3536208390 learned_addr learned my addr 172.21.15.79:0/3536208390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:58.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2bdd9b700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c0159ec0 0x7fd2c0153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2bed9d700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c015a290 0x7fd2c00cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 -- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c015a290 msgr2=0x7fd2c00cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c015a290 0x7fd2c00cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 -- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c0159ec0 msgr2=0x7fd2c0153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:58.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c0159ec0 0x7fd2c0153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:58.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.458+0000 7fd2be59c700 1 -- 172.21.15.79:0/3536208390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4009420 con 0x7fd2c006aae0 2023-10-14T18:45:58.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2be59c700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c590 tx=0x7fd2b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011590 con 0x7fd2c006aae0 2023-10-14T18:45:58.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b0011710 con 0x7fd2c006aae0 2023-10-14T18:45:58.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011ad0 con 0x7fd2c006aae0 2023-10-14T18:45:58.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c01512a0 con 0x7fd2c006aae0 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.459+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c0151860 con 0x7fd2c006aae0 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.460+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c004c3c0 con 0x7fd2c006aae0 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.460+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2b001b3b0 con 0x7fd2c006aae0 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.460+0000 7fd2ae7fc700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.461+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2b0083990 con 0x7fd2c006aae0 2023-10-14T18:45:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.461+0000 7fd2bdd9b700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:58.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.461+0000 7fd2bdd9b700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 0x7fd2a00693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40093f0 tx=0x7fd2b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:58.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.465+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2b0050c00 con 0x7fd2c006aae0 2023-10-14T18:45:58.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:58.695+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd2c00b04b0 con 0x7fd2c006aae0 2023-10-14T18:45:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.688+0000 7fd2ae7fc700 1 -- 172.21.15.79:0/3536208390 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd2b0017070 con 0x7fd2c006aae0 2023-10-14T18:45:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 msgr2=0x7fd2a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 0x7fd2a00693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40093f0 tx=0x7fd2b4017000 comp rx=0 tx=0).stop 2023-10-14T18:45:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 msgr2=0x7fd2c0150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c590 tx=0x7fd2b000c8a0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 shutdown_connections 2023-10-14T18:45:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd2a0066f30 0x7fd2a00693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd2c015a290 0x7fd2c00cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2c006aae0 0x7fd2c0150c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 --2- 172.21.15.79:0/3536208390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c0159ec0 0x7fd2c0153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 >> 172.21.15.79:0/3536208390 conn(0x7fd2c00d1880 msgr2=0x7fd2c0157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 shutdown_connections 2023-10-14T18:45:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.691+0000 7fd2c4933700 1 -- 172.21.15.79:0/3536208390 wait complete. 2023-10-14T18:45:59.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:45:59.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.830+0000 7f6efb59e700 1 Processor -- start 2023-10-14T18:45:59.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.830+0000 7f6efb59e700 1 -- start start 2023-10-14T18:45:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efb59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6efc0cce30 0x7f6efc15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efb59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6efc06aa00 0x7f6efc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efb59e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc0b4d70 con 0x7f6efc0b6580 2023-10-14T18:45:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efb59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc0cd8d0 con 0x7f6efc06aa00 2023-10-14T18:45:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efb59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc0b4440 con 0x7f6efc0cce30 2023-10-14T18:45:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6efc06aa00 0x7f6efc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:59.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6ef9d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6efc0b6580 0x7f6efc06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45124/0 (socket says 172.21.15.79:45124) 2023-10-14T18:45:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6ef9d9b700 1 -- 172.21.15.79:0/4000168931 learned_addr learned my addr 172.21.15.79:0/4000168931 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:45:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efa59c700 1 --2- 172.21.15.79:0/4000168931 >> v2:172.21.15.144:3300/0 conn(0x7f6efc0cce30 0x7f6efc15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 -- 172.21.15.79:0/4000168931 >> v2:172.21.15.144:3300/0 conn(0x7f6efc0cce30 msgr2=0x7f6efc15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:45:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 --2- 172.21.15.79:0/4000168931 >> v2:172.21.15.144:3300/0 conn(0x7f6efc0cce30 0x7f6efc15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 -- 172.21.15.79:0/4000168931 >> v1:172.21.15.79:6789/0 conn(0x7f6efc0b6580 legacy=0x7f6efc06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6ef959a700 1 -- 172.21.15.79:0/4000168931 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104021594 0 0) 0x7f6efc0b4d70 con 0x7f6efc0b6580 2023-10-14T18:45:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 -- 172.21.15.79:0/4000168931 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0b4720 con 0x7f6efc06aa00 2023-10-14T18:45:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.831+0000 7f6efad9d700 1 --2- 172.21.15.79:0/4000168931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc0b5200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0b3770 tx=0x7f6ef4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f1b3e39aeccb11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:59.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6ef959a700 1 -- 172.21.15.79:0/4000168931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400e070 con 0x7f6efc06aa00 2023-10-14T18:45:59.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6ef959a700 1 -- 172.21.15.79:0/4000168931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400bc30 con 0x7f6efc06aa00 2023-10-14T18:45:59.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6ef959a700 1 -- 172.21.15.79:0/4000168931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4012430 con 0x7f6efc06aa00 2023-10-14T18:45:59.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 -- 172.21.15.79:0/4000168931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 msgr2=0x7f6efc0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 --2- 172.21.15.79:0/4000168931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc0b5200 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0b3770 tx=0x7f6ef4009780 comp rx=0 tx=0).stop 2023-10-14T18:45:59.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 -- 172.21.15.79:0/4000168931 shutdown_connections 2023-10-14T18:45:59.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 --2- 172.21.15.79:0/4000168931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc0b5200 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 --2- 172.21.15.79:0/4000168931 >> v2:172.21.15.144:3300/0 conn(0x7f6efc0cce30 0x7f6efc15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 -- 172.21.15.79:0/4000168931 >> 172.21.15.79:0/4000168931 conn(0x7f6efc068cb0 msgr2=0x7f6efc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:45:59.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 -- 172.21.15.79:0/4000168931 shutdown_connections 2023-10-14T18:45:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.832+0000 7f6efb59e700 1 -- 172.21.15.79:0/4000168931 wait complete. 2023-10-14T18:45:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.833+0000 7f6efb59e700 1 Processor -- start 2023-10-14T18:45:59.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.833+0000 7f6efb59e700 1 -- start start 2023-10-14T18:45:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 0x7f6efc0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6efc0cce30 0x7f6efc153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc14ef30 con 0x7f6efc06aa00 2023-10-14T18:45:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc169b00 con 0x7f6efc0b6580 2023-10-14T18:45:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efb59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc169da0 con 0x7f6efc0cce30 2023-10-14T18:45:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40142/0 (socket says 172.21.15.79:40142) 2023-10-14T18:45:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efa59c700 1 -- 172.21.15.79:0/3502885347 learned_addr learned my addr 172.21.15.79:0/3502885347 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:45:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efa59c700 1 -- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6efc0cce30 msgr2=0x7f6efc153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.834+0000 7f6efa59c700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6efc0cce30 0x7f6efc153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efa59c700 1 -- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 msgr2=0x7f6efc0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:45:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6ef9d9b700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 0x7f6efc0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efa59c700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 0x7f6efc0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:45:59.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efa59c700 1 -- 172.21.15.79:0/3502885347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009a20 con 0x7f6efc06aa00 2023-10-14T18:45:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6ef9d9b700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 0x7f6efc0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:45:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efa59c700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c8b0 tx=0x7f6eec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec011600 con 0x7f6efc06aa00 2023-10-14T18:45:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec011760 con 0x7f6efc06aa00 2023-10-14T18:45:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc0b1750 con 0x7f6efc06aa00 2023-10-14T18:45:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec011b00 con 0x7f6efc06aa00 2023-10-14T18:45:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.835+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc0b1d10 con 0x7f6efc06aa00 2023-10-14T18:45:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.836+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc0b1f00 con 0x7f6efc06aa00 2023-10-14T18:45:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.836+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eec018360 con 0x7f6efc06aa00 2023-10-14T18:45:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.836+0000 7f6eea7fc700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 0x7f6edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:45:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.837+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6eec0842d0 con 0x7f6efc06aa00 2023-10-14T18:45:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.837+0000 7f6ef9d9b700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 0x7f6edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:45:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.837+0000 7f6ef9d9b700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 0x7f6edc0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6efc06a740 tx=0x7f6ef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:45:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:45:59.841+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eec054f30 con 0x7f6efc06aa00 2023-10-14T18:46:00.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.066+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6efc0b4a00 con 0x7f6efc06aa00 2023-10-14T18:46:00.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.693+0000 7f6eea7fc700 1 -- 172.21.15.79:0/3502885347 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6eec054ac0 con 0x7f6efc06aa00 2023-10-14T18:46:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 msgr2=0x7f6edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 0x7f6edc0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6efc06a740 tx=0x7f6ef0009040 comp rx=0 tx=0).stop 2023-10-14T18:46:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 msgr2=0x7f6efc14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c8b0 tx=0x7f6eec008040 comp rx=0 tx=0).stop 2023-10-14T18:46:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 shutdown_connections 2023-10-14T18:46:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6edc066f30 0x7f6edc0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6efc0cce30 0x7f6efc153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6efc06aa00 0x7f6efc14e9f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 --2- 172.21.15.79:0/3502885347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6efc0b6580 0x7f6efc0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 >> 172.21.15.79:0/3502885347 conn(0x7f6efc068cb0 msgr2=0x7f6efc150710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 shutdown_connections 2023-10-14T18:46:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.695+0000 7f6efb59e700 1 -- 172.21.15.79:0/3502885347 wait complete. 2023-10-14T18:46:00.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:00.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.823+0000 7f1b63ee5700 1 Processor -- start 2023-10-14T18:46:00.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.823+0000 7f1b63ee5700 1 -- start start 2023-10-14T18:46:00.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b63ee5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b5c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b63ee5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c15cbb0 con 0x7f1b5c157870 2023-10-14T18:46:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b63ee5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5c15bfa0 con 0x7f1b5c15a620 2023-10-14T18:46:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b63ee5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c15bdb0 con 0x7f1b5c157c40 2023-10-14T18:46:00.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b61c81700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1b5c157870 0x7f1b5c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45138/0 (socket says 172.21.15.79:45138) 2023-10-14T18:46:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b61c81700 1 -- 172.21.15.79:0/800874005 learned_addr learned my addr 172.21.15.79:0/800874005 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:00.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b62482700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b5c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099126434 0 0) 0x7f1b5c15cbb0 con 0x7f1b5c157870 2023-10-14T18:46:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b48003570 con 0x7f1b5c157870 2023-10-14T18:46:00.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760297465 0 0) 0x7f1b5c15bfa0 con 0x7f1b5c15a620 2023-10-14T18:46:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c15cbb0 con 0x7f1b5c15a620 2023-10-14T18:46:00.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697119065 0 0) 0x7f1b48003570 con 0x7f1b5c157870 2023-10-14T18:46:00.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 msgr2=0x7f1b5c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:00.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b5c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 >> v1:172.21.15.144:6789/0 conn(0x7f1b5c15a620 legacy=0x7f1b5c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c15c280 con 0x7f1b5c157870 2023-10-14T18:46:00.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1b58001470 con 0x7f1b5c157870 2023-10-14T18:46:00.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 >> v1:172.21.15.79:6789/0 conn(0x7f1b5c157870 legacy=0x7f1b5c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b48004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b48004810 0x7f1b48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4800bb10 con 0x7f1b48003c20 2023-10-14T18:46:00.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4800bc80 con 0x7f1b48004810 2023-10-14T18:46:00.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.824+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4800be40 con 0x7f1b5c157c40 2023-10-14T18:46:00.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b48004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61480700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b48004810 0x7f1b48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b62482700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 -- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 msgr2=0x7f1b480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:00.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 -- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b48004810 msgr2=0x7f1b48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:00.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b48004810 0x7f1b48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 -- 172.21.15.79:0/800874005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48003570 con 0x7f1b48003c20 2023-10-14T18:46:00.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b62482700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c157c40 0x7f1b480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:00.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b61c81700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b48004010 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c2d0 tx=0x7f1b58001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84589b95193c8b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:00.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800cba0 con 0x7f1b48003c20 2023-10-14T18:46:00.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5800cd00 con 0x7f1b48003c20 2023-10-14T18:46:00.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b60c7f700 1 -- 172.21.15.79:0/800874005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58005b70 con 0x7f1b48003c20 2023-10-14T18:46:00.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b63ee5700 1 -- 172.21.15.79:0/800874005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 msgr2=0x7f1b48004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.825+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/800874005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b48004010 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c2d0 tx=0x7f1b58001e10 comp rx=0 tx=0).stop 2023-10-14T18:46:00.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.826+0000 7f1b62482700 1 -- 172.21.15.79:0/800874005 reap_dead start 2023-10-14T18:46:00.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.826+0000 7f1b63ee5700 1 -- 172.21.15.79:0/800874005 shutdown_connections 2023-10-14T18:46:00.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.826+0000 7f1b63ee5700 1 -- 172.21.15.79:0/800874005 >> 172.21.15.79:0/800874005 conn(0x7f1b5c068ce0 msgr2=0x7f1b5c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:00.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.826+0000 7f1b63ee5700 1 -- 172.21.15.79:0/800874005 shutdown_connections 2023-10-14T18:46:00.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.826+0000 7f1b63ee5700 1 -- 172.21.15.79:0/800874005 wait complete. 2023-10-14T18:46:00.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 Processor -- start 2023-10-14T18:46:00.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 -- start start 2023-10-14T18:46:00.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 0x7f1b5c1519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 0x7f1b5c1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c14d780 con 0x7f1b48003c20 2023-10-14T18:46:00.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c14f3a0 con 0x7f1b5c153430 2023-10-14T18:46:00.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.827+0000 7f1b63ee5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c160f50 con 0x7f1b5c14d310 2023-10-14T18:46:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40164/0 (socket says 172.21.15.79:40164) 2023-10-14T18:46:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 -- 172.21.15.79:0/540246377 learned_addr learned my addr 172.21.15.79:0/540246377 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b62482700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 0x7f1b5c1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61480700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 0x7f1b5c1519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 -- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 msgr2=0x7f1b5c1519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 0x7f1b5c1519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 -- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 msgr2=0x7f1b5c1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:00.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 0x7f1b5c1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:00.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 -- 172.21.15.79:0/540246377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c14ea70 con 0x7f1b48003c20 2023-10-14T18:46:00.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b62482700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 0x7f1b5c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:00.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61480700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 0x7f1b5c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:00.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b61c81700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b58007c90 tx=0x7f1b58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:00.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58001640 con 0x7f1b48003c20 2023-10-14T18:46:00.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b580070d0 con 0x7f1b48003c20 2023-10-14T18:46:00.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c14ed50 con 0x7f1b48003c20 2023-10-14T18:46:00.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580074b0 con 0x7f1b48003c20 2023-10-14T18:46:00.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.828+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c153de0 con 0x7f1b48003c20 2023-10-14T18:46:00.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.829+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c14f680 con 0x7f1b48003c20 2023-10-14T18:46:00.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.830+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b58019030 con 0x7f1b48003c20 2023-10-14T18:46:00.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.830+0000 7f1b51ffb700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 0x7f1b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:00.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.830+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b58084eb0 con 0x7f1b48003c20 2023-10-14T18:46:00.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.830+0000 7f1b61480700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 0x7f1b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:00.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.831+0000 7f1b61480700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 0x7f1b400693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0010e0 tx=0x7f1b4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:00.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:00.834+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b580521d0 con 0x7f1b48003c20 2023-10-14T18:46:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.058+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5c14d6e0 con 0x7f1b48003c20 2023-10-14T18:46:01.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.059+0000 7f1b51ffb700 1 -- 172.21.15.79:0/540246377 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1b580557f0 con 0x7f1b48003c20 2023-10-14T18:46:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:01.060 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 msgr2=0x7f1b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 0x7f1b400693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0010e0 tx=0x7f1b4c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 msgr2=0x7f1b5c160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1b58007c90 tx=0x7f1b58015000 comp rx=0 tx=0).stop 2023-10-14T18:46:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 shutdown_connections 2023-10-14T18:46:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b40066f30 0x7f1b400693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b5c153430 0x7f1b5c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b48003c20 0x7f1b5c160970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 --2- 172.21.15.79:0/540246377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b5c14d310 0x7f1b5c1519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 >> 172.21.15.79:0/540246377 conn(0x7f1b5c068ce0 msgr2=0x7f1b5c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 shutdown_connections 2023-10-14T18:46:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.061+0000 7f1b63ee5700 1 -- 172.21.15.79:0/540246377 wait complete. 2023-10-14T18:46:01.064 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:01.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:01.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.187+0000 7fc684dbc700 1 Processor -- start 2023-10-14T18:46:01.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.187+0000 7fc684dbc700 1 -- start start 2023-10-14T18:46:01.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc684dbc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc680157870 0x7fc68015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc684dbc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68015cbb0 con 0x7fc68015a620 2023-10-14T18:46:01.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc684dbc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68015bfa0 con 0x7fc680157c40 2023-10-14T18:46:01.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc684dbc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68015c280 con 0x7fc680157870 2023-10-14T18:46:01.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc675d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc68015a620 0x7fc68015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45142/0 (socket says 172.21.15.79:45142) 2023-10-14T18:46:01.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc675d9b700 1 -- 172.21.15.79:0/3866511719 learned_addr learned my addr 172.21.15.79:0/3866511719 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:01.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc67e59c700 1 --2- 172.21.15.79:0/3866511719 >> v2:172.21.15.144:3300/0 conn(0x7fc680157870 0x7fc68015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590326341 0 0) 0x7fc68015cbb0 con 0x7fc68015a620 2023-10-14T18:46:01.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.188+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc66c003570 con 0x7fc68015a620 2023-10-14T18:46:01.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92866354 0 0) 0x7fc66c003570 con 0x7fc68015a620 2023-10-14T18:46:01.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 >> v2:172.21.15.144:3300/0 conn(0x7fc680157870 msgr2=0x7fc68015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:01.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 --2- 172.21.15.79:0/3866511719 >> v2:172.21.15.144:3300/0 conn(0x7fc680157870 0x7fc68015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 >> v1:172.21.15.144:6789/0 conn(0x7fc680157c40 legacy=0x7fc680158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68015c560 con 0x7fc68015a620 2023-10-14T18:46:01.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc668001470 con 0x7fc68015a620 2023-10-14T18:46:01.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 >> v1:172.21.15.79:6789/0 conn(0x7fc68015a620 legacy=0x7fc68015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 0x7fc66c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c004810 0x7fc66c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc66c0051c0 0x7fc66c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68015c280 con 0x7fc66c003a60 2023-10-14T18:46:01.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00c160 con 0x7fc66c004810 2023-10-14T18:46:01.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c00c320 con 0x7fc66c0051c0 2023-10-14T18:46:01.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 0x7fc66c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc675d9b700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c004810 0x7fc66c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67ed9d700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc66c0051c0 0x7fc66c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 -- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc66c0051c0 msgr2=0x7fc66c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:01.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc66c0051c0 0x7fc66c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 -- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c004810 msgr2=0x7fc66c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:01.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c004810 0x7fc66c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 -- 172.21.15.79:0/3866511719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c003570 con 0x7fc66c003a60 2023-10-14T18:46:01.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67ed9d700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc66c0051c0 0x7fc66c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:01.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67ed9d700 1 -- 172.21.15.79:0/3866511719 reap_dead start 2023-10-14T18:46:01.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67e59c700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 0x7fc66c003e70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc670009c00 tx=0x7fc6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9efd5a6d9bdecd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.189+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000e710 con 0x7fc66c003a60 2023-10-14T18:46:01.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67000e870 con 0x7fc66c003a60 2023-10-14T18:46:01.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc67dd9b700 1 -- 172.21.15.79:0/3866511719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000ec30 con 0x7fc66c003a60 2023-10-14T18:46:01.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 -- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 msgr2=0x7fc66c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 0x7fc66c003e70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc670009c00 tx=0x7fc6700091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 -- 172.21.15.79:0/3866511719 shutdown_connections 2023-10-14T18:46:01.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 --2- 172.21.15.79:0/3866511719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66c003a60 0x7fc66c003e70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 -- 172.21.15.79:0/3866511719 >> 172.21.15.79:0/3866511719 conn(0x7fc680068ce0 msgr2=0x7fc6800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 -- 172.21.15.79:0/3866511719 shutdown_connections 2023-10-14T18:46:01.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.190+0000 7fc684dbc700 1 -- 172.21.15.79:0/3866511719 wait complete. 2023-10-14T18:46:01.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.191+0000 7fc684dbc700 1 Processor -- start 2023-10-14T18:46:01.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.191+0000 7fc684dbc700 1 -- start start 2023-10-14T18:46:01.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 0x7fc680153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc68016dc70 0x7fc68016e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68016e630 con 0x7fc680150410 2023-10-14T18:46:01.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801529f0 con 0x7fc66c003a60 2023-10-14T18:46:01.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc684dbc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc680153850 con 0x7fc68016dc70 2023-10-14T18:46:01.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40178/0 (socket says 172.21.15.79:40178) 2023-10-14T18:46:01.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 -- 172.21.15.79:0/2445131144 learned_addr learned my addr 172.21.15.79:0/2445131144 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:01.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc67e59c700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 0x7fc680153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc67ed9d700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc68016dc70 0x7fc68016e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 -- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc68016dc70 msgr2=0x7fc68016e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc68016dc70 0x7fc68016e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 -- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 msgr2=0x7fc680153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 0x7fc680153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 -- 172.21.15.79:0/2445131144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680152c40 con 0x7fc680150410 2023-10-14T18:46:01.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc67e59c700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 0x7fc680153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:01.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.192+0000 7fc675d9b700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc668007510 tx=0x7fc668001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.193+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800fa50 con 0x7fc680150410 2023-10-14T18:46:01.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.193+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66800fbb0 con 0x7fc680150410 2023-10-14T18:46:01.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.193+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc680152f20 con 0x7fc680150410 2023-10-14T18:46:01.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.193+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680133f0 con 0x7fc680150410 2023-10-14T18:46:01.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.193+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6801534e0 con 0x7fc680150410 2023-10-14T18:46:01.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.194+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68004c3c0 con 0x7fc680150410 2023-10-14T18:46:01.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.194+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc668013760 con 0x7fc680150410 2023-10-14T18:46:01.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.194+0000 7fc676ffd700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.194+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc668084a60 con 0x7fc680150410 2023-10-14T18:46:01.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.195+0000 7fc67e59c700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.195+0000 7fc67e59c700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc6700091e0 tx=0x7fc67001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.198+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc668051c30 con 0x7fc680150410 2023-10-14T18:46:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.381+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc680153990 con 0x7fc680150410 2023-10-14T18:46:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.382+0000 7fc676ffd700 1 -- 172.21.15.79:0/2445131144 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc668055250 con 0x7fc680150410 2023-10-14T18:46:01.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:01.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:45:58.478818+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 msgr2=0x7fc6600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 0x7fc6600693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc6700091e0 tx=0x7fc67001a000 comp rx=0 tx=0).stop 2023-10-14T18:46:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 msgr2=0x7fc680151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc668007510 tx=0x7fc668001e50 comp rx=0 tx=0).stop 2023-10-14T18:46:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 shutdown_connections 2023-10-14T18:46:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc660066f30 0x7fc6600693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc68016dc70 0x7fc68016e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c003a60 0x7fc680153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 --2- 172.21.15.79:0/2445131144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc680150410 0x7fc680151ed0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 >> 172.21.15.79:0/2445131144 conn(0x7fc680068ce0 msgr2=0x7fc6800b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 shutdown_connections 2023-10-14T18:46:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.384+0000 7fc684dbc700 1 -- 172.21.15.79:0/2445131144 wait complete. 2023-10-14T18:46:01.397 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:46:01.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:46:01.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.512+0000 7f3da18a9700 1 Processor -- start 2023-10-14T18:46:01.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.512+0000 7f3da18a9700 1 -- start start 2023-10-14T18:46:01.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da18a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da18a9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d9c0cdab0 0x7f3d9c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da18a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9c0cb7c0 con 0x7f3d9c15dda0 2023-10-14T18:46:01.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da18a9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c15e850 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da18a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0cd030 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d9c0cdab0 0x7f3d9c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d9c0cdab0 0x7f3d9c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40186/0 (socket says 172.21.15.79:40186) 2023-10-14T18:46:01.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 -- 172.21.15.79:0/281689988 learned_addr learned my addr 172.21.15.79:0/281689988 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:01.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da08a7700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 -- 172.21.15.79:0/281689988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 msgr2=0x7f3d9c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:01.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 -- 172.21.15.79:0/281689988 >> v1:172.21.15.144:6789/0 conn(0x7f3d9c15dda0 legacy=0x7f3d9c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3d9bfff700 1 -- 172.21.15.79:0/281689988 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c15e290 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.513+0000 7f3da08a7700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:01.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3d9bfff700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cdab0 0x7f3d9c15d860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d840099b0 tx=0x7f3d84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa3d331486e2042 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3d9b7fe700 1 -- 172.21.15.79:0/281689988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400b860 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3d9b7fe700 1 -- 172.21.15.79:0/281689988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400b9c0 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3d9b7fe700 1 -- 172.21.15.79:0/281689988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400bd60 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 -- 172.21.15.79:0/281689988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cdab0 msgr2=0x7f3d9c15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cdab0 0x7f3d9c15d860 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d840099b0 tx=0x7f3d84009250 comp rx=0 tx=0).stop 2023-10-14T18:46:01.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 -- 172.21.15.79:0/281689988 shutdown_connections 2023-10-14T18:46:01.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 --2- 172.21.15.79:0/281689988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cdab0 0x7f3d9c15d860 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 -- 172.21.15.79:0/281689988 >> 172.21.15.79:0/281689988 conn(0x7f3d9c067660 msgr2=0x7f3d9c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 -- 172.21.15.79:0/281689988 shutdown_connections 2023-10-14T18:46:01.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.514+0000 7f3da18a9700 1 -- 172.21.15.79:0/281689988 wait complete. 2023-10-14T18:46:01.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.515+0000 7f3da18a9700 1 Processor -- start 2023-10-14T18:46:01.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 -- start start 2023-10-14T18:46:01.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cdab0 0x7f3d9c16dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d9c15dda0 0x7f3d9c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c16e000 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0b3c40 con 0x7f3d9c15dda0 2023-10-14T18:46:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da18a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c14f8e0 con 0x7f3d9c0cdab0 2023-10-14T18:46:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da08a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da08a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40188/0 (socket says 172.21.15.79:40188) 2023-10-14T18:46:01.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.516+0000 7f3da08a7700 1 -- 172.21.15.79:0/3453632846 learned_addr learned my addr 172.21.15.79:0/3453632846 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:01.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da10a8700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d9c15dda0 0x7f3d9c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3d9bfff700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cdab0 0x7f3d9c16dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 -- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cdab0 msgr2=0x7f3d9c16dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cdab0 0x7f3d9c16dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 -- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d9c15dda0 msgr2=0x7f3d9c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d9c15dda0 0x7f3d9c14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 -- 172.21.15.79:0/3453632846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840094f0 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da08a7700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00a400 tx=0x7f3d8c007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00d650 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00d7b0 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c16e230 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00db50 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.517+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c16e7f0 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.518+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9c0b3a10 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.518+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d8c015440 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.519+0000 7f3d98ff9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.519+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d8c084e40 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.519+0000 7f3d9bfff700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.519+0000 7f3d9bfff700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 0x7f3d7c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d840099b0 tx=0x7f3d84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.523+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d8c04e5a0 con 0x7f3d9c0cd6e0 2023-10-14T18:46:01.647 INFO:tasks.ceph.mds.c.smithi079.stderr:2023-10-14T18:46:01.647+0000 7f0cefd55700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:46:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.703+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d9c0b3d80 con 0x7f3d7c066f30 2023-10-14T18:46:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.712+0000 7f3d98ff9700 1 -- 172.21.15.79:0/3453632846 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269623 (secure 0 0 0) 0x7f3d8400bc50 con 0x7f3d7c066f30 2023-10-14T18:46:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 msgr2=0x7f3d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 0x7f3d7c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d840099b0 tx=0x7f3d84017000 comp rx=0 tx=0).stop 2023-10-14T18:46:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 msgr2=0x7f3d9c0b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00a400 tx=0x7f3d8c007910 comp rx=0 tx=0).stop 2023-10-14T18:46:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 shutdown_connections 2023-10-14T18:46:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d9c15dda0 0x7f3d9c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d9c0cd6e0 0x7f3d9c0b60c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 --2- 172.21.15.79:0/3453632846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d9c0cdab0 0x7f3d9c16dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.714+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 >> 172.21.15.79:0/3453632846 conn(0x7f3d9c067660 msgr2=0x7f3d9c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.715+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 shutdown_connections 2023-10-14T18:46:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.715+0000 7f3da18a9700 1 -- 172.21.15.79:0/3453632846 wait complete. 2023-10-14T18:46:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:46:01.727 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-10-14T18:46:00.345543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560343,"statfs":{"total":1600000000,"available":1597791247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.681770"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490475+0000","last_change":"2023-10-14T18:45:57.490475+0000","last_active":"2023-10-14T18:45:57.490475+0000","last_peered":"2023-10-14T18:45:57.490475+0000","last_clean":"2023-10-14T18:45:57.490475+0000","last_became_active":"2023-10-14T18:45:57.490256+0000","last_became_peered":"2023-10-14T18:45:57.490256+0000","last_unstale":"2023-10-14T18:45:57.490475+0000","last_undegraded":"2023-10-14T18:45:57.490475+0000","last_fullsized":"2023-10-14T18:45:57.490475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487345+0000","last_change":"2023-10-14T18:45:57.487291+0000","last_active":"2023-10-14T18:45:57.487345+0000","last_peered":"2023-10-14T18:45:57.487345+0000","last_clean":"2023-10-14T18:45:57.487345+0000","last_became_active":"2023-10-14T18:45:57.486675+0000","last_became_peered":"2023-10-14T18:45:57.486675+0000","last_unstale":"2023-10-14T18:45:57.487345+0000","last_undegraded":"2023-10-14T18:45:57.487345+0000","last_fullsized":"2023-10-14T18:45:57.487345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495379+0000","last_change":"2023-10-14T18:45:57.495245+0000","last_active":"2023-10-14T18:45:57.495379+0000","last_peered":"2023-10-14T18:45:57.495379+0000","last_clean":"2023-10-14T18:45:57.495379+0000","last_became_active":"2023-10-14T18:45:57.494181+0000","last_became_peered":"2023-10-14T18:45:57.494181+0000","last_unstale":"2023-10-14T18:45:57.495379+0000","last_undegraded":"2023-10-14T18:45:57.495379+0000","last_fullsized":"2023-10-14T18:45:57.495379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490238+0000","last_change":"2023-10-14T18:45:57.490189+0000","last_active":"2023-10-14T18:45:57.490238+0000","last_peered":"2023-10-14T18:45:57.490238+0000","last_clean":"2023-10-14T18:45:57.490238+0000","last_became_active":"2023-10-14T18:45:57.490016+0000","last_became_peered":"2023-10-14T18:45:57.490016+0000","last_unstale":"2023-10-14T18:45:57.490238+0000","last_undegraded":"2023-10-14T18:45:57.490238+0000","last_fullsized":"2023-10-14T18:45:57.490238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:53.291754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486823+0000","last_change":"2023-10-14T18:45:57.486823+0000","last_active":"2023-10-14T18:45:57.486823+0000","last_peered":"2023-10-14T18:45:57.486823+0000","last_clean":"2023-10-14T18:45:57.486823+0000","last_became_active":"2023-10-14T18:45:57.486608+0000","last_became_peered":"2023-10-14T18:45:57.486608+0000","last_unstale":"2023-10-14T18:45:57.486823+0000","last_undegraded":"2023-10-14T18:45:57.486823+0000","last_fullsized":"2023-10-14T18:45:57.486823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:40.023332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486921+0000","last_change":"2023-10-14T18:45:57.486792+0000","last_active":"2023-10-14T18:45:57.486921+0000","last_peered":"2023-10-14T18:45:57.486921+0000","last_clean":"2023-10-14T18:45:57.486921+0000","last_became_active":"2023-10-14T18:45:57.486573+0000","last_became_peered":"2023-10-14T18:45:57.486573+0000","last_unstale":"2023-10-14T18:45:57.486921+0000","last_undegraded":"2023-10-14T18:45:57.486921+0000","last_fullsized":"2023-10-14T18:45:57.486921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:23.318099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487461+0000","last_change":"2023-10-14T18:45:57.487367+0000","last_active":"2023-10-14T18:45:57.487461+0000","last_peered":"2023-10-14T18:45:57.487461+0000","last_clean":"2023-10-14T18:45:57.487461+0000","last_became_active":"2023-10-14T18:45:57.486820+0000","last_became_peered":"2023-10-14T18:45:57.486820+0000","last_unstale":"2023-10-14T18:45:57.487461+0000","last_undegraded":"2023-10-14T18:45:57.487461+0000","last_fullsized":"2023-10-14T18:45:57.487461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487118+0000","last_change":"2023-10-14T18:45:57.485493+0000","last_active":"2023-10-14T18:45:57.487118+0000","last_peered":"2023-10-14T18:45:57.487118+0000","last_clean":"2023-10-14T18:45:57.487118+0000","last_became_active":"2023-10-14T18:45:57.485227+0000","last_became_peered":"2023-10-14T18:45:57.485227+0000","last_unstale":"2023-10-14T18:45:57.487118+0000","last_undegraded":"2023-10-14T18:45:57.487118+0000","last_fullsized":"2023-10-14T18:45:57.487118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491018+0000","last_change":"2023-10-14T18:45:57.490942+0000","last_active":"2023-10-14T18:45:57.491018+0000","last_peered":"2023-10-14T18:45:57.491018+0000","last_clean":"2023-10-14T18:45:57.491018+0000","last_became_active":"2023-10-14T18:45:57.490508+0000","last_became_peered":"2023-10-14T18:45:57.490508+0000","last_unstale":"2023-10-14T18:45:57.491018+0000","last_undegraded":"2023-10-14T18:45:57.491018+0000","last_fullsized":"2023-10-14T18:45:57.491018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.483037+0000","last_change":"2023-10-14T18:45:57.482932+0000","last_active":"2023-10-14T18:45:57.483037+0000","last_peered":"2023-10-14T18:45:57.483037+0000","last_clean":"2023-10-14T18:45:57.483037+0000","last_became_active":"2023-10-14T18:45:57.482691+0000","last_became_peered":"2023-10-14T18:45:57.482691+0000","last_unstale":"2023-10-14T18:45:57.483037+0000","last_undegraded":"2023-10-14T18:45:57.483037+0000","last_fullsized":"2023-10-14T18:45:57.483037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:24.541678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487152+0000","last_change":"2023-10-14T18:45:57.486721+0000","last_active":"2023-10-14T18:45:57.487152+0000","last_peered":"2023-10-14T18:45:57.487152+0000","last_clean":"2023-10-14T18:45:57.487152+0000","last_became_active":"2023-10-14T18:45:57.484798+0000","last_became_peered":"2023-10-14T18:45:57.484798+0000","last_unstale":"2023-10-14T18:45:57.487152+0000","last_undegraded":"2023-10-14T18:45:57.487152+0000","last_fullsized":"2023-10-14T18:45:57.487152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:12.672358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495259+0000","last_change":"2023-10-14T18:45:57.495194+0000","last_active":"2023-10-14T18:45:57.495259+0000","last_peered":"2023-10-14T18:45:57.495259+0000","last_clean":"2023-10-14T18:45:57.495259+0000","last_became_active":"2023-10-14T18:45:57.494966+0000","last_became_peered":"2023-10-14T18:45:57.494966+0000","last_unstale":"2023-10-14T18:45:57.495259+0000","last_undegraded":"2023-10-14T18:45:57.495259+0000","last_fullsized":"2023-10-14T18:45:57.495259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:02.908535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486786+0000","last_change":"2023-10-14T18:45:57.486786+0000","last_active":"2023-10-14T18:45:57.486786+0000","last_peered":"2023-10-14T18:45:57.486786+0000","last_clean":"2023-10-14T18:45:57.486786+0000","last_became_active":"2023-10-14T18:45:57.486287+0000","last_became_peered":"2023-10-14T18:45:57.486287+0000","last_unstale":"2023-10-14T18:45:57.486786+0000","last_undegraded":"2023-10-14T18:45:57.486786+0000","last_fullsized":"2023-10-14T18:45:57.486786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:51.567659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490775+0000","last_change":"2023-10-14T18:45:57.490542+0000","last_active":"2023-10-14T18:45:57.490775+0000","last_peered":"2023-10-14T18:45:57.490775+0000","last_clean":"2023-10-14T18:45:57.490775+0000","last_became_active":"2023-10-14T18:45:57.490149+0000","last_became_peered":"2023-10-14T18:45:57.490149+0000","last_unstale":"2023-10-14T18:45:57.490775+0000","last_undegraded":"2023-10-14T18:45:57.490775+0000","last_fullsized":"2023-10-14T18:45:57.490775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486972+0000","last_change":"2023-10-14T18:45:57.486900+0000","last_active":"2023-10-14T18:45:57.486972+0000","last_peered":"2023-10-14T18:45:57.486972+0000","last_clean":"2023-10-14T18:45:57.486972+0000","last_became_active":"2023-10-14T18:45:57.486674+0000","last_became_peered":"2023-10-14T18:45:57.486674+0000","last_unstale":"2023-10-14T18:45:57.486972+0000","last_undegraded":"2023-10-14T18:45:57.486972+0000","last_fullsized":"2023-10-14T18:45:57.486972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487168+0000","last_change":"2023-10-14T18:45:57.487060+0000","last_active":"2023-10-14T18:45:57.487168+0000","last_peered":"2023-10-14T18:45:57.487168+0000","last_clean":"2023-10-14T18:45:57.487168+0000","last_became_active":"2023-10-14T18:45:57.486501+0000","last_became_peered":"2023-10-14T18:45:57.486501+0000","last_unstale":"2023-10-14T18:45:57.487168+0000","last_undegraded":"2023-10-14T18:45:57.487168+0000","last_fullsized":"2023-10-14T18:45:57.487168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:20.249429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487363+0000","last_change":"2023-10-14T18:45:57.487225+0000","last_active":"2023-10-14T18:45:57.487363+0000","last_peered":"2023-10-14T18:45:57.487363+0000","last_clean":"2023-10-14T18:45:57.487363+0000","last_became_active":"2023-10-14T18:45:57.486546+0000","last_became_peered":"2023-10-14T18:45:57.486546+0000","last_unstale":"2023-10-14T18:45:57.487363+0000","last_undegraded":"2023-10-14T18:45:57.487363+0000","last_fullsized":"2023-10-14T18:45:57.487363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.482733+0000","last_change":"2023-10-14T18:45:57.481878+0000","last_active":"2023-10-14T18:45:57.482733+0000","last_peered":"2023-10-14T18:45:57.482733+0000","last_clean":"2023-10-14T18:45:57.482733+0000","last_became_active":"2023-10-14T18:45:57.481671+0000","last_became_peered":"2023-10-14T18:45:57.481671+0000","last_unstale":"2023-10-14T18:45:57.482733+0000","last_undegraded":"2023-10-14T18:45:57.482733+0000","last_fullsized":"2023-10-14T18:45:57.482733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:20.030227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488966+0000","last_change":"2023-10-14T18:45:57.488909+0000","last_active":"2023-10-14T18:45:57.488966+0000","last_peered":"2023-10-14T18:45:57.488966+0000","last_clean":"2023-10-14T18:45:57.488966+0000","last_became_active":"2023-10-14T18:45:57.488183+0000","last_became_peered":"2023-10-14T18:45:57.488183+0000","last_unstale":"2023-10-14T18:45:57.488966+0000","last_undegraded":"2023-10-14T18:45:57.488966+0000","last_fullsized":"2023-10-14T18:45:57.488966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487859+0000","last_change":"2023-10-14T18:45:57.487859+0000","last_active":"2023-10-14T18:45:57.487859+0000","last_peered":"2023-10-14T18:45:57.487859+0000","last_clean":"2023-10-14T18:45:57.487859+0000","last_became_active":"2023-10-14T18:45:57.487647+0000","last_became_peered":"2023-10-14T18:45:57.487647+0000","last_unstale":"2023-10-14T18:45:57.487859+0000","last_undegraded":"2023-10-14T18:45:57.487859+0000","last_fullsized":"2023-10-14T18:45:57.487859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:03.606768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492658+0000","last_change":"2023-10-14T18:45:57.491630+0000","last_active":"2023-10-14T18:45:57.492658+0000","last_peered":"2023-10-14T18:45:57.492658+0000","last_clean":"2023-10-14T18:45:57.492658+0000","last_became_active":"2023-10-14T18:45:57.491315+0000","last_became_peered":"2023-10-14T18:45:57.491315+0000","last_unstale":"2023-10-14T18:45:57.492658+0000","last_undegraded":"2023-10-14T18:45:57.492658+0000","last_fullsized":"2023-10-14T18:45:57.492658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:46.162811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491001+0000","last_change":"2023-10-14T18:45:57.490858+0000","last_active":"2023-10-14T18:45:57.491001+0000","last_peered":"2023-10-14T18:45:57.491001+0000","last_clean":"2023-10-14T18:45:57.491001+0000","last_became_active":"2023-10-14T18:45:57.489432+0000","last_became_peered":"2023-10-14T18:45:57.489432+0000","last_unstale":"2023-10-14T18:45:57.491001+0000","last_undegraded":"2023-10-14T18:45:57.491001+0000","last_fullsized":"2023-10-14T18:45:57.491001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:51.296925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485609+0000","last_change":"2023-10-14T18:45:57.485609+0000","last_active":"2023-10-14T18:45:57.485609+0000","last_peered":"2023-10-14T18:45:57.485609+0000","last_clean":"2023-10-14T18:45:57.485609+0000","last_became_active":"2023-10-14T18:45:57.485388+0000","last_became_peered":"2023-10-14T18:45:57.485388+0000","last_unstale":"2023-10-14T18:45:57.485609+0000","last_undegraded":"2023-10-14T18:45:57.485609+0000","last_fullsized":"2023-10-14T18:45:57.485609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493194+0000","last_change":"2023-10-14T18:45:57.489666+0000","last_active":"2023-10-14T18:45:57.493194+0000","last_peered":"2023-10-14T18:45:57.493194+0000","last_clean":"2023-10-14T18:45:57.493194+0000","last_became_active":"2023-10-14T18:45:57.489274+0000","last_became_peered":"2023-10-14T18:45:57.489274+0000","last_unstale":"2023-10-14T18:45:57.493194+0000","last_undegraded":"2023-10-14T18:45:57.493194+0000","last_fullsized":"2023-10-14T18:45:57.493194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485227+0000","last_change":"2023-10-14T18:45:57.484256+0000","last_active":"2023-10-14T18:45:57.485227+0000","last_peered":"2023-10-14T18:45:57.485227+0000","last_clean":"2023-10-14T18:45:57.485227+0000","last_became_active":"2023-10-14T18:45:57.484008+0000","last_became_peered":"2023-10-14T18:45:57.484008+0000","last_unstale":"2023-10-14T18:45:57.485227+0000","last_undegraded":"2023-10-14T18:45:57.485227+0000","last_fullsized":"2023-10-14T18:45:57.485227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:46.162811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485749+0000","last_change":"2023-10-14T18:45:57.485693+0000","last_active":"2023-10-14T18:45:57.485749+0000","last_peered":"2023-10-14T18:45:57.485749+0000","last_clean":"2023-10-14T18:45:57.485749+0000","last_became_active":"2023-10-14T18:45:57.485482+0000","last_became_peered":"2023-10-14T18:45:57.485482+0000","last_unstale":"2023-10-14T18:45:57.485749+0000","last_undegraded":"2023-10-14T18:45:57.485749+0000","last_fullsized":"2023-10-14T18:45:57.485749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487925+0000","last_change":"2023-10-14T18:45:57.486240+0000","last_active":"2023-10-14T18:45:57.487925+0000","last_peered":"2023-10-14T18:45:57.487925+0000","last_clean":"2023-10-14T18:45:57.487925+0000","last_became_active":"2023-10-14T18:45:57.485916+0000","last_became_peered":"2023-10-14T18:45:57.485916+0000","last_unstale":"2023-10-14T18:45:57.487925+0000","last_undegraded":"2023-10-14T18:45:57.487925+0000","last_fullsized":"2023-10-14T18:45:57.487925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:08.049345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495730+0000","last_change":"2023-10-14T18:45:57.495629+0000","last_active":"2023-10-14T18:45:57.495730+0000","last_peered":"2023-10-14T18:45:57.495730+0000","last_clean":"2023-10-14T18:45:57.495730+0000","last_became_active":"2023-10-14T18:45:57.495014+0000","last_became_peered":"2023-10-14T18:45:57.495014+0000","last_unstale":"2023-10-14T18:45:57.495730+0000","last_undegraded":"2023-10-14T18:45:57.495730+0000","last_fullsized":"2023-10-14T18:45:57.495730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:20.030227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490950+0000","last_change":"2023-10-14T18:45:57.490752+0000","last_active":"2023-10-14T18:45:57.490950+0000","last_peered":"2023-10-14T18:45:57.490950+0000","last_clean":"2023-10-14T18:45:57.490950+0000","last_became_active":"2023-10-14T18:45:57.490153+0000","last_became_peered":"2023-10-14T18:45:57.490153+0000","last_unstale":"2023-10-14T18:45:57.490950+0000","last_undegraded":"2023-10-14T18:45:57.490950+0000","last_fullsized":"2023-10-14T18:45:57.490950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488414+0000","last_change":"2023-10-14T18:45:57.487950+0000","last_active":"2023-10-14T18:45:57.488414+0000","last_peered":"2023-10-14T18:45:57.488414+0000","last_clean":"2023-10-14T18:45:57.488414+0000","last_became_active":"2023-10-14T18:45:57.487286+0000","last_became_peered":"2023-10-14T18:45:57.487286+0000","last_unstale":"2023-10-14T18:45:57.488414+0000","last_undegraded":"2023-10-14T18:45:57.488414+0000","last_fullsized":"2023-10-14T18:45:57.488414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490973+0000","last_change":"2023-10-14T18:45:57.490973+0000","last_active":"2023-10-14T18:45:57.490973+0000","last_peered":"2023-10-14T18:45:57.490973+0000","last_clean":"2023-10-14T18:45:57.490973+0000","last_became_active":"2023-10-14T18:45:57.490758+0000","last_became_peered":"2023-10-14T18:45:57.490758+0000","last_unstale":"2023-10-14T18:45:57.490973+0000","last_undegraded":"2023-10-14T18:45:57.490973+0000","last_fullsized":"2023-10-14T18:45:57.490973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:47.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487190+0000","last_change":"2023-10-14T18:45:57.487090+0000","last_active":"2023-10-14T18:45:57.487190+0000","last_peered":"2023-10-14T18:45:57.487190+0000","last_clean":"2023-10-14T18:45:57.487190+0000","last_became_active":"2023-10-14T18:45:57.486266+0000","last_became_peered":"2023-10-14T18:45:57.486266+0000","last_unstale":"2023-10-14T18:45:57.487190+0000","last_undegraded":"2023-10-14T18:45:57.487190+0000","last_fullsized":"2023-10-14T18:45:57.487190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485421+0000","last_change":"2023-10-14T18:45:57.485421+0000","last_active":"2023-10-14T18:45:57.485421+0000","last_peered":"2023-10-14T18:45:57.485421+0000","last_clean":"2023-10-14T18:45:57.485421+0000","last_became_active":"2023-10-14T18:45:57.485225+0000","last_became_peered":"2023-10-14T18:45:57.485225+0000","last_unstale":"2023-10-14T18:45:57.485421+0000","last_undegraded":"2023-10-14T18:45:57.485421+0000","last_fullsized":"2023-10-14T18:45:57.485421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675308+0000","last_change":"2023-10-14T18:45:56.680077+0000","last_active":"2023-10-14T18:45:57.675308+0000","last_peered":"2023-10-14T18:45:57.675308+0000","last_clean":"2023-10-14T18:45:57.675308+0000","last_became_active":"2023-10-14T18:45:56.679822+0000","last_became_peered":"2023-10-14T18:45:56.679822+0000","last_unstale":"2023-10-14T18:45:57.675308+0000","last_undegraded":"2023-10-14T18:45:57.675308+0000","last_fullsized":"2023-10-14T18:45:57.675308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491843+0000","last_change":"2023-10-14T18:45:57.491843+0000","last_active":"2023-10-14T18:45:57.491843+0000","last_peered":"2023-10-14T18:45:57.491843+0000","last_clean":"2023-10-14T18:45:57.491843+0000","last_became_active":"2023-10-14T18:45:57.491603+0000","last_became_peered":"2023-10-14T18:45:57.491603+0000","last_unstale":"2023-10-14T18:45:57.491843+0000","last_undegraded":"2023-10-14T18:45:57.491843+0000","last_fullsized":"2023-10-14T18:45:57.491843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.483263+0000","last_change":"2023-10-14T18:45:56.674659+0000","last_active":"2023-10-14T18:45:57.483263+0000","last_peered":"2023-10-14T18:45:57.483263+0000","last_clean":"2023-10-14T18:45:57.483263+0000","last_became_active":"2023-10-14T18:45:56.674449+0000","last_became_peered":"2023-10-14T18:45:56.674449+0000","last_unstale":"2023-10-14T18:45:57.483263+0000","last_undegraded":"2023-10-14T18:45:57.483263+0000","last_fullsized":"2023-10-14T18:45:57.483263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:41.109082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490365+0000","last_change":"2023-10-14T18:45:57.489541+0000","last_active":"2023-10-14T18:45:57.490365+0000","last_peered":"2023-10-14T18:45:57.490365+0000","last_clean":"2023-10-14T18:45:57.490365+0000","last_became_active":"2023-10-14T18:45:57.489212+0000","last_became_peered":"2023-10-14T18:45:57.489212+0000","last_unstale":"2023-10-14T18:45:57.490365+0000","last_undegraded":"2023-10-14T18:45:57.490365+0000","last_fullsized":"2023-10-14T18:45:57.490365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:47.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.677054+0000","last_change":"2023-10-14T18:45:56.673638+0000","last_active":"2023-10-14T18:45:57.677054+0000","last_peered":"2023-10-14T18:45:57.677054+0000","last_clean":"2023-10-14T18:45:57.677054+0000","last_became_active":"2023-10-14T18:45:56.673429+0000","last_became_peered":"2023-10-14T18:45:56.673429+0000","last_unstale":"2023-10-14T18:45:57.677054+0000","last_undegraded":"2023-10-14T18:45:57.677054+0000","last_fullsized":"2023-10-14T18:45:57.677054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:52.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493994+0000","last_change":"2023-10-14T18:45:57.493951+0000","last_active":"2023-10-14T18:45:57.493994+0000","last_peered":"2023-10-14T18:45:57.493994+0000","last_clean":"2023-10-14T18:45:57.493994+0000","last_became_active":"2023-10-14T18:45:57.493793+0000","last_became_peered":"2023-10-14T18:45:57.493793+0000","last_unstale":"2023-10-14T18:45:57.493994+0000","last_undegraded":"2023-10-14T18:45:57.493994+0000","last_fullsized":"2023-10-14T18:45:57.493994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.678130+0000","last_change":"2023-10-14T18:45:56.676478+0000","last_active":"2023-10-14T18:45:57.678130+0000","last_peered":"2023-10-14T18:45:57.678130+0000","last_clean":"2023-10-14T18:45:57.678130+0000","last_became_active":"2023-10-14T18:45:56.676043+0000","last_became_peered":"2023-10-14T18:45:56.676043+0000","last_unstale":"2023-10-14T18:45:57.678130+0000","last_undegraded":"2023-10-14T18:45:57.678130+0000","last_fullsized":"2023-10-14T18:45:57.678130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:40.638097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.494508+0000","last_change":"2023-10-14T18:45:57.494445+0000","last_active":"2023-10-14T18:45:57.494508+0000","last_peered":"2023-10-14T18:45:57.494508+0000","last_clean":"2023-10-14T18:45:57.494508+0000","last_became_active":"2023-10-14T18:45:57.494084+0000","last_became_peered":"2023-10-14T18:45:57.494084+0000","last_unstale":"2023-10-14T18:45:57.494508+0000","last_undegraded":"2023-10-14T18:45:57.494508+0000","last_fullsized":"2023-10-14T18:45:57.494508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675933+0000","last_change":"2023-10-14T18:45:56.678687+0000","last_active":"2023-10-14T18:45:57.675933+0000","last_peered":"2023-10-14T18:45:57.675933+0000","last_clean":"2023-10-14T18:45:57.675933+0000","last_became_active":"2023-10-14T18:45:56.678424+0000","last_became_peered":"2023-10-14T18:45:56.678424+0000","last_unstale":"2023-10-14T18:45:57.675933+0000","last_undegraded":"2023-10-14T18:45:57.675933+0000","last_fullsized":"2023-10-14T18:45:57.675933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:54.518995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493251+0000","last_change":"2023-10-14T18:45:57.491207+0000","last_active":"2023-10-14T18:45:57.493251+0000","last_peered":"2023-10-14T18:45:57.493251+0000","last_clean":"2023-10-14T18:45:57.493251+0000","last_became_active":"2023-10-14T18:45:57.490733+0000","last_became_peered":"2023-10-14T18:45:57.490733+0000","last_unstale":"2023-10-14T18:45:57.493251+0000","last_undegraded":"2023-10-14T18:45:57.493251+0000","last_fullsized":"2023-10-14T18:45:57.493251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676137+0000","last_change":"2023-10-14T18:45:56.678201+0000","last_active":"2023-10-14T18:45:57.676137+0000","last_peered":"2023-10-14T18:45:57.676137+0000","last_clean":"2023-10-14T18:45:57.676137+0000","last_became_active":"2023-10-14T18:45:56.677985+0000","last_became_peered":"2023-10-14T18:45:56.677985+0000","last_unstale":"2023-10-14T18:45:57.676137+0000","last_undegraded":"2023-10-14T18:45:57.676137+0000","last_fullsized":"2023-10-14T18:45:57.676137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:19.064308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493901+0000","last_change":"2023-10-14T18:45:57.493835+0000","last_active":"2023-10-14T18:45:57.493901+0000","last_peered":"2023-10-14T18:45:57.493901+0000","last_clean":"2023-10-14T18:45:57.493901+0000","last_became_active":"2023-10-14T18:45:57.493602+0000","last_became_peered":"2023-10-14T18:45:57.493602+0000","last_unstale":"2023-10-14T18:45:57.493901+0000","last_undegraded":"2023-10-14T18:45:57.493901+0000","last_fullsized":"2023-10-14T18:45:57.493901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:24.541678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481449+0000","last_change":"2023-10-14T18:45:56.674279+0000","last_active":"2023-10-14T18:45:57.481449+0000","last_peered":"2023-10-14T18:45:57.481449+0000","last_clean":"2023-10-14T18:45:57.481449+0000","last_became_active":"2023-10-14T18:45:56.673151+0000","last_became_peered":"2023-10-14T18:45:56.673151+0000","last_unstale":"2023-10-14T18:45:57.481449+0000","last_undegraded":"2023-10-14T18:45:57.481449+0000","last_fullsized":"2023-10-14T18:45:57.481449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:23.825956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489140+0000","last_change":"2023-10-14T18:45:57.489099+0000","last_active":"2023-10-14T18:45:57.489140+0000","last_peered":"2023-10-14T18:45:57.489140+0000","last_clean":"2023-10-14T18:45:57.489140+0000","last_became_active":"2023-10-14T18:45:57.488632+0000","last_became_peered":"2023-10-14T18:45:57.488632+0000","last_unstale":"2023-10-14T18:45:57.489140+0000","last_undegraded":"2023-10-14T18:45:57.489140+0000","last_fullsized":"2023-10-14T18:45:57.489140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:12.672358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492300+0000","last_change":"2023-10-14T18:45:56.680637+0000","last_active":"2023-10-14T18:45:57.492300+0000","last_peered":"2023-10-14T18:45:57.492300+0000","last_clean":"2023-10-14T18:45:57.492300+0000","last_became_active":"2023-10-14T18:45:56.679994+0000","last_became_peered":"2023-10-14T18:45:56.679994+0000","last_unstale":"2023-10-14T18:45:57.492300+0000","last_undegraded":"2023-10-14T18:45:57.492300+0000","last_fullsized":"2023-10-14T18:45:57.492300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493219+0000","last_change":"2023-10-14T18:45:57.490943+0000","last_active":"2023-10-14T18:45:57.493219+0000","last_peered":"2023-10-14T18:45:57.493219+0000","last_clean":"2023-10-14T18:45:57.493219+0000","last_became_active":"2023-10-14T18:45:57.490161+0000","last_became_peered":"2023-10-14T18:45:57.490161+0000","last_unstale":"2023-10-14T18:45:57.493219+0000","last_undegraded":"2023-10-14T18:45:57.493219+0000","last_fullsized":"2023-10-14T18:45:57.493219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481918+0000","last_change":"2023-10-14T18:45:56.674702+0000","last_active":"2023-10-14T18:45:57.481918+0000","last_peered":"2023-10-14T18:45:57.481918+0000","last_clean":"2023-10-14T18:45:57.481918+0000","last_became_active":"2023-10-14T18:45:56.674475+0000","last_became_peered":"2023-10-14T18:45:56.674475+0000","last_unstale":"2023-10-14T18:45:57.481918+0000","last_undegraded":"2023-10-14T18:45:57.481918+0000","last_fullsized":"2023-10-14T18:45:57.481918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:00.826568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488709+0000","last_change":"2023-10-14T18:45:57.488625+0000","last_active":"2023-10-14T18:45:57.488709+0000","last_peered":"2023-10-14T18:45:57.488709+0000","last_clean":"2023-10-14T18:45:57.488709+0000","last_became_active":"2023-10-14T18:45:57.488397+0000","last_became_peered":"2023-10-14T18:45:57.488397+0000","last_unstale":"2023-10-14T18:45:57.488709+0000","last_undegraded":"2023-10-14T18:45:57.488709+0000","last_fullsized":"2023-10-14T18:45:57.488709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.672373+0000","last_change":"2023-10-14T18:45:56.672312+0000","last_active":"2023-10-14T18:45:56.672373+0000","last_peered":"2023-10-14T18:45:56.672373+0000","last_clean":"2023-10-14T18:45:56.672373+0000","last_became_active":"2023-10-14T18:45:56.672089+0000","last_became_peered":"2023-10-14T18:45:56.672089+0000","last_unstale":"2023-10-14T18:45:56.672373+0000","last_undegraded":"2023-10-14T18:45:56.672373+0000","last_fullsized":"2023-10-14T18:45:56.672373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:38.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484903+0000","last_change":"2023-10-14T18:45:57.484840+0000","last_active":"2023-10-14T18:45:57.484903+0000","last_peered":"2023-10-14T18:45:57.484903+0000","last_clean":"2023-10-14T18:45:57.484903+0000","last_became_active":"2023-10-14T18:45:57.484633+0000","last_became_peered":"2023-10-14T18:45:57.484633+0000","last_unstale":"2023-10-14T18:45:57.484903+0000","last_undegraded":"2023-10-14T18:45:57.484903+0000","last_fullsized":"2023-10-14T18:45:57.484903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:02.908535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676081+0000","last_change":"2023-10-14T18:45:56.682283+0000","last_active":"2023-10-14T18:45:57.676081+0000","last_peered":"2023-10-14T18:45:57.676081+0000","last_clean":"2023-10-14T18:45:57.676081+0000","last_became_active":"2023-10-14T18:45:56.681904+0000","last_became_peered":"2023-10-14T18:45:56.681904+0000","last_unstale":"2023-10-14T18:45:57.676081+0000","last_undegraded":"2023-10-14T18:45:57.676081+0000","last_fullsized":"2023-10-14T18:45:57.676081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:00.826568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495714+0000","last_change":"2023-10-14T18:45:57.495418+0000","last_active":"2023-10-14T18:45:57.495714+0000","last_peered":"2023-10-14T18:45:57.495714+0000","last_clean":"2023-10-14T18:45:57.495714+0000","last_became_active":"2023-10-14T18:45:57.494472+0000","last_became_peered":"2023-10-14T18:45:57.494472+0000","last_unstale":"2023-10-14T18:45:57.495714+0000","last_undegraded":"2023-10-14T18:45:57.495714+0000","last_fullsized":"2023-10-14T18:45:57.495714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.678224+0000","last_change":"2023-10-14T18:45:56.675003+0000","last_active":"2023-10-14T18:45:57.678224+0000","last_peered":"2023-10-14T18:45:57.678224+0000","last_clean":"2023-10-14T18:45:57.678224+0000","last_became_active":"2023-10-14T18:45:56.674490+0000","last_became_peered":"2023-10-14T18:45:56.674490+0000","last_unstale":"2023-10-14T18:45:57.678224+0000","last_undegraded":"2023-10-14T18:45:57.678224+0000","last_fullsized":"2023-10-14T18:45:57.678224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:41.109082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487941+0000","last_change":"2023-10-14T18:45:57.486332+0000","last_active":"2023-10-14T18:45:57.487941+0000","last_peered":"2023-10-14T18:45:57.487941+0000","last_clean":"2023-10-14T18:45:57.487941+0000","last_became_active":"2023-10-14T18:45:57.486098+0000","last_became_peered":"2023-10-14T18:45:57.486098+0000","last_unstale":"2023-10-14T18:45:57.487941+0000","last_undegraded":"2023-10-14T18:45:57.487941+0000","last_fullsized":"2023-10-14T18:45:57.487941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:20.249429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676440+0000","last_change":"2023-10-14T18:45:56.680491+0000","last_active":"2023-10-14T18:45:57.676440+0000","last_peered":"2023-10-14T18:45:57.676440+0000","last_clean":"2023-10-14T18:45:57.676440+0000","last_became_active":"2023-10-14T18:45:56.679694+0000","last_became_peered":"2023-10-14T18:45:56.679694+0000","last_unstale":"2023-10-14T18:45:57.676440+0000","last_undegraded":"2023-10-14T18:45:57.676440+0000","last_fullsized":"2023-10-14T18:45:57.676440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:50.560183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486889+0000","last_change":"2023-10-14T18:45:57.486414+0000","last_active":"2023-10-14T18:45:57.486889+0000","last_peered":"2023-10-14T18:45:57.486889+0000","last_clean":"2023-10-14T18:45:57.486889+0000","last_became_active":"2023-10-14T18:45:57.486173+0000","last_became_peered":"2023-10-14T18:45:57.486173+0000","last_unstale":"2023-10-14T18:45:57.486889+0000","last_undegraded":"2023-10-14T18:45:57.486889+0000","last_fullsized":"2023-10-14T18:45:57.486889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480141+0000","last_change":"2023-10-14T18:45:56.680104+0000","last_active":"2023-10-14T18:45:57.480141+0000","last_peered":"2023-10-14T18:45:57.480141+0000","last_clean":"2023-10-14T18:45:57.480141+0000","last_became_active":"2023-10-14T18:45:56.679782+0000","last_became_peered":"2023-10-14T18:45:56.679782+0000","last_unstale":"2023-10-14T18:45:57.480141+0000","last_undegraded":"2023-10-14T18:45:57.480141+0000","last_fullsized":"2023-10-14T18:45:57.480141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:42.703342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.494377+0000","last_change":"2023-10-14T18:45:57.494308+0000","last_active":"2023-10-14T18:45:57.494377+0000","last_peered":"2023-10-14T18:45:57.494377+0000","last_clean":"2023-10-14T18:45:57.494377+0000","last_became_active":"2023-10-14T18:45:57.493793+0000","last_became_peered":"2023-10-14T18:45:57.493793+0000","last_unstale":"2023-10-14T18:45:57.494377+0000","last_undegraded":"2023-10-14T18:45:57.494377+0000","last_fullsized":"2023-10-14T18:45:57.494377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480846+0000","last_change":"2023-10-14T18:45:56.676395+0000","last_active":"2023-10-14T18:45:57.480846+0000","last_peered":"2023-10-14T18:45:57.480846+0000","last_clean":"2023-10-14T18:45:57.480846+0000","last_became_active":"2023-10-14T18:45:56.676159+0000","last_became_peered":"2023-10-14T18:45:56.676159+0000","last_unstale":"2023-10-14T18:45:57.480846+0000","last_undegraded":"2023-10-14T18:45:57.480846+0000","last_fullsized":"2023-10-14T18:45:57.480846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:47.683953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492084+0000","last_change":"2023-10-14T18:45:57.492084+0000","last_active":"2023-10-14T18:45:57.492084+0000","last_peered":"2023-10-14T18:45:57.492084+0000","last_clean":"2023-10-14T18:45:57.492084+0000","last_became_active":"2023-10-14T18:45:57.491859+0000","last_became_peered":"2023-10-14T18:45:57.491859+0000","last_unstale":"2023-10-14T18:45:57.492084+0000","last_undegraded":"2023-10-14T18:45:57.492084+0000","last_fullsized":"2023-10-14T18:45:57.492084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.677500+0000","last_change":"2023-10-14T18:45:56.676078+0000","last_active":"2023-10-14T18:45:57.677500+0000","last_peered":"2023-10-14T18:45:57.677500+0000","last_clean":"2023-10-14T18:45:57.677500+0000","last_became_active":"2023-10-14T18:45:56.675663+0000","last_became_peered":"2023-10-14T18:45:56.675663+0000","last_unstale":"2023-10-14T18:45:57.677500+0000","last_undegraded":"2023-10-14T18:45:57.677500+0000","last_fullsized":"2023-10-14T18:45:57.677500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495761+0000","last_change":"2023-10-14T18:45:57.495701+0000","last_active":"2023-10-14T18:45:57.495761+0000","last_peered":"2023-10-14T18:45:57.495761+0000","last_clean":"2023-10-14T18:45:57.495761+0000","last_became_active":"2023-10-14T18:45:57.495445+0000","last_became_peered":"2023-10-14T18:45:57.495445+0000","last_unstale":"2023-10-14T18:45:57.495761+0000","last_undegraded":"2023-10-14T18:45:57.495761+0000","last_fullsized":"2023-10-14T18:45:57.495761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676515+0000","last_change":"2023-10-14T18:45:56.677585+0000","last_active":"2023-10-14T18:45:57.676515+0000","last_peered":"2023-10-14T18:45:57.676515+0000","last_clean":"2023-10-14T18:45:57.676515+0000","last_became_active":"2023-10-14T18:45:56.677322+0000","last_became_peered":"2023-10-14T18:45:56.677322+0000","last_unstale":"2023-10-14T18:45:57.676515+0000","last_undegraded":"2023-10-14T18:45:57.676515+0000","last_fullsized":"2023-10-14T18:45:57.676515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493266+0000","last_change":"2023-10-14T18:45:57.492163+0000","last_active":"2023-10-14T18:45:57.493266+0000","last_peered":"2023-10-14T18:45:57.493266+0000","last_clean":"2023-10-14T18:45:57.493266+0000","last_became_active":"2023-10-14T18:45:57.491939+0000","last_became_peered":"2023-10-14T18:45:57.491939+0000","last_unstale":"2023-10-14T18:45:57.493266+0000","last_undegraded":"2023-10-14T18:45:57.493266+0000","last_fullsized":"2023-10-14T18:45:57.493266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675734+0000","last_change":"2023-10-14T18:45:56.677084+0000","last_active":"2023-10-14T18:45:57.675734+0000","last_peered":"2023-10-14T18:45:57.675734+0000","last_clean":"2023-10-14T18:45:57.675734+0000","last_became_active":"2023-10-14T18:45:56.676417+0000","last_became_peered":"2023-10-14T18:45:56.676417+0000","last_unstale":"2023-10-14T18:45:57.675734+0000","last_undegraded":"2023-10-14T18:45:57.675734+0000","last_fullsized":"2023-10-14T18:45:57.675734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:52.275868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487908+0000","last_change":"2023-10-14T18:45:57.486120+0000","last_active":"2023-10-14T18:45:57.487908+0000","last_peered":"2023-10-14T18:45:57.487908+0000","last_clean":"2023-10-14T18:45:57.487908+0000","last_became_active":"2023-10-14T18:45:57.485724+0000","last_became_peered":"2023-10-14T18:45:57.485724+0000","last_unstale":"2023-10-14T18:45:57.487908+0000","last_undegraded":"2023-10-14T18:45:57.487908+0000","last_fullsized":"2023-10-14T18:45:57.487908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:52.956123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674942+0000","last_change":"2023-10-14T18:45:56.677392+0000","last_active":"2023-10-14T18:45:57.674942+0000","last_peered":"2023-10-14T18:45:57.674942+0000","last_clean":"2023-10-14T18:45:57.674942+0000","last_became_active":"2023-10-14T18:45:56.677153+0000","last_became_peered":"2023-10-14T18:45:56.677153+0000","last_unstale":"2023-10-14T18:45:57.674942+0000","last_undegraded":"2023-10-14T18:45:57.674942+0000","last_fullsized":"2023-10-14T18:45:57.674942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:15.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489513+0000","last_change":"2023-10-14T18:45:57.489513+0000","last_active":"2023-10-14T18:45:57.489513+0000","last_peered":"2023-10-14T18:45:57.489513+0000","last_clean":"2023-10-14T18:45:57.489513+0000","last_became_active":"2023-10-14T18:45:57.489304+0000","last_became_peered":"2023-10-14T18:45:57.489304+0000","last_unstale":"2023-10-14T18:45:57.489513+0000","last_undegraded":"2023-10-14T18:45:57.489513+0000","last_fullsized":"2023-10-14T18:45:57.489513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:55.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484882+0000","last_change":"2023-10-14T18:45:56.677395+0000","last_active":"2023-10-14T18:45:57.484882+0000","last_peered":"2023-10-14T18:45:57.484882+0000","last_clean":"2023-10-14T18:45:57.484882+0000","last_became_active":"2023-10-14T18:45:56.677045+0000","last_became_peered":"2023-10-14T18:45:56.677045+0000","last_unstale":"2023-10-14T18:45:57.484882+0000","last_undegraded":"2023-10-14T18:45:57.484882+0000","last_fullsized":"2023-10-14T18:45:57.484882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:03.660262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491596+0000","last_change":"2023-10-14T18:45:57.491596+0000","last_active":"2023-10-14T18:45:57.491596+0000","last_peered":"2023-10-14T18:45:57.491596+0000","last_clean":"2023-10-14T18:45:57.491596+0000","last_became_active":"2023-10-14T18:45:57.491311+0000","last_became_peered":"2023-10-14T18:45:57.491311+0000","last_unstale":"2023-10-14T18:45:57.491596+0000","last_undegraded":"2023-10-14T18:45:57.491596+0000","last_fullsized":"2023-10-14T18:45:57.491596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:52.872089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674841+0000","last_change":"2023-10-14T18:45:56.676435+0000","last_active":"2023-10-14T18:45:57.674841+0000","last_peered":"2023-10-14T18:45:57.674841+0000","last_clean":"2023-10-14T18:45:57.674841+0000","last_became_active":"2023-10-14T18:45:56.676097+0000","last_became_peered":"2023-10-14T18:45:56.676097+0000","last_unstale":"2023-10-14T18:45:57.674841+0000","last_undegraded":"2023-10-14T18:45:57.674841+0000","last_fullsized":"2023-10-14T18:45:57.674841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486920+0000","last_change":"2023-10-14T18:45:57.486920+0000","last_active":"2023-10-14T18:45:57.486920+0000","last_peered":"2023-10-14T18:45:57.486920+0000","last_clean":"2023-10-14T18:45:57.486920+0000","last_became_active":"2023-10-14T18:45:57.486578+0000","last_became_peered":"2023-10-14T18:45:57.486578+0000","last_unstale":"2023-10-14T18:45:57.486920+0000","last_undegraded":"2023-10-14T18:45:57.486920+0000","last_fullsized":"2023-10-14T18:45:57.486920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:53.283344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.676216+0000","last_change":"2023-10-14T18:45:56.676018+0000","last_active":"2023-10-14T18:45:56.676216+0000","last_peered":"2023-10-14T18:45:56.676216+0000","last_clean":"2023-10-14T18:45:56.676216+0000","last_became_active":"2023-10-14T18:45:56.675784+0000","last_became_peered":"2023-10-14T18:45:56.675784+0000","last_unstale":"2023-10-14T18:45:56.676216+0000","last_undegraded":"2023-10-14T18:45:56.676216+0000","last_fullsized":"2023-10-14T18:45:56.676216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:38.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484909+0000","last_change":"2023-10-14T18:45:57.484909+0000","last_active":"2023-10-14T18:45:57.484909+0000","last_peered":"2023-10-14T18:45:57.484909+0000","last_clean":"2023-10-14T18:45:57.484909+0000","last_became_active":"2023-10-14T18:45:57.484689+0000","last_became_peered":"2023-10-14T18:45:57.484689+0000","last_unstale":"2023-10-14T18:45:57.484909+0000","last_undegraded":"2023-10-14T18:45:57.484909+0000","last_fullsized":"2023-10-14T18:45:57.484909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:20.071784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492581+0000","last_change":"2023-10-14T18:45:56.676927+0000","last_active":"2023-10-14T18:45:57.492581+0000","last_peered":"2023-10-14T18:45:57.492581+0000","last_clean":"2023-10-14T18:45:57.492581+0000","last_became_active":"2023-10-14T18:45:56.676162+0000","last_became_peered":"2023-10-14T18:45:56.676162+0000","last_unstale":"2023-10-14T18:45:57.492581+0000","last_undegraded":"2023-10-14T18:45:57.492581+0000","last_fullsized":"2023-10-14T18:45:57.492581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:51.864613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488430+0000","last_change":"2023-10-14T18:45:57.488090+0000","last_active":"2023-10-14T18:45:57.488430+0000","last_peered":"2023-10-14T18:45:57.488430+0000","last_clean":"2023-10-14T18:45:57.488430+0000","last_became_active":"2023-10-14T18:45:57.487587+0000","last_became_peered":"2023-10-14T18:45:57.487587+0000","last_unstale":"2023-10-14T18:45:57.488430+0000","last_undegraded":"2023-10-14T18:45:57.488430+0000","last_fullsized":"2023-10-14T18:45:57.488430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484036+0000","last_change":"2023-10-14T18:45:56.680135+0000","last_active":"2023-10-14T18:45:57.484036+0000","last_peered":"2023-10-14T18:45:57.484036+0000","last_clean":"2023-10-14T18:45:57.484036+0000","last_became_active":"2023-10-14T18:45:56.679897+0000","last_became_peered":"2023-10-14T18:45:56.679897+0000","last_unstale":"2023-10-14T18:45:57.484036+0000","last_undegraded":"2023-10-14T18:45:57.484036+0000","last_fullsized":"2023-10-14T18:45:57.484036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.496002+0000","last_change":"2023-10-14T18:45:57.496002+0000","last_active":"2023-10-14T18:45:57.496002+0000","last_peered":"2023-10-14T18:45:57.496002+0000","last_clean":"2023-10-14T18:45:57.496002+0000","last_became_active":"2023-10-14T18:45:57.495818+0000","last_became_peered":"2023-10-14T18:45:57.495818+0000","last_unstale":"2023-10-14T18:45:57.496002+0000","last_undegraded":"2023-10-14T18:45:57.496002+0000","last_fullsized":"2023-10-14T18:45:57.496002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:39.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674124+0000","last_change":"2023-10-14T18:45:56.680395+0000","last_active":"2023-10-14T18:45:57.674124+0000","last_peered":"2023-10-14T18:45:57.674124+0000","last_clean":"2023-10-14T18:45:57.674124+0000","last_became_active":"2023-10-14T18:45:56.680067+0000","last_became_peered":"2023-10-14T18:45:56.680067+0000","last_unstale":"2023-10-14T18:45:57.674124+0000","last_undegraded":"2023-10-14T18:45:57.674124+0000","last_fullsized":"2023-10-14T18:45:57.674124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493235+0000","last_change":"2023-10-14T18:45:57.491070+0000","last_active":"2023-10-14T18:45:57.493235+0000","last_peered":"2023-10-14T18:45:57.493235+0000","last_clean":"2023-10-14T18:45:57.493235+0000","last_became_active":"2023-10-14T18:45:57.490456+0000","last_became_peered":"2023-10-14T18:45:57.490456+0000","last_unstale":"2023-10-14T18:45:57.493235+0000","last_undegraded":"2023-10-14T18:45:57.493235+0000","last_fullsized":"2023-10-14T18:45:57.493235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.676524+0000","last_change":"2023-10-14T18:45:56.676308+0000","last_active":"2023-10-14T18:45:56.676524+0000","last_peered":"2023-10-14T18:45:56.676524+0000","last_clean":"2023-10-14T18:45:56.676524+0000","last_became_active":"2023-10-14T18:45:56.675783+0000","last_became_peered":"2023-10-14T18:45:56.675783+0000","last_unstale":"2023-10-14T18:45:56.676524+0000","last_undegraded":"2023-10-14T18:45:56.676524+0000","last_fullsized":"2023-10-14T18:45:56.676524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:42.703342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490923+0000","last_change":"2023-10-14T18:45:57.490923+0000","last_active":"2023-10-14T18:45:57.490923+0000","last_peered":"2023-10-14T18:45:57.490923+0000","last_clean":"2023-10-14T18:45:57.490923+0000","last_became_active":"2023-10-14T18:45:57.490744+0000","last_became_peered":"2023-10-14T18:45:57.490744+0000","last_unstale":"2023-10-14T18:45:57.490923+0000","last_undegraded":"2023-10-14T18:45:57.490923+0000","last_fullsized":"2023-10-14T18:45:57.490923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480661+0000","last_change":"2023-10-14T18:45:56.677776+0000","last_active":"2023-10-14T18:45:57.480661+0000","last_peered":"2023-10-14T18:45:57.480661+0000","last_clean":"2023-10-14T18:45:57.480661+0000","last_became_active":"2023-10-14T18:45:56.677557+0000","last_became_peered":"2023-10-14T18:45:56.677557+0000","last_unstale":"2023-10-14T18:45:57.480661+0000","last_undegraded":"2023-10-14T18:45:57.480661+0000","last_fullsized":"2023-10-14T18:45:57.480661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:02.599292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490315+0000","last_change":"2023-10-14T18:45:57.490315+0000","last_active":"2023-10-14T18:45:57.490315+0000","last_peered":"2023-10-14T18:45:57.490315+0000","last_clean":"2023-10-14T18:45:57.490315+0000","last_became_active":"2023-10-14T18:45:57.490067+0000","last_became_peered":"2023-10-14T18:45:57.490067+0000","last_unstale":"2023-10-14T18:45:57.490315+0000","last_undegraded":"2023-10-14T18:45:57.490315+0000","last_fullsized":"2023-10-14T18:45:57.490315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.680993+0000","last_change":"2023-10-14T18:45:56.680950+0000","last_active":"2023-10-14T18:45:56.680993+0000","last_peered":"2023-10-14T18:45:56.680993+0000","last_clean":"2023-10-14T18:45:56.680993+0000","last_became_active":"2023-10-14T18:45:56.680794+0000","last_became_peered":"2023-10-14T18:45:56.680794+0000","last_unstale":"2023-10-14T18:45:56.680993+0000","last_undegraded":"2023-10-14T18:45:56.680993+0000","last_fullsized":"2023-10-14T18:45:56.680993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:31:27.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491960+0000","last_change":"2023-10-14T18:45:57.491960+0000","last_active":"2023-10-14T18:45:57.491960+0000","last_peered":"2023-10-14T18:45:57.491960+0000","last_clean":"2023-10-14T18:45:57.491960+0000","last_became_active":"2023-10-14T18:45:57.491782+0000","last_became_peered":"2023-10-14T18:45:57.491782+0000","last_unstale":"2023-10-14T18:45:57.491960+0000","last_undegraded":"2023-10-14T18:45:57.491960+0000","last_fullsized":"2023-10-14T18:45:57.491960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:51.296925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480504+0000","last_change":"2023-10-14T18:45:56.680301+0000","last_active":"2023-10-14T18:45:57.480504+0000","last_peered":"2023-10-14T18:45:57.480504+0000","last_clean":"2023-10-14T18:45:57.480504+0000","last_became_active":"2023-10-14T18:45:56.679766+0000","last_became_peered":"2023-10-14T18:45:56.679766+0000","last_unstale":"2023-10-14T18:45:57.480504+0000","last_undegraded":"2023-10-14T18:45:57.480504+0000","last_fullsized":"2023-10-14T18:45:57.480504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:31:27.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490803+0000","last_change":"2023-10-14T18:45:57.490676+0000","last_active":"2023-10-14T18:45:57.490803+0000","last_peered":"2023-10-14T18:45:57.490803+0000","last_clean":"2023-10-14T18:45:57.490803+0000","last_became_active":"2023-10-14T18:45:57.490392+0000","last_became_peered":"2023-10-14T18:45:57.490392+0000","last_unstale":"2023-10-14T18:45:57.490803+0000","last_undegraded":"2023-10-14T18:45:57.490803+0000","last_fullsized":"2023-10-14T18:45:57.490803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489986+0000","last_change":"2023-10-14T18:45:56.679431+0000","last_active":"2023-10-14T18:45:57.489986+0000","last_peered":"2023-10-14T18:45:57.489986+0000","last_clean":"2023-10-14T18:45:57.489986+0000","last_became_active":"2023-10-14T18:45:56.679169+0000","last_became_peered":"2023-10-14T18:45:56.679169+0000","last_unstale":"2023-10-14T18:45:57.489986+0000","last_undegraded":"2023-10-14T18:45:57.489986+0000","last_fullsized":"2023-10-14T18:45:57.489986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:09.897943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492681+0000","last_change":"2023-10-14T18:45:57.491966+0000","last_active":"2023-10-14T18:45:57.492681+0000","last_peered":"2023-10-14T18:45:57.492681+0000","last_clean":"2023-10-14T18:45:57.492681+0000","last_became_active":"2023-10-14T18:45:57.491425+0000","last_became_peered":"2023-10-14T18:45:57.491425+0000","last_unstale":"2023-10-14T18:45:57.492681+0000","last_undegraded":"2023-10-14T18:45:57.492681+0000","last_fullsized":"2023-10-14T18:45:57.492681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484345+0000","last_change":"2023-10-14T18:45:56.675136+0000","last_active":"2023-10-14T18:45:57.484345+0000","last_peered":"2023-10-14T18:45:57.484345+0000","last_clean":"2023-10-14T18:45:57.484345+0000","last_became_active":"2023-10-14T18:45:56.674783+0000","last_became_peered":"2023-10-14T18:45:56.674783+0000","last_unstale":"2023-10-14T18:45:57.484345+0000","last_undegraded":"2023-10-14T18:45:57.484345+0000","last_fullsized":"2023-10-14T18:45:57.484345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488395+0000","last_change":"2023-10-14T18:45:57.487805+0000","last_active":"2023-10-14T18:45:57.488395+0000","last_peered":"2023-10-14T18:45:57.488395+0000","last_clean":"2023-10-14T18:45:57.488395+0000","last_became_active":"2023-10-14T18:45:57.486968+0000","last_became_peered":"2023-10-14T18:45:57.486968+0000","last_unstale":"2023-10-14T18:45:57.488395+0000","last_undegraded":"2023-10-14T18:45:57.488395+0000","last_fullsized":"2023-10-14T18:45:57.488395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:08.049345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.679304+0000","last_change":"2023-10-14T18:45:56.679234+0000","last_active":"2023-10-14T18:45:56.679304+0000","last_peered":"2023-10-14T18:45:56.679304+0000","last_clean":"2023-10-14T18:45:56.679304+0000","last_became_active":"2023-10-14T18:45:56.678964+0000","last_became_peered":"2023-10-14T18:45:56.678964+0000","last_unstale":"2023-10-14T18:45:56.679304+0000","last_undegraded":"2023-10-14T18:45:56.679304+0000","last_fullsized":"2023-10-14T18:45:56.679304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:02.599292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481233+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:57.481233+0000","last_peered":"2023-10-14T18:45:57.481233+0000","last_clean":"2023-10-14T18:45:57.481233+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:57.481233+0000","last_undegraded":"2023-10-14T18:45:57.481233+0000","last_fullsized":"2023-10-14T18:45:57.481233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199282276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199283377,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.253}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.371},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.625}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872090,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:46:01.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:46:01.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.881+0000 7f3d58a74700 1 Processor -- start 2023-10-14T18:46:01.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.881+0000 7f3d58a74700 1 -- start start 2023-10-14T18:46:01.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d58a74700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d54143520 0x7f3d540cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d58a74700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d541438f0 0x7f3d5406a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d58a74700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540d0870 con 0x7f3d540ccf00 2023-10-14T18:46:01.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d58a74700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540cdfb0 con 0x7f3d54143520 2023-10-14T18:46:01.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d58a74700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540cfc60 con 0x7f3d541438f0 2023-10-14T18:46:01.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d537fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d54143520 0x7f3d540cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d53fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d540ccf00 0x7f3d5415da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45154/0 (socket says 172.21.15.79:45154) 2023-10-14T18:46:01.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d53fff700 1 -- 172.21.15.79:0/2447222610 learned_addr learned my addr 172.21.15.79:0/2447222610 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:01.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d52ffd700 1 --2- 172.21.15.79:0/2447222610 >> v2:172.21.15.144:3300/0 conn(0x7f3d541438f0 0x7f3d5406a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d537fe700 1 -- 172.21.15.79:0/2447222610 >> v2:172.21.15.144:3300/0 conn(0x7f3d541438f0 msgr2=0x7f3d5406a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:01.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d537fe700 1 --2- 172.21.15.79:0/2447222610 >> v2:172.21.15.144:3300/0 conn(0x7f3d541438f0 0x7f3d5406a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d537fe700 1 -- 172.21.15.79:0/2447222610 >> v1:172.21.15.79:6789/0 conn(0x7f3d540ccf00 legacy=0x7f3d5415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d537fe700 1 -- 172.21.15.79:0/2447222610 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540cff40 con 0x7f3d54143520 2023-10-14T18:46:01.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.882+0000 7f3d527fc700 1 -- 172.21.15.79:0/2447222610 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897967194 0 0) 0x7f3d540d0870 con 0x7f3d540ccf00 2023-10-14T18:46:01.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d537fe700 1 --2- 172.21.15.79:0/2447222610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d540cf580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d5415d9c0 tx=0x7f3d44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a572a7ebff15051e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d527fc700 1 -- 172.21.15.79:0/2447222610 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400e070 con 0x7f3d54143520 2023-10-14T18:46:01.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d527fc700 1 -- 172.21.15.79:0/2447222610 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400bc30 con 0x7f3d54143520 2023-10-14T18:46:01.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d527fc700 1 -- 172.21.15.79:0/2447222610 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44012430 con 0x7f3d54143520 2023-10-14T18:46:01.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 -- 172.21.15.79:0/2447222610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 msgr2=0x7f3d540cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 --2- 172.21.15.79:0/2447222610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d540cf580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3d5415d9c0 tx=0x7f3d44009780 comp rx=0 tx=0).stop 2023-10-14T18:46:01.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 -- 172.21.15.79:0/2447222610 shutdown_connections 2023-10-14T18:46:01.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 --2- 172.21.15.79:0/2447222610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d540cf580 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 --2- 172.21.15.79:0/2447222610 >> v2:172.21.15.144:3300/0 conn(0x7f3d541438f0 0x7f3d5406a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 -- 172.21.15.79:0/2447222610 >> 172.21.15.79:0/2447222610 conn(0x7f3d54069750 msgr2=0x7f3d540b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:01.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 -- 172.21.15.79:0/2447222610 shutdown_connections 2023-10-14T18:46:01.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.883+0000 7f3d58a74700 1 -- 172.21.15.79:0/2447222610 wait complete. 2023-10-14T18:46:01.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.884+0000 7f3d58a74700 1 Processor -- start 2023-10-14T18:46:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 -- start start 2023-10-14T18:46:01.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540ccf00 0x7f3d54159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 0x7f3d5415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5415b270 con 0x7f3d54143520 2023-10-14T18:46:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54159d50 con 0x7f3d540ccf00 2023-10-14T18:46:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d58a74700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5415a380 con 0x7f3d541438f0 2023-10-14T18:46:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d52ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d52ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40212/0 (socket says 172.21.15.79:40212) 2023-10-14T18:46:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.885+0000 7f3d52ffd700 1 -- 172.21.15.79:0/431235129 learned_addr learned my addr 172.21.15.79:0/431235129 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d537fe700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540ccf00 0x7f3d54159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d53fff700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 0x7f3d5415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 -- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 msgr2=0x7f3d5415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 0x7f3d5415fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 -- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540ccf00 msgr2=0x7f3d54159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540ccf00 0x7f3d54159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:01.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 -- 172.21.15.79:0/431235129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44009a20 con 0x7f3d54143520 2023-10-14T18:46:01.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d53fff700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 0x7f3d5415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:01.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d52ffd700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800d860 tx=0x7f3d48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48009610 con 0x7f3d54143520 2023-10-14T18:46:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48009770 con 0x7f3d54143520 2023-10-14T18:46:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48009b30 con 0x7f3d54143520 2023-10-14T18:46:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5415a660 con 0x7f3d54143520 2023-10-14T18:46:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.886+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5415ac20 con 0x7f3d54143520 2023-10-14T18:46:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.887+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54089030 con 0x7f3d54143520 2023-10-14T18:46:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.887+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d4801e460 con 0x7f3d54143520 2023-10-14T18:46:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.888+0000 7f3d3b7fe700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 0x7f3d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.888+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d48084b50 con 0x7f3d54143520 2023-10-14T18:46:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.888+0000 7f3d537fe700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 0x7f3d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.888+0000 7f3d537fe700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 0x7f3d400693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d5415d9c0 tx=0x7f3d44019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:01.892+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d48051dc0 con 0x7f3d54143520 2023-10-14T18:46:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.072+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d540d0220 con 0x7f3d40066f30 2023-10-14T18:46:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.080+0000 7f3d3b7fe700 1 -- 172.21.15.79:0/431235129 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269623 (secure 0 0 0) 0x7f3d540d0220 con 0x7f3d40066f30 2023-10-14T18:46:02.084 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:02.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 msgr2=0x7f3d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 0x7f3d400693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d5415d9c0 tx=0x7f3d44019000 comp rx=0 tx=0).stop 2023-10-14T18:46:02.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 msgr2=0x7f3d541427b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800d860 tx=0x7f3d48008040 comp rx=0 tx=0).stop 2023-10-14T18:46:02.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 shutdown_connections 2023-10-14T18:46:02.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d40066f30 0x7f3d400693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d541438f0 0x7f3d5415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540ccf00 0x7f3d54159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 --2- 172.21.15.79:0/431235129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d54143520 0x7f3d541427b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 >> 172.21.15.79:0/431235129 conn(0x7f3d54069750 msgr2=0x7f3d5406a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:02.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 shutdown_connections 2023-10-14T18:46:02.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.083+0000 7f3d58a74700 1 -- 172.21.15.79:0/431235129 wait complete. 2023-10-14T18:46:02.090 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:46:02.095 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-10-14T18:46:00.345543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2156,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560343,"statfs":{"total":1600000000,"available":1597791247,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.681770"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490475+0000","last_change":"2023-10-14T18:45:57.490475+0000","last_active":"2023-10-14T18:45:57.490475+0000","last_peered":"2023-10-14T18:45:57.490475+0000","last_clean":"2023-10-14T18:45:57.490475+0000","last_became_active":"2023-10-14T18:45:57.490256+0000","last_became_peered":"2023-10-14T18:45:57.490256+0000","last_unstale":"2023-10-14T18:45:57.490475+0000","last_undegraded":"2023-10-14T18:45:57.490475+0000","last_fullsized":"2023-10-14T18:45:57.490475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487345+0000","last_change":"2023-10-14T18:45:57.487291+0000","last_active":"2023-10-14T18:45:57.487345+0000","last_peered":"2023-10-14T18:45:57.487345+0000","last_clean":"2023-10-14T18:45:57.487345+0000","last_became_active":"2023-10-14T18:45:57.486675+0000","last_became_peered":"2023-10-14T18:45:57.486675+0000","last_unstale":"2023-10-14T18:45:57.487345+0000","last_undegraded":"2023-10-14T18:45:57.487345+0000","last_fullsized":"2023-10-14T18:45:57.487345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495379+0000","last_change":"2023-10-14T18:45:57.495245+0000","last_active":"2023-10-14T18:45:57.495379+0000","last_peered":"2023-10-14T18:45:57.495379+0000","last_clean":"2023-10-14T18:45:57.495379+0000","last_became_active":"2023-10-14T18:45:57.494181+0000","last_became_peered":"2023-10-14T18:45:57.494181+0000","last_unstale":"2023-10-14T18:45:57.495379+0000","last_undegraded":"2023-10-14T18:45:57.495379+0000","last_fullsized":"2023-10-14T18:45:57.495379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490238+0000","last_change":"2023-10-14T18:45:57.490189+0000","last_active":"2023-10-14T18:45:57.490238+0000","last_peered":"2023-10-14T18:45:57.490238+0000","last_clean":"2023-10-14T18:45:57.490238+0000","last_became_active":"2023-10-14T18:45:57.490016+0000","last_became_peered":"2023-10-14T18:45:57.490016+0000","last_unstale":"2023-10-14T18:45:57.490238+0000","last_undegraded":"2023-10-14T18:45:57.490238+0000","last_fullsized":"2023-10-14T18:45:57.490238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:53.291754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486823+0000","last_change":"2023-10-14T18:45:57.486823+0000","last_active":"2023-10-14T18:45:57.486823+0000","last_peered":"2023-10-14T18:45:57.486823+0000","last_clean":"2023-10-14T18:45:57.486823+0000","last_became_active":"2023-10-14T18:45:57.486608+0000","last_became_peered":"2023-10-14T18:45:57.486608+0000","last_unstale":"2023-10-14T18:45:57.486823+0000","last_undegraded":"2023-10-14T18:45:57.486823+0000","last_fullsized":"2023-10-14T18:45:57.486823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:40.023332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486921+0000","last_change":"2023-10-14T18:45:57.486792+0000","last_active":"2023-10-14T18:45:57.486921+0000","last_peered":"2023-10-14T18:45:57.486921+0000","last_clean":"2023-10-14T18:45:57.486921+0000","last_became_active":"2023-10-14T18:45:57.486573+0000","last_became_peered":"2023-10-14T18:45:57.486573+0000","last_unstale":"2023-10-14T18:45:57.486921+0000","last_undegraded":"2023-10-14T18:45:57.486921+0000","last_fullsized":"2023-10-14T18:45:57.486921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:23.318099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487461+0000","last_change":"2023-10-14T18:45:57.487367+0000","last_active":"2023-10-14T18:45:57.487461+0000","last_peered":"2023-10-14T18:45:57.487461+0000","last_clean":"2023-10-14T18:45:57.487461+0000","last_became_active":"2023-10-14T18:45:57.486820+0000","last_became_peered":"2023-10-14T18:45:57.486820+0000","last_unstale":"2023-10-14T18:45:57.487461+0000","last_undegraded":"2023-10-14T18:45:57.487461+0000","last_fullsized":"2023-10-14T18:45:57.487461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487118+0000","last_change":"2023-10-14T18:45:57.485493+0000","last_active":"2023-10-14T18:45:57.487118+0000","last_peered":"2023-10-14T18:45:57.487118+0000","last_clean":"2023-10-14T18:45:57.487118+0000","last_became_active":"2023-10-14T18:45:57.485227+0000","last_became_peered":"2023-10-14T18:45:57.485227+0000","last_unstale":"2023-10-14T18:45:57.487118+0000","last_undegraded":"2023-10-14T18:45:57.487118+0000","last_fullsized":"2023-10-14T18:45:57.487118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491018+0000","last_change":"2023-10-14T18:45:57.490942+0000","last_active":"2023-10-14T18:45:57.491018+0000","last_peered":"2023-10-14T18:45:57.491018+0000","last_clean":"2023-10-14T18:45:57.491018+0000","last_became_active":"2023-10-14T18:45:57.490508+0000","last_became_peered":"2023-10-14T18:45:57.490508+0000","last_unstale":"2023-10-14T18:45:57.491018+0000","last_undegraded":"2023-10-14T18:45:57.491018+0000","last_fullsized":"2023-10-14T18:45:57.491018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.483037+0000","last_change":"2023-10-14T18:45:57.482932+0000","last_active":"2023-10-14T18:45:57.483037+0000","last_peered":"2023-10-14T18:45:57.483037+0000","last_clean":"2023-10-14T18:45:57.483037+0000","last_became_active":"2023-10-14T18:45:57.482691+0000","last_became_peered":"2023-10-14T18:45:57.482691+0000","last_unstale":"2023-10-14T18:45:57.483037+0000","last_undegraded":"2023-10-14T18:45:57.483037+0000","last_fullsized":"2023-10-14T18:45:57.483037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:24.541678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487152+0000","last_change":"2023-10-14T18:45:57.486721+0000","last_active":"2023-10-14T18:45:57.487152+0000","last_peered":"2023-10-14T18:45:57.487152+0000","last_clean":"2023-10-14T18:45:57.487152+0000","last_became_active":"2023-10-14T18:45:57.484798+0000","last_became_peered":"2023-10-14T18:45:57.484798+0000","last_unstale":"2023-10-14T18:45:57.487152+0000","last_undegraded":"2023-10-14T18:45:57.487152+0000","last_fullsized":"2023-10-14T18:45:57.487152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:12.672358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495259+0000","last_change":"2023-10-14T18:45:57.495194+0000","last_active":"2023-10-14T18:45:57.495259+0000","last_peered":"2023-10-14T18:45:57.495259+0000","last_clean":"2023-10-14T18:45:57.495259+0000","last_became_active":"2023-10-14T18:45:57.494966+0000","last_became_peered":"2023-10-14T18:45:57.494966+0000","last_unstale":"2023-10-14T18:45:57.495259+0000","last_undegraded":"2023-10-14T18:45:57.495259+0000","last_fullsized":"2023-10-14T18:45:57.495259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:02.908535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486786+0000","last_change":"2023-10-14T18:45:57.486786+0000","last_active":"2023-10-14T18:45:57.486786+0000","last_peered":"2023-10-14T18:45:57.486786+0000","last_clean":"2023-10-14T18:45:57.486786+0000","last_became_active":"2023-10-14T18:45:57.486287+0000","last_became_peered":"2023-10-14T18:45:57.486287+0000","last_unstale":"2023-10-14T18:45:57.486786+0000","last_undegraded":"2023-10-14T18:45:57.486786+0000","last_fullsized":"2023-10-14T18:45:57.486786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:51.567659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490775+0000","last_change":"2023-10-14T18:45:57.490542+0000","last_active":"2023-10-14T18:45:57.490775+0000","last_peered":"2023-10-14T18:45:57.490775+0000","last_clean":"2023-10-14T18:45:57.490775+0000","last_became_active":"2023-10-14T18:45:57.490149+0000","last_became_peered":"2023-10-14T18:45:57.490149+0000","last_unstale":"2023-10-14T18:45:57.490775+0000","last_undegraded":"2023-10-14T18:45:57.490775+0000","last_fullsized":"2023-10-14T18:45:57.490775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486972+0000","last_change":"2023-10-14T18:45:57.486900+0000","last_active":"2023-10-14T18:45:57.486972+0000","last_peered":"2023-10-14T18:45:57.486972+0000","last_clean":"2023-10-14T18:45:57.486972+0000","last_became_active":"2023-10-14T18:45:57.486674+0000","last_became_peered":"2023-10-14T18:45:57.486674+0000","last_unstale":"2023-10-14T18:45:57.486972+0000","last_undegraded":"2023-10-14T18:45:57.486972+0000","last_fullsized":"2023-10-14T18:45:57.486972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487168+0000","last_change":"2023-10-14T18:45:57.487060+0000","last_active":"2023-10-14T18:45:57.487168+0000","last_peered":"2023-10-14T18:45:57.487168+0000","last_clean":"2023-10-14T18:45:57.487168+0000","last_became_active":"2023-10-14T18:45:57.486501+0000","last_became_peered":"2023-10-14T18:45:57.486501+0000","last_unstale":"2023-10-14T18:45:57.487168+0000","last_undegraded":"2023-10-14T18:45:57.487168+0000","last_fullsized":"2023-10-14T18:45:57.487168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:20.249429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487363+0000","last_change":"2023-10-14T18:45:57.487225+0000","last_active":"2023-10-14T18:45:57.487363+0000","last_peered":"2023-10-14T18:45:57.487363+0000","last_clean":"2023-10-14T18:45:57.487363+0000","last_became_active":"2023-10-14T18:45:57.486546+0000","last_became_peered":"2023-10-14T18:45:57.486546+0000","last_unstale":"2023-10-14T18:45:57.487363+0000","last_undegraded":"2023-10-14T18:45:57.487363+0000","last_fullsized":"2023-10-14T18:45:57.487363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.482733+0000","last_change":"2023-10-14T18:45:57.481878+0000","last_active":"2023-10-14T18:45:57.482733+0000","last_peered":"2023-10-14T18:45:57.482733+0000","last_clean":"2023-10-14T18:45:57.482733+0000","last_became_active":"2023-10-14T18:45:57.481671+0000","last_became_peered":"2023-10-14T18:45:57.481671+0000","last_unstale":"2023-10-14T18:45:57.482733+0000","last_undegraded":"2023-10-14T18:45:57.482733+0000","last_fullsized":"2023-10-14T18:45:57.482733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:20.030227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488966+0000","last_change":"2023-10-14T18:45:57.488909+0000","last_active":"2023-10-14T18:45:57.488966+0000","last_peered":"2023-10-14T18:45:57.488966+0000","last_clean":"2023-10-14T18:45:57.488966+0000","last_became_active":"2023-10-14T18:45:57.488183+0000","last_became_peered":"2023-10-14T18:45:57.488183+0000","last_unstale":"2023-10-14T18:45:57.488966+0000","last_undegraded":"2023-10-14T18:45:57.488966+0000","last_fullsized":"2023-10-14T18:45:57.488966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487859+0000","last_change":"2023-10-14T18:45:57.487859+0000","last_active":"2023-10-14T18:45:57.487859+0000","last_peered":"2023-10-14T18:45:57.487859+0000","last_clean":"2023-10-14T18:45:57.487859+0000","last_became_active":"2023-10-14T18:45:57.487647+0000","last_became_peered":"2023-10-14T18:45:57.487647+0000","last_unstale":"2023-10-14T18:45:57.487859+0000","last_undegraded":"2023-10-14T18:45:57.487859+0000","last_fullsized":"2023-10-14T18:45:57.487859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:03.606768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492658+0000","last_change":"2023-10-14T18:45:57.491630+0000","last_active":"2023-10-14T18:45:57.492658+0000","last_peered":"2023-10-14T18:45:57.492658+0000","last_clean":"2023-10-14T18:45:57.492658+0000","last_became_active":"2023-10-14T18:45:57.491315+0000","last_became_peered":"2023-10-14T18:45:57.491315+0000","last_unstale":"2023-10-14T18:45:57.492658+0000","last_undegraded":"2023-10-14T18:45:57.492658+0000","last_fullsized":"2023-10-14T18:45:57.492658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:46.162811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491001+0000","last_change":"2023-10-14T18:45:57.490858+0000","last_active":"2023-10-14T18:45:57.491001+0000","last_peered":"2023-10-14T18:45:57.491001+0000","last_clean":"2023-10-14T18:45:57.491001+0000","last_became_active":"2023-10-14T18:45:57.489432+0000","last_became_peered":"2023-10-14T18:45:57.489432+0000","last_unstale":"2023-10-14T18:45:57.491001+0000","last_undegraded":"2023-10-14T18:45:57.491001+0000","last_fullsized":"2023-10-14T18:45:57.491001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:51.296925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485609+0000","last_change":"2023-10-14T18:45:57.485609+0000","last_active":"2023-10-14T18:45:57.485609+0000","last_peered":"2023-10-14T18:45:57.485609+0000","last_clean":"2023-10-14T18:45:57.485609+0000","last_became_active":"2023-10-14T18:45:57.485388+0000","last_became_peered":"2023-10-14T18:45:57.485388+0000","last_unstale":"2023-10-14T18:45:57.485609+0000","last_undegraded":"2023-10-14T18:45:57.485609+0000","last_fullsized":"2023-10-14T18:45:57.485609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493194+0000","last_change":"2023-10-14T18:45:57.489666+0000","last_active":"2023-10-14T18:45:57.493194+0000","last_peered":"2023-10-14T18:45:57.493194+0000","last_clean":"2023-10-14T18:45:57.493194+0000","last_became_active":"2023-10-14T18:45:57.489274+0000","last_became_peered":"2023-10-14T18:45:57.489274+0000","last_unstale":"2023-10-14T18:45:57.493194+0000","last_undegraded":"2023-10-14T18:45:57.493194+0000","last_fullsized":"2023-10-14T18:45:57.493194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485227+0000","last_change":"2023-10-14T18:45:57.484256+0000","last_active":"2023-10-14T18:45:57.485227+0000","last_peered":"2023-10-14T18:45:57.485227+0000","last_clean":"2023-10-14T18:45:57.485227+0000","last_became_active":"2023-10-14T18:45:57.484008+0000","last_became_peered":"2023-10-14T18:45:57.484008+0000","last_unstale":"2023-10-14T18:45:57.485227+0000","last_undegraded":"2023-10-14T18:45:57.485227+0000","last_fullsized":"2023-10-14T18:45:57.485227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:46.162811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485749+0000","last_change":"2023-10-14T18:45:57.485693+0000","last_active":"2023-10-14T18:45:57.485749+0000","last_peered":"2023-10-14T18:45:57.485749+0000","last_clean":"2023-10-14T18:45:57.485749+0000","last_became_active":"2023-10-14T18:45:57.485482+0000","last_became_peered":"2023-10-14T18:45:57.485482+0000","last_unstale":"2023-10-14T18:45:57.485749+0000","last_undegraded":"2023-10-14T18:45:57.485749+0000","last_fullsized":"2023-10-14T18:45:57.485749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:49:40.612824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487925+0000","last_change":"2023-10-14T18:45:57.486240+0000","last_active":"2023-10-14T18:45:57.487925+0000","last_peered":"2023-10-14T18:45:57.487925+0000","last_clean":"2023-10-14T18:45:57.487925+0000","last_became_active":"2023-10-14T18:45:57.485916+0000","last_became_peered":"2023-10-14T18:45:57.485916+0000","last_unstale":"2023-10-14T18:45:57.487925+0000","last_undegraded":"2023-10-14T18:45:57.487925+0000","last_fullsized":"2023-10-14T18:45:57.487925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:08.049345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495730+0000","last_change":"2023-10-14T18:45:57.495629+0000","last_active":"2023-10-14T18:45:57.495730+0000","last_peered":"2023-10-14T18:45:57.495730+0000","last_clean":"2023-10-14T18:45:57.495730+0000","last_became_active":"2023-10-14T18:45:57.495014+0000","last_became_peered":"2023-10-14T18:45:57.495014+0000","last_unstale":"2023-10-14T18:45:57.495730+0000","last_undegraded":"2023-10-14T18:45:57.495730+0000","last_fullsized":"2023-10-14T18:45:57.495730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:20.030227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490950+0000","last_change":"2023-10-14T18:45:57.490752+0000","last_active":"2023-10-14T18:45:57.490950+0000","last_peered":"2023-10-14T18:45:57.490950+0000","last_clean":"2023-10-14T18:45:57.490950+0000","last_became_active":"2023-10-14T18:45:57.490153+0000","last_became_peered":"2023-10-14T18:45:57.490153+0000","last_unstale":"2023-10-14T18:45:57.490950+0000","last_undegraded":"2023-10-14T18:45:57.490950+0000","last_fullsized":"2023-10-14T18:45:57.490950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488414+0000","last_change":"2023-10-14T18:45:57.487950+0000","last_active":"2023-10-14T18:45:57.488414+0000","last_peered":"2023-10-14T18:45:57.488414+0000","last_clean":"2023-10-14T18:45:57.488414+0000","last_became_active":"2023-10-14T18:45:57.487286+0000","last_became_peered":"2023-10-14T18:45:57.487286+0000","last_unstale":"2023-10-14T18:45:57.488414+0000","last_undegraded":"2023-10-14T18:45:57.488414+0000","last_fullsized":"2023-10-14T18:45:57.488414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490973+0000","last_change":"2023-10-14T18:45:57.490973+0000","last_active":"2023-10-14T18:45:57.490973+0000","last_peered":"2023-10-14T18:45:57.490973+0000","last_clean":"2023-10-14T18:45:57.490973+0000","last_became_active":"2023-10-14T18:45:57.490758+0000","last_became_peered":"2023-10-14T18:45:57.490758+0000","last_unstale":"2023-10-14T18:45:57.490973+0000","last_undegraded":"2023-10-14T18:45:57.490973+0000","last_fullsized":"2023-10-14T18:45:57.490973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:47.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487190+0000","last_change":"2023-10-14T18:45:57.487090+0000","last_active":"2023-10-14T18:45:57.487190+0000","last_peered":"2023-10-14T18:45:57.487190+0000","last_clean":"2023-10-14T18:45:57.487190+0000","last_became_active":"2023-10-14T18:45:57.486266+0000","last_became_peered":"2023-10-14T18:45:57.486266+0000","last_unstale":"2023-10-14T18:45:57.487190+0000","last_undegraded":"2023-10-14T18:45:57.487190+0000","last_fullsized":"2023-10-14T18:45:57.487190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.485421+0000","last_change":"2023-10-14T18:45:57.485421+0000","last_active":"2023-10-14T18:45:57.485421+0000","last_peered":"2023-10-14T18:45:57.485421+0000","last_clean":"2023-10-14T18:45:57.485421+0000","last_became_active":"2023-10-14T18:45:57.485225+0000","last_became_peered":"2023-10-14T18:45:57.485225+0000","last_unstale":"2023-10-14T18:45:57.485421+0000","last_undegraded":"2023-10-14T18:45:57.485421+0000","last_fullsized":"2023-10-14T18:45:57.485421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:53.885917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675308+0000","last_change":"2023-10-14T18:45:56.680077+0000","last_active":"2023-10-14T18:45:57.675308+0000","last_peered":"2023-10-14T18:45:57.675308+0000","last_clean":"2023-10-14T18:45:57.675308+0000","last_became_active":"2023-10-14T18:45:56.679822+0000","last_became_peered":"2023-10-14T18:45:56.679822+0000","last_unstale":"2023-10-14T18:45:57.675308+0000","last_undegraded":"2023-10-14T18:45:57.675308+0000","last_fullsized":"2023-10-14T18:45:57.675308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491843+0000","last_change":"2023-10-14T18:45:57.491843+0000","last_active":"2023-10-14T18:45:57.491843+0000","last_peered":"2023-10-14T18:45:57.491843+0000","last_clean":"2023-10-14T18:45:57.491843+0000","last_became_active":"2023-10-14T18:45:57.491603+0000","last_became_peered":"2023-10-14T18:45:57.491603+0000","last_unstale":"2023-10-14T18:45:57.491843+0000","last_undegraded":"2023-10-14T18:45:57.491843+0000","last_fullsized":"2023-10-14T18:45:57.491843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.833432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.483263+0000","last_change":"2023-10-14T18:45:56.674659+0000","last_active":"2023-10-14T18:45:57.483263+0000","last_peered":"2023-10-14T18:45:57.483263+0000","last_clean":"2023-10-14T18:45:57.483263+0000","last_became_active":"2023-10-14T18:45:56.674449+0000","last_became_peered":"2023-10-14T18:45:56.674449+0000","last_unstale":"2023-10-14T18:45:57.483263+0000","last_undegraded":"2023-10-14T18:45:57.483263+0000","last_fullsized":"2023-10-14T18:45:57.483263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:41.109082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490365+0000","last_change":"2023-10-14T18:45:57.489541+0000","last_active":"2023-10-14T18:45:57.490365+0000","last_peered":"2023-10-14T18:45:57.490365+0000","last_clean":"2023-10-14T18:45:57.490365+0000","last_became_active":"2023-10-14T18:45:57.489212+0000","last_became_peered":"2023-10-14T18:45:57.489212+0000","last_unstale":"2023-10-14T18:45:57.490365+0000","last_undegraded":"2023-10-14T18:45:57.490365+0000","last_fullsized":"2023-10-14T18:45:57.490365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:47.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.677054+0000","last_change":"2023-10-14T18:45:56.673638+0000","last_active":"2023-10-14T18:45:57.677054+0000","last_peered":"2023-10-14T18:45:57.677054+0000","last_clean":"2023-10-14T18:45:57.677054+0000","last_became_active":"2023-10-14T18:45:56.673429+0000","last_became_peered":"2023-10-14T18:45:56.673429+0000","last_unstale":"2023-10-14T18:45:57.677054+0000","last_undegraded":"2023-10-14T18:45:57.677054+0000","last_fullsized":"2023-10-14T18:45:57.677054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:52.878441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493994+0000","last_change":"2023-10-14T18:45:57.493951+0000","last_active":"2023-10-14T18:45:57.493994+0000","last_peered":"2023-10-14T18:45:57.493994+0000","last_clean":"2023-10-14T18:45:57.493994+0000","last_became_active":"2023-10-14T18:45:57.493793+0000","last_became_peered":"2023-10-14T18:45:57.493793+0000","last_unstale":"2023-10-14T18:45:57.493994+0000","last_undegraded":"2023-10-14T18:45:57.493994+0000","last_fullsized":"2023-10-14T18:45:57.493994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.678130+0000","last_change":"2023-10-14T18:45:56.676478+0000","last_active":"2023-10-14T18:45:57.678130+0000","last_peered":"2023-10-14T18:45:57.678130+0000","last_clean":"2023-10-14T18:45:57.678130+0000","last_became_active":"2023-10-14T18:45:56.676043+0000","last_became_peered":"2023-10-14T18:45:56.676043+0000","last_unstale":"2023-10-14T18:45:57.678130+0000","last_undegraded":"2023-10-14T18:45:57.678130+0000","last_fullsized":"2023-10-14T18:45:57.678130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:40.638097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.494508+0000","last_change":"2023-10-14T18:45:57.494445+0000","last_active":"2023-10-14T18:45:57.494508+0000","last_peered":"2023-10-14T18:45:57.494508+0000","last_clean":"2023-10-14T18:45:57.494508+0000","last_became_active":"2023-10-14T18:45:57.494084+0000","last_became_peered":"2023-10-14T18:45:57.494084+0000","last_unstale":"2023-10-14T18:45:57.494508+0000","last_undegraded":"2023-10-14T18:45:57.494508+0000","last_fullsized":"2023-10-14T18:45:57.494508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675933+0000","last_change":"2023-10-14T18:45:56.678687+0000","last_active":"2023-10-14T18:45:57.675933+0000","last_peered":"2023-10-14T18:45:57.675933+0000","last_clean":"2023-10-14T18:45:57.675933+0000","last_became_active":"2023-10-14T18:45:56.678424+0000","last_became_peered":"2023-10-14T18:45:56.678424+0000","last_unstale":"2023-10-14T18:45:57.675933+0000","last_undegraded":"2023-10-14T18:45:57.675933+0000","last_fullsized":"2023-10-14T18:45:57.675933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:54.518995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493251+0000","last_change":"2023-10-14T18:45:57.491207+0000","last_active":"2023-10-14T18:45:57.493251+0000","last_peered":"2023-10-14T18:45:57.493251+0000","last_clean":"2023-10-14T18:45:57.493251+0000","last_became_active":"2023-10-14T18:45:57.490733+0000","last_became_peered":"2023-10-14T18:45:57.490733+0000","last_unstale":"2023-10-14T18:45:57.493251+0000","last_undegraded":"2023-10-14T18:45:57.493251+0000","last_fullsized":"2023-10-14T18:45:57.493251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:45.705606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676137+0000","last_change":"2023-10-14T18:45:56.678201+0000","last_active":"2023-10-14T18:45:57.676137+0000","last_peered":"2023-10-14T18:45:57.676137+0000","last_clean":"2023-10-14T18:45:57.676137+0000","last_became_active":"2023-10-14T18:45:56.677985+0000","last_became_peered":"2023-10-14T18:45:56.677985+0000","last_unstale":"2023-10-14T18:45:57.676137+0000","last_undegraded":"2023-10-14T18:45:57.676137+0000","last_fullsized":"2023-10-14T18:45:57.676137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:19.064308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493901+0000","last_change":"2023-10-14T18:45:57.493835+0000","last_active":"2023-10-14T18:45:57.493901+0000","last_peered":"2023-10-14T18:45:57.493901+0000","last_clean":"2023-10-14T18:45:57.493901+0000","last_became_active":"2023-10-14T18:45:57.493602+0000","last_became_peered":"2023-10-14T18:45:57.493602+0000","last_unstale":"2023-10-14T18:45:57.493901+0000","last_undegraded":"2023-10-14T18:45:57.493901+0000","last_fullsized":"2023-10-14T18:45:57.493901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:13:24.541678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481449+0000","last_change":"2023-10-14T18:45:56.674279+0000","last_active":"2023-10-14T18:45:57.481449+0000","last_peered":"2023-10-14T18:45:57.481449+0000","last_clean":"2023-10-14T18:45:57.481449+0000","last_became_active":"2023-10-14T18:45:56.673151+0000","last_became_peered":"2023-10-14T18:45:56.673151+0000","last_unstale":"2023-10-14T18:45:57.481449+0000","last_undegraded":"2023-10-14T18:45:57.481449+0000","last_fullsized":"2023-10-14T18:45:57.481449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:23.825956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489140+0000","last_change":"2023-10-14T18:45:57.489099+0000","last_active":"2023-10-14T18:45:57.489140+0000","last_peered":"2023-10-14T18:45:57.489140+0000","last_clean":"2023-10-14T18:45:57.489140+0000","last_became_active":"2023-10-14T18:45:57.488632+0000","last_became_peered":"2023-10-14T18:45:57.488632+0000","last_unstale":"2023-10-14T18:45:57.489140+0000","last_undegraded":"2023-10-14T18:45:57.489140+0000","last_fullsized":"2023-10-14T18:45:57.489140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:12.672358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492300+0000","last_change":"2023-10-14T18:45:56.680637+0000","last_active":"2023-10-14T18:45:57.492300+0000","last_peered":"2023-10-14T18:45:57.492300+0000","last_clean":"2023-10-14T18:45:57.492300+0000","last_became_active":"2023-10-14T18:45:56.679994+0000","last_became_peered":"2023-10-14T18:45:56.679994+0000","last_unstale":"2023-10-14T18:45:57.492300+0000","last_undegraded":"2023-10-14T18:45:57.492300+0000","last_fullsized":"2023-10-14T18:45:57.492300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493219+0000","last_change":"2023-10-14T18:45:57.490943+0000","last_active":"2023-10-14T18:45:57.493219+0000","last_peered":"2023-10-14T18:45:57.493219+0000","last_clean":"2023-10-14T18:45:57.493219+0000","last_became_active":"2023-10-14T18:45:57.490161+0000","last_became_peered":"2023-10-14T18:45:57.490161+0000","last_unstale":"2023-10-14T18:45:57.493219+0000","last_undegraded":"2023-10-14T18:45:57.493219+0000","last_fullsized":"2023-10-14T18:45:57.493219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481918+0000","last_change":"2023-10-14T18:45:56.674702+0000","last_active":"2023-10-14T18:45:57.481918+0000","last_peered":"2023-10-14T18:45:57.481918+0000","last_clean":"2023-10-14T18:45:57.481918+0000","last_became_active":"2023-10-14T18:45:56.674475+0000","last_became_peered":"2023-10-14T18:45:56.674475+0000","last_unstale":"2023-10-14T18:45:57.481918+0000","last_undegraded":"2023-10-14T18:45:57.481918+0000","last_fullsized":"2023-10-14T18:45:57.481918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:00.826568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488709+0000","last_change":"2023-10-14T18:45:57.488625+0000","last_active":"2023-10-14T18:45:57.488709+0000","last_peered":"2023-10-14T18:45:57.488709+0000","last_clean":"2023-10-14T18:45:57.488709+0000","last_became_active":"2023-10-14T18:45:57.488397+0000","last_became_peered":"2023-10-14T18:45:57.488397+0000","last_unstale":"2023-10-14T18:45:57.488709+0000","last_undegraded":"2023-10-14T18:45:57.488709+0000","last_fullsized":"2023-10-14T18:45:57.488709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:16.461057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.672373+0000","last_change":"2023-10-14T18:45:56.672312+0000","last_active":"2023-10-14T18:45:56.672373+0000","last_peered":"2023-10-14T18:45:56.672373+0000","last_clean":"2023-10-14T18:45:56.672373+0000","last_became_active":"2023-10-14T18:45:56.672089+0000","last_became_peered":"2023-10-14T18:45:56.672089+0000","last_unstale":"2023-10-14T18:45:56.672373+0000","last_undegraded":"2023-10-14T18:45:56.672373+0000","last_fullsized":"2023-10-14T18:45:56.672373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:38.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484903+0000","last_change":"2023-10-14T18:45:57.484840+0000","last_active":"2023-10-14T18:45:57.484903+0000","last_peered":"2023-10-14T18:45:57.484903+0000","last_clean":"2023-10-14T18:45:57.484903+0000","last_became_active":"2023-10-14T18:45:57.484633+0000","last_became_peered":"2023-10-14T18:45:57.484633+0000","last_unstale":"2023-10-14T18:45:57.484903+0000","last_undegraded":"2023-10-14T18:45:57.484903+0000","last_fullsized":"2023-10-14T18:45:57.484903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:33:02.908535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676081+0000","last_change":"2023-10-14T18:45:56.682283+0000","last_active":"2023-10-14T18:45:57.676081+0000","last_peered":"2023-10-14T18:45:57.676081+0000","last_clean":"2023-10-14T18:45:57.676081+0000","last_became_active":"2023-10-14T18:45:56.681904+0000","last_became_peered":"2023-10-14T18:45:56.681904+0000","last_unstale":"2023-10-14T18:45:57.676081+0000","last_undegraded":"2023-10-14T18:45:57.676081+0000","last_fullsized":"2023-10-14T18:45:57.676081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:00.826568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495714+0000","last_change":"2023-10-14T18:45:57.495418+0000","last_active":"2023-10-14T18:45:57.495714+0000","last_peered":"2023-10-14T18:45:57.495714+0000","last_clean":"2023-10-14T18:45:57.495714+0000","last_became_active":"2023-10-14T18:45:57.494472+0000","last_became_peered":"2023-10-14T18:45:57.494472+0000","last_unstale":"2023-10-14T18:45:57.495714+0000","last_undegraded":"2023-10-14T18:45:57.495714+0000","last_fullsized":"2023-10-14T18:45:57.495714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:20:13.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.678224+0000","last_change":"2023-10-14T18:45:56.675003+0000","last_active":"2023-10-14T18:45:57.678224+0000","last_peered":"2023-10-14T18:45:57.678224+0000","last_clean":"2023-10-14T18:45:57.678224+0000","last_became_active":"2023-10-14T18:45:56.674490+0000","last_became_peered":"2023-10-14T18:45:56.674490+0000","last_unstale":"2023-10-14T18:45:57.678224+0000","last_undegraded":"2023-10-14T18:45:57.678224+0000","last_fullsized":"2023-10-14T18:45:57.678224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:41.109082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487941+0000","last_change":"2023-10-14T18:45:57.486332+0000","last_active":"2023-10-14T18:45:57.487941+0000","last_peered":"2023-10-14T18:45:57.487941+0000","last_clean":"2023-10-14T18:45:57.487941+0000","last_became_active":"2023-10-14T18:45:57.486098+0000","last_became_peered":"2023-10-14T18:45:57.486098+0000","last_unstale":"2023-10-14T18:45:57.487941+0000","last_undegraded":"2023-10-14T18:45:57.487941+0000","last_fullsized":"2023-10-14T18:45:57.487941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:20.249429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676440+0000","last_change":"2023-10-14T18:45:56.680491+0000","last_active":"2023-10-14T18:45:57.676440+0000","last_peered":"2023-10-14T18:45:57.676440+0000","last_clean":"2023-10-14T18:45:57.676440+0000","last_became_active":"2023-10-14T18:45:56.679694+0000","last_became_peered":"2023-10-14T18:45:56.679694+0000","last_unstale":"2023-10-14T18:45:57.676440+0000","last_undegraded":"2023-10-14T18:45:57.676440+0000","last_fullsized":"2023-10-14T18:45:57.676440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:50.560183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486889+0000","last_change":"2023-10-14T18:45:57.486414+0000","last_active":"2023-10-14T18:45:57.486889+0000","last_peered":"2023-10-14T18:45:57.486889+0000","last_clean":"2023-10-14T18:45:57.486889+0000","last_became_active":"2023-10-14T18:45:57.486173+0000","last_became_peered":"2023-10-14T18:45:57.486173+0000","last_unstale":"2023-10-14T18:45:57.486889+0000","last_undegraded":"2023-10-14T18:45:57.486889+0000","last_fullsized":"2023-10-14T18:45:57.486889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480141+0000","last_change":"2023-10-14T18:45:56.680104+0000","last_active":"2023-10-14T18:45:57.480141+0000","last_peered":"2023-10-14T18:45:57.480141+0000","last_clean":"2023-10-14T18:45:57.480141+0000","last_became_active":"2023-10-14T18:45:56.679782+0000","last_became_peered":"2023-10-14T18:45:56.679782+0000","last_unstale":"2023-10-14T18:45:57.480141+0000","last_undegraded":"2023-10-14T18:45:57.480141+0000","last_fullsized":"2023-10-14T18:45:57.480141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:42.703342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.494377+0000","last_change":"2023-10-14T18:45:57.494308+0000","last_active":"2023-10-14T18:45:57.494377+0000","last_peered":"2023-10-14T18:45:57.494377+0000","last_clean":"2023-10-14T18:45:57.494377+0000","last_became_active":"2023-10-14T18:45:57.493793+0000","last_became_peered":"2023-10-14T18:45:57.493793+0000","last_unstale":"2023-10-14T18:45:57.494377+0000","last_undegraded":"2023-10-14T18:45:57.494377+0000","last_fullsized":"2023-10-14T18:45:57.494377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:10:20.679655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480846+0000","last_change":"2023-10-14T18:45:56.676395+0000","last_active":"2023-10-14T18:45:57.480846+0000","last_peered":"2023-10-14T18:45:57.480846+0000","last_clean":"2023-10-14T18:45:57.480846+0000","last_became_active":"2023-10-14T18:45:56.676159+0000","last_became_peered":"2023-10-14T18:45:56.676159+0000","last_unstale":"2023-10-14T18:45:57.480846+0000","last_undegraded":"2023-10-14T18:45:57.480846+0000","last_fullsized":"2023-10-14T18:45:57.480846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:47.683953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492084+0000","last_change":"2023-10-14T18:45:57.492084+0000","last_active":"2023-10-14T18:45:57.492084+0000","last_peered":"2023-10-14T18:45:57.492084+0000","last_clean":"2023-10-14T18:45:57.492084+0000","last_became_active":"2023-10-14T18:45:57.491859+0000","last_became_peered":"2023-10-14T18:45:57.491859+0000","last_unstale":"2023-10-14T18:45:57.492084+0000","last_undegraded":"2023-10-14T18:45:57.492084+0000","last_fullsized":"2023-10-14T18:45:57.492084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.677500+0000","last_change":"2023-10-14T18:45:56.676078+0000","last_active":"2023-10-14T18:45:57.677500+0000","last_peered":"2023-10-14T18:45:57.677500+0000","last_clean":"2023-10-14T18:45:57.677500+0000","last_became_active":"2023-10-14T18:45:56.675663+0000","last_became_peered":"2023-10-14T18:45:56.675663+0000","last_unstale":"2023-10-14T18:45:57.677500+0000","last_undegraded":"2023-10-14T18:45:57.677500+0000","last_fullsized":"2023-10-14T18:45:57.677500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.495761+0000","last_change":"2023-10-14T18:45:57.495701+0000","last_active":"2023-10-14T18:45:57.495761+0000","last_peered":"2023-10-14T18:45:57.495761+0000","last_clean":"2023-10-14T18:45:57.495761+0000","last_became_active":"2023-10-14T18:45:57.495445+0000","last_became_peered":"2023-10-14T18:45:57.495445+0000","last_unstale":"2023-10-14T18:45:57.495761+0000","last_undegraded":"2023-10-14T18:45:57.495761+0000","last_fullsized":"2023-10-14T18:45:57.495761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.676515+0000","last_change":"2023-10-14T18:45:56.677585+0000","last_active":"2023-10-14T18:45:57.676515+0000","last_peered":"2023-10-14T18:45:57.676515+0000","last_clean":"2023-10-14T18:45:57.676515+0000","last_became_active":"2023-10-14T18:45:56.677322+0000","last_became_peered":"2023-10-14T18:45:56.677322+0000","last_unstale":"2023-10-14T18:45:57.676515+0000","last_undegraded":"2023-10-14T18:45:57.676515+0000","last_fullsized":"2023-10-14T18:45:57.676515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:39.015856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493266+0000","last_change":"2023-10-14T18:45:57.492163+0000","last_active":"2023-10-14T18:45:57.493266+0000","last_peered":"2023-10-14T18:45:57.493266+0000","last_clean":"2023-10-14T18:45:57.493266+0000","last_became_active":"2023-10-14T18:45:57.491939+0000","last_became_peered":"2023-10-14T18:45:57.491939+0000","last_unstale":"2023-10-14T18:45:57.493266+0000","last_undegraded":"2023-10-14T18:45:57.493266+0000","last_fullsized":"2023-10-14T18:45:57.493266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:22.294283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.675734+0000","last_change":"2023-10-14T18:45:56.677084+0000","last_active":"2023-10-14T18:45:57.675734+0000","last_peered":"2023-10-14T18:45:57.675734+0000","last_clean":"2023-10-14T18:45:57.675734+0000","last_became_active":"2023-10-14T18:45:56.676417+0000","last_became_peered":"2023-10-14T18:45:56.676417+0000","last_unstale":"2023-10-14T18:45:57.675734+0000","last_undegraded":"2023-10-14T18:45:57.675734+0000","last_fullsized":"2023-10-14T18:45:57.675734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:52.275868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.487908+0000","last_change":"2023-10-14T18:45:57.486120+0000","last_active":"2023-10-14T18:45:57.487908+0000","last_peered":"2023-10-14T18:45:57.487908+0000","last_clean":"2023-10-14T18:45:57.487908+0000","last_became_active":"2023-10-14T18:45:57.485724+0000","last_became_peered":"2023-10-14T18:45:57.485724+0000","last_unstale":"2023-10-14T18:45:57.487908+0000","last_undegraded":"2023-10-14T18:45:57.487908+0000","last_fullsized":"2023-10-14T18:45:57.487908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:52.956123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674942+0000","last_change":"2023-10-14T18:45:56.677392+0000","last_active":"2023-10-14T18:45:57.674942+0000","last_peered":"2023-10-14T18:45:57.674942+0000","last_clean":"2023-10-14T18:45:57.674942+0000","last_became_active":"2023-10-14T18:45:56.677153+0000","last_became_peered":"2023-10-14T18:45:56.677153+0000","last_unstale":"2023-10-14T18:45:57.674942+0000","last_undegraded":"2023-10-14T18:45:57.674942+0000","last_fullsized":"2023-10-14T18:45:57.674942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:15.369240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489513+0000","last_change":"2023-10-14T18:45:57.489513+0000","last_active":"2023-10-14T18:45:57.489513+0000","last_peered":"2023-10-14T18:45:57.489513+0000","last_clean":"2023-10-14T18:45:57.489513+0000","last_became_active":"2023-10-14T18:45:57.489304+0000","last_became_peered":"2023-10-14T18:45:57.489304+0000","last_unstale":"2023-10-14T18:45:57.489513+0000","last_undegraded":"2023-10-14T18:45:57.489513+0000","last_fullsized":"2023-10-14T18:45:57.489513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:55.526470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484882+0000","last_change":"2023-10-14T18:45:56.677395+0000","last_active":"2023-10-14T18:45:57.484882+0000","last_peered":"2023-10-14T18:45:57.484882+0000","last_clean":"2023-10-14T18:45:57.484882+0000","last_became_active":"2023-10-14T18:45:56.677045+0000","last_became_peered":"2023-10-14T18:45:56.677045+0000","last_unstale":"2023-10-14T18:45:57.484882+0000","last_undegraded":"2023-10-14T18:45:57.484882+0000","last_fullsized":"2023-10-14T18:45:57.484882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:03.660262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491596+0000","last_change":"2023-10-14T18:45:57.491596+0000","last_active":"2023-10-14T18:45:57.491596+0000","last_peered":"2023-10-14T18:45:57.491596+0000","last_clean":"2023-10-14T18:45:57.491596+0000","last_became_active":"2023-10-14T18:45:57.491311+0000","last_became_peered":"2023-10-14T18:45:57.491311+0000","last_unstale":"2023-10-14T18:45:57.491596+0000","last_undegraded":"2023-10-14T18:45:57.491596+0000","last_fullsized":"2023-10-14T18:45:57.491596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:52.872089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674841+0000","last_change":"2023-10-14T18:45:56.676435+0000","last_active":"2023-10-14T18:45:57.674841+0000","last_peered":"2023-10-14T18:45:57.674841+0000","last_clean":"2023-10-14T18:45:57.674841+0000","last_became_active":"2023-10-14T18:45:56.676097+0000","last_became_peered":"2023-10-14T18:45:56.676097+0000","last_unstale":"2023-10-14T18:45:57.674841+0000","last_undegraded":"2023-10-14T18:45:57.674841+0000","last_fullsized":"2023-10-14T18:45:57.674841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.486920+0000","last_change":"2023-10-14T18:45:57.486920+0000","last_active":"2023-10-14T18:45:57.486920+0000","last_peered":"2023-10-14T18:45:57.486920+0000","last_clean":"2023-10-14T18:45:57.486920+0000","last_became_active":"2023-10-14T18:45:57.486578+0000","last_became_peered":"2023-10-14T18:45:57.486578+0000","last_unstale":"2023-10-14T18:45:57.486920+0000","last_undegraded":"2023-10-14T18:45:57.486920+0000","last_fullsized":"2023-10-14T18:45:57.486920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:53:53.283344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.676216+0000","last_change":"2023-10-14T18:45:56.676018+0000","last_active":"2023-10-14T18:45:56.676216+0000","last_peered":"2023-10-14T18:45:56.676216+0000","last_clean":"2023-10-14T18:45:56.676216+0000","last_became_active":"2023-10-14T18:45:56.675784+0000","last_became_peered":"2023-10-14T18:45:56.675784+0000","last_unstale":"2023-10-14T18:45:56.676216+0000","last_undegraded":"2023-10-14T18:45:56.676216+0000","last_fullsized":"2023-10-14T18:45:56.676216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:38.358280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484909+0000","last_change":"2023-10-14T18:45:57.484909+0000","last_active":"2023-10-14T18:45:57.484909+0000","last_peered":"2023-10-14T18:45:57.484909+0000","last_clean":"2023-10-14T18:45:57.484909+0000","last_became_active":"2023-10-14T18:45:57.484689+0000","last_became_peered":"2023-10-14T18:45:57.484689+0000","last_unstale":"2023-10-14T18:45:57.484909+0000","last_undegraded":"2023-10-14T18:45:57.484909+0000","last_fullsized":"2023-10-14T18:45:57.484909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:20.071784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492581+0000","last_change":"2023-10-14T18:45:56.676927+0000","last_active":"2023-10-14T18:45:57.492581+0000","last_peered":"2023-10-14T18:45:57.492581+0000","last_clean":"2023-10-14T18:45:57.492581+0000","last_became_active":"2023-10-14T18:45:56.676162+0000","last_became_peered":"2023-10-14T18:45:56.676162+0000","last_unstale":"2023-10-14T18:45:57.492581+0000","last_undegraded":"2023-10-14T18:45:57.492581+0000","last_fullsized":"2023-10-14T18:45:57.492581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:51.864613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488430+0000","last_change":"2023-10-14T18:45:57.488090+0000","last_active":"2023-10-14T18:45:57.488430+0000","last_peered":"2023-10-14T18:45:57.488430+0000","last_clean":"2023-10-14T18:45:57.488430+0000","last_became_active":"2023-10-14T18:45:57.487587+0000","last_became_peered":"2023-10-14T18:45:57.487587+0000","last_unstale":"2023-10-14T18:45:57.488430+0000","last_undegraded":"2023-10-14T18:45:57.488430+0000","last_fullsized":"2023-10-14T18:45:57.488430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:31:53.867064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484036+0000","last_change":"2023-10-14T18:45:56.680135+0000","last_active":"2023-10-14T18:45:57.484036+0000","last_peered":"2023-10-14T18:45:57.484036+0000","last_clean":"2023-10-14T18:45:57.484036+0000","last_became_active":"2023-10-14T18:45:56.679897+0000","last_became_peered":"2023-10-14T18:45:56.679897+0000","last_unstale":"2023-10-14T18:45:57.484036+0000","last_undegraded":"2023-10-14T18:45:57.484036+0000","last_fullsized":"2023-10-14T18:45:57.484036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.496002+0000","last_change":"2023-10-14T18:45:57.496002+0000","last_active":"2023-10-14T18:45:57.496002+0000","last_peered":"2023-10-14T18:45:57.496002+0000","last_clean":"2023-10-14T18:45:57.496002+0000","last_became_active":"2023-10-14T18:45:57.495818+0000","last_became_peered":"2023-10-14T18:45:57.495818+0000","last_unstale":"2023-10-14T18:45:57.496002+0000","last_undegraded":"2023-10-14T18:45:57.496002+0000","last_fullsized":"2023-10-14T18:45:57.496002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:39.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.674124+0000","last_change":"2023-10-14T18:45:56.680395+0000","last_active":"2023-10-14T18:45:57.674124+0000","last_peered":"2023-10-14T18:45:57.674124+0000","last_clean":"2023-10-14T18:45:57.674124+0000","last_became_active":"2023-10-14T18:45:56.680067+0000","last_became_peered":"2023-10-14T18:45:56.680067+0000","last_unstale":"2023-10-14T18:45:57.674124+0000","last_undegraded":"2023-10-14T18:45:57.674124+0000","last_fullsized":"2023-10-14T18:45:57.674124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:49:56.030213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.493235+0000","last_change":"2023-10-14T18:45:57.491070+0000","last_active":"2023-10-14T18:45:57.493235+0000","last_peered":"2023-10-14T18:45:57.493235+0000","last_clean":"2023-10-14T18:45:57.493235+0000","last_became_active":"2023-10-14T18:45:57.490456+0000","last_became_peered":"2023-10-14T18:45:57.490456+0000","last_unstale":"2023-10-14T18:45:57.493235+0000","last_undegraded":"2023-10-14T18:45:57.493235+0000","last_fullsized":"2023-10-14T18:45:57.493235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.676524+0000","last_change":"2023-10-14T18:45:56.676308+0000","last_active":"2023-10-14T18:45:56.676524+0000","last_peered":"2023-10-14T18:45:56.676524+0000","last_clean":"2023-10-14T18:45:56.676524+0000","last_became_active":"2023-10-14T18:45:56.675783+0000","last_became_peered":"2023-10-14T18:45:56.675783+0000","last_unstale":"2023-10-14T18:45:56.676524+0000","last_undegraded":"2023-10-14T18:45:56.676524+0000","last_fullsized":"2023-10-14T18:45:56.676524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:42.703342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490923+0000","last_change":"2023-10-14T18:45:57.490923+0000","last_active":"2023-10-14T18:45:57.490923+0000","last_peered":"2023-10-14T18:45:57.490923+0000","last_clean":"2023-10-14T18:45:57.490923+0000","last_became_active":"2023-10-14T18:45:57.490744+0000","last_became_peered":"2023-10-14T18:45:57.490744+0000","last_unstale":"2023-10-14T18:45:57.490923+0000","last_undegraded":"2023-10-14T18:45:57.490923+0000","last_fullsized":"2023-10-14T18:45:57.490923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480661+0000","last_change":"2023-10-14T18:45:56.677776+0000","last_active":"2023-10-14T18:45:57.480661+0000","last_peered":"2023-10-14T18:45:57.480661+0000","last_clean":"2023-10-14T18:45:57.480661+0000","last_became_active":"2023-10-14T18:45:56.677557+0000","last_became_peered":"2023-10-14T18:45:56.677557+0000","last_unstale":"2023-10-14T18:45:57.480661+0000","last_undegraded":"2023-10-14T18:45:57.480661+0000","last_fullsized":"2023-10-14T18:45:57.480661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:02.599292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490315+0000","last_change":"2023-10-14T18:45:57.490315+0000","last_active":"2023-10-14T18:45:57.490315+0000","last_peered":"2023-10-14T18:45:57.490315+0000","last_clean":"2023-10-14T18:45:57.490315+0000","last_became_active":"2023-10-14T18:45:57.490067+0000","last_became_peered":"2023-10-14T18:45:57.490067+0000","last_unstale":"2023-10-14T18:45:57.490315+0000","last_undegraded":"2023-10-14T18:45:57.490315+0000","last_fullsized":"2023-10-14T18:45:57.490315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:49:01.177719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.680993+0000","last_change":"2023-10-14T18:45:56.680950+0000","last_active":"2023-10-14T18:45:56.680993+0000","last_peered":"2023-10-14T18:45:56.680993+0000","last_clean":"2023-10-14T18:45:56.680993+0000","last_became_active":"2023-10-14T18:45:56.680794+0000","last_became_peered":"2023-10-14T18:45:56.680794+0000","last_unstale":"2023-10-14T18:45:56.680993+0000","last_undegraded":"2023-10-14T18:45:56.680993+0000","last_fullsized":"2023-10-14T18:45:56.680993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:31:27.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.491960+0000","last_change":"2023-10-14T18:45:57.491960+0000","last_active":"2023-10-14T18:45:57.491960+0000","last_peered":"2023-10-14T18:45:57.491960+0000","last_clean":"2023-10-14T18:45:57.491960+0000","last_became_active":"2023-10-14T18:45:57.491782+0000","last_became_peered":"2023-10-14T18:45:57.491782+0000","last_unstale":"2023-10-14T18:45:57.491960+0000","last_undegraded":"2023-10-14T18:45:57.491960+0000","last_fullsized":"2023-10-14T18:45:57.491960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:51.296925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.480504+0000","last_change":"2023-10-14T18:45:56.680301+0000","last_active":"2023-10-14T18:45:57.480504+0000","last_peered":"2023-10-14T18:45:57.480504+0000","last_clean":"2023-10-14T18:45:57.480504+0000","last_became_active":"2023-10-14T18:45:56.679766+0000","last_became_peered":"2023-10-14T18:45:56.679766+0000","last_unstale":"2023-10-14T18:45:57.480504+0000","last_undegraded":"2023-10-14T18:45:57.480504+0000","last_fullsized":"2023-10-14T18:45:57.480504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:31:27.137706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.490803+0000","last_change":"2023-10-14T18:45:57.490676+0000","last_active":"2023-10-14T18:45:57.490803+0000","last_peered":"2023-10-14T18:45:57.490803+0000","last_clean":"2023-10-14T18:45:57.490803+0000","last_became_active":"2023-10-14T18:45:57.490392+0000","last_became_peered":"2023-10-14T18:45:57.490392+0000","last_unstale":"2023-10-14T18:45:57.490803+0000","last_undegraded":"2023-10-14T18:45:57.490803+0000","last_fullsized":"2023-10-14T18:45:57.490803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:07:19.545664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.489986+0000","last_change":"2023-10-14T18:45:56.679431+0000","last_active":"2023-10-14T18:45:57.489986+0000","last_peered":"2023-10-14T18:45:57.489986+0000","last_clean":"2023-10-14T18:45:57.489986+0000","last_became_active":"2023-10-14T18:45:56.679169+0000","last_became_peered":"2023-10-14T18:45:56.679169+0000","last_unstale":"2023-10-14T18:45:57.489986+0000","last_undegraded":"2023-10-14T18:45:57.489986+0000","last_fullsized":"2023-10-14T18:45:57.489986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:09.897943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.492681+0000","last_change":"2023-10-14T18:45:57.491966+0000","last_active":"2023-10-14T18:45:57.492681+0000","last_peered":"2023-10-14T18:45:57.492681+0000","last_clean":"2023-10-14T18:45:57.492681+0000","last_became_active":"2023-10-14T18:45:57.491425+0000","last_became_peered":"2023-10-14T18:45:57.491425+0000","last_unstale":"2023-10-14T18:45:57.492681+0000","last_undegraded":"2023-10-14T18:45:57.492681+0000","last_fullsized":"2023-10-14T18:45:57.492681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:27:20.671974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.484345+0000","last_change":"2023-10-14T18:45:56.675136+0000","last_active":"2023-10-14T18:45:57.484345+0000","last_peered":"2023-10-14T18:45:57.484345+0000","last_clean":"2023-10-14T18:45:57.484345+0000","last_became_active":"2023-10-14T18:45:56.674783+0000","last_became_peered":"2023-10-14T18:45:56.674783+0000","last_unstale":"2023-10-14T18:45:57.484345+0000","last_undegraded":"2023-10-14T18:45:57.484345+0000","last_fullsized":"2023-10-14T18:45:57.484345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.488395+0000","last_change":"2023-10-14T18:45:57.487805+0000","last_active":"2023-10-14T18:45:57.488395+0000","last_peered":"2023-10-14T18:45:57.488395+0000","last_clean":"2023-10-14T18:45:57.488395+0000","last_became_active":"2023-10-14T18:45:57.486968+0000","last_became_peered":"2023-10-14T18:45:57.486968+0000","last_unstale":"2023-10-14T18:45:57.488395+0000","last_undegraded":"2023-10-14T18:45:57.488395+0000","last_fullsized":"2023-10-14T18:45:57.488395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:56.660461+0000","last_clean_scrub_stamp":"2023-10-14T18:45:56.660461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:37:08.049345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-14T18:45:56.679304+0000","last_change":"2023-10-14T18:45:56.679234+0000","last_active":"2023-10-14T18:45:56.679304+0000","last_peered":"2023-10-14T18:45:56.679304+0000","last_clean":"2023-10-14T18:45:56.679304+0000","last_became_active":"2023-10-14T18:45:56.678964+0000","last_became_peered":"2023-10-14T18:45:56.678964+0000","last_unstale":"2023-10-14T18:45:56.679304+0000","last_undegraded":"2023-10-14T18:45:56.679304+0000","last_fullsized":"2023-10-14T18:45:56.679304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:45:55.652985+0000","last_clean_scrub_stamp":"2023-10-14T18:45:55.652985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:48:02.599292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T18:45:57.481233+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:45:57.481233+0000","last_peered":"2023-10-14T18:45:57.481233+0000","last_clean":"2023-10-14T18:45:57.481233+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:45:57.481233+0000","last_undegraded":"2023-10-14T18:45:57.481233+0000","last_fullsized":"2023-10-14T18:45:57.481233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199282276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199283377,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.253}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.28799999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.371},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.71199999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.625}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71099999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872090,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53600000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:46:02.101 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:46:02.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:46:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.255+0000 7f6beee8d700 1 Processor -- start 2023-10-14T18:46:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.255+0000 7f6beee8d700 1 -- start start 2023-10-14T18:46:02.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6beee8d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6be815a290 0x7f6be806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6beee8d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 0x7f6be80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6beee8d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80b0790 con 0x7f6be8159ec0 2023-10-14T18:46:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6beee8d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be806af60 con 0x7f6be815a290 2023-10-14T18:46:02.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6beee8d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80ce1f0 con 0x7f6be806aae0 2023-10-14T18:46:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6be7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6be815a290 0x7f6be806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6becc29700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6be8159ec0 0x7f6be80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45160/0 (socket says 172.21.15.79:45160) 2023-10-14T18:46:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6becc29700 1 -- 172.21.15.79:0/464425233 learned_addr learned my addr 172.21.15.79:0/464425233 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.256+0000 7f6bed42a700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 0x7f6be80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be7fff700 1 -- 172.21.15.79:0/464425233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 msgr2=0x7f6be80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be7fff700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 0x7f6be80cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be7fff700 1 -- 172.21.15.79:0/464425233 >> v1:172.21.15.79:6789/0 conn(0x7f6be8159ec0 legacy=0x7f6be80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be77fe700 1 -- 172.21.15.79:0/464425233 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077642689 0 0) 0x7f6be80b0790 con 0x7f6be8159ec0 2023-10-14T18:46:02.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be7fff700 1 -- 172.21.15.79:0/464425233 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be80b0b20 con 0x7f6be815a290 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6bed42a700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 0x7f6be80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be7fff700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be815a290 0x7f6be806a5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0098e0 tx=0x7f6bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529b95a3fe8d88bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be77fe700 1 -- 172.21.15.79:0/464425233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc009e80 con 0x7f6be815a290 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be77fe700 1 -- 172.21.15.79:0/464425233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc00b860 con 0x7f6be815a290 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6be77fe700 1 -- 172.21.15.79:0/464425233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00bbe0 con 0x7f6be815a290 2023-10-14T18:46:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6beee8d700 1 -- 172.21.15.79:0/464425233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be815a290 msgr2=0x7f6be806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6beee8d700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be815a290 0x7f6be806a5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0098e0 tx=0x7f6bdc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6beee8d700 1 -- 172.21.15.79:0/464425233 shutdown_connections 2023-10-14T18:46:02.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6beee8d700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be806aae0 0x7f6be80cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.257+0000 7f6beee8d700 1 --2- 172.21.15.79:0/464425233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be815a290 0x7f6be806a5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.258+0000 7f6beee8d700 1 -- 172.21.15.79:0/464425233 >> 172.21.15.79:0/464425233 conn(0x7f6be80d1880 msgr2=0x7f6be80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:02.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.258+0000 7f6beee8d700 1 -- 172.21.15.79:0/464425233 shutdown_connections 2023-10-14T18:46:02.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.258+0000 7f6beee8d700 1 -- 172.21.15.79:0/464425233 wait complete. 2023-10-14T18:46:02.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 Processor -- start 2023-10-14T18:46:02.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 -- start start 2023-10-14T18:46:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be8159ec0 0x7f6be80b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be815a290 0x7f6be80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815ade0 con 0x7f6be806aae0 2023-10-14T18:46:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80b6a00 con 0x7f6be8159ec0 2023-10-14T18:46:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.259+0000 7f6beee8d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80b1e30 con 0x7f6be815a290 2023-10-14T18:46:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40236/0 (socket says 172.21.15.79:40236) 2023-10-14T18:46:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 -- 172.21.15.79:0/3523037862 learned_addr learned my addr 172.21.15.79:0/3523037862 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6be7fff700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be8159ec0 0x7f6be80b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 -- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be815a290 msgr2=0x7f6be80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be815a290 0x7f6be80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 -- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be8159ec0 msgr2=0x7f6be80b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be8159ec0 0x7f6be80b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 -- 172.21.15.79:0/3523037862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009420 con 0x7f6be806aae0 2023-10-14T18:46:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6becc29700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800cd80 tx=0x7f6bd8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800ab10 con 0x7f6be806aae0 2023-10-14T18:46:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd800ac70 con 0x7f6be806aae0 2023-10-14T18:46:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80070f0 con 0x7f6be806aae0 2023-10-14T18:46:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be80b2110 con 0x7f6be806aae0 2023-10-14T18:46:02.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.260+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be80b26d0 con 0x7f6be806aae0 2023-10-14T18:46:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.261+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be804c3c0 con 0x7f6be806aae0 2023-10-14T18:46:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.261+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bd80074e0 con 0x7f6be806aae0 2023-10-14T18:46:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.262+0000 7f6be4ff9700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.262+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bd8084a30 con 0x7f6be806aae0 2023-10-14T18:46:02.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.262+0000 7f6be7fff700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.262+0000 7f6be7fff700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 0x7f6bd40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6be815ac80 tx=0x7f6bdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.266+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bd8051d20 con 0x7f6be806aae0 2023-10-14T18:46:02.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.519+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6be80b04b0 con 0x7f6be806aae0 2023-10-14T18:46:02.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.523+0000 7f6be4ff9700 1 -- 172.21.15.79:0/3523037862 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6bd8055340 con 0x7f6be806aae0 2023-10-14T18:46:02.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 msgr2=0x7f6bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 0x7f6bd40693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6be815ac80 tx=0x7f6bdc017000 comp rx=0 tx=0).stop 2023-10-14T18:46:02.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 msgr2=0x7f6be80b17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800cd80 tx=0x7f6bd8001ae0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 shutdown_connections 2023-10-14T18:46:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bd4066f30 0x7f6bd40693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6be815a290 0x7f6be80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be806aae0 0x7f6be80b17e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 --2- 172.21.15.79:0/3523037862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6be8159ec0 0x7f6be80b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 >> 172.21.15.79:0/3523037862 conn(0x7f6be80d1880 msgr2=0x7f6be80cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 shutdown_connections 2023-10-14T18:46:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.525+0000 7f6beee8d700 1 -- 172.21.15.79:0/3523037862 wait complete. 2023-10-14T18:46:02.528 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:46:02.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:02.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.650+0000 7f589793e700 1 Processor -- start 2023-10-14T18:46:02.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.650+0000 7f589793e700 1 -- start start 2023-10-14T18:46:02.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f589793e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f589015a620 0x7f589015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f589793e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 0x7f5890158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f589793e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589015cbb0 con 0x7f5890157870 2023-10-14T18:46:02.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f589793e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589015bdb0 con 0x7f589015a620 2023-10-14T18:46:02.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f589793e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589015bfa0 con 0x7f589015d580 2023-10-14T18:46:02.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f5894ed9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f589015a620 0x7f589015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f58956da700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5890157870 0x7f589015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45164/0 (socket says 172.21.15.79:45164) 2023-10-14T18:46:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f58956da700 1 -- 172.21.15.79:0/661051502 learned_addr learned my addr 172.21.15.79:0/661051502 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f5895edb700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 0x7f5890158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.651+0000 7f5894ed9700 1 -- 172.21.15.79:0/661051502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 msgr2=0x7f5890158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5894ed9700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 0x7f5890158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5887fff700 1 -- 172.21.15.79:0/661051502 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403339292 0 0) 0x7f589015cbb0 con 0x7f5890157870 2023-10-14T18:46:02.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5894ed9700 1 -- 172.21.15.79:0/661051502 >> v1:172.21.15.79:6789/0 conn(0x7f5890157870 legacy=0x7f589015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5894ed9700 1 -- 172.21.15.79:0/661051502 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589015c280 con 0x7f589015a620 2023-10-14T18:46:02.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5895edb700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 0x7f5890158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:02.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5894ed9700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015a620 0x7f589015d040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f58800098e0 tx=0x7f58800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6bb41ed250af17 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5887fff700 1 -- 172.21.15.79:0/661051502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880009e80 con 0x7f589015a620 2023-10-14T18:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5887fff700 1 -- 172.21.15.79:0/661051502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000b860 con 0x7f589015a620 2023-10-14T18:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f5887fff700 1 -- 172.21.15.79:0/661051502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000bbe0 con 0x7f589015a620 2023-10-14T18:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 -- 172.21.15.79:0/661051502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015a620 msgr2=0x7f589015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015a620 0x7f589015d040 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f58800098e0 tx=0x7f58800091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 -- 172.21.15.79:0/661051502 shutdown_connections 2023-10-14T18:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f589015d580 0x7f5890158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 --2- 172.21.15.79:0/661051502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015a620 0x7f589015d040 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 -- 172.21.15.79:0/661051502 >> 172.21.15.79:0/661051502 conn(0x7f5890068ce0 msgr2=0x7f58900690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 -- 172.21.15.79:0/661051502 shutdown_connections 2023-10-14T18:46:02.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.652+0000 7f589793e700 1 -- 172.21.15.79:0/661051502 wait complete. 2023-10-14T18:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 Processor -- start 2023-10-14T18:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 -- start start 2023-10-14T18:46:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5890157870 0x7f589014bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 0x7f5890154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589014d680 con 0x7f589015d580 2023-10-14T18:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b1310 con 0x7f589015a620 2023-10-14T18:46:02.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.654+0000 7f589793e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b15f0 con 0x7f5890157870 2023-10-14T18:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40246/0 (socket says 172.21.15.79:40246) 2023-10-14T18:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 -- 172.21.15.79:0/1288849755 learned_addr learned my addr 172.21.15.79:0/1288849755 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5894ed9700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 0x7f5890154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f58956da700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5890157870 0x7f589014bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 -- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5890157870 msgr2=0x7f589014bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5890157870 0x7f589014bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 -- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 msgr2=0x7f5890154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 0x7f5890154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 -- 172.21.15.79:0/1288849755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880009420 con 0x7f589015d580 2023-10-14T18:46:02.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5894ed9700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 0x7f5890154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f5895edb700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f588800cef0 tx=0x7f5888007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800ae00 con 0x7f589015d580 2023-10-14T18:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888016420 con 0x7f589015d580 2023-10-14T18:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589014d920 con 0x7f589015d580 2023-10-14T18:46:02.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880167e0 con 0x7f589015d580 2023-10-14T18:46:02.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.655+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589014c140 con 0x7f589015d580 2023-10-14T18:46:02.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.656+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589014d4e0 con 0x7f589015d580 2023-10-14T18:46:02.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.656+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5888016bd0 con 0x7f589015d580 2023-10-14T18:46:02.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.657+0000 7f58857fa700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:02.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.657+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5888012070 con 0x7f589015d580 2023-10-14T18:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.657+0000 7f58956da700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.657+0000 7f58956da700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 0x7f58740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f588c0011e0 tx=0x7f588c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.661+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f588804e5a0 con 0x7f589015d580 2023-10-14T18:46:02.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.888+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f589014db60 con 0x7f589015d580 2023-10-14T18:46:02.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.888+0000 7f58857fa700 1 -- 172.21.15.79:0/1288849755 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f589014d4e0 con 0x7f589015d580 2023-10-14T18:46:02.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:02.889 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 msgr2=0x7f58740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 0x7f58740693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f588c0011e0 tx=0x7f588c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 msgr2=0x7f58901550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:02.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f588800cef0 tx=0x7f5888007830 comp rx=0 tx=0).stop 2023-10-14T18:46:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 shutdown_connections 2023-10-14T18:46:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f589015d580 0x7f58901550f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5890157870 0x7f589014bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 --2- 172.21.15.79:0/1288849755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f589015a620 0x7f5890154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 >> 172.21.15.79:0/1288849755 conn(0x7f5890068ce0 msgr2=0x7f5890159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 shutdown_connections 2023-10-14T18:46:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:02.890+0000 7f589793e700 1 -- 172.21.15.79:0/1288849755 wait complete. 2023-10-14T18:46:02.893 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:03.305 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:45:57.046397+0000', 'modified': '2023-10-14T18:46:00.687957+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4908': {'gid': 4908, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/3482587976', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 3482587976}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 3482587976}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:46:03.305 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:46:03.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T18:46:03.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.421+0000 7f8a72211700 1 Processor -- start 2023-10-14T18:46:03.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.421+0000 7f8a72211700 1 -- start start 2023-10-14T18:46:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.421+0000 7f8a72211700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a6c0b0890 0x7f8a6c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.421+0000 7f8a72211700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a6c0cbd40 0x7f8a6c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a72211700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6c0cb370 con 0x7f8a6c06c630 2023-10-14T18:46:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a72211700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c0b0c60 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a72211700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6c06a1e0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a6c0cbd40 0x7f8a6c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8a6c0cbd40 0x7f8a6c067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40256/0 (socket says 172.21.15.79:40256) 2023-10-14T18:46:03.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1779769551 learned_addr learned my addr 172.21.15.79:0/1779769551 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/1779769551 >> v2:172.21.15.144:3300/0 conn(0x7f8a6c0b0890 0x7f8a6c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1779769551 >> v2:172.21.15.144:3300/0 conn(0x7f8a6c0b0890 msgr2=0x7f8a6c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/1779769551 >> v2:172.21.15.144:3300/0 conn(0x7f8a6c0b0890 0x7f8a6c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1779769551 >> v1:172.21.15.144:6789/0 conn(0x7f8a6c06c630 legacy=0x7f8a6c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1779769551 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c06cb80 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/1779769551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0cbd40 0x7f8a6c067660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06aae0 tx=0x7f8a54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543701cbfdd345f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a6affd700 1 -- 172.21.15.79:0/1779769551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400b820 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a6affd700 1 -- 172.21.15.79:0/1779769551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5400b980 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.422+0000 7f8a6affd700 1 -- 172.21.15.79:0/1779769551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400bd20 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 -- 172.21.15.79:0/1779769551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0cbd40 msgr2=0x7f8a6c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 --2- 172.21.15.79:0/1779769551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0cbd40 0x7f8a6c067660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c06aae0 tx=0x7f8a54009250 comp rx=0 tx=0).stop 2023-10-14T18:46:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 -- 172.21.15.79:0/1779769551 shutdown_connections 2023-10-14T18:46:03.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 --2- 172.21.15.79:0/1779769551 >> v2:172.21.15.144:3300/0 conn(0x7f8a6c0b0890 0x7f8a6c0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 --2- 172.21.15.79:0/1779769551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0cbd40 0x7f8a6c067660 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 -- 172.21.15.79:0/1779769551 >> 172.21.15.79:0/1779769551 conn(0x7f8a6c06fe50 msgr2=0x7f8a6c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 -- 172.21.15.79:0/1779769551 shutdown_connections 2023-10-14T18:46:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.423+0000 7f8a72211700 1 -- 172.21.15.79:0/1779769551 wait complete. 2023-10-14T18:46:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.424+0000 7f8a72211700 1 Processor -- start 2023-10-14T18:46:03.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.424+0000 7f8a72211700 1 -- start start 2023-10-14T18:46:03.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a6c06c630 0x7f8a6c0ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a6c0cbd40 0x7f8a6c16dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0add60 con 0x7f8a6c0b0890 2023-10-14T18:46:03.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c0c7c10 con 0x7f8a6c06c630 2023-10-14T18:46:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a72211700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c14c700 con 0x7f8a6c0cbd40 2023-10-14T18:46:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40264/0 (socket says 172.21.15.79:40264) 2023-10-14T18:46:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 -- 172.21.15.79:0/3612464332 learned_addr learned my addr 172.21.15.79:0/3612464332 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a6c06c630 0x7f8a6c0ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a6c0cbd40 0x7f8a6c16dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 -- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a6c0cbd40 msgr2=0x7f8a6c16dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a6c0cbd40 0x7f8a6c16dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 -- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a6c06c630 msgr2=0x7f8a6c0ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a6c06c630 0x7f8a6c0ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 -- 172.21.15.79:0/3612464332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540094f0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a540030c0 tx=0x7f8a54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.425+0000 7f8a63fff700 1 -- 172.21.15.79:0/3612464332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54011db0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.426+0000 7f8a63fff700 1 -- 172.21.15.79:0/3612464332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a54020070 con 0x7f8a6c0b0890 2023-10-14T18:46:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.426+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c0aae30 con 0x7f8a6c0b0890 2023-10-14T18:46:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.426+0000 7f8a63fff700 1 -- 172.21.15.79:0/3612464332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5401b6a0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.426+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c0ab3f0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.427+0000 7f8a63fff700 1 -- 172.21.15.79:0/3612464332 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a54022030 con 0x7f8a6c0b0890 2023-10-14T18:46:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.427+0000 7f8a63fff700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 0x7f8a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.427+0000 7f8a63fff700 1 -- 172.21.15.79:0/3612464332 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a540864d0 con 0x7f8a6c0b0890 2023-10-14T18:46:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.428+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 0x7f8a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.428+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 0x7f8a4c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.429+0000 7f8a7b50ab80 1 Processor -- start 2023-10-14T18:46:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.429+0000 7f8a7b50ab80 1 -- start start 2023-10-14T18:46:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3526a70 con 0x55d1c35f8f60 2023-10-14T18:46:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3524270 con 0x55d1c3619d00 2023-10-14T18:46:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3520060 con 0x55d1c35cfa50 2023-10-14T18:46:03.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40278/0 (socket says 172.21.15.79:40278) 2023-10-14T18:46:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6bfff700 1 -- 172.21.15.79:0/3862287412 learned_addr learned my addr 172.21.15.79:0/3862287412 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6bfff700 1 -- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 msgr2=0x55d1c35cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.430+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a6bfff700 1 -- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 msgr2=0x55d1c35f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a6bfff700 1 -- 172.21.15.79:0/3862287412 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1c33ba270 con 0x55d1c35f8f60 2023-10-14T18:46:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a64001300 tx=0x7f8a64009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a732f99b6dd54a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a60ff9700 1 -- 172.21.15.79:0/3862287412 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64013360 con 0x55d1c35f8f60 2023-10-14T18:46:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a60ff9700 1 -- 172.21.15.79:0/3862287412 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a640134c0 con 0x55d1c35f8f60 2023-10-14T18:46:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a60ff9700 1 -- 172.21.15.79:0/3862287412 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64013880 con 0x55d1c35f8f60 2023-10-14T18:46:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/3862287412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 msgr2=0x55d1c35cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.431+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a64001300 tx=0x7f8a64009940 comp rx=0 tx=0).stop 2023-10-14T18:46:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/3862287412 shutdown_connections 2023-10-14T18:46:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c35cbcf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/3862287412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/3862287412 >> 172.21.15.79:0/3862287412 conn(0x55d1c35d1370 msgr2=0x55d1c35d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/3862287412 shutdown_connections 2023-10-14T18:46:03.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/3862287412 wait complete. 2023-10-14T18:46:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 -- start start 2023-10-14T18:46:03.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.432+0000 7f8a7b50ab80 1 Processor -- start 2023-10-14T18:46:03.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3611e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c360fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c34cb890 con 0x55d1c35cfa50 2023-10-14T18:46:03.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c34e6ea0 con 0x55d1c3619d00 2023-10-14T18:46:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1c33a2e30 con 0x55d1c35f8f60 2023-10-14T18:46:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a7b50ab80 10 client.0 _ll_register_callbacks cb 0x55d1c3593110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:46:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40290/0 (socket says 172.21.15.79:40290) 2023-10-14T18:46:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2859717548 learned_addr learned my addr 172.21.15.79:0/2859717548 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3611e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c360fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 msgr2=0x55d1c3611e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3611e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 msgr2=0x55d1c360fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c360fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.433+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2859717548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a64009c00 con 0x55d1c35cfa50 2023-10-14T18:46:03.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c016bb0 tx=0x7f8a5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0e1d1368f5c29e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:46:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c010e80 con 0x55d1c35cfa50 2023-10-14T18:46:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a5c0107e0 con 0x55d1c35cfa50 2023-10-14T18:46:03.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1c35c4b70 con 0x55d1c35cfa50 2023-10-14T18:46:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a5c014ce0 con 0x55d1c35cfa50 2023-10-14T18:46:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 10 client.5097 fetch_fsmap learned FSMap version 17 2023-10-14T18:46:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1c335cfe0 con 0x55d1c35cfa50 2023-10-14T18:46:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1c35c4b70 con 0x55d1c35cfa50 2023-10-14T18:46:03.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a5c02b440 con 0x55d1c35cfa50 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 10 client.5097 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 20 client.5097 populate_metadata read hostname 'smithi079' 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c35fe840 0x55d1c35fec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 4 client.5097 mds_command: new command op to 4908 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:46:03.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 --> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1c35a1aa0 con 0x55d1c35fe840 2023-10-14T18:46:03.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.434+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c35fe840 0x55d1c35fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a49ffb700 10 client.5097 ms_handle_connect on v2:172.21.15.79:6832/3482587976 2023-10-14T18:46:03.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c35fe840 0x55d1c35fec10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7793fa6349ea14d server_cookie=db465aff62ea7dc4 in_seq=0 out_seq=0 2023-10-14T18:46:03.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a49ffb700 1 -- 172.21.15.79:0/2859717548 <== mds.0 v2:172.21.15.79:6832/3482587976 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d1c35a1aa0 con 0x55d1c35fe840 2023-10-14T18:46:03.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a49ffb700 10 client.5097 handle_command_reply: tid=0 2023-10-14T18:46:03.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 client.5097 shutdown 2023-10-14T18:46:03.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 msgr2=0x55d1c3614100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c016bb0 tx=0x7f8a5c017000 comp rx=0 tx=0).stop 2023-10-14T18:46:03.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 shutdown_connections 2023-10-14T18:46:03.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c35fe840 0x55d1c35fec10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c360fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a49ffb700 0 client.5097 ms_handle_reset on v2:172.21.15.79:6832/3482587976 2023-10-14T18:46:03.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c3614100 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2859717548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3611e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 >> 172.21.15.79:0/2859717548 conn(0x55d1c35d1370 msgr2=0x55d1c35d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 shutdown_connections 2023-10-14T18:46:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2859717548 wait complete. 2023-10-14T18:46:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.435+0000 7f8a7b50ab80 20 client.5097 trim_cache size 0 max 16384 2023-10-14T18:46:03.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.452+0000 7f8a7b50ab80 1 Processor -- start 2023-10-14T18:46:03.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.452+0000 7f8a7b50ab80 1 -- start start 2023-10-14T18:46:03.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3626530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c35cb5f0 con 0x55d1c35cfa50 2023-10-14T18:46:03.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c35ff600 con 0x55d1c3619d00 2023-10-14T18:46:03.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1c35a8410 con 0x55d1c35f8f60 2023-10-14T18:46:03.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40294/0 (socket says 172.21.15.79:40294) 2023-10-14T18:46:03.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2621882362 learned_addr learned my addr 172.21.15.79:0/2621882362 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3626530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 msgr2=0x55d1c3626530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3626530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 msgr2=0x55d1c35cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 -- 172.21.15.79:0/2621882362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1c34ee780 con 0x55d1c35cfa50 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3626530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c007640 tx=0x7f8a5c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d67203e2556898 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a617fa700 1 -- 172.21.15.79:0/2621882362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c010e80 con 0x55d1c35cfa50 2023-10-14T18:46:03.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.453+0000 7f8a617fa700 1 -- 172.21.15.79:0/2621882362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c02b9a0 con 0x55d1c35cfa50 2023-10-14T18:46:03.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a617fa700 1 -- 172.21.15.79:0/2621882362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c02b440 con 0x55d1c35cfa50 2023-10-14T18:46:03.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2621882362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 msgr2=0x55d1c36194e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c007640 tx=0x7f8a5c01a000 comp rx=0 tx=0).stop 2023-10-14T18:46:03.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2621882362 shutdown_connections 2023-10-14T18:46:03.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c35cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35cfa50 0x55d1c36194e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/2621882362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35f8f60 0x55d1c3626530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2621882362 >> 172.21.15.79:0/2621882362 conn(0x55d1c35d1370 msgr2=0x55d1c360fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2621882362 shutdown_connections 2023-10-14T18:46:03.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.454+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/2621882362 wait complete. 2023-10-14T18:46:03.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 -- start start 2023-10-14T18:46:03.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 Processor -- start 2023-10-14T18:46:03.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c3615380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3637a40 con 0x55d1c35f8f60 2023-10-14T18:46:03.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3630100 con 0x55d1c3619d00 2023-10-14T18:46:03.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1c3630350 con 0x55d1c35cfa50 2023-10-14T18:46:03.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a7b50ab80 10 client.0 _ll_register_callbacks cb 0x55d1c3593110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:46:03.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.455+0000 7f8a62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40300/0 (socket says 172.21.15.79:40300) 2023-10-14T18:46:03.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1207755352 learned_addr learned my addr 172.21.15.79:0/1207755352 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a6bfff700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c3615380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 msgr2=0x55d1c35ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 msgr2=0x55d1c3615380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c3615380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 -- 172.21.15.79:0/1207755352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1c335cfe0 con 0x55d1c35f8f60 2023-10-14T18:46:03.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a62ffd700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a540572f0 tx=0x7f8a54086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c776f71388f654a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:46:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54071060 con 0x55d1c35f8f60 2023-10-14T18:46:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a54057360 con 0x55d1c35f8f60 2023-10-14T18:46:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a640134c0 con 0x55d1c35f8f60 2023-10-14T18:46:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a5405a5b0 con 0x55d1c35f8f60 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 10 client.5103 fetch_fsmap learned FSMap version 17 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1c34d5470 con 0x55d1c35f8f60 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a640134c0 con 0x55d1c35f8f60 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a54053a70 con 0x55d1c35f8f60 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 10 client.5103 fetch_fsmap finished waiting for FSMap version 17 2023-10-14T18:46:03.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 10 client.5103 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:46:03.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 20 client.5103 populate_metadata read hostname 'smithi079' 2023-10-14T18:46:03.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c36182c0 0x55d1c3618690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 4 client.5103 mds_command: new command op to 4908 tid=0[{"prefix": "status"}] 2023-10-14T18:46:03.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.456+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 --> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d1c34c2e00 con 0x55d1c36182c0 2023-10-14T18:46:03.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c36182c0 0x55d1c3618690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a49ffb700 10 client.5103 ms_handle_connect on v2:172.21.15.79:6832/3482587976 2023-10-14T18:46:03.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a6b7fe700 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c36182c0 0x55d1c3618690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56ccca7662ce8963 server_cookie=49b117c2ec5af98e in_seq=0 out_seq=0 2023-10-14T18:46:03.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a49ffb700 1 -- 172.21.15.79:0/1207755352 <== mds.0 v2:172.21.15.79:6832/3482587976 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d1c34c2e00 con 0x55d1c36182c0 2023-10-14T18:46:03.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a49ffb700 10 client.5103 handle_command_reply: tid=0 2023-10-14T18:46:03.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 client.5103 shutdown 2023-10-14T18:46:03.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 msgr2=0x55d1c367c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a540572f0 tx=0x7f8a54086040 comp rx=0 tx=0).stop 2023-10-14T18:46:03.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 shutdown_connections 2023-10-14T18:46:03.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:6832/3482587976,v1:172.21.15.79:6835/3482587976] conn(0x55d1c36182c0 0x55d1c3618690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1c3619d00 0x55d1c3615380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a49ffb700 0 client.5103 ms_handle_reset on v2:172.21.15.79:6832/3482587976 2023-10-14T18:46:03.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d1c35cfa50 0x55d1c35ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 --2- 172.21.15.79:0/1207755352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d1c35f8f60 0x55d1c367c130 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 >> 172.21.15.79:0/1207755352 conn(0x55d1c35d1370 msgr2=0x55d1c35cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 shutdown_connections 2023-10-14T18:46:03.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 1 -- 172.21.15.79:0/1207755352 wait complete. 2023-10-14T18:46:03.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.457+0000 7f8a7b50ab80 20 client.5103 trim_cache size 0 max 16384 2023-10-14T18:46:03.495 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:03.496 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:03.496 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:46:03.496 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4908, 2023-10-14T18:46:03.496 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:46:03.497 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:46:03.497 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:46:03.497 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.789460547, 2023-10-14T18:46:03.497 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 17, 2023-10-14T18:46:03.497 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 31, 2023-10-14T18:46:03.498 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 31, 2023-10-14T18:46:03.498 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.690048195999999 2023-10-14T18:46:03.498 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:03.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 msgr2=0x7f8a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 0x7f8a4c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c008040 comp rx=0 tx=0).stop 2023-10-14T18:46:03.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 msgr2=0x7f8a6c14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a540030c0 tx=0x7f8a54016000 comp rx=0 tx=0).stop 2023-10-14T18:46:03.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 shutdown_connections 2023-10-14T18:46:03.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8a4c066f30 0x7f8a4c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a6c0cbd40 0x7f8a6c16dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a6c06c630 0x7f8a6c0ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 --2- 172.21.15.79:0/3612464332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a6c0b0890 0x7f8a6c14c1c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 >> 172.21.15.79:0/3612464332 conn(0x7f8a6c06fe50 msgr2=0x7f8a6c0b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 shutdown_connections 2023-10-14T18:46:03.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.458+0000 7f8a72211700 1 -- 172.21.15.79:0/3612464332 wait complete. 2023-10-14T18:46:03.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:46:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.617+0000 7fe493fff700 1 Processor -- start 2023-10-14T18:46:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.617+0000 7fe493fff700 1 -- start start 2023-10-14T18:46:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe493fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe4940cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe493fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940cb7c0 con 0x7fe4940cdab0 2023-10-14T18:46:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe493fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49415e290 con 0x7fe49415cbd0 2023-10-14T18:46:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe493fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415e850 con 0x7fe4940cd6e0 2023-10-14T18:46:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe48a7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe4940cdab0 0x7fe49415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45170/0 (socket says 172.21.15.79:45170) 2023-10-14T18:46:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe48a7fc700 1 -- 172.21.15.79:0/270540139 learned_addr learned my addr 172.21.15.79:0/270540139 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe492ffd700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe4940cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891699548 0 0) 0x7fe4940cb7c0 con 0x7fe4940cdab0 2023-10-14T18:46:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.618+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe480003570 con 0x7fe4940cdab0 2023-10-14T18:46:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1561141206 0 0) 0x7fe480003570 con 0x7fe4940cdab0 2023-10-14T18:46:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 msgr2=0x7fe4940cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe4940cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 >> v1:172.21.15.144:6789/0 conn(0x7fe49415cbd0 legacy=0x7fe49415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49415e570 con 0x7fe4940cdab0 2023-10-14T18:46:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe47c001470 con 0x7fe4940cdab0 2023-10-14T18:46:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 >> v1:172.21.15.79:6789/0 conn(0x7fe4940cdab0 legacy=0x7fe49415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe480003a90 0x7fe480003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe480004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe480004d50 0x7fe4800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415e850 con 0x7fe480004d50 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48000bb10 con 0x7fe480003a90 2023-10-14T18:46:03.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48000bcd0 con 0x7fe4940cd6e0 2023-10-14T18:46:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe480004d50 0x7fe4800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe48a7fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe480004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe492ffd700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe480003a90 0x7fe480003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 -- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 msgr2=0x7fe480004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe480004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 -- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe480003a90 msgr2=0x7fe480003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe480003a90 0x7fe480003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 -- 172.21.15.79:0/270540139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480003570 con 0x7fe480004d50 2023-10-14T18:46:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe48a7fc700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe4940cd6e0 0x7fe480004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4937fe700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe480004d50 0x7fe4800051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0020a0 tx=0x7fe48c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64890b8f32cf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0019e0 con 0x7fe480004d50 2023-10-14T18:46:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c00c8b0 con 0x7fe480004d50 2023-10-14T18:46:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.619+0000 7fe4927fc700 1 -- 172.21.15.79:0/270540139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00cc50 con 0x7fe480004d50 2023-10-14T18:46:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 -- 172.21.15.79:0/270540139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe480004d50 msgr2=0x7fe4800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 --2- 172.21.15.79:0/270540139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe480004d50 0x7fe4800051c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0020a0 tx=0x7fe48c0016d0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe4937fe700 1 -- 172.21.15.79:0/270540139 reap_dead start 2023-10-14T18:46:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 -- 172.21.15.79:0/270540139 shutdown_connections 2023-10-14T18:46:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 -- 172.21.15.79:0/270540139 >> 172.21.15.79:0/270540139 conn(0x7fe494067660 msgr2=0x7fe494067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 -- 172.21.15.79:0/270540139 shutdown_connections 2023-10-14T18:46:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.620+0000 7fe493fff700 1 -- 172.21.15.79:0/270540139 wait complete. 2023-10-14T18:46:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.621+0000 7fe493fff700 1 Processor -- start 2023-10-14T18:46:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.621+0000 7fe493fff700 1 -- start start 2023-10-14T18:46:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe494160000 0x7fe4940b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe49416e120 0x7fe49414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b6170 con 0x7fe49415fc30 2023-10-14T18:46:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49416dc90 con 0x7fe494160000 2023-10-14T18:46:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe493fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b3150 con 0x7fe49416e120 2023-10-14T18:46:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40322/0 (socket says 172.21.15.79:40322) 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 -- 172.21.15.79:0/204732882 learned_addr learned my addr 172.21.15.79:0/204732882 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe48a7fc700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe494160000 0x7fe4940b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe4937fe700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe49416e120 0x7fe49414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 -- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe49416e120 msgr2=0x7fe49414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe49416e120 0x7fe49414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 -- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe494160000 msgr2=0x7fe4940b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe494160000 0x7fe4940b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 -- 172.21.15.79:0/204732882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940b5bb0 con 0x7fe49415fc30 2023-10-14T18:46:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe492ffd700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe484011960 tx=0x7fe484008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.622+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484015670 con 0x7fe49415fc30 2023-10-14T18:46:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.623+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4840157f0 con 0x7fe49415fc30 2023-10-14T18:46:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.623+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940b5e90 con 0x7fe49415fc30 2023-10-14T18:46:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.623+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484015bb0 con 0x7fe49415fc30 2023-10-14T18:46:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.623+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49416e5c0 con 0x7fe49415fc30 2023-10-14T18:46:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.623+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49416d780 con 0x7fe49415fc30 2023-10-14T18:46:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.624+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe484013410 con 0x7fe49415fc30 2023-10-14T18:46:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.624+0000 7fe48b7fe700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.624+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe484084cd0 con 0x7fe49415fc30 2023-10-14T18:46:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.625+0000 7fe48a7fc700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.625+0000 7fe48a7fc700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 0x7fe4740693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe47c001c20 tx=0x7fe47c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.629+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe49416d780 con 0x7fe49415fc30 2023-10-14T18:46:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.853+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe49416d780 con 0x7fe49415fc30 2023-10-14T18:46:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.854+0000 7fe48b7fe700 1 -- 172.21.15.79:0/204732882 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe49416d780 con 0x7fe49415fc30 2023-10-14T18:46:03.855 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:46:03.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 msgr2=0x7fe4740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 0x7fe4740693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe47c001c20 tx=0x7fe47c007040 comp rx=0 tx=0).stop 2023-10-14T18:46:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 msgr2=0x7fe4940b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe484011960 tx=0x7fe484008040 comp rx=0 tx=0).stop 2023-10-14T18:46:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 shutdown_connections 2023-10-14T18:46:03.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe474066f30 0x7fe4740693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe49416e120 0x7fe49414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe49415fc30 0x7fe4940b54d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 --2- 172.21.15.79:0/204732882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe494160000 0x7fe4940b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 >> 172.21.15.79:0/204732882 conn(0x7fe494067660 msgr2=0x7fe494067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:03.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 shutdown_connections 2023-10-14T18:46:03.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:03.856+0000 7fe493fff700 1 -- 172.21.15.79:0/204732882 wait complete. 2023-10-14T18:46:03.868 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:46:03.868 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:46:03.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:46:03.869 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:46:03.869 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:03.870 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:46:03.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:46:03.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:46:03.871 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:03.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:03.872 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:46:03.888 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:46:03.888 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:46:03.889 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:46:03.889 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.889 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:46:03.890 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.890 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:03.890 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:03.891 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:46:03.891 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:03.891 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:03.892 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:46:03.892 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:03.892 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:03.893 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:46:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:46:03.893 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42470sec preferred_lft 42470sec 2023-10-14T18:46:03.894 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:46:03.894 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.894 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:46:03.894 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:03.894 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:46:03.895 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.895 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:46:03.895 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.895 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:03.896 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:46:03.896 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:46:03.896 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.896 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:03.897 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:46:03.897 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:46:03.897 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:03.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:03.898 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:46:03.951 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:46:03.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:03.953 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:46:04.009 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:46:04.009 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:46:04.009 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:46:04.010 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:46:04.010 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:46:04.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.011 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:46:04.011 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:46:04.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:46:04.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:46:04.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:46:04.013 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:46:04.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.109 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:46:04.123 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:46:04.124 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:46:04.124 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:04.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:46:04.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:04.189 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:04.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:04.244 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:04.297 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:46:04.298 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:46:04.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:04.377 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:04.377 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:04.378 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:04.387 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:04.387 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:04.387 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:04.387 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:04.388 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:04.407 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:04.408 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:04.408 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:04.408 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:04.408 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:04.408 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:46:04.409 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:46:04.409 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:46:04.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:46:04.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:04.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:46:04.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.628+0000 7f4f61c1a700 1 Processor -- start 2023-10-14T18:46:04.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.628+0000 7f4f61c1a700 1 -- start start 2023-10-14T18:46:04.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f61c1a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15a620 0x7f4f5c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f61c1a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f5c15d580 0x7f4f5c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f61c1a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c15cbb0 con 0x7f4f5c157870 2023-10-14T18:46:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f61c1a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c15bdb0 con 0x7f4f5c15d580 2023-10-14T18:46:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f61c1a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c15bfa0 con 0x7f4f5c15a620 2023-10-14T18:46:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4f5c15d580 0x7f4f5c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4f5c157870 0x7f4f5c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45184/0 (socket says 172.21.15.79:45184) 2023-10-14T18:46:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5b7fe700 1 -- 172.21.15.79:0/1999798629 learned_addr learned my addr 172.21.15.79:0/1999798629 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5affd700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15a620 0x7f4f5c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5bfff700 1 -- 172.21.15.79:0/1999798629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15a620 msgr2=0x7f4f5c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5bfff700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15a620 0x7f4f5c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5bfff700 1 -- 172.21.15.79:0/1999798629 >> v1:172.21.15.79:6789/0 conn(0x7f4f5c157870 legacy=0x7f4f5c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5bfff700 1 -- 172.21.15.79:0/1999798629 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c15c280 con 0x7f4f5c15d580 2023-10-14T18:46:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.629+0000 7f4f5a7fc700 1 -- 172.21.15.79:0/1999798629 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792784484 0 0) 0x7f4f5c15cbb0 con 0x7f4f5c157870 2023-10-14T18:46:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f5bfff700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15d580 0x7f4f5c158110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4f540098e0 tx=0x7f4f540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edfe7c100532f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:04.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f5a7fc700 1 -- 172.21.15.79:0/1999798629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54009e80 con 0x7f4f5c15d580 2023-10-14T18:46:04.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f5a7fc700 1 -- 172.21.15.79:0/1999798629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5400b860 con 0x7f4f5c15d580 2023-10-14T18:46:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f5a7fc700 1 -- 172.21.15.79:0/1999798629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5400bbe0 con 0x7f4f5c15d580 2023-10-14T18:46:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 -- 172.21.15.79:0/1999798629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15d580 msgr2=0x7f4f5c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15d580 0x7f4f5c158110 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4f540098e0 tx=0x7f4f540091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 -- 172.21.15.79:0/1999798629 shutdown_connections 2023-10-14T18:46:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15d580 0x7f4f5c158110 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/1999798629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15a620 0x7f4f5c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 -- 172.21.15.79:0/1999798629 >> 172.21.15.79:0/1999798629 conn(0x7f4f5c068ce0 msgr2=0x7f4f5c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 -- 172.21.15.79:0/1999798629 shutdown_connections 2023-10-14T18:46:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.630+0000 7f4f61c1a700 1 -- 172.21.15.79:0/1999798629 wait complete. 2023-10-14T18:46:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.631+0000 7f4f61c1a700 1 Processor -- start 2023-10-14T18:46:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 -- start start 2023-10-14T18:46:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c157870 0x7f4f5c0d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15d580 0x7f4f5c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c159800 con 0x7f4f5c15a620 2023-10-14T18:46:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0d0bc0 con 0x7f4f5c157870 2023-10-14T18:46:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f61c1a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0d0ea0 con 0x7f4f5c15d580 2023-10-14T18:46:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f5affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f5affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40338/0 (socket says 172.21.15.79:40338) 2023-10-14T18:46:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.632+0000 7f4f5affd700 1 -- 172.21.15.79:0/3939939932 learned_addr learned my addr 172.21.15.79:0/3939939932 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5bfff700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15d580 0x7f4f5c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5b7fe700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c157870 0x7f4f5c0d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 -- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15d580 msgr2=0x7f4f5c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15d580 0x7f4f5c1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 -- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c157870 msgr2=0x7f4f5c0d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c157870 0x7f4f5c0d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 -- 172.21.15.79:0/3939939932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54009420 con 0x7f4f5c15a620 2023-10-14T18:46:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f5affd700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000d860 tx=0x7f4f50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500125f0 con 0x7f4f5c15a620 2023-10-14T18:46:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50012750 con 0x7f4f5c15a620 2023-10-14T18:46:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0d1180 con 0x7f4f5c15a620 2023-10-14T18:46:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50012ad0 con 0x7f4f5c15a620 2023-10-14T18:46:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.633+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c1507b0 con 0x7f4f5c15a620 2023-10-14T18:46:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.634+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c1509d0 con 0x7f4f5c15a620 2023-10-14T18:46:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.634+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f5001e460 con 0x7f4f5c15a620 2023-10-14T18:46:04.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.635+0000 7f4f437fe700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.635+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f50084c80 con 0x7f4f5c15a620 2023-10-14T18:46:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.635+0000 7f4f5b7fe700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:04.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.635+0000 7f4f5b7fe700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c001560 tx=0x7f4f4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.639+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f50055980 con 0x7f4f5c15a620 2023-10-14T18:46:04.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.870+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f5c04c3c0 con 0x7f4f5c15a620 2023-10-14T18:46:04.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.870+0000 7f4f437fe700 1 -- 172.21.15.79:0/3939939932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f50055510 con 0x7f4f5c15a620 2023-10-14T18:46:04.871 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:46:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 msgr2=0x7f4f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 0x7f4f480693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c001560 tx=0x7f4f4c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 msgr2=0x7f4f5c14bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000d860 tx=0x7f4f50008040 comp rx=0 tx=0).stop 2023-10-14T18:46:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 shutdown_connections 2023-10-14T18:46:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4f48066f30 0x7f4f480693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f5c15d580 0x7f4f5c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f5c157870 0x7f4f5c0d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 --2- 172.21.15.79:0/3939939932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f5c15a620 0x7f4f5c14bd30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 >> 172.21.15.79:0/3939939932 conn(0x7f4f5c068ce0 msgr2=0x7f4f5c0b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 shutdown_connections 2023-10-14T18:46:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:04.872+0000 7f4f61c1a700 1 -- 172.21.15.79:0/3939939932 wait complete. 2023-10-14T18:46:04.885 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:46:04.885 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:46:04.885 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:46:04.886 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:46:04.886 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:04.886 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:46:04.887 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:46:04.887 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:46:04.887 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:04.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.888 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:46:04.907 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:46:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:46:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:46:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:46:04.908 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:04.909 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:46:04.910 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:04.910 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:46:04.910 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:46:04.911 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:46:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:46:04.912 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.912 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:46:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:46:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.913 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:04.913 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:46:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:46:04.914 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:04.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.915 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:46:04.976 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:46:04.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:04.978 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:46:05.036 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:46:05.036 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:46:05.036 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:46:05.036 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:46:05.037 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:46:05.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:05.038 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:46:05.038 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:46:05.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:46:05.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:46:05.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:46:05.040 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:46:05.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:05.143 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:46:05.158 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:46:05.158 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:46:05.159 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:05.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:05.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:46:05.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:05.224 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:05.278 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:05.279 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:05.279 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:05.333 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:46:05.333 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:46:05.334 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:05.413 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:05.413 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:05.414 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:05.421 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:05.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:05.422 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:05.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:05.422 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:05.443 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:46:05.445 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:46:05.445 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:46:05.446 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:46:05.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:05.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:05.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:05.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.629+0000 7f82d8e7d700 1 Processor -- start 2023-10-14T18:46:05.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.629+0000 7f82d8e7d700 1 -- start start 2023-10-14T18:46:05.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d8e7d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 0x7f82d415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d8e7d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d8e7d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d415cbb0 con 0x7f82d4157870 2023-10-14T18:46:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d8e7d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d415bdb0 con 0x7f82d415a620 2023-10-14T18:46:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d8e7d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d415bfa0 con 0x7f82d415d580 2023-10-14T18:46:05.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d1d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 0x7f82d415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:48742/0 (socket says 172.21.15.79:48742) 2023-10-14T18:46:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 -- 172.21.15.79:0/340257305 learned_addr learned my addr 172.21.15.79:0/340257305 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d259c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f82d4157870 0x7f82d415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:59810/0 (socket says 172.21.15.79:59810) 2023-10-14T18:46:05.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 -- 172.21.15.79:0/340257305 >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 msgr2=0x7f82d415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 --2- 172.21.15.79:0/340257305 >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 0x7f82d415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 -- 172.21.15.79:0/340257305 >> v1:172.21.15.144:6789/0 conn(0x7f82d4157870 legacy=0x7f82d415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d2d9d700 1 -- 172.21.15.79:0/340257305 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d415c280 con 0x7f82d415d580 2023-10-14T18:46:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d159a700 1 -- 172.21.15.79:0/340257305 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427123927 0 0) 0x7f82d415cbb0 con 0x7f82d4157870 2023-10-14T18:46:05.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.630+0000 7f82d1d9b700 1 --2- 172.21.15.79:0/340257305 >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 0x7f82d415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:46:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d2d9d700 1 --2- 172.21.15.79:0/340257305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f82c40099b0 tx=0x7f82c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56330918086947f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d159a700 1 -- 172.21.15.79:0/340257305 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4009ea0 con 0x7f82d415d580 2023-10-14T18:46:05.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d159a700 1 -- 172.21.15.79:0/340257305 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400b860 con 0x7f82d415d580 2023-10-14T18:46:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d159a700 1 -- 172.21.15.79:0/340257305 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400bc00 con 0x7f82d415d580 2023-10-14T18:46:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 -- 172.21.15.79:0/340257305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 msgr2=0x7f82d4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/340257305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f82c40099b0 tx=0x7f82c4009250 comp rx=0 tx=0).stop 2023-10-14T18:46:05.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 -- 172.21.15.79:0/340257305 shutdown_connections 2023-10-14T18:46:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/340257305 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d4158110 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/340257305 >> v2:172.21.15.144:3300/0 conn(0x7f82d415a620 0x7f82d415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 -- 172.21.15.79:0/340257305 >> 172.21.15.79:0/340257305 conn(0x7f82d4068ce0 msgr2=0x7f82d40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 -- 172.21.15.79:0/340257305 shutdown_connections 2023-10-14T18:46:05.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.631+0000 7f82d8e7d700 1 -- 172.21.15.79:0/340257305 wait complete. 2023-10-14T18:46:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.632+0000 7f82d8e7d700 1 Processor -- start 2023-10-14T18:46:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.632+0000 7f82d8e7d700 1 -- start start 2023-10-14T18:46:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d4157870 0x7f82d416a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d416b4a0 con 0x7f82d415a620 2023-10-14T18:46:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d416a9f0 con 0x7f82d4157870 2023-10-14T18:46:05.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d8e7d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d40b08f0 con 0x7f82d415d580 2023-10-14T18:46:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40352/0 (socket says 172.21.15.79:40352) 2023-10-14T18:46:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d1d9b700 1 -- 172.21.15.79:0/1286889757 learned_addr learned my addr 172.21.15.79:0/1286889757 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d259c700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d4157870 0x7f82d416a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.633+0000 7f82d2d9d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 -- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 msgr2=0x7f82d40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d40b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 -- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d4157870 msgr2=0x7f82d416a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d4157870 0x7f82d416a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 -- 172.21.15.79:0/1286889757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009420 con 0x7f82d415a620 2023-10-14T18:46:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d1d9b700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00ec80 tx=0x7f82bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00c7f0 con 0x7f82d415a620 2023-10-14T18:46:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc00c950 con 0x7f82d415a620 2023-10-14T18:46:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40094f0 con 0x7f82d415a620 2023-10-14T18:46:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00ccf0 con 0x7f82d415a620 2023-10-14T18:46:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.634+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d40b2eb0 con 0x7f82d415a620 2023-10-14T18:46:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.635+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d40b0a60 con 0x7f82d415a620 2023-10-14T18:46:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.635+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82bc013680 con 0x7f82d415a620 2023-10-14T18:46:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.635+0000 7f82ca7fc700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.636+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82bc0844f0 con 0x7f82d415a620 2023-10-14T18:46:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.636+0000 7f82d259c700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.636+0000 7f82d259c700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 0x7f82b40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001560 tx=0x7f82cc001b00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.640+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82bc0551f0 con 0x7f82d415a620 2023-10-14T18:46:05.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.868+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d404c3c0 con 0x7f82d415a620 2023-10-14T18:46:05.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.868+0000 7f82ca7fc700 1 -- 172.21.15.79:0/1286889757 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f82bc054d80 con 0x7f82d415a620 2023-10-14T18:46:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:05.870 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:05.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 msgr2=0x7f82b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 0x7f82b40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001560 tx=0x7f82cc001b00 comp rx=0 tx=0).stop 2023-10-14T18:46:05.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 msgr2=0x7f82d40b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:05.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00ec80 tx=0x7f82bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 shutdown_connections 2023-10-14T18:46:05.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f82b4066f30 0x7f82b40693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82d415d580 0x7f82d40b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82d4157870 0x7f82d416a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 --2- 172.21.15.79:0/1286889757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d415a620 0x7f82d40b2970 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:05.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 >> 172.21.15.79:0/1286889757 conn(0x7f82d4068ce0 msgr2=0x7f82d41554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:05.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 shutdown_connections 2023-10-14T18:46:05.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:05.871+0000 7f82d8e7d700 1 -- 172.21.15.79:0/1286889757 wait complete. 2023-10-14T18:46:05.875 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:05.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:46:06.016 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":4908,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3378027629999991,"mdsmap_epoch":17,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":16.238393625} 2023-10-14T18:46:06.016 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 4908, "mdsmap_epoch": 17, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 8.337802763, "state": "up:active", "uptime": 16.238393625, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:46:06.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-14T18:46:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.129+0000 7f795803d700 1 Processor -- start 2023-10-14T18:46:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.129+0000 7f795803d700 1 -- start start 2023-10-14T18:46:06.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f795803d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7950157870 0x7f795015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f795803d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f795015a620 0x7f795015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f795803d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795015cbb0 con 0x7f795015d580 2023-10-14T18:46:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f795803d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795015bfa0 con 0x7f795015a620 2023-10-14T18:46:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f795803d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795015c280 con 0x7f7950157870 2023-10-14T18:46:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79555d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f795015a620 0x7f795015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79565da700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f795015d580 0x7f7950158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45188/0 (socket says 172.21.15.79:45188) 2023-10-14T18:46:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79565da700 1 -- 172.21.15.79:0/1102779026 learned_addr learned my addr 172.21.15.79:0/1102779026 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f7955dd9700 1 --2- 172.21.15.79:0/1102779026 >> v2:172.21.15.144:3300/0 conn(0x7f7950157870 0x7f795015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79555d8700 1 -- 172.21.15.79:0/1102779026 >> v2:172.21.15.144:3300/0 conn(0x7f7950157870 msgr2=0x7f795015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79555d8700 1 --2- 172.21.15.79:0/1102779026 >> v2:172.21.15.144:3300/0 conn(0x7f7950157870 0x7f795015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79555d8700 1 -- 172.21.15.79:0/1102779026 >> v1:172.21.15.79:6789/0 conn(0x7f795015d580 legacy=0x7f7950158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f79555d8700 1 -- 172.21.15.79:0/1102779026 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795015c560 con 0x7f795015a620 2023-10-14T18:46:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.130+0000 7f7954dd7700 1 -- 172.21.15.79:0/1102779026 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594917660 0 0) 0x7f795015cbb0 con 0x7f795015d580 2023-10-14T18:46:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f79555d8700 1 --2- 172.21.15.79:0/1102779026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015a620 0x7f795015d040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7950069d80 tx=0x7f79400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f119ea38745c6747 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f7954dd7700 1 -- 172.21.15.79:0/1102779026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011630 con 0x7f795015a620 2023-10-14T18:46:06.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f7954dd7700 1 -- 172.21.15.79:0/1102779026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940011790 con 0x7f795015a620 2023-10-14T18:46:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f7954dd7700 1 -- 172.21.15.79:0/1102779026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940011b30 con 0x7f795015a620 2023-10-14T18:46:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 -- 172.21.15.79:0/1102779026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015a620 msgr2=0x7f795015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 --2- 172.21.15.79:0/1102779026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015a620 0x7f795015d040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7950069d80 tx=0x7f79400091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 -- 172.21.15.79:0/1102779026 shutdown_connections 2023-10-14T18:46:06.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 --2- 172.21.15.79:0/1102779026 >> v2:172.21.15.144:3300/0 conn(0x7f7950157870 0x7f795015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 --2- 172.21.15.79:0/1102779026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015a620 0x7f795015d040 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 -- 172.21.15.79:0/1102779026 >> 172.21.15.79:0/1102779026 conn(0x7f7950068ce0 msgr2=0x7f79500690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 -- 172.21.15.79:0/1102779026 shutdown_connections 2023-10-14T18:46:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.131+0000 7f795803d700 1 -- 172.21.15.79:0/1102779026 wait complete. 2023-10-14T18:46:06.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.132+0000 7f795803d700 1 Processor -- start 2023-10-14T18:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.132+0000 7f795803d700 1 -- start start 2023-10-14T18:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7950157870 0x7f7950160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f795015a620 0x7f795015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b14a0 con 0x7f795015d580 2023-10-14T18:46:06.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015fea0 con 0x7f7950157870 2023-10-14T18:46:06.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f795803d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500d0df0 con 0x7f795015a620 2023-10-14T18:46:06.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40364/0 (socket says 172.21.15.79:40364) 2023-10-14T18:46:06.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 -- 172.21.15.79:0/966812233 learned_addr learned my addr 172.21.15.79:0/966812233 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:06.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f7955dd9700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7950157870 0x7f7950160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79555d8700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f795015a620 0x7f795015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 -- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f795015a620 msgr2=0x7f795015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f795015a620 0x7f795015f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 -- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7950157870 msgr2=0x7f7950160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7950157870 0x7f7950160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.133+0000 7f79565da700 1 -- 172.21.15.79:0/966812233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009420 con 0x7f795015d580 2023-10-14T18:46:06.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f79565da700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f794800c500 tx=0x7f7948007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948005b30 con 0x7f795015d580 2023-10-14T18:46:06.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948005c90 con 0x7f795015d580 2023-10-14T18:46:06.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500b0b70 con 0x7f795015d580 2023-10-14T18:46:06.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007320 con 0x7f795015d580 2023-10-14T18:46:06.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.134+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500b1130 con 0x7f795015d580 2023-10-14T18:46:06.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.135+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79500b1610 con 0x7f795015d580 2023-10-14T18:46:06.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.135+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f794801b3b0 con 0x7f795015d580 2023-10-14T18:46:06.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.136+0000 7f7945ffb700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.136+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7948083a00 con 0x7f795015d580 2023-10-14T18:46:06.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.136+0000 7f7955dd9700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.136+0000 7f7955dd9700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 0x7f79340693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79500b0770 tx=0x7f794c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.140+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7948050c70 con 0x7f795015d580 2023-10-14T18:46:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.397+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f795004c3c0 con 0x7f795015d580 2023-10-14T18:46:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.398+0000 7f7945ffb700 1 -- 172.21.15.79:0/966812233 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f7948017090 con 0x7f795015d580 2023-10-14T18:46:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:06.399 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2023-10-14T18:46:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 1600000000, 2023-10-14T18:46:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 1597747231, 2023-10-14T18:46:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 2252769, 2023-10-14T18:46:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 2252769, 2023-10-14T18:46:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.0014079805696383119, 2023-10-14T18:46:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "num_osds": 8, 2023-10-14T18:46:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "num_per_pool_osds": 0, 2023-10-14T18:46:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "num_per_pool_omap_osds": 0 2023-10-14T18:46:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "stats_by_class": { 2023-10-14T18:46:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hdd": { 2023-10-14T18:46:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "total_bytes": 1600000000, 2023-10-14T18:46:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "total_avail_bytes": 1597747231, 2023-10-14T18:46:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_bytes": 2252769, 2023-10-14T18:46:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_bytes": 2252769, 2023-10-14T18:46:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "total_used_raw_ratio": 0.0014079805696383119 2023-10-14T18:46:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "name": ".mgr", 2023-10-14T18:46:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 1, 2023-10-14T18:46:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2023-10-14T18:46:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 590368, 2023-10-14T18:46:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 2, 2023-10-14T18:46:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 577, 2023-10-14T18:46:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 590368, 2023-10-14T18:46:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0.00052957510342821479, 2023-10-14T18:46:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 557102656 2023-10-14T18:46:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_metadata", 2023-10-14T18:46:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4, 2023-10-14T18:46:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2023-10-14T18:46:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 2306, 2023-10-14T18:46:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 22, 2023-10-14T18:46:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 3, 2023-10-14T18:46:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 2306, 2023-10-14T18:46:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 2.0696322735602735e-06, 2023-10-14T18:46:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 557102656 2023-10-14T18:46:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "cephfs_data", 2023-10-14T18:46:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5, 2023-10-14T18:46:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "stats": { 2023-10-14T18:46:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "stored": 0, 2023-10-14T18:46:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "objects": 0, 2023-10-14T18:46:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "kb_used": 0, 2023-10-14T18:46:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "bytes_used": 0, 2023-10-14T18:46:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "percent_used": 0, 2023-10-14T18:46:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "max_avail": 557102656 2023-10-14T18:46:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:06.412 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:06.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 msgr2=0x7f79340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 0x7f79340693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79500b0770 tx=0x7f794c00b040 comp rx=0 tx=0).stop 2023-10-14T18:46:06.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 msgr2=0x7f795015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f794800c500 tx=0x7f7948007f60 comp rx=0 tx=0).stop 2023-10-14T18:46:06.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 shutdown_connections 2023-10-14T18:46:06.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7934066f30 0x7f79340693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f795015d580 0x7f795015f960 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7950157870 0x7f7950160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 --2- 172.21.15.79:0/966812233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f795015a620 0x7f795015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 >> 172.21.15.79:0/966812233 conn(0x7f7950068ce0 msgr2=0x7f7950159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:06.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 shutdown_connections 2023-10-14T18:46:06.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.400+0000 7f795803d700 1 -- 172.21.15.79:0/966812233 wait complete. 2023-10-14T18:46:06.417 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:46:06.417 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:46:06.418 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:46:06.419 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:46:06.419 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:46:06.419 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:46:06.420 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:46:06.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:06.674 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:46:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:client4763 2023-10-14T18:46:06.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:06.743 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client4763/osdmap') 2023-10-14T18:46:06.818 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-14T18:46:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:46:06.820 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:46:06.821 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:46:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:46:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:46:06.822 INFO:teuthology.orchestra.run.smithi079.stderr:795 bytes copied, 4.8877e-05 s, 16.3 MB/s 2023-10-14T18:46:06.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-14T18:46:06.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.977+0000 7f1e0740a700 1 Processor -- start 2023-10-14T18:46:06.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.978+0000 7f1e0740a700 1 -- start start 2023-10-14T18:46:06.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.978+0000 7f1e0740a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e0015a620 0x7f1e0015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.978+0000 7f1e0740a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0015cbb0 con 0x7f1e00157870 2023-10-14T18:46:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.978+0000 7f1e0740a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0015bfa0 con 0x7f1e0015d580 2023-10-14T18:46:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.978+0000 7f1e0740a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0015bdb0 con 0x7f1e0015a620 2023-10-14T18:46:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e051a6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e00157870 0x7f1e0015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45204/0 (socket says 172.21.15.79:45204) 2023-10-14T18:46:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e051a6700 1 -- 172.21.15.79:0/3251118830 learned_addr learned my addr 172.21.15.79:0/3251118830 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e049a5700 1 --2- 172.21.15.79:0/3251118830 >> v2:172.21.15.79:3300/0 conn(0x7f1e0015a620 0x7f1e0015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1df7fff700 1 -- 172.21.15.79:0/3251118830 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254959907 0 0) 0x7f1e0015cbb0 con 0x7f1e00157870 2023-10-14T18:46:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1df7fff700 1 -- 172.21.15.79:0/3251118830 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dec003570 con 0x7f1e00157870 2023-10-14T18:46:06.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e049a5700 1 -- 172.21.15.79:0/3251118830 >> v1:172.21.15.144:6789/0 conn(0x7f1e0015d580 legacy=0x7f1e00158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e049a5700 1 -- 172.21.15.79:0/3251118830 >> v1:172.21.15.79:6789/0 conn(0x7f1e00157870 legacy=0x7f1e0015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e049a5700 1 -- 172.21.15.79:0/3251118830 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0015c280 con 0x7f1e0015a620 2023-10-14T18:46:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1e049a5700 1 --2- 172.21.15.79:0/3251118830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e0015d040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1df00098e0 tx=0x7f1df00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14060cd0e2b6da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1df7fff700 1 -- 172.21.15.79:0/3251118830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000b640 con 0x7f1e0015a620 2023-10-14T18:46:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1df7fff700 1 -- 172.21.15.79:0/3251118830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000b7a0 con 0x7f1e0015a620 2023-10-14T18:46:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.979+0000 7f1df7fff700 1 -- 172.21.15.79:0/3251118830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000bb40 con 0x7f1e0015a620 2023-10-14T18:46:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 -- 172.21.15.79:0/3251118830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 msgr2=0x7f1e0015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 --2- 172.21.15.79:0/3251118830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e0015d040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1df00098e0 tx=0x7f1df00091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 -- 172.21.15.79:0/3251118830 shutdown_connections 2023-10-14T18:46:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 --2- 172.21.15.79:0/3251118830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e0015d040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 -- 172.21.15.79:0/3251118830 >> 172.21.15.79:0/3251118830 conn(0x7f1e00068ce0 msgr2=0x7f1e000690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 -- 172.21.15.79:0/3251118830 shutdown_connections 2023-10-14T18:46:06.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.980+0000 7f1e0740a700 1 -- 172.21.15.79:0/3251118830 wait complete. 2023-10-14T18:46:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.981+0000 7f1e0740a700 1 Processor -- start 2023-10-14T18:46:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.981+0000 7f1e0740a700 1 -- start start 2023-10-14T18:46:06.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 0x7f1e0016b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 0x7f1e000b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00150860 con 0x7f1e0015a620 2023-10-14T18:46:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0016de60 con 0x7f1e0015d580 2023-10-14T18:46:06.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0016e140 con 0x7f1e00157870 2023-10-14T18:46:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40386/0 (socket says 172.21.15.79:40386) 2023-10-14T18:46:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 -- 172.21.15.79:0/4228879765 learned_addr learned my addr 172.21.15.79:0/4228879765 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:06.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e059a7700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 0x7f1e000b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e051a6700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 0x7f1e0016b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 -- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 msgr2=0x7f1e0016b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 0x7f1e0016b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 -- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 msgr2=0x7f1e000b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:06.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 0x7f1e000b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 -- 172.21.15.79:0/4228879765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0009420 con 0x7f1e0015a620 2023-10-14T18:46:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e059a7700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 0x7f1e000b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e051a6700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 0x7f1e0016b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e049a5700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013000 tx=0x7f1df0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000bb20 con 0x7f1e0015a620 2023-10-14T18:46:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0011420 con 0x7f1e0015a620 2023-10-14T18:46:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00117c0 con 0x7f1e0015a620 2023-10-14T18:46:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.982+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0016e420 con 0x7f1e0015a620 2023-10-14T18:46:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.983+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0016e9e0 con 0x7f1e0015a620 2023-10-14T18:46:06.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.983+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0016b840 con 0x7f1e0015a620 2023-10-14T18:46:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.984+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1df0011b70 con 0x7f1e0015a620 2023-10-14T18:46:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.984+0000 7f1df57fa700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 0x7f1de40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.984+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1df0085c30 con 0x7f1e0015a620 2023-10-14T18:46:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.984+0000 7f1e051a6700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 0x7f1de40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:06.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.985+0000 7f1e051a6700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 0x7f1de40693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0058d0 tx=0x7f1dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:06.988+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1df0052ea0 con 0x7f1e0015a620 2023-10-14T18:46:07.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.184+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f1e0016ebd0 con 0x7f1e0015a620 2023-10-14T18:46:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.710+0000 7f1df57fa700 1 -- 172.21.15.79:0/4228879765 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1df00564c0 con 0x7f1e0015a620 2023-10-14T18:46:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 msgr2=0x7f1de40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 0x7f1de40693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0058d0 tx=0x7f1dfc009040 comp rx=0 tx=0).stop 2023-10-14T18:46:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 msgr2=0x7f1e00153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013000 tx=0x7f1df0017000 comp rx=0 tx=0).stop 2023-10-14T18:46:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 shutdown_connections 2023-10-14T18:46:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1de4066f30 0x7f1de40693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e0015d580 0x7f1e000b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e00157870 0x7f1e0016b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 --2- 172.21.15.79:0/4228879765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e0015a620 0x7f1e00153310 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 >> 172.21.15.79:0/4228879765 conn(0x7f1e00068ce0 msgr2=0x7f1e00063380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 shutdown_connections 2023-10-14T18:46:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.712+0000 7f1e0740a700 1 -- 172.21.15.79:0/4228879765 wait complete. 2023-10-14T18:46:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:pauserd,pausewr is set 2023-10-14T18:46:07.726 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-14T18:46:07.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.839+0000 7f1f22b51700 1 Processor -- start 2023-10-14T18:46:07.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.839+0000 7f1f22b51700 1 -- start start 2023-10-14T18:46:07.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f22b51700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f1c15a2b0 0x7f1f1c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f22b51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f22b51700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c0c5d80 con 0x7f1f1c0d1c30 2023-10-14T18:46:07.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f22b51700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c068470 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f22b51700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c6060 con 0x7f1f1c15a2b0 2023-10-14T18:46:07.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40402/0 (socket says 172.21.15.79:40402) 2023-10-14T18:46:07.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 -- 172.21.15.79:0/2450765108 learned_addr learned my addr 172.21.15.79:0/2450765108 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f208ed700 1 --2- 172.21.15.79:0/2450765108 >> v2:172.21.15.144:3300/0 conn(0x7f1f1c15a2b0 0x7f1f1c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 -- 172.21.15.79:0/2450765108 >> v2:172.21.15.144:3300/0 conn(0x7f1f1c15a2b0 msgr2=0x7f1f1c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 --2- 172.21.15.79:0/2450765108 >> v2:172.21.15.144:3300/0 conn(0x7f1f1c15a2b0 0x7f1f1c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 -- 172.21.15.79:0/2450765108 >> v1:172.21.15.144:6789/0 conn(0x7f1f1c0d1c30 legacy=0x7f1f1c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 -- 172.21.15.79:0/2450765108 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0c6340 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f210ee700 1 --2- 172.21.15.79:0/2450765108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c089220 tx=0x7f1f04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43b52c314830f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:07.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.840+0000 7f1f1b7fe700 1 -- 172.21.15.79:0/2450765108 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400b860 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f1b7fe700 1 -- 172.21.15.79:0/2450765108 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0400b9c0 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f1b7fe700 1 -- 172.21.15.79:0/2450765108 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400bd60 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 -- 172.21.15.79:0/2450765108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 msgr2=0x7f1f1c0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 --2- 172.21.15.79:0/2450765108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c089220 tx=0x7f1f04009250 comp rx=0 tx=0).stop 2023-10-14T18:46:07.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 -- 172.21.15.79:0/2450765108 shutdown_connections 2023-10-14T18:46:07.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 --2- 172.21.15.79:0/2450765108 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c0ccdd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 --2- 172.21.15.79:0/2450765108 >> v2:172.21.15.144:3300/0 conn(0x7f1f1c15a2b0 0x7f1f1c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 -- 172.21.15.79:0/2450765108 >> 172.21.15.79:0/2450765108 conn(0x7f1f1c067e40 msgr2=0x7f1f1c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:07.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 -- 172.21.15.79:0/2450765108 shutdown_connections 2023-10-14T18:46:07.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.841+0000 7f1f22b51700 1 -- 172.21.15.79:0/2450765108 wait complete. 2023-10-14T18:46:07.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.842+0000 7f1f22b51700 1 Processor -- start 2023-10-14T18:46:07.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.842+0000 7f1f22b51700 1 -- start start 2023-10-14T18:46:07.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f1c0d1c30 0x7f1f1c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f1c15a2b0 0x7f1f1c169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0c8520 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c15b100 con 0x7f1f1c0d1c30 2023-10-14T18:46:07.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f22b51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c1580c0 con 0x7f1f1c15a2b0 2023-10-14T18:46:07.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40404/0 (socket says 172.21.15.79:40404) 2023-10-14T18:46:07.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 -- 172.21.15.79:0/3839420395 learned_addr learned my addr 172.21.15.79:0/3839420395 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:07.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f1bfff700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f1c0d1c30 0x7f1f1c15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f210ee700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f1c15a2b0 0x7f1f1c169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 -- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f1c15a2b0 msgr2=0x7f1f1c169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f1c15a2b0 0x7f1f1c169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 -- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f1c0d1c30 msgr2=0x7f1f1c15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:07.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f1c0d1c30 0x7f1f1c15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:07.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.843+0000 7f1f208ed700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040094f0 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f208ed700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400d840 tx=0x7f1f14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:07.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14014620 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f14014780 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c15b390 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14014b40 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.844+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c15b950 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.845+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c04c3c0 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.845+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f1401d400 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.845+0000 7f1f18ff9700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 0x7f1efc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:07.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.845+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f14084d00 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.846+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=33+}) v3 -- 0x7f1efc06ea50 con 0x7f1f1c0cfe20 2023-10-14T18:46:07.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.846+0000 7f1f1bfff700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 0x7f1efc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:07.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.846+0000 7f1f1bfff700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 0x7f1efc0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0ca2d0 tx=0x7f1f0c001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:07.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:07.850+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f14051f70 con 0x7f1f1c0cfe20 2023-10-14T18:46:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.042+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f1f1c064a00 con 0x7f1f1c0cfe20 2023-10-14T18:46:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.716+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(33..33 src has 1..33) v4 ==== 280+0+0 (secure 0 0 0) 0x7f1f14056330 con 0x7f1f1c0cfe20 2023-10-14T18:46:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.716+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=34}) v3 -- 0x7f1efc06f330 con 0x7f1f1c0cfe20 2023-10-14T18:46:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.719+0000 7f1f18ff9700 1 -- 172.21.15.79:0/3839420395 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1f14055590 con 0x7f1f1c0cfe20 2023-10-14T18:46:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.721+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 msgr2=0x7f1efc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.721+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 0x7f1efc0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0ca2d0 tx=0x7f1f0c001650 comp rx=0 tx=0).stop 2023-10-14T18:46:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.721+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 msgr2=0x7f1f1c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.721+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400d840 tx=0x7f1f14008040 comp rx=0 tx=0).stop 2023-10-14T18:46:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 shutdown_connections 2023-10-14T18:46:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1efc066f30 0x7f1efc0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f1c15a2b0 0x7f1f1c169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0cfe20 0x7f1f1c15a680 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 --2- 172.21.15.79:0/3839420395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f1c0d1c30 0x7f1f1c15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 >> 172.21.15.79:0/3839420395 conn(0x7f1f1c067e40 msgr2=0x7f1f1c158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:08.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 shutdown_connections 2023-10-14T18:46:08.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.722+0000 7f1f22b51700 1 -- 172.21.15.79:0/3839420395 wait complete. 2023-10-14T18:46:08.726 INFO:teuthology.orchestra.run.smithi079.stderr:pauserd,pausewr is unset 2023-10-14T18:46:08.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.850+0000 7f64082eb700 1 Processor -- start 2023-10-14T18:46:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.850+0000 7f64082eb700 1 -- start start 2023-10-14T18:46:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f64082eb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f640015a1e0 0x7f64000cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f64082eb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640015db80 con 0x7f6400159e10 2023-10-14T18:46:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f64082eb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640015de60 con 0x7f64000b3430 2023-10-14T18:46:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f64082eb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640015e800 con 0x7f640015a1e0 2023-10-14T18:46:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f6406087700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6400159e10 0x7f64000b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54280/0 (socket says 172.21.15.79:54280) 2023-10-14T18:46:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f6406087700 1 -- 172.21.15.79:0/2897275730 learned_addr learned my addr 172.21.15.79:0/2897275730 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f6405886700 1 --2- 172.21.15.79:0/2897275730 >> v2:172.21.15.144:3300/0 conn(0x7f640015a1e0 0x7f64000cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.851+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454877485 0 0) 0x7f640015db80 con 0x7f6400159e10 2023-10-14T18:46:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ec003570 con 0x7f6400159e10 2023-10-14T18:46:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867927342 0 0) 0x7f63ec003570 con 0x7f6400159e10 2023-10-14T18:46:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 >> v2:172.21.15.144:3300/0 conn(0x7f640015a1e0 msgr2=0x7f64000cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 --2- 172.21.15.79:0/2897275730 >> v2:172.21.15.144:3300/0 conn(0x7f640015a1e0 0x7f64000cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 >> v1:172.21.15.144:6789/0 conn(0x7f64000b3430 legacy=0x7f64000cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640015e140 con 0x7f6400159e10 2023-10-14T18:46:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f63fc0017f0 con 0x7f6400159e10 2023-10-14T18:46:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 >> v1:172.21.15.79:6789/0 conn(0x7f6400159e10 legacy=0x7f64000b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63ec003a60 0x7f63ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 0x7f63ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0051c0 0x7f63ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015e800 con 0x7f63ec004810 2023-10-14T18:46:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec00c160 con 0x7f63ec0051c0 2023-10-14T18:46:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec00c320 con 0x7f63ec003a60 2023-10-14T18:46:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 0x7f63ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6406888700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0051c0 0x7f63ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6406087700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63ec003a60 0x7f63ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 -- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63ec003a60 msgr2=0x7f63ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f63ec003a60 0x7f63ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 -- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0051c0 msgr2=0x7f63ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec0051c0 0x7f63ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 -- 172.21.15.79:0/2897275730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec003570 con 0x7f63ec004810 2023-10-14T18:46:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6406888700 1 -- 172.21.15.79:0/2897275730 reap_dead start 2023-10-14T18:46:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.852+0000 7f6405886700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 0x7f63ec004c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f64000c4510 tx=0x7f63f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab790dd883498f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000e6e0 con 0x7f63ec004810 2023-10-14T18:46:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000e840 con 0x7f63ec004810 2023-10-14T18:46:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f6405085700 1 -- 172.21.15.79:0/2897275730 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000ec00 con 0x7f63ec004810 2023-10-14T18:46:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 -- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 msgr2=0x7f63ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 0x7f63ec004c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f64000c4510 tx=0x7f63f00091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 -- 172.21.15.79:0/2897275730 shutdown_connections 2023-10-14T18:46:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 --2- 172.21.15.79:0/2897275730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63ec004810 0x7f63ec004c80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 -- 172.21.15.79:0/2897275730 >> 172.21.15.79:0/2897275730 conn(0x7f6400067660 msgr2=0x7f6400067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 -- 172.21.15.79:0/2897275730 shutdown_connections 2023-10-14T18:46:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.853+0000 7f64082eb700 1 -- 172.21.15.79:0/2897275730 wait complete. 2023-10-14T18:46:08.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.854+0000 7f64082eb700 1 Processor -- start 2023-10-14T18:46:08.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.854+0000 7f64082eb700 1 -- start start 2023-10-14T18:46:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 0x7f640016b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64000ca700 0x7f64000c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640016b6c0 con 0x7f64000c7120 2023-10-14T18:46:08.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c4380 con 0x7f63ec004810 2023-10-14T18:46:08.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f64082eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c7b00 con 0x7f64000ca700 2023-10-14T18:46:08.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54894/0 (socket says 172.21.15.79:54894) 2023-10-14T18:46:08.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 -- 172.21.15.79:0/3075365830 learned_addr learned my addr 172.21.15.79:0/3075365830 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6406087700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 0x7f640016b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6406888700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64000ca700 0x7f64000c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 -- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64000ca700 msgr2=0x7f64000c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64000ca700 0x7f64000c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 -- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 msgr2=0x7f640016b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 0x7f640016b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6405886700 1 -- 172.21.15.79:0/3075365830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000cffc0 con 0x7f64000c7120 2023-10-14T18:46:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.855+0000 7f6406087700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 0x7f640016b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f6405886700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f640008a0b0 tx=0x7f63f001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:08.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0022070 con 0x7f64000c7120 2023-10-14T18:46:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000e9b0 con 0x7f64000c7120 2023-10-14T18:46:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f001c450 con 0x7f64000c7120 2023-10-14T18:46:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000c7590 con 0x7f64000c7120 2023-10-14T18:46:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.856+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000cf970 con 0x7f64000c7120 2023-10-14T18:46:08.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.857+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000d0150 con 0x7f64000c7120 2023-10-14T18:46:08.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.857+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63f001c8a0 con 0x7f64000c7120 2023-10-14T18:46:08.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.857+0000 7f63f67fc700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:08.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.858+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63f0085c30 con 0x7f64000c7120 2023-10-14T18:46:08.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.858+0000 7f6406087700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:08.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.858+0000 7f6406087700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 0x7f63e40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f63fc001460 tx=0x7f63fc001320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:08.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:08.862+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63f0052f90 con 0x7f64000c7120 2023-10-14T18:46:08.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:08.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:09.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.051+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f640004c3c0 con 0x7f64000c7120 2023-10-14T18:46:09.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.052+0000 7f63f67fc700 1 -- 172.21.15.79:0/3075365830 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f63f0056570 con 0x7f64000c7120 2023-10-14T18:46:09.054 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:09.055 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:08.713736+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:09.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 msgr2=0x7f63e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 0x7f63e40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f63fc001460 tx=0x7f63fc001320 comp rx=0 tx=0).stop 2023-10-14T18:46:09.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 msgr2=0x7f640016b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f640008a0b0 tx=0x7f63f001a000 comp rx=0 tx=0).stop 2023-10-14T18:46:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 shutdown_connections 2023-10-14T18:46:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f63e4066f30 0x7f63e40693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64000ca700 0x7f64000c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63ec004810 0x7f640016b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 --2- 172.21.15.79:0/3075365830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64000c7120 0x7f640016b180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 >> 172.21.15.79:0/3075365830 conn(0x7f6400067660 msgr2=0x7f6400156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:09.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 shutdown_connections 2023-10-14T18:46:09.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.054+0000 7f64082eb700 1 -- 172.21.15.79:0/3075365830 wait complete. 2023-10-14T18:46:09.067 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:46:09.068 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:46:09.068 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:46:09.069 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:46:09.069 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:46:09.069 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:46:09.070 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:46:09.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:09.323 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:46:09.391 INFO:teuthology.orchestra.run.smithi079.stdout:client4763 2023-10-14T18:46:09.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:09.392 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client4763/osdmap') 2023-10-14T18:46:09.467 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 31 barrier 31 flags 0x588000 2023-10-14T18:46:09.468 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:09.468 INFO:teuthology.orchestra.run.smithi079.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:09.468 INFO:teuthology.orchestra.run.smithi079.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:09.469 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:46:09.469 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:46:09.469 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:46:09.469 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:46:09.470 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:46:09.470 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:46:09.470 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:46:09.470 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:46:09.471 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:46:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:46:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:795 bytes copied, 3.3899e-05 s, 23.5 MB/s 2023-10-14T18:46:09.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.623+0000 7f73ecf65700 1 Processor -- start 2023-10-14T18:46:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.623+0000 7f73ecf65700 1 -- start start 2023-10-14T18:46:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ecf65700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f73e815e3a0 0x7f73e80ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ecf65700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80cd4e0 con 0x7f73e8070700 2023-10-14T18:46:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ecf65700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e8067f70 con 0x7f73e8159d20 2023-10-14T18:46:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ecf65700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e815e820 con 0x7f73e815e3a0 2023-10-14T18:46:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ddd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f73e815e3a0 0x7f73e80ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73e6d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f73e8070700 0x7f73e8068400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54284/0 (socket says 172.21.15.79:54284) 2023-10-14T18:46:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73e6d9d700 1 -- 172.21.15.79:0/171032014 learned_addr learned my addr 172.21.15.79:0/171032014 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ddd9b700 1 -- 172.21.15.79:0/171032014 >> v1:172.21.15.144:6789/0 conn(0x7f73e8159d20 legacy=0x7f73e80c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.624+0000 7f73ddd9b700 1 -- 172.21.15.79:0/171032014 >> v1:172.21.15.79:6789/0 conn(0x7f73e8070700 legacy=0x7f73e8068400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ddd9b700 1 -- 172.21.15.79:0/171032014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8067660 con 0x7f73e815e3a0 2023-10-14T18:46:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73e5d9b700 1 -- 172.21.15.79:0/171032014 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101857172 0 0) 0x7f73e80cd4e0 con 0x7f73e8070700 2023-10-14T18:46:09.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ddd9b700 1 --2- 172.21.15.79:0/171032014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e80ccfa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f73d00098e0 tx=0x7f73d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32cf0cc4a3a0c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:09.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73e5d9b700 1 -- 172.21.15.79:0/171032014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0009e80 con 0x7f73e815e3a0 2023-10-14T18:46:09.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73e5d9b700 1 -- 172.21.15.79:0/171032014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d000b820 con 0x7f73e815e3a0 2023-10-14T18:46:09.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73e5d9b700 1 -- 172.21.15.79:0/171032014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d000bba0 con 0x7f73e815e3a0 2023-10-14T18:46:09.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 -- 172.21.15.79:0/171032014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 msgr2=0x7f73e80ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 --2- 172.21.15.79:0/171032014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e80ccfa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f73d00098e0 tx=0x7f73d00091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 -- 172.21.15.79:0/171032014 shutdown_connections 2023-10-14T18:46:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 --2- 172.21.15.79:0/171032014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e80ccfa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 -- 172.21.15.79:0/171032014 >> 172.21.15.79:0/171032014 conn(0x7f73e80cda10 msgr2=0x7f73e80cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 -- 172.21.15.79:0/171032014 shutdown_connections 2023-10-14T18:46:09.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.625+0000 7f73ecf65700 1 -- 172.21.15.79:0/171032014 wait complete. 2023-10-14T18:46:09.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 Processor -- start 2023-10-14T18:46:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 -- start start 2023-10-14T18:46:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73e8070700 0x7f73e8156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73e8159d20 0x7f73e816aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:09.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e816aa40 con 0x7f73e815e3a0 2023-10-14T18:46:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815e0e0 con 0x7f73e8070700 2023-10-14T18:46:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73ecf65700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815db20 con 0x7f73e8159d20 2023-10-14T18:46:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73e6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73e6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54916/0 (socket says 172.21.15.79:54916) 2023-10-14T18:46:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.627+0000 7f73e6d9d700 1 -- 172.21.15.79:0/2670798652 learned_addr learned my addr 172.21.15.79:0/2670798652 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e659c700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73e8070700 0x7f73e8156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73ddd9b700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73e8159d20 0x7f73e816aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 -- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73e8159d20 msgr2=0x7f73e816aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73e8159d20 0x7f73e816aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 -- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73e8070700 msgr2=0x7f73e8156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73e8070700 0x7f73e8156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 -- 172.21.15.79:0/2670798652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0009420 con 0x7f73e815e3a0 2023-10-14T18:46:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73e6d9d700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f73e000cc90 tx=0x7f73e0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000a960 con 0x7f73e815e3a0 2023-10-14T18:46:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000aac0 con 0x7f73e815e3a0 2023-10-14T18:46:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000ae80 con 0x7f73e815e3a0 2023-10-14T18:46:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e815de00 con 0x7f73e815e3a0 2023-10-14T18:46:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.628+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e816b410 con 0x7f73e815e3a0 2023-10-14T18:46:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.629+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e816abb0 con 0x7f73e815e3a0 2023-10-14T18:46:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.629+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73e0007300 con 0x7f73e815e3a0 2023-10-14T18:46:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.630+0000 7f73deffd700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.630+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73e0084910 con 0x7f73e815e3a0 2023-10-14T18:46:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.630+0000 7f73e659c700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.630+0000 7f73e659c700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 0x7f73c80693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73d8003a30 tx=0x7f73d8007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.634+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73e0051c00 con 0x7f73e815e3a0 2023-10-14T18:46:09.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.861+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73e80cd710 con 0x7f73e815e3a0 2023-10-14T18:46:09.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.861+0000 7f73deffd700 1 -- 172.21.15.79:0/2670798652 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f73e0055220 con 0x7f73e815e3a0 2023-10-14T18:46:09.863 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:09.864 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:09.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 msgr2=0x7f73c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 0x7f73c80693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f73d8003a30 tx=0x7f73d8007ea0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 msgr2=0x7f73e815d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:09.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f73e000cc90 tx=0x7f73e0001a80 comp rx=0 tx=0).stop 2023-10-14T18:46:09.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 shutdown_connections 2023-10-14T18:46:09.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73c8066f30 0x7f73c80693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73e815e3a0 0x7f73e815d120 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73e8070700 0x7f73e8156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 --2- 172.21.15.79:0/2670798652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73e8159d20 0x7f73e816aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:09.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 >> 172.21.15.79:0/2670798652 conn(0x7f73e80cda10 msgr2=0x7f73e8068400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:09.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 shutdown_connections 2023-10-14T18:46:09.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:09.863+0000 7f73ecf65700 1 -- 172.21.15.79:0/2670798652 wait complete. 2023-10-14T18:46:09.868 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:09.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 33 2023-10-14T18:46:10.007 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-14T18:46:10.008 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:46:10.008 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:46:10.008 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:46:10.009 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:46:10.009 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:46:10.009 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:46:10.010 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:46:10.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:10.263 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:46:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:client4763 2023-10-14T18:46:10.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:10.333 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client4763/osdmap') 2023-10-14T18:46:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-14T18:46:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.409 INFO:teuthology.orchestra.run.smithi079.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:46:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:46:10.410 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:46:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:46:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:46:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:46:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:46:10.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:46:10.412 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:46:10.413 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:46:10.413 INFO:teuthology.orchestra.run.smithi079.stderr:795 bytes copied, 3.3749e-05 s, 23.6 MB/s 2023-10-14T18:46:10.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:10.414 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:46:10.480 INFO:teuthology.orchestra.run.smithi079.stdout:client4763 2023-10-14T18:46:10.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:10.481 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client4763/osdmap') 2023-10-14T18:46:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 33 barrier 33 flags 0x588000 2023-10-14T18:46:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:46:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:46:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:46:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:46:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:46:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:46:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:46:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:46:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:46:10.559 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:46:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:46:10.560 INFO:teuthology.orchestra.run.smithi079.stderr:795 bytes copied, 5.0223e-05 s, 15.8 MB/s 2023-10-14T18:46:10.560 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:46:10.561 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:46:10.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:10.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:10.680 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:46:10.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:46:10.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:10.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:10.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:46:10.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:10.744 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:46:10.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:46:10.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:10.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:10.796 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:46:10.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:10.797 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:46:10.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.965+0000 7f2a0da10700 1 Processor -- start 2023-10-14T18:46:10.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.965+0000 7f2a0da10700 1 -- start start 2023-10-14T18:46:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a0da10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 0x7f2a0815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a0da10700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a08157c40 0x7f2a08158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a0da10700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0815cbb0 con 0x7f2a0815a620 2023-10-14T18:46:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a0da10700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0815bfa0 con 0x7f2a08157c40 2023-10-14T18:46:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a0da10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815c280 con 0x7f2a08157870 2023-10-14T18:46:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a08157c40 0x7f2a08158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a067fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2a0815a620 0x7f2a0815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54300/0 (socket says 172.21.15.79:54300) 2023-10-14T18:46:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a067fc700 1 -- 172.21.15.79:0/3917658573 learned_addr learned my addr 172.21.15.79:0/3917658573 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a06ffd700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 0x7f2a0815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 -- 172.21.15.79:0/3917658573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 msgr2=0x7f2a0815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:10.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 0x7f2a0815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 -- 172.21.15.79:0/3917658573 >> v1:172.21.15.79:6789/0 conn(0x7f2a0815a620 legacy=0x7f2a0815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 -- 172.21.15.79:0/3917658573 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0815c560 con 0x7f2a08157c40 2023-10-14T18:46:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a05ffb700 1 -- 172.21.15.79:0/3917658573 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047966860 0 0) 0x7f2a0815cbb0 con 0x7f2a0815a620 2023-10-14T18:46:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a06ffd700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 0x7f2a0815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:10.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a077fe700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157c40 0x7f2a08158110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf66f59fa379d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a05ffb700 1 -- 172.21.15.79:0/3917658573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00009e80 con 0x7f2a08157c40 2023-10-14T18:46:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a05ffb700 1 -- 172.21.15.79:0/3917658573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0000b860 con 0x7f2a08157c40 2023-10-14T18:46:10.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.966+0000 7f2a05ffb700 1 -- 172.21.15.79:0/3917658573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000bbe0 con 0x7f2a08157c40 2023-10-14T18:46:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 -- 172.21.15.79:0/3917658573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157c40 msgr2=0x7f2a08158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157c40 0x7f2a08158110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2a000098e0 tx=0x7f2a000091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 -- 172.21.15.79:0/3917658573 shutdown_connections 2023-10-14T18:46:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157c40 0x7f2a08158110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 --2- 172.21.15.79:0/3917658573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a08157870 0x7f2a0815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 -- 172.21.15.79:0/3917658573 >> 172.21.15.79:0/3917658573 conn(0x7f2a08068ce0 msgr2=0x7f2a080690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 -- 172.21.15.79:0/3917658573 shutdown_connections 2023-10-14T18:46:10.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.967+0000 7f2a0da10700 1 -- 172.21.15.79:0/3917658573 wait complete. 2023-10-14T18:46:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.968+0000 7f2a0da10700 1 Processor -- start 2023-10-14T18:46:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.968+0000 7f2a0da10700 1 -- start start 2023-10-14T18:46:10.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 0x7f2a080b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 0x7f2a0815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815e400 con 0x7f2a08157870 2023-10-14T18:46:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815e6e0 con 0x7f2a08157c40 2023-10-14T18:46:10.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a0da10700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815e9c0 con 0x7f2a0815a620 2023-10-14T18:46:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54934/0 (socket says 172.21.15.79:54934) 2023-10-14T18:46:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 -- 172.21.15.79:0/2222609362 learned_addr learned my addr 172.21.15.79:0/2222609362 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a077fe700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 0x7f2a0815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a067fc700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 0x7f2a080b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 -- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 msgr2=0x7f2a0815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 0x7f2a0815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 -- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 msgr2=0x7f2a080b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 0x7f2a080b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a06ffd700 1 -- 172.21.15.79:0/2222609362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00009420 con 0x7f2a08157870 2023-10-14T18:46:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a077fe700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 0x7f2a0815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.969+0000 7f2a067fc700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 0x7f2a080b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f2a06ffd700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a400 tx=0x7f29f8007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800d650 con 0x7f2a08157870 2023-10-14T18:46:10.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800d7b0 con 0x7f2a08157870 2023-10-14T18:46:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800db50 con 0x7f2a08157870 2023-10-14T18:46:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0815eca0 con 0x7f2a08157870 2023-10-14T18:46:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.970+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081438f0 con 0x7f2a08157870 2023-10-14T18:46:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.971+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0804c3c0 con 0x7f2a08157870 2023-10-14T18:46:10.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.971+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29f8015440 con 0x7f2a08157870 2023-10-14T18:46:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.971+0000 7f29feffd700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 0x7f29e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.971+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29f8084de0 con 0x7f2a08157870 2023-10-14T18:46:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.972+0000 7f2a067fc700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 0x7f29e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.972+0000 7f2a067fc700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 0x7f29e80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f29f0001890 tx=0x7f29f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:10.975+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29f804e5a0 con 0x7f2a08157870 2023-10-14T18:46:11.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.197+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a0815c840 con 0x7f2a08157870 2023-10-14T18:46:11.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.197+0000 7f29feffd700 1 -- 172.21.15.79:0/2222609362 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f29f801a090 con 0x7f2a08157870 2023-10-14T18:46:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:11.200 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:11.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 msgr2=0x7f29e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 0x7f29e80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f29f0001890 tx=0x7f29f0009040 comp rx=0 tx=0).stop 2023-10-14T18:46:11.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 msgr2=0x7f2a081433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a400 tx=0x7f29f8007910 comp rx=0 tx=0).stop 2023-10-14T18:46:11.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 shutdown_connections 2023-10-14T18:46:11.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f29e8066f30 0x7f29e80693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a0815a620 0x7f2a0815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a08157870 0x7f2a081433b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 --2- 172.21.15.79:0/2222609362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08157c40 0x7f2a080b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 >> 172.21.15.79:0/2222609362 conn(0x7f2a08068ce0 msgr2=0x7f2a080cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 shutdown_connections 2023-10-14T18:46:11.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.199+0000 7f2a0da10700 1 -- 172.21.15.79:0/2222609362 wait complete. 2023-10-14T18:46:11.204 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:11.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:11.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.326+0000 7f537793e700 1 Processor -- start 2023-10-14T18:46:11.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.326+0000 7f537793e700 1 -- start start 2023-10-14T18:46:11.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f537793e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f537793e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f537793e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700c9cb0 con 0x7f53700abeb0 2023-10-14T18:46:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f537793e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700c90a0 con 0x7f53700c8b10 2023-10-14T18:46:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f537793e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700c9380 con 0x7f53700abae0 2023-10-14T18:46:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5375edb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5374ed9700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f53700abeb0 0x7f53700c8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:52056/0 (socket says 172.21.15.79:52056) 2023-10-14T18:46:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:60854/0 (socket says 172.21.15.79:60854) 2023-10-14T18:46:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5375edb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:56716/0 (socket says 172.21.15.79:56716) 2023-10-14T18:46:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5374ed9700 1 -- 172.21.15.79:0/231850861 learned_addr learned my addr 172.21.15.79:0/231850861 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 -- 172.21.15.79:0/231850861 >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 msgr2=0x7f53700c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 --2- 172.21.15.79:0/231850861 >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 -- 172.21.15.79:0/231850861 >> v1:172.21.15.144:6789/0 conn(0x7f53700abeb0 legacy=0x7f53700c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5367fff700 1 -- 172.21.15.79:0/231850861 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834854288 0 0) 0x7f53700c9cb0 con 0x7f53700abeb0 2023-10-14T18:46:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f53756da700 1 -- 172.21.15.79:0/231850861 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700c9660 con 0x7f53700abae0 2023-10-14T18:46:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.327+0000 7f5375edb700 1 --2- 172.21.15.79:0/231850861 >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:46:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f53756da700 1 --2- 172.21.15.79:0/231850861 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f536c0098e0 tx=0x7f536c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d9901659a09b20 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f5367fff700 1 -- 172.21.15.79:0/231850861 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00b640 con 0x7f53700abae0 2023-10-14T18:46:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f5367fff700 1 -- 172.21.15.79:0/231850861 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c00b7a0 con 0x7f53700abae0 2023-10-14T18:46:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f5367fff700 1 -- 172.21.15.79:0/231850861 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00bb40 con 0x7f53700abae0 2023-10-14T18:46:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 -- 172.21.15.79:0/231850861 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 msgr2=0x7f53700c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 --2- 172.21.15.79:0/231850861 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f536c0098e0 tx=0x7f536c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 -- 172.21.15.79:0/231850861 shutdown_connections 2023-10-14T18:46:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 --2- 172.21.15.79:0/231850861 >> v2:172.21.15.144:3300/0 conn(0x7f53700c8b10 0x7f53700c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 --2- 172.21.15.79:0/231850861 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700abae0 0x7f53700c6eb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 -- 172.21.15.79:0/231850861 >> 172.21.15.79:0/231850861 conn(0x7f5370067660 msgr2=0x7f5370067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 -- 172.21.15.79:0/231850861 shutdown_connections 2023-10-14T18:46:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.328+0000 7f537793e700 1 -- 172.21.15.79:0/231850861 wait complete. 2023-10-14T18:46:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.329+0000 7f537793e700 1 Processor -- start 2023-10-14T18:46:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.329+0000 7f537793e700 1 -- start start 2023-10-14T18:46:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53700abae0 0x7f53700cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 0x7f5370157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700cd3b0 con 0x7f53700abeb0 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700ca720 con 0x7f53700abae0 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.330+0000 7f537793e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700c3780 con 0x7f53700c8b10 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54946/0 (socket says 172.21.15.79:54946) 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 -- 172.21.15.79:0/1560475359 learned_addr learned my addr 172.21.15.79:0/1560475359 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5375edb700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 0x7f5370157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f53756da700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53700abae0 0x7f53700cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 -- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 msgr2=0x7f5370157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 0x7f5370157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 -- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53700abae0 msgr2=0x7f53700cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53700abae0 0x7f53700cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 -- 172.21.15.79:0/1560475359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368009a20 con 0x7f53700abeb0 2023-10-14T18:46:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5375edb700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 0x7f5370157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f5374ed9700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f536000c810 tx=0x7f5360007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360005b30 con 0x7f53700abeb0 2023-10-14T18:46:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5360005c90 con 0x7f53700abeb0 2023-10-14T18:46:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c009420 con 0x7f53700abeb0 2023-10-14T18:46:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360007300 con 0x7f53700abeb0 2023-10-14T18:46:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.331+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53700c2ca0 con 0x7f53700abeb0 2023-10-14T18:46:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.332+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53700ca890 con 0x7f53700abeb0 2023-10-14T18:46:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.333+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f536001b400 con 0x7f53700abeb0 2023-10-14T18:46:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.333+0000 7f53657fa700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.333+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5360083e90 con 0x7f53700abeb0 2023-10-14T18:46:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.333+0000 7f53756da700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.334+0000 7f53756da700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 0x7f53540693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f536c0093f0 tx=0x7f536c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.337+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53700ca890 con 0x7f53700abeb0 2023-10-14T18:46:11.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.520+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53700c2ca0 con 0x7f53700abeb0 2023-10-14T18:46:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.521+0000 7f53657fa700 1 -- 172.21.15.79:0/1560475359 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f53700c2ca0 con 0x7f53700abeb0 2023-10-14T18:46:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:11.523 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:08.713736+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:11.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 msgr2=0x7f53540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 0x7f53540693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f536c0093f0 tx=0x7f536c017000 comp rx=0 tx=0).stop 2023-10-14T18:46:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 msgr2=0x7f53700c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f536000c810 tx=0x7f5360007df0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 shutdown_connections 2023-10-14T18:46:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5354066f30 0x7f53540693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53700c8b10 0x7f5370157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53700abae0 0x7f53700cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 --2- 172.21.15.79:0/1560475359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53700abeb0 0x7f53700c2760 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 >> 172.21.15.79:0/1560475359 conn(0x7f5370067660 msgr2=0x7f53700adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 shutdown_connections 2023-10-14T18:46:11.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.523+0000 7f537793e700 1 -- 172.21.15.79:0/1560475359 wait complete. 2023-10-14T18:46:11.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:45:54.791292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:45:56.016855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:46:11.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:46:11.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 Processor -- start 2023-10-14T18:46:11.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 -- start start 2023-10-14T18:46:11.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cd850 0x7fd3a80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3a80cdc20 0x7fd3a80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a815e660 con 0x7fd3a80cba70 2023-10-14T18:46:11.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a815d870 con 0x7fd3a80cdc20 2023-10-14T18:46:11.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.653+0000 7fd3aca12700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80b17f0 con 0x7fd3a80cd850 2023-10-14T18:46:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3a80cdc20 0x7fd3a80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3a80cba70 0x7fd3a8157250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54308/0 (socket says 172.21.15.79:54308) 2023-10-14T18:46:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a659c700 1 -- 172.21.15.79:0/1941729809 learned_addr learned my addr 172.21.15.79:0/1941729809 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a6d9d700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cd850 0x7fd3a80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 -- 172.21.15.79:0/1941729809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cd850 msgr2=0x7fd3a80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:11.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cd850 0x7fd3a80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 -- 172.21.15.79:0/1941729809 >> v1:172.21.15.79:6789/0 conn(0x7fd3a80cba70 legacy=0x7fd3a8157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a5d9b700 1 -- 172.21.15.79:0/1941729809 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843412681 0 0) 0x7fd3a815e660 con 0x7fd3a80cba70 2023-10-14T18:46:11.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 -- 172.21.15.79:0/1941729809 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a815da50 con 0x7fd3a80cdc20 2023-10-14T18:46:11.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a759e700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80b3120 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3980098e0 tx=0x7fd3980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50e534e2ac8cc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a5d9b700 1 -- 172.21.15.79:0/1941729809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398009e80 con 0x7fd3a80cdc20 2023-10-14T18:46:11.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a5d9b700 1 -- 172.21.15.79:0/1941729809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800b860 con 0x7fd3a80cdc20 2023-10-14T18:46:11.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.654+0000 7fd3a5d9b700 1 -- 172.21.15.79:0/1941729809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800bbe0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 -- 172.21.15.79:0/1941729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 msgr2=0x7fd3a80b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80b3120 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd3980098e0 tx=0x7fd3980091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 -- 172.21.15.79:0/1941729809 shutdown_connections 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80b3120 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 --2- 172.21.15.79:0/1941729809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cd850 0x7fd3a80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 -- 172.21.15.79:0/1941729809 >> 172.21.15.79:0/1941729809 conn(0x7fd3a8067660 msgr2=0x7fd3a8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 -- 172.21.15.79:0/1941729809 shutdown_connections 2023-10-14T18:46:11.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.655+0000 7fd3aca12700 1 -- 172.21.15.79:0/1941729809 wait complete. 2023-10-14T18:46:11.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.656+0000 7fd3aca12700 1 Processor -- start 2023-10-14T18:46:11.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.656+0000 7fd3aca12700 1 -- start start 2023-10-14T18:46:11.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cba70 0x7fd3a8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 0x7fd3a816b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80b5aa0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80ca1a0 con 0x7fd3a80cd850 2023-10-14T18:46:11.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c9b90 con 0x7fd3a80cba70 2023-10-14T18:46:11.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54956/0 (socket says 172.21.15.79:54956) 2023-10-14T18:46:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 -- 172.21.15.79:0/2470208436 learned_addr learned my addr 172.21.15.79:0/2470208436 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a659c700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 0x7fd3a816b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a6d9d700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cba70 0x7fd3a8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 -- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cba70 msgr2=0x7fd3a8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cba70 0x7fd3a8153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 -- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 msgr2=0x7fd3a816b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 0x7fd3a816b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 -- 172.21.15.79:0/2470208436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398009420 con 0x7fd3a80cdc20 2023-10-14T18:46:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a659c700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 0x7fd3a816b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3a759e700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd39800b3c0 tx=0x7fd398017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011630 con 0x7fd3a80cdc20 2023-10-14T18:46:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3980117b0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a816ad90 con 0x7fd3a80cdc20 2023-10-14T18:46:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011b70 con 0x7fd3a80cdc20 2023-10-14T18:46:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.657+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a816b070 con 0x7fd3a80cdc20 2023-10-14T18:46:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.658+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80c99f0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.659+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3980253f0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.659+0000 7fd38effd700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.659+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd398086160 con 0x7fd3a80cdc20 2023-10-14T18:46:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.659+0000 7fd3a6d9d700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.660+0000 7fd3a6d9d700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00075a0 tx=0x7fd3a00097a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.663+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3a80c99f0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.847+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3a80c99f0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.847+0000 7fd38effd700 1 -- 172.21.15.79:0/2470208436 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3a80c99f0 con 0x7fd3a80cdc20 2023-10-14T18:46:11.849 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:46:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 msgr2=0x7fd3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00075a0 tx=0x7fd3a00097a0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 msgr2=0x7fd3a80ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd39800b3c0 tx=0x7fd398017000 comp rx=0 tx=0).stop 2023-10-14T18:46:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 shutdown_connections 2023-10-14T18:46:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3a80cdc20 0x7fd3a80ca630 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3a80cba70 0x7fd3a8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 --2- 172.21.15.79:0/2470208436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a80cd850 0x7fd3a816b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 >> 172.21.15.79:0/2470208436 conn(0x7fd3a8067660 msgr2=0x7fd3a80cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 shutdown_connections 2023-10-14T18:46:11.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.849+0000 7fd3aca12700 1 -- 172.21.15.79:0/2470208436 wait complete. 2023-10-14T18:46:11.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:46:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.978+0000 7faa17b68700 1 Processor -- start 2023-10-14T18:46:11.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.978+0000 7faa17b68700 1 -- start start 2023-10-14T18:46:11.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa17b68700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa100c94c0 0x7faa100c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa17b68700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100c2bf0 con 0x7faa1015a120 2023-10-14T18:46:11.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa17b68700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100c9000 con 0x7faa100cc960 2023-10-14T18:46:11.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa17b68700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100cced0 con 0x7faa100c94c0 2023-10-14T18:46:11.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa15904700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faa1015a120 0x7faa100c1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54314/0 (socket says 172.21.15.79:54314) 2023-10-14T18:46:11.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa15904700 1 -- 172.21.15.79:0/655430022 learned_addr learned my addr 172.21.15.79:0/655430022 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:11.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.979+0000 7faa16105700 1 --2- 172.21.15.79:0/655430022 >> v2:172.21.15.144:3300/0 conn(0x7faa100c94c0 0x7faa100c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073510882 0 0) 0x7faa100c2bf0 con 0x7faa1015a120 2023-10-14T18:46:11.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc003570 con 0x7faa1015a120 2023-10-14T18:46:11.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157123694 0 0) 0x7faa100c9000 con 0x7faa100cc960 2023-10-14T18:46:11.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa100c2bf0 con 0x7faa100cc960 2023-10-14T18:46:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa16105700 1 -- 172.21.15.79:0/655430022 >> v1:172.21.15.144:6789/0 conn(0x7faa100cc960 legacy=0x7faa100aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa16105700 1 -- 172.21.15.79:0/655430022 >> v1:172.21.15.79:6789/0 conn(0x7faa1015a120 legacy=0x7faa100c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2477992579 0 0) 0x7fa9fc003570 con 0x7faa1015a120 2023-10-14T18:46:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa16105700 1 -- 172.21.15.79:0/655430022 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1006f750 con 0x7faa100c94c0 2023-10-14T18:46:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa16105700 1 --2- 172.21.15.79:0/655430022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100c94c0 0x7faa100c26b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa08009e60 tx=0x7faa08009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a950eb0959ac4677 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0800e070 con 0x7faa100c94c0 2023-10-14T18:46:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0800b7a0 con 0x7faa100c94c0 2023-10-14T18:46:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.980+0000 7faa14902700 1 -- 172.21.15.79:0/655430022 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c001470 con 0x7faa100c94c0 2023-10-14T18:46:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 -- 172.21.15.79:0/655430022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100c94c0 msgr2=0x7faa100c26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 --2- 172.21.15.79:0/655430022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100c94c0 0x7faa100c26b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa08009e60 tx=0x7faa08009780 comp rx=0 tx=0).stop 2023-10-14T18:46:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 -- 172.21.15.79:0/655430022 shutdown_connections 2023-10-14T18:46:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 --2- 172.21.15.79:0/655430022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100c94c0 0x7faa100c26b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 -- 172.21.15.79:0/655430022 >> 172.21.15.79:0/655430022 conn(0x7faa100680f0 msgr2=0x7faa100cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 -- 172.21.15.79:0/655430022 shutdown_connections 2023-10-14T18:46:11.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.981+0000 7faa17b68700 1 -- 172.21.15.79:0/655430022 wait complete. 2023-10-14T18:46:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.982+0000 7faa17b68700 1 Processor -- start 2023-10-14T18:46:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.982+0000 7faa17b68700 1 -- start start 2023-10-14T18:46:11.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100cc960 0x7faa1014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1015a120 0x7faa100c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10097a00 con 0x7faa100c94c0 2023-10-14T18:46:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa100c4600 con 0x7faa100cc960 2023-10-14T18:46:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1016a410 con 0x7faa1015a120 2023-10-14T18:46:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54970/0 (socket says 172.21.15.79:54970) 2023-10-14T18:46:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 -- 172.21.15.79:0/845151843 learned_addr learned my addr 172.21.15.79:0/845151843 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15103700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100cc960 0x7faa1014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa16105700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1015a120 0x7faa100c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 -- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1015a120 msgr2=0x7faa100c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1015a120 0x7faa100c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 -- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100cc960 msgr2=0x7faa1014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100cc960 0x7faa1014da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 -- 172.21.15.79:0/845151843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08009a20 con 0x7faa100c94c0 2023-10-14T18:46:11.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa15904700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00cb70 tx=0x7faa0c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c001d20 con 0x7faa100c94c0 2023-10-14T18:46:11.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c007360 con 0x7faa100c94c0 2023-10-14T18:46:11.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa100c42b0 con 0x7faa100c94c0 2023-10-14T18:46:11.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.983+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c004830 con 0x7faa100c94c0 2023-10-14T18:46:11.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.984+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1016a990 con 0x7faa100c94c0 2023-10-14T18:46:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.985+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1004c3c0 con 0x7faa100c94c0 2023-10-14T18:46:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.985+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa0c004ba0 con 0x7faa100c94c0 2023-10-14T18:46:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.985+0000 7faa05ffb700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 0x7fa9f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.985+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa0c083830 con 0x7faa100c94c0 2023-10-14T18:46:11.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.985+0000 7faa15103700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 0x7fa9f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.986+0000 7faa15103700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 0x7fa9f40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa100c2e80 tx=0x7faa00007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:11.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:11.989+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa0c050b20 con 0x7faa100c94c0 2023-10-14T18:46:12.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.169+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa1006fa30 con 0x7faa100c94c0 2023-10-14T18:46:12.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.170+0000 7faa05ffb700 1 -- 172.21.15.79:0/845151843 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa0c0180a0 con 0x7faa100c94c0 2023-10-14T18:46:12.172 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:46:12.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 msgr2=0x7fa9f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 0x7fa9f40693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa100c2e80 tx=0x7faa00007d50 comp rx=0 tx=0).stop 2023-10-14T18:46:12.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 msgr2=0x7faa10169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00cb70 tx=0x7faa0c001ab0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 shutdown_connections 2023-10-14T18:46:12.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa9f4066f30 0x7fa9f40693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa1015a120 0x7faa100c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa100c94c0 0x7faa10169ed0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 --2- 172.21.15.79:0/845151843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa100cc960 0x7faa1014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 >> 172.21.15.79:0/845151843 conn(0x7faa100680f0 msgr2=0x7faa100c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:12.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 shutdown_connections 2023-10-14T18:46:12.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.172+0000 7faa17b68700 1 -- 172.21.15.79:0/845151843 wait complete. 2023-10-14T18:46:12.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:46:12.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.301+0000 7f87d3fff700 1 Processor -- start 2023-10-14T18:46:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.301+0000 7f87d3fff700 1 -- start start 2023-10-14T18:46:12.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87d40b6580 0x7f87d406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d3fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d406ac90 con 0x7f87d406a830 2023-10-14T18:46:12.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d3fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d40b4d70 con 0x7f87d40cce30 2023-10-14T18:46:12.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d3fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d415b3b0 con 0x7f87d40b6580 2023-10-14T18:46:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d27fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87d40b6580 0x7f87d406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87d406a830 0x7f87d40b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54330/0 (socket says 172.21.15.79:54330) 2023-10-14T18:46:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d37fe700 1 -- 172.21.15.79:0/588033775 learned_addr learned my addr 172.21.15.79:0/588033775 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d27fc700 1 -- 172.21.15.79:0/588033775 >> v1:172.21.15.144:6789/0 conn(0x7f87d40cce30 legacy=0x7f87d415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d27fc700 1 -- 172.21.15.79:0/588033775 >> v1:172.21.15.79:6789/0 conn(0x7f87d406a830 legacy=0x7f87d40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d27fc700 1 -- 172.21.15.79:0/588033775 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40cd8d0 con 0x7f87d40b6580 2023-10-14T18:46:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d27fc700 1 --2- 172.21.15.79:0/588033775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d406a2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0098e0 tx=0x7f87bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825aa5f4112225c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.302+0000 7f87d1ffb700 1 -- 172.21.15.79:0/588033775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc009e80 con 0x7f87d40b6580 2023-10-14T18:46:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d1ffb700 1 -- 172.21.15.79:0/588033775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc00b860 con 0x7f87d40b6580 2023-10-14T18:46:12.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d1ffb700 1 -- 172.21.15.79:0/588033775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00bbe0 con 0x7f87d40b6580 2023-10-14T18:46:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 -- 172.21.15.79:0/588033775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 msgr2=0x7f87d406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 --2- 172.21.15.79:0/588033775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d406a2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0098e0 tx=0x7f87bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 -- 172.21.15.79:0/588033775 shutdown_connections 2023-10-14T18:46:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 --2- 172.21.15.79:0/588033775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d406a2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 -- 172.21.15.79:0/588033775 >> 172.21.15.79:0/588033775 conn(0x7f87d4068cb0 msgr2=0x7f87d40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 -- 172.21.15.79:0/588033775 shutdown_connections 2023-10-14T18:46:12.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.303+0000 7f87d3fff700 1 -- 172.21.15.79:0/588033775 wait complete. 2023-10-14T18:46:12.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.304+0000 7f87d3fff700 1 Processor -- start 2023-10-14T18:46:12.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.304+0000 7f87d3fff700 1 -- start start 2023-10-14T18:46:12.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d406a830 0x7f87d40af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d40cce30 0x7f87d41517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d416a0d0 con 0x7f87d40b6580 2023-10-14T18:46:12.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d416aef0 con 0x7f87d406a830 2023-10-14T18:46:12.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d3fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d416a2e0 con 0x7f87d40cce30 2023-10-14T18:46:12.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54980/0 (socket says 172.21.15.79:54980) 2023-10-14T18:46:12.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 -- 172.21.15.79:0/1154638682 learned_addr learned my addr 172.21.15.79:0/1154638682 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:12.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d2ffd700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d406a830 0x7f87d40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d37fe700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d40cce30 0x7f87d41517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 -- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d40cce30 msgr2=0x7f87d41517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d40cce30 0x7f87d41517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 -- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d406a830 msgr2=0x7f87d40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d406a830 0x7f87d40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.305+0000 7f87d27fc700 1 -- 172.21.15.79:0/1154638682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc009420 con 0x7f87d40b6580 2023-10-14T18:46:12.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87d27fc700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87d406b300 tx=0x7f87bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00bb20 con 0x7f87d40b6580 2023-10-14T18:46:12.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc025420 con 0x7f87d40b6580 2023-10-14T18:46:12.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0257c0 con 0x7f87d40b6580 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d416a5c0 con 0x7f87d40b6580 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.306+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d416ab80 con 0x7f87d40b6580 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.307+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d4089550 con 0x7f87d40b6580 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.307+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87bc023070 con 0x7f87d40b6580 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.307+0000 7f87caffd700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.307+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87bc085b30 con 0x7f87d40b6580 2023-10-14T18:46:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.308+0000 7f87d2ffd700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.308+0000 7f87d2ffd700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87c4007fd0 tx=0x7f87c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.312+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87bc052da0 con 0x7f87d40b6580 2023-10-14T18:46:12.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.494+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87d416b030 con 0x7f87d40b6580 2023-10-14T18:46:12.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.494+0000 7f87caffd700 1 -- 172.21.15.79:0/1154638682 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87bc0150a0 con 0x7f87d40b6580 2023-10-14T18:46:12.496 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:46:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 msgr2=0x7f87b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 0x7f87b40693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f87c4007fd0 tx=0x7f87c4009040 comp rx=0 tx=0).stop 2023-10-14T18:46:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 msgr2=0x7f87d40afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f87d406b300 tx=0x7f87bc017000 comp rx=0 tx=0).stop 2023-10-14T18:46:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 shutdown_connections 2023-10-14T18:46:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87b4066f30 0x7f87b40693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d40cce30 0x7f87d41517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d406a830 0x7f87d40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 --2- 172.21.15.79:0/1154638682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d40b6580 0x7f87d40afc70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 >> 172.21.15.79:0/1154638682 conn(0x7f87d4068cb0 msgr2=0x7f87d4158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 shutdown_connections 2023-10-14T18:46:12.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.496+0000 7f87d3fff700 1 -- 172.21.15.79:0/1154638682 wait complete. 2023-10-14T18:46:12.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:12.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.623+0000 7f62ae4ad700 1 Processor -- start 2023-10-14T18:46:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.623+0000 7f62ae4ad700 1 -- start start 2023-10-14T18:46:12.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62ae4ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a815a620 0x7f62a815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62ae4ad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62a815d580 0x7f62a8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62ae4ad700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a815cbb0 con 0x7f62a8157870 2023-10-14T18:46:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62ae4ad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a815bdb0 con 0x7f62a815d580 2023-10-14T18:46:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62ae4ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a815bfa0 con 0x7f62a815a620 2023-10-14T18:46:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62a815d580 0x7f62a8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62a7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f62a8157870 0x7f62a815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54346/0 (socket says 172.21.15.79:54346) 2023-10-14T18:46:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62a7fff700 1 -- 172.21.15.79:0/1679925133 learned_addr learned my addr 172.21.15.79:0/1679925133 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 -- 172.21.15.79:0/1679925133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a815a620 msgr2=0x7f62a815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62a77fe700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a815a620 0x7f62a815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a815a620 0x7f62a815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62a6ffd700 1 -- 172.21.15.79:0/1679925133 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566107826 0 0) 0x7f62a815cbb0 con 0x7f62a8157870 2023-10-14T18:46:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 -- 172.21.15.79:0/1679925133 >> v1:172.21.15.79:6789/0 conn(0x7f62a8157870 legacy=0x7f62a815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 -- 172.21.15.79:0/1679925133 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a815c280 con 0x7f62a815d580 2023-10-14T18:46:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.624+0000 7f62aca4a700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e60 tx=0x7f62a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473c44956e85a362 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62a6ffd700 1 -- 172.21.15.79:0/1679925133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000e070 con 0x7f62a815d580 2023-10-14T18:46:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62a6ffd700 1 -- 172.21.15.79:0/1679925133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a000bc30 con 0x7f62a815d580 2023-10-14T18:46:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62a6ffd700 1 -- 172.21.15.79:0/1679925133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0012430 con 0x7f62a815d580 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 -- 172.21.15.79:0/1679925133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 msgr2=0x7f62a8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e60 tx=0x7f62a0009780 comp rx=0 tx=0).stop 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 -- 172.21.15.79:0/1679925133 shutdown_connections 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158110 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/1679925133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a815a620 0x7f62a815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 -- 172.21.15.79:0/1679925133 >> 172.21.15.79:0/1679925133 conn(0x7f62a8068ce0 msgr2=0x7f62a80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 -- 172.21.15.79:0/1679925133 shutdown_connections 2023-10-14T18:46:12.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.625+0000 7f62ae4ad700 1 -- 172.21.15.79:0/1679925133 wait complete. 2023-10-14T18:46:12.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.626+0000 7f62ae4ad700 1 Processor -- start 2023-10-14T18:46:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.626+0000 7f62ae4ad700 1 -- start start 2023-10-14T18:46:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a8157870 0x7f62a814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a815a620 0x7f62a80d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a8150440 con 0x7f62a815d580 2023-10-14T18:46:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a814b450 con 0x7f62a815a620 2023-10-14T18:46:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62ae4ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cfa50 con 0x7f62a8157870 2023-10-14T18:46:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62aca4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62aca4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54992/0 (socket says 172.21.15.79:54992) 2023-10-14T18:46:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62aca4a700 1 -- 172.21.15.79:0/3352500847 learned_addr learned my addr 172.21.15.79:0/3352500847 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62a77fe700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a815a620 0x7f62a80d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.627+0000 7f62a7fff700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a8157870 0x7f62a814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 -- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a8157870 msgr2=0x7f62a814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a8157870 0x7f62a814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 -- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a815a620 msgr2=0x7f62a80d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a815a620 0x7f62a80d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 -- 172.21.15.79:0/3352500847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0009a20 con 0x7f62a815d580 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62aca4a700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f62a0013000 tx=0x7f62a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0027470 con 0x7f62a815d580 2023-10-14T18:46:12.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a00275d0 con 0x7f62a815d580 2023-10-14T18:46:12.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80cfcf0 con 0x7f62a815d580 2023-10-14T18:46:12.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0027970 con 0x7f62a815d580 2023-10-14T18:46:12.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.628+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a80d0590 con 0x7f62a815d580 2023-10-14T18:46:12.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.629+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a804c3c0 con 0x7f62a815d580 2023-10-14T18:46:12.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.629+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62a0024070 con 0x7f62a815d580 2023-10-14T18:46:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.629+0000 7f628ffff700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 0x7f62940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.630+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62a0086da0 con 0x7f62a815d580 2023-10-14T18:46:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.630+0000 7f62a7fff700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 0x7f62940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.630+0000 7f62a7fff700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 0x7f62940693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6298007fd0 tx=0x7f6298007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.635+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62a0054010 con 0x7f62a815d580 2023-10-14T18:46:12.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.862+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62a815c560 con 0x7f62a815d580 2023-10-14T18:46:12.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.863+0000 7f628ffff700 1 -- 172.21.15.79:0/3352500847 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f62a0057630 con 0x7f62a815d580 2023-10-14T18:46:12.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:12.865 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 msgr2=0x7f62940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 0x7f62940693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6298007fd0 tx=0x7f6298007d30 comp rx=0 tx=0).stop 2023-10-14T18:46:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 msgr2=0x7f62a8158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:12.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f62a0013000 tx=0x7f62a0019000 comp rx=0 tx=0).stop 2023-10-14T18:46:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 shutdown_connections 2023-10-14T18:46:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6294066f30 0x7f62940693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62a815d580 0x7f62a8158d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a8157870 0x7f62a814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 --2- 172.21.15.79:0/3352500847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a815a620 0x7f62a80d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 >> 172.21.15.79:0/3352500847 conn(0x7f62a8068ce0 msgr2=0x7f62a80b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 shutdown_connections 2023-10-14T18:46:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.865+0000 7f62ae4ad700 1 -- 172.21.15.79:0/3352500847 wait complete. 2023-10-14T18:46:12.869 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:12.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.991+0000 7f5b8e2d4700 1 Processor -- start 2023-10-14T18:46:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.991+0000 7f5b8e2d4700 1 -- start start 2023-10-14T18:46:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b88157870 0x7f5b8815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b8815a620 0x7f5b8815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 0x7f5b88158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:12.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8815cbb0 con 0x7f5b88157870 2023-10-14T18:46:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8815bfa0 con 0x7f5b8815d580 2023-10-14T18:46:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8e2d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8815c280 con 0x7f5b8815a620 2023-10-14T18:46:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b87fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b88157870 0x7f5b8815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b87fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b88157870 0x7f5b8815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54994/0 (socket says 172.21.15.79:54994) 2023-10-14T18:46:12.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b87fff700 1 -- 172.21.15.79:0/21590071 learned_addr learned my addr 172.21.15.79:0/21590071 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:12.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b8c871700 1 --2- 172.21.15.79:0/21590071 >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 0x7f5b88158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.992+0000 7f5b877fe700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b8815a620 0x7f5b8815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:12.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 -- 172.21.15.79:0/21590071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b8815a620 msgr2=0x7f5b8815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:12.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b8815a620 0x7f5b8815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 -- 172.21.15.79:0/21590071 >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 msgr2=0x7f5b88158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:12.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 --2- 172.21.15.79:0/21590071 >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 0x7f5b88158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:12.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 -- 172.21.15.79:0/21590071 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8815c560 con 0x7f5b88157870 2023-10-14T18:46:12.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8c871700 1 --2- 172.21.15.79:0/21590071 >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 0x7f5b88158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:12.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b87fff700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b88157870 0x7f5b8815b6a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b03b0 tx=0x7f5b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3c1160a6447750 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:12.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b86ffd700 1 -- 172.21.15.79:0/21590071 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800b860 con 0x7f5b88157870 2023-10-14T18:46:13.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b86ffd700 1 -- 172.21.15.79:0/21590071 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800b9c0 con 0x7f5b88157870 2023-10-14T18:46:13.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b86ffd700 1 -- 172.21.15.79:0/21590071 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800bd60 con 0x7f5b88157870 2023-10-14T18:46:13.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/21590071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b88157870 msgr2=0x7f5b8815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b88157870 0x7f5b8815b6a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b03b0 tx=0x7f5b78009250 comp rx=0 tx=0).stop 2023-10-14T18:46:13.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/21590071 shutdown_connections 2023-10-14T18:46:13.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/21590071 >> v2:172.21.15.144:3300/0 conn(0x7f5b8815d580 0x7f5b88158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b88157870 0x7f5b8815b6a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/21590071 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b8815a620 0x7f5b8815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/21590071 >> 172.21.15.79:0/21590071 conn(0x7f5b88068ce0 msgr2=0x7f5b880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/21590071 shutdown_connections 2023-10-14T18:46:13.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.993+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/21590071 wait complete. 2023-10-14T18:46:13.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.994+0000 7f5b8e2d4700 1 Processor -- start 2023-10-14T18:46:13.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 -- start start 2023-10-14T18:46:13.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 0x7f5b881499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 0x7f5b8814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b5b90 con 0x7f5b8815d580 2023-10-14T18:46:13.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b4fc0 con 0x7f5b8815a620 2023-10-14T18:46:13.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8e2d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880b5260 con 0x7f5b88157870 2023-10-14T18:46:13.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8c871700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8c871700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54998/0 (socket says 172.21.15.79:54998) 2023-10-14T18:46:13.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.995+0000 7f5b8c871700 1 -- 172.21.15.79:0/2434800534 learned_addr learned my addr 172.21.15.79:0/2434800534 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:13.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b87fff700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 0x7f5b881499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b877fe700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 0x7f5b8814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 -- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 msgr2=0x7f5b881499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 0x7f5b881499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 -- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 msgr2=0x7f5b8814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 0x7f5b8814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 -- 172.21.15.79:0/2434800534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780094f0 con 0x7f5b8815d580 2023-10-14T18:46:13.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b87fff700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 0x7f5b881499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b877fe700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 0x7f5b8814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8c871700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009fa0 tx=0x7f5b800099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000dd10 con 0x7f5b8815d580 2023-10-14T18:46:13.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8000f040 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880b5540 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80015650 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.996+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b88149f10 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.997+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880b5d00 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.997+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b80015a40 con 0x7f5b8815d580 2023-10-14T18:46:13.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.998+0000 7f5b6ffff700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.998+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b80084d20 con 0x7f5b8815d580 2023-10-14T18:46:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.998+0000 7f5b87fff700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:12.998+0000 7f5b87fff700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b03b0 tx=0x7f5b78017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.002+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b80051f90 con 0x7f5b8815d580 2023-10-14T18:46:13.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.185+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b8804c3c0 con 0x7f5b8815d580 2023-10-14T18:46:13.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.186+0000 7f5b6ffff700 1 -- 172.21.15.79:0/2434800534 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5b800555b0 con 0x7f5b8815d580 2023-10-14T18:46:13.188 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:13.188 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:08.713736+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 msgr2=0x7f5b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 0x7f5b740693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b03b0 tx=0x7f5b78017000 comp rx=0 tx=0).stop 2023-10-14T18:46:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 msgr2=0x7f5b880b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009fa0 tx=0x7f5b800099b0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 shutdown_connections 2023-10-14T18:46:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5b74066f30 0x7f5b740693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b8815d580 0x7f5b880b1490 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b88157870 0x7f5b881499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 --2- 172.21.15.79:0/2434800534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8815a620 0x7f5b8814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 >> 172.21.15.79:0/2434800534 conn(0x7f5b88068ce0 msgr2=0x7f5b8814c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 shutdown_connections 2023-10-14T18:46:13.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.189+0000 7f5b8e2d4700 1 -- 172.21.15.79:0/2434800534 wait complete. 2023-10-14T18:46:13.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:46:13.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:13.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.315+0000 7f295ccf1700 1 Processor -- start 2023-10-14T18:46:13.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.315+0000 7f295ccf1700 1 -- start start 2023-10-14T18:46:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295ccf1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f29580b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295ccf1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29580cfe20 0x7f29580ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295ccf1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29580c5d80 con 0x7f29580d1c30 2023-10-14T18:46:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295ccf1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2958068470 con 0x7f29580cfe20 2023-10-14T18:46:13.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295ccf1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c6060 con 0x7f295815a2b0 2023-10-14T18:46:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f2955d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29580d1c30 0x7f29580cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54358/0 (socket says 172.21.15.79:54358) 2023-10-14T18:46:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f2955d9b700 1 -- 172.21.15.79:0/2800823983 learned_addr learned my addr 172.21.15.79:0/2800823983 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f2956d9d700 1 --2- 172.21.15.79:0/2800823983 >> v2:172.21.15.144:3300/0 conn(0x7f29580cfe20 0x7f29580ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295659c700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f29580b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826683423 0 0) 0x7f29580c5d80 con 0x7f29580d1c30 2023-10-14T18:46:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.316+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2944003570 con 0x7f29580d1c30 2023-10-14T18:46:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834741315 0 0) 0x7f2944003570 con 0x7f29580d1c30 2023-10-14T18:46:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 msgr2=0x7f29580b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f29580b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 >> v2:172.21.15.144:3300/0 conn(0x7f29580cfe20 msgr2=0x7f29580ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 --2- 172.21.15.79:0/2800823983 >> v2:172.21.15.144:3300/0 conn(0x7f29580cfe20 0x7f29580ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580c6340 con 0x7f29580d1c30 2023-10-14T18:46:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f2940001470 con 0x7f29580d1c30 2023-10-14T18:46:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 >> v1:172.21.15.79:6789/0 conn(0x7f29580d1c30 legacy=0x7f29580cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f2944003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944003fe0 0x7f2944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958068470 con 0x7f2944004d50 2023-10-14T18:46:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580c6060 con 0x7f2944003fe0 2023-10-14T18:46:13.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294400ba90 con 0x7f295815a2b0 2023-10-14T18:46:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295659c700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f2944003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2955d9b700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944003fe0 0x7f2944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 -- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 msgr2=0x7f2944003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:13.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295815a2b0 0x7f2944003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 -- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944003fe0 msgr2=0x7f2944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2944003fe0 0x7f2944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 -- 172.21.15.79:0/2800823983 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944003570 con 0x7f2944004d50 2023-10-14T18:46:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f2956d9d700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29440051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f29580cda20 tx=0x7f29480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac13e7ffed8e447 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294800e680 con 0x7f2944004d50 2023-10-14T18:46:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294800e7e0 con 0x7f2944004d50 2023-10-14T18:46:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.317+0000 7f295559a700 1 -- 172.21.15.79:0/2800823983 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294800eba0 con 0x7f2944004d50 2023-10-14T18:46:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 -- 172.21.15.79:0/2800823983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 msgr2=0x7f29440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 --2- 172.21.15.79:0/2800823983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29440051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f29580cda20 tx=0x7f29480091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f2956d9d700 1 -- 172.21.15.79:0/2800823983 reap_dead start 2023-10-14T18:46:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 -- 172.21.15.79:0/2800823983 shutdown_connections 2023-10-14T18:46:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 -- 172.21.15.79:0/2800823983 >> 172.21.15.79:0/2800823983 conn(0x7f2958067e40 msgr2=0x7f29580d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 -- 172.21.15.79:0/2800823983 shutdown_connections 2023-10-14T18:46:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.318+0000 7f295ccf1700 1 -- 172.21.15.79:0/2800823983 wait complete. 2023-10-14T18:46:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.319+0000 7f295ccf1700 1 Processor -- start 2023-10-14T18:46:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.319+0000 7f295ccf1700 1 -- start start 2023-10-14T18:46:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295816a8b0 0x7f2958157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 0x7f2958160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958158010 con 0x7f2944004d50 2023-10-14T18:46:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580ca9b0 con 0x7f29580b5e40 2023-10-14T18:46:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580b6740 con 0x7f295816a8b0 2023-10-14T18:46:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55016/0 (socket says 172.21.15.79:55016) 2023-10-14T18:46:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 -- 172.21.15.79:0/1186826886 learned_addr learned my addr 172.21.15.79:0/1186826886 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f2955d9b700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295816a8b0 0x7f2958157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f2956d9d700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 0x7f2958160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 -- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295816a8b0 msgr2=0x7f2958157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295816a8b0 0x7f2958157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 -- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 msgr2=0x7f2958160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 0x7f2958160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 -- 172.21.15.79:0/1186826886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580b6a20 con 0x7f2944004d50 2023-10-14T18:46:13.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f2956d9d700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 0x7f2958160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295659c700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2950011f80 tx=0x7f295000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000e040 con 0x7f2944004d50 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295000f040 con 0x7f2944004d50 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.320+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29580ca360 con 0x7f2944004d50 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.321+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950015430 con 0x7f2944004d50 2023-10-14T18:46:13.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.321+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29580b62b0 con 0x7f2944004d50 2023-10-14T18:46:13.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.321+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29580b64d0 con 0x7f2944004d50 2023-10-14T18:46:13.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.322+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2950015860 con 0x7f2944004d50 2023-10-14T18:46:13.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.322+0000 7f294e7fc700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 0x7f29380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.322+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29500851e0 con 0x7f2944004d50 2023-10-14T18:46:13.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.322+0000 7f2955d9b700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 0x7f29380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.323+0000 7f2955d9b700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 0x7f29380693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2940007fd0 tx=0x7f2940001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.326+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2950052450 con 0x7f2944004d50 2023-10-14T18:46:13.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.556+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f295804c3c0 con 0x7f2944004d50 2023-10-14T18:46:13.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.556+0000 7f294e7fc700 1 -- 172.21.15.79:0/1186826886 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2950055a70 con 0x7f2944004d50 2023-10-14T18:46:13.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:13.557 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:13.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 msgr2=0x7f29380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 0x7f29380693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2940007fd0 tx=0x7f2940001e90 comp rx=0 tx=0).stop 2023-10-14T18:46:13.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 msgr2=0x7f29580cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2950011f80 tx=0x7f295000b040 comp rx=0 tx=0).stop 2023-10-14T18:46:13.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 shutdown_connections 2023-10-14T18:46:13.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2938066f30 0x7f29380693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29580b5e40 0x7f2958160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2944004d50 0x7f29580cae40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 --2- 172.21.15.79:0/1186826886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f295816a8b0 0x7f2958157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 >> 172.21.15.79:0/1186826886 conn(0x7f2958067e40 msgr2=0x7f29580ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 shutdown_connections 2023-10-14T18:46:13.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.558+0000 7f295ccf1700 1 -- 172.21.15.79:0/1186826886 wait complete. 2023-10-14T18:46:13.562 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:13.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 Processor -- start 2023-10-14T18:46:13.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 -- start start 2023-10-14T18:46:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed006c010 con 0x7fbed0158e50 2023-10-14T18:46:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed006bd10 con 0x7fbed01523e0 2023-10-14T18:46:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.684+0000 7fbed7c95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed015c060 con 0x7fbed0152010 2023-10-14T18:46:13.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed6232700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbed0158e50 0x7fbed00cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54362/0 (socket says 172.21.15.79:54362) 2023-10-14T18:46:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed6232700 1 -- 172.21.15.79:0/1564946934 learned_addr learned my addr 172.21.15.79:0/1564946934 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed5a31700 1 --2- 172.21.15.79:0/1564946934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876263192 0 0) 0x7fbed006c010 con 0x7fbed0158e50 2023-10-14T18:46:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc003570 con 0x7fbed0158e50 2023-10-14T18:46:13.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198054825 0 0) 0x7fbed006bd10 con 0x7fbed01523e0 2023-10-14T18:46:13.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed006c010 con 0x7fbed01523e0 2023-10-14T18:46:13.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803963831 0 0) 0x7fbebc003570 con 0x7fbed0158e50 2023-10-14T18:46:13.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed5a31700 1 -- 172.21.15.79:0/1564946934 >> v1:172.21.15.144:6789/0 conn(0x7fbed01523e0 legacy=0x7fbed006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed5a31700 1 -- 172.21.15.79:0/1564946934 >> v1:172.21.15.79:6789/0 conn(0x7fbed0158e50 legacy=0x7fbed00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed5a31700 1 -- 172.21.15.79:0/1564946934 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed015c340 con 0x7fbed0152010 2023-10-14T18:46:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed5a31700 1 --2- 172.21.15.79:0/1564946934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed015b810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e90 tx=0x7fbecc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928c5b0baf2b95b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00e070 con 0x7fbed0152010 2023-10-14T18:46:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00b870 con 0x7fbed0152010 2023-10-14T18:46:13.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.685+0000 7fbed4a2f700 1 -- 172.21.15.79:0/1564946934 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8001470 con 0x7fbed0152010 2023-10-14T18:46:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 -- 172.21.15.79:0/1564946934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 msgr2=0x7fbed015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 --2- 172.21.15.79:0/1564946934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed015b810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e90 tx=0x7fbecc009780 comp rx=0 tx=0).stop 2023-10-14T18:46:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 -- 172.21.15.79:0/1564946934 shutdown_connections 2023-10-14T18:46:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 --2- 172.21.15.79:0/1564946934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed015b810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 -- 172.21.15.79:0/1564946934 >> 172.21.15.79:0/1564946934 conn(0x7fbed0069870 msgr2=0x7fbed0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 -- 172.21.15.79:0/1564946934 shutdown_connections 2023-10-14T18:46:13.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.686+0000 7fbed7c95700 1 -- 172.21.15.79:0/1564946934 wait complete. 2023-10-14T18:46:13.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.687+0000 7fbed7c95700 1 Processor -- start 2023-10-14T18:46:13.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.687+0000 7fbed7c95700 1 -- start start 2023-10-14T18:46:13.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed0158e50 0x7fbed00c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c8740 con 0x7fbed01523e0 2023-10-14T18:46:13.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c8d00 con 0x7fbed0158e50 2023-10-14T18:46:13.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0155b50 con 0x7fbed0152010 2023-10-14T18:46:13.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55026/0 (socket says 172.21.15.79:55026) 2023-10-14T18:46:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 -- 172.21.15.79:0/2716745048 learned_addr learned my addr 172.21.15.79:0/2716745048 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5a31700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed6232700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed0158e50 0x7fbed00c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 -- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 msgr2=0x7fbed014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 -- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed0158e50 msgr2=0x7fbed00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed0158e50 0x7fbed00c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 -- 172.21.15.79:0/2716745048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009a20 con 0x7fbed01523e0 2023-10-14T18:46:13.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed5230700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c7c0 tx=0x7fbec0007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0010510 con 0x7fbed01523e0 2023-10-14T18:46:13.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec00106b0 con 0x7fbed01523e0 2023-10-14T18:46:13.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed014f8f0 con 0x7fbed01523e0 2023-10-14T18:46:13.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0010a70 con 0x7fbed01523e0 2023-10-14T18:46:13.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.689+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed0153660 con 0x7fbed01523e0 2023-10-14T18:46:13.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00c8e70 con 0x7fbed01523e0 2023-10-14T18:46:13.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbec0012440 con 0x7fbed01523e0 2023-10-14T18:46:13.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbec5ffb700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 0x7fbeb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:13.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbec0083c00 con 0x7fbed01523e0 2023-10-14T18:46:13.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbed5a31700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 0x7fbeb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:13.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.691+0000 7fbed5a31700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 0x7fbeb40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097c0 tx=0x7fbecc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:13.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.694+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbec004b5a0 con 0x7fbed01523e0 2023-10-14T18:46:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.921+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbed004c3c0 con 0x7fbed01523e0 2023-10-14T18:46:13.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.921+0000 7fbec5ffb700 1 -- 172.21.15.79:0/2716745048 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fbec0017070 con 0x7fbed01523e0 2023-10-14T18:46:13.923 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:13.923 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:45:57.046397+0000","modified":"2023-10-14T18:46:00.687957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/3482587976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3482587976},{"type":"v1","addr":"172.21.15.79:6835","nonce":3482587976}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-14T18:46:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.923+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 msgr2=0x7fbeb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.923+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 0x7fbeb40693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097c0 tx=0x7fbecc017000 comp rx=0 tx=0).stop 2023-10-14T18:46:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.923+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 msgr2=0x7fbed014f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.923+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c7c0 tx=0x7fbec0007de0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 shutdown_connections 2023-10-14T18:46:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbeb4066f30 0x7fbeb40693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbed0158e50 0x7fbed00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbed0152010 0x7fbed014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 --2- 172.21.15.79:0/2716745048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01523e0 0x7fbed014f3b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 >> 172.21.15.79:0/2716745048 conn(0x7fbed0069870 msgr2=0x7fbed0158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:13.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 shutdown_connections 2023-10-14T18:46:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:13.924+0000 7fbed7c95700 1 -- 172.21.15.79:0/2716745048 wait complete. 2023-10-14T18:46:13.927 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2023-10-14T18:46:13.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:14.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.049+0000 7fe1cb59e700 1 Processor -- start 2023-10-14T18:46:14.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.049+0000 7fe1cb59e700 1 -- start start 2023-10-14T18:46:14.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1cb59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1cc06aa70 0x7fe1cc0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1cb59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1cb59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0c76b0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1cb59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0ccc10 con 0x7fe1cc06aa70 2023-10-14T18:46:14.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1cb59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c7900 con 0x7fe1cc06ae40 2023-10-14T18:46:14.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1ca59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1cc06aa70 0x7fe1cc0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1ca59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1cc06aa70 0x7fe1cc0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55030/0 (socket says 172.21.15.79:55030) 2023-10-14T18:46:14.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.050+0000 7fe1ca59c700 1 -- 172.21.15.79:0/1878299342 learned_addr learned my addr 172.21.15.79:0/1878299342 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:14.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1c1d9b700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1ca59c700 1 -- 172.21.15.79:0/1878299342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 msgr2=0x7fe1cc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:14.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1ca59c700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1ca59c700 1 -- 172.21.15.79:0/1878299342 >> v1:172.21.15.144:6789/0 conn(0x7fe1cc0ab0e0 legacy=0x7fe1cc0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1ca59c700 1 -- 172.21.15.79:0/1878299342 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0c7be0 con 0x7fe1cc06aa70 2023-10-14T18:46:14.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1ca59c700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc0cc630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0099b0 tx=0x7fe1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2687b4e494cbe25f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1c9d9b700 1 -- 172.21.15.79:0/1878299342 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00b860 con 0x7fe1cc06aa70 2023-10-14T18:46:14.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1c9d9b700 1 -- 172.21.15.79:0/1878299342 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc00b9c0 con 0x7fe1cc06aa70 2023-10-14T18:46:14.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1c9d9b700 1 -- 172.21.15.79:0/1878299342 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00bd60 con 0x7fe1cc06aa70 2023-10-14T18:46:14.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 -- 172.21.15.79:0/1878299342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc06aa70 msgr2=0x7fe1cc0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc0cc630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0099b0 tx=0x7fe1bc009250 comp rx=0 tx=0).stop 2023-10-14T18:46:14.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 -- 172.21.15.79:0/1878299342 shutdown_connections 2023-10-14T18:46:14.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc0cc630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/1878299342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.051+0000 7fe1cb59e700 1 -- 172.21.15.79:0/1878299342 >> 172.21.15.79:0/1878299342 conn(0x7fe1cc0cd070 msgr2=0x7fe1cc0cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:14.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.052+0000 7fe1cb59e700 1 -- 172.21.15.79:0/1878299342 shutdown_connections 2023-10-14T18:46:14.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.052+0000 7fe1cb59e700 1 -- 172.21.15.79:0/1878299342 wait complete. 2023-10-14T18:46:14.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 Processor -- start 2023-10-14T18:46:14.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 -- start start 2023-10-14T18:46:14.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0c74a0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b04c0 con 0x7fe1cc06aa70 2023-10-14T18:46:14.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.053+0000 7fe1cb59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0afeb0 con 0x7fe1cc06ae40 2023-10-14T18:46:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55040/0 (socket says 172.21.15.79:55040) 2023-10-14T18:46:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 -- 172.21.15.79:0/432485291 learned_addr learned my addr 172.21.15.79:0/432485291 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1ca59c700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1c1d9b700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 -- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 msgr2=0x7fe1cc15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 -- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1cc06aa70 msgr2=0x7fe1cc097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 -- 172.21.15.79:0/432485291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0094f0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cad9d700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c840 tx=0x7fe1c4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4012630 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c40127b0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc098680 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4012b70 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.054+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc097f40 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.055+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0c9250 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.056+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1c401a3a0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.056+0000 7fe1c2ffd700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 0x7fe1ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.056+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1c4084610 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.056+0000 7fe1ca59c700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 0x7fe1ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.056+0000 7fe1ca59c700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 0x7fe1ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0099b0 tx=0x7fe1bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.060+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1c4051880 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.244+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1cc0b0630 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.244+0000 7fe1c2ffd700 1 -- 172.21.15.79:0/432485291 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe1c4054ea0 con 0x7fe1cc0ab0e0 2023-10-14T18:46:14.245 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:14.246 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:08.713736+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:45:54.791292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-14T18:45:56.016855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 msgr2=0x7fe1ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 0x7fe1ac0693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0099b0 tx=0x7fe1bc017000 comp rx=0 tx=0).stop 2023-10-14T18:46:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 msgr2=0x7fe1cc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c840 tx=0x7fe1c4001670 comp rx=0 tx=0).stop 2023-10-14T18:46:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 shutdown_connections 2023-10-14T18:46:14.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1ac066f30 0x7fe1ac0693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1cc0ab0e0 0x7fe1cc0b0950 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1cc06aa70 0x7fe1cc097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 --2- 172.21.15.79:0/432485291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1cc06ae40 0x7fe1cc15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.246+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 >> 172.21.15.79:0/432485291 conn(0x7fe1cc0cd070 msgr2=0x7fe1cc06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:14.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.247+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 shutdown_connections 2023-10-14T18:46:14.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.247+0000 7fe1cb59e700 1 -- 172.21.15.79:0/432485291 wait complete. 2023-10-14T18:46:14.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:46:14.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.373+0000 7fdd5bac1700 1 Processor -- start 2023-10-14T18:46:14.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5bac1700 1 -- start start 2023-10-14T18:46:14.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5bac1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd54157870 0x7fdd5415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5bac1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5415cbb0 con 0x7fdd5415a620 2023-10-14T18:46:14.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5bac1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5415bfa0 con 0x7fdd54157c40 2023-10-14T18:46:14.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5bac1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5415c280 con 0x7fdd54157870 2023-10-14T18:46:14.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5985d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd54157870 0x7fdd5415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.374+0000 7fdd5905c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdd5415a620 0x7fdd5415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54374/0 (socket says 172.21.15.79:54374) 2023-10-14T18:46:14.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5905c700 1 -- 172.21.15.79:0/2784854057 learned_addr learned my addr 172.21.15.79:0/2784854057 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:14.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5985d700 1 -- 172.21.15.79:0/2784854057 >> v1:172.21.15.144:6789/0 conn(0x7fdd54157c40 legacy=0x7fdd54158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:14.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5985d700 1 -- 172.21.15.79:0/2784854057 >> v1:172.21.15.79:6789/0 conn(0x7fdd5415a620 legacy=0x7fdd5415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5885b700 1 -- 172.21.15.79:0/2784854057 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095017898 0 0) 0x7fdd5415cbb0 con 0x7fdd5415a620 2023-10-14T18:46:14.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5985d700 1 -- 172.21.15.79:0/2784854057 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5415c560 con 0x7fdd54157870 2023-10-14T18:46:14.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5985d700 1 --2- 172.21.15.79:0/2784854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd54157870 0x7fdd5415b6a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098e0 tx=0x7fdd500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90012a61b90883f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5885b700 1 -- 172.21.15.79:0/2784854057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50009e80 con 0x7fdd54157870 2023-10-14T18:46:14.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5885b700 1 -- 172.21.15.79:0/2784854057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000b820 con 0x7fdd54157870 2023-10-14T18:46:14.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.375+0000 7fdd5885b700 1 -- 172.21.15.79:0/2784854057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000bba0 con 0x7fdd54157870 2023-10-14T18:46:14.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 -- 172.21.15.79:0/2784854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd54157870 msgr2=0x7fdd5415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/2784854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd54157870 0x7fdd5415b6a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098e0 tx=0x7fdd500091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 -- 172.21.15.79:0/2784854057 shutdown_connections 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/2784854057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd54157870 0x7fdd5415b6a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 -- 172.21.15.79:0/2784854057 >> 172.21.15.79:0/2784854057 conn(0x7fdd54068ce0 msgr2=0x7fdd540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 -- 172.21.15.79:0/2784854057 shutdown_connections 2023-10-14T18:46:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.376+0000 7fdd5bac1700 1 -- 172.21.15.79:0/2784854057 wait complete. 2023-10-14T18:46:14.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 Processor -- start 2023-10-14T18:46:14.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 -- start start 2023-10-14T18:46:14.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd54157870 0x7fdd54150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54157c40 0x7fdd541506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5414da40 con 0x7fdd5415a620 2023-10-14T18:46:14.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5414e2e0 con 0x7fdd54157c40 2023-10-14T18:46:14.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.377+0000 7fdd5bac1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54153b10 con 0x7fdd54157870 2023-10-14T18:46:14.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55054/0 (socket says 172.21.15.79:55054) 2023-10-14T18:46:14.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 -- 172.21.15.79:0/4114461157 learned_addr learned my addr 172.21.15.79:0/4114461157 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:14.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5905c700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54157c40 0x7fdd541506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5985d700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd54157870 0x7fdd54150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 -- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd54157870 msgr2=0x7fdd54150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd54157870 0x7fdd54150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 -- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54157c40 msgr2=0x7fdd541506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54157c40 0x7fdd541506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 -- 172.21.15.79:0/4114461157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50009420 con 0x7fdd5415a620 2023-10-14T18:46:14.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5a05e700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c890 tx=0x7fdd4c0026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c012630 con 0x7fdd5415a620 2023-10-14T18:46:14.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c012790 con 0x7fdd5415a620 2023-10-14T18:46:14.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5414dc90 con 0x7fdd5415a620 2023-10-14T18:46:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c012b50 con 0x7fdd5415a620 2023-10-14T18:46:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.378+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd54153320 con 0x7fdd5415a620 2023-10-14T18:46:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.379+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5414e490 con 0x7fdd5415a620 2023-10-14T18:46:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.379+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd4c01b400 con 0x7fdd5415a620 2023-10-14T18:46:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.380+0000 7fdd49ffb700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.380+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd4c084850 con 0x7fdd5415a620 2023-10-14T18:46:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.380+0000 7fdd5985d700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.380+0000 7fdd5985d700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 0x7fdd380693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd500030c0 tx=0x7fdd50016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.384+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd5414e490 con 0x7fdd5415a620 2023-10-14T18:46:14.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.608+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdd5414e450 con 0x7fdd5415a620 2023-10-14T18:46:14.609 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:46:14.609+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:46:14.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.613+0000 7fdd49ffb700 1 -- 172.21.15.79:0/4114461157 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdd4c051ac0 con 0x7fdd5415a620 2023-10-14T18:46:14.615 INFO:tasks.ceph.mds.c.smithi079.stderr: -3337> 2023-10-14T18:46:01.647+0000 7f0cefd55700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:46:14.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 msgr2=0x7fdd380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 0x7fdd380693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd500030c0 tx=0x7fdd50016000 comp rx=0 tx=0).stop 2023-10-14T18:46:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 msgr2=0x7fdd54152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c890 tx=0x7fdd4c0026a0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 shutdown_connections 2023-10-14T18:46:14.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd5415a620 0x7fdd54152de0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd54157870 0x7fdd54150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 --2- 172.21.15.79:0/4114461157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54157c40 0x7fdd541506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 >> 172.21.15.79:0/4114461157 conn(0x7fdd54068ce0 msgr2=0x7fdd540d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:14.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 shutdown_connections 2023-10-14T18:46:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.615+0000 7fdd5bac1700 1 -- 172.21.15.79:0/4114461157 wait complete. 2023-10-14T18:46:14.619 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:46:14.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:46:14.640 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:46:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 Processor -- start 2023-10-14T18:46:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 -- start start 2023-10-14T18:46:14.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 0x7f2ad40af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40c8d20 con 0x7f2ad4157df0 2023-10-14T18:46:14.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40c76d0 con 0x7f2ad406eaf0 2023-10-14T18:46:14.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.745+0000 7f2ada17e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c8a80 con 0x7f2ad4157a20 2023-10-14T18:46:14.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2ad4157df0 0x7f2ad40c6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54380/0 (socket says 172.21.15.79:54380) 2023-10-14T18:46:14.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad2ffd700 1 -- 172.21.15.79:0/1226194461 learned_addr learned my addr 172.21.15.79:0/1226194461 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:14.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad37fe700 1 --2- 172.21.15.79:0/1226194461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 0x7f2ad40af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad37fe700 1 -- 172.21.15.79:0/1226194461 >> v1:172.21.15.144:6789/0 conn(0x7f2ad406eaf0 legacy=0x7f2ad406ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad37fe700 1 -- 172.21.15.79:0/1226194461 >> v1:172.21.15.79:6789/0 conn(0x7f2ad4157df0 legacy=0x7f2ad40c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad37fe700 1 -- 172.21.15.79:0/1226194461 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40c7930 con 0x7f2ad4157a20 2023-10-14T18:46:14.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.746+0000 7f2ad37fe700 1 --2- 172.21.15.79:0/1226194461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 0x7f2ad40af870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009910 tx=0x7f2ac80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=383adf5f61532d15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.753+0000 7f2ad27fc700 1 -- 172.21.15.79:0/1226194461 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800b860 con 0x7f2ad4157a20 2023-10-14T18:46:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.753+0000 7f2ad27fc700 1 -- 172.21.15.79:0/1226194461 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800b9c0 con 0x7f2ad4157a20 2023-10-14T18:46:14.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.753+0000 7f2ad27fc700 1 -- 172.21.15.79:0/1226194461 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800bd60 con 0x7f2ad4157a20 2023-10-14T18:46:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 -- 172.21.15.79:0/1226194461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 msgr2=0x7f2ad40af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 --2- 172.21.15.79:0/1226194461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 0x7f2ad40af870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009910 tx=0x7f2ac80091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 -- 172.21.15.79:0/1226194461 shutdown_connections 2023-10-14T18:46:14.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 --2- 172.21.15.79:0/1226194461 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad4157a20 0x7f2ad40af870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 -- 172.21.15.79:0/1226194461 >> 172.21.15.79:0/1226194461 conn(0x7f2ad4067660 msgr2=0x7f2ad4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 -- 172.21.15.79:0/1226194461 shutdown_connections 2023-10-14T18:46:14.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.754+0000 7f2ada17e700 1 -- 172.21.15.79:0/1226194461 wait complete. 2023-10-14T18:46:14.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.755+0000 7f2ada17e700 1 Processor -- start 2023-10-14T18:46:14.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.755+0000 7f2ada17e700 1 -- start start 2023-10-14T18:46:14.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad406eaf0 0x7f2ad40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ad4157df0 0x7f2ad406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad416a970 con 0x7f2ad4157a20 2023-10-14T18:46:14.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad416da10 con 0x7f2ad4157df0 2023-10-14T18:46:14.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad416dcf0 con 0x7f2ad406eaf0 2023-10-14T18:46:14.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55082/0 (socket says 172.21.15.79:55082) 2023-10-14T18:46:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 -- 172.21.15.79:0/427769283 learned_addr learned my addr 172.21.15.79:0/427769283 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad37fe700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad406eaf0 0x7f2ad40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad3fff700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ad4157df0 0x7f2ad406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 -- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad406eaf0 msgr2=0x7f2ad40b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad406eaf0 0x7f2ad40b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 -- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ad4157df0 msgr2=0x7f2ad406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:14.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ad4157df0 0x7f2ad406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:14.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 -- 172.21.15.79:0/427769283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8009420 con 0x7f2ad4157a20 2023-10-14T18:46:14.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ad2ffd700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c590 tx=0x7f2ac4001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4005b30 con 0x7f2ad4157a20 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4005cb0 con 0x7f2ad4157a20 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad416aba0 con 0x7f2ad4157a20 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.756+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4007320 con 0x7f2ad4157a20 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.757+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad416b160 con 0x7f2ad4157a20 2023-10-14T18:46:14.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.758+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad404c3c0 con 0x7f2ad4157a20 2023-10-14T18:46:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.758+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac401b3b0 con 0x7f2ad4157a20 2023-10-14T18:46:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.758+0000 7f2abb7fe700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.758+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2ac4083900 con 0x7f2ad4157a20 2023-10-14T18:46:14.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.758+0000 7f2ad37fe700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:14.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.759+0000 7f2ad37fe700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 0x7f2ac00693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80093f0 tx=0x7f2ac8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:14.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.762+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac4050b20 con 0x7f2ad4157a20 2023-10-14T18:46:14.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:14.984+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ad416de30 con 0x7f2ad4157a20 2023-10-14T18:46:15.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.613+0000 7f2abb7fe700 1 -- 172.21.15.79:0/427769283 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2ac4054140 con 0x7f2ad4157a20 2023-10-14T18:46:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 msgr2=0x7f2ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 0x7f2ac00693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80093f0 tx=0x7f2ac8017000 comp rx=0 tx=0).stop 2023-10-14T18:46:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 msgr2=0x7f2ad416a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c590 tx=0x7f2ac4001020 comp rx=0 tx=0).stop 2023-10-14T18:46:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 shutdown_connections 2023-10-14T18:46:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ad4157df0 0x7f2ad406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ad406eaf0 0x7f2ad40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 --2- 172.21.15.79:0/427769283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ad4157a20 0x7f2ad416a430 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.615+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 >> 172.21.15.79:0/427769283 conn(0x7f2ad4067660 msgr2=0x7f2ad4158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.616+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 shutdown_connections 2023-10-14T18:46:15.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.616+0000 7f2ada17e700 1 -- 172.21.15.79:0/427769283 wait complete. 2023-10-14T18:46:15.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:46:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.788+0000 7f5a550f6700 1 Processor -- start 2023-10-14T18:46:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.788+0000 7f5a550f6700 1 -- start start 2023-10-14T18:46:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a550f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a50164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a550f6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500cd4f0 con 0x7f5a500cc940 2023-10-14T18:46:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a550f6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500cbb80 con 0x7f5a5015d240 2023-10-14T18:46:15.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a550f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500cbe60 con 0x7f5a500cf820 2023-10-14T18:46:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a4f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a500cc940 0x7f5a500ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54384/0 (socket says 172.21.15.79:54384) 2023-10-14T18:46:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3491878676 learned_addr learned my addr 172.21.15.79:0/3491878676 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000552766 0 0) 0x7f5a500cd4f0 con 0x7f5a500cc940 2023-10-14T18:46:15.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a38003570 con 0x7f5a500cc940 2023-10-14T18:46:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.789+0000 7f5a548f5700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a50164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720741595 0 0) 0x7f5a38003570 con 0x7f5a500cc940 2023-10-14T18:46:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 msgr2=0x7f5a50164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:15.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a50164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 >> v1:172.21.15.144:6789/0 conn(0x7f5a5015d240 legacy=0x7f5a500b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500cc140 con 0x7f5a500cc940 2023-10-14T18:46:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f5a44001470 con 0x7f5a500cc940 2023-10-14T18:46:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 >> v1:172.21.15.79:6789/0 conn(0x7f5a500cc940 legacy=0x7f5a500ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a38003a90 0x7f5a38003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38004810 0x7f5a38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a38005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500cbe60 con 0x7f5a38004810 2023-10-14T18:46:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800bbc0 con 0x7f5a38003a90 2023-10-14T18:46:15.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800bd80 con 0x7f5a500cf820 2023-10-14T18:46:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38004810 0x7f5a38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a548f5700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a38005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4ffff700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a38003a90 0x7f5a38003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 msgr2=0x7f5a38005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:15.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a38005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a38003a90 msgr2=0x7f5a38003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a38003a90 0x7f5a38003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3491878676 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a38003570 con 0x7f5a38004810 2023-10-14T18:46:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a548f5700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a500cf820 0x7f5a38005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:15.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38004810 0x7f5a38004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400c3c0 tx=0x7f5a44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d2ee76d7019066 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400cc90 con 0x7f5a38004810 2023-10-14T18:46:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4400cdf0 con 0x7f5a38004810 2023-10-14T18:46:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.790+0000 7f5a4effd700 1 -- 172.21.15.79:0/3491878676 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44005b70 con 0x7f5a38004810 2023-10-14T18:46:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 -- 172.21.15.79:0/3491878676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38004810 msgr2=0x7f5a38004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3491878676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a38004810 0x7f5a38004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400c3c0 tx=0x7f5a44001e70 comp rx=0 tx=0).stop 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a548f5700 1 -- 172.21.15.79:0/3491878676 reap_dead start 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 -- 172.21.15.79:0/3491878676 shutdown_connections 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 -- 172.21.15.79:0/3491878676 >> 172.21.15.79:0/3491878676 conn(0x7f5a50067e40 msgr2=0x7f5a500d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 -- 172.21.15.79:0/3491878676 shutdown_connections 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.791+0000 7f5a550f6700 1 -- 172.21.15.79:0/3491878676 wait complete. 2023-10-14T18:46:15.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.792+0000 7f5a550f6700 1 Processor -- start 2023-10-14T18:46:15.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.792+0000 7f5a550f6700 1 -- start start 2023-10-14T18:46:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a38004810 0x7f5a50154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a5015e1b0 0x7f5a50069150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5015e700 con 0x7f5a500b50a0 2023-10-14T18:46:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500b4c10 con 0x7f5a5015e1b0 2023-10-14T18:46:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a550f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a500b42e0 con 0x7f5a38004810 2023-10-14T18:46:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55088/0 (socket says 172.21.15.79:55088) 2023-10-14T18:46:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3722206554 learned_addr learned my addr 172.21.15.79:0/3722206554 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4ffff700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a38004810 0x7f5a50154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a548f5700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a5015e1b0 0x7f5a50069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a38004810 msgr2=0x7f5a50154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a38004810 0x7f5a50154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a5015e1b0 msgr2=0x7f5a50069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a5015e1b0 0x7f5a50069150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 -- 172.21.15.79:0/3722206554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500b45c0 con 0x7f5a500b50a0 2023-10-14T18:46:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.793+0000 7f5a4f7fe700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800bb90 tx=0x7f5a44015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:15.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.794+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400cc90 con 0x7f5a500b50a0 2023-10-14T18:46:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.794+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44000fe0 con 0x7f5a500b50a0 2023-10-14T18:46:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.794+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44007530 con 0x7f5a500b50a0 2023-10-14T18:46:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.794+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a500b48a0 con 0x7f5a500b50a0 2023-10-14T18:46:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.794+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5015ef80 con 0x7f5a500b50a0 2023-10-14T18:46:15.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.795+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a500b4d80 con 0x7f5a500b50a0 2023-10-14T18:46:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.795+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a44019030 con 0x7f5a500b50a0 2023-10-14T18:46:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.795+0000 7f5a37fff700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.795+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f5a44085750 con 0x7f5a500b50a0 2023-10-14T18:46:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.795+0000 7f5a4ffff700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:15.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.796+0000 7f5a4ffff700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 0x7f5a3c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a40001130 tx=0x7f5a40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:15.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.799+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a44052ae0 con 0x7f5a500b50a0 2023-10-14T18:46:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:15.980+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a500cc420 con 0x7f5a500b50a0 2023-10-14T18:46:16.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.761+0000 7f5a37fff700 1 -- 172.21.15.79:0/3722206554 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5a44056100 con 0x7f5a500b50a0 2023-10-14T18:46:16.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 msgr2=0x7f5a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 0x7f5a3c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a40001130 tx=0x7f5a40009040 comp rx=0 tx=0).stop 2023-10-14T18:46:16.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 msgr2=0x7f5a50068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800bb90 tx=0x7f5a44015000 comp rx=0 tx=0).stop 2023-10-14T18:46:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 shutdown_connections 2023-10-14T18:46:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a3c066f30 0x7f5a3c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a5015e1b0 0x7f5a50069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a38004810 0x7f5a50154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 --2- 172.21.15.79:0/3722206554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a500b50a0 0x7f5a50068c10 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800bb90 tx=0x7f5a44015000 comp rx=0 tx=0).stop 2023-10-14T18:46:16.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.764+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 >> 172.21.15.79:0/3722206554 conn(0x7f5a50067e40 msgr2=0x7f5a50156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:16.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.765+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 shutdown_connections 2023-10-14T18:46:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.765+0000 7f5a550f6700 1 -- 172.21.15.79:0/3722206554 wait complete. 2023-10-14T18:46:16.768 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:46:16.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:46:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.898+0000 7ff101582700 1 Processor -- start 2023-10-14T18:46:16.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.898+0000 7ff101582700 1 -- start start 2023-10-14T18:46:16.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff101582700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0fc15d240 0x7ff0fc0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff101582700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0cd4f0 con 0x7ff0fc0cc940 2023-10-14T18:46:16.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff101582700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0b3f40 con 0x7ff0fc0ce810 2023-10-14T18:46:16.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff101582700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0cbb80 con 0x7ff0fc15d240 2023-10-14T18:46:16.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0fb7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff0fc0cc940 0x7ff0fc0ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54396/0 (socket says 172.21.15.79:54396) 2023-10-14T18:46:16.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0fb7fe700 1 -- 172.21.15.79:0/3065845422 learned_addr learned my addr 172.21.15.79:0/3065845422 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:16.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0fbfff700 1 --2- 172.21.15.79:0/3065845422 >> v2:172.21.15.144:3300/0 conn(0x7ff0fc15d240 0x7ff0fc0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238249016 0 0) 0x7ff0fc0cd4f0 con 0x7ff0fc0cc940 2023-10-14T18:46:16.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e4003570 con 0x7ff0fc0cc940 2023-10-14T18:46:16.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.899+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585133509 0 0) 0x7ff0e4003570 con 0x7ff0fc0cc940 2023-10-14T18:46:16.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 >> v2:172.21.15.144:3300/0 conn(0x7ff0fc15d240 msgr2=0x7ff0fc0b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:16.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 --2- 172.21.15.79:0/3065845422 >> v2:172.21.15.144:3300/0 conn(0x7ff0fc15d240 0x7ff0fc0b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 >> v1:172.21.15.144:6789/0 conn(0x7ff0fc0ce810 legacy=0x7ff0fc0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0cbe60 con 0x7ff0fc0cc940 2023-10-14T18:46:16.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff0f0001470 con 0x7ff0fc0cc940 2023-10-14T18:46:16.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 >> v1:172.21.15.79:6789/0 conn(0x7ff0fc0cc940 legacy=0x7ff0fc0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e4003a60 0x7ff0e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40051c0 0x7ff0e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0cbb80 con 0x7ff0e4004810 2023-10-14T18:46:16.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e400c160 con 0x7ff0e40051c0 2023-10-14T18:46:16.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e400c320 con 0x7ff0e4003a60 2023-10-14T18:46:16.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fbfff700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e4003a60 0x7ff0e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff100d81700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40051c0 0x7ff0e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 -- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e4003a60 msgr2=0x7ff0e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:16.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e4003a60 0x7ff0e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 -- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40051c0 msgr2=0x7ff0e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:16.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40051c0 0x7ff0e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 -- 172.21.15.79:0/3065845422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4003570 con 0x7ff0e4004810 2023-10-14T18:46:16.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff100d81700 1 -- 172.21.15.79:0/3065845422 reap_dead start 2023-10-14T18:46:16.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0e4004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c3c0 tx=0x7ff0f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503279c282e71295 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:16.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000cc90 con 0x7ff0e4004810 2023-10-14T18:46:16.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000cdf0 con 0x7ff0e4004810 2023-10-14T18:46:16.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.900+0000 7ff0faffd700 1 -- 172.21.15.79:0/3065845422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0005b50 con 0x7ff0e4004810 2023-10-14T18:46:16.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 -- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 msgr2=0x7ff0e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0e4004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c3c0 tx=0x7ff0f0001e50 comp rx=0 tx=0).stop 2023-10-14T18:46:16.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 -- 172.21.15.79:0/3065845422 shutdown_connections 2023-10-14T18:46:16.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 --2- 172.21.15.79:0/3065845422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0e4004c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 -- 172.21.15.79:0/3065845422 >> 172.21.15.79:0/3065845422 conn(0x7ff0fc067e40 msgr2=0x7ff0fc0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:16.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 -- 172.21.15.79:0/3065845422 shutdown_connections 2023-10-14T18:46:16.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.901+0000 7ff101582700 1 -- 172.21.15.79:0/3065845422 wait complete. 2023-10-14T18:46:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.902+0000 7ff101582700 1 Processor -- start 2023-10-14T18:46:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.902+0000 7ff101582700 1 -- start start 2023-10-14T18:46:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0fc0b2ee0 0x7ff0fc09c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 0x7ff0fc09c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09cd50 con 0x7ff0e4004810 2023-10-14T18:46:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc16a8f0 con 0x7ff0fc0cabf0 2023-10-14T18:46:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff101582700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc16abd0 con 0x7ff0fc0b2ee0 2023-10-14T18:46:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55116/0 (socket says 172.21.15.79:55116) 2023-10-14T18:46:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 -- 172.21.15.79:0/3390488134 learned_addr learned my addr 172.21.15.79:0/3390488134 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0fc0b2ee0 0x7ff0fc09c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff100d81700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 0x7ff0fc09c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 -- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0fc0b2ee0 msgr2=0x7ff0fc09c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0fc0b2ee0 0x7ff0fc09c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 -- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 msgr2=0x7ff0fc09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 0x7ff0fc09c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 -- 172.21.15.79:0/3390488134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc16aeb0 con 0x7ff0e4004810 2023-10-14T18:46:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff100d81700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 0x7ff0fc09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.903+0000 7ff0fbfff700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0116e0 tx=0x7ff0ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec005c10 con 0x7ff0e4004810 2023-10-14T18:46:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec005d70 con 0x7ff0e4004810 2023-10-14T18:46:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec006280 con 0x7ff0e4004810 2023-10-14T18:46:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc16b190 con 0x7ff0e4004810 2023-10-14T18:46:16.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc16a560 con 0x7ff0e4004810 2023-10-14T18:46:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.904+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc06ac60 con 0x7ff0e4004810 2023-10-14T18:46:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.905+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0ec0066b0 con 0x7ff0e4004810 2023-10-14T18:46:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.905+0000 7ff0e3fff700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.905+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff0ec084930 con 0x7ff0e4004810 2023-10-14T18:46:16.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.905+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:16.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.906+0000 7ff0fb7fe700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 0x7ff0e80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1591a0 tx=0x7ff0f0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:16.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:16.909+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0ec051d00 con 0x7ff0e4004810 2023-10-14T18:46:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.093+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0fc09a8a0 con 0x7ff0e4004810 2023-10-14T18:46:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.764+0000 7ff0e3fff700 1 -- 172.21.15.79:0/3390488134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff0ec0190d0 con 0x7ff0e4004810 2023-10-14T18:46:17.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.767+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 msgr2=0x7ff0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.767+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 0x7ff0e80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc1591a0 tx=0x7ff0f0015000 comp rx=0 tx=0).stop 2023-10-14T18:46:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 msgr2=0x7ff0fc1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0116e0 tx=0x7ff0ec008040 comp rx=0 tx=0).stop 2023-10-14T18:46:17.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 shutdown_connections 2023-10-14T18:46:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff0e8066f30 0x7ff0e80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0fc0cabf0 0x7ff0fc09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0e4004810 0x7ff0fc1585a0 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0116e0 tx=0x7ff0ec008040 comp rx=0 tx=0).stop 2023-10-14T18:46:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 --2- 172.21.15.79:0/3390488134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0fc0b2ee0 0x7ff0fc09c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 >> 172.21.15.79:0/3390488134 conn(0x7ff0fc067e40 msgr2=0x7ff0fc0cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:17.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 shutdown_connections 2023-10-14T18:46:17.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.768+0000 7ff101582700 1 -- 172.21.15.79:0/3390488134 wait complete. 2023-10-14T18:46:17.771 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:46:17.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:46:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.899+0000 7f5f50a27700 1 Processor -- start 2023-10-14T18:46:17.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.899+0000 7f5f50a27700 1 -- start start 2023-10-14T18:46:17.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f50a27700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f4c06aa00 0x7f5f4c164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:17.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f50a27700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0b4d70 con 0x7f5f4c0b6580 2023-10-14T18:46:17.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f50a27700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c15b3b0 con 0x7f5f4c0cce30 2023-10-14T18:46:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f50a27700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0cd8d0 con 0x7f5f4c06aa00 2023-10-14T18:46:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4b59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f4c06aa00 0x7f5f4c164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4a59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5f4c0b6580 0x7f5f4c06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54406/0 (socket says 172.21.15.79:54406) 2023-10-14T18:46:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4a59c700 1 -- 172.21.15.79:0/1863096459 learned_addr learned my addr 172.21.15.79:0/1863096459 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1863096459 >> v1:172.21.15.144:6789/0 conn(0x7f5f4c0cce30 legacy=0x7f5f4c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1863096459 >> v1:172.21.15.79:6789/0 conn(0x7f5f4c0b6580 legacy=0x7f5f4c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f49d9b700 1 -- 172.21.15.79:0/1863096459 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096610678 0 0) 0x7f5f4c0b4d70 con 0x7f5f4c0b6580 2023-10-14T18:46:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1863096459 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0b4440 con 0x7f5f4c06aa00 2023-10-14T18:46:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f4b59e700 1 --2- 172.21.15.79:0/1863096459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c06aa00 0x7f5f4c164c20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ea7aa4be8b3f5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f49d9b700 1 -- 172.21.15.79:0/1863096459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400e070 con 0x7f5f4c06aa00 2023-10-14T18:46:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f49d9b700 1 -- 172.21.15.79:0/1863096459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400bbf0 con 0x7f5f4c06aa00 2023-10-14T18:46:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.900+0000 7f5f49d9b700 1 -- 172.21.15.79:0/1863096459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44012430 con 0x7f5f4c06aa00 2023-10-14T18:46:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 -- 172.21.15.79:0/1863096459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c06aa00 msgr2=0x7f5f4c164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1863096459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c06aa00 0x7f5f4c164c20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e60 tx=0x7f5f44009780 comp rx=0 tx=0).stop 2023-10-14T18:46:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 -- 172.21.15.79:0/1863096459 shutdown_connections 2023-10-14T18:46:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1863096459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c06aa00 0x7f5f4c164c20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 -- 172.21.15.79:0/1863096459 >> 172.21.15.79:0/1863096459 conn(0x7f5f4c068cb0 msgr2=0x7f5f4c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 -- 172.21.15.79:0/1863096459 shutdown_connections 2023-10-14T18:46:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.901+0000 7f5f50a27700 1 -- 172.21.15.79:0/1863096459 wait complete. 2023-10-14T18:46:17.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.902+0000 7f5f50a27700 1 Processor -- start 2023-10-14T18:46:17.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.902+0000 7f5f50a27700 1 -- start start 2023-10-14T18:46:17.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f4c06aa00 0x7f5f4c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:17.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4c0b6580 0x7f5f4c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:17.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:17.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1544e0 con 0x7f5f4c0cce30 2023-10-14T18:46:17.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c152f40 con 0x7f5f4c0b6580 2023-10-14T18:46:17.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f50a27700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c1531e0 con 0x7f5f4c06aa00 2023-10-14T18:46:17.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:17.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55136/0 (socket says 172.21.15.79:55136) 2023-10-14T18:46:17.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1394766117 learned_addr learned my addr 172.21.15.79:0/1394766117 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:17.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4ad9d700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f4c06aa00 0x7f5f4c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4a59c700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4c0b6580 0x7f5f4c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f4c06aa00 msgr2=0x7f5f4c153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f4c06aa00 0x7f5f4c153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4c0b6580 msgr2=0x7f5f4c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4c0b6580 0x7f5f4c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 -- 172.21.15.79:0/1394766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009a20 con 0x7f5f4c0cce30 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.903+0000 7f5f4b59e700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f44003000 tx=0x7f5f44018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.904+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4401e640 con 0x7f5f4c0cce30 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.904+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4401e7a0 con 0x7f5f4c0cce30 2023-10-14T18:46:17.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.904+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c1534c0 con 0x7f5f4c0cce30 2023-10-14T18:46:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.904+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4401eb60 con 0x7f5f4c0cce30 2023-10-14T18:46:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.904+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c153a80 con 0x7f5f4c0cce30 2023-10-14T18:46:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.905+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c089550 con 0x7f5f4c0cce30 2023-10-14T18:46:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.905+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f44024070 con 0x7f5f4c0cce30 2023-10-14T18:46:17.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.905+0000 7f5f32ffd700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 0x7f5f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.905+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5f44086c50 con 0x7f5f4c0cce30 2023-10-14T18:46:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.905+0000 7f5f4ad9d700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 0x7f5f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.906+0000 7f5f4ad9d700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 0x7f5f380693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c160160 tx=0x7f5f3c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:17.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:17.909+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f4408c020 con 0x7f5f4c0cce30 2023-10-14T18:46:18.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.092+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5f4c0b4720 con 0x7f5f4c0cce30 2023-10-14T18:46:18.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.096+0000 7f5f32ffd700 1 -- 172.21.15.79:0/1394766117 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5f44054270 con 0x7f5f4c0cce30 2023-10-14T18:46:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 msgr2=0x7f5f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 0x7f5f380693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c160160 tx=0x7f5f3c009060 comp rx=0 tx=0).stop 2023-10-14T18:46:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 msgr2=0x7f5f4c16d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f44003000 tx=0x7f5f44018000 comp rx=0 tx=0).stop 2023-10-14T18:46:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 shutdown_connections 2023-10-14T18:46:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f38066f30 0x7f5f380693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f4c0cce30 0x7f5f4c16d980 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f4c06aa00 0x7f5f4c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 --2- 172.21.15.79:0/1394766117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f4c0b6580 0x7f5f4c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 >> 172.21.15.79:0/1394766117 conn(0x7f5f4c068cb0 msgr2=0x7f5f4c0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:18.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 shutdown_connections 2023-10-14T18:46:18.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.098+0000 7f5f50a27700 1 -- 172.21.15.79:0/1394766117 wait complete. 2023-10-14T18:46:18.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-14T18:46:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.223+0000 7f0f5bc76700 1 Processor -- start 2023-10-14T18:46:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 -- start start 2023-10-14T18:46:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5415a620 0x7f0f5415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 0x7f0f54158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5415cbb0 con 0x7f0f54157870 2023-10-14T18:46:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5415bdb0 con 0x7f0f5415a620 2023-10-14T18:46:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.224+0000 7f0f5bc76700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5415bfa0 con 0x7f0f5415d580 2023-10-14T18:46:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f5a213700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 0x7f0f54158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5415a620 0x7f0f5415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59a12700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f54157870 0x7f0f5415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:52170/0 (socket says 172.21.15.79:52170) 2023-10-14T18:46:18.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59a12700 1 -- 172.21.15.79:0/3640941657 learned_addr learned my addr 172.21.15.79:0/3640941657 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:18.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5415a620 0x7f0f5415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:56896/0 (socket says 172.21.15.79:56896) 2023-10-14T18:46:18.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f5a213700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 0x7f0f54158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:32880/0 (socket says 172.21.15.79:32880) 2023-10-14T18:46:18.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 -- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 msgr2=0x7f0f54158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:18.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 --2- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 0x7f0f54158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 -- 172.21.15.79:0/3640941657 >> v1:172.21.15.144:6789/0 conn(0x7f0f54157870 legacy=0x7f0f5415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f58a10700 1 -- 172.21.15.79:0/3640941657 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759146883 0 0) 0x7f0f5415cbb0 con 0x7f0f54157870 2023-10-14T18:46:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 -- 172.21.15.79:0/3640941657 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5415c280 con 0x7f0f5415a620 2023-10-14T18:46:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.225+0000 7f0f59211700 1 --2- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415a620 0x7f0f5415d040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098e0 tx=0x7f0f440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20170d79928fb5d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f58a10700 1 -- 172.21.15.79:0/3640941657 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400b640 con 0x7f0f5415a620 2023-10-14T18:46:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f58a10700 1 -- 172.21.15.79:0/3640941657 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4400b7a0 con 0x7f0f5415a620 2023-10-14T18:46:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f58a10700 1 -- 172.21.15.79:0/3640941657 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400bb40 con 0x7f0f5415a620 2023-10-14T18:46:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415a620 msgr2=0x7f0f5415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415a620 0x7f0f5415d040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098e0 tx=0x7f0f440091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3640941657 shutdown_connections 2023-10-14T18:46:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415d580 0x7f0f54158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3640941657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415a620 0x7f0f5415d040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3640941657 >> 172.21.15.79:0/3640941657 conn(0x7f0f54068ce0 msgr2=0x7f0f540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3640941657 shutdown_connections 2023-10-14T18:46:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.226+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3640941657 wait complete. 2023-10-14T18:46:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.227+0000 7f0f5bc76700 1 Processor -- start 2023-10-14T18:46:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.227+0000 7f0f5bc76700 1 -- start start 2023-10-14T18:46:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415a620 0x7f0f5415f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 0x7f0f5415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5415f120 con 0x7f0f54157870 2023-10-14T18:46:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54159d90 con 0x7f0f5415d580 2023-10-14T18:46:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5bc76700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5415e780 con 0x7f0f5415a620 2023-10-14T18:46:18.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55148/0 (socket says 172.21.15.79:55148) 2023-10-14T18:46:18.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 -- 172.21.15.79:0/3310487571 learned_addr learned my addr 172.21.15.79:0/3310487571 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:18.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5a213700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 0x7f0f5415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59211700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415a620 0x7f0f5415f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 -- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415a620 msgr2=0x7f0f5415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415a620 0x7f0f5415f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 -- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 msgr2=0x7f0f5415fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 0x7f0f5415fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f59a12700 1 -- 172.21.15.79:0/3310487571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44009420 con 0x7f0f54157870 2023-10-14T18:46:18.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.228+0000 7f0f5a213700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 0x7f0f5415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:18.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f59a12700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c7e0 tx=0x7f0f50007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50005b30 con 0x7f0f54157870 2023-10-14T18:46:18.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f50005c90 con 0x7f0f54157870 2023-10-14T18:46:18.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5415ea60 con 0x7f0f54157870 2023-10-14T18:46:18.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50007300 con 0x7f0f54157870 2023-10-14T18:46:18.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.229+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5416da50 con 0x7f0f54157870 2023-10-14T18:46:18.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.230+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5404c3c0 con 0x7f0f54157870 2023-10-14T18:46:18.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.230+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f500076b0 con 0x7f0f54157870 2023-10-14T18:46:18.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.230+0000 7f0f49ffb700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.231+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0f50083cd0 con 0x7f0f54157870 2023-10-14T18:46:18.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.231+0000 7f0f59211700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.231+0000 7f0f59211700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f5415aa20 tx=0x7f0f44017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.234+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f500512c0 con 0x7f0f54157870 2023-10-14T18:46:18.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.496+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f0f5415c560 con 0x7f0f54157870 2023-10-14T18:46:18.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.764+0000 7f0f49ffb700 1 -- 172.21.15.79:0/3310487571 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v84) v1 ==== 130+0+0 (secure 0 0 0) 0x7f0f500548e0 con 0x7f0f54157870 2023-10-14T18:46:18.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 msgr2=0x7f0f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 0x7f0f380693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f5415aa20 tx=0x7f0f44017000 comp rx=0 tx=0).stop 2023-10-14T18:46:18.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 msgr2=0x7f0f5416a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c7e0 tx=0x7f0f50007df0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 shutdown_connections 2023-10-14T18:46:18.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f38066f30 0x7f0f380693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5415d580 0x7f0f5415fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f54157870 0x7f0f5416a760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 --2- 172.21.15.79:0/3310487571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f5415a620 0x7f0f5415f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 >> 172.21.15.79:0/3310487571 conn(0x7f0f54068ce0 msgr2=0x7f0f541544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 shutdown_connections 2023-10-14T18:46:18.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.766+0000 7f0f5bc76700 1 -- 172.21.15.79:0/3310487571 wait complete. 2023-10-14T18:46:18.779 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-14T18:46:18.780 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-14T18:46:18.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-14T18:46:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.894+0000 7f4d6fda2700 1 Processor -- start 2023-10-14T18:46:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 -- start start 2023-10-14T18:46:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d680d1c30 0x7f4d680ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d6815a680 0x7f4d680cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680c5d80 con 0x7f4d6815a2b0 2023-10-14T18:46:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d68068470 con 0x7f4d6815a680 2023-10-14T18:46:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.895+0000 7f4d6fda2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c6060 con 0x7f4d680d1c30 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d6815a680 0x7f4d680cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d6815a680 0x7f4d680cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48384/0 (socket says 172.21.15.79:48384) 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 -- 172.21.15.79:0/4185927147 learned_addr learned my addr 172.21.15.79:0/4185927147 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6d33d700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d680d1c30 0x7f4d680ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 -- 172.21.15.79:0/4185927147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d680d1c30 msgr2=0x7f4d680ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d680d1c30 0x7f4d680ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 -- 172.21.15.79:0/4185927147 >> v1:172.21.15.144:6789/0 conn(0x7f4d6815a2b0 legacy=0x7f4d680b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 -- 172.21.15.79:0/4185927147 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680c6340 con 0x7f4d6815a680 2023-10-14T18:46:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6e33f700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d6815a680 0x7f4d680cf710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009f20 tx=0x7f4d60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef903fc810598fae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6cb3c700 1 -- 172.21.15.79:0/4185927147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000e070 con 0x7f4d6815a680 2023-10-14T18:46:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6cb3c700 1 -- 172.21.15.79:0/4185927147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000b9d0 con 0x7f4d6815a680 2023-10-14T18:46:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.896+0000 7f4d6cb3c700 1 -- 172.21.15.79:0/4185927147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600092e0 con 0x7f4d6815a680 2023-10-14T18:46:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 -- 172.21.15.79:0/4185927147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d6815a680 msgr2=0x7f4d680cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d6815a680 0x7f4d680cf710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009f20 tx=0x7f4d60009840 comp rx=0 tx=0).stop 2023-10-14T18:46:18.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 -- 172.21.15.79:0/4185927147 shutdown_connections 2023-10-14T18:46:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d6815a680 0x7f4d680cf710 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/4185927147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d680d1c30 0x7f4d680ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 -- 172.21.15.79:0/4185927147 >> 172.21.15.79:0/4185927147 conn(0x7f4d68067e40 msgr2=0x7f4d680d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 -- 172.21.15.79:0/4185927147 shutdown_connections 2023-10-14T18:46:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.897+0000 7f4d6fda2700 1 -- 172.21.15.79:0/4185927147 wait complete. 2023-10-14T18:46:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.898+0000 7f4d6fda2700 1 Processor -- start 2023-10-14T18:46:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.898+0000 7f4d6fda2700 1 -- start start 2023-10-14T18:46:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d6815a2b0 0x7f4d680b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d6815a680 0x7f4d680b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6815ac90 con 0x7f4d680d1c30 2023-10-14T18:46:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c9af0 con 0x7f4d6815a680 2023-10-14T18:46:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c9dd0 con 0x7f4d6815a2b0 2023-10-14T18:46:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48394/0 (socket says 172.21.15.79:48394) 2023-10-14T18:46:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 -- 172.21.15.79:0/2801680099 learned_addr learned my addr 172.21.15.79:0/2801680099 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6e33f700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d6815a680 0x7f4d680b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6d33d700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d6815a2b0 0x7f4d680b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 -- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d6815a2b0 msgr2=0x7f4d680b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d6815a2b0 0x7f4d680b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 -- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d6815a680 msgr2=0x7f4d680b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d6815a680 0x7f4d680b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 -- 172.21.15.79:0/2801680099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009ae0 con 0x7f4d680d1c30 2023-10-14T18:46:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6db3e700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c540 tx=0x7f4d64001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011590 con 0x7f4d680d1c30 2023-10-14T18:46:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d640116f0 con 0x7f4d680d1c30 2023-10-14T18:46:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d680ca0b0 con 0x7f4d680d1c30 2023-10-14T18:46:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.899+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011ab0 con 0x7f4d680d1c30 2023-10-14T18:46:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.900+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680ca390 con 0x7f4d680d1c30 2023-10-14T18:46:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.900+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680d04d0 con 0x7f4d680d1c30 2023-10-14T18:46:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.901+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d6401b3b0 con 0x7f4d680d1c30 2023-10-14T18:46:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.901+0000 7f4d5dffb700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 0x7f4d4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.901+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4d640834c0 con 0x7f4d680d1c30 2023-10-14T18:46:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.901+0000 7f4d6d33d700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 0x7f4d4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:18.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.902+0000 7f4d6d33d700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 0x7f4d4c0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d6815df90 tx=0x7f4d580091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:18.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:18.905+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d64050ae0 con 0x7f4d680d1c30 2023-10-14T18:46:19.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.161+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f4d6804c3c0 con 0x7f4d680d1c30 2023-10-14T18:46:19.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.765+0000 7f4d5dffb700 1 -- 172.21.15.79:0/2801680099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v85) v1 ==== 145+0+0 (secure 0 0 0) 0x7f4d64017020 con 0x7f4d680d1c30 2023-10-14T18:46:19.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 msgr2=0x7f4d4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:19.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 0x7f4d4c0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d6815df90 tx=0x7f4d580091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:19.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 msgr2=0x7f4d68155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:19.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c540 tx=0x7f4d64001070 comp rx=0 tx=0).stop 2023-10-14T18:46:19.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 shutdown_connections 2023-10-14T18:46:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d4c066f30 0x7f4d4c0693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d6815a680 0x7f4d680b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d680d1c30 0x7f4d68155b40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 --2- 172.21.15.79:0/2801680099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d6815a2b0 0x7f4d680b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 >> 172.21.15.79:0/2801680099 conn(0x7f4d68067e40 msgr2=0x7f4d68069370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 shutdown_connections 2023-10-14T18:46:19.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:19.767+0000 7f4d6fda2700 1 -- 172.21.15.79:0/2801680099 wait complete. 2023-10-14T18:46:19.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-14T18:46:19.911 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_objectstore":"memstore"} 2023-10-14T18:46:19.911 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-14T18:46:19.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:46:20.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.028+0000 7ff29e2dc700 1 Processor -- start 2023-10-14T18:46:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.028+0000 7ff29e2dc700 1 -- start start 2023-10-14T18:46:20.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29e2dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff298164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29e2dc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980b4d70 con 0x7ff2980cce30 2023-10-14T18:46:20.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29e2dc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29815b3b0 con 0x7ff2980b6580 2023-10-14T18:46:20.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29e2dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980cd8d0 con 0x7ff29806aa00 2023-10-14T18:46:20.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29d2da700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2980cce30 0x7ff29815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46410/0 (socket says 172.21.15.79:46410) 2023-10-14T18:46:20.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29d2da700 1 -- 172.21.15.79:0/4038500361 learned_addr learned my addr 172.21.15.79:0/4038500361 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:20.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29dadb700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff298164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565409196 0 0) 0x7ff2980b4d70 con 0x7ff2980cce30 2023-10-14T18:46:20.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff280003570 con 0x7ff2980cce30 2023-10-14T18:46:20.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280334543 0 0) 0x7ff29815b3b0 con 0x7ff2980b6580 2023-10-14T18:46:20.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2980b4d70 con 0x7ff2980b6580 2023-10-14T18:46:20.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705797124 0 0) 0x7ff280003570 con 0x7ff2980cce30 2023-10-14T18:46:20.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 msgr2=0x7ff298164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff298164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 >> v1:172.21.15.144:6789/0 conn(0x7ff2980b6580 legacy=0x7ff29806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980b4440 con 0x7ff2980cce30 2023-10-14T18:46:20.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff2880017f0 con 0x7ff2980cce30 2023-10-14T18:46:20.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff29dadb700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff298164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:46:20.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 >> v1:172.21.15.79:6789/0 conn(0x7ff2980cce30 legacy=0x7ff29815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff280003c20 0x7ff280004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff280004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980cd8d0 con 0x7ff280003c20 2023-10-14T18:46:20.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000bb10 con 0x7ff280004d50 2023-10-14T18:46:20.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.029+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000bcd0 con 0x7ff29806aa00 2023-10-14T18:46:20.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff280003c20 0x7ff280004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29dadb700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29cad9700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff280004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 -- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 msgr2=0x7ff280004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff29806aa00 0x7ff280004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 -- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280004d50 msgr2=0x7ff2800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 -- 172.21.15.79:0/4038500361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009420 con 0x7ff280003c20 2023-10-14T18:46:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29d2da700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff280003c20 0x7ff280004010 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a8f0 tx=0x7ff2980ce820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875908ed2f5031e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880070d0 con 0x7ff280003c20 2023-10-14T18:46:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288007250 con 0x7ff280003c20 2023-10-14T18:46:20.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff297fff700 1 -- 172.21.15.79:0/4038500361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288007610 con 0x7ff280003c20 2023-10-14T18:46:20.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29e2dc700 1 -- 172.21.15.79:0/4038500361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff280003c20 msgr2=0x7ff280004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.030+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/4038500361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff280003c20 0x7ff280004010 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a8f0 tx=0x7ff2980ce820 comp rx=0 tx=0).stop 2023-10-14T18:46:20.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.031+0000 7ff29dadb700 1 -- 172.21.15.79:0/4038500361 reap_dead start 2023-10-14T18:46:20.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.031+0000 7ff29e2dc700 1 -- 172.21.15.79:0/4038500361 shutdown_connections 2023-10-14T18:46:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.031+0000 7ff29e2dc700 1 -- 172.21.15.79:0/4038500361 >> 172.21.15.79:0/4038500361 conn(0x7ff298068cb0 msgr2=0x7ff2980690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.031+0000 7ff29e2dc700 1 -- 172.21.15.79:0/4038500361 shutdown_connections 2023-10-14T18:46:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.031+0000 7ff29e2dc700 1 -- 172.21.15.79:0/4038500361 wait complete. 2023-10-14T18:46:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.032+0000 7ff29e2dc700 1 Processor -- start 2023-10-14T18:46:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.032+0000 7ff29e2dc700 1 -- start start 2023-10-14T18:46:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280003c20 0x7ff29814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff298153310 0x7ff29815e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29814f0a0 con 0x7ff2981558e0 2023-10-14T18:46:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981543f0 con 0x7ff280003c20 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2981537e0 con 0x7ff298153310 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48400/0 (socket says 172.21.15.79:48400) 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 -- 172.21.15.79:0/839449507 learned_addr learned my addr 172.21.15.79:0/839449507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29d2da700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280003c20 0x7ff29814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 -- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff298153310 msgr2=0x7ff29815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff298153310 0x7ff29815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 -- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280003c20 msgr2=0x7ff29814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280003c20 0x7ff29814eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 -- 172.21.15.79:0/839449507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298153ac0 con 0x7ff2981558e0 2023-10-14T18:46:20.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29cad9700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00f8b0 tx=0x7ff28c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c013600 con 0x7ff2981558e0 2023-10-14T18:46:20.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c013760 con 0x7ff2981558e0 2023-10-14T18:46:20.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c013b20 con 0x7ff2981558e0 2023-10-14T18:46:20.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff298153da0 con 0x7ff2981558e0 2023-10-14T18:46:20.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.033+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29815eb60 con 0x7ff2981558e0 2023-10-14T18:46:20.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.034+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff298089550 con 0x7ff2981558e0 2023-10-14T18:46:20.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.035+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff28c01c400 con 0x7ff2981558e0 2023-10-14T18:46:20.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.035+0000 7ff2957fa700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.035+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff28c084590 con 0x7ff2981558e0 2023-10-14T18:46:20.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.035+0000 7ff29d2da700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.036+0000 7ff29d2da700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 0x7ff2840693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a8f0 tx=0x7ff288013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.039+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff28c051b00 con 0x7ff2981558e0 2023-10-14T18:46:20.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.223+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff2980b4720 con 0x7ff2981558e0 2023-10-14T18:46:20.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.226+0000 7ff2957fa700 1 -- 172.21.15.79:0/839449507 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff28c055120 con 0x7ff2981558e0 2023-10-14T18:46:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 msgr2=0x7ff2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 0x7ff2840693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff28800a8f0 tx=0x7ff288013000 comp rx=0 tx=0).stop 2023-10-14T18:46:20.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 msgr2=0x7ff298152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00f8b0 tx=0x7ff28c007d30 comp rx=0 tx=0).stop 2023-10-14T18:46:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 shutdown_connections 2023-10-14T18:46:20.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff284066f30 0x7ff2840693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff298153310 0x7ff29815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff280003c20 0x7ff29814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 --2- 172.21.15.79:0/839449507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2981558e0 0x7ff298152dd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 >> 172.21.15.79:0/839449507 conn(0x7ff298068cb0 msgr2=0x7ff2980d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:20.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 shutdown_connections 2023-10-14T18:46:20.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.228+0000 7ff29e2dc700 1 -- 172.21.15.79:0/839449507 wait complete. 2023-10-14T18:46:20.241 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:46:20.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:20.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:20.324 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:46:20.325 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:46:20.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:20.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.439+0000 7f28ce561700 1 Processor -- start 2023-10-14T18:46:20.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.439+0000 7f28ce561700 1 -- start start 2023-10-14T18:46:20.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ce561700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28c806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ce561700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28c815a230 0x7f28c806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ce561700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b3d40 con 0x7f28c8159e60 2023-10-14T18:46:20.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ce561700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c8069d70 con 0x7f28c815a230 2023-10-14T18:46:20.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ce561700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80b4300 con 0x7f28c80cffa0 2023-10-14T18:46:20.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28c7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28c8159e60 0x7f28c80b6890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46424/0 (socket says 172.21.15.79:46424) 2023-10-14T18:46:20.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28c7fff700 1 -- 172.21.15.79:0/1192353354 learned_addr learned my addr 172.21.15.79:0/1192353354 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:20.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28ccafe700 1 --2- 172.21.15.79:0/1192353354 >> v2:172.21.15.144:3300/0 conn(0x7f28c815a230 0x7f28c806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28bffff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28c806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.440+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299854097 0 0) 0x7f28c80b3d40 con 0x7f28c8159e60 2023-10-14T18:46:20.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b4003570 con 0x7f28c8159e60 2023-10-14T18:46:20.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279761574 0 0) 0x7f28b4003570 con 0x7f28c8159e60 2023-10-14T18:46:20.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 msgr2=0x7f28c806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28c806a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 >> v2:172.21.15.144:3300/0 conn(0x7f28c815a230 msgr2=0x7f28c806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 --2- 172.21.15.79:0/1192353354 >> v2:172.21.15.144:3300/0 conn(0x7f28c815a230 0x7f28c806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80d0480 con 0x7f28c8159e60 2023-10-14T18:46:20.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f28b8001470 con 0x7f28c8159e60 2023-10-14T18:46:20.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 >> v1:172.21.15.79:6789/0 conn(0x7f28c8159e60 legacy=0x7f28c80b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8069d70 con 0x7f28b4003a60 2023-10-14T18:46:20.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80b4300 con 0x7f28b4004810 2023-10-14T18:46:20.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b400ba60 con 0x7f28c80cffa0 2023-10-14T18:46:20.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28bffff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28ccafe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 -- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 msgr2=0x7f28b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 -- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b4004810 msgr2=0x7f28b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 -- 172.21.15.79:0/1192353354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4003570 con 0x7f28b4003a60 2023-10-14T18:46:20.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28ccafe700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c80cffa0 0x7f28b40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:20.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28b4003e70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c3f0 tx=0x7f28c80d0a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45315fa6446f431 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800cc80 con 0x7f28b4003a60 2023-10-14T18:46:20.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800cde0 con 0x7f28b4003a60 2023-10-14T18:46:20.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.441+0000 7f28c77fe700 1 -- 172.21.15.79:0/1192353354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8005b70 con 0x7f28b4003a60 2023-10-14T18:46:20.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 -- 172.21.15.79:0/1192353354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 msgr2=0x7f28b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 --2- 172.21.15.79:0/1192353354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28b4003e70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c3f0 tx=0x7f28c80d0a40 comp rx=0 tx=0).stop 2023-10-14T18:46:20.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ccafe700 1 -- 172.21.15.79:0/1192353354 reap_dead start 2023-10-14T18:46:20.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 -- 172.21.15.79:0/1192353354 shutdown_connections 2023-10-14T18:46:20.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 -- 172.21.15.79:0/1192353354 >> 172.21.15.79:0/1192353354 conn(0x7f28c80d1a50 msgr2=0x7f28c8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:20.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 -- 172.21.15.79:0/1192353354 shutdown_connections 2023-10-14T18:46:20.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.442+0000 7f28ce561700 1 -- 172.21.15.79:0/1192353354 wait complete. 2023-10-14T18:46:20.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.443+0000 7f28ce561700 1 Processor -- start 2023-10-14T18:46:20.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.443+0000 7f28ce561700 1 -- start start 2023-10-14T18:46:20.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 0x7f28c815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80c6ab0 0x7f28c80c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8149180 con 0x7f28b4003a60 2023-10-14T18:46:20.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815ba90 con 0x7f28c80c6ab0 2023-10-14T18:46:20.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ce561700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815ae80 con 0x7f28c815bf20 2023-10-14T18:46:20.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48418/0 (socket says 172.21.15.79:48418) 2023-10-14T18:46:20.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 -- 172.21.15.79:0/1521036615 learned_addr learned my addr 172.21.15.79:0/1521036615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:20.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28bffff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 0x7f28c815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28ccafe700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80c6ab0 0x7f28c80c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 -- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 msgr2=0x7f28c815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 0x7f28c815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 -- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80c6ab0 msgr2=0x7f28c80c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80c6ab0 0x7f28c80c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 -- 172.21.15.79:0/1521036615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c815b160 con 0x7f28b4003a60 2023-10-14T18:46:20.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28bffff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 0x7f28c815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:20.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.444+0000 7f28c7fff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007d10 tx=0x7f28b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800cc80 con 0x7f28b4003a60 2023-10-14T18:46:20.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b80072e0 con 0x7f28b4003a60 2023-10-14T18:46:20.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c815b440 con 0x7f28b4003a60 2023-10-14T18:46:20.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8007680 con 0x7f28b4003a60 2023-10-14T18:46:20.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c815ab70 con 0x7f28b4003a60 2023-10-14T18:46:20.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.445+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c804c3c0 con 0x7f28b4003a60 2023-10-14T18:46:20.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.446+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28b8019070 con 0x7f28b4003a60 2023-10-14T18:46:20.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.446+0000 7f28c4ff9700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.446+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f28b8085920 con 0x7f28b4003a60 2023-10-14T18:46:20.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.447+0000 7f28bffff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.447+0000 7f28bffff700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 0x7f28a80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28c815c310 tx=0x7f28b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.451+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28b8052f40 con 0x7f28b4003a60 2023-10-14T18:46:20.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.674+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28c80d0760 con 0x7f28b4003a60 2023-10-14T18:46:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.674+0000 7f28c4ff9700 1 -- 172.21.15.79:0/1521036615 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f28b8017090 con 0x7f28b4003a60 2023-10-14T18:46:20.675 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:20.676 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/4075645197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4075645197},{"type":"v1","addr":"172.21.15.144:6836","nonce":4075645197}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4664,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3534350761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3534350761},{"type":"v1","addr":"172.21.15.144:6837","nonce":3534350761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4905,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/260621342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":260621342},{"type":"v1","addr":"172.21.15.79:6834","nonce":260621342}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3241249605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3241249605},{"type":"v1","addr":"172.21.15.79:6835","nonce":3241249605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-10-14T18:46:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 msgr2=0x7f28a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 0x7f28a80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28c815c310 tx=0x7f28b0008040 comp rx=0 tx=0).stop 2023-10-14T18:46:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 msgr2=0x7f28c8148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28b8007d10 tx=0x7f28b8015000 comp rx=0 tx=0).stop 2023-10-14T18:46:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 shutdown_connections 2023-10-14T18:46:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80c6ab0 0x7f28c80c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4003a60 0x7f28c8148c40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 --2- 172.21.15.79:0/1521036615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28c815bf20 0x7f28c815a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 >> 172.21.15.79:0/1521036615 conn(0x7f28c80d1a50 msgr2=0x7f28c80b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 shutdown_connections 2023-10-14T18:46:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.676+0000 7f28ce561700 1 -- 172.21.15.79:0/1521036615 wait complete. 2023-10-14T18:46:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 19 2023-10-14T18:46:20.689 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:46:20.689 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:46:20.690 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:46:20.690 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:46:20.690 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:46:20.690 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:46:20.691 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:46:20.691 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:46:20.691 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:46:20.692 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:46:20.692 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:46:20.692 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:46:20.693 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:46:20.693 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:46:20.693 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:46:20.694 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:46:20.699 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:46:20.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:46:20.700 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:46:20.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:46:20.703 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:46:20.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:46:20.704 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:46:20.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:46:20.742 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:46:20.743 DEBUG:teuthology.parallel:result is None 2023-10-14T18:46:20.744 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:46:20.745 DEBUG:teuthology.parallel:result is None 2023-10-14T18:46:20.745 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:46:20.746 DEBUG:teuthology.parallel:result is None 2023-10-14T18:46:20.746 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:46:20.747 DEBUG:teuthology.parallel:result is None 2023-10-14T18:46:20.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:46:20.815 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:46:20.816 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:46:20.828 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:46:20.829 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:46:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.867+0000 7fc54a3b6700 1 Processor -- start 2023-10-14T18:46:20.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.867+0000 7fc54a3b6700 1 -- start start 2023-10-14T18:46:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc54a3b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc544156a50 0x7fc5440c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc54a3b6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc544156e20 0x7fc544067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc54a3b6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440c87d0 con 0x7fc5440c91a0 2023-10-14T18:46:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc54a3b6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544068d10 con 0x7fc544156e20 2023-10-14T18:46:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc54a3b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54406e650 con 0x7fc544156a50 2023-10-14T18:46:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc5437fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc544156e20 0x7fc544067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc5437fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc544156e20 0x7fc544067b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48454/0 (socket says 172.21.15.79:48454) 2023-10-14T18:46:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc5437fe700 1 -- 172.21.15.79:0/2117365116 learned_addr learned my addr 172.21.15.79:0/2117365116 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc548953700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc5440c91a0 0x7fc5440adab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46446/0 (socket says 172.21.15.79:46446) 2023-10-14T18:46:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.868+0000 7fc543fff700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc544156a50 0x7fc5440c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc5437fe700 1 -- 172.21.15.79:0/2117365116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc544156a50 msgr2=0x7fc5440c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:20.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc5437fe700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc544156a50 0x7fc5440c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc5437fe700 1 -- 172.21.15.79:0/2117365116 >> v1:172.21.15.79:6789/0 conn(0x7fc5440c91a0 legacy=0x7fc5440adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc5437fe700 1 -- 172.21.15.79:0/2117365116 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544068750 con 0x7fc544156e20 2023-10-14T18:46:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc542ffd700 1 -- 172.21.15.79:0/2117365116 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193182819 0 0) 0x7fc5440c87d0 con 0x7fc5440c91a0 2023-10-14T18:46:20.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc5437fe700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544067b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5380099b0 tx=0x7fc538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252430c7416c97eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc542ffd700 1 -- 172.21.15.79:0/2117365116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538009ea0 con 0x7fc544156e20 2023-10-14T18:46:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc542ffd700 1 -- 172.21.15.79:0/2117365116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53800b860 con 0x7fc544156e20 2023-10-14T18:46:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc542ffd700 1 -- 172.21.15.79:0/2117365116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53800bc00 con 0x7fc544156e20 2023-10-14T18:46:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2117365116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 msgr2=0x7fc544067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544067b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc5380099b0 tx=0x7fc538009250 comp rx=0 tx=0).stop 2023-10-14T18:46:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2117365116 shutdown_connections 2023-10-14T18:46:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc544156a50 0x7fc5440c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2117365116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544067b70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2117365116 >> 172.21.15.79:0/2117365116 conn(0x7fc54406a250 msgr2=0x7fc54406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:20.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2117365116 shutdown_connections 2023-10-14T18:46:20.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.869+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2117365116 wait complete. 2023-10-14T18:46:20.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.870+0000 7fc54a3b6700 1 Processor -- start 2023-10-14T18:46:20.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 -- start start 2023-10-14T18:46:20.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 0x7fc5440b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc544156a50 0x7fc544070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440b2260 con 0x7fc544156e20 2023-10-14T18:46:20.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440b3750 con 0x7fc544156a50 2023-10-14T18:46:20.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc54a3b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440b1970 con 0x7fc5440c91a0 2023-10-14T18:46:20.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.871+0000 7fc548953700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48458/0 (socket says 172.21.15.79:48458) 2023-10-14T18:46:20.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 -- 172.21.15.79:0/2889705694 learned_addr learned my addr 172.21.15.79:0/2889705694 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:20.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc5437fe700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc544156a50 0x7fc544070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc543fff700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 0x7fc5440b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 -- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 msgr2=0x7fc5440b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 0x7fc5440b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 -- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc544156a50 msgr2=0x7fc544070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc544156a50 0x7fc544070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 -- 172.21.15.79:0/2889705694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380094f0 con 0x7fc544156e20 2023-10-14T18:46:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc543fff700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 0x7fc5440b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc548953700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cd80 tx=0x7fc53c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c005df0 con 0x7fc544156e20 2023-10-14T18:46:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c00a900 con 0x7fc544156e20 2023-10-14T18:46:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440b1c10 con 0x7fc544156e20 2023-10-14T18:46:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00acc0 con 0x7fc544156e20 2023-10-14T18:46:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.872+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54416b970 con 0x7fc544156e20 2023-10-14T18:46:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.873+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5440b23f0 con 0x7fc544156e20 2023-10-14T18:46:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.873+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc53c007300 con 0x7fc544156e20 2023-10-14T18:46:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.874+0000 7fc52bfff700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:20.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.874+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc53c0843e0 con 0x7fc544156e20 2023-10-14T18:46:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.874+0000 7fc543fff700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.874+0000 7fc543fff700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 0x7fc5300693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc534006f00 tx=0x7fc534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:20.878+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc53c0519d0 con 0x7fc544156e20 2023-10-14T18:46:21.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:21.075+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc54404c3c0 con 0x7fc544156e20 2023-10-14T18:46:22.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.253+0000 7fc52bfff700 1 -- 172.21.15.79:0/2889705694 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc53c054ff0 con 0x7fc544156e20 2023-10-14T18:46:22.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 msgr2=0x7fc5300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 0x7fc5300693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc534006f00 tx=0x7fc534008040 comp rx=0 tx=0).stop 2023-10-14T18:46:22.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 msgr2=0x7fc544070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cd80 tx=0x7fc53c001ae0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 shutdown_connections 2023-10-14T18:46:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc530066f30 0x7fc5300693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc544156e20 0x7fc544070c40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5440c91a0 0x7fc5440b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 --2- 172.21.15.79:0/2889705694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc544156a50 0x7fc544070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 >> 172.21.15.79:0/2889705694 conn(0x7fc54406a250 msgr2=0x7fc5440afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 shutdown_connections 2023-10-14T18:46:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.255+0000 7fc54a3b6700 1 -- 172.21.15.79:0/2889705694 wait complete. 2023-10-14T18:46:22.259 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:46:22.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:46:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.385+0000 7f4fe26d3700 1 Processor -- start 2023-10-14T18:46:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.385+0000 7f4fe26d3700 1 -- start start 2023-10-14T18:46:22.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fe26d3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4fdc15a620 0x7f4fdc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fe26d3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc15cbb0 con 0x7f4fdc157870 2023-10-14T18:46:22.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fe26d3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fdc15bfa0 con 0x7f4fdc15d580 2023-10-14T18:46:22.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fe26d3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fdc15bdb0 con 0x7f4fdc15a620 2023-10-14T18:46:22.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fdbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4fdc157870 0x7f4fdc15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46454/0 (socket says 172.21.15.79:46454) 2023-10-14T18:46:22.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fdbfff700 1 -- 172.21.15.79:0/4246274980 learned_addr learned my addr 172.21.15.79:0/4246274980 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:22.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/4246274980 >> v2:172.21.15.144:3300/0 conn(0x7f4fdc15a620 0x7f4fdc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842941207 0 0) 0x7f4fdc15cbb0 con 0x7f4fdc157870 2023-10-14T18:46:22.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.386+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc4003570 con 0x7f4fdc157870 2023-10-14T18:46:22.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4200834905 0 0) 0x7f4fc4003570 con 0x7f4fdc157870 2023-10-14T18:46:22.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdb7fe700 1 -- 172.21.15.79:0/4246274980 >> v1:172.21.15.144:6789/0 conn(0x7f4fdc15d580 legacy=0x7f4fdc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdb7fe700 1 -- 172.21.15.79:0/4246274980 >> v1:172.21.15.79:6789/0 conn(0x7f4fdc157870 legacy=0x7f4fdc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdb7fe700 1 -- 172.21.15.79:0/4246274980 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc15c280 con 0x7f4fdc15a620 2023-10-14T18:46:22.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/4246274980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc15a620 0x7f4fdc15d040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00098e0 tx=0x7f4fd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ec27e014ab48852 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc001470 con 0x7f4fdc15a620 2023-10-14T18:46:22.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0011420 con 0x7f4fdc15a620 2023-10-14T18:46:22.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fdaffd700 1 -- 172.21.15.79:0/4246274980 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00117c0 con 0x7f4fdc15a620 2023-10-14T18:46:22.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 -- 172.21.15.79:0/4246274980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc15a620 msgr2=0x7f4fdc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/4246274980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc15a620 0x7f4fdc15d040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00098e0 tx=0x7f4fd00091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 -- 172.21.15.79:0/4246274980 shutdown_connections 2023-10-14T18:46:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/4246274980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc15a620 0x7f4fdc15d040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 -- 172.21.15.79:0/4246274980 >> 172.21.15.79:0/4246274980 conn(0x7f4fdc068ce0 msgr2=0x7f4fdc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 -- 172.21.15.79:0/4246274980 shutdown_connections 2023-10-14T18:46:22.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.387+0000 7f4fe26d3700 1 -- 172.21.15.79:0/4246274980 wait complete. 2023-10-14T18:46:22.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 Processor -- start 2023-10-14T18:46:22.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 -- start start 2023-10-14T18:46:22.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 0x7f4fdc1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 0x7f4fdc0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc154b50 con 0x7f4fdc157870 2023-10-14T18:46:22.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0b1d30 con 0x7f4fdc1546b0 2023-10-14T18:46:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fe26d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc0b2010 con 0x7f4fdc15d580 2023-10-14T18:46:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.389+0000 7f4fdbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48470/0 (socket says 172.21.15.79:48470) 2023-10-14T18:46:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 -- 172.21.15.79:0/792823017 learned_addr learned my addr 172.21.15.79:0/792823017 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 -- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 msgr2=0x7f4fdc1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 0x7f4fdc1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fe0c70700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 0x7f4fdc0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 0x7f4fdc1499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 -- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 msgr2=0x7f4fdc0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 0x7f4fdc0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 -- 172.21.15.79:0/792823017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009420 con 0x7f4fdc157870 2023-10-14T18:46:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fe0c70700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 0x7f4fdc0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 0x7f4fdc1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fdbfff700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00cb90 tx=0x7f4fcc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc007360 con 0x7f4fdc157870 2023-10-14T18:46:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0074e0 con 0x7f4fdc157870 2023-10-14T18:46:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc0b22f0 con 0x7f4fdc157870 2023-10-14T18:46:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc004830 con 0x7f4fdc157870 2023-10-14T18:46:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.390+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc0b28b0 con 0x7f4fdc157870 2023-10-14T18:46:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.391+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc0b2aa0 con 0x7f4fdc157870 2023-10-14T18:46:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.391+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fcc004c00 con 0x7f4fdc157870 2023-10-14T18:46:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.392+0000 7f4fc3fff700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.392+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4fcc083760 con 0x7f4fdc157870 2023-10-14T18:46:22.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.392+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.393+0000 7f4fdb7fe700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 0x7f4fc80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc15aa20 tx=0x7f4fd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.396+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fcc050d20 con 0x7f4fdc157870 2023-10-14T18:46:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.653+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4fdc04c3c0 con 0x7f4fdc157870 2023-10-14T18:46:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.654+0000 7f4fc3fff700 1 -- 172.21.15.79:0/792823017 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4fcc018090 con 0x7f4fdc157870 2023-10-14T18:46:22.655 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:22.655 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:46:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:46:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:46:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:46:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:46:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:46:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:46:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:46:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:46:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:46:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:46:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:46:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:46:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:46:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:46:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:46:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:46:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:46:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:46:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:46:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:46:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:46:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:46:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:46:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:46:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:46:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:46:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:46:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:46:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:46:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:22.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 msgr2=0x7f4fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 0x7f4fc80693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc15aa20 tx=0x7f4fd0017000 comp rx=0 tx=0).stop 2023-10-14T18:46:22.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 msgr2=0x7f4fdc0b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00cb90 tx=0x7f4fcc001b50 comp rx=0 tx=0).stop 2023-10-14T18:46:22.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 shutdown_connections 2023-10-14T18:46:22.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc8066f30 0x7f4fc80693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fdc1546b0 0x7f4fdc0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fdc157870 0x7f4fdc0b16c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 --2- 172.21.15.79:0/792823017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fdc15d580 0x7f4fdc1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 >> 172.21.15.79:0/792823017 conn(0x7f4fdc068ce0 msgr2=0x7f4fdc156990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:22.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 shutdown_connections 2023-10-14T18:46:22.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.656+0000 7f4fe26d3700 1 -- 172.21.15.79:0/792823017 wait complete. 2023-10-14T18:46:22.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.811+0000 7f9ac949b700 1 Processor -- start 2023-10-14T18:46:22.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac949b700 1 -- start start 2023-10-14T18:46:22.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac949b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ac415a330 0x7f9ac4156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac949b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac4157c30 con 0x7f9ac4156570 2023-10-14T18:46:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac949b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac41584f0 con 0x7f9ac406da90 2023-10-14T18:46:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac949b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4157670 con 0x7f9ac415a330 2023-10-14T18:46:22.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac27fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ac415a330 0x7f9ac4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ac4156570 0x7f9ac406d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46468/0 (socket says 172.21.15.79:46468) 2023-10-14T18:46:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.812+0000 7f9ac2ffd700 1 -- 172.21.15.79:0/3254500099 learned_addr learned my addr 172.21.15.79:0/3254500099 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac27fc700 1 -- 172.21.15.79:0/3254500099 >> v1:172.21.15.144:6789/0 conn(0x7f9ac406da90 legacy=0x7f9ac4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac27fc700 1 -- 172.21.15.79:0/3254500099 >> v1:172.21.15.79:6789/0 conn(0x7f9ac4156570 legacy=0x7f9ac406d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac1ffb700 1 -- 172.21.15.79:0/3254500099 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031740725 0 0) 0x7f9ac4157c30 con 0x7f9ac4156570 2023-10-14T18:46:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac27fc700 1 -- 172.21.15.79:0/3254500099 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4157950 con 0x7f9ac415a330 2023-10-14T18:46:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac27fc700 1 --2- 172.21.15.79:0/3254500099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4156940 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80098e0 tx=0x7f9ab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63918ed5442bf6f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac1ffb700 1 -- 172.21.15.79:0/3254500099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8009e80 con 0x7f9ac415a330 2023-10-14T18:46:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac1ffb700 1 -- 172.21.15.79:0/3254500099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800b860 con 0x7f9ac415a330 2023-10-14T18:46:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac1ffb700 1 -- 172.21.15.79:0/3254500099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800bbe0 con 0x7f9ac415a330 2023-10-14T18:46:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac949b700 1 -- 172.21.15.79:0/3254500099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 msgr2=0x7f9ac4156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac949b700 1 --2- 172.21.15.79:0/3254500099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4156940 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80098e0 tx=0x7f9ab80091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac949b700 1 -- 172.21.15.79:0/3254500099 shutdown_connections 2023-10-14T18:46:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac949b700 1 --2- 172.21.15.79:0/3254500099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4156940 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.813+0000 7f9ac949b700 1 -- 172.21.15.79:0/3254500099 >> 172.21.15.79:0/3254500099 conn(0x7f9ac4067660 msgr2=0x7f9ac4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.814+0000 7f9ac949b700 1 -- 172.21.15.79:0/3254500099 shutdown_connections 2023-10-14T18:46:22.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.814+0000 7f9ac949b700 1 -- 172.21.15.79:0/3254500099 wait complete. 2023-10-14T18:46:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 Processor -- start 2023-10-14T18:46:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 -- start start 2023-10-14T18:46:22.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ac406da90 0x7f9ac40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac4156570 0x7f9ac41413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b18f0 con 0x7f9ac415a330 2023-10-14T18:46:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c39c0 con 0x7f9ac4156570 2023-10-14T18:46:22.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.815+0000 7f9ac949b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c3ca0 con 0x7f9ac406da90 2023-10-14T18:46:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48488/0 (socket says 172.21.15.79:48488) 2023-10-14T18:46:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2236435911 learned_addr learned my addr 172.21.15.79:0/2236435911 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:22.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac2ffd700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ac406da90 0x7f9ac40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac27fc700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac4156570 0x7f9ac41413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ac406da90 msgr2=0x7f9ac40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ac406da90 0x7f9ac40b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac4156570 msgr2=0x7f9ac41413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:22.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac4156570 0x7f9ac41413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2236435911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8009420 con 0x7f9ac415a330 2023-10-14T18:46:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac37fe700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c810 tx=0x7f9abc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc012630 con 0x7f9ac415a330 2023-10-14T18:46:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0127b0 con 0x7f9ac415a330 2023-10-14T18:46:22.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40c3f80 con 0x7f9ac415a330 2023-10-14T18:46:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc012b70 con 0x7f9ac415a330 2023-10-14T18:46:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.816+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40b1580 con 0x7f9ac415a330 2023-10-14T18:46:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.817+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404c3c0 con 0x7f9ac415a330 2023-10-14T18:46:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.817+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9abc003030 con 0x7f9ac415a330 2023-10-14T18:46:22.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.818+0000 7f9aaaffd700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.818+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9abc0840c0 con 0x7f9ac415a330 2023-10-14T18:46:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.818+0000 7f9ac2ffd700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:22.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.818+0000 7f9ac2ffd700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 0x7f9ab00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab4007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:22.822+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9abc051680 con 0x7f9ac415a330 2023-10-14T18:46:23.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.006+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ac4158180 con 0x7f9ac415a330 2023-10-14T18:46:23.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.006+0000 7f9aaaffd700 1 -- 172.21.15.79:0/2236435911 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f9abc054ca0 con 0x7f9ac415a330 2023-10-14T18:46:23.007 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:23.008 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:22.250444+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:23.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 msgr2=0x7f9ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 0x7f9ab00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007fd0 tx=0x7f9ab4007d10 comp rx=0 tx=0).stop 2023-10-14T18:46:23.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 msgr2=0x7f9ac4145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c810 tx=0x7f9abc001650 comp rx=0 tx=0).stop 2023-10-14T18:46:23.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 shutdown_connections 2023-10-14T18:46:23.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9ab0066f30 0x7f9ab00693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac415a330 0x7f9ac4145750 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ac406da90 0x7f9ac40b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 --2- 172.21.15.79:0/2236435911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ac4156570 0x7f9ac41413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 >> 172.21.15.79:0/2236435911 conn(0x7f9ac4067660 msgr2=0x7f9ac4156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 shutdown_connections 2023-10-14T18:46:23.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.008+0000 7f9ac949b700 1 -- 172.21.15.79:0/2236435911 wait complete. 2023-10-14T18:46:23.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:46:23.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:46:23.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.139+0000 7f4299c95700 1 Processor -- start 2023-10-14T18:46:23.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.139+0000 7f4299c95700 1 -- start start 2023-10-14T18:46:23.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4294159ec0 0x7f42940af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 0x7f42940afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429406af60 con 0x7f4294159ec0 2023-10-14T18:46:23.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42940b0790 con 0x7f429415a290 2023-10-14T18:46:23.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4299c95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940ce1f0 con 0x7f429406a5a0 2023-10-14T18:46:23.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4294159ec0 0x7f42940af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4294159ec0 0x7f42940af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48490/0 (socket says 172.21.15.79:48490) 2023-10-14T18:46:23.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 -- 172.21.15.79:0/2077452169 learned_addr learned my addr 172.21.15.79:0/2077452169 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4293fff700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4292ffd700 1 --2- 172.21.15.79:0/2077452169 >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 0x7f42940afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 -- 172.21.15.79:0/2077452169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 msgr2=0x7f429406aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429406aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 -- 172.21.15.79:0/2077452169 >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 msgr2=0x7f42940afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:23.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 --2- 172.21.15.79:0/2077452169 >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 0x7f42940afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f42937fe700 1 -- 172.21.15.79:0/2077452169 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940b0b20 con 0x7f4294159ec0 2023-10-14T18:46:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4293fff700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.140+0000 7f4292ffd700 1 --2- 172.21.15.79:0/2077452169 >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 0x7f42940afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f42937fe700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4294159ec0 0x7f42940af940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4294089910 tx=0x7f4284009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c35dbb5973235f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f42927fc700 1 -- 172.21.15.79:0/2077452169 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400e070 con 0x7f4294159ec0 2023-10-14T18:46:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f42927fc700 1 -- 172.21.15.79:0/2077452169 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400ba50 con 0x7f4294159ec0 2023-10-14T18:46:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f42927fc700 1 -- 172.21.15.79:0/2077452169 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840092e0 con 0x7f4294159ec0 2023-10-14T18:46:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 -- 172.21.15.79:0/2077452169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4294159ec0 msgr2=0x7f42940af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4294159ec0 0x7f42940af940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4294089910 tx=0x7f4284009840 comp rx=0 tx=0).stop 2023-10-14T18:46:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 -- 172.21.15.79:0/2077452169 shutdown_connections 2023-10-14T18:46:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 --2- 172.21.15.79:0/2077452169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4294159ec0 0x7f42940af940 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 --2- 172.21.15.79:0/2077452169 >> v2:172.21.15.144:3300/0 conn(0x7f429415a290 0x7f42940afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 -- 172.21.15.79:0/2077452169 >> 172.21.15.79:0/2077452169 conn(0x7f42940d1880 msgr2=0x7f42940cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 -- 172.21.15.79:0/2077452169 shutdown_connections 2023-10-14T18:46:23.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.141+0000 7f4299c95700 1 -- 172.21.15.79:0/2077452169 wait complete. 2023-10-14T18:46:23.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.142+0000 7f4299c95700 1 Processor -- start 2023-10-14T18:46:23.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 -- start start 2023-10-14T18:46:23.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429416a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 0x7f42940cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294158030 con 0x7f429415a290 2023-10-14T18:46:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429416e6b0 con 0x7f4294159ec0 2023-10-14T18:46:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4299c95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940c8a70 con 0x7f429406a5a0 2023-10-14T18:46:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4293fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4293fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48506/0 (socket says 172.21.15.79:48506) 2023-10-14T18:46:23.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.143+0000 7f4293fff700 1 -- 172.21.15.79:0/408788711 learned_addr learned my addr 172.21.15.79:0/408788711 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f42937fe700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429416a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4292ffd700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 0x7f42940cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 -- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 msgr2=0x7f429416a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429416a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 -- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 msgr2=0x7f42940cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 0x7f42940cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 -- 172.21.15.79:0/408788711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009ae0 con 0x7f429415a290 2023-10-14T18:46:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f42937fe700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:23.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4292ffd700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 0x7f42940cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:23.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4293fff700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c8b0 tx=0x7f428c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011600 con 0x7f429415a290 2023-10-14T18:46:23.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c011780 con 0x7f429415a290 2023-10-14T18:46:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011b40 con 0x7f429415a290 2023-10-14T18:46:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42940c7e60 con 0x7f429415a290 2023-10-14T18:46:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.144+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42940c84a0 con 0x7f429415a290 2023-10-14T18:46:23.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.145+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429404c3c0 con 0x7f429415a290 2023-10-14T18:46:23.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.145+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f428c018350 con 0x7f429415a290 2023-10-14T18:46:23.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.145+0000 7f427b7fe700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.146+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f428c084130 con 0x7f429415a290 2023-10-14T18:46:23.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.146+0000 7f42937fe700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.146+0000 7f42937fe700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4284009ab0 tx=0x7f4284018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.150+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f428c055180 con 0x7f429415a290 2023-10-14T18:46:23.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.331+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42940b04b0 con 0x7f429415a290 2023-10-14T18:46:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.332+0000 7f427b7fe700 1 -- 172.21.15.79:0/408788711 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f428c054d10 con 0x7f429415a290 2023-10-14T18:46:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:46:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 msgr2=0x7f42800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 0x7f42800693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4284009ab0 tx=0x7f4284018000 comp rx=0 tx=0).stop 2023-10-14T18:46:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 msgr2=0x7f429416e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c8b0 tx=0x7f428c008040 comp rx=0 tx=0).stop 2023-10-14T18:46:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 shutdown_connections 2023-10-14T18:46:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4280066f30 0x7f42800693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f429415a290 0x7f429416e170 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f429406a5a0 0x7f429416a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 --2- 172.21.15.79:0/408788711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4294159ec0 0x7f42940cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 >> 172.21.15.79:0/408788711 conn(0x7f42940d1880 msgr2=0x7f42940b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 shutdown_connections 2023-10-14T18:46:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.334+0000 7f4299c95700 1 -- 172.21.15.79:0/408788711 wait complete. 2023-10-14T18:46:23.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:46:23.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.461+0000 7fe546fef700 1 Processor -- start 2023-10-14T18:46:23.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.461+0000 7fe546fef700 1 -- start start 2023-10-14T18:46:23.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.461+0000 7fe546fef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe540157870 0x7fe54015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.461+0000 7fe546fef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 0x7fe54015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.461+0000 7fe546fef700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54015cbb0 con 0x7fe54015d580 2023-10-14T18:46:23.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe546fef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54015bfa0 con 0x7fe540157870 2023-10-14T18:46:23.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe546fef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015c280 con 0x7fe54015a620 2023-10-14T18:46:23.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe540157870 0x7fe54015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe540157870 0x7fe54015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48520/0 (socket says 172.21.15.79:48520) 2023-10-14T18:46:23.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 -- 172.21.15.79:0/1378301146 learned_addr learned my addr 172.21.15.79:0/1378301146 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe537fff700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 0x7fe54015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 -- 172.21.15.79:0/1378301146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 msgr2=0x7fe54015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:23.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 0x7fe54015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 -- 172.21.15.79:0/1378301146 >> v1:172.21.15.144:6789/0 conn(0x7fe54015d580 legacy=0x7fe540158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 -- 172.21.15.79:0/1378301146 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54015c560 con 0x7fe540157870 2023-10-14T18:46:23.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe537fff700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 0x7fe54015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:23.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe544d8b700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54015b6a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009f20 tx=0x7fe53c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85630ac13d243327 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe5377fe700 1 -- 172.21.15.79:0/1378301146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00e070 con 0x7fe540157870 2023-10-14T18:46:23.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe5377fe700 1 -- 172.21.15.79:0/1378301146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00ba80 con 0x7fe540157870 2023-10-14T18:46:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.462+0000 7fe5377fe700 1 -- 172.21.15.79:0/1378301146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0092e0 con 0x7fe540157870 2023-10-14T18:46:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 -- 172.21.15.79:0/1378301146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 msgr2=0x7fe54015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54015b6a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009f20 tx=0x7fe53c009840 comp rx=0 tx=0).stop 2023-10-14T18:46:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 -- 172.21.15.79:0/1378301146 shutdown_connections 2023-10-14T18:46:23.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54015b6a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 --2- 172.21.15.79:0/1378301146 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015a620 0x7fe54015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 -- 172.21.15.79:0/1378301146 >> 172.21.15.79:0/1378301146 conn(0x7fe540068ce0 msgr2=0x7fe5400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 -- 172.21.15.79:0/1378301146 shutdown_connections 2023-10-14T18:46:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.463+0000 7fe546fef700 1 -- 172.21.15.79:0/1378301146 wait complete. 2023-10-14T18:46:23.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.464+0000 7fe546fef700 1 Processor -- start 2023-10-14T18:46:23.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.464+0000 7fe546fef700 1 -- start start 2023-10-14T18:46:23.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54015a620 0x7fe54016dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 0x7fe5400b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400b0a20 con 0x7fe540157870 2023-10-14T18:46:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54016e560 con 0x7fe54015a620 2023-10-14T18:46:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54016e840 con 0x7fe54015d580 2023-10-14T18:46:23.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48524/0 (socket says 172.21.15.79:48524) 2023-10-14T18:46:23.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 -- 172.21.15.79:0/4188608499 learned_addr learned my addr 172.21.15.79:0/4188608499 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe537fff700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54015a620 0x7fe54016dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe54558c700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 0x7fe5400b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 -- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 msgr2=0x7fe5400b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 0x7fe5400b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 -- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54015a620 msgr2=0x7fe54016dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54015a620 0x7fe54016dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 -- 172.21.15.79:0/4188608499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009ae0 con 0x7fe540157870 2023-10-14T18:46:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe54558c700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 0x7fe5400b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe544d8b700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00b6c0 tx=0x7fe53c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c008980 con 0x7fe540157870 2023-10-14T18:46:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c008b20 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c026460 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54016eb20 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.465+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54016ac20 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.466+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54004c3c0 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.467+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe53c003040 con 0x7fe540157870 2023-10-14T18:46:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.467+0000 7fe534ff9700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.467+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe53c085f80 con 0x7fe540157870 2023-10-14T18:46:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.467+0000 7fe537fff700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.468+0000 7fe537fff700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe54016dbc0 tx=0x7fe530008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.471+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe53c0535f0 con 0x7fe540157870 2023-10-14T18:46:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.654+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe54015c840 con 0x7fe540157870 2023-10-14T18:46:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.654+0000 7fe534ff9700 1 -- 172.21.15.79:0/4188608499 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe53c02b060 con 0x7fe540157870 2023-10-14T18:46:23.655 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:23.655 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:46:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:46:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:46:23.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:23.656 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:46:23.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 msgr2=0x7fe52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe54016dbc0 tx=0x7fe530008040 comp rx=0 tx=0).stop 2023-10-14T18:46:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 msgr2=0x7fe54016a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00b6c0 tx=0x7fe53c018000 comp rx=0 tx=0).stop 2023-10-14T18:46:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 shutdown_connections 2023-10-14T18:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe54015d580 0x7fe5400b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe540157870 0x7fe54016a6e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 --2- 172.21.15.79:0/4188608499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe54015a620 0x7fe54016dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 >> 172.21.15.79:0/4188608499 conn(0x7fe540068ce0 msgr2=0x7fe540155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 shutdown_connections 2023-10-14T18:46:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.656+0000 7fe546fef700 1 -- 172.21.15.79:0/4188608499 wait complete. 2023-10-14T18:46:23.669 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:46:23.669 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:46:23.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.788+0000 7f77f3fac700 1 Processor -- start 2023-10-14T18:46:23.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.788+0000 7f77f3fac700 1 -- start start 2023-10-14T18:46:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f3fac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77ec159ef0 0x7f77ec15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f3fac700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77ec0b6a10 0x7f77ec0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f3fac700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ec0b1a60 con 0x7f77ec0b15e0 2023-10-14T18:46:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f3fac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec0b1d40 con 0x7f77ec159ef0 2023-10-14T18:46:23.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f3fac700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec0b2020 con 0x7f77ec0b6a10 2023-10-14T18:46:23.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77ec159ef0 0x7f77ec15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77ec159ef0 0x7f77ec15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48532/0 (socket says 172.21.15.79:48532) 2023-10-14T18:46:23.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 -- 172.21.15.79:0/2756267781 learned_addr learned my addr 172.21.15.79:0/2756267781 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1547700 1 --2- 172.21.15.79:0/2756267781 >> v2:172.21.15.144:3300/0 conn(0x7f77ec0b6a10 0x7f77ec0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 -- 172.21.15.79:0/2756267781 >> v2:172.21.15.144:3300/0 conn(0x7f77ec0b6a10 msgr2=0x7f77ec0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 --2- 172.21.15.79:0/2756267781 >> v2:172.21.15.144:3300/0 conn(0x7f77ec0b6a10 0x7f77ec0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 -- 172.21.15.79:0/2756267781 >> v1:172.21.15.144:6789/0 conn(0x7f77ec0b15e0 legacy=0x7f77ec0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 -- 172.21.15.79:0/2756267781 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0b2300 con 0x7f77ec159ef0 2023-10-14T18:46:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f1d48700 1 --2- 172.21.15.79:0/2756267781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec159ef0 0x7f77ec15a2c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f77ec089550 tx=0x7f77e4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef87492977a5382 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.789+0000 7f77f0d46700 1 -- 172.21.15.79:0/2756267781 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4005c10 con 0x7f77ec159ef0 2023-10-14T18:46:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f0d46700 1 -- 172.21.15.79:0/2756267781 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4005d70 con 0x7f77ec159ef0 2023-10-14T18:46:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f0d46700 1 -- 172.21.15.79:0/2756267781 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400b840 con 0x7f77ec159ef0 2023-10-14T18:46:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 -- 172.21.15.79:0/2756267781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec159ef0 msgr2=0x7f77ec15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2756267781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec159ef0 0x7f77ec15a2c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f77ec089550 tx=0x7f77e4009220 comp rx=0 tx=0).stop 2023-10-14T18:46:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 -- 172.21.15.79:0/2756267781 shutdown_connections 2023-10-14T18:46:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2756267781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec159ef0 0x7f77ec15a2c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2756267781 >> v2:172.21.15.144:3300/0 conn(0x7f77ec0b6a10 0x7f77ec0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 -- 172.21.15.79:0/2756267781 >> 172.21.15.79:0/2756267781 conn(0x7f77ec09a0a0 msgr2=0x7f77ec067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 -- 172.21.15.79:0/2756267781 shutdown_connections 2023-10-14T18:46:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.790+0000 7f77f3fac700 1 -- 172.21.15.79:0/2756267781 wait complete. 2023-10-14T18:46:23.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.791+0000 7f77f3fac700 1 Processor -- start 2023-10-14T18:46:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.791+0000 7f77f3fac700 1 -- start start 2023-10-14T18:46:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77ec159ef0 0x7f77ec09cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77ec09e6a0 0x7f77ec1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec157750 con 0x7f77ec0b6a10 2023-10-14T18:46:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec09e210 con 0x7f77ec09e6a0 2023-10-14T18:46:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f3fac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec09d600 con 0x7f77ec159ef0 2023-10-14T18:46:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48542/0 (socket says 172.21.15.79:48542) 2023-10-14T18:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 -- 172.21.15.79:0/2972577900 learned_addr learned my addr 172.21.15.79:0/2972577900 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f2549700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77ec09e6a0 0x7f77ec1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1547700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77ec159ef0 0x7f77ec09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 -- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77ec159ef0 msgr2=0x7f77ec09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77ec159ef0 0x7f77ec09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 -- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77ec09e6a0 msgr2=0x7f77ec1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77ec09e6a0 0x7f77ec1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 -- 172.21.15.79:0/2972577900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4009480 con 0x7f77ec0b6a10 2023-10-14T18:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.792+0000 7f77f1d48700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009260 tx=0x7f77e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.793+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4011a30 con 0x7f77ec0b6a10 2023-10-14T18:46:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.793+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e4011bb0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.793+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec09d8e0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.793+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e401c420 con 0x7f77ec0b6a10 2023-10-14T18:46:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.793+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec09dea0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.794+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec09e4f0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.794+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77e401c7d0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.795+0000 7f77e1ffb700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 0x7f77d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.795+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f77e4085db0 con 0x7f77ec0b6a10 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.795+0000 7f77f1547700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 0x7f77d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.795+0000 7f77f1547700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 0x7f77d00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77ec09abc0 tx=0x7f77dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.799+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77e408a070 con 0x7f77ec0b6a10 2023-10-14T18:46:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:23.980+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f77ec04c3c0 con 0x7f77ec0b6a10 2023-10-14T18:46:24.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.783+0000 7f77e1ffb700 1 -- 172.21.15.79:0/2972577900 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7f77e40532d0 con 0x7f77ec0b6a10 2023-10-14T18:46:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 msgr2=0x7f77d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 0x7f77d00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77ec09abc0 tx=0x7f77dc008040 comp rx=0 tx=0).stop 2023-10-14T18:46:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 msgr2=0x7f77ec09c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009260 tx=0x7f77e4015000 comp rx=0 tx=0).stop 2023-10-14T18:46:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 shutdown_connections 2023-10-14T18:46:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77d0066f30 0x7f77d00693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77ec09e6a0 0x7f77ec1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77ec0b6a10 0x7f77ec09c9f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 --2- 172.21.15.79:0/2972577900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77ec159ef0 0x7f77ec09cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 >> 172.21.15.79:0/2972577900 conn(0x7f77ec09a0a0 msgr2=0x7f77ec1524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:24.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 shutdown_connections 2023-10-14T18:46:24.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.786+0000 7f77f3fac700 1 -- 172.21.15.79:0/2972577900 wait complete. 2023-10-14T18:46:24.789 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:46:24.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:46:24.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.920+0000 7f560ad5e700 1 Processor -- start 2023-10-14T18:46:24.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.920+0000 7f560ad5e700 1 -- start start 2023-10-14T18:46:24.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f560ad5e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f560ad5e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f560ad5e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56040b0790 con 0x7f560406a5a0 2023-10-14T18:46:24.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f560ad5e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56040ce1f0 con 0x7f5604159ec0 2023-10-14T18:46:24.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f560ad5e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040b0b20 con 0x7f560415a290 2023-10-14T18:46:24.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f5608afa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f5608afa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:59668/0 (socket says 172.21.15.79:59668) 2023-10-14T18:46:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:43322/0 (socket says 172.21.15.79:43322) 2023-10-14T18:46:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f5608afa700 1 -- 172.21.15.79:0/2024211882 learned_addr learned my addr 172.21.15.79:0/2024211882 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:24.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.921+0000 7f56092fb700 1 --1- 172.21.15.79:0/2024211882 >> v1:172.21.15.144:6789/0 conn(0x7f560406a5a0 0x7f560415db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:49982/0 (socket says 172.21.15.79:49982) 2023-10-14T18:46:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fbfff700 1 -- 172.21.15.79:0/2024211882 >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 msgr2=0x7f56040af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fbfff700 1 --2- 172.21.15.79:0/2024211882 >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fbfff700 1 -- 172.21.15.79:0/2024211882 >> v1:172.21.15.144:6789/0 conn(0x7f560406a5a0 legacy=0x7f560415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fbfff700 1 -- 172.21.15.79:0/2024211882 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040b04b0 con 0x7f560415a290 2023-10-14T18:46:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f5608afa700 1 --2- 172.21.15.79:0/2024211882 >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:46:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fbfff700 1 --2- 172.21.15.79:0/2024211882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098e0 tx=0x7f55f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279c5881747c85dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fb7fe700 1 -- 172.21.15.79:0/2024211882 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400b640 con 0x7f560415a290 2023-10-14T18:46:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fb7fe700 1 -- 172.21.15.79:0/2024211882 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400b7a0 con 0x7f560415a290 2023-10-14T18:46:24.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f55fb7fe700 1 -- 172.21.15.79:0/2024211882 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400bb40 con 0x7f560415a290 2023-10-14T18:46:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f560ad5e700 1 -- 172.21.15.79:0/2024211882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 msgr2=0x7f56040afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.922+0000 7f560ad5e700 1 --2- 172.21.15.79:0/2024211882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f55f40098e0 tx=0x7f55f40091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 -- 172.21.15.79:0/2024211882 shutdown_connections 2023-10-14T18:46:24.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 --2- 172.21.15.79:0/2024211882 >> v2:172.21.15.144:3300/0 conn(0x7f5604159ec0 0x7f56040af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 --2- 172.21.15.79:0/2024211882 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560415a290 0x7f56040afe80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 -- 172.21.15.79:0/2024211882 >> 172.21.15.79:0/2024211882 conn(0x7f56040d1880 msgr2=0x7f56040cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 -- 172.21.15.79:0/2024211882 shutdown_connections 2023-10-14T18:46:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.923+0000 7f560ad5e700 1 -- 172.21.15.79:0/2024211882 wait complete. 2023-10-14T18:46:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.924+0000 7f560ad5e700 1 Processor -- start 2023-10-14T18:46:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.924+0000 7f560ad5e700 1 -- start start 2023-10-14T18:46:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560406a5a0 0x7f5604146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5604159ec0 0x7f56040afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040c8e30 con 0x7f560415a290 2023-10-14T18:46:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040c8220 con 0x7f5604159ec0 2023-10-14T18:46:24.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56040c8500 con 0x7f560406a5a0 2023-10-14T18:46:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f55fbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5604159ec0 0x7f56040afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48556/0 (socket says 172.21.15.79:48556) 2023-10-14T18:46:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 -- 172.21.15.79:0/1623481860 learned_addr learned my addr 172.21.15.79:0/1623481860 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:24.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f5608afa700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560406a5a0 0x7f5604146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 -- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560406a5a0 msgr2=0x7f5604146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560406a5a0 0x7f5604146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 -- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5604159ec0 msgr2=0x7f56040afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5604159ec0 0x7f56040afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:24.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 -- 172.21.15.79:0/1623481860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009ae0 con 0x7f560415a290 2023-10-14T18:46:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f56092fb700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c4e0 tx=0x7f55fc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00ce90 con 0x7f560415a290 2023-10-14T18:46:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f4009420 con 0x7f560415a290 2023-10-14T18:46:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc005a70 con 0x7f560415a290 2023-10-14T18:46:24.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc005e10 con 0x7f560415a290 2023-10-14T18:46:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.925+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56040c8ac0 con 0x7f560415a290 2023-10-14T18:46:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.926+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56040c8fa0 con 0x7f560415a290 2023-10-14T18:46:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.927+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55fc0072e0 con 0x7f560415a290 2023-10-14T18:46:24.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.927+0000 7f55f8ff9700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 0x7f55f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.927+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f55fc0836d0 con 0x7f560415a290 2023-10-14T18:46:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.927+0000 7f5608afa700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 0x7f55f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.928+0000 7f5608afa700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 0x7f55f00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56000072d0 tx=0x7f560000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:24.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:24.932+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55fc050b20 con 0x7f560415a290 2023-10-14T18:46:25.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.116+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f560404c3c0 con 0x7f560415a290 2023-10-14T18:46:25.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.784+0000 7f55f8ff9700 1 -- 172.21.15.79:0/1623481860 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f55fc0170d0 con 0x7f560415a290 2023-10-14T18:46:25.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 msgr2=0x7f55f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 0x7f55f00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56000072d0 tx=0x7f560000b040 comp rx=0 tx=0).stop 2023-10-14T18:46:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 msgr2=0x7f560415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c4e0 tx=0x7f55fc007f50 comp rx=0 tx=0).stop 2023-10-14T18:46:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 shutdown_connections 2023-10-14T18:46:25.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f55f0066f30 0x7f55f00693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f560415a290 0x7f560415cda0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f560406a5a0 0x7f5604146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 --2- 172.21.15.79:0/1623481860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5604159ec0 0x7f56040afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.789+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 >> 172.21.15.79:0/1623481860 conn(0x7f56040d1880 msgr2=0x7f56040b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.791+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 shutdown_connections 2023-10-14T18:46:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.791+0000 7f560ad5e700 1 -- 172.21.15.79:0/1623481860 wait complete. 2023-10-14T18:46:25.794 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:46:25.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:46:25.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.925+0000 7fb47359e700 1 Processor -- start 2023-10-14T18:46:25.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.925+0000 7fb47359e700 1 -- start start 2023-10-14T18:46:25.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb474164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47359e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4740b4d70 con 0x7fb4740cce30 2023-10-14T18:46:25.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47359e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47415b3b0 con 0x7fb4740b6580 2023-10-14T18:46:25.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740cd8d0 con 0x7fb47406aa00 2023-10-14T18:46:25.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb4740cce30 0x7fb47415aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46476/0 (socket says 172.21.15.79:46476) 2023-10-14T18:46:25.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47259c700 1 -- 172.21.15.79:0/4288169067 learned_addr learned my addr 172.21.15.79:0/4288169067 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:25.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983444826 0 0) 0x7fb4740b4d70 con 0x7fb4740cce30 2023-10-14T18:46:25.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb472d9d700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb474164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c003570 con 0x7fb4740cce30 2023-10-14T18:46:25.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.926+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1375807749 0 0) 0x7fb45c003570 con 0x7fb4740cce30 2023-10-14T18:46:25.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 msgr2=0x7fb474164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:25.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb474164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 >> v1:172.21.15.144:6789/0 conn(0x7fb4740b6580 legacy=0x7fb47406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740b4440 con 0x7fb4740cce30 2023-10-14T18:46:25.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb46c001470 con 0x7fb4740cce30 2023-10-14T18:46:25.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 >> v1:172.21.15.79:6789/0 conn(0x7fb4740cce30 legacy=0x7fb47415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb45c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb45c004010 0x7fb45c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c004d50 0x7fb45c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740cd8d0 con 0x7fb45c004010 2023-10-14T18:46:25.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c00bbf0 con 0x7fb45c004d50 2023-10-14T18:46:25.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c00bdb0 con 0x7fb47406aa00 2023-10-14T18:46:25.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb45c004010 0x7fb45c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47259c700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb45c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb472d9d700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c004d50 0x7fb45c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 -- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 msgr2=0x7fb45c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:25.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb47406aa00 0x7fb45c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 -- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c004d50 msgr2=0x7fb45c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:25.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c004d50 0x7fb45c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 -- 172.21.15.79:0/4288169067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c003570 con 0x7fb45c004010 2023-10-14T18:46:25.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb472d9d700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c004d50 0x7fb45c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:25.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb471d9b700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb45c004010 0x7fb45c004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb468001fc0 tx=0x7fb468001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1183d82a07ba4dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468001980 con 0x7fb45c004010 2023-10-14T18:46:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800c8b0 con 0x7fb45c004010 2023-10-14T18:46:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.927+0000 7fb47159a700 1 -- 172.21.15.79:0/4288169067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800cc50 con 0x7fb45c004010 2023-10-14T18:46:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 -- 172.21.15.79:0/4288169067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb45c004010 msgr2=0x7fb45c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 --2- 172.21.15.79:0/4288169067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb45c004010 0x7fb45c004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb468001fc0 tx=0x7fb468001670 comp rx=0 tx=0).stop 2023-10-14T18:46:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb472d9d700 1 -- 172.21.15.79:0/4288169067 reap_dead start 2023-10-14T18:46:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 -- 172.21.15.79:0/4288169067 shutdown_connections 2023-10-14T18:46:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 -- 172.21.15.79:0/4288169067 >> 172.21.15.79:0/4288169067 conn(0x7fb474068cb0 msgr2=0x7fb4740690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 -- 172.21.15.79:0/4288169067 shutdown_connections 2023-10-14T18:46:25.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.928+0000 7fb47359e700 1 -- 172.21.15.79:0/4288169067 wait complete. 2023-10-14T18:46:25.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.929+0000 7fb47359e700 1 Processor -- start 2023-10-14T18:46:25.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.929+0000 7fb47359e700 1 -- start start 2023-10-14T18:46:25.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 0x7fb474135f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740b2280 0x7fb4740b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4741524b0 con 0x7fb474152940 2023-10-14T18:46:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4741518a0 con 0x7fb4740b2280 2023-10-14T18:46:25.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb474151b80 con 0x7fb45c004010 2023-10-14T18:46:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48584/0 (socket says 172.21.15.79:48584) 2023-10-14T18:46:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 -- 172.21.15.79:0/446832886 learned_addr learned my addr 172.21.15.79:0/446832886 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb471d9b700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740b2280 0x7fb4740b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47259c700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 0x7fb474135f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 -- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 msgr2=0x7fb474135f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 0x7fb474135f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 -- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740b2280 msgr2=0x7fb4740b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:25.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740b2280 0x7fb4740b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 -- 172.21.15.79:0/446832886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474151e60 con 0x7fb474152940 2023-10-14T18:46:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47259c700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 0x7fb474135f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb472d9d700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb47415a280 tx=0x7fb464008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464015670 con 0x7fb474152940 2023-10-14T18:46:25.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640157d0 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464015b90 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb474152140 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.930+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4741532d0 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.931+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb474089550 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.932+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb464020460 con 0x7fb474152940 2023-10-14T18:46:25.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.932+0000 7fb4627fc700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.932+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb464085000 con 0x7fb474152940 2023-10-14T18:46:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.933+0000 7fb47259c700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.933+0000 7fb47259c700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 0x7fb4540693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0015a0 tx=0x7fb46c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:25.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:25.936+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb464052350 con 0x7fb474152940 2023-10-14T18:46:26.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.162+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb4741525f0 con 0x7fb474152940 2023-10-14T18:46:26.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.799+0000 7fb4627fc700 1 -- 172.21.15.79:0/446832886 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb464055970 con 0x7fb474152940 2023-10-14T18:46:26.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.804+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 msgr2=0x7fb4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:26.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.804+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 0x7fb4540693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0015a0 tx=0x7fb46c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:26.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.804+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 msgr2=0x7fb474152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:26.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.804+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb47415a280 tx=0x7fb464008040 comp rx=0 tx=0).stop 2023-10-14T18:46:26.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 shutdown_connections 2023-10-14T18:46:26.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb474152940 0x7fb474152d90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb45c004010 0x7fb474135f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 --2- 172.21.15.79:0/446832886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740b2280 0x7fb4740b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 >> 172.21.15.79:0/446832886 conn(0x7fb474068cb0 msgr2=0x7fb47406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:26.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 shutdown_connections 2023-10-14T18:46:26.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.806+0000 7fb47359e700 1 -- 172.21.15.79:0/446832886 wait complete. 2023-10-14T18:46:26.808 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 6 and data pool 7 2023-10-14T18:46:26.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:26.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.934+0000 7f6d7a7aa700 1 Processor -- start 2023-10-14T18:46:26.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.934+0000 7f6d7a7aa700 1 -- start start 2023-10-14T18:46:26.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d7a7aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d74156570 0x7f6d7406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d7a7aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d74157050 0x7f6d7406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d7a7aa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d74157c30 con 0x7f6d7415a330 2023-10-14T18:46:26.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d7a7aa700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d74157490 con 0x7f6d74156570 2023-10-14T18:46:26.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d7a7aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d741584f0 con 0x7f6d74157050 2023-10-14T18:46:26.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d74156570 0x7f6d7406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d74156570 0x7f6d7406d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48592/0 (socket says 172.21.15.79:48592) 2023-10-14T18:46:26.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 -- 172.21.15.79:0/2340616355 learned_addr learned my addr 172.21.15.79:0/2340616355 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:26.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d78d47700 1 --2- 172.21.15.79:0/2340616355 >> v2:172.21.15.144:3300/0 conn(0x7f6d74157050 0x7f6d7406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 -- 172.21.15.79:0/2340616355 >> v2:172.21.15.144:3300/0 conn(0x7f6d74157050 msgr2=0x7f6d7406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:26.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 --2- 172.21.15.79:0/2340616355 >> v2:172.21.15.144:3300/0 conn(0x7f6d74157050 0x7f6d7406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 -- 172.21.15.79:0/2340616355 >> v1:172.21.15.144:6789/0 conn(0x7f6d7415a330 legacy=0x7f6d74156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:26.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 -- 172.21.15.79:0/2340616355 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74157670 con 0x7f6d74156570 2023-10-14T18:46:26.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d73fff700 1 --2- 172.21.15.79:0/2340616355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74156570 0x7f6d7406d380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6d7415a1b0 tx=0x7f6d6400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12f275018c2b42f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:26.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.935+0000 7f6d72ffd700 1 -- 172.21.15.79:0/2340616355 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400dc10 con 0x7f6d74156570 2023-10-14T18:46:26.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d72ffd700 1 -- 172.21.15.79:0/2340616355 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400dd70 con 0x7f6d74156570 2023-10-14T18:46:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d72ffd700 1 -- 172.21.15.79:0/2340616355 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640106a0 con 0x7f6d74156570 2023-10-14T18:46:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/2340616355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74156570 msgr2=0x7f6d7406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/2340616355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74156570 0x7f6d7406d380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6d7415a1b0 tx=0x7f6d6400b4f0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/2340616355 shutdown_connections 2023-10-14T18:46:26.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/2340616355 >> v2:172.21.15.144:3300/0 conn(0x7f6d74157050 0x7f6d7406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/2340616355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74156570 0x7f6d7406d380 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/2340616355 >> 172.21.15.79:0/2340616355 conn(0x7f6d74067660 msgr2=0x7f6d74067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:26.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/2340616355 shutdown_connections 2023-10-14T18:46:26.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.936+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/2340616355 wait complete. 2023-10-14T18:46:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.937+0000 7f6d7a7aa700 1 Processor -- start 2023-10-14T18:46:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.937+0000 7f6d7a7aa700 1 -- start start 2023-10-14T18:46:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d74156570 0x7f6d740c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d7415a330 0x7f6d74150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c2dc0 con 0x7f6d74157050 2023-10-14T18:46:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c57e0 con 0x7f6d7415a330 2023-10-14T18:46:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d7a7aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c4bd0 con 0x7f6d74156570 2023-10-14T18:46:26.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48598/0 (socket says 172.21.15.79:48598) 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d737fe700 1 -- 172.21.15.79:0/1547604374 learned_addr learned my addr 172.21.15.79:0/1547604374 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d73fff700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d74156570 0x7f6d740c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.938+0000 7f6d78d47700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d7415a330 0x7f6d74150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 -- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d74156570 msgr2=0x7f6d740c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:26.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d74156570 0x7f6d740c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 -- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d7415a330 msgr2=0x7f6d74150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d7415a330 0x7f6d74150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 -- 172.21.15.79:0/1547604374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6400b790 con 0x7f6d74157050 2023-10-14T18:46:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d737fe700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800b7e0 tx=0x7f6d680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:26.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800f510 con 0x7f6d74157050 2023-10-14T18:46:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6800f670 con 0x7f6d74157050 2023-10-14T18:46:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740c4eb0 con 0x7f6d74157050 2023-10-14T18:46:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800fa10 con 0x7f6d74157050 2023-10-14T18:46:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.939+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740c5470 con 0x7f6d74157050 2023-10-14T18:46:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.940+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7404c3c0 con 0x7f6d74157050 2023-10-14T18:46:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.940+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d6801a400 con 0x7f6d74157050 2023-10-14T18:46:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.941+0000 7f6d5bfff700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:26.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.941+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d68083ef0 con 0x7f6d74157050 2023-10-14T18:46:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.941+0000 7f6d73fff700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.941+0000 7f6d73fff700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 0x7f6d600693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d7415a1b0 tx=0x7f6d6401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:26.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:26.945+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d680511e0 con 0x7f6d74157050 2023-10-14T18:46:27.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.129+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d740c5920 con 0x7f6d74157050 2023-10-14T18:46:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.129+0000 7f6d5bfff700 1 -- 172.21.15.79:0/1547604374 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f6d68054800 con 0x7f6d74157050 2023-10-14T18:46:27.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:27.131 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:26.163388+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 msgr2=0x7f6d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 0x7f6d600693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d7415a1b0 tx=0x7f6d6401a000 comp rx=0 tx=0).stop 2023-10-14T18:46:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 msgr2=0x7f6d740c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800b7e0 tx=0x7f6d680091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 shutdown_connections 2023-10-14T18:46:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d60066f30 0x7f6d600693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d7415a330 0x7f6d74150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d74156570 0x7f6d740c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 --2- 172.21.15.79:0/1547604374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d74157050 0x7f6d740c5c70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.131+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 >> 172.21.15.79:0/1547604374 conn(0x7f6d74067660 msgr2=0x7f6d740caa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.132+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 shutdown_connections 2023-10-14T18:46:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.132+0000 7f6d7a7aa700 1 -- 172.21.15.79:0/1547604374 wait complete. 2023-10-14T18:46:27.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.258+0000 7f871d561700 1 Processor -- start 2023-10-14T18:46:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.258+0000 7f871d561700 1 -- start start 2023-10-14T18:46:27.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f871d561700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8718070e10 0x7f871806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f871d561700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180ca0b0 con 0x7f87180c9af0 2023-10-14T18:46:27.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f871d561700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8718068a10 con 0x7f87181510f0 2023-10-14T18:46:27.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f871d561700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8718068cf0 con 0x7f8718070e10 2023-10-14T18:46:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f87177fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8718070e10 0x7f871806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.259+0000 7f870e7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87180c9af0 0x7f8718070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46492/0 (socket says 172.21.15.79:46492) 2023-10-14T18:46:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f870e7fc700 1 -- 172.21.15.79:0/901077922 learned_addr learned my addr 172.21.15.79:0/901077922 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87177fe700 1 -- 172.21.15.79:0/901077922 >> v1:172.21.15.144:6789/0 conn(0x7f87181510f0 legacy=0x7f871815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87177fe700 1 -- 172.21.15.79:0/901077922 >> v1:172.21.15.79:6789/0 conn(0x7f87180c9af0 legacy=0x7f8718070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87177fe700 1 -- 172.21.15.79:0/901077922 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180cb230 con 0x7f8718070e10 2023-10-14T18:46:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87167fc700 1 -- 172.21.15.79:0/901077922 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991420929 0 0) 0x7f87180ca0b0 con 0x7f87180c9af0 2023-10-14T18:46:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87177fe700 1 --2- 172.21.15.79:0/901077922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718070e10 0x7f871806ecc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8710009e60 tx=0x7f8710009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7cdf2ab84c95d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87167fc700 1 -- 172.21.15.79:0/901077922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000e070 con 0x7f8718070e10 2023-10-14T18:46:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87167fc700 1 -- 172.21.15.79:0/901077922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000bbf0 con 0x7f8718070e10 2023-10-14T18:46:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.260+0000 7f87167fc700 1 -- 172.21.15.79:0/901077922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710012430 con 0x7f8718070e10 2023-10-14T18:46:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 -- 172.21.15.79:0/901077922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718070e10 msgr2=0x7f871806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 --2- 172.21.15.79:0/901077922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718070e10 0x7f871806ecc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8710009e60 tx=0x7f8710009780 comp rx=0 tx=0).stop 2023-10-14T18:46:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 -- 172.21.15.79:0/901077922 shutdown_connections 2023-10-14T18:46:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 --2- 172.21.15.79:0/901077922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718070e10 0x7f871806ecc0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 -- 172.21.15.79:0/901077922 >> 172.21.15.79:0/901077922 conn(0x7f87180ca4f0 msgr2=0x7f87180ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 -- 172.21.15.79:0/901077922 shutdown_connections 2023-10-14T18:46:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.261+0000 7f871d561700 1 -- 172.21.15.79:0/901077922 wait complete. 2023-10-14T18:46:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.262+0000 7f871d561700 1 Processor -- start 2023-10-14T18:46:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.262+0000 7f871d561700 1 -- start start 2023-10-14T18:46:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8718070e10 0x7f871815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 0x7f87180c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871815da60 con 0x7f87180c9af0 2023-10-14T18:46:27.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871815ce50 con 0x7f87181510f0 2023-10-14T18:46:27.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871815d130 con 0x7f8718070e10 2023-10-14T18:46:27.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48604/0 (socket says 172.21.15.79:48604) 2023-10-14T18:46:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 -- 172.21.15.79:0/441371322 learned_addr learned my addr 172.21.15.79:0/441371322 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f87177fe700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 0x7f87180c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f8716ffd700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8718070e10 0x7f871815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 -- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8718070e10 msgr2=0x7f871815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8718070e10 0x7f871815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 -- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 msgr2=0x7f87180c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 0x7f87180c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 -- 172.21.15.79:0/441371322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009a20 con 0x7f87180c9af0 2023-10-14T18:46:27.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f87177fe700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 0x7f87180c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:27.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870e7fc700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f870000c7e0 tx=0x7f8700007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700005b30 con 0x7f87180c9af0 2023-10-14T18:46:27.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700005c90 con 0x7f87180c9af0 2023-10-14T18:46:27.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871815d410 con 0x7f87180c9af0 2023-10-14T18:46:27.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700007300 con 0x7f87180c9af0 2023-10-14T18:46:27.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.263+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871816b720 con 0x7f87180c9af0 2023-10-14T18:46:27.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.264+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871815e430 con 0x7f87180c9af0 2023-10-14T18:46:27.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.265+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f870001b400 con 0x7f87180c9af0 2023-10-14T18:46:27.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.265+0000 7f870f7fe700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.265+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8700083fe0 con 0x7f87180c9af0 2023-10-14T18:46:27.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.265+0000 7f8716ffd700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.266+0000 7f8716ffd700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f870800a8a0 tx=0x7f8708008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.270+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87000512d0 con 0x7f87180c9af0 2023-10-14T18:46:27.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.451+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f871804c3c0 con 0x7f87180c9af0 2023-10-14T18:46:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.452+0000 7f870f7fe700 1 -- 172.21.15.79:0/441371322 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f87000548f0 con 0x7f87180c9af0 2023-10-14T18:46:27.453 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:27.453 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":44,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:26.163388+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:27.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 msgr2=0x7f86f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f870800a8a0 tx=0x7f8708008040 comp rx=0 tx=0).stop 2023-10-14T18:46:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 msgr2=0x7f871816b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f870000c7e0 tx=0x7f8700007df0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 shutdown_connections 2023-10-14T18:46:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87181510f0 0x7f87180c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8718070e10 0x7f871815def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 --2- 172.21.15.79:0/441371322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87180c9af0 0x7f871816b1e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.454+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 >> 172.21.15.79:0/441371322 conn(0x7f87180ca4f0 msgr2=0x7f8718070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.455+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 shutdown_connections 2023-10-14T18:46:27.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.455+0000 7f871d561700 1 -- 172.21.15.79:0/441371322 wait complete. 2023-10-14T18:46:27.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:46:27.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.585+0000 7fbc48cbf700 1 Processor -- start 2023-10-14T18:46:27.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.585+0000 7fbc48cbf700 1 -- start start 2023-10-14T18:46:27.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc48cbf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4415d190 0x7fbc4406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc48cbf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b46b0 con 0x7fbc440b68e0 2023-10-14T18:46:27.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc48cbf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b54f0 con 0x7fbc4415d560 2023-10-14T18:46:27.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc48cbf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b48e0 con 0x7fbc4415d190 2023-10-14T18:46:27.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc4259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc4415d190 0x7fbc4406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc39d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc440b68e0 0x7fbc4415aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:46504/0 (socket says 172.21.15.79:46504) 2023-10-14T18:46:27.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc39d9b700 1 -- 172.21.15.79:0/599764967 learned_addr learned my addr 172.21.15.79:0/599764967 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:27.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc4259c700 1 -- 172.21.15.79:0/599764967 >> v1:172.21.15.144:6789/0 conn(0x7fbc4415d560 legacy=0x7fbc440b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:27.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc4259c700 1 -- 172.21.15.79:0/599764967 >> v1:172.21.15.79:6789/0 conn(0x7fbc440b68e0 legacy=0x7fbc4415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc41d9b700 1 -- 172.21.15.79:0/599764967 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21453086 0 0) 0x7fbc440b46b0 con 0x7fbc440b68e0 2023-10-14T18:46:27.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.586+0000 7fbc4259c700 1 -- 172.21.15.79:0/599764967 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440b4bc0 con 0x7fbc4415d190 2023-10-14T18:46:27.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc4259c700 1 --2- 172.21.15.79:0/599764967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4415d190 0x7fbc4406a520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc340098e0 tx=0x7fbc340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346659278535b4f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc41d9b700 1 -- 172.21.15.79:0/599764967 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34009e80 con 0x7fbc4415d190 2023-10-14T18:46:27.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc41d9b700 1 -- 172.21.15.79:0/599764967 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400b820 con 0x7fbc4415d190 2023-10-14T18:46:27.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc41d9b700 1 -- 172.21.15.79:0/599764967 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bba0 con 0x7fbc4415d190 2023-10-14T18:46:27.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 -- 172.21.15.79:0/599764967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4415d190 msgr2=0x7fbc4406a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/599764967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4415d190 0x7fbc4406a520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbc340098e0 tx=0x7fbc340091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 -- 172.21.15.79:0/599764967 shutdown_connections 2023-10-14T18:46:27.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/599764967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc4415d190 0x7fbc4406a520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 -- 172.21.15.79:0/599764967 >> 172.21.15.79:0/599764967 conn(0x7fbc44068ce0 msgr2=0x7fbc440690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:27.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 -- 172.21.15.79:0/599764967 shutdown_connections 2023-10-14T18:46:27.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.587+0000 7fbc48cbf700 1 -- 172.21.15.79:0/599764967 wait complete. 2023-10-14T18:46:27.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.588+0000 7fbc48cbf700 1 Processor -- start 2023-10-14T18:46:27.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 -- start start 2023-10-14T18:46:27.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc4415d190 0x7fbc44156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc4415d560 0x7fbc440cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440b1670 con 0x7fbc440b68e0 2023-10-14T18:46:27.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440b0a60 con 0x7fbc4415d560 2023-10-14T18:46:27.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc48cbf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440b0d40 con 0x7fbc4415d190 2023-10-14T18:46:27.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48616/0 (socket says 172.21.15.79:48616) 2023-10-14T18:46:27.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.589+0000 7fbc4259c700 1 -- 172.21.15.79:0/1187244841 learned_addr learned my addr 172.21.15.79:0/1187244841 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:27.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 -- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc4415d190 msgr2=0x7fbc44156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc4415d190 0x7fbc44156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 -- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc4415d560 msgr2=0x7fbc440cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:27.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc4415d560 0x7fbc440cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 -- 172.21.15.79:0/1187244841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34009420 con 0x7fbc440b68e0 2023-10-14T18:46:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc4259c700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc340030c0 tx=0x7fbc34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400bae0 con 0x7fbc440b68e0 2023-10-14T18:46:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34020070 con 0x7fbc440b68e0 2023-10-14T18:46:27.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc440b1020 con 0x7fbc440b68e0 2023-10-14T18:46:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3401b6a0 con 0x7fbc440b68e0 2023-10-14T18:46:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.590+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44145cb0 con 0x7fbc440b68e0 2023-10-14T18:46:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.591+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4404c3c0 con 0x7fbc440b68e0 2023-10-14T18:46:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.591+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc34022030 con 0x7fbc440b68e0 2023-10-14T18:46:27.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.591+0000 7fbc3affd700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 0x7fbc240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:27.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.591+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc340865a0 con 0x7fbc440b68e0 2023-10-14T18:46:27.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.592+0000 7fbc39d9b700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 0x7fbc240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:27.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.592+0000 7fbc39d9b700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 0x7fbc240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc4416d7b0 tx=0x7fbc2c007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:27.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.596+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc34053810 con 0x7fbc440b68e0 2023-10-14T18:46:27.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:27.825+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbc4404c3c0 con 0x7fbc440b68e0 2023-10-14T18:46:28.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.805+0000 7fbc3affd700 1 -- 172.21.15.79:0/1187244841 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbc34056e30 con 0x7fbc440b68e0 2023-10-14T18:46:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 msgr2=0x7fbc240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 0x7fbc240693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc4416d7b0 tx=0x7fbc2c007bd0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 msgr2=0x7fbc44145770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbc340030c0 tx=0x7fbc34016000 comp rx=0 tx=0).stop 2023-10-14T18:46:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 shutdown_connections 2023-10-14T18:46:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc24066f30 0x7fbc240693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc4415d560 0x7fbc440cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc440b68e0 0x7fbc44145770 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 --2- 172.21.15.79:0/1187244841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc4415d190 0x7fbc44156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 >> 172.21.15.79:0/1187244841 conn(0x7fbc44068ce0 msgr2=0x7fbc440d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 shutdown_connections 2023-10-14T18:46:28.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.808+0000 7fbc48cbf700 1 -- 172.21.15.79:0/1187244841 wait complete. 2023-10-14T18:46:28.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:46:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.945+0000 7f21a9f73700 1 Processor -- start 2023-10-14T18:46:28.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.945+0000 7f21a9f73700 1 -- start start 2023-10-14T18:46:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a9f73700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f21a406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a9f73700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40b0790 con 0x7f21a4159ec0 2023-10-14T18:46:28.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a9f73700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40ce1f0 con 0x7f21a406aae0 2023-10-14T18:46:28.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a9f73700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a406af60 con 0x7f21a415a290 2023-10-14T18:46:28.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21a4159ec0 0x7f21a40af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36788/0 (socket says 172.21.15.79:36788) 2023-10-14T18:46:28.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a37fe700 1 -- 172.21.15.79:0/122654036 learned_addr learned my addr 172.21.15.79:0/122654036 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:28.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770317547 0 0) 0x7f21a40b0790 con 0x7f21a4159ec0 2023-10-14T18:46:28.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f218c003570 con 0x7f21a4159ec0 2023-10-14T18:46:28.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.946+0000 7f21a2ffd700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f21a406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720490697 0 0) 0x7f218c003570 con 0x7f21a4159ec0 2023-10-14T18:46:28.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 msgr2=0x7f21a406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:28.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f21a406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 >> v1:172.21.15.144:6789/0 conn(0x7f21a406aae0 legacy=0x7f21a40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40b0b20 con 0x7f21a4159ec0 2023-10-14T18:46:28.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f2194001470 con 0x7f21a4159ec0 2023-10-14T18:46:28.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 >> v1:172.21.15.79:6789/0 conn(0x7f21a4159ec0 legacy=0x7f21a40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c003a90 0x7f218c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f218c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f218c004da0 0x7f218c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a406af60 con 0x7f218c003a90 2023-10-14T18:46:28.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c00bc20 con 0x7f218c004da0 2023-10-14T18:46:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c00bde0 con 0x7f21a415a290 2023-10-14T18:46:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c003a90 0x7f218c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a2ffd700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f218c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a3fff700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f218c004da0 0x7f218c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 -- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 msgr2=0x7f218c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f218c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 -- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f218c004da0 msgr2=0x7f218c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f218c004da0 0x7f218c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 -- 172.21.15.79:0/122654036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c003570 con 0x7f218c003a90 2023-10-14T18:46:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a2ffd700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21a415a290 0x7f218c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:28.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a3fff700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f218c004da0 0x7f218c0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a37fe700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c003a90 0x7f218c003ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f219400c390 tx=0x7f2194001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e6696cca8d937f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400cc60 con 0x7f218c003a90 2023-10-14T18:46:28.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.947+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219400cdc0 con 0x7f218c003a90 2023-10-14T18:46:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a27fc700 1 -- 172.21.15.79:0/122654036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194005b50 con 0x7f218c003a90 2023-10-14T18:46:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 -- 172.21.15.79:0/122654036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c003a90 msgr2=0x7f218c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 --2- 172.21.15.79:0/122654036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c003a90 0x7f218c003ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f219400c390 tx=0x7f2194001e50 comp rx=0 tx=0).stop 2023-10-14T18:46:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a3fff700 1 -- 172.21.15.79:0/122654036 reap_dead start 2023-10-14T18:46:28.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 -- 172.21.15.79:0/122654036 shutdown_connections 2023-10-14T18:46:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 -- 172.21.15.79:0/122654036 >> 172.21.15.79:0/122654036 conn(0x7f21a40d1880 msgr2=0x7f21a40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 -- 172.21.15.79:0/122654036 shutdown_connections 2023-10-14T18:46:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.948+0000 7f21a9f73700 1 -- 172.21.15.79:0/122654036 wait complete. 2023-10-14T18:46:28.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.949+0000 7f21a9f73700 1 Processor -- start 2023-10-14T18:46:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.949+0000 7f21a9f73700 1 -- start start 2023-10-14T18:46:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f218c003a90 0x7f21a40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21a414baa0 0x7f21a40b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41563a0 con 0x7f21a40c9cb0 2023-10-14T18:46:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40caa50 con 0x7f21a414baa0 2023-10-14T18:46:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a9f73700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40cad30 con 0x7f218c003a90 2023-10-14T18:46:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37826/0 (socket says 172.21.15.79:37826) 2023-10-14T18:46:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 -- 172.21.15.79:0/943170006 learned_addr learned my addr 172.21.15.79:0/943170006 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:28.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a2ffd700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21a414baa0 0x7f21a40b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a37fe700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f218c003a90 0x7f21a40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 -- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f218c003a90 msgr2=0x7f21a40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f218c003a90 0x7f21a40b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 -- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21a414baa0 msgr2=0x7f21a40b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:28.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21a414baa0 0x7f21a40b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 -- 172.21.15.79:0/943170006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40cb010 con 0x7f21a40c9cb0 2023-10-14T18:46:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.950+0000 7f21a3fff700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f21a4089910 tx=0x7f219c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:28.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c013630 con 0x7f21a40c9cb0 2023-10-14T18:46:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c013790 con 0x7f21a40c9cb0 2023-10-14T18:46:28.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40cb2f0 con 0x7f21a40c9cb0 2023-10-14T18:46:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c013b50 con 0x7f21a40c9cb0 2023-10-14T18:46:28.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a4156830 con 0x7f21a40c9cb0 2023-10-14T18:46:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.951+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a4156510 con 0x7f21a40c9cb0 2023-10-14T18:46:28.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.952+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f219c003030 con 0x7f21a40c9cb0 2023-10-14T18:46:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.952+0000 7f218b7fe700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 0x7f21900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:28.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.952+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f219c084360 con 0x7f21a40c9cb0 2023-10-14T18:46:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.952+0000 7f21a37fe700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 0x7f21900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.953+0000 7f21a37fe700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 0x7f21900693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2194001ed0 tx=0x7f2194015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:28.956+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f219c0515d0 con 0x7f21a40c9cb0 2023-10-14T18:46:29.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.186+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21a404c3c0 con 0x7f21a40c9cb0 2023-10-14T18:46:29.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.806+0000 7f218b7fe700 1 -- 172.21.15.79:0/943170006 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f219c054bf0 con 0x7f21a40c9cb0 2023-10-14T18:46:29.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 msgr2=0x7f21900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:29.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 0x7f21900693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2194001ed0 tx=0x7f2194015000 comp rx=0 tx=0).stop 2023-10-14T18:46:29.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 msgr2=0x7f21a40ca150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:29.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f21a4089910 tx=0x7f219c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 shutdown_connections 2023-10-14T18:46:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2190066f30 0x7f21900693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a40c9cb0 0x7f21a40ca150 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f218c003a90 0x7f21a40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 --2- 172.21.15.79:0/943170006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21a414baa0 0x7f21a40b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 >> 172.21.15.79:0/943170006 conn(0x7f21a40d1880 msgr2=0x7f21a40b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:29.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 shutdown_connections 2023-10-14T18:46:29.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.809+0000 7f21a9f73700 1 -- 172.21.15.79:0/943170006 wait complete. 2023-10-14T18:46:29.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:29.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.939+0000 7f13430ae700 1 Processor -- start 2023-10-14T18:46:29.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.939+0000 7f13430ae700 1 -- start start 2023-10-14T18:46:29.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c0b0890 0x7f133c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0cbd40 0x7f133c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f133c06c630 0x7f133c067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0cb370 con 0x7f133c0b0890 2023-10-14T18:46:29.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0b0c60 con 0x7f133c06c630 2023-10-14T18:46:29.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f13430ae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c06a1e0 con 0x7f133c0cbd40 2023-10-14T18:46:29.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f1340e4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c0b0890 0x7f133c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f1340e4a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c0b0890 0x7f133c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37840/0 (socket says 172.21.15.79:37840) 2023-10-14T18:46:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.940+0000 7f1340e4a700 1 -- 172.21.15.79:0/501929594 learned_addr learned my addr 172.21.15.79:0/501929594 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f134164b700 1 --2- 172.21.15.79:0/501929594 >> v2:172.21.15.144:3300/0 conn(0x7f133c06c630 0x7f133c067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1333fff700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0cbd40 0x7f133c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 -- 172.21.15.79:0/501929594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0cbd40 msgr2=0x7f133c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0cbd40 0x7f133c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 -- 172.21.15.79:0/501929594 >> v2:172.21.15.144:3300/0 conn(0x7f133c06c630 msgr2=0x7f133c067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 --2- 172.21.15.79:0/501929594 >> v2:172.21.15.144:3300/0 conn(0x7f133c06c630 0x7f133c067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 -- 172.21.15.79:0/501929594 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c06cb80 con 0x7f133c0b0890 2023-10-14T18:46:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f1340e4a700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0b0890 0x7f133c0cb800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f133c071430 tx=0x7f1338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6957a28acb838fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13337fe700 1 -- 172.21.15.79:0/501929594 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800b860 con 0x7f133c0b0890 2023-10-14T18:46:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13337fe700 1 -- 172.21.15.79:0/501929594 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133800b9c0 con 0x7f133c0b0890 2023-10-14T18:46:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13337fe700 1 -- 172.21.15.79:0/501929594 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800bd60 con 0x7f133c0b0890 2023-10-14T18:46:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 -- 172.21.15.79:0/501929594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0b0890 msgr2=0x7f133c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0b0890 0x7f133c0cb800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f133c071430 tx=0x7f1338009250 comp rx=0 tx=0).stop 2023-10-14T18:46:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 -- 172.21.15.79:0/501929594 shutdown_connections 2023-10-14T18:46:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 --2- 172.21.15.79:0/501929594 >> v2:172.21.15.144:3300/0 conn(0x7f133c06c630 0x7f133c067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0b0890 0x7f133c0cb800 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 --2- 172.21.15.79:0/501929594 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0cbd40 0x7f133c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.941+0000 7f13430ae700 1 -- 172.21.15.79:0/501929594 >> 172.21.15.79:0/501929594 conn(0x7f133c06fe50 msgr2=0x7f133c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.942+0000 7f13430ae700 1 -- 172.21.15.79:0/501929594 shutdown_connections 2023-10-14T18:46:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.942+0000 7f13430ae700 1 -- 172.21.15.79:0/501929594 wait complete. 2023-10-14T18:46:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 Processor -- start 2023-10-14T18:46:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 -- start start 2023-10-14T18:46:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133c06c630 0x7f133c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0b0890 0x7f133c0c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0c5530 con 0x7f133c0cbd40 2023-10-14T18:46:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0ab030 con 0x7f133c06c630 2023-10-14T18:46:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.943+0000 7f13430ae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0af5d0 con 0x7f133c0b0890 2023-10-14T18:46:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37856/0 (socket says 172.21.15.79:37856) 2023-10-14T18:46:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 -- 172.21.15.79:0/4239537066 learned_addr learned my addr 172.21.15.79:0/4239537066 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f1333fff700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0b0890 0x7f133c0c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f1340e4a700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133c06c630 0x7f133c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 -- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0b0890 msgr2=0x7f133c0c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0b0890 0x7f133c0c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 -- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133c06c630 msgr2=0x7f133c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133c06c630 0x7f133c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 -- 172.21.15.79:0/4239537066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380094f0 con 0x7f133c0cbd40 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f134164b700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fa0 tx=0x7f1334009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400ebc0 con 0x7f133c0cbd40 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133400ed20 con 0x7f133c0cbd40 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0aaa20 con 0x7f133c0cbd40 2023-10-14T18:46:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334014670 con 0x7f133c0cbd40 2023-10-14T18:46:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.944+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c0aacc0 con 0x7f133c0cbd40 2023-10-14T18:46:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.945+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0ab1e0 con 0x7f133c0cbd40 2023-10-14T18:46:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.945+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13340149e0 con 0x7f133c0cbd40 2023-10-14T18:46:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.946+0000 7f1330ff9700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.946+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1334084b30 con 0x7f133c0cbd40 2023-10-14T18:46:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.946+0000 7f1340e4a700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.946+0000 7f1340e4a700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f133c071430 tx=0x7f1338017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:29.950+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1334051da0 con 0x7f133c0cbd40 2023-10-14T18:46:30.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.173+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f133c04c3c0 con 0x7f133c0cbd40 2023-10-14T18:46:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.174+0000 7f1330ff9700 1 -- 172.21.15.79:0/4239537066 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f13340553c0 con 0x7f133c0cbd40 2023-10-14T18:46:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:30.175 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 msgr2=0x7f13280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 0x7f13280693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f133c071430 tx=0x7f1338017000 comp rx=0 tx=0).stop 2023-10-14T18:46:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 msgr2=0x7f133c0c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1334009fa0 tx=0x7f1334009900 comp rx=0 tx=0).stop 2023-10-14T18:46:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 shutdown_connections 2023-10-14T18:46:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1328066f30 0x7f13280693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cbd40 0x7f133c0c4bd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f133c06c630 0x7f133c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 --2- 172.21.15.79:0/4239537066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f133c0b0890 0x7f133c0c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 >> 172.21.15.79:0/4239537066 conn(0x7f133c06fe50 msgr2=0x7f133c0cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 shutdown_connections 2023-10-14T18:46:30.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.176+0000 7f13430ae700 1 -- 172.21.15.79:0/4239537066 wait complete. 2023-10-14T18:46:30.180 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:30.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:30.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.302+0000 7ff090222700 1 Processor -- start 2023-10-14T18:46:30.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.302+0000 7ff090222700 1 -- start start 2023-10-14T18:46:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.303+0000 7ff090222700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff08815a620 0x7ff08815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.303+0000 7ff090222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.303+0000 7ff090222700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08815cbb0 con 0x7ff088157870 2023-10-14T18:46:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.303+0000 7ff090222700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08815bdb0 con 0x7ff08815a620 2023-10-14T18:46:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.303+0000 7ff090222700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08815bfa0 con 0x7ff08815d580 2023-10-14T18:46:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff08815a620 0x7ff08815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08e7bf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08dfbe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff088157870 0x7ff08815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:44116/0 (socket says 172.21.15.79:44116) 2023-10-14T18:46:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08dfbe700 1 -- 172.21.15.79:0/2732246481 learned_addr learned my addr 172.21.15.79:0/2732246481 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 -- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 msgr2=0x7ff088158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 --2- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 -- 172.21.15.79:0/2732246481 >> v1:172.21.15.144:6789/0 conn(0x7ff088157870 legacy=0x7ff08815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 -- 172.21.15.79:0/2732246481 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08815c280 con 0x7ff08815a620 2023-10-14T18:46:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08cfbc700 1 -- 172.21.15.79:0/2732246481 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603723526 0 0) 0x7ff08815cbb0 con 0x7ff088157870 2023-10-14T18:46:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08d7bd700 1 --2- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff08815a620 0x7ff08815d040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0780098e0 tx=0x7ff0780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644a24376df84c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08cfbc700 1 -- 172.21.15.79:0/2732246481 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800b640 con 0x7ff08815a620 2023-10-14T18:46:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08cfbc700 1 -- 172.21.15.79:0/2732246481 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07800b7a0 con 0x7ff08815a620 2023-10-14T18:46:30.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.304+0000 7ff08cfbc700 1 -- 172.21.15.79:0/2732246481 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800bb40 con 0x7ff08815a620 2023-10-14T18:46:30.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 -- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff08815a620 msgr2=0x7ff08815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 --2- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff08815a620 0x7ff08815d040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0780098e0 tx=0x7ff0780091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 -- 172.21.15.79:0/2732246481 shutdown_connections 2023-10-14T18:46:30.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 --2- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 --2- 172.21.15.79:0/2732246481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff08815a620 0x7ff08815d040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 -- 172.21.15.79:0/2732246481 >> 172.21.15.79:0/2732246481 conn(0x7ff088068ce0 msgr2=0x7ff0880690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:30.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 -- 172.21.15.79:0/2732246481 shutdown_connections 2023-10-14T18:46:30.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.305+0000 7ff090222700 1 -- 172.21.15.79:0/2732246481 wait complete. 2023-10-14T18:46:30.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.306+0000 7ff090222700 1 Processor -- start 2023-10-14T18:46:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.306+0000 7ff090222700 1 -- start start 2023-10-14T18:46:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff088157870 0x7ff08816b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b65f0 con 0x7ff08815a620 2023-10-14T18:46:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b06c0 con 0x7ff088157870 2023-10-14T18:46:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff090222700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880b0c80 con 0x7ff08815d580 2023-10-14T18:46:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37868/0 (socket says 172.21.15.79:37868) 2023-10-14T18:46:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 -- 172.21.15.79:0/602567139 learned_addr learned my addr 172.21.15.79:0/602567139 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08dfbe700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff088157870 0x7ff08816b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08e7bf700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 -- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 msgr2=0x7ff088152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 -- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff088157870 msgr2=0x7ff08816b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff088157870 0x7ff08816b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 -- 172.21.15.79:0/602567139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078009420 con 0x7ff08815a620 2023-10-14T18:46:30.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff08d7bd700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff078009f80 tx=0x7ff078017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.307+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800bb20 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.308+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078000c90 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.308+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078011650 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.308+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880b6810 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.308+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0880b0910 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.309+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880b0e10 con 0x7ff08815a620 2023-10-14T18:46:30.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.309+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff078011a00 con 0x7ff08815a620 2023-10-14T18:46:30.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.310+0000 7ff07dffb700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 0x7ff06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.310+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff078085da0 con 0x7ff08815a620 2023-10-14T18:46:30.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.310+0000 7ff08dfbe700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 0x7ff06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.310+0000 7ff08dfbe700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 0x7ff06c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff084007fd0 tx=0x7ff084007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.313+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff078053090 con 0x7ff08815a620 2023-10-14T18:46:30.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.497+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff08804c3c0 con 0x7ff08815a620 2023-10-14T18:46:30.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.498+0000 7ff07dffb700 1 -- 172.21.15.79:0/602567139 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff078011cb0 con 0x7ff08815a620 2023-10-14T18:46:30.498 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:30.499 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":45,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:27.784949+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 msgr2=0x7ff06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 0x7ff06c0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff084007fd0 tx=0x7ff084007d30 comp rx=0 tx=0).stop 2023-10-14T18:46:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 msgr2=0x7ff0880b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff078009f80 tx=0x7ff078017000 comp rx=0 tx=0).stop 2023-10-14T18:46:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 shutdown_connections 2023-10-14T18:46:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff06c066f30 0x7ff06c0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff08815d580 0x7ff088152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff088157870 0x7ff08816b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 --2- 172.21.15.79:0/602567139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff08815a620 0x7ff0880b60b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 >> 172.21.15.79:0/602567139 conn(0x7ff088068ce0 msgr2=0x7ff08814c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:30.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 shutdown_connections 2023-10-14T18:46:30.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.500+0000 7ff090222700 1 -- 172.21.15.79:0/602567139 wait complete. 2023-10-14T18:46:30.512 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:46:30.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:46:30.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.626+0000 7f13d608b700 1 Processor -- start 2023-10-14T18:46:30.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.626+0000 7f13d608b700 1 -- start start 2023-10-14T18:46:30.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13d608b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13d0157870 0x7f13d015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13d608b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 0x7f13d0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13d608b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d015cbb0 con 0x7f13d015a620 2023-10-14T18:46:30.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13d608b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d015bfa0 con 0x7f13d0157870 2023-10-14T18:46:30.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13d608b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d015c280 con 0x7f13d0157c40 2023-10-14T18:46:30.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13cf7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13d0157870 0x7f13d015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13ceffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f13d015a620 0x7f13d015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36804/0 (socket says 172.21.15.79:36804) 2023-10-14T18:46:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13ceffd700 1 -- 172.21.15.79:0/3966635813 learned_addr learned my addr 172.21.15.79:0/3966635813 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.627+0000 7f13cffff700 1 --2- 172.21.15.79:0/3966635813 >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 0x7f13d0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cf7fe700 1 -- 172.21.15.79:0/3966635813 >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 msgr2=0x7f13d0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/3966635813 >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 0x7f13d0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cf7fe700 1 -- 172.21.15.79:0/3966635813 >> v1:172.21.15.79:6789/0 conn(0x7f13d015a620 legacy=0x7f13d015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cf7fe700 1 -- 172.21.15.79:0/3966635813 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d015c560 con 0x7f13d0157870 2023-10-14T18:46:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13ce7fc700 1 -- 172.21.15.79:0/3966635813 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402753898 0 0) 0x7f13d015cbb0 con 0x7f13d015a620 2023-10-14T18:46:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cffff700 1 --2- 172.21.15.79:0/3966635813 >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 0x7f13d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/3966635813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157870 0x7f13d015b6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13d006b4e0 tx=0x7f13c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25331caae872323d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13ce7fc700 1 -- 172.21.15.79:0/3966635813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000e070 con 0x7f13d0157870 2023-10-14T18:46:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13ce7fc700 1 -- 172.21.15.79:0/3966635813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000bc30 con 0x7f13d0157870 2023-10-14T18:46:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13ce7fc700 1 -- 172.21.15.79:0/3966635813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0012430 con 0x7f13d0157870 2023-10-14T18:46:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 -- 172.21.15.79:0/3966635813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157870 msgr2=0x7f13d015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 --2- 172.21.15.79:0/3966635813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157870 0x7f13d015b6a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f13d006b4e0 tx=0x7f13c0009780 comp rx=0 tx=0).stop 2023-10-14T18:46:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 -- 172.21.15.79:0/3966635813 shutdown_connections 2023-10-14T18:46:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 --2- 172.21.15.79:0/3966635813 >> v2:172.21.15.144:3300/0 conn(0x7f13d0157c40 0x7f13d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 --2- 172.21.15.79:0/3966635813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157870 0x7f13d015b6a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 -- 172.21.15.79:0/3966635813 >> 172.21.15.79:0/3966635813 conn(0x7f13d0068ce0 msgr2=0x7f13d00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 -- 172.21.15.79:0/3966635813 shutdown_connections 2023-10-14T18:46:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.628+0000 7f13d608b700 1 -- 172.21.15.79:0/3966635813 wait complete. 2023-10-14T18:46:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 Processor -- start 2023-10-14T18:46:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 -- start start 2023-10-14T18:46:30.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 0x7f13d016a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 0x7f13d00c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00b06b0 con 0x7f13d0157c40 2023-10-14T18:46:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d016ab20 con 0x7f13d015a620 2023-10-14T18:46:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.630+0000 7f13d608b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d016ae00 con 0x7f13d0157870 2023-10-14T18:46:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37886/0 (socket says 172.21.15.79:37886) 2023-10-14T18:46:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 -- 172.21.15.79:0/2578191618 learned_addr learned my addr 172.21.15.79:0/2578191618 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13cffff700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 0x7f13d00c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 0x7f13d016a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 -- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 msgr2=0x7f13d016a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 0x7f13d016a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 -- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 msgr2=0x7f13d00c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 0x7f13d00c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 -- 172.21.15.79:0/2578191618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0009a20 con 0x7f13d0157c40 2023-10-14T18:46:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13cffff700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 0x7f13d00c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 0x7f13d016a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13ceffd700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c5e0 tx=0x7f13c4000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4005b30 con 0x7f13d0157c40 2023-10-14T18:46:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c4005c90 con 0x7f13d0157c40 2023-10-14T18:46:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00b0950 con 0x7f13d0157c40 2023-10-14T18:46:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4007300 con 0x7f13d0157c40 2023-10-14T18:46:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.631+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d016a6f0 con 0x7f13d0157c40 2023-10-14T18:46:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.632+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d00b0b40 con 0x7f13d0157c40 2023-10-14T18:46:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.632+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13c40076b0 con 0x7f13d0157c40 2023-10-14T18:46:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.633+0000 7f13b77fe700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 0x7f13bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.633+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13c4083a70 con 0x7f13d0157c40 2023-10-14T18:46:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.633+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 0x7f13bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.633+0000 7f13cf7fe700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 0x7f13bc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13d006b4e0 tx=0x7f13c0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.637+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13c4050ce0 con 0x7f13d0157c40 2023-10-14T18:46:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.816+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13d004c3c0 con 0x7f13bc066f30 2023-10-14T18:46:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.825+0000 7f13b77fe700 1 -- 172.21.15.79:0/2578191618 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285150 (secure 0 0 0) 0x7f13d004c3c0 con 0x7f13bc066f30 2023-10-14T18:46:30.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:30.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 msgr2=0x7f13bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 0x7f13bc0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13d006b4e0 tx=0x7f13c0019000 comp rx=0 tx=0).stop 2023-10-14T18:46:30.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 msgr2=0x7f13d00b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:30.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f13c400c5e0 tx=0x7f13c4000fe0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 shutdown_connections 2023-10-14T18:46:30.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13bc066f30 0x7f13bc0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d015a620 0x7f13d00c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13d0157870 0x7f13d016a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 --2- 172.21.15.79:0/2578191618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13d0157c40 0x7f13d00b0e70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:30.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 >> 172.21.15.79:0/2578191618 conn(0x7f13d0068ce0 msgr2=0x7f13d00d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:30.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 shutdown_connections 2023-10-14T18:46:30.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.828+0000 7f13d608b700 1 -- 172.21.15.79:0/2578191618 wait complete. 2023-10-14T18:46:30.834 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:46:30.841 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-14T18:46:30.352255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559673,"statfs":{"total":1600000000,"available":1597105975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.572251"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796935+0000","last_change":"2023-10-14T18:46:26.796516+0000","last_active":"2023-10-14T18:46:26.796935+0000","last_peered":"2023-10-14T18:46:26.796935+0000","last_clean":"2023-10-14T18:46:26.796935+0000","last_became_active":"2023-10-14T18:46:26.795391+0000","last_became_peered":"2023-10-14T18:46:26.795391+0000","last_unstale":"2023-10-14T18:46:26.796935+0000","last_undegraded":"2023-10-14T18:46:26.796935+0000","last_fullsized":"2023-10-14T18:46:26.796935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:15.177872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797333+0000","last_change":"2023-10-14T18:46:26.797075+0000","last_active":"2023-10-14T18:46:26.797333+0000","last_peered":"2023-10-14T18:46:26.797333+0000","last_clean":"2023-10-14T18:46:26.797333+0000","last_became_active":"2023-10-14T18:46:26.796846+0000","last_became_peered":"2023-10-14T18:46:26.796846+0000","last_unstale":"2023-10-14T18:46:26.797333+0000","last_undegraded":"2023-10-14T18:46:26.797333+0000","last_fullsized":"2023-10-14T18:46:26.797333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:14.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801570+0000","last_change":"2023-10-14T18:46:26.801489+0000","last_active":"2023-10-14T18:46:26.801570+0000","last_peered":"2023-10-14T18:46:26.801570+0000","last_clean":"2023-10-14T18:46:26.801570+0000","last_became_active":"2023-10-14T18:46:26.800884+0000","last_became_peered":"2023-10-14T18:46:26.800884+0000","last_unstale":"2023-10-14T18:46:26.801570+0000","last_undegraded":"2023-10-14T18:46:26.801570+0000","last_fullsized":"2023-10-14T18:46:26.801570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:45.589239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800678+0000","last_change":"2023-10-14T18:46:26.800613+0000","last_active":"2023-10-14T18:46:26.800678+0000","last_peered":"2023-10-14T18:46:26.800678+0000","last_clean":"2023-10-14T18:46:26.800678+0000","last_became_active":"2023-10-14T18:46:26.800408+0000","last_became_peered":"2023-10-14T18:46:26.800408+0000","last_unstale":"2023-10-14T18:46:26.800678+0000","last_undegraded":"2023-10-14T18:46:26.800678+0000","last_fullsized":"2023-10-14T18:46:26.800678+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:19.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799202+0000","last_change":"2023-10-14T18:46:26.798908+0000","last_active":"2023-10-14T18:46:26.799202+0000","last_peered":"2023-10-14T18:46:26.799202+0000","last_clean":"2023-10-14T18:46:26.799202+0000","last_became_active":"2023-10-14T18:46:26.798687+0000","last_became_peered":"2023-10-14T18:46:26.798687+0000","last_unstale":"2023-10-14T18:46:26.799202+0000","last_undegraded":"2023-10-14T18:46:26.799202+0000","last_fullsized":"2023-10-14T18:46:26.799202+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:19.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796540+0000","last_change":"2023-10-14T18:46:26.796455+0000","last_active":"2023-10-14T18:46:26.796540+0000","last_peered":"2023-10-14T18:46:26.796540+0000","last_clean":"2023-10-14T18:46:26.796540+0000","last_became_active":"2023-10-14T18:46:26.795939+0000","last_became_peered":"2023-10-14T18:46:26.795939+0000","last_unstale":"2023-10-14T18:46:26.796540+0000","last_undegraded":"2023-10-14T18:46:26.796540+0000","last_fullsized":"2023-10-14T18:46:26.796540+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:44.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.791584+0000","last_change":"2023-10-14T18:46:26.791519+0000","last_active":"2023-10-14T18:46:26.791584+0000","last_peered":"2023-10-14T18:46:26.791584+0000","last_clean":"2023-10-14T18:46:26.791584+0000","last_became_active":"2023-10-14T18:46:26.791291+0000","last_became_peered":"2023-10-14T18:46:26.791291+0000","last_unstale":"2023-10-14T18:46:26.791584+0000","last_undegraded":"2023-10-14T18:46:26.791584+0000","last_fullsized":"2023-10-14T18:46:26.791584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:39.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795715+0000","last_change":"2023-10-14T18:46:26.795505+0000","last_active":"2023-10-14T18:46:26.795715+0000","last_peered":"2023-10-14T18:46:26.795715+0000","last_clean":"2023-10-14T18:46:26.795715+0000","last_became_active":"2023-10-14T18:46:26.795312+0000","last_became_peered":"2023-10-14T18:46:26.795312+0000","last_unstale":"2023-10-14T18:46:26.795715+0000","last_undegraded":"2023-10-14T18:46:26.795715+0000","last_fullsized":"2023-10-14T18:46:26.795715+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:45.589239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793446+0000","last_change":"2023-10-14T18:46:26.793377+0000","last_active":"2023-10-14T18:46:26.793446+0000","last_peered":"2023-10-14T18:46:26.793446+0000","last_clean":"2023-10-14T18:46:26.793446+0000","last_became_active":"2023-10-14T18:46:26.793035+0000","last_became_peered":"2023-10-14T18:46:26.793035+0000","last_unstale":"2023-10-14T18:46:26.793446+0000","last_undegraded":"2023-10-14T18:46:26.793446+0000","last_fullsized":"2023-10-14T18:46:26.793446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:25.961638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797072+0000","last_change":"2023-10-14T18:46:26.797020+0000","last_active":"2023-10-14T18:46:26.797072+0000","last_peered":"2023-10-14T18:46:26.797072+0000","last_clean":"2023-10-14T18:46:26.797072+0000","last_became_active":"2023-10-14T18:46:26.795524+0000","last_became_peered":"2023-10-14T18:46:26.795524+0000","last_unstale":"2023-10-14T18:46:26.797072+0000","last_undegraded":"2023-10-14T18:46:26.797072+0000","last_fullsized":"2023-10-14T18:46:26.797072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793105+0000","last_change":"2023-10-14T18:46:26.792921+0000","last_active":"2023-10-14T18:46:26.793105+0000","last_peered":"2023-10-14T18:46:26.793105+0000","last_clean":"2023-10-14T18:46:26.793105+0000","last_became_active":"2023-10-14T18:46:26.792690+0000","last_became_peered":"2023-10-14T18:46:26.792690+0000","last_unstale":"2023-10-14T18:46:26.793105+0000","last_undegraded":"2023-10-14T18:46:26.793105+0000","last_fullsized":"2023-10-14T18:46:26.793105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794647+0000","last_change":"2023-10-14T18:46:26.794583+0000","last_active":"2023-10-14T18:46:26.794647+0000","last_peered":"2023-10-14T18:46:26.794647+0000","last_clean":"2023-10-14T18:46:26.794647+0000","last_became_active":"2023-10-14T18:46:26.794361+0000","last_became_peered":"2023-10-14T18:46:26.794361+0000","last_unstale":"2023-10-14T18:46:26.794647+0000","last_undegraded":"2023-10-14T18:46:26.794647+0000","last_fullsized":"2023-10-14T18:46:26.794647+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796993+0000","last_change":"2023-10-14T18:46:26.796608+0000","last_active":"2023-10-14T18:46:26.796993+0000","last_peered":"2023-10-14T18:46:26.796993+0000","last_clean":"2023-10-14T18:46:26.796993+0000","last_became_active":"2023-10-14T18:46:26.796074+0000","last_became_peered":"2023-10-14T18:46:26.796074+0000","last_unstale":"2023-10-14T18:46:26.796993+0000","last_undegraded":"2023-10-14T18:46:26.796993+0000","last_fullsized":"2023-10-14T18:46:26.796993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:19.657463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793430+0000","last_change":"2023-10-14T18:46:26.793245+0000","last_active":"2023-10-14T18:46:26.793430+0000","last_peered":"2023-10-14T18:46:26.793430+0000","last_clean":"2023-10-14T18:46:26.793430+0000","last_became_active":"2023-10-14T18:46:26.792738+0000","last_became_peered":"2023-10-14T18:46:26.792738+0000","last_unstale":"2023-10-14T18:46:26.793430+0000","last_undegraded":"2023-10-14T18:46:26.793430+0000","last_fullsized":"2023-10-14T18:46:26.793430+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793877+0000","last_change":"2023-10-14T18:46:26.793578+0000","last_active":"2023-10-14T18:46:26.793877+0000","last_peered":"2023-10-14T18:46:26.793877+0000","last_clean":"2023-10-14T18:46:26.793877+0000","last_became_active":"2023-10-14T18:46:26.793367+0000","last_became_peered":"2023-10-14T18:46:26.793367+0000","last_unstale":"2023-10-14T18:46:26.793877+0000","last_undegraded":"2023-10-14T18:46:26.793877+0000","last_fullsized":"2023-10-14T18:46:26.793877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:46.446898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795561+0000","last_change":"2023-10-14T18:46:26.794872+0000","last_active":"2023-10-14T18:46:26.795561+0000","last_peered":"2023-10-14T18:46:26.795561+0000","last_clean":"2023-10-14T18:46:26.795561+0000","last_became_active":"2023-10-14T18:46:26.794489+0000","last_became_peered":"2023-10-14T18:46:26.794489+0000","last_unstale":"2023-10-14T18:46:26.795561+0000","last_undegraded":"2023-10-14T18:46:26.795561+0000","last_fullsized":"2023-10-14T18:46:26.795561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:35.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794778+0000","last_change":"2023-10-14T18:46:26.794655+0000","last_active":"2023-10-14T18:46:26.794778+0000","last_peered":"2023-10-14T18:46:26.794778+0000","last_clean":"2023-10-14T18:46:26.794778+0000","last_became_active":"2023-10-14T18:46:26.794267+0000","last_became_peered":"2023-10-14T18:46:26.794267+0000","last_unstale":"2023-10-14T18:46:26.794778+0000","last_undegraded":"2023-10-14T18:46:26.794778+0000","last_fullsized":"2023-10-14T18:46:26.794778+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:40.861435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801156+0000","last_change":"2023-10-14T18:46:26.801089+0000","last_active":"2023-10-14T18:46:26.801156+0000","last_peered":"2023-10-14T18:46:26.801156+0000","last_clean":"2023-10-14T18:46:26.801156+0000","last_became_active":"2023-10-14T18:46:26.800520+0000","last_became_peered":"2023-10-14T18:46:26.800520+0000","last_unstale":"2023-10-14T18:46:26.801156+0000","last_undegraded":"2023-10-14T18:46:26.801156+0000","last_fullsized":"2023-10-14T18:46:26.801156+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:43.033926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803901+0000","last_change":"2023-10-14T18:46:26.803805+0000","last_active":"2023-10-14T18:46:26.803901+0000","last_peered":"2023-10-14T18:46:26.803901+0000","last_clean":"2023-10-14T18:46:26.803901+0000","last_became_active":"2023-10-14T18:46:26.803575+0000","last_became_peered":"2023-10-14T18:46:26.803575+0000","last_unstale":"2023-10-14T18:46:26.803901+0000","last_undegraded":"2023-10-14T18:46:26.803901+0000","last_fullsized":"2023-10-14T18:46:26.803901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:52.652114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798047+0000","last_change":"2023-10-14T18:46:26.797987+0000","last_active":"2023-10-14T18:46:26.798047+0000","last_peered":"2023-10-14T18:46:26.798047+0000","last_clean":"2023-10-14T18:46:26.798047+0000","last_became_active":"2023-10-14T18:46:26.797800+0000","last_became_peered":"2023-10-14T18:46:26.797800+0000","last_unstale":"2023-10-14T18:46:26.798047+0000","last_undegraded":"2023-10-14T18:46:26.798047+0000","last_fullsized":"2023-10-14T18:46:26.798047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:39:45.506770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796523+0000","last_change":"2023-10-14T18:46:26.796324+0000","last_active":"2023-10-14T18:46:26.796523+0000","last_peered":"2023-10-14T18:46:26.796523+0000","last_clean":"2023-10-14T18:46:26.796523+0000","last_became_active":"2023-10-14T18:46:26.795606+0000","last_became_peered":"2023-10-14T18:46:26.795606+0000","last_unstale":"2023-10-14T18:46:26.796523+0000","last_undegraded":"2023-10-14T18:46:26.796523+0000","last_fullsized":"2023-10-14T18:46:26.796523+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:43:23.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797017+0000","last_change":"2023-10-14T18:46:26.796945+0000","last_active":"2023-10-14T18:46:26.797017+0000","last_peered":"2023-10-14T18:46:26.797017+0000","last_clean":"2023-10-14T18:46:26.797017+0000","last_became_active":"2023-10-14T18:46:26.796629+0000","last_became_peered":"2023-10-14T18:46:26.796629+0000","last_unstale":"2023-10-14T18:46:26.797017+0000","last_undegraded":"2023-10-14T18:46:26.797017+0000","last_fullsized":"2023-10-14T18:46:26.797017+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798806+0000","last_change":"2023-10-14T18:46:26.797916+0000","last_active":"2023-10-14T18:46:26.798806+0000","last_peered":"2023-10-14T18:46:26.798806+0000","last_clean":"2023-10-14T18:46:26.798806+0000","last_became_active":"2023-10-14T18:46:26.797701+0000","last_became_peered":"2023-10-14T18:46:26.797701+0000","last_unstale":"2023-10-14T18:46:26.798806+0000","last_undegraded":"2023-10-14T18:46:26.798806+0000","last_fullsized":"2023-10-14T18:46:26.798806+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:40.861435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801967+0000","last_change":"2023-10-14T18:46:26.801893+0000","last_active":"2023-10-14T18:46:26.801967+0000","last_peered":"2023-10-14T18:46:26.801967+0000","last_clean":"2023-10-14T18:46:26.801967+0000","last_became_active":"2023-10-14T18:46:26.801226+0000","last_became_peered":"2023-10-14T18:46:26.801226+0000","last_unstale":"2023-10-14T18:46:26.801967+0000","last_undegraded":"2023-10-14T18:46:26.801967+0000","last_fullsized":"2023-10-14T18:46:26.801967+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799372+0000","last_change":"2023-10-14T18:46:26.799286+0000","last_active":"2023-10-14T18:46:26.799372+0000","last_peered":"2023-10-14T18:46:26.799372+0000","last_clean":"2023-10-14T18:46:26.799372+0000","last_became_active":"2023-10-14T18:46:26.799054+0000","last_became_peered":"2023-10-14T18:46:26.799054+0000","last_unstale":"2023-10-14T18:46:26.799372+0000","last_undegraded":"2023-10-14T18:46:26.799372+0000","last_fullsized":"2023-10-14T18:46:26.799372+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:46.347475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799328+0000","last_change":"2023-10-14T18:46:26.799225+0000","last_active":"2023-10-14T18:46:26.799328+0000","last_peered":"2023-10-14T18:46:26.799328+0000","last_clean":"2023-10-14T18:46:26.799328+0000","last_became_active":"2023-10-14T18:46:26.798686+0000","last_became_peered":"2023-10-14T18:46:26.798686+0000","last_unstale":"2023-10-14T18:46:26.799328+0000","last_undegraded":"2023-10-14T18:46:26.799328+0000","last_fullsized":"2023-10-14T18:46:26.799328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:56.631765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794573+0000","last_change":"2023-10-14T18:46:26.794506+0000","last_active":"2023-10-14T18:46:26.794573+0000","last_peered":"2023-10-14T18:46:26.794573+0000","last_clean":"2023-10-14T18:46:26.794573+0000","last_became_active":"2023-10-14T18:46:26.793955+0000","last_became_peered":"2023-10-14T18:46:26.793955+0000","last_unstale":"2023-10-14T18:46:26.794573+0000","last_undegraded":"2023-10-14T18:46:26.794573+0000","last_fullsized":"2023-10-14T18:46:26.794573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796088+0000","last_change":"2023-10-14T18:46:26.795467+0000","last_active":"2023-10-14T18:46:26.796088+0000","last_peered":"2023-10-14T18:46:26.796088+0000","last_clean":"2023-10-14T18:46:26.796088+0000","last_became_active":"2023-10-14T18:46:26.795201+0000","last_became_peered":"2023-10-14T18:46:26.795201+0000","last_unstale":"2023-10-14T18:46:26.796088+0000","last_undegraded":"2023-10-14T18:46:26.796088+0000","last_fullsized":"2023-10-14T18:46:26.796088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.802084+0000","last_change":"2023-10-14T18:46:26.802025+0000","last_active":"2023-10-14T18:46:26.802084+0000","last_peered":"2023-10-14T18:46:26.802084+0000","last_clean":"2023-10-14T18:46:26.802084+0000","last_became_active":"2023-10-14T18:46:26.801678+0000","last_became_peered":"2023-10-14T18:46:26.801678+0000","last_unstale":"2023-10-14T18:46:26.802084+0000","last_undegraded":"2023-10-14T18:46:26.802084+0000","last_fullsized":"2023-10-14T18:46:26.802084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:20.637059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796470+0000","last_change":"2023-10-14T18:46:26.796151+0000","last_active":"2023-10-14T18:46:26.796470+0000","last_peered":"2023-10-14T18:46:26.796470+0000","last_clean":"2023-10-14T18:46:26.796470+0000","last_became_active":"2023-10-14T18:46:26.795928+0000","last_became_peered":"2023-10-14T18:46:26.795928+0000","last_unstale":"2023-10-14T18:46:26.796470+0000","last_undegraded":"2023-10-14T18:46:26.796470+0000","last_fullsized":"2023-10-14T18:46:26.796470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795053+0000","last_change":"2023-10-14T18:46:26.794828+0000","last_active":"2023-10-14T18:46:26.795053+0000","last_peered":"2023-10-14T18:46:26.795053+0000","last_clean":"2023-10-14T18:46:26.795053+0000","last_became_active":"2023-10-14T18:46:26.794311+0000","last_became_peered":"2023-10-14T18:46:26.794311+0000","last_unstale":"2023-10-14T18:46:26.795053+0000","last_undegraded":"2023-10-14T18:46:26.795053+0000","last_fullsized":"2023-10-14T18:46:26.795053+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.741203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794167+0000","last_change":"2023-10-14T18:46:26.794035+0000","last_active":"2023-10-14T18:46:26.794167+0000","last_peered":"2023-10-14T18:46:26.794167+0000","last_clean":"2023-10-14T18:46:26.794167+0000","last_became_active":"2023-10-14T18:46:26.793815+0000","last_became_peered":"2023-10-14T18:46:26.793815+0000","last_unstale":"2023-10-14T18:46:26.794167+0000","last_undegraded":"2023-10-14T18:46:26.794167+0000","last_fullsized":"2023-10-14T18:46:26.794167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:01:02.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793910+0000","last_change":"2023-10-14T18:46:26.793834+0000","last_active":"2023-10-14T18:46:26.793910+0000","last_peered":"2023-10-14T18:46:26.793910+0000","last_clean":"2023-10-14T18:46:26.793910+0000","last_became_active":"2023-10-14T18:46:26.793603+0000","last_became_peered":"2023-10-14T18:46:26.793603+0000","last_unstale":"2023-10-14T18:46:26.793910+0000","last_undegraded":"2023-10-14T18:46:26.793910+0000","last_fullsized":"2023-10-14T18:46:26.793910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:06:55.049147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805792+0000","last_change":"2023-10-14T18:46:25.800489+0000","last_active":"2023-10-14T18:46:26.805792+0000","last_peered":"2023-10-14T18:46:26.805792+0000","last_clean":"2023-10-14T18:46:26.805792+0000","last_became_active":"2023-10-14T18:46:25.800223+0000","last_became_peered":"2023-10-14T18:46:25.800223+0000","last_unstale":"2023-10-14T18:46:26.805792+0000","last_undegraded":"2023-10-14T18:46:26.805792+0000","last_fullsized":"2023-10-14T18:46:26.805792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:56.710920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799997+0000","last_change":"2023-10-14T18:46:26.799927+0000","last_active":"2023-10-14T18:46:26.799997+0000","last_peered":"2023-10-14T18:46:26.799997+0000","last_clean":"2023-10-14T18:46:26.799997+0000","last_became_active":"2023-10-14T18:46:26.799723+0000","last_became_peered":"2023-10-14T18:46:26.799723+0000","last_unstale":"2023-10-14T18:46:26.799997+0000","last_undegraded":"2023-10-14T18:46:26.799997+0000","last_fullsized":"2023-10-14T18:46:26.799997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:46.039820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806246+0000","last_change":"2023-10-14T18:46:25.801678+0000","last_active":"2023-10-14T18:46:26.806246+0000","last_peered":"2023-10-14T18:46:26.806246+0000","last_clean":"2023-10-14T18:46:26.806246+0000","last_became_active":"2023-10-14T18:46:25.801543+0000","last_became_peered":"2023-10-14T18:46:25.801543+0000","last_unstale":"2023-10-14T18:46:26.806246+0000","last_undegraded":"2023-10-14T18:46:26.806246+0000","last_fullsized":"2023-10-14T18:46:26.806246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:24.293831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795233+0000","last_change":"2023-10-14T18:46:26.794910+0000","last_active":"2023-10-14T18:46:26.795233+0000","last_peered":"2023-10-14T18:46:26.795233+0000","last_clean":"2023-10-14T18:46:26.795233+0000","last_became_active":"2023-10-14T18:46:26.794695+0000","last_became_peered":"2023-10-14T18:46:26.794695+0000","last_unstale":"2023-10-14T18:46:26.795233+0000","last_undegraded":"2023-10-14T18:46:26.795233+0000","last_fullsized":"2023-10-14T18:46:26.795233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:39.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803778+0000","last_change":"2023-10-14T18:46:25.791532+0000","last_active":"2023-10-14T18:46:26.803778+0000","last_peered":"2023-10-14T18:46:26.803778+0000","last_clean":"2023-10-14T18:46:26.803778+0000","last_became_active":"2023-10-14T18:46:25.791166+0000","last_became_peered":"2023-10-14T18:46:25.791166+0000","last_unstale":"2023-10-14T18:46:26.803778+0000","last_undegraded":"2023-10-14T18:46:26.803778+0000","last_fullsized":"2023-10-14T18:46:26.803778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800315+0000","last_change":"2023-10-14T18:46:26.799512+0000","last_active":"2023-10-14T18:46:26.800315+0000","last_peered":"2023-10-14T18:46:26.800315+0000","last_clean":"2023-10-14T18:46:26.800315+0000","last_became_active":"2023-10-14T18:46:26.799298+0000","last_became_peered":"2023-10-14T18:46:26.799298+0000","last_unstale":"2023-10-14T18:46:26.800315+0000","last_undegraded":"2023-10-14T18:46:26.800315+0000","last_fullsized":"2023-10-14T18:46:26.800315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:45.533544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805865+0000","last_change":"2023-10-14T18:46:25.790347+0000","last_active":"2023-10-14T18:46:26.805865+0000","last_peered":"2023-10-14T18:46:26.805865+0000","last_clean":"2023-10-14T18:46:26.805865+0000","last_became_active":"2023-10-14T18:46:25.790141+0000","last_became_peered":"2023-10-14T18:46:25.790141+0000","last_unstale":"2023-10-14T18:46:26.805865+0000","last_undegraded":"2023-10-14T18:46:26.805865+0000","last_fullsized":"2023-10-14T18:46:26.805865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:39.855271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800393+0000","last_change":"2023-10-14T18:46:26.800337+0000","last_active":"2023-10-14T18:46:26.800393+0000","last_peered":"2023-10-14T18:46:26.800393+0000","last_clean":"2023-10-14T18:46:26.800393+0000","last_became_active":"2023-10-14T18:46:26.799899+0000","last_became_peered":"2023-10-14T18:46:26.799899+0000","last_unstale":"2023-10-14T18:46:26.800393+0000","last_undegraded":"2023-10-14T18:46:26.800393+0000","last_fullsized":"2023-10-14T18:46:26.800393+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:19.372044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804732+0000","last_change":"2023-10-14T18:46:25.796816+0000","last_active":"2023-10-14T18:46:26.804732+0000","last_peered":"2023-10-14T18:46:26.804732+0000","last_clean":"2023-10-14T18:46:26.804732+0000","last_became_active":"2023-10-14T18:46:25.796586+0000","last_became_peered":"2023-10-14T18:46:25.796586+0000","last_unstale":"2023-10-14T18:46:26.804732+0000","last_undegraded":"2023-10-14T18:46:26.804732+0000","last_fullsized":"2023-10-14T18:46:26.804732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:18.365879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793074+0000","last_change":"2023-10-14T18:46:26.792145+0000","last_active":"2023-10-14T18:46:26.793074+0000","last_peered":"2023-10-14T18:46:26.793074+0000","last_clean":"2023-10-14T18:46:26.793074+0000","last_became_active":"2023-10-14T18:46:26.791891+0000","last_became_peered":"2023-10-14T18:46:26.791891+0000","last_unstale":"2023-10-14T18:46:26.793074+0000","last_undegraded":"2023-10-14T18:46:26.793074+0000","last_fullsized":"2023-10-14T18:46:26.793074+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:52.652114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804506+0000","last_change":"2023-10-14T18:46:25.799005+0000","last_active":"2023-10-14T18:46:26.804506+0000","last_peered":"2023-10-14T18:46:26.804506+0000","last_clean":"2023-10-14T18:46:26.804506+0000","last_became_active":"2023-10-14T18:46:25.798035+0000","last_became_peered":"2023-10-14T18:46:25.798035+0000","last_unstale":"2023-10-14T18:46:26.804506+0000","last_undegraded":"2023-10-14T18:46:26.804506+0000","last_fullsized":"2023-10-14T18:46:26.804506+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796924+0000","last_change":"2023-10-14T18:46:26.796856+0000","last_active":"2023-10-14T18:46:26.796924+0000","last_peered":"2023-10-14T18:46:26.796924+0000","last_clean":"2023-10-14T18:46:26.796924+0000","last_became_active":"2023-10-14T18:46:26.795259+0000","last_became_peered":"2023-10-14T18:46:26.795259+0000","last_unstale":"2023-10-14T18:46:26.796924+0000","last_undegraded":"2023-10-14T18:46:26.796924+0000","last_fullsized":"2023-10-14T18:46:26.796924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790158+0000","last_change":"2023-10-14T18:46:25.790058+0000","last_active":"2023-10-14T18:46:26.790158+0000","last_peered":"2023-10-14T18:46:26.790158+0000","last_clean":"2023-10-14T18:46:26.790158+0000","last_became_active":"2023-10-14T18:46:25.789801+0000","last_became_peered":"2023-10-14T18:46:25.789801+0000","last_unstale":"2023-10-14T18:46:26.790158+0000","last_undegraded":"2023-10-14T18:46:26.790158+0000","last_fullsized":"2023-10-14T18:46:26.790158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:50.057190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801606+0000","last_change":"2023-10-14T18:46:26.801457+0000","last_active":"2023-10-14T18:46:26.801606+0000","last_peered":"2023-10-14T18:46:26.801606+0000","last_clean":"2023-10-14T18:46:26.801606+0000","last_became_active":"2023-10-14T18:46:26.800944+0000","last_became_peered":"2023-10-14T18:46:26.800944+0000","last_unstale":"2023-10-14T18:46:26.801606+0000","last_undegraded":"2023-10-14T18:46:26.801606+0000","last_fullsized":"2023-10-14T18:46:26.801606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.786320+0000","last_change":"2023-10-14T18:46:25.793310+0000","last_active":"2023-10-14T18:46:26.786320+0000","last_peered":"2023-10-14T18:46:26.786320+0000","last_clean":"2023-10-14T18:46:26.786320+0000","last_became_active":"2023-10-14T18:46:25.791432+0000","last_became_peered":"2023-10-14T18:46:25.791432+0000","last_unstale":"2023-10-14T18:46:26.786320+0000","last_undegraded":"2023-10-14T18:46:26.786320+0000","last_fullsized":"2023-10-14T18:46:26.786320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:02.491654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798705+0000","last_change":"2023-10-14T18:46:26.798057+0000","last_active":"2023-10-14T18:46:26.798705+0000","last_peered":"2023-10-14T18:46:26.798705+0000","last_clean":"2023-10-14T18:46:26.798705+0000","last_became_active":"2023-10-14T18:46:26.797809+0000","last_became_peered":"2023-10-14T18:46:26.797809+0000","last_unstale":"2023-10-14T18:46:26.798705+0000","last_undegraded":"2023-10-14T18:46:26.798705+0000","last_fullsized":"2023-10-14T18:46:26.798705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792169+0000","last_change":"2023-10-14T18:46:25.795441+0000","last_active":"2023-10-14T18:46:26.792169+0000","last_peered":"2023-10-14T18:46:26.792169+0000","last_clean":"2023-10-14T18:46:26.792169+0000","last_became_active":"2023-10-14T18:46:25.795186+0000","last_became_peered":"2023-10-14T18:46:25.795186+0000","last_unstale":"2023-10-14T18:46:26.792169+0000","last_undegraded":"2023-10-14T18:46:26.792169+0000","last_fullsized":"2023-10-14T18:46:26.792169+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:02.491654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796956+0000","last_change":"2023-10-14T18:46:26.796680+0000","last_active":"2023-10-14T18:46:26.796956+0000","last_peered":"2023-10-14T18:46:26.796956+0000","last_clean":"2023-10-14T18:46:26.796956+0000","last_became_active":"2023-10-14T18:46:26.796298+0000","last_became_peered":"2023-10-14T18:46:26.796298+0000","last_unstale":"2023-10-14T18:46:26.796956+0000","last_undegraded":"2023-10-14T18:46:26.796956+0000","last_fullsized":"2023-10-14T18:46:26.796956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.785805+0000","last_change":"2023-10-14T18:46:25.789409+0000","last_active":"2023-10-14T18:46:26.785805+0000","last_peered":"2023-10-14T18:46:26.785805+0000","last_clean":"2023-10-14T18:46:26.785805+0000","last_became_active":"2023-10-14T18:46:25.789185+0000","last_became_peered":"2023-10-14T18:46:25.789185+0000","last_unstale":"2023-10-14T18:46:26.785805+0000","last_undegraded":"2023-10-14T18:46:26.785805+0000","last_fullsized":"2023-10-14T18:46:26.785805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793491+0000","last_change":"2023-10-14T18:46:26.793152+0000","last_active":"2023-10-14T18:46:26.793491+0000","last_peered":"2023-10-14T18:46:26.793491+0000","last_clean":"2023-10-14T18:46:26.793491+0000","last_became_active":"2023-10-14T18:46:26.792406+0000","last_became_peered":"2023-10-14T18:46:26.792406+0000","last_unstale":"2023-10-14T18:46:26.793491+0000","last_undegraded":"2023-10-14T18:46:26.793491+0000","last_fullsized":"2023-10-14T18:46:26.793491+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:24.639752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806326+0000","last_change":"2023-10-14T18:46:25.792117+0000","last_active":"2023-10-14T18:46:26.806326+0000","last_peered":"2023-10-14T18:46:26.806326+0000","last_clean":"2023-10-14T18:46:26.806326+0000","last_became_active":"2023-10-14T18:46:25.791852+0000","last_became_peered":"2023-10-14T18:46:25.791852+0000","last_unstale":"2023-10-14T18:46:26.806326+0000","last_undegraded":"2023-10-14T18:46:26.806326+0000","last_fullsized":"2023-10-14T18:46:26.806326+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:19.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.791999+0000","last_change":"2023-10-14T18:46:26.791857+0000","last_active":"2023-10-14T18:46:26.791999+0000","last_peered":"2023-10-14T18:46:26.791999+0000","last_clean":"2023-10-14T18:46:26.791999+0000","last_became_active":"2023-10-14T18:46:26.791639+0000","last_became_peered":"2023-10-14T18:46:26.791639+0000","last_unstale":"2023-10-14T18:46:26.791999+0000","last_undegraded":"2023-10-14T18:46:26.791999+0000","last_fullsized":"2023-10-14T18:46:26.791999+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:07.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.808362+0000","last_change":"2023-10-14T18:46:25.795744+0000","last_active":"2023-10-14T18:46:26.808362+0000","last_peered":"2023-10-14T18:46:26.808362+0000","last_clean":"2023-10-14T18:46:26.808362+0000","last_became_active":"2023-10-14T18:46:25.795532+0000","last_became_peered":"2023-10-14T18:46:25.795532+0000","last_unstale":"2023-10-14T18:46:26.808362+0000","last_undegraded":"2023-10-14T18:46:26.808362+0000","last_fullsized":"2023-10-14T18:46:26.808362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:29.796478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795540+0000","last_change":"2023-10-14T18:46:26.794707+0000","last_active":"2023-10-14T18:46:26.795540+0000","last_peered":"2023-10-14T18:46:26.795540+0000","last_clean":"2023-10-14T18:46:26.795540+0000","last_became_active":"2023-10-14T18:46:26.794157+0000","last_became_peered":"2023-10-14T18:46:26.794157+0000","last_unstale":"2023-10-14T18:46:26.795540+0000","last_undegraded":"2023-10-14T18:46:26.795540+0000","last_fullsized":"2023-10-14T18:46:26.795540+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:03.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805362+0000","last_change":"2023-10-14T18:46:25.795174+0000","last_active":"2023-10-14T18:46:26.805362+0000","last_peered":"2023-10-14T18:46:26.805362+0000","last_clean":"2023-10-14T18:46:26.805362+0000","last_became_active":"2023-10-14T18:46:25.794925+0000","last_became_peered":"2023-10-14T18:46:25.794925+0000","last_unstale":"2023-10-14T18:46:26.805362+0000","last_undegraded":"2023-10-14T18:46:26.805362+0000","last_fullsized":"2023-10-14T18:46:26.805362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792129+0000","last_change":"2023-10-14T18:46:26.789392+0000","last_active":"2023-10-14T18:46:26.792129+0000","last_peered":"2023-10-14T18:46:26.792129+0000","last_clean":"2023-10-14T18:46:26.792129+0000","last_became_active":"2023-10-14T18:46:26.789186+0000","last_became_peered":"2023-10-14T18:46:26.789186+0000","last_unstale":"2023-10-14T18:46:26.792129+0000","last_undegraded":"2023-10-14T18:46:26.792129+0000","last_fullsized":"2023-10-14T18:46:26.792129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:14.698760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787986+0000","last_change":"2023-10-14T18:46:25.791806+0000","last_active":"2023-10-14T18:46:26.787986+0000","last_peered":"2023-10-14T18:46:26.787986+0000","last_clean":"2023-10-14T18:46:26.787986+0000","last_became_active":"2023-10-14T18:46:25.791196+0000","last_became_peered":"2023-10-14T18:46:25.791196+0000","last_unstale":"2023-10-14T18:46:26.787986+0000","last_undegraded":"2023-10-14T18:46:26.787986+0000","last_fullsized":"2023-10-14T18:46:26.787986+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:42.027762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793001+0000","last_change":"2023-10-14T18:46:26.792814+0000","last_active":"2023-10-14T18:46:26.793001+0000","last_peered":"2023-10-14T18:46:26.793001+0000","last_clean":"2023-10-14T18:46:26.793001+0000","last_became_active":"2023-10-14T18:46:26.792591+0000","last_became_peered":"2023-10-14T18:46:26.792591+0000","last_unstale":"2023-10-14T18:46:26.793001+0000","last_undegraded":"2023-10-14T18:46:26.793001+0000","last_fullsized":"2023-10-14T18:46:26.793001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:23.172836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.789842+0000","last_change":"2023-10-14T18:46:25.794744+0000","last_active":"2023-10-14T18:46:26.789842+0000","last_peered":"2023-10-14T18:46:26.789842+0000","last_clean":"2023-10-14T18:46:26.789842+0000","last_became_active":"2023-10-14T18:46:25.794514+0000","last_became_peered":"2023-10-14T18:46:25.794514+0000","last_unstale":"2023-10-14T18:46:26.789842+0000","last_undegraded":"2023-10-14T18:46:26.789842+0000","last_fullsized":"2023-10-14T18:46:26.789842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:42.027762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796080+0000","last_change":"2023-10-14T18:46:26.796017+0000","last_active":"2023-10-14T18:46:26.796080+0000","last_peered":"2023-10-14T18:46:26.796080+0000","last_clean":"2023-10-14T18:46:26.796080+0000","last_became_active":"2023-10-14T18:46:26.795793+0000","last_became_peered":"2023-10-14T18:46:26.795793+0000","last_unstale":"2023-10-14T18:46:26.796080+0000","last_undegraded":"2023-10-14T18:46:26.796080+0000","last_fullsized":"2023-10-14T18:46:26.796080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.809165+0000","last_change":"2023-10-14T18:46:25.789907+0000","last_active":"2023-10-14T18:46:26.809165+0000","last_peered":"2023-10-14T18:46:26.809165+0000","last_clean":"2023-10-14T18:46:26.809165+0000","last_became_active":"2023-10-14T18:46:25.789682+0000","last_became_peered":"2023-10-14T18:46:25.789682+0000","last_unstale":"2023-10-14T18:46:26.809165+0000","last_undegraded":"2023-10-14T18:46:26.809165+0000","last_fullsized":"2023-10-14T18:46:26.809165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795208+0000","last_change":"2023-10-14T18:46:26.795150+0000","last_active":"2023-10-14T18:46:26.795208+0000","last_peered":"2023-10-14T18:46:26.795208+0000","last_clean":"2023-10-14T18:46:26.795208+0000","last_became_active":"2023-10-14T18:46:26.794935+0000","last_became_peered":"2023-10-14T18:46:26.794935+0000","last_unstale":"2023-10-14T18:46:26.795208+0000","last_undegraded":"2023-10-14T18:46:26.795208+0000","last_fullsized":"2023-10-14T18:46:26.795208+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:25.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.807023+0000","last_change":"2023-10-14T18:46:25.792733+0000","last_active":"2023-10-14T18:46:26.807023+0000","last_peered":"2023-10-14T18:46:26.807023+0000","last_clean":"2023-10-14T18:46:26.807023+0000","last_became_active":"2023-10-14T18:46:25.792570+0000","last_became_peered":"2023-10-14T18:46:25.792570+0000","last_unstale":"2023-10-14T18:46:26.807023+0000","last_undegraded":"2023-10-14T18:46:26.807023+0000","last_fullsized":"2023-10-14T18:46:26.807023+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:50.360855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792151+0000","last_change":"2023-10-14T18:46:26.791467+0000","last_active":"2023-10-14T18:46:26.792151+0000","last_peered":"2023-10-14T18:46:26.792151+0000","last_clean":"2023-10-14T18:46:26.792151+0000","last_became_active":"2023-10-14T18:46:26.791251+0000","last_became_peered":"2023-10-14T18:46:26.791251+0000","last_unstale":"2023-10-14T18:46:26.792151+0000","last_undegraded":"2023-10-14T18:46:26.792151+0000","last_fullsized":"2023-10-14T18:46:26.792151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804844+0000","last_change":"2023-10-14T18:46:25.798816+0000","last_active":"2023-10-14T18:46:26.804844+0000","last_peered":"2023-10-14T18:46:26.804844+0000","last_clean":"2023-10-14T18:46:26.804844+0000","last_became_active":"2023-10-14T18:46:25.798587+0000","last_became_peered":"2023-10-14T18:46:25.798587+0000","last_unstale":"2023-10-14T18:46:26.804844+0000","last_undegraded":"2023-10-14T18:46:26.804844+0000","last_fullsized":"2023-10-14T18:46:26.804844+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.648806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799154+0000","last_change":"2023-10-14T18:46:26.799099+0000","last_active":"2023-10-14T18:46:26.799154+0000","last_peered":"2023-10-14T18:46:26.799154+0000","last_clean":"2023-10-14T18:46:26.799154+0000","last_became_active":"2023-10-14T18:46:26.798382+0000","last_became_peered":"2023-10-14T18:46:26.798382+0000","last_unstale":"2023-10-14T18:46:26.799154+0000","last_undegraded":"2023-10-14T18:46:26.799154+0000","last_fullsized":"2023-10-14T18:46:26.799154+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:45.533544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803967+0000","last_change":"2023-10-14T18:46:25.791300+0000","last_active":"2023-10-14T18:46:26.803967+0000","last_peered":"2023-10-14T18:46:26.803967+0000","last_clean":"2023-10-14T18:46:26.803967+0000","last_became_active":"2023-10-14T18:46:25.791051+0000","last_became_peered":"2023-10-14T18:46:25.791051+0000","last_unstale":"2023-10-14T18:46:26.803967+0000","last_undegraded":"2023-10-14T18:46:26.803967+0000","last_fullsized":"2023-10-14T18:46:26.803967+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:19.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798837+0000","last_change":"2023-10-14T18:46:26.798736+0000","last_active":"2023-10-14T18:46:26.798837+0000","last_peered":"2023-10-14T18:46:26.798837+0000","last_clean":"2023-10-14T18:46:26.798837+0000","last_became_active":"2023-10-14T18:46:26.798459+0000","last_became_peered":"2023-10-14T18:46:26.798459+0000","last_unstale":"2023-10-14T18:46:26.798837+0000","last_undegraded":"2023-10-14T18:46:26.798837+0000","last_fullsized":"2023-10-14T18:46:26.798837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:26.686691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.789930+0000","last_change":"2023-10-14T18:46:25.793545+0000","last_active":"2023-10-14T18:46:26.789930+0000","last_peered":"2023-10-14T18:46:26.789930+0000","last_clean":"2023-10-14T18:46:26.789930+0000","last_became_active":"2023-10-14T18:46:25.793322+0000","last_became_peered":"2023-10-14T18:46:25.793322+0000","last_unstale":"2023-10-14T18:46:26.789930+0000","last_undegraded":"2023-10-14T18:46:26.789930+0000","last_fullsized":"2023-10-14T18:46:26.789930+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:39.855271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793133+0000","last_change":"2023-10-14T18:46:26.793022+0000","last_active":"2023-10-14T18:46:26.793133+0000","last_peered":"2023-10-14T18:46:26.793133+0000","last_clean":"2023-10-14T18:46:26.793133+0000","last_became_active":"2023-10-14T18:46:26.792068+0000","last_became_peered":"2023-10-14T18:46:26.792068+0000","last_unstale":"2023-10-14T18:46:26.793133+0000","last_undegraded":"2023-10-14T18:46:26.793133+0000","last_fullsized":"2023-10-14T18:46:26.793133+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:45.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806035+0000","last_change":"2023-10-14T18:46:25.798610+0000","last_active":"2023-10-14T18:46:26.806035+0000","last_peered":"2023-10-14T18:46:26.806035+0000","last_clean":"2023-10-14T18:46:26.806035+0000","last_became_active":"2023-10-14T18:46:25.798427+0000","last_became_peered":"2023-10-14T18:46:25.798427+0000","last_unstale":"2023-10-14T18:46:26.806035+0000","last_undegraded":"2023-10-14T18:46:26.806035+0000","last_fullsized":"2023-10-14T18:46:26.806035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:44.583075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795170+0000","last_change":"2023-10-14T18:46:26.795108+0000","last_active":"2023-10-14T18:46:26.795170+0000","last_peered":"2023-10-14T18:46:26.795170+0000","last_clean":"2023-10-14T18:46:26.795170+0000","last_became_active":"2023-10-14T18:46:26.794886+0000","last_became_peered":"2023-10-14T18:46:26.794886+0000","last_unstale":"2023-10-14T18:46:26.795170+0000","last_undegraded":"2023-10-14T18:46:26.795170+0000","last_fullsized":"2023-10-14T18:46:26.795170+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:05.413309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790261+0000","last_change":"2023-10-14T18:46:25.791819+0000","last_active":"2023-10-14T18:46:26.790261+0000","last_peered":"2023-10-14T18:46:26.790261+0000","last_clean":"2023-10-14T18:46:26.790261+0000","last_became_active":"2023-10-14T18:46:25.791561+0000","last_became_peered":"2023-10-14T18:46:25.791561+0000","last_unstale":"2023-10-14T18:46:26.790261+0000","last_undegraded":"2023-10-14T18:46:26.790261+0000","last_fullsized":"2023-10-14T18:46:26.790261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.645949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799311+0000","last_change":"2023-10-14T18:46:26.799088+0000","last_active":"2023-10-14T18:46:26.799311+0000","last_peered":"2023-10-14T18:46:26.799311+0000","last_clean":"2023-10-14T18:46:26.799311+0000","last_became_active":"2023-10-14T18:46:26.798395+0000","last_became_peered":"2023-10-14T18:46:26.798395+0000","last_unstale":"2023-10-14T18:46:26.799311+0000","last_undegraded":"2023-10-14T18:46:26.799311+0000","last_fullsized":"2023-10-14T18:46:26.799311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:32.612572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.786235+0000","last_change":"2023-10-14T18:46:25.793461+0000","last_active":"2023-10-14T18:46:26.786235+0000","last_peered":"2023-10-14T18:46:26.786235+0000","last_clean":"2023-10-14T18:46:26.786235+0000","last_became_active":"2023-10-14T18:46:25.791761+0000","last_became_peered":"2023-10-14T18:46:25.791761+0000","last_unstale":"2023-10-14T18:46:26.786235+0000","last_undegraded":"2023-10-14T18:46:26.786235+0000","last_fullsized":"2023-10-14T18:46:26.786235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:00.924085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797250+0000","last_change":"2023-10-14T18:46:26.797199+0000","last_active":"2023-10-14T18:46:26.797250+0000","last_peered":"2023-10-14T18:46:26.797250+0000","last_clean":"2023-10-14T18:46:26.797250+0000","last_became_active":"2023-10-14T18:46:26.796324+0000","last_became_peered":"2023-10-14T18:46:26.796324+0000","last_unstale":"2023-10-14T18:46:26.797250+0000","last_undegraded":"2023-10-14T18:46:26.797250+0000","last_fullsized":"2023-10-14T18:46:26.797250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:15.177872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.788106+0000","last_change":"2023-10-14T18:46:25.792475+0000","last_active":"2023-10-14T18:46:26.788106+0000","last_peered":"2023-10-14T18:46:26.788106+0000","last_clean":"2023-10-14T18:46:26.788106+0000","last_became_active":"2023-10-14T18:46:25.792051+0000","last_became_peered":"2023-10-14T18:46:25.792051+0000","last_unstale":"2023-10-14T18:46:26.788106+0000","last_undegraded":"2023-10-14T18:46:26.788106+0000","last_fullsized":"2023-10-14T18:46:26.788106+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:44.583075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799355+0000","last_change":"2023-10-14T18:46:26.799246+0000","last_active":"2023-10-14T18:46:26.799355+0000","last_peered":"2023-10-14T18:46:26.799355+0000","last_clean":"2023-10-14T18:46:26.799355+0000","last_became_active":"2023-10-14T18:46:26.798894+0000","last_became_peered":"2023-10-14T18:46:26.798894+0000","last_unstale":"2023-10-14T18:46:26.799355+0000","last_undegraded":"2023-10-14T18:46:26.799355+0000","last_fullsized":"2023-10-14T18:46:26.799355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:19.312608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790240+0000","last_change":"2023-10-14T18:46:25.797994+0000","last_active":"2023-10-14T18:46:26.790240+0000","last_peered":"2023-10-14T18:46:26.790240+0000","last_clean":"2023-10-14T18:46:26.790240+0000","last_became_active":"2023-10-14T18:46:25.797723+0000","last_became_peered":"2023-10-14T18:46:25.797723+0000","last_unstale":"2023-10-14T18:46:26.790240+0000","last_undegraded":"2023-10-14T18:46:26.790240+0000","last_fullsized":"2023-10-14T18:46:26.790240+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:35.404621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797378+0000","last_change":"2023-10-14T18:46:26.797327+0000","last_active":"2023-10-14T18:46:26.797378+0000","last_peered":"2023-10-14T18:46:26.797378+0000","last_clean":"2023-10-14T18:46:26.797378+0000","last_became_active":"2023-10-14T18:46:26.796614+0000","last_became_peered":"2023-10-14T18:46:26.796614+0000","last_unstale":"2023-10-14T18:46:26.797378+0000","last_undegraded":"2023-10-14T18:46:26.797378+0000","last_fullsized":"2023-10-14T18:46:26.797378+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:07.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787899+0000","last_change":"2023-10-14T18:46:25.792636+0000","last_active":"2023-10-14T18:46:26.787899+0000","last_peered":"2023-10-14T18:46:26.787899+0000","last_clean":"2023-10-14T18:46:26.787899+0000","last_became_active":"2023-10-14T18:46:25.792423+0000","last_became_peered":"2023-10-14T18:46:25.792423+0000","last_unstale":"2023-10-14T18:46:26.787899+0000","last_undegraded":"2023-10-14T18:46:26.787899+0000","last_fullsized":"2023-10-14T18:46:26.787899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.645949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793601+0000","last_change":"2023-10-14T18:46:26.793424+0000","last_active":"2023-10-14T18:46:26.793601+0000","last_peered":"2023-10-14T18:46:26.793601+0000","last_clean":"2023-10-14T18:46:26.793601+0000","last_became_active":"2023-10-14T18:46:26.793199+0000","last_became_peered":"2023-10-14T18:46:26.793199+0000","last_unstale":"2023-10-14T18:46:26.793601+0000","last_undegraded":"2023-10-14T18:46:26.793601+0000","last_fullsized":"2023-10-14T18:46:26.793601+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790409+0000","last_change":"2023-10-14T18:46:25.791375+0000","last_active":"2023-10-14T18:46:26.790409+0000","last_peered":"2023-10-14T18:46:26.790409+0000","last_clean":"2023-10-14T18:46:26.790409+0000","last_became_active":"2023-10-14T18:46:25.790846+0000","last_became_peered":"2023-10-14T18:46:25.790846+0000","last_unstale":"2023-10-14T18:46:26.790409+0000","last_undegraded":"2023-10-14T18:46:26.790409+0000","last_fullsized":"2023-10-14T18:46:26.790409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:24.293831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795038+0000","last_change":"2023-10-14T18:46:26.794050+0000","last_active":"2023-10-14T18:46:26.795038+0000","last_peered":"2023-10-14T18:46:26.795038+0000","last_clean":"2023-10-14T18:46:26.795038+0000","last_became_active":"2023-10-14T18:46:26.793839+0000","last_became_peered":"2023-10-14T18:46:26.793839+0000","last_unstale":"2023-10-14T18:46:26.795038+0000","last_undegraded":"2023-10-14T18:46:26.795038+0000","last_fullsized":"2023-10-14T18:46:26.795038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.788410+0000","last_change":"2023-10-14T18:46:25.792306+0000","last_active":"2023-10-14T18:46:26.788410+0000","last_peered":"2023-10-14T18:46:26.788410+0000","last_clean":"2023-10-14T18:46:26.788410+0000","last_became_active":"2023-10-14T18:46:25.791534+0000","last_became_peered":"2023-10-14T18:46:25.791534+0000","last_unstale":"2023-10-14T18:46:26.788410+0000","last_undegraded":"2023-10-14T18:46:26.788410+0000","last_fullsized":"2023-10-14T18:46:26.788410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795068+0000","last_change":"2023-10-14T18:46:26.794984+0000","last_active":"2023-10-14T18:46:26.795068+0000","last_peered":"2023-10-14T18:46:26.795068+0000","last_clean":"2023-10-14T18:46:26.795068+0000","last_became_active":"2023-10-14T18:46:26.794597+0000","last_became_peered":"2023-10-14T18:46:26.794597+0000","last_unstale":"2023-10-14T18:46:26.795068+0000","last_undegraded":"2023-10-14T18:46:26.795068+0000","last_fullsized":"2023-10-14T18:46:26.795068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:14.698760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793669+0000","last_change":"2023-10-14T18:46:25.796984+0000","last_active":"2023-10-14T18:46:26.793669+0000","last_peered":"2023-10-14T18:46:26.793669+0000","last_clean":"2023-10-14T18:46:26.793669+0000","last_became_active":"2023-10-14T18:46:25.793999+0000","last_became_peered":"2023-10-14T18:46:25.793999+0000","last_unstale":"2023-10-14T18:46:26.793669+0000","last_undegraded":"2023-10-14T18:46:26.793669+0000","last_fullsized":"2023-10-14T18:46:26.793669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793573+0000","last_change":"2023-10-14T18:46:26.793364+0000","last_active":"2023-10-14T18:46:26.793573+0000","last_peered":"2023-10-14T18:46:26.793573+0000","last_clean":"2023-10-14T18:46:26.793573+0000","last_became_active":"2023-10-14T18:46:26.793107+0000","last_became_peered":"2023-10-14T18:46:26.793107+0000","last_unstale":"2023-10-14T18:46:26.793573+0000","last_undegraded":"2023-10-14T18:46:26.793573+0000","last_fullsized":"2023-10-14T18:46:26.793573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:19.372044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790258+0000","last_change":"2023-10-14T18:46:25.789068+0000","last_active":"2023-10-14T18:46:26.790258+0000","last_peered":"2023-10-14T18:46:26.790258+0000","last_clean":"2023-10-14T18:46:26.790258+0000","last_became_active":"2023-10-14T18:46:25.788837+0000","last_became_peered":"2023-10-14T18:46:25.788837+0000","last_unstale":"2023-10-14T18:46:26.790258+0000","last_undegraded":"2023-10-14T18:46:26.790258+0000","last_fullsized":"2023-10-14T18:46:26.790258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800177+0000","last_change":"2023-10-14T18:46:26.800106+0000","last_active":"2023-10-14T18:46:26.800177+0000","last_peered":"2023-10-14T18:46:26.800177+0000","last_clean":"2023-10-14T18:46:26.800177+0000","last_became_active":"2023-10-14T18:46:26.799602+0000","last_became_peered":"2023-10-14T18:46:26.799602+0000","last_unstale":"2023-10-14T18:46:26.800177+0000","last_undegraded":"2023-10-14T18:46:26.800177+0000","last_fullsized":"2023-10-14T18:46:26.800177+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:57.717084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.785856+0000","last_change":"2023-10-14T18:46:25.793932+0000","last_active":"2023-10-14T18:46:26.785856+0000","last_peered":"2023-10-14T18:46:26.785856+0000","last_clean":"2023-10-14T18:46:26.785856+0000","last_became_active":"2023-10-14T18:46:25.793706+0000","last_became_peered":"2023-10-14T18:46:25.793706+0000","last_unstale":"2023-10-14T18:46:26.785856+0000","last_undegraded":"2023-10-14T18:46:26.785856+0000","last_fullsized":"2023-10-14T18:46:26.785856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.648806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792111+0000","last_change":"2023-10-14T18:46:26.789301+0000","last_active":"2023-10-14T18:46:26.792111+0000","last_peered":"2023-10-14T18:46:26.792111+0000","last_clean":"2023-10-14T18:46:26.792111+0000","last_became_active":"2023-10-14T18:46:26.789080+0000","last_became_peered":"2023-10-14T18:46:26.789080+0000","last_unstale":"2023-10-14T18:46:26.792111+0000","last_undegraded":"2023-10-14T18:46:26.792111+0000","last_fullsized":"2023-10-14T18:46:26.792111+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:46.039820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805829+0000","last_change":"2023-10-14T18:46:25.792529+0000","last_active":"2023-10-14T18:46:26.805829+0000","last_peered":"2023-10-14T18:46:26.805829+0000","last_clean":"2023-10-14T18:46:26.805829+0000","last_became_active":"2023-10-14T18:46:25.792315+0000","last_became_peered":"2023-10-14T18:46:25.792315+0000","last_unstale":"2023-10-14T18:46:26.805829+0000","last_undegraded":"2023-10-14T18:46:26.805829+0000","last_fullsized":"2023-10-14T18:46:26.805829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787998+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:46:26.787998+0000","last_peered":"2023-10-14T18:46:26.787998+0000","last_clean":"2023-10-14T18:46:26.787998+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:46:26.787998+0000","last_undegraded":"2023-10-14T18:46:26.787998+0000","last_fullsized":"2023-10-14T18:46:26.787998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.8129999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":9.5779999999999994,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52700000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.37},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.217},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":10.574,"5min":10.574,"15min":10.574},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.24299999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.28999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.27400000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.62},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.23300000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.314}]},{"osd":4,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41399999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.498}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.315}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.436}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.37},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]}]}],"pool_statfs":[]}} 2023-10-14T18:46:30.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:46:30.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.995+0000 7fe9bf351700 1 Processor -- start 2023-10-14T18:46:30.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.995+0000 7fe9bf351700 1 -- start start 2023-10-14T18:46:30.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b8157870 0x7fe9b815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9b815a620 0x7fe9b815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:30.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 0x7fe9b8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b815cbb0 con 0x7fe9b8157870 2023-10-14T18:46:31.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b815bfa0 con 0x7fe9b815a620 2023-10-14T18:46:31.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bf351700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b815c280 con 0x7fe9b815d580 2023-10-14T18:46:31.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b8157870 0x7fe9b815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9b8157870 0x7fe9b815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37898/0 (socket says 172.21.15.79:37898) 2023-10-14T18:46:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/2666151440 learned_addr learned my addr 172.21.15.79:0/2666151440 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bc8ec700 1 --2- 172.21.15.79:0/2666151440 >> v2:172.21.15.144:3300/0 conn(0x7fe9b815a620 0x7fe9b815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd8ee700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 0x7fe9b8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/2666151440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 msgr2=0x7fe9b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 0x7fe9b8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/2666151440 >> v2:172.21.15.144:3300/0 conn(0x7fe9b815a620 msgr2=0x7fe9b815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/2666151440 >> v2:172.21.15.144:3300/0 conn(0x7fe9b815a620 0x7fe9b815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/2666151440 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b815c560 con 0x7fe9b8157870 2023-10-14T18:46:31.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd8ee700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 0x7fe9b8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:31.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b815b6a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9b815cb20 tx=0x7fe9b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f977f2357da135fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9affff700 1 -- 172.21.15.79:0/2666151440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400b860 con 0x7fe9b8157870 2023-10-14T18:46:31.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9affff700 1 -- 172.21.15.79:0/2666151440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b400b9c0 con 0x7fe9b8157870 2023-10-14T18:46:31.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.996+0000 7fe9affff700 1 -- 172.21.15.79:0/2666151440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400bd60 con 0x7fe9b8157870 2023-10-14T18:46:31.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 -- 172.21.15.79:0/2666151440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 msgr2=0x7fe9b815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b815b6a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9b815cb20 tx=0x7fe9b4009250 comp rx=0 tx=0).stop 2023-10-14T18:46:31.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 -- 172.21.15.79:0/2666151440 shutdown_connections 2023-10-14T18:46:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815d580 0x7fe9b8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 --2- 172.21.15.79:0/2666151440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b815b6a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 --2- 172.21.15.79:0/2666151440 >> v2:172.21.15.144:3300/0 conn(0x7fe9b815a620 0x7fe9b815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 -- 172.21.15.79:0/2666151440 >> 172.21.15.79:0/2666151440 conn(0x7fe9b8068ce0 msgr2=0x7fe9b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 -- 172.21.15.79:0/2666151440 shutdown_connections 2023-10-14T18:46:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.997+0000 7fe9bf351700 1 -- 172.21.15.79:0/2666151440 wait complete. 2023-10-14T18:46:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.998+0000 7fe9bf351700 1 Processor -- start 2023-10-14T18:46:31.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.998+0000 7fe9bf351700 1 -- start start 2023-10-14T18:46:31.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815a620 0x7fe9b80b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9b815d580 0x7fe9b80d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80b27d0 con 0x7fe9b8157870 2023-10-14T18:46:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80b1bc0 con 0x7fe9b815d580 2023-10-14T18:46:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bf351700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80b1ea0 con 0x7fe9b815a620 2023-10-14T18:46:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37900/0 (socket says 172.21.15.79:37900) 2023-10-14T18:46:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/3907412031 learned_addr learned my addr 172.21.15.79:0/3907412031 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bc8ec700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815a620 0x7fe9b80b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd8ee700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9b815d580 0x7fe9b80d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815a620 msgr2=0x7fe9b80b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815a620 0x7fe9b80b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9b815d580 msgr2=0x7fe9b80d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9b815d580 0x7fe9b80d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 -- 172.21.15.79:0/3907412031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b40094f0 con 0x7fe9b8157870 2023-10-14T18:46:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:30.999+0000 7fe9bd0ed700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe9b806b530 tx=0x7fe9b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4011dc0 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b4024440 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4024800 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80b2180 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b80d10c0 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.000+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b804c3c0 con 0x7fe9b8157870 2023-10-14T18:46:31.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.001+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9b401a420 con 0x7fe9b8157870 2023-10-14T18:46:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.001+0000 7fe9ad7fa700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.001+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9b4086350 con 0x7fe9b8157870 2023-10-14T18:46:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.002+0000 7fe9bc8ec700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.002+0000 7fe9bc8ec700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 0x7fe99c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80b1120 tx=0x7fe9a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.006+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9b40535c0 con 0x7fe9b8157870 2023-10-14T18:46:31.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.184+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9b80b2910 con 0x7fe99c066f30 2023-10-14T18:46:31.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.192+0000 7fe9ad7fa700 1 -- 172.21.15.79:0/3907412031 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285150 (secure 0 0 0) 0x7fe9a8010870 con 0x7fe99c066f30 2023-10-14T18:46:31.196 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.195+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 msgr2=0x7fe99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.195+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 0x7fe99c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80b1120 tx=0x7fe9a8008040 comp rx=0 tx=0).stop 2023-10-14T18:46:31.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.195+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 msgr2=0x7fe9b814ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.195+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe9b806b530 tx=0x7fe9b4017000 comp rx=0 tx=0).stop 2023-10-14T18:46:31.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 shutdown_connections 2023-10-14T18:46:31.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9b815d580 0x7fe9b80d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9b8157870 0x7fe9b814ced0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 --2- 172.21.15.79:0/3907412031 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9b815a620 0x7fe9b80b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 >> 172.21.15.79:0/3907412031 conn(0x7fe9b8068ce0 msgr2=0x7fe9b81591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 shutdown_connections 2023-10-14T18:46:31.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.196+0000 7fe9bf351700 1 -- 172.21.15.79:0/3907412031 wait complete. 2023-10-14T18:46:31.201 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:46:31.208 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-14T18:46:30.352255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559673,"statfs":{"total":1600000000,"available":1597105975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.572251"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796935+0000","last_change":"2023-10-14T18:46:26.796516+0000","last_active":"2023-10-14T18:46:26.796935+0000","last_peered":"2023-10-14T18:46:26.796935+0000","last_clean":"2023-10-14T18:46:26.796935+0000","last_became_active":"2023-10-14T18:46:26.795391+0000","last_became_peered":"2023-10-14T18:46:26.795391+0000","last_unstale":"2023-10-14T18:46:26.796935+0000","last_undegraded":"2023-10-14T18:46:26.796935+0000","last_fullsized":"2023-10-14T18:46:26.796935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:15.177872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797333+0000","last_change":"2023-10-14T18:46:26.797075+0000","last_active":"2023-10-14T18:46:26.797333+0000","last_peered":"2023-10-14T18:46:26.797333+0000","last_clean":"2023-10-14T18:46:26.797333+0000","last_became_active":"2023-10-14T18:46:26.796846+0000","last_became_peered":"2023-10-14T18:46:26.796846+0000","last_unstale":"2023-10-14T18:46:26.797333+0000","last_undegraded":"2023-10-14T18:46:26.797333+0000","last_fullsized":"2023-10-14T18:46:26.797333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:14.096887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801570+0000","last_change":"2023-10-14T18:46:26.801489+0000","last_active":"2023-10-14T18:46:26.801570+0000","last_peered":"2023-10-14T18:46:26.801570+0000","last_clean":"2023-10-14T18:46:26.801570+0000","last_became_active":"2023-10-14T18:46:26.800884+0000","last_became_peered":"2023-10-14T18:46:26.800884+0000","last_unstale":"2023-10-14T18:46:26.801570+0000","last_undegraded":"2023-10-14T18:46:26.801570+0000","last_fullsized":"2023-10-14T18:46:26.801570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:45.589239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800678+0000","last_change":"2023-10-14T18:46:26.800613+0000","last_active":"2023-10-14T18:46:26.800678+0000","last_peered":"2023-10-14T18:46:26.800678+0000","last_clean":"2023-10-14T18:46:26.800678+0000","last_became_active":"2023-10-14T18:46:26.800408+0000","last_became_peered":"2023-10-14T18:46:26.800408+0000","last_unstale":"2023-10-14T18:46:26.800678+0000","last_undegraded":"2023-10-14T18:46:26.800678+0000","last_fullsized":"2023-10-14T18:46:26.800678+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:19.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799202+0000","last_change":"2023-10-14T18:46:26.798908+0000","last_active":"2023-10-14T18:46:26.799202+0000","last_peered":"2023-10-14T18:46:26.799202+0000","last_clean":"2023-10-14T18:46:26.799202+0000","last_became_active":"2023-10-14T18:46:26.798687+0000","last_became_peered":"2023-10-14T18:46:26.798687+0000","last_unstale":"2023-10-14T18:46:26.799202+0000","last_undegraded":"2023-10-14T18:46:26.799202+0000","last_fullsized":"2023-10-14T18:46:26.799202+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:19.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796540+0000","last_change":"2023-10-14T18:46:26.796455+0000","last_active":"2023-10-14T18:46:26.796540+0000","last_peered":"2023-10-14T18:46:26.796540+0000","last_clean":"2023-10-14T18:46:26.796540+0000","last_became_active":"2023-10-14T18:46:26.795939+0000","last_became_peered":"2023-10-14T18:46:26.795939+0000","last_unstale":"2023-10-14T18:46:26.796540+0000","last_undegraded":"2023-10-14T18:46:26.796540+0000","last_fullsized":"2023-10-14T18:46:26.796540+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:44.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.791584+0000","last_change":"2023-10-14T18:46:26.791519+0000","last_active":"2023-10-14T18:46:26.791584+0000","last_peered":"2023-10-14T18:46:26.791584+0000","last_clean":"2023-10-14T18:46:26.791584+0000","last_became_active":"2023-10-14T18:46:26.791291+0000","last_became_peered":"2023-10-14T18:46:26.791291+0000","last_unstale":"2023-10-14T18:46:26.791584+0000","last_undegraded":"2023-10-14T18:46:26.791584+0000","last_fullsized":"2023-10-14T18:46:26.791584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:39.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795715+0000","last_change":"2023-10-14T18:46:26.795505+0000","last_active":"2023-10-14T18:46:26.795715+0000","last_peered":"2023-10-14T18:46:26.795715+0000","last_clean":"2023-10-14T18:46:26.795715+0000","last_became_active":"2023-10-14T18:46:26.795312+0000","last_became_peered":"2023-10-14T18:46:26.795312+0000","last_unstale":"2023-10-14T18:46:26.795715+0000","last_undegraded":"2023-10-14T18:46:26.795715+0000","last_fullsized":"2023-10-14T18:46:26.795715+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:45.589239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793446+0000","last_change":"2023-10-14T18:46:26.793377+0000","last_active":"2023-10-14T18:46:26.793446+0000","last_peered":"2023-10-14T18:46:26.793446+0000","last_clean":"2023-10-14T18:46:26.793446+0000","last_became_active":"2023-10-14T18:46:26.793035+0000","last_became_peered":"2023-10-14T18:46:26.793035+0000","last_unstale":"2023-10-14T18:46:26.793446+0000","last_undegraded":"2023-10-14T18:46:26.793446+0000","last_fullsized":"2023-10-14T18:46:26.793446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:25.961638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797072+0000","last_change":"2023-10-14T18:46:26.797020+0000","last_active":"2023-10-14T18:46:26.797072+0000","last_peered":"2023-10-14T18:46:26.797072+0000","last_clean":"2023-10-14T18:46:26.797072+0000","last_became_active":"2023-10-14T18:46:26.795524+0000","last_became_peered":"2023-10-14T18:46:26.795524+0000","last_unstale":"2023-10-14T18:46:26.797072+0000","last_undegraded":"2023-10-14T18:46:26.797072+0000","last_fullsized":"2023-10-14T18:46:26.797072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793105+0000","last_change":"2023-10-14T18:46:26.792921+0000","last_active":"2023-10-14T18:46:26.793105+0000","last_peered":"2023-10-14T18:46:26.793105+0000","last_clean":"2023-10-14T18:46:26.793105+0000","last_became_active":"2023-10-14T18:46:26.792690+0000","last_became_peered":"2023-10-14T18:46:26.792690+0000","last_unstale":"2023-10-14T18:46:26.793105+0000","last_undegraded":"2023-10-14T18:46:26.793105+0000","last_fullsized":"2023-10-14T18:46:26.793105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794647+0000","last_change":"2023-10-14T18:46:26.794583+0000","last_active":"2023-10-14T18:46:26.794647+0000","last_peered":"2023-10-14T18:46:26.794647+0000","last_clean":"2023-10-14T18:46:26.794647+0000","last_became_active":"2023-10-14T18:46:26.794361+0000","last_became_peered":"2023-10-14T18:46:26.794361+0000","last_unstale":"2023-10-14T18:46:26.794647+0000","last_undegraded":"2023-10-14T18:46:26.794647+0000","last_fullsized":"2023-10-14T18:46:26.794647+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796993+0000","last_change":"2023-10-14T18:46:26.796608+0000","last_active":"2023-10-14T18:46:26.796993+0000","last_peered":"2023-10-14T18:46:26.796993+0000","last_clean":"2023-10-14T18:46:26.796993+0000","last_became_active":"2023-10-14T18:46:26.796074+0000","last_became_peered":"2023-10-14T18:46:26.796074+0000","last_unstale":"2023-10-14T18:46:26.796993+0000","last_undegraded":"2023-10-14T18:46:26.796993+0000","last_fullsized":"2023-10-14T18:46:26.796993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:19.657463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793430+0000","last_change":"2023-10-14T18:46:26.793245+0000","last_active":"2023-10-14T18:46:26.793430+0000","last_peered":"2023-10-14T18:46:26.793430+0000","last_clean":"2023-10-14T18:46:26.793430+0000","last_became_active":"2023-10-14T18:46:26.792738+0000","last_became_peered":"2023-10-14T18:46:26.792738+0000","last_unstale":"2023-10-14T18:46:26.793430+0000","last_undegraded":"2023-10-14T18:46:26.793430+0000","last_fullsized":"2023-10-14T18:46:26.793430+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793877+0000","last_change":"2023-10-14T18:46:26.793578+0000","last_active":"2023-10-14T18:46:26.793877+0000","last_peered":"2023-10-14T18:46:26.793877+0000","last_clean":"2023-10-14T18:46:26.793877+0000","last_became_active":"2023-10-14T18:46:26.793367+0000","last_became_peered":"2023-10-14T18:46:26.793367+0000","last_unstale":"2023-10-14T18:46:26.793877+0000","last_undegraded":"2023-10-14T18:46:26.793877+0000","last_fullsized":"2023-10-14T18:46:26.793877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:46.446898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795561+0000","last_change":"2023-10-14T18:46:26.794872+0000","last_active":"2023-10-14T18:46:26.795561+0000","last_peered":"2023-10-14T18:46:26.795561+0000","last_clean":"2023-10-14T18:46:26.795561+0000","last_became_active":"2023-10-14T18:46:26.794489+0000","last_became_peered":"2023-10-14T18:46:26.794489+0000","last_unstale":"2023-10-14T18:46:26.795561+0000","last_undegraded":"2023-10-14T18:46:26.795561+0000","last_fullsized":"2023-10-14T18:46:26.795561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:35.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794778+0000","last_change":"2023-10-14T18:46:26.794655+0000","last_active":"2023-10-14T18:46:26.794778+0000","last_peered":"2023-10-14T18:46:26.794778+0000","last_clean":"2023-10-14T18:46:26.794778+0000","last_became_active":"2023-10-14T18:46:26.794267+0000","last_became_peered":"2023-10-14T18:46:26.794267+0000","last_unstale":"2023-10-14T18:46:26.794778+0000","last_undegraded":"2023-10-14T18:46:26.794778+0000","last_fullsized":"2023-10-14T18:46:26.794778+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:40.861435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801156+0000","last_change":"2023-10-14T18:46:26.801089+0000","last_active":"2023-10-14T18:46:26.801156+0000","last_peered":"2023-10-14T18:46:26.801156+0000","last_clean":"2023-10-14T18:46:26.801156+0000","last_became_active":"2023-10-14T18:46:26.800520+0000","last_became_peered":"2023-10-14T18:46:26.800520+0000","last_unstale":"2023-10-14T18:46:26.801156+0000","last_undegraded":"2023-10-14T18:46:26.801156+0000","last_fullsized":"2023-10-14T18:46:26.801156+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:43.033926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803901+0000","last_change":"2023-10-14T18:46:26.803805+0000","last_active":"2023-10-14T18:46:26.803901+0000","last_peered":"2023-10-14T18:46:26.803901+0000","last_clean":"2023-10-14T18:46:26.803901+0000","last_became_active":"2023-10-14T18:46:26.803575+0000","last_became_peered":"2023-10-14T18:46:26.803575+0000","last_unstale":"2023-10-14T18:46:26.803901+0000","last_undegraded":"2023-10-14T18:46:26.803901+0000","last_fullsized":"2023-10-14T18:46:26.803901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:52.652114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798047+0000","last_change":"2023-10-14T18:46:26.797987+0000","last_active":"2023-10-14T18:46:26.798047+0000","last_peered":"2023-10-14T18:46:26.798047+0000","last_clean":"2023-10-14T18:46:26.798047+0000","last_became_active":"2023-10-14T18:46:26.797800+0000","last_became_peered":"2023-10-14T18:46:26.797800+0000","last_unstale":"2023-10-14T18:46:26.798047+0000","last_undegraded":"2023-10-14T18:46:26.798047+0000","last_fullsized":"2023-10-14T18:46:26.798047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:39:45.506770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796523+0000","last_change":"2023-10-14T18:46:26.796324+0000","last_active":"2023-10-14T18:46:26.796523+0000","last_peered":"2023-10-14T18:46:26.796523+0000","last_clean":"2023-10-14T18:46:26.796523+0000","last_became_active":"2023-10-14T18:46:26.795606+0000","last_became_peered":"2023-10-14T18:46:26.795606+0000","last_unstale":"2023-10-14T18:46:26.796523+0000","last_undegraded":"2023-10-14T18:46:26.796523+0000","last_fullsized":"2023-10-14T18:46:26.796523+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:43:23.375425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797017+0000","last_change":"2023-10-14T18:46:26.796945+0000","last_active":"2023-10-14T18:46:26.797017+0000","last_peered":"2023-10-14T18:46:26.797017+0000","last_clean":"2023-10-14T18:46:26.797017+0000","last_became_active":"2023-10-14T18:46:26.796629+0000","last_became_peered":"2023-10-14T18:46:26.796629+0000","last_unstale":"2023-10-14T18:46:26.797017+0000","last_undegraded":"2023-10-14T18:46:26.797017+0000","last_fullsized":"2023-10-14T18:46:26.797017+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798806+0000","last_change":"2023-10-14T18:46:26.797916+0000","last_active":"2023-10-14T18:46:26.798806+0000","last_peered":"2023-10-14T18:46:26.798806+0000","last_clean":"2023-10-14T18:46:26.798806+0000","last_became_active":"2023-10-14T18:46:26.797701+0000","last_became_peered":"2023-10-14T18:46:26.797701+0000","last_unstale":"2023-10-14T18:46:26.798806+0000","last_undegraded":"2023-10-14T18:46:26.798806+0000","last_fullsized":"2023-10-14T18:46:26.798806+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:40.861435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801967+0000","last_change":"2023-10-14T18:46:26.801893+0000","last_active":"2023-10-14T18:46:26.801967+0000","last_peered":"2023-10-14T18:46:26.801967+0000","last_clean":"2023-10-14T18:46:26.801967+0000","last_became_active":"2023-10-14T18:46:26.801226+0000","last_became_peered":"2023-10-14T18:46:26.801226+0000","last_unstale":"2023-10-14T18:46:26.801967+0000","last_undegraded":"2023-10-14T18:46:26.801967+0000","last_fullsized":"2023-10-14T18:46:26.801967+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799372+0000","last_change":"2023-10-14T18:46:26.799286+0000","last_active":"2023-10-14T18:46:26.799372+0000","last_peered":"2023-10-14T18:46:26.799372+0000","last_clean":"2023-10-14T18:46:26.799372+0000","last_became_active":"2023-10-14T18:46:26.799054+0000","last_became_peered":"2023-10-14T18:46:26.799054+0000","last_unstale":"2023-10-14T18:46:26.799372+0000","last_undegraded":"2023-10-14T18:46:26.799372+0000","last_fullsized":"2023-10-14T18:46:26.799372+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:46.347475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799328+0000","last_change":"2023-10-14T18:46:26.799225+0000","last_active":"2023-10-14T18:46:26.799328+0000","last_peered":"2023-10-14T18:46:26.799328+0000","last_clean":"2023-10-14T18:46:26.799328+0000","last_became_active":"2023-10-14T18:46:26.798686+0000","last_became_peered":"2023-10-14T18:46:26.798686+0000","last_unstale":"2023-10-14T18:46:26.799328+0000","last_undegraded":"2023-10-14T18:46:26.799328+0000","last_fullsized":"2023-10-14T18:46:26.799328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:27:56.631765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794573+0000","last_change":"2023-10-14T18:46:26.794506+0000","last_active":"2023-10-14T18:46:26.794573+0000","last_peered":"2023-10-14T18:46:26.794573+0000","last_clean":"2023-10-14T18:46:26.794573+0000","last_became_active":"2023-10-14T18:46:26.793955+0000","last_became_peered":"2023-10-14T18:46:26.793955+0000","last_unstale":"2023-10-14T18:46:26.794573+0000","last_undegraded":"2023-10-14T18:46:26.794573+0000","last_fullsized":"2023-10-14T18:46:26.794573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:03.902411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796088+0000","last_change":"2023-10-14T18:46:26.795467+0000","last_active":"2023-10-14T18:46:26.796088+0000","last_peered":"2023-10-14T18:46:26.796088+0000","last_clean":"2023-10-14T18:46:26.796088+0000","last_became_active":"2023-10-14T18:46:26.795201+0000","last_became_peered":"2023-10-14T18:46:26.795201+0000","last_unstale":"2023-10-14T18:46:26.796088+0000","last_undegraded":"2023-10-14T18:46:26.796088+0000","last_fullsized":"2023-10-14T18:46:26.796088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.802084+0000","last_change":"2023-10-14T18:46:26.802025+0000","last_active":"2023-10-14T18:46:26.802084+0000","last_peered":"2023-10-14T18:46:26.802084+0000","last_clean":"2023-10-14T18:46:26.802084+0000","last_became_active":"2023-10-14T18:46:26.801678+0000","last_became_peered":"2023-10-14T18:46:26.801678+0000","last_unstale":"2023-10-14T18:46:26.802084+0000","last_undegraded":"2023-10-14T18:46:26.802084+0000","last_fullsized":"2023-10-14T18:46:26.802084+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:20.637059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796470+0000","last_change":"2023-10-14T18:46:26.796151+0000","last_active":"2023-10-14T18:46:26.796470+0000","last_peered":"2023-10-14T18:46:26.796470+0000","last_clean":"2023-10-14T18:46:26.796470+0000","last_became_active":"2023-10-14T18:46:26.795928+0000","last_became_peered":"2023-10-14T18:46:26.795928+0000","last_unstale":"2023-10-14T18:46:26.796470+0000","last_undegraded":"2023-10-14T18:46:26.796470+0000","last_fullsized":"2023-10-14T18:46:26.796470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:36.410786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795053+0000","last_change":"2023-10-14T18:46:26.794828+0000","last_active":"2023-10-14T18:46:26.795053+0000","last_peered":"2023-10-14T18:46:26.795053+0000","last_clean":"2023-10-14T18:46:26.795053+0000","last_became_active":"2023-10-14T18:46:26.794311+0000","last_became_peered":"2023-10-14T18:46:26.794311+0000","last_unstale":"2023-10-14T18:46:26.795053+0000","last_undegraded":"2023-10-14T18:46:26.795053+0000","last_fullsized":"2023-10-14T18:46:26.795053+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.741203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.794167+0000","last_change":"2023-10-14T18:46:26.794035+0000","last_active":"2023-10-14T18:46:26.794167+0000","last_peered":"2023-10-14T18:46:26.794167+0000","last_clean":"2023-10-14T18:46:26.794167+0000","last_became_active":"2023-10-14T18:46:26.793815+0000","last_became_peered":"2023-10-14T18:46:26.793815+0000","last_unstale":"2023-10-14T18:46:26.794167+0000","last_undegraded":"2023-10-14T18:46:26.794167+0000","last_fullsized":"2023-10-14T18:46:26.794167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:01:02.117205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793910+0000","last_change":"2023-10-14T18:46:26.793834+0000","last_active":"2023-10-14T18:46:26.793910+0000","last_peered":"2023-10-14T18:46:26.793910+0000","last_clean":"2023-10-14T18:46:26.793910+0000","last_became_active":"2023-10-14T18:46:26.793603+0000","last_became_peered":"2023-10-14T18:46:26.793603+0000","last_unstale":"2023-10-14T18:46:26.793910+0000","last_undegraded":"2023-10-14T18:46:26.793910+0000","last_fullsized":"2023-10-14T18:46:26.793910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:06:55.049147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805792+0000","last_change":"2023-10-14T18:46:25.800489+0000","last_active":"2023-10-14T18:46:26.805792+0000","last_peered":"2023-10-14T18:46:26.805792+0000","last_clean":"2023-10-14T18:46:26.805792+0000","last_became_active":"2023-10-14T18:46:25.800223+0000","last_became_peered":"2023-10-14T18:46:25.800223+0000","last_unstale":"2023-10-14T18:46:26.805792+0000","last_undegraded":"2023-10-14T18:46:26.805792+0000","last_fullsized":"2023-10-14T18:46:26.805792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:56.710920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799997+0000","last_change":"2023-10-14T18:46:26.799927+0000","last_active":"2023-10-14T18:46:26.799997+0000","last_peered":"2023-10-14T18:46:26.799997+0000","last_clean":"2023-10-14T18:46:26.799997+0000","last_became_active":"2023-10-14T18:46:26.799723+0000","last_became_peered":"2023-10-14T18:46:26.799723+0000","last_unstale":"2023-10-14T18:46:26.799997+0000","last_undegraded":"2023-10-14T18:46:26.799997+0000","last_fullsized":"2023-10-14T18:46:26.799997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:46.039820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806246+0000","last_change":"2023-10-14T18:46:25.801678+0000","last_active":"2023-10-14T18:46:26.806246+0000","last_peered":"2023-10-14T18:46:26.806246+0000","last_clean":"2023-10-14T18:46:26.806246+0000","last_became_active":"2023-10-14T18:46:25.801543+0000","last_became_peered":"2023-10-14T18:46:25.801543+0000","last_unstale":"2023-10-14T18:46:26.806246+0000","last_undegraded":"2023-10-14T18:46:26.806246+0000","last_fullsized":"2023-10-14T18:46:26.806246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:24.293831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795233+0000","last_change":"2023-10-14T18:46:26.794910+0000","last_active":"2023-10-14T18:46:26.795233+0000","last_peered":"2023-10-14T18:46:26.795233+0000","last_clean":"2023-10-14T18:46:26.795233+0000","last_became_active":"2023-10-14T18:46:26.794695+0000","last_became_peered":"2023-10-14T18:46:26.794695+0000","last_unstale":"2023-10-14T18:46:26.795233+0000","last_undegraded":"2023-10-14T18:46:26.795233+0000","last_fullsized":"2023-10-14T18:46:26.795233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:37:39.026751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803778+0000","last_change":"2023-10-14T18:46:25.791532+0000","last_active":"2023-10-14T18:46:26.803778+0000","last_peered":"2023-10-14T18:46:26.803778+0000","last_clean":"2023-10-14T18:46:26.803778+0000","last_became_active":"2023-10-14T18:46:25.791166+0000","last_became_peered":"2023-10-14T18:46:25.791166+0000","last_unstale":"2023-10-14T18:46:26.803778+0000","last_undegraded":"2023-10-14T18:46:26.803778+0000","last_fullsized":"2023-10-14T18:46:26.803778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800315+0000","last_change":"2023-10-14T18:46:26.799512+0000","last_active":"2023-10-14T18:46:26.800315+0000","last_peered":"2023-10-14T18:46:26.800315+0000","last_clean":"2023-10-14T18:46:26.800315+0000","last_became_active":"2023-10-14T18:46:26.799298+0000","last_became_peered":"2023-10-14T18:46:26.799298+0000","last_unstale":"2023-10-14T18:46:26.800315+0000","last_undegraded":"2023-10-14T18:46:26.800315+0000","last_fullsized":"2023-10-14T18:46:26.800315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:45.533544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805865+0000","last_change":"2023-10-14T18:46:25.790347+0000","last_active":"2023-10-14T18:46:26.805865+0000","last_peered":"2023-10-14T18:46:26.805865+0000","last_clean":"2023-10-14T18:46:26.805865+0000","last_became_active":"2023-10-14T18:46:25.790141+0000","last_became_peered":"2023-10-14T18:46:25.790141+0000","last_unstale":"2023-10-14T18:46:26.805865+0000","last_undegraded":"2023-10-14T18:46:26.805865+0000","last_fullsized":"2023-10-14T18:46:26.805865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:39.855271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800393+0000","last_change":"2023-10-14T18:46:26.800337+0000","last_active":"2023-10-14T18:46:26.800393+0000","last_peered":"2023-10-14T18:46:26.800393+0000","last_clean":"2023-10-14T18:46:26.800393+0000","last_became_active":"2023-10-14T18:46:26.799899+0000","last_became_peered":"2023-10-14T18:46:26.799899+0000","last_unstale":"2023-10-14T18:46:26.800393+0000","last_undegraded":"2023-10-14T18:46:26.800393+0000","last_fullsized":"2023-10-14T18:46:26.800393+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:19.372044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804732+0000","last_change":"2023-10-14T18:46:25.796816+0000","last_active":"2023-10-14T18:46:26.804732+0000","last_peered":"2023-10-14T18:46:26.804732+0000","last_clean":"2023-10-14T18:46:26.804732+0000","last_became_active":"2023-10-14T18:46:25.796586+0000","last_became_peered":"2023-10-14T18:46:25.796586+0000","last_unstale":"2023-10-14T18:46:26.804732+0000","last_undegraded":"2023-10-14T18:46:26.804732+0000","last_fullsized":"2023-10-14T18:46:26.804732+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:18.365879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793074+0000","last_change":"2023-10-14T18:46:26.792145+0000","last_active":"2023-10-14T18:46:26.793074+0000","last_peered":"2023-10-14T18:46:26.793074+0000","last_clean":"2023-10-14T18:46:26.793074+0000","last_became_active":"2023-10-14T18:46:26.791891+0000","last_became_peered":"2023-10-14T18:46:26.791891+0000","last_unstale":"2023-10-14T18:46:26.793074+0000","last_undegraded":"2023-10-14T18:46:26.793074+0000","last_fullsized":"2023-10-14T18:46:26.793074+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:52.652114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804506+0000","last_change":"2023-10-14T18:46:25.799005+0000","last_active":"2023-10-14T18:46:26.804506+0000","last_peered":"2023-10-14T18:46:26.804506+0000","last_clean":"2023-10-14T18:46:26.804506+0000","last_became_active":"2023-10-14T18:46:25.798035+0000","last_became_peered":"2023-10-14T18:46:25.798035+0000","last_unstale":"2023-10-14T18:46:26.804506+0000","last_undegraded":"2023-10-14T18:46:26.804506+0000","last_fullsized":"2023-10-14T18:46:26.804506+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796924+0000","last_change":"2023-10-14T18:46:26.796856+0000","last_active":"2023-10-14T18:46:26.796924+0000","last_peered":"2023-10-14T18:46:26.796924+0000","last_clean":"2023-10-14T18:46:26.796924+0000","last_became_active":"2023-10-14T18:46:26.795259+0000","last_became_peered":"2023-10-14T18:46:26.795259+0000","last_unstale":"2023-10-14T18:46:26.796924+0000","last_undegraded":"2023-10-14T18:46:26.796924+0000","last_fullsized":"2023-10-14T18:46:26.796924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790158+0000","last_change":"2023-10-14T18:46:25.790058+0000","last_active":"2023-10-14T18:46:26.790158+0000","last_peered":"2023-10-14T18:46:26.790158+0000","last_clean":"2023-10-14T18:46:26.790158+0000","last_became_active":"2023-10-14T18:46:25.789801+0000","last_became_peered":"2023-10-14T18:46:25.789801+0000","last_unstale":"2023-10-14T18:46:26.790158+0000","last_undegraded":"2023-10-14T18:46:26.790158+0000","last_fullsized":"2023-10-14T18:46:26.790158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:50.057190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.801606+0000","last_change":"2023-10-14T18:46:26.801457+0000","last_active":"2023-10-14T18:46:26.801606+0000","last_peered":"2023-10-14T18:46:26.801606+0000","last_clean":"2023-10-14T18:46:26.801606+0000","last_became_active":"2023-10-14T18:46:26.800944+0000","last_became_peered":"2023-10-14T18:46:26.800944+0000","last_unstale":"2023-10-14T18:46:26.801606+0000","last_undegraded":"2023-10-14T18:46:26.801606+0000","last_fullsized":"2023-10-14T18:46:26.801606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.786320+0000","last_change":"2023-10-14T18:46:25.793310+0000","last_active":"2023-10-14T18:46:26.786320+0000","last_peered":"2023-10-14T18:46:26.786320+0000","last_clean":"2023-10-14T18:46:26.786320+0000","last_became_active":"2023-10-14T18:46:25.791432+0000","last_became_peered":"2023-10-14T18:46:25.791432+0000","last_unstale":"2023-10-14T18:46:26.786320+0000","last_undegraded":"2023-10-14T18:46:26.786320+0000","last_fullsized":"2023-10-14T18:46:26.786320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:02.491654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798705+0000","last_change":"2023-10-14T18:46:26.798057+0000","last_active":"2023-10-14T18:46:26.798705+0000","last_peered":"2023-10-14T18:46:26.798705+0000","last_clean":"2023-10-14T18:46:26.798705+0000","last_became_active":"2023-10-14T18:46:26.797809+0000","last_became_peered":"2023-10-14T18:46:26.797809+0000","last_unstale":"2023-10-14T18:46:26.798705+0000","last_undegraded":"2023-10-14T18:46:26.798705+0000","last_fullsized":"2023-10-14T18:46:26.798705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:51.063354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792169+0000","last_change":"2023-10-14T18:46:25.795441+0000","last_active":"2023-10-14T18:46:26.792169+0000","last_peered":"2023-10-14T18:46:26.792169+0000","last_clean":"2023-10-14T18:46:26.792169+0000","last_became_active":"2023-10-14T18:46:25.795186+0000","last_became_peered":"2023-10-14T18:46:25.795186+0000","last_unstale":"2023-10-14T18:46:26.792169+0000","last_undegraded":"2023-10-14T18:46:26.792169+0000","last_fullsized":"2023-10-14T18:46:26.792169+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:02.491654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796956+0000","last_change":"2023-10-14T18:46:26.796680+0000","last_active":"2023-10-14T18:46:26.796956+0000","last_peered":"2023-10-14T18:46:26.796956+0000","last_clean":"2023-10-14T18:46:26.796956+0000","last_became_active":"2023-10-14T18:46:26.796298+0000","last_became_peered":"2023-10-14T18:46:26.796298+0000","last_unstale":"2023-10-14T18:46:26.796956+0000","last_undegraded":"2023-10-14T18:46:26.796956+0000","last_fullsized":"2023-10-14T18:46:26.796956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.785805+0000","last_change":"2023-10-14T18:46:25.789409+0000","last_active":"2023-10-14T18:46:26.785805+0000","last_peered":"2023-10-14T18:46:26.785805+0000","last_clean":"2023-10-14T18:46:26.785805+0000","last_became_active":"2023-10-14T18:46:25.789185+0000","last_became_peered":"2023-10-14T18:46:25.789185+0000","last_unstale":"2023-10-14T18:46:26.785805+0000","last_undegraded":"2023-10-14T18:46:26.785805+0000","last_fullsized":"2023-10-14T18:46:26.785805+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793491+0000","last_change":"2023-10-14T18:46:26.793152+0000","last_active":"2023-10-14T18:46:26.793491+0000","last_peered":"2023-10-14T18:46:26.793491+0000","last_clean":"2023-10-14T18:46:26.793491+0000","last_became_active":"2023-10-14T18:46:26.792406+0000","last_became_peered":"2023-10-14T18:46:26.792406+0000","last_unstale":"2023-10-14T18:46:26.793491+0000","last_undegraded":"2023-10-14T18:46:26.793491+0000","last_fullsized":"2023-10-14T18:46:26.793491+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:24.639752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806326+0000","last_change":"2023-10-14T18:46:25.792117+0000","last_active":"2023-10-14T18:46:26.806326+0000","last_peered":"2023-10-14T18:46:26.806326+0000","last_clean":"2023-10-14T18:46:26.806326+0000","last_became_active":"2023-10-14T18:46:25.791852+0000","last_became_peered":"2023-10-14T18:46:25.791852+0000","last_unstale":"2023-10-14T18:46:26.806326+0000","last_undegraded":"2023-10-14T18:46:26.806326+0000","last_fullsized":"2023-10-14T18:46:26.806326+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:19.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.791999+0000","last_change":"2023-10-14T18:46:26.791857+0000","last_active":"2023-10-14T18:46:26.791999+0000","last_peered":"2023-10-14T18:46:26.791999+0000","last_clean":"2023-10-14T18:46:26.791999+0000","last_became_active":"2023-10-14T18:46:26.791639+0000","last_became_peered":"2023-10-14T18:46:26.791639+0000","last_unstale":"2023-10-14T18:46:26.791999+0000","last_undegraded":"2023-10-14T18:46:26.791999+0000","last_fullsized":"2023-10-14T18:46:26.791999+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:07.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.808362+0000","last_change":"2023-10-14T18:46:25.795744+0000","last_active":"2023-10-14T18:46:26.808362+0000","last_peered":"2023-10-14T18:46:26.808362+0000","last_clean":"2023-10-14T18:46:26.808362+0000","last_became_active":"2023-10-14T18:46:25.795532+0000","last_became_peered":"2023-10-14T18:46:25.795532+0000","last_unstale":"2023-10-14T18:46:26.808362+0000","last_undegraded":"2023-10-14T18:46:26.808362+0000","last_fullsized":"2023-10-14T18:46:26.808362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:29.796478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795540+0000","last_change":"2023-10-14T18:46:26.794707+0000","last_active":"2023-10-14T18:46:26.795540+0000","last_peered":"2023-10-14T18:46:26.795540+0000","last_clean":"2023-10-14T18:46:26.795540+0000","last_became_active":"2023-10-14T18:46:26.794157+0000","last_became_peered":"2023-10-14T18:46:26.794157+0000","last_unstale":"2023-10-14T18:46:26.795540+0000","last_undegraded":"2023-10-14T18:46:26.795540+0000","last_fullsized":"2023-10-14T18:46:26.795540+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:09:03.497819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805362+0000","last_change":"2023-10-14T18:46:25.795174+0000","last_active":"2023-10-14T18:46:26.805362+0000","last_peered":"2023-10-14T18:46:26.805362+0000","last_clean":"2023-10-14T18:46:26.805362+0000","last_became_active":"2023-10-14T18:46:25.794925+0000","last_became_peered":"2023-10-14T18:46:25.794925+0000","last_unstale":"2023-10-14T18:46:26.805362+0000","last_undegraded":"2023-10-14T18:46:26.805362+0000","last_fullsized":"2023-10-14T18:46:26.805362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792129+0000","last_change":"2023-10-14T18:46:26.789392+0000","last_active":"2023-10-14T18:46:26.792129+0000","last_peered":"2023-10-14T18:46:26.792129+0000","last_clean":"2023-10-14T18:46:26.792129+0000","last_became_active":"2023-10-14T18:46:26.789186+0000","last_became_peered":"2023-10-14T18:46:26.789186+0000","last_unstale":"2023-10-14T18:46:26.792129+0000","last_undegraded":"2023-10-14T18:46:26.792129+0000","last_fullsized":"2023-10-14T18:46:26.792129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:14.698760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787986+0000","last_change":"2023-10-14T18:46:25.791806+0000","last_active":"2023-10-14T18:46:26.787986+0000","last_peered":"2023-10-14T18:46:26.787986+0000","last_clean":"2023-10-14T18:46:26.787986+0000","last_became_active":"2023-10-14T18:46:25.791196+0000","last_became_peered":"2023-10-14T18:46:25.791196+0000","last_unstale":"2023-10-14T18:46:26.787986+0000","last_undegraded":"2023-10-14T18:46:26.787986+0000","last_fullsized":"2023-10-14T18:46:26.787986+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:42.027762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793001+0000","last_change":"2023-10-14T18:46:26.792814+0000","last_active":"2023-10-14T18:46:26.793001+0000","last_peered":"2023-10-14T18:46:26.793001+0000","last_clean":"2023-10-14T18:46:26.793001+0000","last_became_active":"2023-10-14T18:46:26.792591+0000","last_became_peered":"2023-10-14T18:46:26.792591+0000","last_unstale":"2023-10-14T18:46:26.793001+0000","last_undegraded":"2023-10-14T18:46:26.793001+0000","last_fullsized":"2023-10-14T18:46:26.793001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:23.172836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.789842+0000","last_change":"2023-10-14T18:46:25.794744+0000","last_active":"2023-10-14T18:46:26.789842+0000","last_peered":"2023-10-14T18:46:26.789842+0000","last_clean":"2023-10-14T18:46:26.789842+0000","last_became_active":"2023-10-14T18:46:25.794514+0000","last_became_peered":"2023-10-14T18:46:25.794514+0000","last_unstale":"2023-10-14T18:46:26.789842+0000","last_undegraded":"2023-10-14T18:46:26.789842+0000","last_fullsized":"2023-10-14T18:46:26.789842+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:42.027762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.796080+0000","last_change":"2023-10-14T18:46:26.796017+0000","last_active":"2023-10-14T18:46:26.796080+0000","last_peered":"2023-10-14T18:46:26.796080+0000","last_clean":"2023-10-14T18:46:26.796080+0000","last_became_active":"2023-10-14T18:46:26.795793+0000","last_became_peered":"2023-10-14T18:46:26.795793+0000","last_unstale":"2023-10-14T18:46:26.796080+0000","last_undegraded":"2023-10-14T18:46:26.796080+0000","last_fullsized":"2023-10-14T18:46:26.796080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.809165+0000","last_change":"2023-10-14T18:46:25.789907+0000","last_active":"2023-10-14T18:46:26.809165+0000","last_peered":"2023-10-14T18:46:26.809165+0000","last_clean":"2023-10-14T18:46:26.809165+0000","last_became_active":"2023-10-14T18:46:25.789682+0000","last_became_peered":"2023-10-14T18:46:25.789682+0000","last_unstale":"2023-10-14T18:46:26.809165+0000","last_undegraded":"2023-10-14T18:46:26.809165+0000","last_fullsized":"2023-10-14T18:46:26.809165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:18.306444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795208+0000","last_change":"2023-10-14T18:46:26.795150+0000","last_active":"2023-10-14T18:46:26.795208+0000","last_peered":"2023-10-14T18:46:26.795208+0000","last_clean":"2023-10-14T18:46:26.795208+0000","last_became_active":"2023-10-14T18:46:26.794935+0000","last_became_peered":"2023-10-14T18:46:26.794935+0000","last_unstale":"2023-10-14T18:46:26.795208+0000","last_undegraded":"2023-10-14T18:46:26.795208+0000","last_fullsized":"2023-10-14T18:46:26.795208+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:25.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.807023+0000","last_change":"2023-10-14T18:46:25.792733+0000","last_active":"2023-10-14T18:46:26.807023+0000","last_peered":"2023-10-14T18:46:26.807023+0000","last_clean":"2023-10-14T18:46:26.807023+0000","last_became_active":"2023-10-14T18:46:25.792570+0000","last_became_peered":"2023-10-14T18:46:25.792570+0000","last_unstale":"2023-10-14T18:46:26.807023+0000","last_undegraded":"2023-10-14T18:46:26.807023+0000","last_fullsized":"2023-10-14T18:46:26.807023+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:50.360855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792151+0000","last_change":"2023-10-14T18:46:26.791467+0000","last_active":"2023-10-14T18:46:26.792151+0000","last_peered":"2023-10-14T18:46:26.792151+0000","last_clean":"2023-10-14T18:46:26.792151+0000","last_became_active":"2023-10-14T18:46:26.791251+0000","last_became_peered":"2023-10-14T18:46:26.791251+0000","last_unstale":"2023-10-14T18:46:26.792151+0000","last_undegraded":"2023-10-14T18:46:26.792151+0000","last_fullsized":"2023-10-14T18:46:26.792151+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.804844+0000","last_change":"2023-10-14T18:46:25.798816+0000","last_active":"2023-10-14T18:46:26.804844+0000","last_peered":"2023-10-14T18:46:26.804844+0000","last_clean":"2023-10-14T18:46:26.804844+0000","last_became_active":"2023-10-14T18:46:25.798587+0000","last_became_peered":"2023-10-14T18:46:25.798587+0000","last_unstale":"2023-10-14T18:46:26.804844+0000","last_undegraded":"2023-10-14T18:46:26.804844+0000","last_fullsized":"2023-10-14T18:46:26.804844+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.648806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799154+0000","last_change":"2023-10-14T18:46:26.799099+0000","last_active":"2023-10-14T18:46:26.799154+0000","last_peered":"2023-10-14T18:46:26.799154+0000","last_clean":"2023-10-14T18:46:26.799154+0000","last_became_active":"2023-10-14T18:46:26.798382+0000","last_became_peered":"2023-10-14T18:46:26.798382+0000","last_unstale":"2023-10-14T18:46:26.799154+0000","last_undegraded":"2023-10-14T18:46:26.799154+0000","last_fullsized":"2023-10-14T18:46:26.799154+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:45.533544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.803967+0000","last_change":"2023-10-14T18:46:25.791300+0000","last_active":"2023-10-14T18:46:26.803967+0000","last_peered":"2023-10-14T18:46:26.803967+0000","last_clean":"2023-10-14T18:46:26.803967+0000","last_became_active":"2023-10-14T18:46:25.791051+0000","last_became_peered":"2023-10-14T18:46:25.791051+0000","last_unstale":"2023-10-14T18:46:26.803967+0000","last_undegraded":"2023-10-14T18:46:26.803967+0000","last_fullsized":"2023-10-14T18:46:26.803967+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:41:19.630895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.798837+0000","last_change":"2023-10-14T18:46:26.798736+0000","last_active":"2023-10-14T18:46:26.798837+0000","last_peered":"2023-10-14T18:46:26.798837+0000","last_clean":"2023-10-14T18:46:26.798837+0000","last_became_active":"2023-10-14T18:46:26.798459+0000","last_became_peered":"2023-10-14T18:46:26.798459+0000","last_unstale":"2023-10-14T18:46:26.798837+0000","last_undegraded":"2023-10-14T18:46:26.798837+0000","last_fullsized":"2023-10-14T18:46:26.798837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:26.686691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.789930+0000","last_change":"2023-10-14T18:46:25.793545+0000","last_active":"2023-10-14T18:46:26.789930+0000","last_peered":"2023-10-14T18:46:26.789930+0000","last_clean":"2023-10-14T18:46:26.789930+0000","last_became_active":"2023-10-14T18:46:25.793322+0000","last_became_peered":"2023-10-14T18:46:25.793322+0000","last_unstale":"2023-10-14T18:46:26.789930+0000","last_undegraded":"2023-10-14T18:46:26.789930+0000","last_fullsized":"2023-10-14T18:46:26.789930+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:39.855271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793133+0000","last_change":"2023-10-14T18:46:26.793022+0000","last_active":"2023-10-14T18:46:26.793133+0000","last_peered":"2023-10-14T18:46:26.793133+0000","last_clean":"2023-10-14T18:46:26.793133+0000","last_became_active":"2023-10-14T18:46:26.792068+0000","last_became_peered":"2023-10-14T18:46:26.792068+0000","last_unstale":"2023-10-14T18:46:26.793133+0000","last_undegraded":"2023-10-14T18:46:26.793133+0000","last_fullsized":"2023-10-14T18:46:26.793133+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:42:45.539314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.806035+0000","last_change":"2023-10-14T18:46:25.798610+0000","last_active":"2023-10-14T18:46:26.806035+0000","last_peered":"2023-10-14T18:46:26.806035+0000","last_clean":"2023-10-14T18:46:26.806035+0000","last_became_active":"2023-10-14T18:46:25.798427+0000","last_became_peered":"2023-10-14T18:46:25.798427+0000","last_unstale":"2023-10-14T18:46:26.806035+0000","last_undegraded":"2023-10-14T18:46:26.806035+0000","last_fullsized":"2023-10-14T18:46:26.806035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:44.583075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795170+0000","last_change":"2023-10-14T18:46:26.795108+0000","last_active":"2023-10-14T18:46:26.795170+0000","last_peered":"2023-10-14T18:46:26.795170+0000","last_clean":"2023-10-14T18:46:26.795170+0000","last_became_active":"2023-10-14T18:46:26.794886+0000","last_became_peered":"2023-10-14T18:46:26.794886+0000","last_unstale":"2023-10-14T18:46:26.795170+0000","last_undegraded":"2023-10-14T18:46:26.795170+0000","last_fullsized":"2023-10-14T18:46:26.795170+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:05.413309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790261+0000","last_change":"2023-10-14T18:46:25.791819+0000","last_active":"2023-10-14T18:46:26.790261+0000","last_peered":"2023-10-14T18:46:26.790261+0000","last_clean":"2023-10-14T18:46:26.790261+0000","last_became_active":"2023-10-14T18:46:25.791561+0000","last_became_peered":"2023-10-14T18:46:25.791561+0000","last_unstale":"2023-10-14T18:46:26.790261+0000","last_undegraded":"2023-10-14T18:46:26.790261+0000","last_fullsized":"2023-10-14T18:46:26.790261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.645949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799311+0000","last_change":"2023-10-14T18:46:26.799088+0000","last_active":"2023-10-14T18:46:26.799311+0000","last_peered":"2023-10-14T18:46:26.799311+0000","last_clean":"2023-10-14T18:46:26.799311+0000","last_became_active":"2023-10-14T18:46:26.798395+0000","last_became_peered":"2023-10-14T18:46:26.798395+0000","last_unstale":"2023-10-14T18:46:26.799311+0000","last_undegraded":"2023-10-14T18:46:26.799311+0000","last_fullsized":"2023-10-14T18:46:26.799311+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:32.612572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.786235+0000","last_change":"2023-10-14T18:46:25.793461+0000","last_active":"2023-10-14T18:46:26.786235+0000","last_peered":"2023-10-14T18:46:26.786235+0000","last_clean":"2023-10-14T18:46:26.786235+0000","last_became_active":"2023-10-14T18:46:25.791761+0000","last_became_peered":"2023-10-14T18:46:25.791761+0000","last_unstale":"2023-10-14T18:46:26.786235+0000","last_undegraded":"2023-10-14T18:46:26.786235+0000","last_fullsized":"2023-10-14T18:46:26.786235+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:00.924085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797250+0000","last_change":"2023-10-14T18:46:26.797199+0000","last_active":"2023-10-14T18:46:26.797250+0000","last_peered":"2023-10-14T18:46:26.797250+0000","last_clean":"2023-10-14T18:46:26.797250+0000","last_became_active":"2023-10-14T18:46:26.796324+0000","last_became_peered":"2023-10-14T18:46:26.796324+0000","last_unstale":"2023-10-14T18:46:26.797250+0000","last_undegraded":"2023-10-14T18:46:26.797250+0000","last_fullsized":"2023-10-14T18:46:26.797250+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:15.177872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.788106+0000","last_change":"2023-10-14T18:46:25.792475+0000","last_active":"2023-10-14T18:46:26.788106+0000","last_peered":"2023-10-14T18:46:26.788106+0000","last_clean":"2023-10-14T18:46:26.788106+0000","last_became_active":"2023-10-14T18:46:25.792051+0000","last_became_peered":"2023-10-14T18:46:25.792051+0000","last_unstale":"2023-10-14T18:46:26.788106+0000","last_undegraded":"2023-10-14T18:46:26.788106+0000","last_fullsized":"2023-10-14T18:46:26.788106+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:49:44.583075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.799355+0000","last_change":"2023-10-14T18:46:26.799246+0000","last_active":"2023-10-14T18:46:26.799355+0000","last_peered":"2023-10-14T18:46:26.799355+0000","last_clean":"2023-10-14T18:46:26.799355+0000","last_became_active":"2023-10-14T18:46:26.798894+0000","last_became_peered":"2023-10-14T18:46:26.798894+0000","last_unstale":"2023-10-14T18:46:26.799355+0000","last_undegraded":"2023-10-14T18:46:26.799355+0000","last_fullsized":"2023-10-14T18:46:26.799355+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:29:19.312608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790240+0000","last_change":"2023-10-14T18:46:25.797994+0000","last_active":"2023-10-14T18:46:26.790240+0000","last_peered":"2023-10-14T18:46:26.790240+0000","last_clean":"2023-10-14T18:46:26.790240+0000","last_became_active":"2023-10-14T18:46:25.797723+0000","last_became_peered":"2023-10-14T18:46:25.797723+0000","last_unstale":"2023-10-14T18:46:26.790240+0000","last_undegraded":"2023-10-14T18:46:26.790240+0000","last_fullsized":"2023-10-14T18:46:26.790240+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:28:35.404621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.797378+0000","last_change":"2023-10-14T18:46:26.797327+0000","last_active":"2023-10-14T18:46:26.797378+0000","last_peered":"2023-10-14T18:46:26.797378+0000","last_clean":"2023-10-14T18:46:26.797378+0000","last_became_active":"2023-10-14T18:46:26.796614+0000","last_became_peered":"2023-10-14T18:46:26.796614+0000","last_unstale":"2023-10-14T18:46:26.797378+0000","last_undegraded":"2023-10-14T18:46:26.797378+0000","last_fullsized":"2023-10-14T18:46:26.797378+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:07.834708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787899+0000","last_change":"2023-10-14T18:46:25.792636+0000","last_active":"2023-10-14T18:46:26.787899+0000","last_peered":"2023-10-14T18:46:26.787899+0000","last_clean":"2023-10-14T18:46:26.787899+0000","last_became_active":"2023-10-14T18:46:25.792423+0000","last_became_peered":"2023-10-14T18:46:25.792423+0000","last_unstale":"2023-10-14T18:46:26.787899+0000","last_undegraded":"2023-10-14T18:46:26.787899+0000","last_fullsized":"2023-10-14T18:46:26.787899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.645949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793601+0000","last_change":"2023-10-14T18:46:26.793424+0000","last_active":"2023-10-14T18:46:26.793601+0000","last_peered":"2023-10-14T18:46:26.793601+0000","last_clean":"2023-10-14T18:46:26.793601+0000","last_became_active":"2023-10-14T18:46:26.793199+0000","last_became_peered":"2023-10-14T18:46:26.793199+0000","last_unstale":"2023-10-14T18:46:26.793601+0000","last_undegraded":"2023-10-14T18:46:26.793601+0000","last_fullsized":"2023-10-14T18:46:26.793601+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:02.763493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790409+0000","last_change":"2023-10-14T18:46:25.791375+0000","last_active":"2023-10-14T18:46:26.790409+0000","last_peered":"2023-10-14T18:46:26.790409+0000","last_clean":"2023-10-14T18:46:26.790409+0000","last_became_active":"2023-10-14T18:46:25.790846+0000","last_became_peered":"2023-10-14T18:46:25.790846+0000","last_unstale":"2023-10-14T18:46:26.790409+0000","last_undegraded":"2023-10-14T18:46:26.790409+0000","last_fullsized":"2023-10-14T18:46:26.790409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:24.293831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795038+0000","last_change":"2023-10-14T18:46:26.794050+0000","last_active":"2023-10-14T18:46:26.795038+0000","last_peered":"2023-10-14T18:46:26.795038+0000","last_clean":"2023-10-14T18:46:26.795038+0000","last_became_active":"2023-10-14T18:46:26.793839+0000","last_became_peered":"2023-10-14T18:46:26.793839+0000","last_unstale":"2023-10-14T18:46:26.795038+0000","last_undegraded":"2023-10-14T18:46:26.795038+0000","last_fullsized":"2023-10-14T18:46:26.795038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:50:29.639335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.788410+0000","last_change":"2023-10-14T18:46:25.792306+0000","last_active":"2023-10-14T18:46:26.788410+0000","last_peered":"2023-10-14T18:46:26.788410+0000","last_clean":"2023-10-14T18:46:26.788410+0000","last_became_active":"2023-10-14T18:46:25.791534+0000","last_became_peered":"2023-10-14T18:46:25.791534+0000","last_unstale":"2023-10-14T18:46:26.788410+0000","last_undegraded":"2023-10-14T18:46:26.788410+0000","last_fullsized":"2023-10-14T18:46:26.788410+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.795068+0000","last_change":"2023-10-14T18:46:26.794984+0000","last_active":"2023-10-14T18:46:26.795068+0000","last_peered":"2023-10-14T18:46:26.795068+0000","last_clean":"2023-10-14T18:46:26.795068+0000","last_became_active":"2023-10-14T18:46:26.794597+0000","last_became_peered":"2023-10-14T18:46:26.794597+0000","last_unstale":"2023-10-14T18:46:26.795068+0000","last_undegraded":"2023-10-14T18:46:26.795068+0000","last_fullsized":"2023-10-14T18:46:26.795068+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:09:14.698760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793669+0000","last_change":"2023-10-14T18:46:25.796984+0000","last_active":"2023-10-14T18:46:26.793669+0000","last_peered":"2023-10-14T18:46:26.793669+0000","last_clean":"2023-10-14T18:46:26.793669+0000","last_became_active":"2023-10-14T18:46:25.793999+0000","last_became_peered":"2023-10-14T18:46:25.793999+0000","last_unstale":"2023-10-14T18:46:26.793669+0000","last_undegraded":"2023-10-14T18:46:26.793669+0000","last_fullsized":"2023-10-14T18:46:26.793669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.793573+0000","last_change":"2023-10-14T18:46:26.793364+0000","last_active":"2023-10-14T18:46:26.793573+0000","last_peered":"2023-10-14T18:46:26.793573+0000","last_clean":"2023-10-14T18:46:26.793573+0000","last_became_active":"2023-10-14T18:46:26.793107+0000","last_became_peered":"2023-10-14T18:46:26.793107+0000","last_unstale":"2023-10-14T18:46:26.793573+0000","last_undegraded":"2023-10-14T18:46:26.793573+0000","last_fullsized":"2023-10-14T18:46:26.793573+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:17:19.372044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.790258+0000","last_change":"2023-10-14T18:46:25.789068+0000","last_active":"2023-10-14T18:46:26.790258+0000","last_peered":"2023-10-14T18:46:26.790258+0000","last_clean":"2023-10-14T18:46:26.790258+0000","last_became_active":"2023-10-14T18:46:25.788837+0000","last_became_peered":"2023-10-14T18:46:25.788837+0000","last_unstale":"2023-10-14T18:46:26.790258+0000","last_undegraded":"2023-10-14T18:46:26.790258+0000","last_fullsized":"2023-10-14T18:46:26.790258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:36:24.758858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.800177+0000","last_change":"2023-10-14T18:46:26.800106+0000","last_active":"2023-10-14T18:46:26.800177+0000","last_peered":"2023-10-14T18:46:26.800177+0000","last_clean":"2023-10-14T18:46:26.800177+0000","last_became_active":"2023-10-14T18:46:26.799602+0000","last_became_peered":"2023-10-14T18:46:26.799602+0000","last_unstale":"2023-10-14T18:46:26.800177+0000","last_undegraded":"2023-10-14T18:46:26.800177+0000","last_fullsized":"2023-10-14T18:46:26.800177+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:57.717084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.785856+0000","last_change":"2023-10-14T18:46:25.793932+0000","last_active":"2023-10-14T18:46:26.785856+0000","last_peered":"2023-10-14T18:46:26.785856+0000","last_clean":"2023-10-14T18:46:26.785856+0000","last_became_active":"2023-10-14T18:46:25.793706+0000","last_became_peered":"2023-10-14T18:46:25.793706+0000","last_unstale":"2023-10-14T18:46:26.785856+0000","last_undegraded":"2023-10-14T18:46:26.785856+0000","last_fullsized":"2023-10-14T18:46:26.785856+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:51.648806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.792111+0000","last_change":"2023-10-14T18:46:26.789301+0000","last_active":"2023-10-14T18:46:26.792111+0000","last_peered":"2023-10-14T18:46:26.792111+0000","last_clean":"2023-10-14T18:46:26.792111+0000","last_became_active":"2023-10-14T18:46:26.789080+0000","last_became_peered":"2023-10-14T18:46:26.789080+0000","last_unstale":"2023-10-14T18:46:26.792111+0000","last_undegraded":"2023-10-14T18:46:26.792111+0000","last_fullsized":"2023-10-14T18:46:26.792111+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:25.779108+0000","last_clean_scrub_stamp":"2023-10-14T18:46:25.779108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:46.039820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.805829+0000","last_change":"2023-10-14T18:46:25.792529+0000","last_active":"2023-10-14T18:46:26.805829+0000","last_peered":"2023-10-14T18:46:26.805829+0000","last_clean":"2023-10-14T18:46:26.805829+0000","last_became_active":"2023-10-14T18:46:25.792315+0000","last_became_peered":"2023-10-14T18:46:25.792315+0000","last_unstale":"2023-10-14T18:46:26.805829+0000","last_undegraded":"2023-10-14T18:46:26.805829+0000","last_fullsized":"2023-10-14T18:46:26.805829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:46:24.772943+0000","last_clean_scrub_stamp":"2023-10-14T18:46:24.772943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:02.896247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T18:46:26.787998+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:46:26.787998+0000","last_peered":"2023-10-14T18:46:26.787998+0000","last_clean":"2023-10-14T18:46:26.787998+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:46:26.787998+0000","last_undegraded":"2023-10-14T18:46:26.787998+0000","last_fullsized":"2023-10-14T18:46:26.787998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.54000000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":7.8129999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":9.5779999999999994,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52700000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.37},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40500000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.438},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.217},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":10.574,"5min":10.574,"15min":10.574},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.24299999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.71199999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.253},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.28999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:46:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.27400000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.28799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.62},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.23300000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.314}]},{"osd":4,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41399999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.45500000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.498}]},{"osd":3,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.315}]},{"osd":6,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.436}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.55900000000000005}]},{"osd":1,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57899999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.37},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:45:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54200000000000004}]}]}],"pool_statfs":[]}} 2023-10-14T18:46:31.214 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:46:31.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:46:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.369+0000 7fa50d3bc700 1 Processor -- start 2023-10-14T18:46:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.369+0000 7fa50d3bc700 1 -- start start 2023-10-14T18:46:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa50d3bc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa508159a90 0x7fa508159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa50d3bc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa50815a450 0x7fa50815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa50d3bc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50815d930 con 0x7fa5080cd460 2023-10-14T18:46:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa50d3bc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080cdff0 con 0x7fa508159a90 2023-10-14T18:46:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa50d3bc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50815b1c0 con 0x7fa50815a450 2023-10-14T18:46:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa508159a90 0x7fa508159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa508159a90 0x7fa508159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37908/0 (socket says 172.21.15.79:37908) 2023-10-14T18:46:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 -- 172.21.15.79:0/2221404475 learned_addr learned my addr 172.21.15.79:0/2221404475 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa4fe7fc700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa50815a450 0x7fa50815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 -- 172.21.15.79:0/2221404475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa50815a450 msgr2=0x7fa50815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa50815a450 0x7fa50815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 -- 172.21.15.79:0/2221404475 >> v1:172.21.15.144:6789/0 conn(0x7fa5080cd460 legacy=0x7fa5080cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.370+0000 7fa506ffd700 1 -- 172.21.15.79:0/2221404475 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50815dbd0 con 0x7fa508159a90 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa506ffd700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa508159e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80099b0 tx=0x7fa4f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1237b24dc7e667 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa5067fc700 1 -- 172.21.15.79:0/2221404475 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800b820 con 0x7fa508159a90 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa5067fc700 1 -- 172.21.15.79:0/2221404475 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f800b980 con 0x7fa508159a90 2023-10-14T18:46:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa5067fc700 1 -- 172.21.15.79:0/2221404475 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f800bd20 con 0x7fa508159a90 2023-10-14T18:46:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 -- 172.21.15.79:0/2221404475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 msgr2=0x7fa508159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa508159e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80099b0 tx=0x7fa4f8009250 comp rx=0 tx=0).stop 2023-10-14T18:46:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 -- 172.21.15.79:0/2221404475 shutdown_connections 2023-10-14T18:46:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa508159e60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/2221404475 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa50815a450 0x7fa50815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 -- 172.21.15.79:0/2221404475 >> 172.21.15.79:0/2221404475 conn(0x7fa508067660 msgr2=0x7fa508067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 -- 172.21.15.79:0/2221404475 shutdown_connections 2023-10-14T18:46:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.371+0000 7fa50d3bc700 1 -- 172.21.15.79:0/2221404475 wait complete. 2023-10-14T18:46:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 Processor -- start 2023-10-14T18:46:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 -- start start 2023-10-14T18:46:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5080cd460 0x7fa5080a7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50815a450 0x7fa50816dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080d00c0 con 0x7fa508159a90 2023-10-14T18:46:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080cb160 con 0x7fa50815a450 2023-10-14T18:46:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa50d3bc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080cf790 con 0x7fa5080cd460 2023-10-14T18:46:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa4fe7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa4fe7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37910/0 (socket says 172.21.15.79:37910) 2023-10-14T18:46:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.373+0000 7fa4fe7fc700 1 -- 172.21.15.79:0/1551510585 learned_addr learned my addr 172.21.15.79:0/1551510585 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa506ffd700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5080cd460 0x7fa5080a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 -- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5080cd460 msgr2=0x7fa5080a7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5080cd460 0x7fa5080a7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa5077fe700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50815a450 0x7fa50816dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 -- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50815a450 msgr2=0x7fa50816dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50815a450 0x7fa50816dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 -- 172.21.15.79:0/1551510585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80094f0 con 0x7fa508159a90 2023-10-14T18:46:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4fe7fc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c880 tx=0x7fa4f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0011600 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0011780 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080cfa70 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0011b40 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.374+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50816e160 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.375+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5080892b0 con 0x7fa508159a90 2023-10-14T18:46:31.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.375+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4f0018360 con 0x7fa508159a90 2023-10-14T18:46:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.376+0000 7fa4ff7fe700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.376+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4f0084230 con 0x7fa508159a90 2023-10-14T18:46:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.376+0000 7fa506ffd700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.376+0000 7fa506ffd700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80099b0 tx=0x7fa4f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.380+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4f0054f30 con 0x7fa508159a90 2023-10-14T18:46:31.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.636+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa50815deb0 con 0x7fa508159a90 2023-10-14T18:46:31.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.640+0000 7fa4ff7fe700 1 -- 172.21.15.79:0/1551510585 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa4f0054ac0 con 0x7fa508159a90 2023-10-14T18:46:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 msgr2=0x7fa4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80099b0 tx=0x7fa4f8016000 comp rx=0 tx=0).stop 2023-10-14T18:46:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 msgr2=0x7fa5080caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4f000c880 tx=0x7fa4f0008040 comp rx=0 tx=0).stop 2023-10-14T18:46:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 shutdown_connections 2023-10-14T18:46:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa50815a450 0x7fa50816dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5080cd460 0x7fa5080a7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 --2- 172.21.15.79:0/1551510585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa508159a90 0x7fa5080caa60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 >> 172.21.15.79:0/1551510585 conn(0x7fa508067660 msgr2=0x7fa50815cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 shutdown_connections 2023-10-14T18:46:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.642+0000 7fa50d3bc700 1 -- 172.21.15.79:0/1551510585 wait complete. 2023-10-14T18:46:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:46:31.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:31.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.769+0000 7f1b011a9700 1 Processor -- start 2023-10-14T18:46:31.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.769+0000 7f1b011a9700 1 -- start start 2023-10-14T18:46:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.769+0000 7f1b011a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.769+0000 7f1b011a9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1afc15a620 0x7f1afc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.769+0000 7f1b011a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc15cbb0 con 0x7f1afc15d580 2023-10-14T18:46:31.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1b011a9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc15bfa0 con 0x7f1afc15a620 2023-10-14T18:46:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1b011a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc15c280 con 0x7f1afc157870 2023-10-14T18:46:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1afc15a620 0x7f1afc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1afc15a620 0x7f1afc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37926/0 (socket says 172.21.15.79:37926) 2023-10-14T18:46:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 -- 172.21.15.79:0/894091851 learned_addr learned my addr 172.21.15.79:0/894091851 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 -- 172.21.15.79:0/894091851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 msgr2=0x7f1afc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 --2- 172.21.15.79:0/894091851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 -- 172.21.15.79:0/894091851 >> v1:172.21.15.144:6789/0 conn(0x7f1afc15d580 legacy=0x7f1afc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 -- 172.21.15.79:0/894091851 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc15c560 con 0x7f1afc15a620 2023-10-14T18:46:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1afa59c700 1 --2- 172.21.15.79:0/894091851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15a620 0x7f1afc15d040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40099b0 tx=0x7f1ae4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbd46875fcf1e5e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1af9d9b700 1 -- 172.21.15.79:0/894091851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400b820 con 0x7f1afc15a620 2023-10-14T18:46:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1af9d9b700 1 -- 172.21.15.79:0/894091851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400b980 con 0x7f1afc15a620 2023-10-14T18:46:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.770+0000 7f1af9d9b700 1 -- 172.21.15.79:0/894091851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400bd20 con 0x7f1afc15a620 2023-10-14T18:46:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 -- 172.21.15.79:0/894091851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15a620 msgr2=0x7f1afc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 --2- 172.21.15.79:0/894091851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15a620 0x7f1afc15d040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1ae40099b0 tx=0x7f1ae4009250 comp rx=0 tx=0).stop 2023-10-14T18:46:31.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 -- 172.21.15.79:0/894091851 shutdown_connections 2023-10-14T18:46:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 --2- 172.21.15.79:0/894091851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 --2- 172.21.15.79:0/894091851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15a620 0x7f1afc15d040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 -- 172.21.15.79:0/894091851 >> 172.21.15.79:0/894091851 conn(0x7f1afc068ce0 msgr2=0x7f1afc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 -- 172.21.15.79:0/894091851 shutdown_connections 2023-10-14T18:46:31.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.771+0000 7f1b011a9700 1 -- 172.21.15.79:0/894091851 wait complete. 2023-10-14T18:46:31.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.772+0000 7f1b011a9700 1 Processor -- start 2023-10-14T18:46:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.772+0000 7f1b011a9700 1 -- start start 2023-10-14T18:46:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 0x7f1afc0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc16b900 con 0x7f1afc15d580 2023-10-14T18:46:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc16acf0 con 0x7f1afc15a620 2023-10-14T18:46:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc16afd0 con 0x7f1afc157870 2023-10-14T18:46:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37936/0 (socket says 172.21.15.79:37936) 2023-10-14T18:46:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 -- 172.21.15.79:0/1266077369 learned_addr learned my addr 172.21.15.79:0/1266077369 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afa59c700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 0x7f1afc0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afad9d700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 -- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 msgr2=0x7f1afc14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 -- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 msgr2=0x7f1afc0b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 0x7f1afc0b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 -- 172.21.15.79:0/1266077369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae40094f0 con 0x7f1afc15d580 2023-10-14T18:46:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afa59c700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 0x7f1afc0b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afad9d700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:31.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1afb59e700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009fd0 tx=0x7f1aec009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00f510 con 0x7f1afc15d580 2023-10-14T18:46:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00f690 con 0x7f1afc15d580 2023-10-14T18:46:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc16b2b0 con 0x7f1afc15d580 2023-10-14T18:46:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00fa50 con 0x7f1afc15d580 2023-10-14T18:46:31.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.773+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc14cd20 con 0x7f1afc15d580 2023-10-14T18:46:31.784 INFO:tasks.ceph.mds.c.smithi079.stderr:2023-10-14T18:46:31.774+0000 7f594245e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:46:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.774+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc0b0610 con 0x7f1afc15d580 2023-10-14T18:46:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.775+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1aec01a400 con 0x7f1afc15d580 2023-10-14T18:46:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.775+0000 7f1af2ffd700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 0x7f1adc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.775+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1aec084080 con 0x7f1afc15d580 2023-10-14T18:46:31.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.775+0000 7f1afad9d700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 0x7f1adc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.776+0000 7f1afad9d700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 0x7f1adc0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1af4001370 tx=0x7f1af40096a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:31.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:31.779+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1afc0b0610 con 0x7f1afc15d580 2023-10-14T18:46:32.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.004+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1afc0b0610 con 0x7f1afc15d580 2023-10-14T18:46:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.005+0000 7f1af2ffd700 1 -- 172.21.15.79:0/1266077369 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1afc0b0610 con 0x7f1afc15d580 2023-10-14T18:46:32.005 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:32.006 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:32.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 msgr2=0x7f1adc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 0x7f1adc0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1af4001370 tx=0x7f1af40096a0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 msgr2=0x7f1afc0b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009fd0 tx=0x7f1aec009060 comp rx=0 tx=0).stop 2023-10-14T18:46:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 shutdown_connections 2023-10-14T18:46:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1adc066f30 0x7f1adc0693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1afc15d580 0x7f1afc0b31d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1afc157870 0x7f1afc14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 --2- 172.21.15.79:0/1266077369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1afc15a620 0x7f1afc0b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 >> 172.21.15.79:0/1266077369 conn(0x7f1afc068ce0 msgr2=0x7f1afc158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 shutdown_connections 2023-10-14T18:46:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.007+0000 7f1b011a9700 1 -- 172.21.15.79:0/1266077369 wait complete. 2023-10-14T18:46:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:32.421 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:46:26.163690+0000', 'modified': '2023-10-14T18:46:29.805182+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5304}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5304': {'gid': 5304, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1192316967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 1192316967}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1192316967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:46:32.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:46:32.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T18:46:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.541+0000 7fc60b055700 1 Processor -- start 2023-10-14T18:46:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.541+0000 7fc60b055700 1 -- start start 2023-10-14T18:46:32.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc60b055700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc604157870 0x7fc60415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc60b055700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc604157c40 0x7fc604158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc60b055700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60415cbb0 con 0x7fc60415a620 2023-10-14T18:46:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc60b055700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60415bfa0 con 0x7fc604157c40 2023-10-14T18:46:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc60b055700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60415c280 con 0x7fc604157870 2023-10-14T18:46:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc6095f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc604157c40 0x7fc604158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc6095f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc604157c40 0x7fc604158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37942/0 (socket says 172.21.15.79:37942) 2023-10-14T18:46:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc6095f2700 1 -- 172.21.15.79:0/2665555884 learned_addr learned my addr 172.21.15.79:0/2665555884 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.542+0000 7fc608df1700 1 --2- 172.21.15.79:0/2665555884 >> v2:172.21.15.144:3300/0 conn(0x7fc604157870 0x7fc60415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc6095f2700 1 -- 172.21.15.79:0/2665555884 >> v2:172.21.15.144:3300/0 conn(0x7fc604157870 msgr2=0x7fc60415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc6095f2700 1 --2- 172.21.15.79:0/2665555884 >> v2:172.21.15.144:3300/0 conn(0x7fc604157870 0x7fc60415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc6095f2700 1 -- 172.21.15.79:0/2665555884 >> v1:172.21.15.144:6789/0 conn(0x7fc60415a620 legacy=0x7fc60415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc6095f2700 1 -- 172.21.15.79:0/2665555884 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60415c560 con 0x7fc604157c40 2023-10-14T18:46:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc6095f2700 1 --2- 172.21.15.79:0/2665555884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc604158110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc604069d80 tx=0x7fc5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2251ef89d94340bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc5fb7fe700 1 -- 172.21.15.79:0/2665555884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc009e70 con 0x7fc604157c40 2023-10-14T18:46:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc5fb7fe700 1 -- 172.21.15.79:0/2665555884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00b860 con 0x7fc604157c40 2023-10-14T18:46:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc5fb7fe700 1 -- 172.21.15.79:0/2665555884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00bc00 con 0x7fc604157c40 2023-10-14T18:46:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 -- 172.21.15.79:0/2665555884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 msgr2=0x7fc604158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 --2- 172.21.15.79:0/2665555884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc604158110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc604069d80 tx=0x7fc5fc009250 comp rx=0 tx=0).stop 2023-10-14T18:46:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 -- 172.21.15.79:0/2665555884 shutdown_connections 2023-10-14T18:46:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 --2- 172.21.15.79:0/2665555884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc604158110 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 --2- 172.21.15.79:0/2665555884 >> v2:172.21.15.144:3300/0 conn(0x7fc604157870 0x7fc60415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 -- 172.21.15.79:0/2665555884 >> 172.21.15.79:0/2665555884 conn(0x7fc604068ce0 msgr2=0x7fc6040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 -- 172.21.15.79:0/2665555884 shutdown_connections 2023-10-14T18:46:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.543+0000 7fc60b055700 1 -- 172.21.15.79:0/2665555884 wait complete. 2023-10-14T18:46:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.544+0000 7fc60b055700 1 Processor -- start 2023-10-14T18:46:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 -- start start 2023-10-14T18:46:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 0x7fc60414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc60415a620 0x7fc6040b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414e070 con 0x7fc604157c40 2023-10-14T18:46:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414efb0 con 0x7fc60415a620 2023-10-14T18:46:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc60b055700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60414e6c0 con 0x7fc604157870 2023-10-14T18:46:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.545+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37952/0 (socket says 172.21.15.79:37952) 2023-10-14T18:46:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 -- 172.21.15.79:0/578638099 learned_addr learned my addr 172.21.15.79:0/578638099 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc6095f2700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc60415a620 0x7fc6040b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc608df1700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 0x7fc60414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 -- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 msgr2=0x7fc60414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 0x7fc60414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 -- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc60415a620 msgr2=0x7fc6040b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc60415a620 0x7fc6040b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 -- 172.21.15.79:0/578638099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0094f0 con 0x7fc604157c40 2023-10-14T18:46:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc608df1700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 0x7fc60414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c4e0 tx=0x7fc5f4007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5f8ff9700 1 -- 172.21.15.79:0/578638099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4011590 con 0x7fc604157c40 2023-10-14T18:46:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5f8ff9700 1 -- 172.21.15.79:0/578638099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40116f0 con 0x7fc604157c40 2023-10-14T18:46:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60414e960 con 0x7fc604157c40 2023-10-14T18:46:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc5f8ff9700 1 -- 172.21.15.79:0/578638099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4011ab0 con 0x7fc604157c40 2023-10-14T18:46:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.546+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60416b570 con 0x7fc604157c40 2023-10-14T18:46:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.548+0000 7fc5f8ff9700 1 -- 172.21.15.79:0/578638099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5f401c440 con 0x7fc604157c40 2023-10-14T18:46:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.548+0000 7fc5f8ff9700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 0x7fc5f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.548+0000 7fc5f8ff9700 1 -- 172.21.15.79:0/578638099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5f40839f0 con 0x7fc604157c40 2023-10-14T18:46:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.548+0000 7fc608df1700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 0x7fc5f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.549+0000 7fc608df1700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 0x7fc5f00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc600007780 tx=0x7fc60000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.550+0000 7fc61434eb80 1 Processor -- start 2023-10-14T18:46:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.550+0000 7fc61434eb80 1 -- start start 2023-10-14T18:46:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d476a50 0x56231d476e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d472cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d3cda70 con 0x56231d4c0d00 2023-10-14T18:46:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d3cb270 con 0x56231d476a50 2023-10-14T18:46:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56231d3c7060 con 0x56231d49ff60 2023-10-14T18:46:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37966/0 (socket says 172.21.15.79:37966) 2023-10-14T18:46:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 -- 172.21.15.79:0/2580491488 learned_addr learned my addr 172.21.15.79:0/2580491488 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc6095f2700 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d472cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc608df1700 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d476a50 0x56231d476e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 -- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 msgr2=0x56231d472cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d472cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 -- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d476a50 msgr2=0x56231d476e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d476a50 0x56231d476e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 -- 172.21.15.79:0/2580491488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56231d261270 con 0x56231d4c0d00 2023-10-14T18:46:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400a040 tx=0x7fc5f4081e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f638302d6ce90459 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5e9ffb700 1 -- 172.21.15.79:0/2580491488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4054920 con 0x56231d4c0d00 2023-10-14T18:46:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5e9ffb700 1 -- 172.21.15.79:0/2580491488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4057b70 con 0x56231d4c0d00 2023-10-14T18:46:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.551+0000 7fc5e9ffb700 1 -- 172.21.15.79:0/2580491488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f405b8c0 con 0x56231d4c0d00 2023-10-14T18:46:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- 172.21.15.79:0/2580491488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 msgr2=0x56231d49fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400a040 tx=0x7fc5f4081e70 comp rx=0 tx=0).stop 2023-10-14T18:46:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- 172.21.15.79:0/2580491488 shutdown_connections 2023-10-14T18:46:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d472cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d476a50 0x56231d476e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 --2- 172.21.15.79:0/2580491488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d49fa20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- 172.21.15.79:0/2580491488 >> 172.21.15.79:0/2580491488 conn(0x56231d478370 msgr2=0x56231d478740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- 172.21.15.79:0/2580491488 shutdown_connections 2023-10-14T18:46:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- 172.21.15.79:0/2580491488 wait complete. 2023-10-14T18:46:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.552+0000 7fc61434eb80 1 -- start start 2023-10-14T18:46:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 Processor -- start 2023-10-14T18:46:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d4d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4c0d00 0x56231d4b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d372890 con 0x56231d476a50 2023-10-14T18:46:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d38dea0 con 0x56231d4c0d00 2023-10-14T18:46:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.553+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56231d249e30 con 0x56231d49ff60 2023-10-14T18:46:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc61434eb80 10 client.0 _ll_register_callbacks cb 0x56231d43a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:46:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37968/0 (socket says 172.21.15.79:37968) 2023-10-14T18:46:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 -- 172.21.15.79:0/1932102749 learned_addr learned my addr 172.21.15.79:0/1932102749 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc6095f2700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4c0d00 0x56231d4b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d4d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 -- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 msgr2=0x56231d4d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d4d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 -- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4c0d00 msgr2=0x56231d4b6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4c0d00 0x56231d4b6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 -- 172.21.15.79:0/1932102749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60416b570 con 0x56231d476a50 2023-10-14T18:46:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc608df1700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc600016eb0 tx=0x7fc600016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4a7b0888804f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:46:32.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600014cd0 con 0x56231d476a50 2023-10-14T18:46:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc600014e30 con 0x56231d476a50 2023-10-14T18:46:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56231d46bb70 con 0x56231d476a50 2023-10-14T18:46:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc600022600 con 0x56231d476a50 2023-10-14T18:46:32.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc61434eb80 10 client.5445 fetch_fsmap learned FSMap version 24 2023-10-14T18:46:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56231d203fe0 con 0x56231d476a50 2023-10-14T18:46:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.554+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56231d46bb70 con 0x56231d476a50 2023-10-14T18:46:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc600021070 con 0x56231d476a50 2023-10-14T18:46:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 10 client.5445 fetch_fsmap finished waiting for FSMap version 24 2023-10-14T18:46:32.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 10 client.5445 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:46:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 20 client.5445 populate_metadata read hostname 'smithi079' 2023-10-14T18:46:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d49b9b0 0x56231d49bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 4 client.5445 mds_command: new command op to 5304 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:46:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 --> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56231d448aa0 con 0x56231d49b9b0 2023-10-14T18:46:32.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d49b9b0 0x56231d49bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc5e2ffd700 10 client.5445 ms_handle_connect on v2:172.21.15.79:6833/1192316967 2023-10-14T18:46:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.555+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d49b9b0 0x56231d49bd80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c36f1b8e59541b9 server_cookie=b7407d9f78efb7c4 in_seq=0 out_seq=0 2023-10-14T18:46:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/1932102749 <== mds.0 v2:172.21.15.79:6833/1192316967 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56231d448aa0 con 0x56231d49b9b0 2023-10-14T18:46:32.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc5e2ffd700 10 client.5445 handle_command_reply: tid=0 2023-10-14T18:46:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 client.5445 shutdown 2023-10-14T18:46:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 msgr2=0x56231d4bf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc600016eb0 tx=0x7fc600016000 comp rx=0 tx=0).stop 2023-10-14T18:46:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 shutdown_connections 2023-10-14T18:46:32.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d49b9b0 0x56231d49bd80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4c0d00 0x56231d4b6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc5e2ffd700 0 client.5445 ms_handle_reset on v2:172.21.15.79:6833/1192316967 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d476a50 0x56231d4bf890 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1932102749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d49ff60 0x56231d4d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 >> 172.21.15.79:0/1932102749 conn(0x56231d478370 msgr2=0x56231d473850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 shutdown_connections 2023-10-14T18:46:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 1 -- 172.21.15.79:0/1932102749 wait complete. 2023-10-14T18:46:32.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.556+0000 7fc61434eb80 20 client.5445 trim_cache size 0 max 16384 2023-10-14T18:46:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 Processor -- start 2023-10-14T18:46:32.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 -- start start 2023-10-14T18:46:32.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4c0d00 0x56231d4d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4beeb0 0x56231d49bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d4779f0 con 0x56231d49ff60 2023-10-14T18:46:32.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d4b64f0 con 0x56231d4beeb0 2023-10-14T18:46:32.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56231d474da0 con 0x56231d4c0d00 2023-10-14T18:46:32.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc608df1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc608df1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37982/0 (socket says 172.21.15.79:37982) 2023-10-14T18:46:32.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.573+0000 7fc608df1700 1 -- 172.21.15.79:0/1274703142 learned_addr learned my addr 172.21.15.79:0/1274703142 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc6095f2700 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4beeb0 0x56231d49bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4c0d00 0x56231d4d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 -- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4c0d00 msgr2=0x56231d4d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4c0d00 0x56231d4d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 -- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4beeb0 msgr2=0x56231d49bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4beeb0 0x56231d49bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 -- 172.21.15.79:0/1274703142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56231d395780 con 0x56231d49ff60 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc608df1700 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc600016f30 tx=0x7fc600022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ae0640cf8283c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc5ea7fc700 1 -- 172.21.15.79:0/1274703142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6000228a0 con 0x56231d49ff60 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc5ea7fc700 1 -- 172.21.15.79:0/1274703142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600022600 con 0x56231d49ff60 2023-10-14T18:46:32.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc5ea7fc700 1 -- 172.21.15.79:0/1274703142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600022a90 con 0x56231d49ff60 2023-10-14T18:46:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc61434eb80 1 -- 172.21.15.79:0/1274703142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 msgr2=0x56231d49ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.574+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc600016f30 tx=0x7fc600022000 comp rx=0 tx=0).stop 2023-10-14T18:46:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 -- 172.21.15.79:0/1274703142 shutdown_connections 2023-10-14T18:46:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d4beeb0 0x56231d49bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d49ff60 0x56231d49ea40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 --2- 172.21.15.79:0/1274703142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4c0d00 0x56231d4d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 -- 172.21.15.79:0/1274703142 >> 172.21.15.79:0/1274703142 conn(0x56231d478370 msgr2=0x56231d477090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 -- 172.21.15.79:0/1274703142 shutdown_connections 2023-10-14T18:46:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 -- 172.21.15.79:0/1274703142 wait complete. 2023-10-14T18:46:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 -- start start 2023-10-14T18:46:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.575+0000 7fc61434eb80 1 Processor -- start 2023-10-14T18:46:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d49ff60 0x56231d4c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 0x56231d4b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d471fa0 con 0x56231d4c0d00 2023-10-14T18:46:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56231d4ba760 con 0x56231d49ff60 2023-10-14T18:46:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x56231d4bb2a0 con 0x56231d4beeb0 2023-10-14T18:46:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc61434eb80 10 client.0 _ll_register_callbacks cb 0x56231d43a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:46:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37996/0 (socket says 172.21.15.79:37996) 2023-10-14T18:46:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 -- 172.21.15.79:0/3775014200 learned_addr learned my addr 172.21.15.79:0/3775014200 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc608df1700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d49ff60 0x56231d4c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 0x56231d4b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 -- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 msgr2=0x56231d4b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 0x56231d4b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 -- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d49ff60 msgr2=0x56231d4c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d49ff60 0x56231d4c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc6095f2700 1 -- 172.21.15.79:0/3775014200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56231d203fe0 con 0x56231d4c0d00 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.576+0000 7fc5fbfff700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 0x56231d4b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc6095f2700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc60406b530 tx=0x7fc5fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddeb3571825fe16 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:46:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc020040 con 0x56231d4c0d00 2023-10-14T18:46:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5fc01a930 con 0x56231d4c0d00 2023-10-14T18:46:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56231d4be740 con 0x56231d4c0d00 2023-10-14T18:46:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5fc01ad00 con 0x56231d4c0d00 2023-10-14T18:46:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 10 client.5451 fetch_fsmap learned FSMap version 24 2023-10-14T18:46:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56231d37c470 con 0x56231d4c0d00 2023-10-14T18:46:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56231d4be740 con 0x56231d4c0d00 2023-10-14T18:46:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5fc030440 con 0x56231d4c0d00 2023-10-14T18:46:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 10 client.5451 fetch_fsmap finished waiting for FSMap version 24 2023-10-14T18:46:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 10 client.5451 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:46:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 20 client.5451 populate_metadata read hostname 'smithi079' 2023-10-14T18:46:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d4b7890 0x56231d49a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 4 client.5451 mds_command: new command op to 5304 tid=0[{"prefix": "status"}] 2023-10-14T18:46:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 --> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fc5f4057b70 con 0x56231d4b7890 2023-10-14T18:46:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.577+0000 7fc608df1700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d4b7890 0x56231d49a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc5e2ffd700 10 client.5451 ms_handle_connect on v2:172.21.15.79:6833/1192316967 2023-10-14T18:46:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc608df1700 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d4b7890 0x56231d49a8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c79eca79f5d1b8 server_cookie=47c9dae90b62632 in_seq=0 out_seq=0 2023-10-14T18:46:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc5e2ffd700 1 -- 172.21.15.79:0/3775014200 <== mds.0 v2:172.21.15.79:6833/1192316967 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7fc5f4057b70 con 0x56231d4b7890 2023-10-14T18:46:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc5e2ffd700 10 client.5451 handle_command_reply: tid=0 2023-10-14T18:46:32.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 client.5451 shutdown 2023-10-14T18:46:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 msgr2=0x56231d4b7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc60406b530 tx=0x7fc5fc017000 comp rx=0 tx=0).stop 2023-10-14T18:46:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 shutdown_connections 2023-10-14T18:46:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:6833/1192316967,v1:172.21.15.79:6835/1192316967] conn(0x56231d4b7890 0x56231d49a8a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56231d4c0d00 0x56231d4b7350 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56231d49ff60 0x56231d4c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc5e2ffd700 0 client.5451 ms_handle_reset on v2:172.21.15.79:6833/1192316967 2023-10-14T18:46:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 --2- 172.21.15.79:0/3775014200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x56231d4beeb0 0x56231d4b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 >> 172.21.15.79:0/3775014200 conn(0x56231d478370 msgr2=0x56231d49ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 shutdown_connections 2023-10-14T18:46:32.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 1 -- 172.21.15.79:0/3775014200 wait complete. 2023-10-14T18:46:32.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc61434eb80 20 client.5451 trim_cache size 0 max 16384 2023-10-14T18:46:32.607 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:32.607 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:32.608 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:46:32.608 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5304, 2023-10-14T18:46:32.608 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:46:32.608 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:46:32.608 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:46:32.609 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.7816018580000001, 2023-10-14T18:46:32.609 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 24, 2023-10-14T18:46:32.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 45, 2023-10-14T18:46:32.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 45, 2023-10-14T18:46:32.609 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.761405763999999 2023-10-14T18:46:32.610 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:32.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 msgr2=0x7fc5f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 0x7fc5f00693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc600007780 tx=0x7fc60000b040 comp rx=0 tx=0).stop 2023-10-14T18:46:32.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 msgr2=0x7fc6040b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.578+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400c4e0 tx=0x7fc5f4007f00 comp rx=0 tx=0).stop 2023-10-14T18:46:32.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 shutdown_connections 2023-10-14T18:46:32.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5f0066f30 0x7fc5f00693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc60415a620 0x7fc6040b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc604157870 0x7fc60414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 --2- 172.21.15.79:0/578638099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc604157c40 0x7fc6040b2910 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 >> 172.21.15.79:0/578638099 conn(0x7fc604068ce0 msgr2=0x7fc604159860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 shutdown_connections 2023-10-14T18:46:32.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.579+0000 7fc60b055700 1 -- 172.21.15.79:0/578638099 wait complete. 2023-10-14T18:46:32.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:46:32.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.728+0000 7fdf70743700 1 Processor -- start 2023-10-14T18:46:32.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.728+0000 7fdf70743700 1 -- start start 2023-10-14T18:46:32.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf70743700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf68157870 0x7fdf6815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf70743700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6815cbb0 con 0x7fdf6815a620 2023-10-14T18:46:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf70743700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6815bfa0 con 0x7fdf68157c40 2023-10-14T18:46:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf70743700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6815c280 con 0x7fdf68157870 2023-10-14T18:46:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6e4df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf68157870 0x7fdf6815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6dcde700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdf6815a620 0x7fdf6815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36812/0 (socket says 172.21.15.79:36812) 2023-10-14T18:46:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6e4df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf68157870 0x7fdf6815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38010/0 (socket says 172.21.15.79:38010) 2023-10-14T18:46:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6dcde700 1 -- 172.21.15.79:0/3000771339 learned_addr learned my addr 172.21.15.79:0/3000771339 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6e4df700 1 -- 172.21.15.79:0/3000771339 >> v1:172.21.15.144:6789/0 conn(0x7fdf68157c40 legacy=0x7fdf68158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6e4df700 1 -- 172.21.15.79:0/3000771339 >> v1:172.21.15.79:6789/0 conn(0x7fdf6815a620 legacy=0x7fdf6815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6e4df700 1 -- 172.21.15.79:0/3000771339 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6815c560 con 0x7fdf68157870 2023-10-14T18:46:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.729+0000 7fdf6d4dd700 1 -- 172.21.15.79:0/3000771339 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304641124 0 0) 0x7fdf6815cbb0 con 0x7fdf6815a620 2023-10-14T18:46:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf6e4df700 1 --2- 172.21.15.79:0/3000771339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf68157870 0x7fdf6815b6a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009e60 tx=0x7fdf64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf0d265c54ad706 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf6d4dd700 1 -- 172.21.15.79:0/3000771339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400e070 con 0x7fdf68157870 2023-10-14T18:46:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf6d4dd700 1 -- 172.21.15.79:0/3000771339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400bbf0 con 0x7fdf68157870 2023-10-14T18:46:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf6d4dd700 1 -- 172.21.15.79:0/3000771339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64012430 con 0x7fdf68157870 2023-10-14T18:46:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 -- 172.21.15.79:0/3000771339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf68157870 msgr2=0x7fdf6815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 --2- 172.21.15.79:0/3000771339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf68157870 0x7fdf6815b6a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009e60 tx=0x7fdf64009780 comp rx=0 tx=0).stop 2023-10-14T18:46:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 -- 172.21.15.79:0/3000771339 shutdown_connections 2023-10-14T18:46:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 --2- 172.21.15.79:0/3000771339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf68157870 0x7fdf6815b6a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 -- 172.21.15.79:0/3000771339 >> 172.21.15.79:0/3000771339 conn(0x7fdf68068ce0 msgr2=0x7fdf680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 -- 172.21.15.79:0/3000771339 shutdown_connections 2023-10-14T18:46:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.730+0000 7fdf70743700 1 -- 172.21.15.79:0/3000771339 wait complete. 2023-10-14T18:46:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.731+0000 7fdf70743700 1 Processor -- start 2023-10-14T18:46:32.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.731+0000 7fdf70743700 1 -- start start 2023-10-14T18:46:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf68157870 0x7fdf6815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf68157c40 0x7fdf680a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6815e550 con 0x7fdf6815a620 2023-10-14T18:46:32.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680a89b0 con 0x7fdf68157870 2023-10-14T18:46:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf70743700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6815f350 con 0x7fdf68157c40 2023-10-14T18:46:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf6ece0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf6ece0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38016/0 (socket says 172.21.15.79:38016) 2023-10-14T18:46:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf6ece0700 1 -- 172.21.15.79:0/749538631 learned_addr learned my addr 172.21.15.79:0/749538631 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf6e4df700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf68157870 0x7fdf6815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.732+0000 7fdf6dcde700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf68157c40 0x7fdf680a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 -- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf68157c40 msgr2=0x7fdf680a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf68157c40 0x7fdf680a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 -- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf68157870 msgr2=0x7fdf6815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf68157870 0x7fdf6815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 -- 172.21.15.79:0/749538631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009a20 con 0x7fdf6815a620 2023-10-14T18:46:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf6ece0700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b5e0 tx=0x7fdf600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000f510 con 0x7fdf6815a620 2023-10-14T18:46:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000f690 con 0x7fdf6815a620 2023-10-14T18:46:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf68145d20 con 0x7fdf6815a620 2023-10-14T18:46:32.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000fa50 con 0x7fdf6815a620 2023-10-14T18:46:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.733+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6815ea20 con 0x7fdf6815a620 2023-10-14T18:46:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.734+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6804c3c0 con 0x7fdf6815a620 2023-10-14T18:46:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.734+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf6001a400 con 0x7fdf6815a620 2023-10-14T18:46:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.735+0000 7fdf5e7fc700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 0x7fdf4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:32.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.735+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf60083e50 con 0x7fdf6815a620 2023-10-14T18:46:32.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.735+0000 7fdf6e4df700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 0x7fdf4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:32.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.735+0000 7fdf6e4df700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 0x7fdf4c0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf640099f0 tx=0x7fdf64018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:32.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.739+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf60051140 con 0x7fdf6815a620 2023-10-14T18:46:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.967+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf6815f490 con 0x7fdf6815a620 2023-10-14T18:46:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.967+0000 7fdf5e7fc700 1 -- 172.21.15.79:0/749538631 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdf60054760 con 0x7fdf6815a620 2023-10-14T18:46:32.968 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:46:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 msgr2=0x7fdf4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 0x7fdf4c0693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf640099f0 tx=0x7fdf64018000 comp rx=0 tx=0).stop 2023-10-14T18:46:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 msgr2=0x7fdf681457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000b5e0 tx=0x7fdf600090f0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 shutdown_connections 2023-10-14T18:46:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf4c066f30 0x7fdf4c0693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf6815a620 0x7fdf681457e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf68157870 0x7fdf6815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 --2- 172.21.15.79:0/749538631 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf68157c40 0x7fdf680a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:32.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 >> 172.21.15.79:0/749538631 conn(0x7fdf68068ce0 msgr2=0x7fdf680690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:32.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 shutdown_connections 2023-10-14T18:46:32.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:32.969+0000 7fdf70743700 1 -- 172.21.15.79:0/749538631 wait complete. 2023-10-14T18:46:32.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:46:32.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:46:32.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:46:32.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:46:32.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:32.983 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:46:32.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:46:32.984 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:46:32.984 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:32.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:32.985 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:46:33.000 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:46:33.001 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:46:33.001 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:46:33.001 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.001 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:46:33.002 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.002 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:33.002 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:33.002 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:46:33.002 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:33.003 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:33.003 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:46:33.003 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:33.003 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:33.003 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:46:33.004 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:33.004 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:46:33.004 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42441sec preferred_lft 42441sec 2023-10-14T18:46:33.004 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:46:33.004 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:46:33.005 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.006 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:33.006 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:46:33.006 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:46:33.006 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.006 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:33.007 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:46:33.007 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:46:33.007 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:33.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.008 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:46:33.063 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:46:33.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.065 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:46:33.121 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:46:33.121 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:46:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:46:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:46:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:46:33.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.123 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:46:33.123 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:46:33.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:46:33.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:46:33.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:46:33.125 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:46:33.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.222 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:46:33.236 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:46:33.237 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:46:33.237 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:33.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:46:33.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:33.302 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:33.356 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:46:33.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:33.357 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:33.410 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:46:33.411 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:46:33.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:33.490 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:33.490 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:33.490 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:33.498 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:33.499 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:33.499 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:33.500 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:33.500 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:33.519 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:46:33.520 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:46:33.520 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:46:33.520 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:33.520 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:33.521 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:46:33.521 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:46:33.521 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:46:33.522 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:46:33.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:33.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:46:33.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.741+0000 7f31528ea700 1 Processor -- start 2023-10-14T18:46:33.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.741+0000 7f31528ea700 1 -- start start 2023-10-14T18:46:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31528ea700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 0x7f314c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31528ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f314c159fb0 0x7f314c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31528ea700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c067800 con 0x7f314c0692f0 2023-10-14T18:46:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31528ea700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0701f0 con 0x7f314c159fb0 2023-10-14T18:46:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31528ea700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c067ae0 con 0x7f314c159be0 2023-10-14T18:46:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f314c159fb0 0x7f314c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f314c159fb0 0x7f314c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38028/0 (socket says 172.21.15.79:38028) 2023-10-14T18:46:33.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 -- 172.21.15.79:0/1571379146 learned_addr learned my addr 172.21.15.79:0/1571379146 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31518e8700 1 --2- 172.21.15.79:0/1571379146 >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 0x7f314c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 -- 172.21.15.79:0/1571379146 >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 msgr2=0x7f314c068db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 --2- 172.21.15.79:0/1571379146 >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 0x7f314c068db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 -- 172.21.15.79:0/1571379146 >> v1:172.21.15.144:6789/0 conn(0x7f314c0692f0 legacy=0x7f314c0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 -- 172.21.15.79:0/1571379146 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c067dc0 con 0x7f314c159fb0 2023-10-14T18:46:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31518e8700 1 --2- 172.21.15.79:0/1571379146 >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 0x7f314c068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31510e7700 1 --2- 172.21.15.79:0/1571379146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0ce950 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f314c06efa0 tx=0x7f313c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb8ca0edcd281a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.742+0000 7f31508e6700 1 -- 172.21.15.79:0/1571379146 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00b860 con 0x7f314c159fb0 2023-10-14T18:46:33.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31508e6700 1 -- 172.21.15.79:0/1571379146 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00b9c0 con 0x7f314c159fb0 2023-10-14T18:46:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31508e6700 1 -- 172.21.15.79:0/1571379146 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00bd60 con 0x7f314c159fb0 2023-10-14T18:46:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 -- 172.21.15.79:0/1571379146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 msgr2=0x7f314c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 --2- 172.21.15.79:0/1571379146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0ce950 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f314c06efa0 tx=0x7f313c009250 comp rx=0 tx=0).stop 2023-10-14T18:46:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 -- 172.21.15.79:0/1571379146 shutdown_connections 2023-10-14T18:46:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 --2- 172.21.15.79:0/1571379146 >> v2:172.21.15.144:3300/0 conn(0x7f314c159be0 0x7f314c068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 --2- 172.21.15.79:0/1571379146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0ce950 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 -- 172.21.15.79:0/1571379146 >> 172.21.15.79:0/1571379146 conn(0x7f314c06bc70 msgr2=0x7f314c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 -- 172.21.15.79:0/1571379146 shutdown_connections 2023-10-14T18:46:33.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.743+0000 7f31528ea700 1 -- 172.21.15.79:0/1571379146 wait complete. 2023-10-14T18:46:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.744+0000 7f31528ea700 1 Processor -- start 2023-10-14T18:46:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.744+0000 7f31528ea700 1 -- start start 2023-10-14T18:46:33.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314c0692f0 0x7f314c157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f314c159be0 0x7f314c0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c158170 con 0x7f314c159fb0 2023-10-14T18:46:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0b1dc0 con 0x7f314c0692f0 2023-10-14T18:46:33.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31528ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0c6bc0 con 0x7f314c159be0 2023-10-14T18:46:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38044/0 (socket says 172.21.15.79:38044) 2023-10-14T18:46:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 -- 172.21.15.79:0/843264258 learned_addr learned my addr 172.21.15.79:0/843264258 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31518e8700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314c0692f0 0x7f314c157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31510e7700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f314c159be0 0x7f314c0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 -- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f314c159be0 msgr2=0x7f314c0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f314c159be0 0x7f314c0c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 -- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314c0692f0 msgr2=0x7f314c157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314c0692f0 0x7f314c157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 -- 172.21.15.79:0/843264258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0094f0 con 0x7f314c159fb0 2023-10-14T18:46:33.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.745+0000 7f31520e9700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f314400c840 tx=0x7f3144001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:33.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.746+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144012630 con 0x7f314c159fb0 2023-10-14T18:46:33.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.746+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31440127b0 con 0x7f314c159fb0 2023-10-14T18:46:33.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.746+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c0c6ea0 con 0x7f314c159fb0 2023-10-14T18:46:33.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.746+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144012b70 con 0x7f314c159fb0 2023-10-14T18:46:33.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.746+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c0c68d0 con 0x7f314c159fb0 2023-10-14T18:46:33.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.747+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c06e3e0 con 0x7f314c159fb0 2023-10-14T18:46:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.747+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f314401a3a0 con 0x7f314c159fb0 2023-10-14T18:46:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.747+0000 7f3141ffb700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.748+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3144084660 con 0x7f314c159fb0 2023-10-14T18:46:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.748+0000 7f31518e8700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:33.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.748+0000 7f31518e8700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f314c0c8550 tx=0x7f3148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:33.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.752+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31440518d0 con 0x7f314c159fb0 2023-10-14T18:46:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.978+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f314c04bb80 con 0x7f314c159fb0 2023-10-14T18:46:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.978+0000 7f3141ffb700 1 -- 172.21.15.79:0/843264258 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3144054ef0 con 0x7f314c159fb0 2023-10-14T18:46:33.979 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:46:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 msgr2=0x7f31300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f314c0c8550 tx=0x7f3148008040 comp rx=0 tx=0).stop 2023-10-14T18:46:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 msgr2=0x7f314c0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f314400c840 tx=0x7f3144001670 comp rx=0 tx=0).stop 2023-10-14T18:46:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 shutdown_connections 2023-10-14T18:46:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f314c159fb0 0x7f314c0b3bd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314c0692f0 0x7f314c157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 --2- 172.21.15.79:0/843264258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f314c159be0 0x7f314c0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 >> 172.21.15.79:0/843264258 conn(0x7f314c06bc70 msgr2=0x7f314c15ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 shutdown_connections 2023-10-14T18:46:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:33.980+0000 7f31528ea700 1 -- 172.21.15.79:0/843264258 wait complete. 2023-10-14T18:46:33.993 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:46:33.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:46:33.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:46:33.994 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:46:33.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:33.995 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:46:33.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:46:33.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:46:33.996 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:33.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:33.997 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:46:34.017 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:46:34.017 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:46:34.017 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:46:34.017 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.018 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:46:34.018 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.018 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:34.018 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:34.019 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:46:34.019 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:34.019 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:34.019 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:46:34.019 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:46:34.020 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:34.020 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:46:34.020 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:34.020 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:46:34.020 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42432sec preferred_lft 42432sec 2023-10-14T18:46:34.021 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:46:34.021 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.021 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:46:34.021 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:46:34.021 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:46:34.022 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.022 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:46:34.022 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.022 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:34.023 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:46:34.023 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:46:34.023 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.023 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:46:34.023 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:46:34.024 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:46:34.024 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:46:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.025 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:46:34.085 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:46:34.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.087 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:46:34.145 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:46:34.146 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:46:34.146 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:46:34.146 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:46:34.147 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:46:34.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.148 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:46:34.148 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:46:34.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:46:34.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:46:34.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:46:34.150 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:46:34.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.251 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:46:34.266 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:46:34.267 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:46:34.267 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:34.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:46:34.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:34.332 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:34.387 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:46:34.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:46:34.389 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:34.443 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:46:34.444 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:46:34.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:34.523 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:34.523 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:34.524 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:34.533 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:34.534 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:34.534 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:34.535 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:34.554 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:46:34.554 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:46:34.555 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:46:34.555 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:46:34.555 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:46:34.555 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:46:34.555 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:46:34.556 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:46:34.557 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:46:34.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:34.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:34.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.738+0000 7f0f7ed8c700 1 Processor -- start 2023-10-14T18:46:34.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.738+0000 7f0f7ed8c700 1 -- start start 2023-10-14T18:46:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7ed8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f7815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7ed8c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f780cb7c0 con 0x7f0f780cdab0 2023-10-14T18:46:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7ed8c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7815e290 con 0x7f0f780cd6e0 2023-10-14T18:46:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7ed8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7815e850 con 0x7f0f7815cbd0 2023-10-14T18:46:34.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7d589700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0f780cdab0 0x7f0f7815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36814/0 (socket says 172.21.15.79:36814) 2023-10-14T18:46:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7d589700 1 -- 172.21.15.79:0/2136276463 learned_addr learned my addr 172.21.15.79:0/2136276463 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7e58b700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f7815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422435086 0 0) 0x7f0f780cb7c0 con 0x7f0f780cdab0 2023-10-14T18:46:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f64003570 con 0x7f0f780cdab0 2023-10-14T18:46:34.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157846679 0 0) 0x7f0f64003570 con 0x7f0f780cdab0 2023-10-14T18:46:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 msgr2=0x7f0f7815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f7815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 >> v1:172.21.15.144:6789/0 conn(0x7f0f780cd6e0 legacy=0x7f0f780cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7815e570 con 0x7f0f780cdab0 2023-10-14T18:46:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0f68001470 con 0x7f0f780cdab0 2023-10-14T18:46:34.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.739+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 >> v1:172.21.15.79:6789/0 conn(0x7f0f780cdab0 legacy=0x7f0f7815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f64003a90 0x7f0f64003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64004810 0x7f0f64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f640051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7815e850 con 0x7f0f64003a90 2023-10-14T18:46:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6400bb60 con 0x7f0f64004810 2023-10-14T18:46:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6400bd20 con 0x7f0f7815cbd0 2023-10-14T18:46:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f64003a90 0x7f0f64003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7d589700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64004810 0x7f0f64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7e58b700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f640051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 -- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 msgr2=0x7f0f640051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f7815cbd0 0x7f0f640051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 -- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64004810 msgr2=0x7f0f64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64004810 0x7f0f64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 -- 172.21.15.79:0/2136276463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64003570 con 0x7f0f64003a90 2023-10-14T18:46:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7d589700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f64004810 0x7f0f64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f64003a90 0x7f0f64003ea0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0f74001fc0 tx=0x7f0f74001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1898773aa11602f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74001950 con 0x7f0f64003a90 2023-10-14T18:46:34.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400c8b0 con 0x7f0f64003a90 2023-10-14T18:46:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.740+0000 7f0f7cd88700 1 -- 172.21.15.79:0/2136276463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400cc50 con 0x7f0f64003a90 2023-10-14T18:46:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/2136276463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f64003a90 msgr2=0x7f0f64003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/2136276463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f64003a90 0x7f0f64003ea0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0f74001fc0 tx=0x7f0f74001640 comp rx=0 tx=0).stop 2023-10-14T18:46:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7e58b700 1 -- 172.21.15.79:0/2136276463 reap_dead start 2023-10-14T18:46:34.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/2136276463 shutdown_connections 2023-10-14T18:46:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/2136276463 >> 172.21.15.79:0/2136276463 conn(0x7f0f78067660 msgr2=0x7f0f78067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/2136276463 shutdown_connections 2023-10-14T18:46:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.741+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/2136276463 wait complete. 2023-10-14T18:46:34.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.742+0000 7f0f7ed8c700 1 Processor -- start 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.742+0000 7f0f7ed8c700 1 -- start start 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f64003a90 0x7f0f78158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f781558e0 0x7f0f780c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780cc360 con 0x7f0f780b5b60 2023-10-14T18:46:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780b6520 con 0x7f0f781558e0 2023-10-14T18:46:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7816e110 con 0x7f0f64003a90 2023-10-14T18:46:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38062/0 (socket says 172.21.15.79:38062) 2023-10-14T18:46:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 -- 172.21.15.79:0/3985654524 learned_addr learned my addr 172.21.15.79:0/3985654524 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f64003a90 0x7f0f78158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7d589700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f781558e0 0x7f0f780c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 -- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f64003a90 msgr2=0x7f0f78158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f64003a90 0x7f0f78158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 -- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f781558e0 msgr2=0x7f0f780c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f781558e0 0x7f0f780c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 -- 172.21.15.79:0/3985654524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7816e3f0 con 0x7f0f780b5b60 2023-10-14T18:46:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7e58b700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006f00 tx=0x7f0f700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70013750 con 0x7f0f780b5b60 2023-10-14T18:46:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f700138b0 con 0x7f0f780b5b60 2023-10-14T18:46:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7816e6d0 con 0x7f0f780b5b60 2023-10-14T18:46:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.743+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70013c50 con 0x7f0f780b5b60 2023-10-14T18:46:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.744+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7816ec90 con 0x7f0f780b5b60 2023-10-14T18:46:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.745+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7816ee50 con 0x7f0f780b5b60 2023-10-14T18:46:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.745+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f70014650 con 0x7f0f780b5b60 2023-10-14T18:46:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.745+0000 7f0f6dffb700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 0x7f0f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.745+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f70084900 con 0x7f0f780b5b60 2023-10-14T18:46:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.745+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 0x7f0f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.746+0000 7f0f7dd8a700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 0x7f0f5c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f78156660 tx=0x7f0f74015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.749+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f70051bf0 con 0x7f0f780b5b60 2023-10-14T18:46:34.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.982+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f7804bb80 con 0x7f0f780b5b60 2023-10-14T18:46:34.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.982+0000 7f0f6dffb700 1 -- 172.21.15.79:0/3985654524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f0f70022090 con 0x7f0f780b5b60 2023-10-14T18:46:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:34.984 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:34.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 msgr2=0x7f0f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 0x7f0f5c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f78156660 tx=0x7f0f74015000 comp rx=0 tx=0).stop 2023-10-14T18:46:34.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 msgr2=0x7f0f780b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:34.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006f00 tx=0x7f0f700091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 shutdown_connections 2023-10-14T18:46:34.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f5c066f30 0x7f0f5c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f780b5b60 0x7f0f780b5fe0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f64003a90 0x7f0f78158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 --2- 172.21.15.79:0/3985654524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f781558e0 0x7f0f780c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:34.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 >> 172.21.15.79:0/3985654524 conn(0x7f0f78067660 msgr2=0x7f0f781566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:34.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 shutdown_connections 2023-10-14T18:46:34.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:34.985+0000 7f0f7ed8c700 1 -- 172.21.15.79:0/3985654524 wait complete. 2023-10-14T18:46:34.989 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:34.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:46:35.132 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3232352150000004,"mdsmap_epoch":24,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":14.303041673999999} 2023-10-14T18:46:35.132 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 24, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 8.323235215, "state": "up:active", "uptime": 14.303041674, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:46:35.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:46:35.263 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:46:35.263 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:46:35.264 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-14T18:46:35.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:35.265 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-14T18:46:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:265+0 records in 2023-10-14T18:46:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:265+0 records out 2023-10-14T18:46:36.612 INFO:teuthology.orchestra.run.smithi079.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.32817 s, 209 MB/s 2023-10-14T18:46:36.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:36.612 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-14T18:46:38.132 INFO:teuthology.orchestra.run.smithi079.stderr:292+0 records in 2023-10-14T18:46:38.132 INFO:teuthology.orchestra.run.smithi079.stderr:292+0 records out 2023-10-14T18:46:38.132 INFO:teuthology.orchestra.run.smithi079.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.50226 s, 204 MB/s 2023-10-14T18:46:38.132 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-14T18:46:38.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:38.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.246+0000 7f3a0f3fe700 1 Processor -- start 2023-10-14T18:46:38.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.246+0000 7f3a0f3fe700 1 -- start start 2023-10-14T18:46:38.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0f3fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a080cdab0 0x7f3a0815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0f3fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a0815dda0 0x7f3a0815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0f3fe700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cb7c0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0f3fe700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0815e850 con 0x7f3a0815dda0 2023-10-14T18:46:38.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0f3fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080cc360 con 0x7f3a080cdab0 2023-10-14T18:46:38.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a0815dda0 0x7f3a0815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a0815dda0 0x7f3a0815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38068/0 (socket says 172.21.15.79:38068) 2023-10-14T18:46:38.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 -- 172.21.15.79:0/1127410713 learned_addr learned my addr 172.21.15.79:0/1127410713 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:38.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0dbfb700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a080cdab0 0x7f3a0815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 -- 172.21.15.79:0/1127410713 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a080cdab0 msgr2=0x7f3a0815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:38.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a080cdab0 0x7f3a0815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 -- 172.21.15.79:0/1127410713 >> v1:172.21.15.144:6789/0 conn(0x7f3a080cd6e0 legacy=0x7f3a080cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.247+0000 7f3a0ebfd700 1 -- 172.21.15.79:0/1127410713 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0815e290 con 0x7f3a0815dda0 2023-10-14T18:46:38.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0ebfd700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0815dda0 0x7f3a0815cbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a000099b0 tx=0x7f3a00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6cac47dd967ae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:38.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0d3fa700 1 -- 172.21.15.79:0/1127410713 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00009ea0 con 0x7f3a0815dda0 2023-10-14T18:46:38.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0d3fa700 1 -- 172.21.15.79:0/1127410713 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000b860 con 0x7f3a0815dda0 2023-10-14T18:46:38.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0d3fa700 1 -- 172.21.15.79:0/1127410713 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000bc00 con 0x7f3a0815dda0 2023-10-14T18:46:38.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/1127410713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0815dda0 msgr2=0x7f3a0815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0815dda0 0x7f3a0815cbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a000099b0 tx=0x7f3a00009250 comp rx=0 tx=0).stop 2023-10-14T18:46:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/1127410713 shutdown_connections 2023-10-14T18:46:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a0815dda0 0x7f3a0815cbd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/1127410713 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a080cdab0 0x7f3a0815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/1127410713 >> 172.21.15.79:0/1127410713 conn(0x7f3a08067660 msgr2=0x7f3a08067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:38.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/1127410713 shutdown_connections 2023-10-14T18:46:38.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.248+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/1127410713 wait complete. 2023-10-14T18:46:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.249+0000 7f3a0f3fe700 1 Processor -- start 2023-10-14T18:46:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 -- start start 2023-10-14T18:46:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a080cdab0 0x7f3a080b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0815dda0 0x7f3a080b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c8650 con 0x7f3a080cd6e0 2023-10-14T18:46:38.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0814d030 con 0x7f3a080cdab0 2023-10-14T18:46:38.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0f3fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080b49e0 con 0x7f3a0815dda0 2023-10-14T18:46:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0e3fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0e3fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38078/0 (socket says 172.21.15.79:38078) 2023-10-14T18:46:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.250+0000 7f3a0e3fc700 1 -- 172.21.15.79:0/3240263360 learned_addr learned my addr 172.21.15.79:0/3240263360 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:38.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 -- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0815dda0 msgr2=0x7f3a080b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0ebfd700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0815dda0 0x7f3a080b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0dbfb700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a080cdab0 0x7f3a080b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0815dda0 0x7f3a080b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 -- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a080cdab0 msgr2=0x7f3a080b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a080cdab0 0x7f3a080b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 -- 172.21.15.79:0/3240263360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000094f0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0e3fc700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cb10 tx=0x7f3a040017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:38.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400a760 con 0x7f3a080cd6e0 2023-10-14T18:46:38.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400a8e0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080c7d20 con 0x7f3a080cd6e0 2023-10-14T18:46:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0400aca0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.251+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080c82e0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.252+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08089280 con 0x7f3a080cd6e0 2023-10-14T18:46:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.252+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a04003030 con 0x7f3a080cd6e0 2023-10-14T18:46:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.253+0000 7f39fe7fc700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.253+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a04084700 con 0x7f3a080cd6e0 2023-10-14T18:46:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.253+0000 7f3a0dbfb700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.253+0000 7f3a0dbfb700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 0x7f39ec0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39f80093f0 tx=0x7f39f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:38.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.257+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a04051980 con 0x7f3a080cd6e0 2023-10-14T18:46:38.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.439+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3a080cfa70 con 0x7f3a080cd6e0 2023-10-14T18:46:38.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.440+0000 7f39fe7fc700 1 -- 172.21.15.79:0/3240263360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f3a04054fa0 con 0x7f3a080cd6e0 2023-10-14T18:46:38.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:38.442 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:38.442 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 45, 2023-10-14T18:46:38.442 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:38.442 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:38.443 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:27.784949+0000", 2023-10-14T18:46:38.443 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:38.443 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:38.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:38.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:38.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:38.444 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:38.444 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:38.444 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:38.444 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:38.445 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:38.445 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:38.445 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:38.445 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:38.445 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:38.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:38.446 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:38.446 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:38.446 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:38.447 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:38.447 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:38.447 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:38.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.448 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:38.448 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:38.448 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:38.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:38.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:38.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:38.449 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:38.449 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:38.449 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:38.449 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:38.450 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:38.450 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:38.450 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:38.450 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:38.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:38.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:38.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:38.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:38.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:38.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:38.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:38.452 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:38.452 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:38.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:38.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:38.453 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:38.453 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:38.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.453 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2023-10-14T18:46:38.453 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:38.454 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:38.454 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:38.454 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:38.454 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:38.455 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:38.455 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:38.455 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:38.455 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:38.455 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:38.456 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:38.456 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:38.456 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:38.456 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:38.457 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:38.457 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:38.457 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:38.457 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:38.458 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:38.458 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:38.458 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:38.458 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:38.458 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:38.459 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:38.460 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:38.460 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:38.460 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:38.460 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:38.460 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:38.461 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:38.461 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:38.461 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:38.461 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:38.462 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:38.462 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:38.462 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:38.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.463 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:38.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:38.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:38.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:38.464 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:38.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:38.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:38.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:38.465 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:38.465 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:38.466 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:38.466 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:38.466 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:38.466 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:38.466 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:38.467 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:38.467 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:38.467 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:38.467 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:38.468 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:38.468 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:38.468 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:38.468 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:38.470 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:38.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.470 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "44", 2023-10-14T18:46:38.470 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:38.470 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:38.471 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:38.471 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:38.471 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:38.471 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:38.472 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:38.472 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:38.472 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:38.472 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:38.472 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:38.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:38.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:38.473 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:38.473 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:38.474 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:38.474 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:38.474 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:38.474 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:38.475 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:38.475 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:38.475 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:38.475 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:38.475 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:38.476 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:38.477 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:38.477 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:38.477 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:38.477 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:38.477 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:38.478 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:38.478 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:38.478 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:38.478 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:38.478 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "45", 2023-10-14T18:46:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:38.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:38.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.582 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:38.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:38.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:38.585 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:38.586 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.587 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:38.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:38.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:38.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.592 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:38.592 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:38.592 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:38.592 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.594 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:38.594 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.594 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.594 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.594 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.595 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.595 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.595 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.595 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.595 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.596 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.596 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.596 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:38.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:38.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:38.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:38.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:38.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:38.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:38.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.608 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:38.608 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:38.608 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:38.608 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:38.610 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:38.611 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:38.611 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:38.611 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:38.611 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:38.611 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:38.612 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:38.612 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:38.612 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:38.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:38.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:38.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:38.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:38.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:38.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:38.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:38.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:38.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:38.622 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:38.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:38.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:38.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.624 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:38.624 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:38.624 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:38.624 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:38.625 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:38.625 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:38.625 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:38.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:38.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.626 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:38.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:38.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:38.626 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.627 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.627 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.627 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.628 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.629 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.629 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.629 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.629 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:38.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.630 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:38.630 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.630 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.631 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.631 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.631 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:38.632 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.632 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:38.633 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.633 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.633 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.633 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.633 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.634 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:38.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.634 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:38.635 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.635 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.635 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.635 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.635 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.636 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:38.636 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.636 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:38.637 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.637 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.637 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.637 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.637 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.638 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:38.639 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.639 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.639 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.639 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.640 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.640 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:38.640 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:38.641 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:38.641 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:38.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:38.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:38.642 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:38.642 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:38.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:38.642 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:38.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.643 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:38.643 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:38.643 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:38.643 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:38.643 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:38.644 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:38.644 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:38.644 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:38.644 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:38.644 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:38.645 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:38.645 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:38.645 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:38.645 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:38.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:38.646 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:38.646 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:38.646 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:38.647 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:38.647 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:38.647 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:38.647 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:38.647 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:38.648 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:38.648 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:38.648 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:38.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:38.648 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:38.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 msgr2=0x7f39ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 0x7f39ec0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39f80093f0 tx=0x7f39f8008040 comp rx=0 tx=0).stop 2023-10-14T18:46:38.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 msgr2=0x7f3a0814caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:38.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400cb10 tx=0x7f3a040017b0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 shutdown_connections 2023-10-14T18:46:38.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f39ec066f30 0x7f39ec0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a0815dda0 0x7f3a080b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a080cd6e0 0x7f3a0814caf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 --2- 172.21.15.79:0/3240263360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a080cdab0 0x7f3a080b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:38.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 >> 172.21.15.79:0/3240263360 conn(0x7f3a08067660 msgr2=0x7f3a080d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:38.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 shutdown_connections 2023-10-14T18:46:38.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:38.442+0000 7f3a0f3fe700 1 -- 172.21.15.79:0/3240263360 wait complete. 2023-10-14T18:46:38.654 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:46:39.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:39.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:39.488 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:46:39.488+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-14T18:46:43.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:43.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.780+0000 7fd71329d700 1 Processor -- start 2023-10-14T18:46:43.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.780+0000 7fd71329d700 1 -- start start 2023-10-14T18:46:43.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71329d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd70c0c9af0 0x7fd70c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71329d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd70c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71329d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c071080 con 0x7fd70c1510f0 2023-10-14T18:46:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71329d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0ca0b0 con 0x7fd70c0c9af0 2023-10-14T18:46:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71329d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c068a10 con 0x7fd70c070700 2023-10-14T18:46:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd711039700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd70c1510f0 0x7fd70c15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33568/0 (socket says 172.21.15.79:33568) 2023-10-14T18:46:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd711039700 1 -- 172.21.15.79:0/2259308809 learned_addr learned my addr 172.21.15.79:0/2259308809 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd710838700 1 --2- 172.21.15.79:0/2259308809 >> v2:172.21.15.144:3300/0 conn(0x7fd70c0c9af0 0x7fd70c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd71183a700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd70c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024733788 0 0) 0x7fd70c071080 con 0x7fd70c1510f0 2023-10-14T18:46:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f4003570 con 0x7fd70c1510f0 2023-10-14T18:46:43.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779514315 0 0) 0x7fd6f4003570 con 0x7fd70c1510f0 2023-10-14T18:46:43.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 msgr2=0x7fd70c070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:43.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd70c070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 >> v2:172.21.15.144:3300/0 conn(0x7fd70c0c9af0 msgr2=0x7fd70c06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:43.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 --2- 172.21.15.79:0/2259308809 >> v2:172.21.15.144:3300/0 conn(0x7fd70c0c9af0 0x7fd70c06ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c068cf0 con 0x7fd70c1510f0 2023-10-14T18:46:43.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd6fc0017f0 con 0x7fd70c1510f0 2023-10-14T18:46:43.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 >> v1:172.21.15.79:6789/0 conn(0x7fd70c1510f0 legacy=0x7fd70c15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:43.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd6f4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f4003fe0 0x7fd6f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6f4004d50 0x7fd6f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0ca0b0 con 0x7fd6f4003fe0 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c068a10 con 0x7fd6f4004d50 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f400ba90 con 0x7fd70c070700 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.781+0000 7fd710838700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f4003fe0 0x7fd6f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd711039700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd6f4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd71183a700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6f4004d50 0x7fd6f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 -- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 msgr2=0x7fd6f4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:43.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd70c070700 0x7fd6f4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 -- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6f4004d50 msgr2=0x7fd6f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:43.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6f4004d50 0x7fd6f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 -- 172.21.15.79:0/2259308809 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4003570 con 0x7fd6f4003fe0 2023-10-14T18:46:43.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd710838700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f4003fe0 0x7fd6f4004810 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd700009c00 tx=0x7fd7000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e9996bad09110b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:43.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000e6b0 con 0x7fd6f4003fe0 2023-10-14T18:46:43.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000e810 con 0x7fd6f4003fe0 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd70bfff700 1 -- 172.21.15.79:0/2259308809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000ebd0 con 0x7fd6f4003fe0 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd71329d700 1 -- 172.21.15.79:0/2259308809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f4003fe0 msgr2=0x7fd6f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.782+0000 7fd71329d700 1 --2- 172.21.15.79:0/2259308809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6f4003fe0 0x7fd6f4004810 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd700009c00 tx=0x7fd7000091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.783+0000 7fd71183a700 1 -- 172.21.15.79:0/2259308809 reap_dead start 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.783+0000 7fd71329d700 1 -- 172.21.15.79:0/2259308809 shutdown_connections 2023-10-14T18:46:43.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.783+0000 7fd71329d700 1 -- 172.21.15.79:0/2259308809 >> 172.21.15.79:0/2259308809 conn(0x7fd70c0ca4f0 msgr2=0x7fd70c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.783+0000 7fd71329d700 1 -- 172.21.15.79:0/2259308809 shutdown_connections 2023-10-14T18:46:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.783+0000 7fd71329d700 1 -- 172.21.15.79:0/2259308809 wait complete. 2023-10-14T18:46:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.784+0000 7fd71329d700 1 Processor -- start 2023-10-14T18:46:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.784+0000 7fd71329d700 1 -- start start 2023-10-14T18:46:43.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6f4003fe0 0x7fd70c13f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd70c0c7260 0x7fd70c0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c76c0 con 0x7fd70c16b990 2023-10-14T18:46:43.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c13f640 con 0x7fd70c0c7260 2023-10-14T18:46:43.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15c8c0 con 0x7fd6f4003fe0 2023-10-14T18:46:43.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44860/0 (socket says 172.21.15.79:44860) 2023-10-14T18:46:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 -- 172.21.15.79:0/3522731590 learned_addr learned my addr 172.21.15.79:0/3522731590 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71183a700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd70c0c7260 0x7fd70c0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd711039700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6f4003fe0 0x7fd70c13f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 -- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6f4003fe0 msgr2=0x7fd70c13f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6f4003fe0 0x7fd70c13f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 -- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd70c0c7260 msgr2=0x7fd70c0c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd70c0c7260 0x7fd70c0c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c15ce80 con 0x7fd70c16b990 2023-10-14T18:46:43.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd710838700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4004730 tx=0x7fd70001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700022070 con 0x7fd70c16b990 2023-10-14T18:46:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000e980 con 0x7fd70c16b990 2023-10-14T18:46:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0c78c0 con 0x7fd70c16b990 2023-10-14T18:46:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700027470 con 0x7fd70c16b990 2023-10-14T18:46:43.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.785+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c15cb10 con 0x7fd70c16b990 2023-10-14T18:46:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.786+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0c8df0 con 0x7fd70c16b990 2023-10-14T18:46:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.787+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd70001c450 con 0x7fd70c16b990 2023-10-14T18:46:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.787+0000 7fd7097fa700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:43.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.787+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd700085f70 con 0x7fd70c16b990 2023-10-14T18:46:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.787+0000 7fd711039700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.787+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fd6f806ea50 con 0x7fd70c16b990 2023-10-14T18:46:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.788+0000 7fd711039700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 0x7fd6f80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0019a0 tx=0x7fd6fc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:43.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.791+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7000b75a0 con 0x7fd70c16b990 2023-10-14T18:46:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.977+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd70c0c7660 con 0x7fd70c16b990 2023-10-14T18:46:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.978+0000 7fd7097fa700 1 -- 172.21.15.79:0/3522731590 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fd70002c060 con 0x7fd70c16b990 2023-10-14T18:46:43.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:43.980 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:43.980 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 48, 2023-10-14T18:46:43.980 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:43.981 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:43.981 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:41.499171+0000", 2023-10-14T18:46:43.981 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:43.982 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:43.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:43.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:43.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:43.983 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:43.984 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:43.984 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:43.985 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:43.985 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:43.985 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:43.985 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:43.986 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:43.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:43.986 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:43.986 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:43.987 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:43.987 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:43.987 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:43.988 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:43.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:43.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:43.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:43.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:43.989 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:43.990 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:43.990 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:43.990 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:43.990 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:43.991 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:43.991 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:43.991 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:43.991 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:43.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:43.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:43.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:43.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:43.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:43.993 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:43.993 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:43.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:43.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:43.994 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:43.994 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:43.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:43.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:43.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:43.995 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:43.995 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:43.995 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:43.995 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:43.996 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:43.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:43.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:43.997 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:43.997 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:43.997 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:43.998 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:43.998 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:43.998 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:43.998 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:43.999 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:43.999 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:43.999 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:43.999 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:43.999 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.000 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.000 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.001 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.001 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.002 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.002 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.002 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.003 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.003 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.003 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:44.004 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:44.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.004 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.004 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:44.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:44.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:44.006 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:44.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:44.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:44.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:44.006 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:44.007 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:44.008 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:44.008 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:44.008 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:44.008 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:44.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:44.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:44.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:44.009 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:44.010 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:44.010 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:44.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:44.010 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:44.010 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:44.011 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:44.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:44.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:44.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:44.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:44.012 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:44.012 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:44.012 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:44.013 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:44.013 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:44.013 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:44.013 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:44.013 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:44.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:44.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:44.014 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:44.014 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:44.015 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:44.015 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:44.015 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:44.015 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:44.015 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:44.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:44.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:44.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:44.016 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:44.016 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.017 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.017 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.017 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.018 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.018 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.018 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.018 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.019 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.019 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.019 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.019 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:44.020 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:44.020 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:44.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.020 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.020 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.022 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:44.022 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:44.022 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:44.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:44.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:44.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:44.023 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:44.023 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:44.023 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:44.023 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:44.024 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:44.024 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:44.024 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:44.024 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:44.024 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:44.025 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:44.025 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:44.025 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:44.026 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:44.026 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:44.026 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:44.027 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:44.027 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:44.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:44.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:44.028 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:44.029 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:44.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.030 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:44.030 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:44.030 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:44.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:44.031 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:44.031 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:44.032 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:44.032 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:44.033 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:44.033 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:44.033 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:44.034 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:44.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:44.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:44.035 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:44.035 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:44.035 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:44.036 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:44.036 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:44.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:44.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:44.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:44.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:44.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:44.038 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:44.038 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.040 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.041 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.041 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.041 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.041 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.041 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:44.042 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:44.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.042 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.042 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:44.042 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:44.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.043 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.043 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.044 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.045 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.045 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.045 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.046 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.046 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.046 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:44.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:44.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:44.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:44.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.051 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:44.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:44.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.054 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.056 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:44.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.057 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:44.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:44.057 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:44.057 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:44.058 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.058 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.058 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:44.059 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.060 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.060 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.060 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.061 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.061 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.062 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:44.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.064 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:44.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:46:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:44.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:44.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.168 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:44.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:44.170 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.171 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:44.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.176 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:44.176 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.177 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:44.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:44.177 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:44.178 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:44.178 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.178 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.179 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.179 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.180 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:44.181 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.181 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.181 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.182 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.182 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.183 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.183 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.184 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.184 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.184 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:44.186 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.187 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:44.187 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.188 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.188 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:44.189 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.190 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:44.190 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.191 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.191 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:44.192 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.193 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:44.193 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.194 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.194 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:44.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.197 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:44.197 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:44.197 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:44.197 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:44.197 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.198 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.198 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.198 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.199 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:44.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.200 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.201 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:44.201 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.201 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.202 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.203 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.203 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:44.204 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.205 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:44.205 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.205 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.206 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.206 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.206 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.207 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:44.207 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.208 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:44.208 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.208 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.209 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.209 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.209 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.210 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:44.210 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.211 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:44.211 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.211 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.211 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.212 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.212 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.212 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:44.212 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.213 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:44.213 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.214 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.214 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.214 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.215 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:44.215 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.217 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:44.217 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.218 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.218 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.219 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.219 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.219 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:44.220 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.220 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:44.221 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.221 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.221 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.222 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.222 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:44.223 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.223 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:44.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:44.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:44.225 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:44.225 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:44.225 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:44.225 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:44.226 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:44.226 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:44.227 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:44.227 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:44.228 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:44.228 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:44.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.229 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:44.229 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:44.230 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:44.230 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:44.231 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:44.231 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:44.231 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:44.232 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:44.232 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:44.233 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:44.233 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:44.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.234 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:44.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 msgr2=0x7fd6f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 0x7fd6f80693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0019a0 tx=0x7fd6fc006040 comp rx=0 tx=0).stop 2023-10-14T18:46:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 msgr2=0x7fd70c0c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4004730 tx=0x7fd70001a000 comp rx=0 tx=0).stop 2023-10-14T18:46:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 shutdown_connections 2023-10-14T18:46:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd6f8066f30 0x7fd6f80693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd70c0c7260 0x7fd70c0c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6f4003fe0 0x7fd70c13f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 --2- 172.21.15.79:0/3522731590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd70c16b990 0x7fd70c0c6d20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 >> 172.21.15.79:0/3522731590 conn(0x7fd70c0ca4f0 msgr2=0x7fd70c15ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:44.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 shutdown_connections 2023-10-14T18:46:44.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:43.980+0000 7fd71329d700 1 -- 172.21.15.79:0/3522731590 wait complete. 2023-10-14T18:46:44.239 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-14T18:46:44.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:44.240 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-14T18:46:44.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:46:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-14T18:46:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:46:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:46:44.490 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.228747 s, 229 MB/s 2023-10-14T18:46:44.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.604+0000 7fecb0749700 1 Processor -- start 2023-10-14T18:46:44.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.604+0000 7fecb0749700 1 -- start start 2023-10-14T18:46:44.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecb0749700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 0x7feca815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecb0749700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feca815a0c0 0x7feca80ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecb0749700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca80cca20 con 0x7feca80ce1a0 2023-10-14T18:46:44.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecb0749700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca815ea40 con 0x7feca815a0c0 2023-10-14T18:46:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecb0749700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca8067660 con 0x7feca8159cf0 2023-10-14T18:46:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecadce4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feca815a0c0 0x7feca80ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecaece6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feca80ce1a0 0x7feca80cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33572/0 (socket says 172.21.15.79:33572) 2023-10-14T18:46:44.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecaece6700 1 -- 172.21.15.79:0/4217772207 learned_addr learned my addr 172.21.15.79:0/4217772207 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.605+0000 7fecae4e5700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 0x7feca815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecadce4700 1 -- 172.21.15.79:0/4217772207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 msgr2=0x7feca815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecadce4700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 0x7feca815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecadce4700 1 -- 172.21.15.79:0/4217772207 >> v1:172.21.15.79:6789/0 conn(0x7feca80ce1a0 legacy=0x7feca80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecad4e3700 1 -- 172.21.15.79:0/4217772207 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505059773 0 0) 0x7feca80cca20 con 0x7feca80ce1a0 2023-10-14T18:46:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecadce4700 1 -- 172.21.15.79:0/4217772207 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8067f00 con 0x7feca815a0c0 2023-10-14T18:46:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecae4e5700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 0x7feca815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecadce4700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca815a0c0 0x7feca80ceab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec980098e0 tx=0x7fec980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65acd680d5f567c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:44.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecad4e3700 1 -- 172.21.15.79:0/4217772207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98009e80 con 0x7feca815a0c0 2023-10-14T18:46:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecad4e3700 1 -- 172.21.15.79:0/4217772207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800b860 con 0x7feca815a0c0 2023-10-14T18:46:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecad4e3700 1 -- 172.21.15.79:0/4217772207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800bbe0 con 0x7feca815a0c0 2023-10-14T18:46:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 -- 172.21.15.79:0/4217772207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca815a0c0 msgr2=0x7feca80ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca815a0c0 0x7feca80ceab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec980098e0 tx=0x7fec980091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 -- 172.21.15.79:0/4217772207 shutdown_connections 2023-10-14T18:46:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca8159cf0 0x7feca815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 --2- 172.21.15.79:0/4217772207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca815a0c0 0x7feca80ceab0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 -- 172.21.15.79:0/4217772207 >> 172.21.15.79:0/4217772207 conn(0x7feca806c6e0 msgr2=0x7feca8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 -- 172.21.15.79:0/4217772207 shutdown_connections 2023-10-14T18:46:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.606+0000 7fecb0749700 1 -- 172.21.15.79:0/4217772207 wait complete. 2023-10-14T18:46:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.607+0000 7fecb0749700 1 Processor -- start 2023-10-14T18:46:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.607+0000 7fecb0749700 1 -- start start 2023-10-14T18:46:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca80ce1a0 0x7feca8151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca815a0c0 0x7feca80c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c60d0 con 0x7feca8159cf0 2023-10-14T18:46:44.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c6f30 con 0x7feca80ce1a0 2023-10-14T18:46:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecb0749700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c73c0 con 0x7feca815a0c0 2023-10-14T18:46:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecadce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecadce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44868/0 (socket says 172.21.15.79:44868) 2023-10-14T18:46:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.608+0000 7fecadce4700 1 -- 172.21.15.79:0/795962241 learned_addr learned my addr 172.21.15.79:0/795962241 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 -- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca815a0c0 msgr2=0x7feca80c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca815a0c0 0x7feca80c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 -- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca80ce1a0 msgr2=0x7feca8151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca80ce1a0 0x7feca8151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:44.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009420 con 0x7feca8159cf0 2023-10-14T18:46:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecadce4700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec98013000 tx=0x7fec98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98011420 con 0x7feca8159cf0 2023-10-14T18:46:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec980115a0 con 0x7feca8159cf0 2023-10-14T18:46:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98011960 con 0x7feca8159cf0 2023-10-14T18:46:44.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca815e780 con 0x7feca8159cf0 2023-10-14T18:46:44.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.609+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca80c6600 con 0x7feca8159cf0 2023-10-14T18:46:44.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.610+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca804c3c0 con 0x7feca8159cf0 2023-10-14T18:46:44.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.610+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec980253f0 con 0x7feca8159cf0 2023-10-14T18:46:44.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.611+0000 7fec9e7fc700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:44.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.611+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec98085fe0 con 0x7feca8159cf0 2023-10-14T18:46:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.611+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fec8c06ea50 con 0x7feca8159cf0 2023-10-14T18:46:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.611+0000 7fecae4e5700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.611+0000 7fecae4e5700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 0x7fec8c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feca4007aa0 tx=0x7feca4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.615+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec98053250 con 0x7feca8159cf0 2023-10-14T18:46:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.800+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feca80ce730 con 0x7feca8159cf0 2023-10-14T18:46:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.801+0000 7fec9e7fc700 1 -- 172.21.15.79:0/795962241 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fec98015070 con 0x7feca8159cf0 2023-10-14T18:46:44.802 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:44.802 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:44.802 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 48, 2023-10-14T18:46:44.802 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:44.803 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:44.803 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:41.499171+0000", 2023-10-14T18:46:44.803 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:44.803 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:44.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:44.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:44.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:44.804 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:44.804 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:44.804 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:44.805 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:44.805 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.805 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:44.805 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:44.805 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:44.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:44.807 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:44.807 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:44.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.807 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:44.808 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:44.808 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:44.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:44.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:44.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:44.809 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:44.809 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:44.809 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:44.809 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:44.809 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:44.810 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:44.810 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:44.810 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:44.810 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:44.810 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:44.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:44.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:44.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:44.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:44.811 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:44.812 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:44.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.813 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:44.813 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:44.813 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:44.813 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:44.814 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:44.814 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:44.814 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:44.814 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:44.814 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:44.815 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:44.815 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:44.815 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:44.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:44.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:44.816 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:44.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:44.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:44.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:44.817 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:44.817 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:44.818 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.818 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.818 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.819 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.819 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.819 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.819 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.820 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.820 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.820 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.820 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.820 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:44.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.822 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:44.822 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:44.822 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:44.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:44.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:44.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:44.823 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:44.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:44.824 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:44.824 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:44.824 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:44.824 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:44.824 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:44.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:44.826 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:44.826 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:44.826 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:44.826 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:44.826 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:44.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:44.827 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:44.827 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:44.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:44.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:44.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:44.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:44.828 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:44.828 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:44.829 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:44.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:44.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:44.830 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:44.830 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:44.830 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:44.831 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:44.831 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:44.831 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:44.831 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:44.831 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:44.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:44.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:44.832 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:44.832 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.833 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.833 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.833 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.833 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.834 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.834 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.834 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.834 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.835 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.835 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.835 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.835 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:44.835 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:44.836 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:44.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.836 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.836 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:44.836 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:44.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.837 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:44.838 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:44.838 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:44.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:44.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:44.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:44.839 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:44.839 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:44.839 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:44.839 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:44.839 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:44.840 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:44.840 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:44.840 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:44.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:44.840 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:44.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:44.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:44.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:44.841 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:44.841 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:44.842 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:44.842 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:44.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:44.842 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:44.842 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:44.843 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:44.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:44.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:44.843 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:44.844 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:44.844 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:44.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:44.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:44.844 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:44.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:44.846 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:44.846 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:44.846 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:44.846 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:44.846 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:44.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:44.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:44.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:44.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:44.847 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:44.848 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:44.848 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:44.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:44.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.848 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:44.849 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:44.849 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:44.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:44.849 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:44.849 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:44.850 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:44.850 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:44.850 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:44.850 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:44.850 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:44.851 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:44.851 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:44.851 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:44.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.851 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.852 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.853 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:44.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.853 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:44.853 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.853 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.854 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.854 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.854 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.854 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.854 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.855 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.857 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:44.857 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.858 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.858 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.858 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:44.860 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.861 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:44.862 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.862 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:44.863 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.863 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:44.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:44.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:44.866 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.867 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.868 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.869 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.870 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.878 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:44.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:44.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:44.881 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.884 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.885 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.892 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.893 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:44.896 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.897 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:44.898 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.899 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.900 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.900 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.900 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.900 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.900 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.901 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:44.901 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.902 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:44.902 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.903 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.903 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.904 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:44.904 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.905 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:44.909 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:44.910 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:44.911 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:46:44.912 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:44.913 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.914 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.915 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:44.917 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.918 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.919 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.920 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:44.920 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.921 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:44.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.922 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.922 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.922 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:44.923 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.923 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:44.924 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.924 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:44.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.926 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:44.926 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:44.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.927 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:44.927 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.929 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:44.929 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.929 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.930 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.930 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.930 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.931 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.931 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.931 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.931 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.931 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:44.932 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:44.933 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:44.935 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:44.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.937 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.937 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.938 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:44.939 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.939 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:44.941 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:44.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.942 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:44.942 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:44.944 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.944 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.945 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.945 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.945 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.945 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.945 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.946 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.946 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.946 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.946 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.946 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:44.947 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:44.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.949 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:44.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:44.953 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:44.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:44.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:44.956 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:44.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.957 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:44.957 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:44.958 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:44.958 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:44.958 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.958 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.958 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.959 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.959 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:44.960 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:44.960 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:44.960 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:44.960 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:44.960 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:44.961 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:44.961 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:44.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:44.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:44.961 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:44.963 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:44.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:44.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:44.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.967 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:44.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:44.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:44.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:44.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:44.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:44.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:44.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.974 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:44.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:44.975 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.975 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.976 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.976 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.976 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.976 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:44.976 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.977 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.978 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.978 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.978 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:44.978 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.979 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.980 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.980 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.980 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:44.980 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.981 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.982 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.982 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:44.982 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.983 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:44.983 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.983 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.983 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.983 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.984 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:44.985 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.985 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.985 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.985 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.985 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.986 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:44.986 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.986 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.987 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:44.988 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:44.988 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:44.988 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:44.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:44.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:44.989 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:44.989 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:44.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:44.990 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:44.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.990 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:44.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:44.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:44.993 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:44.993 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:44.993 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:44.994 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:44.994 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:44.994 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:44.994 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:44.994 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:44.995 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:44.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:44.998 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 msgr2=0x7fec8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 0x7fec8c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feca4007aa0 tx=0x7feca4008040 comp rx=0 tx=0).stop 2023-10-14T18:46:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 msgr2=0x7feca80c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec98013000 tx=0x7fec98017000 comp rx=0 tx=0).stop 2023-10-14T18:46:45.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 shutdown_connections 2023-10-14T18:46:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fec8c066f30 0x7fec8c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feca815a0c0 0x7feca80c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feca80ce1a0 0x7feca8151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 --2- 172.21.15.79:0/795962241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feca8159cf0 0x7feca80c7d90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 >> 172.21.15.79:0/795962241 conn(0x7feca806c6e0 msgr2=0x7feca80ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 shutdown_connections 2023-10-14T18:46:45.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:44.803+0000 7fecb0749700 1 -- 172.21.15.79:0/795962241 wait complete. 2023-10-14T18:46:45.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:45.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.116+0000 7f2a6bfff700 1 Processor -- start 2023-10-14T18:46:45.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.116+0000 7f2a6bfff700 1 -- start start 2023-10-14T18:46:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a6c068240 0x7f2a6c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6bfff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c0b4bf0 con 0x7f2a6c159db0 2023-10-14T18:46:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6bfff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0b5790 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6bfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0ae9b0 con 0x7f2a6c068240 2023-10-14T18:46:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2a6c159db0 0x7f2a6c0b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33584/0 (socket says 172.21.15.79:33584) 2023-10-14T18:46:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44876/0 (socket says 172.21.15.79:44876) 2023-10-14T18:46:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6affd700 1 -- 172.21.15.79:0/3564609344 learned_addr learned my addr 172.21.15.79:0/3564609344 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6b7fe700 1 --2- 172.21.15.79:0/3564609344 >> v2:172.21.15.144:3300/0 conn(0x7f2a6c068240 0x7f2a6c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 -- 172.21.15.79:0/3564609344 >> v2:172.21.15.144:3300/0 conn(0x7f2a6c068240 msgr2=0x7f2a6c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 --2- 172.21.15.79:0/3564609344 >> v2:172.21.15.144:3300/0 conn(0x7f2a6c068240 0x7f2a6c0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 -- 172.21.15.79:0/3564609344 >> v1:172.21.15.79:6789/0 conn(0x7f2a6c159db0 legacy=0x7f2a6c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a627fc700 1 -- 172.21.15.79:0/3564609344 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0b59e0 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.117+0000 7f2a6a7fc700 1 -- 172.21.15.79:0/3564609344 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845166660 0 0) 0x7f2a6c0b4bf0 con 0x7f2a6c159db0 2023-10-14T18:46:45.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a627fc700 1 --2- 172.21.15.79:0/3564609344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c08af90 tx=0x7f2a540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7fc1905afe4a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6a7fc700 1 -- 172.21.15.79:0/3564609344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400b6b0 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6a7fc700 1 -- 172.21.15.79:0/3564609344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400b810 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6a7fc700 1 -- 172.21.15.79:0/3564609344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400bbb0 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 -- 172.21.15.79:0/3564609344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c0b1f00 msgr2=0x7f2a6c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/3564609344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c08af90 tx=0x7f2a540091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 -- 172.21.15.79:0/3564609344 shutdown_connections 2023-10-14T18:46:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/3564609344 >> v2:172.21.15.144:3300/0 conn(0x7f2a6c068240 0x7f2a6c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/3564609344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c0d13c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 -- 172.21.15.79:0/3564609344 >> 172.21.15.79:0/3564609344 conn(0x7f2a6c067e40 msgr2=0x7f2a6c0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 -- 172.21.15.79:0/3564609344 shutdown_connections 2023-10-14T18:46:45.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.118+0000 7f2a6bfff700 1 -- 172.21.15.79:0/3564609344 wait complete. 2023-10-14T18:46:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.119+0000 7f2a6bfff700 1 Processor -- start 2023-10-14T18:46:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.119+0000 7f2a6bfff700 1 -- start start 2023-10-14T18:46:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a6c068240 0x7f2a6c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c09e8e0 con 0x7f2a6c159db0 2023-10-14T18:46:45.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c1536a0 con 0x7f2a6c0b1f00 2023-10-14T18:46:45.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c15afe0 con 0x7f2a6c068240 2023-10-14T18:46:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44892/0 (socket says 172.21.15.79:44892) 2023-10-14T18:46:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.120+0000 7f2a6b7fe700 1 -- 172.21.15.79:0/1681180942 learned_addr learned my addr 172.21.15.79:0/1681180942 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a627fc700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6affd700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a6c068240 0x7f2a6c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 -- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a6c068240 msgr2=0x7f2a6c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a6c068240 0x7f2a6c153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 -- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 msgr2=0x7f2a6c15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009420 con 0x7f2a6c159db0 2023-10-14T18:46:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a627fc700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6b7fe700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400ceb0 tx=0x7f2a64007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400ae40 con 0x7f2a6c159db0 2023-10-14T18:46:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64016430 con 0x7f2a6c159db0 2023-10-14T18:46:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c15b2c0 con 0x7f2a6c159db0 2023-10-14T18:46:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a640167d0 con 0x7f2a6c159db0 2023-10-14T18:46:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.121+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c15b880 con 0x7f2a6c159db0 2023-10-14T18:46:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.122+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c06ace0 con 0x7f2a6c159db0 2023-10-14T18:46:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.122+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a64003020 con 0x7f2a6c159db0 2023-10-14T18:46:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.122+0000 7f2a637fe700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 0x7f2a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.123+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a64012070 con 0x7f2a6c159db0 2023-10-14T18:46:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.123+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7f2a4c06ea50 con 0x7f2a6c159db0 2023-10-14T18:46:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.123+0000 7f2a6affd700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 0x7f2a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.123+0000 7f2a6affd700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 0x7f2a4c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001750 tx=0x7f2a5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.127+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a64052680 con 0x7f2a6c159db0 2023-10-14T18:46:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.353+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a6c04bb80 con 0x7f2a6c159db0 2023-10-14T18:46:45.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.354+0000 7f2a637fe700 1 -- 172.21.15.79:0/1681180942 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2a64055ca0 con 0x7f2a6c159db0 2023-10-14T18:46:45.355 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 msgr2=0x7f2a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 0x7f2a4c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c001750 tx=0x7f2a5c009040 comp rx=0 tx=0).stop 2023-10-14T18:46:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 msgr2=0x7f2a6c0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400ceb0 tx=0x7f2a64007870 comp rx=0 tx=0).stop 2023-10-14T18:46:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 shutdown_connections 2023-10-14T18:46:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2a4c066f30 0x7f2a4c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a6c159db0 0x7f2a6c0b0aa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2a6c068240 0x7f2a6c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 --2- 172.21.15.79:0/1681180942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c0b1f00 0x7f2a6c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 >> 172.21.15.79:0/1681180942 conn(0x7f2a6c067e40 msgr2=0x7f2a6c1551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 shutdown_connections 2023-10-14T18:46:45.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.356+0000 7f2a6bfff700 1 -- 172.21.15.79:0/1681180942 wait complete. 2023-10-14T18:46:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:45.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:46:45.501 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.694187026000002,"mdsmap_epoch":24,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":24.673993994} 2023-10-14T18:46:45.501 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 24, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 18.694187026, "state": "up:active", "uptime": 24.673993994, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:46:45.502 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:46:45.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:45.503 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T18:46:45.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:46:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-14T18:46:45.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:45.520 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-14T18:46:45.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:45.576 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-14T18:46:45.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.786+0000 7fa97e1b5700 1 Processor -- start 2023-10-14T18:46:45.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.786+0000 7fa97e1b5700 1 -- start start 2023-10-14T18:46:45.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa97e1b5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9780c9af0 0x7fa97806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa97e1b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa978070700 0x7fa978070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa97e1b5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa978071040 con 0x7fa9781510f0 2023-10-14T18:46:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa97e1b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780ca0b0 con 0x7fa978070700 2023-10-14T18:46:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa97e1b5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa978068a10 con 0x7fa9780c9af0 2023-10-14T18:46:45.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa9777fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa9781510f0 0x7fa97815dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33596/0 (socket says 172.21.15.79:33596) 2023-10-14T18:46:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa9777fe700 1 -- 172.21.15.79:0/422006733 learned_addr learned my addr 172.21.15.79:0/422006733 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa977fff700 1 --2- 172.21.15.79:0/422006733 >> v2:172.21.15.79:3300/0 conn(0x7fa978070700 0x7fa978070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.787+0000 7fa976ffd700 1 --2- 172.21.15.79:0/422006733 >> v2:172.21.15.144:3300/0 conn(0x7fa9780c9af0 0x7fa97806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa977fff700 1 -- 172.21.15.79:0/422006733 >> v2:172.21.15.144:3300/0 conn(0x7fa9780c9af0 msgr2=0x7fa97806ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:45.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa977fff700 1 --2- 172.21.15.79:0/422006733 >> v2:172.21.15.144:3300/0 conn(0x7fa9780c9af0 0x7fa97806ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa977fff700 1 -- 172.21.15.79:0/422006733 >> v1:172.21.15.79:6789/0 conn(0x7fa9781510f0 legacy=0x7fa97815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa977fff700 1 -- 172.21.15.79:0/422006733 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978068cf0 con 0x7fa978070700 2023-10-14T18:46:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa9767fc700 1 -- 172.21.15.79:0/422006733 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405261617 0 0) 0x7fa978071040 con 0x7fa9781510f0 2023-10-14T18:46:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa977fff700 1 --2- 172.21.15.79:0/422006733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa978070b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa978069b20 tx=0x7fa9700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55087d1fec7ce912 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa9767fc700 1 -- 172.21.15.79:0/422006733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970011630 con 0x7fa978070700 2023-10-14T18:46:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa9767fc700 1 -- 172.21.15.79:0/422006733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa970011790 con 0x7fa978070700 2023-10-14T18:46:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa9767fc700 1 -- 172.21.15.79:0/422006733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970011b30 con 0x7fa978070700 2023-10-14T18:46:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 -- 172.21.15.79:0/422006733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 msgr2=0x7fa978070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/422006733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa978070b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa978069b20 tx=0x7fa9700091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 -- 172.21.15.79:0/422006733 shutdown_connections 2023-10-14T18:46:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/422006733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa978070b00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/422006733 >> v2:172.21.15.144:3300/0 conn(0x7fa9780c9af0 0x7fa97806ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 -- 172.21.15.79:0/422006733 >> 172.21.15.79:0/422006733 conn(0x7fa9780ca4f0 msgr2=0x7fa9780ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 -- 172.21.15.79:0/422006733 shutdown_connections 2023-10-14T18:46:45.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.788+0000 7fa97e1b5700 1 -- 172.21.15.79:0/422006733 wait complete. 2023-10-14T18:46:45.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 Processor -- start 2023-10-14T18:46:45.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 -- start start 2023-10-14T18:46:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 0x7fa9780b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 0x7fa978159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978156fb0 con 0x7fa978070700 2023-10-14T18:46:45.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978157290 con 0x7fa9781510f0 2023-10-14T18:46:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.790+0000 7fa97e1b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978157570 con 0x7fa9780c9af0 2023-10-14T18:46:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44906/0 (socket says 172.21.15.79:44906) 2023-10-14T18:46:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 -- 172.21.15.79:0/4082119766 learned_addr learned my addr 172.21.15.79:0/4082119766 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:45.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa976ffd700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 0x7fa9780b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa977fff700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 0x7fa978159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 -- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 msgr2=0x7fa9780b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 0x7fa9780b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 -- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 msgr2=0x7fa978159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 0x7fa978159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009420 con 0x7fa978070700 2023-10-14T18:46:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa976ffd700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 0x7fa9780b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa977fff700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 0x7fa978159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa9777fe700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cc70 tx=0x7fa968001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800ce80 con 0x7fa978070700 2023-10-14T18:46:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800ab70 con 0x7fa978070700 2023-10-14T18:46:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978157850 con 0x7fa978070700 2023-10-14T18:46:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680070f0 con 0x7fa978070700 2023-10-14T18:46:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.791+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978156bd0 con 0x7fa978070700 2023-10-14T18:46:45.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.792+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97806de70 con 0x7fa978070700 2023-10-14T18:46:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9680074e0 con 0x7fa978070700 2023-10-14T18:46:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa95f7fe700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 0x7fa9640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9680849d0 con 0x7fa978070700 2023-10-14T18:46:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fa96406ea50 con 0x7fa978070700 2023-10-14T18:46:45.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa976ffd700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 0x7fa9640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:45.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.793+0000 7fa976ffd700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 0x7fa9640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa97815a740 tx=0x7fa96c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:45.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.797+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa968051cc0 con 0x7fa978070700 2023-10-14T18:46:46.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:45.999+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa97804c3c0 con 0x7fa978070700 2023-10-14T18:46:46.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.000+0000 7fa95f7fe700 1 -- 172.21.15.79:0/4082119766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+32403 (secure 0 0 0) 0x7fa9680552e0 con 0x7fa978070700 2023-10-14T18:46:46.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:46.002 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:46.002 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 48, 2023-10-14T18:46:46.002 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:46.002 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:46.002 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:41.499171+0000", 2023-10-14T18:46:46.003 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:46.003 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:46.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:46.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:46.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:46.004 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:46.004 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:46.004 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:46.004 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:46.005 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:46.005 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:46.005 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:46.005 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:46.006 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:46.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:46.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:46.006 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:46.006 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:46.007 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:46.007 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:46.007 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:46.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.007 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:46.008 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:46.008 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:46.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:46.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:46.009 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:46.010 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:46.010 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:46.010 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:46.010 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:46.010 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:46.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:46.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:46.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:46.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:46.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:46.012 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:46.012 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:46.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:46.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:46.012 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:46.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:46.014 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:46.014 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:46.014 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:46.014 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:46.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:46.015 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:46.015 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:46.016 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:46.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:46.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:46.016 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:46.016 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:46.017 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:46.017 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:46.017 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:46.017 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:46.017 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:46.018 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:46.018 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:46.018 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:46.018 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:46.019 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:46.021 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:46.022 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:46.023 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:46.023 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:46.023 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:46.023 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:46.023 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:46.024 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:46.024 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:46.024 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:46.024 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:46.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.025 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:46.025 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:46.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.026 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:46.027 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:46.027 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:46.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:46.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:46.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:46.028 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:46.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:46.028 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:46.028 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:46.029 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:46.029 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:46.029 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:46.029 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:46.029 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:46.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:46.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:46.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:46.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:46.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:46.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:46.031 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:46.031 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:46.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:46.031 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:46.032 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:46.032 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:46.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.032 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:46.032 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:46.033 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:46.033 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:46.033 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:46.033 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:46.033 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:46.034 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:46.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:46.034 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:46.034 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:46.034 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:46.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:46.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:46.035 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:46.035 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:46.036 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:46.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:46.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:46.037 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:46.037 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:46.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:46.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.038 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:46.038 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:46.038 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:46.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:46.039 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:46.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:46.039 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:46.039 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:46.039 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:46.040 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:46.040 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:46.040 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:46.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:46.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:46.041 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:46.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:46.044 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:46.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:46.046 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:46.047 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:46.048 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:46.048 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:46.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.048 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:46.048 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:46.049 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:46.049 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:46.049 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:46.049 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:46.049 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:46.050 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:46.050 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:46.050 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:46.050 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:46.050 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:46.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:46.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:46.051 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:46.051 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:46.051 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:46.052 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:46.052 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:46.052 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:46.052 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:46.053 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:46.053 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:46.053 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:46.053 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:46.053 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:46.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:46.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.054 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:46.054 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:46.054 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:46.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:46.055 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:46.055 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:46.055 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:46.056 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:46.057 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:46.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.057 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:46.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:46.058 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:46.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.058 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:46.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:46.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:46.059 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.060 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.060 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.060 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.060 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:46.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:46.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.072 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.073 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.074 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.075 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.076 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.082 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:46.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:46.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.090 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.091 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:46.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:46.102 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:46.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.103 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:46.103 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:46.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:46.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:46.104 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.104 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.104 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:46.105 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.105 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:46.106 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.106 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.106 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.106 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.106 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.107 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.107 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.107 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.107 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.107 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.108 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.108 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:46.109 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:46.111 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:46.112 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.113 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:46.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:46.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:46.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.119 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:46.119 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:46.119 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:46.119 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:46.119 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.120 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:46:46.120 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.120 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.121 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:46.121 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.121 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.121 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.122 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.122 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.122 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.122 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.122 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:46.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:46.125 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.126 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:46.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:46.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.129 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:46.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:46.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.134 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:46.134 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:46.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:46.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:46.135 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.135 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.135 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:46.136 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.136 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.137 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.137 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.137 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.138 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.138 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.138 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.138 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.138 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:46.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:46.140 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.142 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:46.142 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:46.143 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.144 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:46.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:46.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.147 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:46.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:46.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:46.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.150 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:46.150 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:46.150 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:46.150 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:46.150 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.151 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.151 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.152 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:46.152 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.152 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.152 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.152 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.153 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.153 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.153 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.153 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.154 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.154 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.154 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.154 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:46.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:46.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:46.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.159 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:46.159 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.160 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:46.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:46.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.163 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.163 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:46.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:46.165 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:46.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.166 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:46.166 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:46.167 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:46.167 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:46.167 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.167 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.167 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:46.168 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.168 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.169 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:46.169 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:46.169 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:46.169 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:46.170 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:46.170 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:46.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:46.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:46.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.172 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:46.172 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:46.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.174 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.174 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:46.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:46.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.176 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:46.176 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.177 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:46.177 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.178 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:46.178 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.179 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:46.179 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.180 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:46.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:46.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:46.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:46.182 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:46.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:46.183 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:46.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.183 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:46.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:46.184 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:46.184 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:46.184 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:46.184 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:46.185 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:46.185 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:46.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:46.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.186 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:46.186 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:46.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.186 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:46.186 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.187 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.187 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.187 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:46.188 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.188 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:46.188 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.189 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.189 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.189 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.189 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:46.190 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.190 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:46.190 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.191 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.191 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.191 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.191 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.191 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:46.192 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.192 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:46.192 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.193 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.193 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.193 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.193 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.193 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:46.194 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.194 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:46.194 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.195 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.195 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.195 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.195 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.195 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.196 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.197 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.197 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.197 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.197 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:46.197 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.198 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:46.198 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.199 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.199 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.199 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:46.200 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:46.200 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:46.200 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:46.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:46.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:46.201 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:46.201 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:46.201 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:46.202 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:46.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.202 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:46.202 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:46.202 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:46.203 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:46.203 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:46.203 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:46.203 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:46.203 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:46.204 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:46.204 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:46.204 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:46.204 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:46.204 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:46.205 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:46.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:46.205 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:46.205 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:46.206 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:46.206 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:46.206 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:46.206 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:46.206 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:46.207 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:46.207 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:46.207 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:46.207 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:46.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:46.208 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 msgr2=0x7fa9640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 0x7fa9640693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa97815a740 tx=0x7fa96c008040 comp rx=0 tx=0).stop 2023-10-14T18:46:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 msgr2=0x7fa9780afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:46.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cc70 tx=0x7fa968001a30 comp rx=0 tx=0).stop 2023-10-14T18:46:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 shutdown_connections 2023-10-14T18:46:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa964066f30 0x7fa9640693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9781510f0 0x7fa978159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa978070700 0x7fa9780afde0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 --2- 172.21.15.79:0/4082119766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9780c9af0 0x7fa9780b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 >> 172.21.15.79:0/4082119766 conn(0x7fa9780ca4f0 msgr2=0x7fa9780ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 shutdown_connections 2023-10-14T18:46:46.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:46.002+0000 7fa97e1b5700 1 -- 172.21.15.79:0/4082119766 wait complete. 2023-10-14T18:46:46.213 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:46:47.484 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:46:47.485+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-14T18:46:51.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:51.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.340+0000 7f5af6e3f700 1 Processor -- start 2023-10-14T18:46:51.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.340+0000 7f5af6e3f700 1 -- start start 2023-10-14T18:46:51.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.340+0000 7f5af6e3f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 0x7f5af006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af6e3f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 0x7f5af00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af6e3f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5af0070700 0x7f5af0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af6e3f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af006fa60 con 0x7f5af0070700 2023-10-14T18:46:51.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af6e3f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af00710c0 con 0x7f5af0159d40 2023-10-14T18:46:51.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af6e3f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af006a5e0 con 0x7f5af006eef0 2023-10-14T18:46:51.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5af0070700 0x7f5af0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5af0070700 0x7f5af0070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34480/0 (socket says 172.21.15.79:34480) 2023-10-14T18:46:51.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 -- 172.21.15.79:0/3461242931 learned_addr learned my addr 172.21.15.79:0/3461242931 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:51.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 -- 172.21.15.79:0/3461242931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 msgr2=0x7f5af00689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:51.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5aeffff700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 0x7f5af00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/3461242931 >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 0x7f5af006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 0x7f5af00689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 -- 172.21.15.79:0/3461242931 >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 msgr2=0x7f5af006aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:51.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 --2- 172.21.15.79:0/3461242931 >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 0x7f5af006aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 -- 172.21.15.79:0/3461242931 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af006afb0 con 0x7f5af0070700 2023-10-14T18:46:51.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/3461242931 >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 0x7f5af006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:51.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5aeffff700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 0x7f5af00689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:46:51.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5af53dc700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0070700 0x7f5af0070b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5af00cb500 tx=0x7f5ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5858b946f079dbe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:51.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5aef7fe700 1 -- 172.21.15.79:0/3461242931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800b820 con 0x7f5af0070700 2023-10-14T18:46:51.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5aef7fe700 1 -- 172.21.15.79:0/3461242931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800b980 con 0x7f5af0070700 2023-10-14T18:46:51.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.341+0000 7f5aef7fe700 1 -- 172.21.15.79:0/3461242931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800bd20 con 0x7f5af0070700 2023-10-14T18:46:51.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 -- 172.21.15.79:0/3461242931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0070700 msgr2=0x7f5af0070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:51.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0070700 0x7f5af0070b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5af00cb500 tx=0x7f5ae8009250 comp rx=0 tx=0).stop 2023-10-14T18:46:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 -- 172.21.15.79:0/3461242931 shutdown_connections 2023-10-14T18:46:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0070700 0x7f5af0070b80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/3461242931 >> v2:172.21.15.144:3300/0 conn(0x7f5af0159d40 0x7f5af006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/3461242931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af006eef0 0x7f5af00689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 -- 172.21.15.79:0/3461242931 >> 172.21.15.79:0/3461242931 conn(0x7f5af00cda60 msgr2=0x7f5af00cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 -- 172.21.15.79:0/3461242931 shutdown_connections 2023-10-14T18:46:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.342+0000 7f5af6e3f700 1 -- 172.21.15.79:0/3461242931 wait complete. 2023-10-14T18:46:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.343+0000 7f5af6e3f700 1 Processor -- start 2023-10-14T18:46:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.343+0000 7f5af6e3f700 1 -- start start 2023-10-14T18:46:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 0x7f5af0169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af0070700 0x7f5af00abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0157a30 con 0x7f5af0159d40 2023-10-14T18:46:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0157700 con 0x7f5af006eef0 2023-10-14T18:46:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af6e3f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af016a290 con 0x7f5af0070700 2023-10-14T18:46:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34482/0 (socket says 172.21.15.79:34482) 2023-10-14T18:46:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 -- 172.21.15.79:0/2360367037 learned_addr learned my addr 172.21.15.79:0/2360367037 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 0x7f5af0169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5aeffff700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af0070700 0x7f5af00abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 -- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af0070700 msgr2=0x7f5af00abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af0070700 0x7f5af00abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 -- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 msgr2=0x7f5af0169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:51.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 0x7f5af0169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af53dc700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80094f0 con 0x7f5af0159d40 2023-10-14T18:46:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.344+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 0x7f5af0169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5af53dc700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009290 tx=0x7f5ae8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae801a630 con 0x7f5af0159d40 2023-10-14T18:46:51.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae801a7d0 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af016a530 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae801ab90 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.345+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af016aaf0 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.346+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af0157ba0 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.346+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ae802e450 con 0x7f5af0159d40 2023-10-14T18:46:51.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.347+0000 7f5aecff9700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.347+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ae8086090 con 0x7f5af0159d40 2023-10-14T18:46:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.347+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:51.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.347+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f5ad006ea50 con 0x7f5af0159d40 2023-10-14T18:46:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.347+0000 7f5af4bdb700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 0x7f5ad00693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5af015da00 tx=0x7f5ae0007700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:51.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.351+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ae8015060 con 0x7f5af0159d40 2023-10-14T18:46:51.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.534+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(50..50 src has 1..50) v4 ==== 288+0+0 (secure 0 0 0) 0x7f5ae80576c0 con 0x7f5af0159d40 2023-10-14T18:46:51.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.534+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f5ad006f3a0 con 0x7f5af0159d40 2023-10-14T18:46:51.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.537+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5af004c3c0 con 0x7f5af0159d40 2023-10-14T18:46:51.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.538+0000 7f5aecff9700 1 -- 172.21.15.79:0/2360367037 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32355 (secure 0 0 0) 0x7f5ae8053300 con 0x7f5af0159d40 2023-10-14T18:46:51.539 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:51.540 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 50, 2023-10-14T18:46:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:51.540 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:51.530900+0000", 2023-10-14T18:46:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:51.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:51.542 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:51.543 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:51.544 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:51.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:51.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:51.548 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:51.549 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:51.550 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:51.551 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:51.552 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:51.553 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:51.554 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:51.555 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:51.556 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:51.558 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:51.559 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:51.560 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:51.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:51.563 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:51.564 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:51.565 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:51.566 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.567 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:51.569 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:51.570 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:51.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:51.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:51.573 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:51.574 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:51.575 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:51.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:51.577 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:46:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:46:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:51.578 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:51.579 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:51.580 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:51.581 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:51.582 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "46", 2023-10-14T18:46:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:51.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:51.584 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:51.585 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:51.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:51.587 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.588 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:51.589 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:51.590 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.591 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.593 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.594 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.595 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:51.599 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:51.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.607 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.609 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.616 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:51.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:51.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:51.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:51.622 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.624 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.625 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.626 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:51.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.637 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.638 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:51.640 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.640 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.640 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.640 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.640 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.642 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:51.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.643 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:51.644 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.644 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.644 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.645 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.645 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:51.645 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:51.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.648 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:51.648 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:51.649 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.650 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.650 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:51.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:51.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.652 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:46:51.653 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.654 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:51.655 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.655 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.655 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.655 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.655 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.656 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.656 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.656 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.656 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.656 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.657 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.657 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.658 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:51.658 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.659 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:51.659 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.660 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:51.662 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.662 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.664 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:51.664 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.665 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.665 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:51.666 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.668 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:51.668 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:51.668 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:51.668 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:51.669 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.669 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.669 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.670 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:51.670 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.670 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.671 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.671 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.671 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.671 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.671 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.672 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.672 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.672 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.672 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.672 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:51.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:51.674 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.675 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:51.676 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:51.677 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.678 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.678 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.681 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:51.682 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.683 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.684 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.685 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:51.685 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.686 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.686 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.686 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.686 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.686 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.687 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.687 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.687 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.687 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.687 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.688 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:51.689 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:51.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.693 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:51.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:51.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:51.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:51.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.699 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:51.699 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:51.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:51.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:51.700 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.700 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.700 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.701 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:51.701 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:51.701 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:51.701 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:51.702 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:51.702 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:51.702 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:51.702 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:51.702 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:51.703 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:51.703 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:51.703 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:51.703 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:51.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:51.704 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.705 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:51.705 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.706 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:51.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:51.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:51.708 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.709 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:51.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.710 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:51.710 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:51.711 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:51.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:51.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:51.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.715 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:51.715 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:51.715 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:51.716 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:51.716 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:51.716 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:51.716 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:46:51.716 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:51.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:51.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.717 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:51.717 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:51.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.718 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:51.718 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.718 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.718 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.718 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.720 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:51.720 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.720 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.720 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.720 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.721 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.721 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:51.721 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.722 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:51.722 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.722 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.722 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.722 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.723 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.723 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:51.723 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.724 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:51.724 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.724 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.724 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.724 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.726 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:51.726 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.726 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.726 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.726 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.727 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.727 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:51.727 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.728 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:51.728 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.728 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.728 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.730 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:51.730 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.730 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.730 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.730 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.731 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.731 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:51.731 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:51.732 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:51.732 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:51.732 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:51.732 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:51.732 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:51.733 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:51.733 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:51.733 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:51.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.733 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:51.734 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:51.734 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:51.734 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:51.734 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:51.734 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:51.735 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:51.736 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:51.736 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:51.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:51.736 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:51.737 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:51.737 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:51.737 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:51.737 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:51.737 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:51.738 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:51.738 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:51.738 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:51.738 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:51.738 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:51.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:51.739 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:51.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.540+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 msgr2=0x7f5ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.540+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 0x7f5ad00693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5af015da00 tx=0x7f5ae0007700 comp rx=0 tx=0).stop 2023-10-14T18:46:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.540+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 msgr2=0x7f5af00ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.540+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009290 tx=0x7f5ae8017000 comp rx=0 tx=0).stop 2023-10-14T18:46:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 shutdown_connections 2023-10-14T18:46:51.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af0159d40 0x7f5af00ac2d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af006eef0 0x7f5af0169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 --2- 172.21.15.79:0/2360367037 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5af0070700 0x7f5af00abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:51.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 >> 172.21.15.79:0/2360367037 conn(0x7f5af00cda60 msgr2=0x7f5af00ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:51.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 shutdown_connections 2023-10-14T18:46:51.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:51.541+0000 7f5af6e3f700 1 -- 172.21.15.79:0/2360367037 wait complete. 2023-10-14T18:46:51.743 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:46:52.485 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:46:52.486+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-10-14T18:46:56.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:56.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.868+0000 7f514821c700 1 Processor -- start 2023-10-14T18:46:56.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.868+0000 7f514821c700 1 -- start start 2023-10-14T18:46:56.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f514821c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5140143630 0x7f51400cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f514821c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f514821c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400b3b70 con 0x7f514006a4e0 2023-10-14T18:46:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f514821c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51400b3380 con 0x7f5140143630 2023-10-14T18:46:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f514821c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b3e50 con 0x7f5140143a00 2023-10-14T18:46:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f5145fb8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5140143630 0x7f51400cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f5145fb8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5140143630 0x7f51400cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34498/0 (socket says 172.21.15.79:34498) 2023-10-14T18:46:56.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f5145fb8700 1 -- 172.21.15.79:0/243087853 learned_addr learned my addr 172.21.15.79:0/243087853 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:56.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.869+0000 7f51457b7700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5145fb8700 1 -- 172.21.15.79:0/243087853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 msgr2=0x7f51400d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:56.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5145fb8700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:56.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5145fb8700 1 -- 172.21.15.79:0/243087853 >> v1:172.21.15.144:6789/0 conn(0x7f514006a4e0 legacy=0x7f514015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:56.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5145fb8700 1 -- 172.21.15.79:0/243087853 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400b4130 con 0x7f5140143630 2023-10-14T18:46:56.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5145fb8700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5140143630 0x7f51400cfee0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f513c009f20 tx=0x7f513c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62206a05f3a122fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:56.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5144fb6700 1 -- 172.21.15.79:0/243087853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00e070 con 0x7f5140143630 2023-10-14T18:46:56.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5144fb6700 1 -- 172.21.15.79:0/243087853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c00b9d0 con 0x7f5140143630 2023-10-14T18:46:56.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f5144fb6700 1 -- 172.21.15.79:0/243087853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0092e0 con 0x7f5140143630 2023-10-14T18:46:56.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 -- 172.21.15.79:0/243087853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5140143630 msgr2=0x7f51400cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:56.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5140143630 0x7f51400cfee0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f513c009f20 tx=0x7f513c009840 comp rx=0 tx=0).stop 2023-10-14T18:46:56.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 -- 172.21.15.79:0/243087853 shutdown_connections 2023-10-14T18:46:56.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5140143630 0x7f51400cfee0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:56.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 --2- 172.21.15.79:0/243087853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:56.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.870+0000 7f514821c700 1 -- 172.21.15.79:0/243087853 >> 172.21.15.79:0/243087853 conn(0x7f5140069760 msgr2=0x7f51400b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:56.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.871+0000 7f514821c700 1 -- 172.21.15.79:0/243087853 shutdown_connections 2023-10-14T18:46:56.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.871+0000 7f514821c700 1 -- 172.21.15.79:0/243087853 wait complete. 2023-10-14T18:46:56.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 Processor -- start 2023-10-14T18:46:56.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 -- start start 2023-10-14T18:46:56.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 0x7f5140140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514016e0f0 con 0x7f514006a4e0 2023-10-14T18:46:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b1150 con 0x7f5140143630 2023-10-14T18:46:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f514821c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b1430 con 0x7f5140143a00 2023-10-14T18:46:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f5145fb8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f5145fb8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34506/0 (socket says 172.21.15.79:34506) 2023-10-14T18:46:56.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.872+0000 7f5145fb8700 1 -- 172.21.15.79:0/206932300 learned_addr learned my addr 172.21.15.79:0/206932300 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f51467b9700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f51457b7700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 0x7f5140140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 -- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 msgr2=0x7f51400c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:56.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 -- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 msgr2=0x7f5140140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 0x7f5140140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 -- 172.21.15.79:0/206932300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009ae0 con 0x7f514006a4e0 2023-10-14T18:46:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f51457b7700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 0x7f5140140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:46:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5145fb8700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b610 tx=0x7f513c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0089a0 con 0x7f514006a4e0 2023-10-14T18:46:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c008b00 con 0x7f514006a4e0 2023-10-14T18:46:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c026460 con 0x7f514006a4e0 2023-10-14T18:46:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51400b1710 con 0x7f514006a4e0 2023-10-14T18:46:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.873+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514016eac0 con 0x7f514006a4e0 2023-10-14T18:46:56.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.874+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514016e3d0 con 0x7f514006a4e0 2023-10-14T18:46:56.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.875+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f513c003040 con 0x7f514006a4e0 2023-10-14T18:46:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.875+0000 7f5135ffb700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 0x7f51240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.875+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f513c0862d0 con 0x7f514006a4e0 2023-10-14T18:46:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.875+0000 7f51457b7700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 0x7f51240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.876+0000 7f51457b7700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 0x7f51240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51400b0a20 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:56.879+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f513c053540 con 0x7f514006a4e0 2023-10-14T18:46:57.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.061+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5140069b60 con 0x7f514006a4e0 2023-10-14T18:46:57.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.062+0000 7f5135ffb700 1 -- 172.21.15.79:0/206932300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f513c056b60 con 0x7f514006a4e0 2023-10-14T18:46:57.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:57.064 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:57.064 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 53, 2023-10-14T18:46:57.065 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:57.065 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:57.065 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:56.603355+0000", 2023-10-14T18:46:57.065 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:57.065 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:57.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:57.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:57.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:57.066 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:57.066 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:57.067 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:57.067 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:57.067 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.067 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:57.068 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:57.068 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:57.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:57.068 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:57.068 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:57.069 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:57.069 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:57.069 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:57.069 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:57.069 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:57.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.070 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:57.070 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:57.070 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.071 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.072 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.072 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.072 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.072 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.073 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.073 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.073 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:57.073 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:57.074 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:57.074 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:57.075 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:57.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.075 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.076 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.076 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.076 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.077 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.077 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.079 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.079 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.079 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.080 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.080 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.081 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.081 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.081 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.082 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.082 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.083 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.083 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.084 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.084 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.084 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.084 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.085 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.085 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.085 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.085 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.085 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.086 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.086 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.086 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.087 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.087 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.087 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.088 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.088 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.088 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.088 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.088 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.089 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:57.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.090 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:57.091 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:57.091 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:57.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.092 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.093 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.093 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.093 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:57.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:57.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:57.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:57.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.096 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.096 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.097 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.097 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.097 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.097 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.097 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.098 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.098 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.098 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.098 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.099 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.099 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.099 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.101 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.101 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.101 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.101 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.102 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.102 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.102 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.102 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.103 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.103 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.103 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.103 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.104 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.104 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.104 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.104 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.105 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:57.105 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:57.105 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:57.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.105 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.106 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:57.106 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:57.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:57.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:57.107 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:57.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.108 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.108 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.109 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.109 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.109 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.109 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.109 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.110 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.110 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.110 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:57.111 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:57.111 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:57.111 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:57.112 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:57.112 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.113 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.113 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.113 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.114 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.114 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.114 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.116 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.116 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.116 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.116 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.116 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.117 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.118 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.118 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.118 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.119 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.119 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.119 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.119 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.119 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.120 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.120 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.120 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.120 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.121 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.121 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.121 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.121 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.122 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.123 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.123 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.123 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.124 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:57.124 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:57.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.124 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.125 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:57.125 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:57.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.126 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.127 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:57.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.127 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:57.128 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.128 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.128 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.129 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.129 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.130 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.130 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.130 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.131 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.131 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.131 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.132 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:57.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:57.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.136 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:57.137 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:57.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:57.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.143 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:57.144 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:57.145 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:57.146 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:57.146 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:57.146 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.146 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.146 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.147 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:57.147 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.148 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.148 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.148 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.148 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.148 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.149 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:57.151 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.152 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.152 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:57.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:57.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.158 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.159 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.159 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:57.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:57.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.163 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:57.163 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:57.164 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:57.164 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:57.164 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.165 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:57.166 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.166 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.166 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.166 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.166 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.167 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.167 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.167 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.167 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.167 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.168 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.168 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:57.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:57.171 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.172 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:57.174 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:57.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.176 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.176 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.178 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:57.178 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.179 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.179 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.182 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:57.182 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:57.182 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:57.182 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:57.182 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.183 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.183 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.184 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.185 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.185 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.185 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.185 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.185 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.186 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.186 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.186 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.187 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:57.187 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.188 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:57.188 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.189 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:57.190 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.191 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:57.191 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.196 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:57.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:57.198 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.199 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:57.199 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:57.199 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:57.199 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.201 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:57.201 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.201 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.201 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.201 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.202 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.202 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.202 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.202 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.202 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.204 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:57.204 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.205 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:57.205 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.205 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.206 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:57.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.208 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:57.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.210 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:57.210 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.212 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:57.212 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.213 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:57.213 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.214 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.215 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.215 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.215 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.216 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.217 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.217 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.217 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.217 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.217 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.218 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:57.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.220 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:57.222 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.223 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:57.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.226 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:57.229 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:57.229 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:57.229 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.229 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.229 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.230 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:57.230 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.231 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.231 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.231 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.231 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.231 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.232 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:57.233 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.234 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:57.234 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.235 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.235 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.237 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:57.237 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.238 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.238 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.238 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:57.239 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:57.240 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.241 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:57.242 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:57.243 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:57.244 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:57.244 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:57.244 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.244 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.244 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:57.245 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.246 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.246 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.246 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.246 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.246 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.247 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.247 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.247 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.247 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.247 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.248 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.248 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.248 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:57.249 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.250 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.250 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.251 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:57.251 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.252 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.253 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.253 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.256 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.256 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:57.256 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.258 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.258 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:57.258 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:57.258 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:57.259 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:57.259 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.259 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.259 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:57.260 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.261 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.261 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.261 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.261 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.261 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:57.262 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.262 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:57.262 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.263 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.263 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.263 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.263 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.263 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:57.264 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.264 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:57.264 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:57.265 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.266 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:57.266 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.266 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.267 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.267 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.267 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.267 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:57.267 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.268 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.269 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.269 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.269 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:57.269 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.270 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:57.270 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.270 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.270 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.272 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.273 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.273 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:57.273 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.274 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:57.274 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.274 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.274 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.274 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.275 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.275 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:57.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.275 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.277 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:57.277 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:57.277 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:57.277 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:57.278 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:57.278 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:57.278 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:57.278 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:57.278 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:57.279 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:57.280 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:57.281 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:57.281 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:57.281 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:57.281 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:57.281 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:57.282 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:57.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.282 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:57.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 msgr2=0x7f51240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 0x7f51240693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51400b0a20 tx=0x7f5130008040 comp rx=0 tx=0).stop 2023-10-14T18:46:57.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 msgr2=0x7f514016e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b610 tx=0x7f513c018000 comp rx=0 tx=0).stop 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 shutdown_connections 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5124066f30 0x7f51240693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5140143a00 0x7f51400c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f514006a4e0 0x7f514016e580 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 --2- 172.21.15.79:0/206932300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5140143630 0x7f5140140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 >> 172.21.15.79:0/206932300 conn(0x7f5140069760 msgr2=0x7f5140142470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:57.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 shutdown_connections 2023-10-14T18:46:57.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.064+0000 7f514821c700 1 -- 172.21.15.79:0/206932300 wait complete. 2023-10-14T18:46:57.287 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-14T18:46:57.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:46:57.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.400+0000 7f8d7a828700 1 Processor -- start 2023-10-14T18:46:57.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.400+0000 7f8d7a828700 1 -- start start 2023-10-14T18:46:57.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d7a828700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d740cd6e0 0x7f8d740cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d7a828700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740cb7c0 con 0x7f8d740cdab0 2023-10-14T18:46:57.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d7a828700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7415e290 con 0x7f8d7415cbd0 2023-10-14T18:46:57.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d7a828700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7415e850 con 0x7f8d740cd6e0 2023-10-14T18:46:57.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79826700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d740cd6e0 0x7f8d740cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79025700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8d740cdab0 0x7f8d7415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51876/0 (socket says 172.21.15.79:51876) 2023-10-14T18:46:57.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79025700 1 -- 172.21.15.79:0/2016965617 learned_addr learned my addr 172.21.15.79:0/2016965617 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:57.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79826700 1 -- 172.21.15.79:0/2016965617 >> v1:172.21.15.144:6789/0 conn(0x7f8d7415cbd0 legacy=0x7f8d7415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79826700 1 -- 172.21.15.79:0/2016965617 >> v1:172.21.15.79:6789/0 conn(0x7f8d740cdab0 legacy=0x7f8d7415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79826700 1 -- 172.21.15.79:0/2016965617 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7415e570 con 0x7f8d740cd6e0 2023-10-14T18:46:57.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d78824700 1 -- 172.21.15.79:0/2016965617 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591467853 0 0) 0x7f8d740cb7c0 con 0x7f8d740cdab0 2023-10-14T18:46:57.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.401+0000 7f8d79826700 1 --2- 172.21.15.79:0/2016965617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cd6e0 0x7f8d740cbc50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429447771f74760 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d78824700 1 -- 172.21.15.79:0/2016965617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70009e80 con 0x7f8d740cd6e0 2023-10-14T18:46:57.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d78824700 1 -- 172.21.15.79:0/2016965617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7000b860 con 0x7f8d740cd6e0 2023-10-14T18:46:57.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d78824700 1 -- 172.21.15.79:0/2016965617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000bbe0 con 0x7f8d740cd6e0 2023-10-14T18:46:57.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 -- 172.21.15.79:0/2016965617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cd6e0 msgr2=0x7f8d740cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2016965617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cd6e0 0x7f8d740cbc50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d700091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 -- 172.21.15.79:0/2016965617 shutdown_connections 2023-10-14T18:46:57.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2016965617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cd6e0 0x7f8d740cbc50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 -- 172.21.15.79:0/2016965617 >> 172.21.15.79:0/2016965617 conn(0x7f8d74067660 msgr2=0x7f8d74067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:57.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 -- 172.21.15.79:0/2016965617 shutdown_connections 2023-10-14T18:46:57.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.402+0000 7f8d7a828700 1 -- 172.21.15.79:0/2016965617 wait complete. 2023-10-14T18:46:57.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.403+0000 7f8d7a828700 1 Processor -- start 2023-10-14T18:46:57.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.403+0000 7f8d7a828700 1 -- start start 2023-10-14T18:46:57.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d740cd6e0 0x7f8d7414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7415cbd0 0x7f8d7414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740b5ac0 con 0x7f8d740cdab0 2023-10-14T18:46:57.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740c7ec0 con 0x7f8d740cd6e0 2023-10-14T18:46:57.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d7a828700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7414fec0 con 0x7f8d7415cbd0 2023-10-14T18:46:57.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34518/0 (socket says 172.21.15.79:34518) 2023-10-14T18:46:57.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 -- 172.21.15.79:0/2718027215 learned_addr learned my addr 172.21.15.79:0/2718027215 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:57.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 -- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7415cbd0 msgr2=0x7f8d7414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7415cbd0 0x7f8d7414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 -- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d740cd6e0 msgr2=0x7f8d7414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79826700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d740cd6e0 0x7f8d7414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d740cd6e0 0x7f8d7414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.404+0000 7f8d79025700 1 -- 172.21.15.79:0/2718027215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009420 con 0x7f8d740cdab0 2023-10-14T18:46:57.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d79025700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c810 tx=0x7f8d64007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64005c00 con 0x7f8d740cdab0 2023-10-14T18:46:57.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64005d60 con 0x7f8d740cdab0 2023-10-14T18:46:57.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7414f2b0 con 0x7f8d740cdab0 2023-10-14T18:46:57.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007340 con 0x7f8d740cdab0 2023-10-14T18:46:57.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.405+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7414f870 con 0x7f8d740cdab0 2023-10-14T18:46:57.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.406+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d740c8050 con 0x7f8d740cdab0 2023-10-14T18:46:57.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.406+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d6401b400 con 0x7f8d740cdab0 2023-10-14T18:46:57.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.406+0000 7f8d69ffb700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.407+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d640840b0 con 0x7f8d740cdab0 2023-10-14T18:46:57.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.407+0000 7f8d79826700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.407+0000 7f8d79826700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.411+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d740c8050 con 0x7f8d740cdab0 2023-10-14T18:46:57.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.595+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8d740c8000 con 0x7f8d740cdab0 2023-10-14T18:46:57.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.596+0000 7f8d69ffb700 1 -- 172.21.15.79:0/2718027215 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f8d640513a0 con 0x7f8d740cdab0 2023-10-14T18:46:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:57.599 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:46:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 53, 2023-10-14T18:46:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:46:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:46:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:46:56.603355+0000", 2023-10-14T18:46:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:46:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:46:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:46:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:46:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:46:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:46:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:46:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:46:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:46:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:46:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:46:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:46:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:46:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:46:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 7, 2023-10-14T18:46:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:46:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:46:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:46:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:46:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:46:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:46:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:46:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:46:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:46:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:46:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:46:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:46:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 6, 2023-10-14T18:46:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:46:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:23.998299+0000", 2023-10-14T18:46:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:46:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:46:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:46:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:46:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:46:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:46:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 7, 2023-10-14T18:46:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:46:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:46:25.134494+0000", 2023-10-14T18:46:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:46:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:46:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:46:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:46:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:46:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:46:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:46:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:46:57.637 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:46:57.637 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:46:57.637 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:46:57.637 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:46:57.637 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:46:57.638 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:46:57.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "53", 2023-10-14T18:46:57.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:46:57.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:46:57.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:46:57.640 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:46:57.640 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:46:57.640 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:46:57.640 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:46:57.640 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:46:57.641 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:46:57.641 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:46:57.641 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:46:57.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:46:57.641 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:46:57.642 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:46:57.642 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:46:57.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:46:57.642 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:46:57.642 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:46:57.643 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:46:57.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:46:57.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:46:57.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:46:57.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:46:57.645 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:46:57.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:46:57.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:46:57.645 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:46:57.645 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:46:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:46:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:46:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:46:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:46:57.646 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:46:57.647 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:46:57.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.648 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.648 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:46:57.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.649 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:57.649 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.649 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.649 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.650 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.651 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.651 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.651 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.652 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:46:57.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:46:57.653 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.653 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.654 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.654 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.655 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:46:57.656 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.656 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:46:57.657 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.658 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:46:57.658 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:46:57.660 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:46:57.661 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:46:57.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.662 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:46:57.662 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:46:57.662 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:46:57.662 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:57.664 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.664 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.664 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.664 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.665 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:46:57.667 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.668 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:46:57.668 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.669 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:46:57.670 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.670 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:46:57.671 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.671 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:46:57.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.674 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.674 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:46:57.675 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:46:57.676 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:46:57.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:46:57.677 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.679 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.680 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.680 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.680 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.680 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.680 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:46:57.682 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:46:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:46:57.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:46:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.686 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.687 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:46:57.687 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.689 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:46:57.690 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.690 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:46:57.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:46:57.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:46:57.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.693 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:46:57.693 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:46:57.694 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:46:57.694 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:46:57.694 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.694 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.694 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.695 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:57.695 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.696 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.697 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.697 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.697 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.697 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.697 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:46:57.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.699 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:46:57.699 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.701 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:46:57.701 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:46:57.702 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:46:57.704 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.705 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:46:57.705 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.706 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:46:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:46:57.708 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:46:57.709 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:46:57.709 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:46:57.709 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.709 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.709 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:57.710 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.711 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.712 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.712 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.712 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.712 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.712 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:46:57.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:46:57.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.715 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.715 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.717 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:46:57.717 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.718 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:46:57.719 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:46:57.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:46:57.721 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.722 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:46:57.722 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:46:57.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.723 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:46:57.723 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:46:57.724 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:46:57.724 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:46:57.724 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.724 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.724 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.725 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.726 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.726 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.726 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.726 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.726 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.727 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.727 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.727 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.727 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.727 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:46:57.728 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.730 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.731 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:46:57.731 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.732 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:46:57.732 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.733 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:46:57.734 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:46:57.735 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.735 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:46:57.737 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:46:57.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:46:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:46:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.740 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:57.740 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.740 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.740 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.741 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.741 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.741 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.741 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.741 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.742 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.742 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.742 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.742 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.744 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:46:57.744 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.744 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.744 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.745 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.745 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.746 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:46:57.746 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.747 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:46:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.749 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:46:57.749 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.751 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:46:57.751 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.752 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:46:57.752 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:46:57.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:46:57.753 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.754 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.754 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.754 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:57.755 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:46:57.755 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:46:57.755 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:46:57.755 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2023-10-14T18:46:57.756 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:46:57.757 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:46:57.757 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:46:57.757 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.758 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:46:57.758 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.759 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:46:57.760 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.760 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:46:57.760 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.761 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:46:57.761 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.762 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:46:57.762 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.764 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.764 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:46:57.764 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.764 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:46:57.765 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:46:57.766 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:46:57.766 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:46:57.767 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:46:57.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.767 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:46:57.768 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:46:57.768 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:46:57.768 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:46:57.768 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:46:57.768 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:46:57.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:46:57.770 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.770 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.770 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.770 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.771 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.771 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:46:57.771 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:46:57.772 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.772 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.772 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.772 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.773 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.773 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:46:57.773 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.774 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.775 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:46:57.775 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.775 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:46:57.776 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.776 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.776 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.776 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.776 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:46:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.778 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:46:57.779 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:46:57.779 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.780 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.780 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.780 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.780 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:46:57.781 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:46:57.781 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:46:57.782 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:46:57.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:46:57.783 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:46:57.783 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:46:57.784 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:46:57.784 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:46:57.784 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:46:57.784 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:46:57.784 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:46:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:46:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:46:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:46:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:46:57.786 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:46:57.787 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:46:57.787 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:46:57.787 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:46:57.787 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:46:57.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:46:57.788 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:46:57.789 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:46:57.789 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:46:57.789 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:46:57.789 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:46:57.789 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:46:57.790 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:46:57.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:46:57.790 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:46:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 msgr2=0x7f8d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d70017000 comp rx=0 tx=0).stop 2023-10-14T18:46:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 msgr2=0x7f8d740b5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c810 tx=0x7f8d64007d90 comp rx=0 tx=0).stop 2023-10-14T18:46:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 shutdown_connections 2023-10-14T18:46:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7415cbd0 0x7f8d7414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d740cd6e0 0x7f8d7414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 --2- 172.21.15.79:0/2718027215 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740cdab0 0x7f8d740b5580 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 >> 172.21.15.79:0/2718027215 conn(0x7f8d74067660 msgr2=0x7f8d740b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 shutdown_connections 2023-10-14T18:46:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.598+0000 7f8d7a828700 1 -- 172.21.15.79:0/2718027215 wait complete. 2023-10-14T18:46:57.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:57.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.909+0000 7f1a7b59e700 1 Processor -- start 2023-10-14T18:46:57.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.909+0000 7f1a7b59e700 1 -- start start 2023-10-14T18:46:57.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a7c0cdab0 0x7f1a7c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a7c15dda0 0x7f1a7c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c15e850 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c0cd030 con 0x7f1a7c15dda0 2023-10-14T18:46:57.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0cb7c0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a7c0cdab0 0x7f1a7c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a7c0cdab0 0x7f1a7c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34530/0 (socket says 172.21.15.79:34530) 2023-10-14T18:46:57.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 -- 172.21.15.79:0/254988250 learned_addr learned my addr 172.21.15.79:0/254988250 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:57.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 -- 172.21.15.79:0/254988250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cd6e0 msgr2=0x7f1a7c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:57.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 --2- 172.21.15.79:0/254988250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 -- 172.21.15.79:0/254988250 >> v2:172.21.15.144:3300/0 conn(0x7f1a7c15dda0 msgr2=0x7f1a7c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:57.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7ad9d700 1 --2- 172.21.15.79:0/254988250 >> v2:172.21.15.144:3300/0 conn(0x7f1a7c15dda0 0x7f1a7c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 --2- 172.21.15.79:0/254988250 >> v2:172.21.15.144:3300/0 conn(0x7f1a7c15dda0 0x7f1a7c15cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 -- 172.21.15.79:0/254988250 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c15e290 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a79d9b700 1 --2- 172.21.15.79:0/254988250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cdab0 0x7f1a7c15d860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c089ac0 tx=0x7f1a70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7578af4abb9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7959a700 1 -- 172.21.15.79:0/254988250 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000b860 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7959a700 1 -- 172.21.15.79:0/254988250 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000b9c0 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7959a700 1 -- 172.21.15.79:0/254988250 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000bd60 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- 172.21.15.79:0/254988250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cdab0 msgr2=0x7f1a7c15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/254988250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cdab0 0x7f1a7c15d860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c089ac0 tx=0x7f1a70009250 comp rx=0 tx=0).stop 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- 172.21.15.79:0/254988250 shutdown_connections 2023-10-14T18:46:57.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/254988250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/254988250 >> v2:172.21.15.144:3300/0 conn(0x7f1a7c15dda0 0x7f1a7c15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/254988250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cdab0 0x7f1a7c15d860 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- 172.21.15.79:0/254988250 >> 172.21.15.79:0/254988250 conn(0x7f1a7c067660 msgr2=0x7f1a7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- 172.21.15.79:0/254988250 shutdown_connections 2023-10-14T18:46:57.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.910+0000 7f1a7b59e700 1 -- 172.21.15.79:0/254988250 wait complete. 2023-10-14T18:46:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.911+0000 7f1a7b59e700 1 Processor -- start 2023-10-14T18:46:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.911+0000 7f1a7b59e700 1 -- start start 2023-10-14T18:46:57.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cdab0 0x7f1a7c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7c15dda0 0x7f1a7c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0c8d80 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15b530 con 0x7f1a7c15dda0 2023-10-14T18:46:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0c8170 con 0x7f1a7c0cdab0 2023-10-14T18:46:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34546/0 (socket says 172.21.15.79:34546) 2023-10-14T18:46:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 -- 172.21.15.79:0/2092354507 learned_addr learned my addr 172.21.15.79:0/2092354507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 -- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cdab0 msgr2=0x7f1a7c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cdab0 0x7f1a7c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 -- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7c15dda0 msgr2=0x7f1a7c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7ad9d700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7c15dda0 0x7f1a7c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7c15dda0 0x7f1a7c1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.912+0000 7f1a7a59c700 1 -- 172.21.15.79:0/2092354507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700094f0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a7a59c700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400bc30 tx=0x7f1a74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740092e0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400c7a0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c0c8450 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400cb80 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.913+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c0c8a10 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.914+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c089280 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.914+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a74012070 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.914+0000 7f1a6a7fc700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 0x7f1a5c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.914+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a74084140 con 0x7f1a7c0cd6e0 2023-10-14T18:46:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.915+0000 7f1a79d9b700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 0x7f1a5c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.915+0000 7f1a79d9b700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 0x7f1a5c069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c089ac0 tx=0x7f1a70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:57.919+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a740513b0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.142+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a7c15e570 con 0x7f1a7c0cd6e0 2023-10-14T18:46:58.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.142+0000 7f1a6a7fc700 1 -- 172.21.15.79:0/2092354507 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f1a740549d0 con 0x7f1a7c0cd6e0 2023-10-14T18:46:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:58.144 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 msgr2=0x7f1a5c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 0x7f1a5c069410 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c089ac0 tx=0x7f1a70017000 comp rx=0 tx=0).stop 2023-10-14T18:46:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 msgr2=0x7f1a7c0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400bc30 tx=0x7f1a74009840 comp rx=0 tx=0).stop 2023-10-14T18:46:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 shutdown_connections 2023-10-14T18:46:58.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a5c066f60 0x7f1a5c069410 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7c15dda0 0x7f1a7c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a7c0cd6e0 0x7f1a7c0c90b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 --2- 172.21.15.79:0/2092354507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a7c0cdab0 0x7f1a7c155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 >> 172.21.15.79:0/2092354507 conn(0x7f1a7c067660 msgr2=0x7f1a7c0c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:58.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 shutdown_connections 2023-10-14T18:46:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.144+0000 7f1a7b59e700 1 -- 172.21.15.79:0/2092354507 wait complete. 2023-10-14T18:46:58.149 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:58.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:46:58.290 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.483388379000001,"mdsmap_epoch":24,"osdmap_epoch":53,"osdmap_epoch_barrier":48,"uptime":37.4631951} 2023-10-14T18:46:58.290 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 24, "osdmap_epoch": 53, "osdmap_epoch_barrier": 48, "rank_uptime": 31.483388379, "state": "up:active", "uptime": 37.4631951, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:46:58.291 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:46:58.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:58.292 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-14T18:46:58.571 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:46:58.571 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:46:58.571 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.262346 s, 200 MB/s 2023-10-14T18:46:58.572 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:46:58.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:58.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:46:58.659 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:46:58.660 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:46:58.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:58.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:46:58.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:46:58.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:58.727 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:46:58.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:46:58.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:46:58.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:46:58.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:46:58.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:46:58.783 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:46:58.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:46:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.952+0000 7fa92b59e700 1 Processor -- start 2023-10-14T18:46:58.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.952+0000 7fa92b59e700 1 -- start start 2023-10-14T18:46:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92b59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa92c15cbd0 0x7fa92c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92b59e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c0cb7c0 con 0x7fa92c0cdab0 2023-10-14T18:46:58.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92b59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92c15e290 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92b59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92c15e850 con 0x7fa92c15cbd0 2023-10-14T18:46:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa929d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa92c0cdab0 0x7fa92c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39692/0 (socket says 172.21.15.79:39692) 2023-10-14T18:46:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa929d9b700 1 -- 172.21.15.79:0/1204909369 learned_addr learned my addr 172.21.15.79:0/1204909369 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92ad9d700 1 --2- 172.21.15.79:0/1204909369 >> v2:172.21.15.144:3300/0 conn(0x7fa92c15cbd0 0x7fa92c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:58.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468899099 0 0) 0x7fa92c0cb7c0 con 0x7fa92c0cdab0 2023-10-14T18:46:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.953+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa918003570 con 0x7fa92c0cdab0 2023-10-14T18:46:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136104146 0 0) 0x7fa918003570 con 0x7fa92c0cdab0 2023-10-14T18:46:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92ad9d700 1 -- 172.21.15.79:0/1204909369 >> v1:172.21.15.144:6789/0 conn(0x7fa92c0cd6e0 legacy=0x7fa92c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92ad9d700 1 -- 172.21.15.79:0/1204909369 >> v1:172.21.15.79:6789/0 conn(0x7fa92c0cdab0 legacy=0x7fa92c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92ad9d700 1 -- 172.21.15.79:0/1204909369 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c15e570 con 0x7fa92c15cbd0 2023-10-14T18:46:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92ad9d700 1 --2- 172.21.15.79:0/1204909369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c15cbd0 0x7fa92c15d050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9240098e0 tx=0x7fa9240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6fe00bfdfd246fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914001470 con 0x7fa92c15cbd0 2023-10-14T18:46:58.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924011420 con 0x7fa92c15cbd0 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92959a700 1 -- 172.21.15.79:0/1204909369 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9240117c0 con 0x7fa92c15cbd0 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92b59e700 1 -- 172.21.15.79:0/1204909369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c15cbd0 msgr2=0x7fa92c15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.954+0000 7fa92b59e700 1 --2- 172.21.15.79:0/1204909369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c15cbd0 0x7fa92c15d050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9240098e0 tx=0x7fa9240091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.955+0000 7fa92b59e700 1 -- 172.21.15.79:0/1204909369 shutdown_connections 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.955+0000 7fa92b59e700 1 --2- 172.21.15.79:0/1204909369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c15cbd0 0x7fa92c15d050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.955+0000 7fa92b59e700 1 -- 172.21.15.79:0/1204909369 >> 172.21.15.79:0/1204909369 conn(0x7fa92c067660 msgr2=0x7fa92c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.955+0000 7fa92b59e700 1 -- 172.21.15.79:0/1204909369 shutdown_connections 2023-10-14T18:46:58.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.955+0000 7fa92b59e700 1 -- 172.21.15.79:0/1204909369 wait complete. 2023-10-14T18:46:58.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.956+0000 7fa92b59e700 1 Processor -- start 2023-10-14T18:46:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.956+0000 7fa92b59e700 1 -- start start 2023-10-14T18:46:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.956+0000 7fa92b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.956+0000 7fa92b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0cdab0 0x7fa92c0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:58.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c15cbd0 0x7fa92c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0cc360 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c155c90 con 0x7fa92c0cdab0 2023-10-14T18:46:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0b29e0 con 0x7fa92c15cbd0 2023-10-14T18:46:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:58.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55090/0 (socket says 172.21.15.79:55090) 2023-10-14T18:46:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 -- 172.21.15.79:0/908398380 learned_addr learned my addr 172.21.15.79:0/908398380 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa929d9b700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0cdab0 0x7fa92c0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92ad9d700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c15cbd0 0x7fa92c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 -- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c15cbd0 msgr2=0x7fa92c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c15cbd0 0x7fa92c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 -- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0cdab0 msgr2=0x7fa92c0c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:58.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0cdab0 0x7fa92c0c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:58.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 -- 172.21.15.79:0/908398380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924009420 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92a59c700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cb60 tx=0x7fa91c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:58.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0020b0 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91c00a7e0 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c00aba0 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c0b6810 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.957+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c0b20b0 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.958+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c089280 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.959+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa91c003030 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.959+0000 7fa9227fc700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 0x7fa90c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.959+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa91c0845c0 con 0x7fa92c0cd6e0 2023-10-14T18:46:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.959+0000 7fa929d9b700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 0x7fa90c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:58.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.959+0000 7fa929d9b700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 0x7fa90c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa92c070050 tx=0x7fa914000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:58.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:58.963+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa91c0517f0 con 0x7fa92c0cd6e0 2023-10-14T18:46:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.187+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa92c04bb80 con 0x7fa92c0cd6e0 2023-10-14T18:46:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.187+0000 7fa9227fc700 1 -- 172.21.15.79:0/908398380 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fa91c054e10 con 0x7fa92c0cd6e0 2023-10-14T18:46:59.188 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:46:59.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.189+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 msgr2=0x7fa90c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.189+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 0x7fa90c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa92c070050 tx=0x7fa914000bc0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.189+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 msgr2=0x7fa92c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.189+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00cb60 tx=0x7fa91c0017a0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 shutdown_connections 2023-10-14T18:46:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa90c066f30 0x7fa90c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa92c15cbd0 0x7fa92c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa92c0cd6e0 0x7fa92c0b62d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 --2- 172.21.15.79:0/908398380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa92c0cdab0 0x7fa92c0c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 >> 172.21.15.79:0/908398380 conn(0x7fa92c067660 msgr2=0x7fa92c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 shutdown_connections 2023-10-14T18:46:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.190+0000 7fa92b59e700 1 -- 172.21.15.79:0/908398380 wait complete. 2023-10-14T18:46:59.193 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:46:59.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:46:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.319+0000 7f355a95b700 1 Processor -- start 2023-10-14T18:46:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.319+0000 7f355a95b700 1 -- start start 2023-10-14T18:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f355a95b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f355415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f355a95b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540cb7c0 con 0x7f35540cdab0 2023-10-14T18:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f355a95b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355415e290 con 0x7f35540cd6e0 2023-10-14T18:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f355a95b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355415e850 con 0x7f355415cbd0 2023-10-14T18:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3559158700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f35540cdab0 0x7f355415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39702/0 (socket says 172.21.15.79:39702) 2023-10-14T18:46:59.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3559158700 1 -- 172.21.15.79:0/2447467931 learned_addr learned my addr 172.21.15.79:0/2447467931 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f355a15a700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f355415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752298459 0 0) 0x7f35540cb7c0 con 0x7f35540cdab0 2023-10-14T18:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c003570 con 0x7f35540cdab0 2023-10-14T18:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686307269 0 0) 0x7f353c003570 con 0x7f35540cdab0 2023-10-14T18:46:59.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 msgr2=0x7f355415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f355415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 >> v1:172.21.15.144:6789/0 conn(0x7f35540cd6e0 legacy=0x7f35540cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355415e570 con 0x7f35540cdab0 2023-10-14T18:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f3548001470 con 0x7f35540cdab0 2023-10-14T18:46:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 >> v1:172.21.15.79:6789/0 conn(0x7f35540cdab0 legacy=0x7f355415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f353c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f353c003fd0 0x7f353c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c004d50 0x7f353c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355415e850 con 0x7f353c004d50 2023-10-14T18:46:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00bb40 con 0x7f353c003fd0 2023-10-14T18:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.320+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00bd00 con 0x7f355415cbd0 2023-10-14T18:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c004d50 0x7f353c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f3559959700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f353c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f3559158700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f353c003fd0 0x7f353c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 -- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 msgr2=0x7f353c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355415cbd0 0x7f353c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 -- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f353c003fd0 msgr2=0x7f353c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f353c003fd0 0x7f353c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 -- 172.21.15.79:0/2447467931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c003570 con 0x7f353c004d50 2023-10-14T18:46:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f355a15a700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c004d50 0x7f353c0051c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3544009c00 tx=0x7f35440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d996119cb082898 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400e710 con 0x7f353c004d50 2023-10-14T18:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400e870 con 0x7f353c004d50 2023-10-14T18:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.321+0000 7f3558957700 1 -- 172.21.15.79:0/2447467931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400ec30 con 0x7f353c004d50 2023-10-14T18:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 -- 172.21.15.79:0/2447467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c004d50 msgr2=0x7f353c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 --2- 172.21.15.79:0/2447467931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f353c004d50 0x7f353c0051c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3544009c00 tx=0x7f35440091a0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a15a700 1 -- 172.21.15.79:0/2447467931 reap_dead start 2023-10-14T18:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 -- 172.21.15.79:0/2447467931 shutdown_connections 2023-10-14T18:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 -- 172.21.15.79:0/2447467931 >> 172.21.15.79:0/2447467931 conn(0x7f3554067660 msgr2=0x7f3554067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 -- 172.21.15.79:0/2447467931 shutdown_connections 2023-10-14T18:46:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.322+0000 7f355a95b700 1 -- 172.21.15.79:0/2447467931 wait complete. 2023-10-14T18:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 Processor -- start 2023-10-14T18:46:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 -- start start 2023-10-14T18:46:59.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35540b4420 0x7f355416b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355416bec0 0x7f35540b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540cc360 con 0x7f35540b5490 2023-10-14T18:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540c6280 con 0x7f35540b4420 2023-10-14T18:46:59.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.323+0000 7f355a95b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540b4890 con 0x7f355416bec0 2023-10-14T18:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55112/0 (socket says 172.21.15.79:55112) 2023-10-14T18:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 -- 172.21.15.79:0/2215418057 learned_addr learned my addr 172.21.15.79:0/2215418057 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f355a15a700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355416bec0 0x7f35540b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559158700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35540b4420 0x7f355416b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 -- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355416bec0 msgr2=0x7f35540b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355416bec0 0x7f35540b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 -- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35540b4420 msgr2=0x7f355416b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35540b4420 0x7f355416b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 -- 172.21.15.79:0/2215418057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355416a950 con 0x7f35540b5490 2023-10-14T18:46:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3559959700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f354c00ec10 tx=0x7f354c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00c8b0 con 0x7f35540b5490 2023-10-14T18:46:59.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c00ca10 con 0x7f35540b5490 2023-10-14T18:46:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35540b5860 con 0x7f35540b5490 2023-10-14T18:46:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00cdb0 con 0x7f35540b5490 2023-10-14T18:46:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.324+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35540c9d60 con 0x7f35540b5490 2023-10-14T18:46:59.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.325+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3554089280 con 0x7f35540b5490 2023-10-14T18:46:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.326+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f354c015640 con 0x7f35540b5490 2023-10-14T18:46:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.326+0000 7f3551ffb700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.326+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f354c084dd0 con 0x7f35540b5490 2023-10-14T18:46:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.326+0000 7f3559158700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.326+0000 7f3559158700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3548000e50 tx=0x7f3548001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.330+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f354c052000 con 0x7f35540b5490 2023-10-14T18:46:59.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.514+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35540b6820 con 0x7f35540b5490 2023-10-14T18:46:59.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.515+0000 7f3551ffb700 1 -- 172.21.15.79:0/2215418057 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f354c055620 con 0x7f35540b5490 2023-10-14T18:46:59.516 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:46:59.516 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":54,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:58.608443+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:46:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 msgr2=0x7f35400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 0x7f35400693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3548000e50 tx=0x7f3548001e70 comp rx=0 tx=0).stop 2023-10-14T18:46:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 msgr2=0x7f35540c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f354c00ec10 tx=0x7f354c0016d0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 shutdown_connections 2023-10-14T18:46:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3540066f30 0x7f35400693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f355416bec0 0x7f35540b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35540b5490 0x7f35540c94a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 --2- 172.21.15.79:0/2215418057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35540b4420 0x7f355416b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 >> 172.21.15.79:0/2215418057 conn(0x7f3554067660 msgr2=0x7f3554157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 shutdown_connections 2023-10-14T18:46:59.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.517+0000 7f355a95b700 1 -- 172.21.15.79:0/2215418057 wait complete. 2023-10-14T18:46:59.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:46:23.998299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:46:25.134494+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:46:59.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:46:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.650+0000 7fac3bee7700 1 Processor -- start 2023-10-14T18:46:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.650+0000 7fac3bee7700 1 -- start start 2023-10-14T18:46:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac3bee7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac34159ec0 0x7fac340af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac3bee7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac3415a290 0x7fac340afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac3bee7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340b0790 con 0x7fac3406a5a0 2023-10-14T18:46:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac3bee7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340ce1f0 con 0x7fac34159ec0 2023-10-14T18:46:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac3bee7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b0b20 con 0x7fac3415a290 2023-10-14T18:46:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac34159ec0 0x7fac340af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac34159ec0 0x7fac340af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55128/0 (socket says 172.21.15.79:55128) 2023-10-14T18:46:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 -- 172.21.15.79:0/4251709654 learned_addr learned my addr 172.21.15.79:0/4251709654 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39482700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac3415a290 0x7fac340afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 -- 172.21.15.79:0/4251709654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac3415a290 msgr2=0x7fac340afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac3415a290 0x7fac340afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 -- 172.21.15.79:0/4251709654 >> v1:172.21.15.144:6789/0 conn(0x7fac3406a5a0 legacy=0x7fac3415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.651+0000 7fac39c83700 1 -- 172.21.15.79:0/4251709654 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340b04b0 con 0x7fac34159ec0 2023-10-14T18:46:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac39c83700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34159ec0 0x7fac340af940 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac300099b0 tx=0x7fac30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18600ce432b6c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac38c81700 1 -- 172.21.15.79:0/4251709654 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000b860 con 0x7fac34159ec0 2023-10-14T18:46:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac38c81700 1 -- 172.21.15.79:0/4251709654 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000b9c0 con 0x7fac34159ec0 2023-10-14T18:46:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac38c81700 1 -- 172.21.15.79:0/4251709654 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000bd60 con 0x7fac34159ec0 2023-10-14T18:46:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 -- 172.21.15.79:0/4251709654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34159ec0 msgr2=0x7fac340af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34159ec0 0x7fac340af940 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fac300099b0 tx=0x7fac30009250 comp rx=0 tx=0).stop 2023-10-14T18:46:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 -- 172.21.15.79:0/4251709654 shutdown_connections 2023-10-14T18:46:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac34159ec0 0x7fac340af940 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 --2- 172.21.15.79:0/4251709654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac3415a290 0x7fac340afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 -- 172.21.15.79:0/4251709654 >> 172.21.15.79:0/4251709654 conn(0x7fac340d1880 msgr2=0x7fac340cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 -- 172.21.15.79:0/4251709654 shutdown_connections 2023-10-14T18:46:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.652+0000 7fac3bee7700 1 -- 172.21.15.79:0/4251709654 wait complete. 2023-10-14T18:46:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.653+0000 7fac3bee7700 1 Processor -- start 2023-10-14T18:46:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.653+0000 7fac3bee7700 1 -- start start 2023-10-14T18:46:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac34159ec0 0x7fac340b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415a290 0x7fac340c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415b130 con 0x7fac3406a5a0 2023-10-14T18:46:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415a800 con 0x7fac3415a290 2023-10-14T18:46:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac3bee7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415aae0 con 0x7fac34159ec0 2023-10-14T18:46:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55130/0 (socket says 172.21.15.79:55130) 2023-10-14T18:46:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 -- 172.21.15.79:0/2030576081 learned_addr learned my addr 172.21.15.79:0/2030576081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 -- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac34159ec0 msgr2=0x7fac340b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac34159ec0 0x7fac340b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 -- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415a290 msgr2=0x7fac340c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415a290 0x7fac340c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.654+0000 7fac39c83700 1 -- 172.21.15.79:0/2030576081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300094f0 con 0x7fac3406a5a0 2023-10-14T18:46:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac39c83700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac34071eb0 tx=0x7fac30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30024440 con 0x7fac3406a5a0 2023-10-14T18:46:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac300245c0 con 0x7fac3406a5a0 2023-10-14T18:46:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30024980 con 0x7fac3406a5a0 2023-10-14T18:46:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3415adc0 con 0x7fac3406a5a0 2023-10-14T18:46:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.655+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340b5990 con 0x7fac3406a5a0 2023-10-14T18:46:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.656+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac340b5bb0 con 0x7fac3406a5a0 2023-10-14T18:46:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.656+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac3001a420 con 0x7fac3406a5a0 2023-10-14T18:46:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.657+0000 7fac29ffb700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 0x7fac180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.657+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fac30086480 con 0x7fac3406a5a0 2023-10-14T18:46:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.657+0000 7fac39482700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 0x7fac180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.657+0000 7fac39482700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 0x7fac180693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac340cf930 tx=0x7fac24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.661+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac340b5bb0 con 0x7fac3406a5a0 2023-10-14T18:46:59.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.843+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac340b5bb0 con 0x7fac3406a5a0 2023-10-14T18:46:59.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.844+0000 7fac29ffb700 1 -- 172.21.15.79:0/2030576081 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac340b5bb0 con 0x7fac3406a5a0 2023-10-14T18:46:59.845 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:46:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 msgr2=0x7fac180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 0x7fac180693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac340cf930 tx=0x7fac24008040 comp rx=0 tx=0).stop 2023-10-14T18:46:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 msgr2=0x7fac3414a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac34071eb0 tx=0x7fac30017000 comp rx=0 tx=0).stop 2023-10-14T18:46:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 shutdown_connections 2023-10-14T18:46:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac18066f30 0x7fac180693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac3415a290 0x7fac340c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3406a5a0 0x7fac3414a740 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 --2- 172.21.15.79:0/2030576081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac34159ec0 0x7fac340b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 >> 172.21.15.79:0/2030576081 conn(0x7fac340d1880 msgr2=0x7fac340b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 shutdown_connections 2023-10-14T18:46:59.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.846+0000 7fac3bee7700 1 -- 172.21.15.79:0/2030576081 wait complete. 2023-10-14T18:46:59.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:46:59.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.975+0000 7f30dff62700 1 Processor -- start 2023-10-14T18:46:59.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.975+0000 7f30dff62700 1 -- start start 2023-10-14T18:46:59.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dff62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30d815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dff62700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d815ea90 con 0x7f30d815a230 2023-10-14T18:46:59.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dff62700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d80b3100 con 0x7f30d8159e60 2023-10-14T18:46:59.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dff62700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80d1cf0 con 0x7f30d80697c0 2023-10-14T18:46:59.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30de4ff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30d815a230 0x7f30d80af730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39712/0 (socket says 172.21.15.79:39712) 2023-10-14T18:46:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30de4ff700 1 -- 172.21.15.79:0/2517412779 learned_addr learned my addr 172.21.15.79:0/2517412779 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:46:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dd4fd700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30d815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609004773 0 0) 0x7f30d815ea90 con 0x7f30d815a230 2023-10-14T18:46:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.976+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30c4003570 con 0x7f30d815a230 2023-10-14T18:46:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2364968868 0 0) 0x7f30c4003570 con 0x7f30d815a230 2023-10-14T18:46:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 msgr2=0x7f30d815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30d815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 >> v1:172.21.15.144:6789/0 conn(0x7f30d8159e60 legacy=0x7f30d80690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d80d10e0 con 0x7f30d815a230 2023-10-14T18:46:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f30d00017f0 con 0x7f30d815a230 2023-10-14T18:46:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 >> v1:172.21.15.79:6789/0 conn(0x7f30d815a230 legacy=0x7f30d80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30c4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4003fd0 0x7f30c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80d1cf0 con 0x7f30c4004d50 2023-10-14T18:46:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c400bb40 con 0x7f30c4003fd0 2023-10-14T18:46:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c400bd00 con 0x7f30d80697c0 2023-10-14T18:46:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dd4fd700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4003fd0 0x7f30c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30ddcfe700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30c4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 -- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 msgr2=0x7f30c4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d80697c0 0x7f30c4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 -- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4003fd0 msgr2=0x7f30c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:46:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4003fd0 0x7f30c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 -- 172.21.15.79:0/2517412779 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4003570 con 0x7f30c4004d50 2023-10-14T18:46:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30de4ff700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30c40051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f30d000a950 tx=0x7f30d00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9224c79690c61674 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00070d0 con 0x7f30c4004d50 2023-10-14T18:46:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d0007230 con 0x7f30c4004d50 2023-10-14T18:46:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.977+0000 7f30dccfc700 1 -- 172.21.15.79:0/2517412779 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00075f0 con 0x7f30c4004d50 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 -- 172.21.15.79:0/2517412779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 msgr2=0x7f30c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 --2- 172.21.15.79:0/2517412779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30c40051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f30d000a950 tx=0x7f30d00021f0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30de4ff700 1 -- 172.21.15.79:0/2517412779 reap_dead start 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 -- 172.21.15.79:0/2517412779 shutdown_connections 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 -- 172.21.15.79:0/2517412779 >> 172.21.15.79:0/2517412779 conn(0x7f30d8070700 msgr2=0x7f30d8070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:46:59.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 -- 172.21.15.79:0/2517412779 shutdown_connections 2023-10-14T18:46:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.978+0000 7f30dff62700 1 -- 172.21.15.79:0/2517412779 wait complete. 2023-10-14T18:46:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.979+0000 7f30dff62700 1 Processor -- start 2023-10-14T18:46:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.979+0000 7f30dff62700 1 -- start start 2023-10-14T18:46:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30d80aff40 0x7f30d815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d8158d00 0x7f30d815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d815d380 con 0x7f30c4004d50 2023-10-14T18:46:59.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d815d5d0 con 0x7f30d80aff40 2023-10-14T18:46:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dff62700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d815d8b0 con 0x7f30d8158d00 2023-10-14T18:46:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55160/0 (socket says 172.21.15.79:55160) 2023-10-14T18:46:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 -- 172.21.15.79:0/3666555629 learned_addr learned my addr 172.21.15.79:0/3666555629 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:46:59.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30de4ff700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d8158d00 0x7f30d815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30dd4fd700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30d80aff40 0x7f30d815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 -- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d8158d00 msgr2=0x7f30d815ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d8158d00 0x7f30d815ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 -- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30d80aff40 msgr2=0x7f30d815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30d80aff40 0x7f30d815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:46:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 -- 172.21.15.79:0/3666555629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d815db90 con 0x7f30c4004d50 2023-10-14T18:46:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30ddcfe700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f30d4002ab0 tx=0x7f30d4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:46:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.980+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d400f8d0 con 0x7f30c4004d50 2023-10-14T18:46:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.981+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d400fa30 con 0x7f30c4004d50 2023-10-14T18:46:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.981+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d815de70 con 0x7f30c4004d50 2023-10-14T18:46:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.981+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d400fe30 con 0x7f30c4004d50 2023-10-14T18:46:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.981+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d8159480 con 0x7f30c4004d50 2023-10-14T18:46:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.982+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d815e060 con 0x7f30c4004d50 2023-10-14T18:46:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.982+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30d4013600 con 0x7f30c4004d50 2023-10-14T18:46:59.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.982+0000 7f30cdffb700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 0x7f30bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:46:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.982+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f30d4084bd0 con 0x7f30c4004d50 2023-10-14T18:46:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.982+0000 7f30dd4fd700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 0x7f30bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:46:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.983+0000 7f30dd4fd700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 0x7f30bc0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30d80ce320 tx=0x7f30c80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:46:59.986+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30d4051d60 con 0x7f30c4004d50 2023-10-14T18:47:00.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.168+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30d804c3c0 con 0x7f30c4004d50 2023-10-14T18:47:00.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.169+0000 7f30cdffb700 1 -- 172.21.15.79:0/3666555629 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30d4017020 con 0x7f30c4004d50 2023-10-14T18:47:00.170 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:47:00.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 msgr2=0x7f30bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 0x7f30bc0693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30d80ce320 tx=0x7f30c80091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 msgr2=0x7f30d81584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f30d4002ab0 tx=0x7f30d4007d10 comp rx=0 tx=0).stop 2023-10-14T18:47:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 shutdown_connections 2023-10-14T18:47:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30bc066f30 0x7f30bc0693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30d8158d00 0x7f30d815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4004d50 0x7f30d81584d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 --2- 172.21.15.79:0/3666555629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30d80aff40 0x7f30d815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 >> 172.21.15.79:0/3666555629 conn(0x7f30d8070700 msgr2=0x7f30d80d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 shutdown_connections 2023-10-14T18:47:00.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.171+0000 7f30dff62700 1 -- 172.21.15.79:0/3666555629 wait complete. 2023-10-14T18:47:00.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:47:00.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.299+0000 7f889cad3700 1 Processor -- start 2023-10-14T18:47:00.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.299+0000 7f889cad3700 1 -- start start 2023-10-14T18:47:00.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8898159ec0 0x7f88980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f889815a290 0x7f88980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f889806a5a0 0x7f889806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889806af60 con 0x7f889815a290 2023-10-14T18:47:00.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980b0790 con 0x7f889806a5a0 2023-10-14T18:47:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889cad3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980ce1f0 con 0x7f8898159ec0 2023-10-14T18:47:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f889815a290 0x7f88980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f889815a290 0x7f88980afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55168/0 (socket says 172.21.15.79:55168) 2023-10-14T18:47:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 -- 172.21.15.79:0/1097846699 learned_addr learned my addr 172.21.15.79:0/1097846699 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:00.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f889659c700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8898159ec0 0x7f88980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f8896d9d700 1 --2- 172.21.15.79:0/1097846699 >> v2:172.21.15.144:3300/0 conn(0x7f889806a5a0 0x7f889806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 -- 172.21.15.79:0/1097846699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8898159ec0 msgr2=0x7f88980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:00.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8898159ec0 0x7f88980af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 -- 172.21.15.79:0/1097846699 >> v2:172.21.15.144:3300/0 conn(0x7f889806a5a0 msgr2=0x7f889806aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:00.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 --2- 172.21.15.79:0/1097846699 >> v2:172.21.15.144:3300/0 conn(0x7f889806a5a0 0x7f889806aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.300+0000 7f888dd9b700 1 -- 172.21.15.79:0/1097846699 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980b0b20 con 0x7f889815a290 2023-10-14T18:47:00.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f888dd9b700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889815a290 0x7f88980afe80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f88980b03c0 tx=0x7f8880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b99aba4fd582d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f8895d9b700 1 -- 172.21.15.79:0/1097846699 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000b640 con 0x7f889815a290 2023-10-14T18:47:00.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f8895d9b700 1 -- 172.21.15.79:0/1097846699 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000b7a0 con 0x7f889815a290 2023-10-14T18:47:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f8895d9b700 1 -- 172.21.15.79:0/1097846699 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888000bb60 con 0x7f889815a290 2023-10-14T18:47:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 -- 172.21.15.79:0/1097846699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889815a290 msgr2=0x7f88980afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889815a290 0x7f88980afe80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f88980b03c0 tx=0x7f8880009250 comp rx=0 tx=0).stop 2023-10-14T18:47:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 -- 172.21.15.79:0/1097846699 shutdown_connections 2023-10-14T18:47:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8898159ec0 0x7f88980af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 --2- 172.21.15.79:0/1097846699 >> v2:172.21.15.144:3300/0 conn(0x7f889806a5a0 0x7f889806aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 --2- 172.21.15.79:0/1097846699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f889815a290 0x7f88980afe80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 -- 172.21.15.79:0/1097846699 >> 172.21.15.79:0/1097846699 conn(0x7f88980d1880 msgr2=0x7f88980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 -- 172.21.15.79:0/1097846699 shutdown_connections 2023-10-14T18:47:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.301+0000 7f889cad3700 1 -- 172.21.15.79:0/1097846699 wait complete. 2023-10-14T18:47:00.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.302+0000 7f889cad3700 1 Processor -- start 2023-10-14T18:47:00.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 -- start start 2023-10-14T18:47:00.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f889806a5a0 0x7f8898157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 0x7f88980c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980cbd10 con 0x7f8898159ec0 2023-10-14T18:47:00.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898158220 con 0x7f889815a290 2023-10-14T18:47:00.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889cad3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889815e140 con 0x7f889806a5a0 2023-10-14T18:47:00.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f888dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f888dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55176/0 (socket says 172.21.15.79:55176) 2023-10-14T18:47:00.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f888dd9b700 1 -- 172.21.15.79:0/4159226403 learned_addr learned my addr 172.21.15.79:0/4159226403 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:00.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f889659c700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f889806a5a0 0x7f8898157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.303+0000 7f8896d9d700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 0x7f88980c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 -- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f889806a5a0 msgr2=0x7f8898157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f889806a5a0 0x7f8898157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 -- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 msgr2=0x7f88980c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 0x7f88980c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 -- 172.21.15.79:0/4159226403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800094f0 con 0x7f8898159ec0 2023-10-14T18:47:00.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f8896d9d700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 0x7f88980c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:00.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888dd9b700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8898071eb0 tx=0x7f8880017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880000d10 con 0x7f8898159ec0 2023-10-14T18:47:00.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000bb20 con 0x7f8898159ec0 2023-10-14T18:47:00.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980cb4b0 con 0x7f8898159ec0 2023-10-14T18:47:00.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880011670 con 0x7f8898159ec0 2023-10-14T18:47:00.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.304+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980cba30 con 0x7f8898159ec0 2023-10-14T18:47:00.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.305+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889804c3c0 con 0x7f8898159ec0 2023-10-14T18:47:00.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.305+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88800119e0 con 0x7f8898159ec0 2023-10-14T18:47:00.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.306+0000 7f888effd700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.306+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8880085c60 con 0x7f8898159ec0 2023-10-14T18:47:00.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.306+0000 7f889659c700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.306+0000 7f889659c700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8888009db0 tx=0x7f88880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.310+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8880052e90 con 0x7f8898159ec0 2023-10-14T18:47:00.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.492+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f889815e280 con 0x7f8898159ec0 2023-10-14T18:47:00.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.493+0000 7f888effd700 1 -- 172.21.15.79:0/4159226403 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88800564b0 con 0x7f8898159ec0 2023-10-14T18:47:00.494 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:47:00.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 msgr2=0x7f88780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8888009db0 tx=0x7f88880091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 msgr2=0x7f889816a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8898071eb0 tx=0x7f8880017000 comp rx=0 tx=0).stop 2023-10-14T18:47:00.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 shutdown_connections 2023-10-14T18:47:00.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889815a290 0x7f88980c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f889806a5a0 0x7f8898157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 --2- 172.21.15.79:0/4159226403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8898159ec0 0x7f889816a5e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 >> 172.21.15.79:0/4159226403 conn(0x7f88980d1880 msgr2=0x7f8898158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 shutdown_connections 2023-10-14T18:47:00.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.495+0000 7f889cad3700 1 -- 172.21.15.79:0/4159226403 wait complete. 2023-10-14T18:47:00.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.621+0000 7f767e4ec700 1 Processor -- start 2023-10-14T18:47:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.621+0000 7f767e4ec700 1 -- start start 2023-10-14T18:47:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767e4ec700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7678159e60 0x7f76780cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767e4ec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767815b020 con 0x7f76780cb8d0 2023-10-14T18:47:00.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767e4ec700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780cbd30 con 0x7f7678159a90 2023-10-14T18:47:00.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767e4ec700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767815a450 con 0x7f7678159e60 2023-10-14T18:47:00.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767cce9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7678159e60 0x7f76780cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767dceb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f76780cb8d0 0x7f767815d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39716/0 (socket says 172.21.15.79:39716) 2023-10-14T18:47:00.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.622+0000 7f767dceb700 1 -- 172.21.15.79:0/983344078 learned_addr learned my addr 172.21.15.79:0/983344078 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:00.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767cce9700 1 -- 172.21.15.79:0/983344078 >> v1:172.21.15.144:6789/0 conn(0x7f7678159a90 legacy=0x7f7678068e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767cce9700 1 -- 172.21.15.79:0/983344078 >> v1:172.21.15.79:6789/0 conn(0x7f76780cb8d0 legacy=0x7f767815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767cce9700 1 -- 172.21.15.79:0/983344078 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678068670 con 0x7f7678159e60 2023-10-14T18:47:00.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f766ffff700 1 -- 172.21.15.79:0/983344078 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763656125 0 0) 0x7f767815b020 con 0x7f76780cb8d0 2023-10-14T18:47:00.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767cce9700 1 --2- 172.21.15.79:0/983344078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678159e60 0x7f76780cb390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f76680098e0 tx=0x7f76680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5fff1bd14dd32d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f766ffff700 1 -- 172.21.15.79:0/983344078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668009e80 con 0x7f7678159e60 2023-10-14T18:47:00.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f766ffff700 1 -- 172.21.15.79:0/983344078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766800b860 con 0x7f7678159e60 2023-10-14T18:47:00.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f766ffff700 1 -- 172.21.15.79:0/983344078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800bbe0 con 0x7f7678159e60 2023-10-14T18:47:00.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767e4ec700 1 -- 172.21.15.79:0/983344078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678159e60 msgr2=0x7f76780cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767e4ec700 1 --2- 172.21.15.79:0/983344078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678159e60 0x7f76780cb390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f76680098e0 tx=0x7f76680091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767e4ec700 1 -- 172.21.15.79:0/983344078 shutdown_connections 2023-10-14T18:47:00.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767e4ec700 1 --2- 172.21.15.79:0/983344078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7678159e60 0x7f76780cb390 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.623+0000 7f767e4ec700 1 -- 172.21.15.79:0/983344078 >> 172.21.15.79:0/983344078 conn(0x7f7678069870 msgr2=0x7f7678069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.624+0000 7f767e4ec700 1 -- 172.21.15.79:0/983344078 shutdown_connections 2023-10-14T18:47:00.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.624+0000 7f767e4ec700 1 -- 172.21.15.79:0/983344078 wait complete. 2023-10-14T18:47:00.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.625+0000 7f767e4ec700 1 Processor -- start 2023-10-14T18:47:00.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.625+0000 7f767e4ec700 1 -- start start 2023-10-14T18:47:00.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.625+0000 7f767e4ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 0x7f7678158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7678159e60 0x7f76780af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c7d10 con 0x7f76780cb8d0 2023-10-14T18:47:00.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b2470 con 0x7f7678159a90 2023-10-14T18:47:00.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780c60a0 con 0x7f7678159e60 2023-10-14T18:47:00.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55194/0 (socket says 172.21.15.79:55194) 2023-10-14T18:47:00.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 -- 172.21.15.79:0/2807391150 learned_addr learned my addr 172.21.15.79:0/2807391150 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:00.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767cce9700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 0x7f7678158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767dceb700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7678159e60 0x7f76780af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 -- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7678159e60 msgr2=0x7f76780af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7678159e60 0x7f76780af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 -- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 msgr2=0x7f7678158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 0x7f7678158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 -- 172.21.15.79:0/2807391150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7668009420 con 0x7f76780cb8d0 2023-10-14T18:47:00.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767cce9700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 0x7f7678158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:00.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767d4ea700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f767400c590 tx=0x7f767400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674011590 con 0x7f76780cb8d0 2023-10-14T18:47:00.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76740116f0 con 0x7f76780cb8d0 2023-10-14T18:47:00.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76780c6380 con 0x7f76780cb8d0 2023-10-14T18:47:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674011ab0 con 0x7f76780cb8d0 2023-10-14T18:47:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.626+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780b2090 con 0x7f76780cb8d0 2023-10-14T18:47:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.627+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767806e3e0 con 0x7f76780cb8d0 2023-10-14T18:47:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.628+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f767401b3b0 con 0x7f76780cb8d0 2023-10-14T18:47:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.628+0000 7f766d7fa700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 0x7f765c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.628+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7674083950 con 0x7f76780cb8d0 2023-10-14T18:47:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.628+0000 7f767cce9700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 0x7f765c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.629+0000 7f767cce9700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 0x7f765c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76680093f0 tx=0x7f7668017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.632+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7674050b80 con 0x7f76780cb8d0 2023-10-14T18:47:00.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.856+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76780cbd30 con 0x7f76780cb8d0 2023-10-14T18:47:00.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.856+0000 7f766d7fa700 1 -- 172.21.15.79:0/2807391150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f76780cbd30 con 0x7f76780cb8d0 2023-10-14T18:47:00.858 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:00.858 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:47:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 msgr2=0x7f765c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 0x7f765c0693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f76680093f0 tx=0x7f7668017000 comp rx=0 tx=0).stop 2023-10-14T18:47:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 msgr2=0x7f76780c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f767400c590 tx=0x7f767400c950 comp rx=0 tx=0).stop 2023-10-14T18:47:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 shutdown_connections 2023-10-14T18:47:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f765c066f30 0x7f765c0693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7678159e60 0x7f76780af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76780cb8d0 0x7f76780c59a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 --2- 172.21.15.79:0/2807391150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7678159a90 0x7f7678158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 >> 172.21.15.79:0/2807391150 conn(0x7f7678069870 msgr2=0x7f76780cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 shutdown_connections 2023-10-14T18:47:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.858+0000 7f767e4ec700 1 -- 172.21.15.79:0/2807391150 wait complete. 2023-10-14T18:47:00.862 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:47:00.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.984+0000 7f8edd188700 1 Processor -- start 2023-10-14T18:47:00.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.984+0000 7f8edd188700 1 -- start start 2023-10-14T18:47:00.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ed80afff0 0x7f8ed815e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8069e20 0x7f8ed806a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ed8070700 0x7f8ed8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80710c0 con 0x7f8ed80afff0 2023-10-14T18:47:00.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80b03c0 con 0x7f8ed8070700 2023-10-14T18:47:00.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8edd188700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed806a870 con 0x7f8ed8069e20 2023-10-14T18:47:00.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8ed6d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ed80afff0 0x7f8ed815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8ed6d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ed80afff0 0x7f8ed815e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55208/0 (socket says 172.21.15.79:55208) 2023-10-14T18:47:00.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.985+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/375780511 learned_addr learned my addr 172.21.15.79:0/375780511 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:00.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/375780511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8069e20 msgr2=0x7f8ed806a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:00.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/375780511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8069e20 0x7f8ed806a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/375780511 >> v2:172.21.15.144:3300/0 conn(0x7f8ed8070700 msgr2=0x7f8ed8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:00.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/375780511 >> v2:172.21.15.144:3300/0 conn(0x7f8ed8070700 0x7f8ed8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/375780511 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed806ab50 con 0x7f8ed80afff0 2023-10-14T18:47:00.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/375780511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed80afff0 0x7f8ed815e540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80c4a90 tx=0x7f8ec8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6949e70bc0996011 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:00.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed5d9b700 1 -- 172.21.15.79:0/375780511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800e070 con 0x7f8ed80afff0 2023-10-14T18:47:00.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed5d9b700 1 -- 172.21.15.79:0/375780511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800ba50 con 0x7f8ed80afff0 2023-10-14T18:47:00.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8ed5d9b700 1 -- 172.21.15.79:0/375780511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80092e0 con 0x7f8ed80afff0 2023-10-14T18:47:00.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 -- 172.21.15.79:0/375780511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed80afff0 msgr2=0x7f8ed815e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 --2- 172.21.15.79:0/375780511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed80afff0 0x7f8ed815e540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80c4a90 tx=0x7f8ec8009840 comp rx=0 tx=0).stop 2023-10-14T18:47:00.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 -- 172.21.15.79:0/375780511 shutdown_connections 2023-10-14T18:47:00.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 --2- 172.21.15.79:0/375780511 >> v2:172.21.15.144:3300/0 conn(0x7f8ed8070700 0x7f8ed8070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 --2- 172.21.15.79:0/375780511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed80afff0 0x7f8ed815e540 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 --2- 172.21.15.79:0/375780511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8069e20 0x7f8ed806a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 -- 172.21.15.79:0/375780511 >> 172.21.15.79:0/375780511 conn(0x7f8ed80cda50 msgr2=0x7f8ed80cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:00.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 -- 172.21.15.79:0/375780511 shutdown_connections 2023-10-14T18:47:00.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.986+0000 7f8edd188700 1 -- 172.21.15.79:0/375780511 wait complete. 2023-10-14T18:47:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 Processor -- start 2023-10-14T18:47:00.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 -- start start 2023-10-14T18:47:00.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8070700 0x7f8ed80b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed80afff0 0x7f8ed80b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:00.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b3960 con 0x7f8ed8069e20 2023-10-14T18:47:00.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b2ba0 con 0x7f8ed80afff0 2023-10-14T18:47:00.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8edd188700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80b2e80 con 0x7f8ed8070700 2023-10-14T18:47:00.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8ed6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:00.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8ed6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55210/0 (socket says 172.21.15.79:55210) 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.988+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/2766648999 learned_addr learned my addr 172.21.15.79:0/2766648999 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8070700 msgr2=0x7f8ed80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8070700 0x7f8ed80b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed80afff0 msgr2=0x7f8ed80b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed80afff0 0x7f8ed80b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:00.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 -- 172.21.15.79:0/2766648999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8009ae0 con 0x7f8ed8069e20 2023-10-14T18:47:01.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8ed6d9d700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ed806b150 tx=0x7f8ec8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8008b90 con 0x7f8ed8069e20 2023-10-14T18:47:01.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec8008d10 con 0x7f8ed8069e20 2023-10-14T18:47:01.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80b3160 con 0x7f8ed8069e20 2023-10-14T18:47:01.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80266b0 con 0x7f8ed8069e20 2023-10-14T18:47:01.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.989+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed80ab790 con 0x7f8ed8069e20 2023-10-14T18:47:01.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.990+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed804c3c0 con 0x7f8ed8069e20 2023-10-14T18:47:01.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.990+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ec8003040 con 0x7f8ed8069e20 2023-10-14T18:47:01.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.991+0000 7f8eceffd700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 0x7f8eb8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.991+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8ec8086470 con 0x7f8ed8069e20 2023-10-14T18:47:01.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.991+0000 7f8ed659c700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 0x7f8eb8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.991+0000 7f8ed659c700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 0x7f8eb8069460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097e0 tx=0x7f8ec0006d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:00.995+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec8053600 con 0x7f8ed8069e20 2023-10-14T18:47:01.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.179+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ed80cdec0 con 0x7f8ed8069e20 2023-10-14T18:47:01.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.180+0000 7f8eceffd700 1 -- 172.21.15.79:0/2766648999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f8ec8056c20 con 0x7f8ed8069e20 2023-10-14T18:47:01.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:01.181 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:59.611994+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 msgr2=0x7f8eb8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 0x7f8eb8069460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097e0 tx=0x7f8ec0006d10 comp rx=0 tx=0).stop 2023-10-14T18:47:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 msgr2=0x7f8ed80ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8ed806b150 tx=0x7f8ec8018000 comp rx=0 tx=0).stop 2023-10-14T18:47:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 shutdown_connections 2023-10-14T18:47:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8eb8066fb0 0x7f8eb8069460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed80afff0 0x7f8ed80b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8069e20 0x7f8ed80ab250 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 --2- 172.21.15.79:0/2766648999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed8070700 0x7f8ed80b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 >> 172.21.15.79:0/2766648999 conn(0x7f8ed80cda50 msgr2=0x7f8ed80cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:01.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 shutdown_connections 2023-10-14T18:47:01.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.182+0000 7f8edd188700 1 -- 172.21.15.79:0/2766648999 wait complete. 2023-10-14T18:47:01.195 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:47:01.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:01.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.309+0000 7f483efbe700 1 Processor -- start 2023-10-14T18:47:01.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.309+0000 7f483efbe700 1 -- start start 2023-10-14T18:47:01.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483efbe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815a620 0x7f483815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483efbe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f483815d580 0x7f4838158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483efbe700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483815cbb0 con 0x7f4838157870 2023-10-14T18:47:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483efbe700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483815bdb0 con 0x7f483815d580 2023-10-14T18:47:01.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483efbe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483815bfa0 con 0x7f483815a620 2023-10-14T18:47:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483d55b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f483815d580 0x7f4838158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483cd5a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4838157870 0x7f483815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39722/0 (socket says 172.21.15.79:39722) 2023-10-14T18:47:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f483cd5a700 1 -- 172.21.15.79:0/961295351 learned_addr learned my addr 172.21.15.79:0/961295351 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f482f7fe700 1 -- 172.21.15.79:0/961295351 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534311864 0 0) 0x7f483815cbb0 con 0x7f4838157870 2023-10-14T18:47:01.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.310+0000 7f482f7fe700 1 -- 172.21.15.79:0/961295351 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4820003570 con 0x7f4838157870 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483d55b700 1 -- 172.21.15.79:0/961295351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815a620 msgr2=0x7f483815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f482ffff700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815a620 0x7f483815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483d55b700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815a620 0x7f483815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483d55b700 1 -- 172.21.15.79:0/961295351 >> v1:172.21.15.79:6789/0 conn(0x7f4838157870 legacy=0x7f483815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483d55b700 1 -- 172.21.15.79:0/961295351 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483815c280 con 0x7f483815d580 2023-10-14T18:47:01.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483d55b700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483815d580 0x7f4838158110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4830009e60 tx=0x7f4830009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3695452e298d863b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f482f7fe700 1 -- 172.21.15.79:0/961295351 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483000e070 con 0x7f483815d580 2023-10-14T18:47:01.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f482f7fe700 1 -- 172.21.15.79:0/961295351 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483000bb60 con 0x7f483815d580 2023-10-14T18:47:01.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f482f7fe700 1 -- 172.21.15.79:0/961295351 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830012430 con 0x7f483815d580 2023-10-14T18:47:01.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 -- 172.21.15.79:0/961295351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483815d580 msgr2=0x7f4838158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483815d580 0x7f4838158110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4830009e60 tx=0x7f4830009780 comp rx=0 tx=0).stop 2023-10-14T18:47:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 -- 172.21.15.79:0/961295351 shutdown_connections 2023-10-14T18:47:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f483815d580 0x7f4838158110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 --2- 172.21.15.79:0/961295351 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815a620 0x7f483815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 -- 172.21.15.79:0/961295351 >> 172.21.15.79:0/961295351 conn(0x7f4838068ce0 msgr2=0x7f48380690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 -- 172.21.15.79:0/961295351 shutdown_connections 2023-10-14T18:47:01.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.311+0000 7f483efbe700 1 -- 172.21.15.79:0/961295351 wait complete. 2023-10-14T18:47:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.312+0000 7f483efbe700 1 Processor -- start 2023-10-14T18:47:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 -- start start 2023-10-14T18:47:01.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f483815a620 0x7f483814a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815d580 0x7f483815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48380d1360 con 0x7f4838157870 2023-10-14T18:47:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483814a6e0 con 0x7f483815a620 2023-10-14T18:47:01.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.313+0000 7f483efbe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48381532b0 con 0x7f483815d580 2023-10-14T18:47:01.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55226/0 (socket says 172.21.15.79:55226) 2023-10-14T18:47:01.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 -- 172.21.15.79:0/226095700 learned_addr learned my addr 172.21.15.79:0/226095700 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:01.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 -- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815d580 msgr2=0x7f483815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815d580 0x7f483815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 -- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f483815a620 msgr2=0x7f483814a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f483815a620 0x7f483814a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 -- 172.21.15.79:0/226095700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009a20 con 0x7f4838157870 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483cd5a700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f483400c7c0 tx=0x7f4834007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834005b30 con 0x7f4838157870 2023-10-14T18:47:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834005c90 con 0x7f4838157870 2023-10-14T18:47:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4838153590 con 0x7f4838157870 2023-10-14T18:47:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834007340 con 0x7f4838157870 2023-10-14T18:47:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.314+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380b2ed0 con 0x7f4838157870 2023-10-14T18:47:01.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.315+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48380b30f0 con 0x7f4838157870 2023-10-14T18:47:01.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.316+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f483401b400 con 0x7f4838157870 2023-10-14T18:47:01.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.316+0000 7f482cff9700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 0x7f4824069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.316+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f4834084010 con 0x7f4838157870 2023-10-14T18:47:01.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.316+0000 7f482ffff700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 0x7f4824069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.317+0000 7f482ffff700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 0x7f4824069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f483815e1b0 tx=0x7f4828008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.320+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48340512c0 con 0x7f4838157870 2023-10-14T18:47:01.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.543+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f483804c3c0 con 0x7f4838157870 2023-10-14T18:47:01.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.544+0000 7f482cff9700 1 -- 172.21.15.79:0/226095700 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f48340548e0 con 0x7f4838157870 2023-10-14T18:47:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:01.545 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:47:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 msgr2=0x7f4824069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 0x7f4824069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f483815e1b0 tx=0x7f4828008040 comp rx=0 tx=0).stop 2023-10-14T18:47:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 msgr2=0x7f4838152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f483400c7c0 tx=0x7f4834007e00 comp rx=0 tx=0).stop 2023-10-14T18:47:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 shutdown_connections 2023-10-14T18:47:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4824066f60 0x7f4824069410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483815d580 0x7f483815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4838157870 0x7f4838152bd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 --2- 172.21.15.79:0/226095700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f483815a620 0x7f483814a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 >> 172.21.15.79:0/226095700 conn(0x7f4838068ce0 msgr2=0x7f48380b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 shutdown_connections 2023-10-14T18:47:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.546+0000 7f483efbe700 1 -- 172.21.15.79:0/226095700 wait complete. 2023-10-14T18:47:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:47:01.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:01.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.673+0000 7f07f118c700 1 Processor -- start 2023-10-14T18:47:01.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.673+0000 7f07f118c700 1 -- start start 2023-10-14T18:47:01.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07f118c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f07ec06ac30 0x7f07ec164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07f118c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec15c360 con 0x7f07ec1577d0 2023-10-14T18:47:01.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07f118c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec15b790 con 0x7f07ec157ba0 2023-10-14T18:47:01.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07f118c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec15d800 con 0x7f07ec06ac30 2023-10-14T18:47:01.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07ead9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f07ec1577d0 0x7f07ec0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39734/0 (socket says 172.21.15.79:39734) 2023-10-14T18:47:01.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07ead9d700 1 -- 172.21.15.79:0/3436618837 learned_addr learned my addr 172.21.15.79:0/3436618837 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:01.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07eb59e700 1 --2- 172.21.15.79:0/3436618837 >> v2:172.21.15.144:3300/0 conn(0x7f07ec06ac30 0x7f07ec164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.674+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013224553 0 0) 0x7f07ec15c360 con 0x7f07ec1577d0 2023-10-14T18:47:01.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07d4003570 con 0x7f07ec1577d0 2023-10-14T18:47:01.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472681657 0 0) 0x7f07ec15b790 con 0x7f07ec157ba0 2023-10-14T18:47:01.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec15c360 con 0x7f07ec157ba0 2023-10-14T18:47:01.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910851991 0 0) 0x7f07d4003570 con 0x7f07ec1577d0 2023-10-14T18:47:01.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 >> v2:172.21.15.144:3300/0 conn(0x7f07ec06ac30 msgr2=0x7f07ec164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:01.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 --2- 172.21.15.79:0/3436618837 >> v2:172.21.15.144:3300/0 conn(0x7f07ec06ac30 0x7f07ec164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 >> v1:172.21.15.144:6789/0 conn(0x7f07ec157ba0 legacy=0x7f07ec06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec15ba30 con 0x7f07ec1577d0 2023-10-14T18:47:01.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f07dc001470 con 0x7f07ec1577d0 2023-10-14T18:47:01.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 >> v1:172.21.15.79:6789/0 conn(0x7f07ec1577d0 legacy=0x7f07ec0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 0x7f07d4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4004810 0x7f07d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d40051c0 0x7f07d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec15d800 con 0x7f07d4003bf0 2023-10-14T18:47:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d400c160 con 0x7f07d40051c0 2023-10-14T18:47:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d400c320 con 0x7f07d4004810 2023-10-14T18:47:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 0x7f07d4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07eb59e700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d40051c0 0x7f07d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ea59c700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4004810 0x7f07d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 -- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4004810 msgr2=0x7f07d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4004810 0x7f07d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 -- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d40051c0 msgr2=0x7f07d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:01.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d40051c0 0x7f07d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 -- 172.21.15.79:0/3436618837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d4003570 con 0x7f07d4003bf0 2023-10-14T18:47:01.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07eb59e700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d40051c0 0x7f07d400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:01.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07eb59e700 1 -- 172.21.15.79:0/3436618837 reap_dead start 2023-10-14T18:47:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07ead9d700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 0x7f07d4003fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c2a0 tx=0x7f07dc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ad37355354b8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00cb70 con 0x7f07d4003bf0 2023-10-14T18:47:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00ccd0 con 0x7f07d4003bf0 2023-10-14T18:47:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.675+0000 7f07e9d9b700 1 -- 172.21.15.79:0/3436618837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc005b70 con 0x7f07d4003bf0 2023-10-14T18:47:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 -- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 msgr2=0x7f07d4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 0x7f07d4003fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00c2a0 tx=0x7f07dc001e10 comp rx=0 tx=0).stop 2023-10-14T18:47:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 -- 172.21.15.79:0/3436618837 shutdown_connections 2023-10-14T18:47:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 --2- 172.21.15.79:0/3436618837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d4003bf0 0x7f07d4003fe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 -- 172.21.15.79:0/3436618837 >> 172.21.15.79:0/3436618837 conn(0x7f07ec068ce0 msgr2=0x7f07ec0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 -- 172.21.15.79:0/3436618837 shutdown_connections 2023-10-14T18:47:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.676+0000 7f07f118c700 1 -- 172.21.15.79:0/3436618837 wait complete. 2023-10-14T18:47:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.677+0000 7f07f118c700 1 Processor -- start 2023-10-14T18:47:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.677+0000 7f07f118c700 1 -- start start 2023-10-14T18:47:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4003bf0 0x7f07ec14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07ec14f250 0x7f07ec14f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec14edc0 con 0x7f07ec154ef0 2023-10-14T18:47:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec14e1b0 con 0x7f07ec14f250 2023-10-14T18:47:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07f118c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec14e490 con 0x7f07d4003bf0 2023-10-14T18:47:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55244/0 (socket says 172.21.15.79:55244) 2023-10-14T18:47:01.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 -- 172.21.15.79:0/700271684 learned_addr learned my addr 172.21.15.79:0/700271684 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:01.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07eb59e700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07ec14f250 0x7f07ec14f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ead9d700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4003bf0 0x7f07ec14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 -- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4003bf0 msgr2=0x7f07ec14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4003bf0 0x7f07ec14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 -- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07ec14f250 msgr2=0x7f07ec14f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07ec14f250 0x7f07ec14f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.678+0000 7f07ea59c700 1 -- 172.21.15.79:0/700271684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec14e770 con 0x7f07ec154ef0 2023-10-14T18:47:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07ea59c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f07e000e840 tx=0x7f07e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e00025d0 con 0x7f07ec154ef0 2023-10-14T18:47:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0002730 con 0x7f07ec154ef0 2023-10-14T18:47:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec14ea50 con 0x7f07ec154ef0 2023-10-14T18:47:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0002af0 con 0x7f07ec154ef0 2023-10-14T18:47:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.679+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec0b2900 con 0x7f07ec154ef0 2023-10-14T18:47:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.680+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec14cf40 con 0x7f07ec154ef0 2023-10-14T18:47:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.680+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07e00133e0 con 0x7f07ec154ef0 2023-10-14T18:47:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.680+0000 7f07d2ffd700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 0x7f07d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.680+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f07e0084590 con 0x7f07ec154ef0 2023-10-14T18:47:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.681+0000 7f07ead9d700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 0x7f07d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.681+0000 7f07ead9d700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 0x7f07d8069410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007c90 tx=0x7f07dc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.685+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07e0055250 con 0x7f07ec154ef0 2023-10-14T18:47:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.908+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07ec04c3c0 con 0x7f07ec154ef0 2023-10-14T18:47:01.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.909+0000 7f07d2ffd700 1 -- 172.21.15.79:0/700271684 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f07e0019090 con 0x7f07ec154ef0 2023-10-14T18:47:01.910 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:01.910 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:46:26.163690+0000","modified":"2023-10-14T18:46:29.805182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1192316967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1192316967},{"type":"v1","addr":"172.21.15.79:6835","nonce":1192316967}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-14T18:47:01.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 msgr2=0x7f07d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 0x7f07d8069410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007c90 tx=0x7f07dc015000 comp rx=0 tx=0).stop 2023-10-14T18:47:01.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 msgr2=0x7f07ec0b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:01.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f07e000e840 tx=0x7f07e0009040 comp rx=0 tx=0).stop 2023-10-14T18:47:01.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 shutdown_connections 2023-10-14T18:47:01.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.910+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07d8066f60 0x7f07d8069410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07ec14f250 0x7f07ec14f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d4003bf0 0x7f07ec14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 --2- 172.21.15.79:0/700271684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07ec154ef0 0x7f07ec0b05c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:01.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 >> 172.21.15.79:0/700271684 conn(0x7f07ec068ce0 msgr2=0x7f07ec063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:01.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 shutdown_connections 2023-10-14T18:47:01.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:01.911+0000 7f07f118c700 1 -- 172.21.15.79:0/700271684 wait complete. 2023-10-14T18:47:01.914 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2023-10-14T18:47:01.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.036+0000 7f6e0a7d9700 1 Processor -- start 2023-10-14T18:47:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.036+0000 7f6e0a7d9700 1 -- start start 2023-10-14T18:47:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e0a7d9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04157c40 0x7f6e04158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e0a7d9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0415cbb0 con 0x7f6e04157870 2023-10-14T18:47:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e0a7d9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0415bfa0 con 0x7f6e0415a620 2023-10-14T18:47:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e0a7d9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0415bdb0 con 0x7f6e04157c40 2023-10-14T18:47:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e03fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e04157870 0x7f6e0415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39736/0 (socket says 172.21.15.79:39736) 2023-10-14T18:47:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.037+0000 7f6e03fff700 1 -- 172.21.15.79:0/991670818 learned_addr learned my addr 172.21.15.79:0/991670818 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04157c40 0x7f6e04158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772760611 0 0) 0x7f6e0415cbb0 con 0x7f6e04157870 2023-10-14T18:47:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dec003570 con 0x7f6e04157870 2023-10-14T18:47:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014325736 0 0) 0x7f6e0415bfa0 con 0x7f6e0415a620 2023-10-14T18:47:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e0415cbb0 con 0x7f6e0415a620 2023-10-14T18:47:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 730408525 0 0) 0x7f6dec003570 con 0x7f6e04157870 2023-10-14T18:47:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04157c40 msgr2=0x7f6e04158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04157c40 0x7f6e04158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 >> v1:172.21.15.144:6789/0 conn(0x7f6e0415a620 legacy=0x7f6e0415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0415c280 con 0x7f6e04157870 2023-10-14T18:47:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f6df4001470 con 0x7f6e04157870 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 >> v1:172.21.15.79:6789/0 conn(0x7f6e04157870 legacy=0x7f6e0415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dec003c20 0x7f6dec004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dec004810 0x7f6dec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec0051c0 0x7f6dec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec00bff0 con 0x7f6dec0051c0 2023-10-14T18:47:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec00c160 con 0x7f6dec004810 2023-10-14T18:47:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec00c320 con 0x7f6dec003c20 2023-10-14T18:47:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04157c40 0x7f6e04158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec0051c0 0x7f6dec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e03fff700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dec003c20 0x7f6dec004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e037fe700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dec004810 0x7f6dec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 -- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dec003c20 msgr2=0x7f6dec004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dec003c20 0x7f6dec004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 -- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dec004810 msgr2=0x7f6dec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dec004810 0x7f6dec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.038+0000 7f6e08d76700 1 -- 172.21.15.79:0/991670818 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec003570 con 0x7f6dec0051c0 2023-10-14T18:47:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e08d76700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec0051c0 0x7f6dec00ba60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e04158010 tx=0x7f6dfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f906df6a805a0d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc00ea70 con 0x7f6dec0051c0 2023-10-14T18:47:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc00f040 con 0x7f6dec0051c0 2023-10-14T18:47:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e02ffd700 1 -- 172.21.15.79:0/991670818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc00ee00 con 0x7f6dec0051c0 2023-10-14T18:47:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/991670818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec0051c0 msgr2=0x7f6dec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/991670818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dec0051c0 0x7f6dec00ba60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6e04158010 tx=0x7f6dfc00b040 comp rx=0 tx=0).stop 2023-10-14T18:47:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e08d76700 1 -- 172.21.15.79:0/991670818 reap_dead start 2023-10-14T18:47:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/991670818 shutdown_connections 2023-10-14T18:47:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/991670818 >> 172.21.15.79:0/991670818 conn(0x7f6e04068ce0 msgr2=0x7f6e040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/991670818 shutdown_connections 2023-10-14T18:47:02.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.039+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/991670818 wait complete. 2023-10-14T18:47:02.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.040+0000 7f6e0a7d9700 1 Processor -- start 2023-10-14T18:47:02.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 -- start start 2023-10-14T18:47:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04156260 0x7f6e04160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 0x7f6e040c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0416dcf0 con 0x7f6e040c5b10 2023-10-14T18:47:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0415f880 con 0x7f6e040c7bc0 2023-10-14T18:47:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e0a7d9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040c8570 con 0x7f6e04156260 2023-10-14T18:47:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e08d76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e08d76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55258/0 (socket says 172.21.15.79:55258) 2023-10-14T18:47:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e08d76700 1 -- 172.21.15.79:0/1459185495 learned_addr learned my addr 172.21.15.79:0/1459185495 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.041+0000 7f6e03fff700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04156260 0x7f6e04160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e037fe700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 0x7f6e040c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 -- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04156260 msgr2=0x7f6e04160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04156260 0x7f6e04160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 -- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 msgr2=0x7f6e040c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 0x7f6e040c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 -- 172.21.15.79:0/1459185495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0415e9c0 con 0x7f6e040c5b10 2023-10-14T18:47:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e037fe700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 0x7f6e040c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e08d76700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc015000 tx=0x7f6dfc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc014e00 con 0x7f6e040c5b10 2023-10-14T18:47:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc01f410 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0415ec70 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc01f7d0 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.042+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0415f230 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.043+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0404c3c0 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.043+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dfc01fb80 con 0x7f6e040c5b10 2023-10-14T18:47:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.044+0000 7f6debfff700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.044+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6dfc085b70 con 0x7f6e040c5b10 2023-10-14T18:47:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.044+0000 7f6e03fff700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.044+0000 7f6e03fff700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 0x7f6df00693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6df4000c00 tx=0x7f6df4001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.048+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dfc052da0 con 0x7f6e040c5b10 2023-10-14T18:47:02.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.231+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0415c560 con 0x7f6e040c5b10 2023-10-14T18:47:02.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.232+0000 7f6debfff700 1 -- 172.21.15.79:0/1459185495 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+15445 (secure 0 0 0) 0x7f6dfc0563c0 con 0x7f6e040c5b10 2023-10-14T18:47:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:02.233 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":55,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:46:59.611994+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:46:23.998299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-14T18:46:25.134494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":5}]},{"pgid":"7.37","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:02.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 msgr2=0x7f6df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 0x7f6df00693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6df4000c00 tx=0x7f6df4001e10 comp rx=0 tx=0).stop 2023-10-14T18:47:02.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 msgr2=0x7f6e040c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc015000 tx=0x7f6dfc016000 comp rx=0 tx=0).stop 2023-10-14T18:47:02.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 shutdown_connections 2023-10-14T18:47:02.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6df0066f30 0x7f6df00693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e040c5b10 0x7f6e040c5f60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e04156260 0x7f6e04160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 --2- 172.21.15.79:0/1459185495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e040c7bc0 0x7f6e040c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 >> 172.21.15.79:0/1459185495 conn(0x7f6e04068ce0 msgr2=0x7f6e040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:02.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 shutdown_connections 2023-10-14T18:47:02.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.234+0000 7f6e0a7d9700 1 -- 172.21.15.79:0/1459185495 wait complete. 2023-10-14T18:47:02.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:47:02.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.361+0000 7f0f7af19700 1 Processor -- start 2023-10-14T18:47:02.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.361+0000 7f0f7af19700 1 -- start start 2023-10-14T18:47:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f7af19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f7406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f7af19700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740b26d0 con 0x7f0f740a7dc0 2023-10-14T18:47:02.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f7af19700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7415e900 con 0x7f0f740b15e0 2023-10-14T18:47:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f7af19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740aeab0 con 0x7f0f740a79f0 2023-10-14T18:47:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f794b6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0f740a7dc0 0x7f0f7415e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39746/0 (socket says 172.21.15.79:39746) 2023-10-14T18:47:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.362+0000 7f0f794b6700 1 -- 172.21.15.79:0/319885066 learned_addr learned my addr 172.21.15.79:0/319885066 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f78cb5700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f7406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364347822 0 0) 0x7f0f740b26d0 con 0x7f0f740a7dc0 2023-10-14T18:47:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c003570 con 0x7f0f740a7dc0 2023-10-14T18:47:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267868731 0 0) 0x7f0f7415e900 con 0x7f0f740b15e0 2023-10-14T18:47:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f740b26d0 con 0x7f0f740b15e0 2023-10-14T18:47:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223045368 0 0) 0x7f0f5c003570 con 0x7f0f740a7dc0 2023-10-14T18:47:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 msgr2=0x7f0f7406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f7406eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 >> v1:172.21.15.144:6789/0 conn(0x7f0f740b15e0 legacy=0x7f0f7415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740b2b60 con 0x7f0f740a7dc0 2023-10-14T18:47:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0f6c0017f0 con 0x7f0f740a7dc0 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 >> v1:172.21.15.79:6789/0 conn(0x7f0f740a7dc0 legacy=0x7f0f7415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c003c20 0x7f0f5c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c004d50 0x7f0f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740aeab0 con 0x7f0f5c004d50 2023-10-14T18:47:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00bb40 con 0x7f0f5c003c20 2023-10-14T18:47:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c00bd00 con 0x7f0f740a79f0 2023-10-14T18:47:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c004d50 0x7f0f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f78cb5700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c003c20 0x7f0f5c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f73fff700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 -- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 msgr2=0x7f0f5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f740a79f0 0x7f0f5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 -- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c003c20 msgr2=0x7f0f5c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c003c20 0x7f0f5c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.363+0000 7f0f794b6700 1 -- 172.21.15.79:0/319885066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c003570 con 0x7f0f5c004d50 2023-10-14T18:47:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f794b6700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c004d50 0x7f0f5c0051c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00a8d0 tx=0x7f0f6c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3120a4d6e7ca60d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0070d0 con 0x7f0f5c004d50 2023-10-14T18:47:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c007230 con 0x7f0f5c004d50 2023-10-14T18:47:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f737fe700 1 -- 172.21.15.79:0/319885066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0075f0 con 0x7f0f5c004d50 2023-10-14T18:47:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 -- 172.21.15.79:0/319885066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c004d50 msgr2=0x7f0f5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 --2- 172.21.15.79:0/319885066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f5c004d50 0x7f0f5c0051c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00a8d0 tx=0x7f0f6c002190 comp rx=0 tx=0).stop 2023-10-14T18:47:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f794b6700 1 -- 172.21.15.79:0/319885066 reap_dead start 2023-10-14T18:47:02.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 -- 172.21.15.79:0/319885066 shutdown_connections 2023-10-14T18:47:02.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 -- 172.21.15.79:0/319885066 >> 172.21.15.79:0/319885066 conn(0x7f0f740cd1e0 msgr2=0x7f0f740cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:02.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 -- 172.21.15.79:0/319885066 shutdown_connections 2023-10-14T18:47:02.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.364+0000 7f0f7af19700 1 -- 172.21.15.79:0/319885066 wait complete. 2023-10-14T18:47:02.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.365+0000 7f0f7af19700 1 Processor -- start 2023-10-14T18:47:02.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 -- start start 2023-10-14T18:47:02.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f74099c20 0x7f0f740c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f74099ff0 0x7f0f74159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740c24c0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415c220 con 0x7f0f74099c20 2023-10-14T18:47:02.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f7af19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740c2b00 con 0x7f0f74099ff0 2023-10-14T18:47:02.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f73fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f73fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55282/0 (socket says 172.21.15.79:55282) 2023-10-14T18:47:02.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.366+0000 7f0f73fff700 1 -- 172.21.15.79:0/1298592280 learned_addr learned my addr 172.21.15.79:0/1298592280 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:02.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f78cb5700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f74099c20 0x7f0f740c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 -- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f74099ff0 msgr2=0x7f0f74159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f74099ff0 0x7f0f74159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 -- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f74099c20 msgr2=0x7f0f740c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f74099c20 0x7f0f740c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 -- 172.21.15.79:0/1298592280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740c2de0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f73fff700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0f68007a80 tx=0x7f0f68007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800f9f0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800fb70 con 0x7f0f7416dfc0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7415a730 con 0x7f0f7416dfc0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680133f0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.367+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f74159870 con 0x7f0f7416dfc0 2023-10-14T18:47:02.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.368+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7404c3c0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.368+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f68013760 con 0x7f0f7416dfc0 2023-10-14T18:47:02.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.369+0000 7f0f70ff9700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 0x7f0f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.369+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0f68084a50 con 0x7f0f7416dfc0 2023-10-14T18:47:02.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.369+0000 7f0f78cb5700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 0x7f0f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.369+0000 7f0f78cb5700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 0x7f0f600693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0f7409a8e0 tx=0x7f0f64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.373+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f68051be0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.597+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f740b1ac0 con 0x7f0f7416dfc0 2023-10-14T18:47:02.598 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:47:02.598+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:47:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.602+0000 7f0f70ff9700 1 -- 172.21.15.79:0/1298592280 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f68055200 con 0x7f0f7416dfc0 2023-10-14T18:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 msgr2=0x7f0f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 0x7f0f600693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0f7409a8e0 tx=0x7f0f64008040 comp rx=0 tx=0).stop 2023-10-14T18:47:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 msgr2=0x7f0f7415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0f68007a80 tx=0x7f0f68007d30 comp rx=0 tx=0).stop 2023-10-14T18:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 shutdown_connections 2023-10-14T18:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f60066f30 0x7f0f600693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0f74099ff0 0x7f0f74159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f74099c20 0x7f0f740c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 --2- 172.21.15.79:0/1298592280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f7416dfc0 0x7f0f7415bce0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 >> 172.21.15.79:0/1298592280 conn(0x7f0f740cd1e0 msgr2=0x7f0f740acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:02.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 shutdown_connections 2023-10-14T18:47:02.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.604+0000 7f0f7af19700 1 -- 172.21.15.79:0/1298592280 wait complete. 2023-10-14T18:47:02.610 INFO:tasks.ceph.mds.c.smithi079.stderr: -9118> 2023-10-14T18:46:31.774+0000 7f594245e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:47:02.610 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:47:02.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:47:02.634 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:47:02.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.734+0000 7fcb1053f700 1 Processor -- start 2023-10-14T18:47:02.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.734+0000 7fcb1053f700 1 -- start start 2023-10-14T18:47:02.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.735+0000 7fcb1053f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb08159c30 0x7fcb080711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.735+0000 7fcb1053f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb0806ecc0 0x7fcb0806f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.735+0000 7fcb1053f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb08070d30 con 0x7fcb0806c380 2023-10-14T18:47:02.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.735+0000 7fcb1053f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb08070700 con 0x7fcb08159c30 2023-10-14T18:47:02.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.735+0000 7fcb1053f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0806f710 con 0x7fcb0806ecc0 2023-10-14T18:47:02.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb08159c30 0x7fcb080711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb08159c30 0x7fcb080711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55314/0 (socket says 172.21.15.79:55314) 2023-10-14T18:47:02.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0eadc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb0806c380 0x7fcb08067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39760/0 (socket says 172.21.15.79:39760) 2023-10-14T18:47:02.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 -- 172.21.15.79:0/4155145068 learned_addr learned my addr 172.21.15.79:0/4155145068 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:02.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0dada700 1 --2- 172.21.15.79:0/4155145068 >> v2:172.21.15.144:3300/0 conn(0x7fcb0806ecc0 0x7fcb0806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 -- 172.21.15.79:0/4155145068 >> v2:172.21.15.144:3300/0 conn(0x7fcb0806ecc0 msgr2=0x7fcb0806f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:02.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 --2- 172.21.15.79:0/4155145068 >> v2:172.21.15.144:3300/0 conn(0x7fcb0806ecc0 0x7fcb0806f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 -- 172.21.15.79:0/4155145068 >> v1:172.21.15.79:6789/0 conn(0x7fcb0806c380 legacy=0x7fcb08067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 -- 172.21.15.79:0/4155145068 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0806f9f0 con 0x7fcb08159c30 2023-10-14T18:47:02.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0e2db700 1 --2- 172.21.15.79:0/4155145068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb08159c30 0x7fcb080711c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcb08069180 tx=0x7fcb04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94060cefe29baa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0d2d9700 1 -- 172.21.15.79:0/4155145068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400e070 con 0x7fcb08159c30 2023-10-14T18:47:02.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0d2d9700 1 -- 172.21.15.79:0/4155145068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0400ba50 con 0x7fcb08159c30 2023-10-14T18:47:02.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.736+0000 7fcb0d2d9700 1 -- 172.21.15.79:0/4155145068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb040092e0 con 0x7fcb08159c30 2023-10-14T18:47:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.737+0000 7fcb1053f700 1 -- 172.21.15.79:0/4155145068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb08159c30 msgr2=0x7fcb080711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.737+0000 7fcb1053f700 1 --2- 172.21.15.79:0/4155145068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb08159c30 0x7fcb080711c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcb08069180 tx=0x7fcb04009840 comp rx=0 tx=0).stop 2023-10-14T18:47:02.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 -- 172.21.15.79:0/4155145068 shutdown_connections 2023-10-14T18:47:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 --2- 172.21.15.79:0/4155145068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb08159c30 0x7fcb080711c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 --2- 172.21.15.79:0/4155145068 >> v2:172.21.15.144:3300/0 conn(0x7fcb0806ecc0 0x7fcb0806f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 -- 172.21.15.79:0/4155145068 >> 172.21.15.79:0/4155145068 conn(0x7fcb080cb030 msgr2=0x7fcb0806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 -- 172.21.15.79:0/4155145068 shutdown_connections 2023-10-14T18:47:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.738+0000 7fcb1053f700 1 -- 172.21.15.79:0/4155145068 wait complete. 2023-10-14T18:47:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.739+0000 7fcb1053f700 1 Processor -- start 2023-10-14T18:47:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.739+0000 7fcb1053f700 1 -- start start 2023-10-14T18:47:02.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb0806ecc0 0x7fcb0815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 0x7fcb081522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080ad4f0 con 0x7fcb0806c380 2023-10-14T18:47:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080ad7d0 con 0x7fcb08159c30 2023-10-14T18:47:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb1053f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080adab0 con 0x7fcb0806ecc0 2023-10-14T18:47:02.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb0e2db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb0e2db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55328/0 (socket says 172.21.15.79:55328) 2023-10-14T18:47:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb0e2db700 1 -- 172.21.15.79:0/3401626981 learned_addr learned my addr 172.21.15.79:0/3401626981 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:02.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb0dada700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb0806ecc0 0x7fcb0815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.740+0000 7fcb0eadc700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 0x7fcb081522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 -- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb0806ecc0 msgr2=0x7fcb0815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb0806ecc0 0x7fcb0815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 -- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 msgr2=0x7fcb081522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 0x7fcb081522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:02.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 -- 172.21.15.79:0/3401626981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04009ae0 con 0x7fcb0806c380 2023-10-14T18:47:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0eadc700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 0x7fcb081522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb0e2db700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcb08072020 tx=0x7fcb04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04008a80 con 0x7fcb0806c380 2023-10-14T18:47:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04008c20 con 0x7fcb0806c380 2023-10-14T18:47:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb080add90 con 0x7fcb0806c380 2023-10-14T18:47:02.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0401c410 con 0x7fcb0806c380 2023-10-14T18:47:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.741+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080ae350 con 0x7fcb0806c380 2023-10-14T18:47:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.742+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0804c3c0 con 0x7fcb0806c380 2023-10-14T18:47:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.742+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb04003040 con 0x7fcb0806c380 2023-10-14T18:47:02.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.743+0000 7fcafe7fc700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 0x7fcaec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.743+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fcb04085c50 con 0x7fcb0806c380 2023-10-14T18:47:02.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.743+0000 7fcb0dada700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 0x7fcaec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.743+0000 7fcb0dada700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 0x7fcaec0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb080c3f60 tx=0x7fcaf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:02.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.747+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb04052e30 con 0x7fcb0806c380 2023-10-14T18:47:02.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:02.973+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb080709c0 con 0x7fcb0806c380 2023-10-14T18:47:03.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.631+0000 7fcafe7fc700 1 -- 172.21.15.79:0/3401626981 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb04009940 con 0x7fcb0806c380 2023-10-14T18:47:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 msgr2=0x7fcaec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 0x7fcaec0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb080c3f60 tx=0x7fcaf8008040 comp rx=0 tx=0).stop 2023-10-14T18:47:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 msgr2=0x7fcb0815bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcb08072020 tx=0x7fcb04018000 comp rx=0 tx=0).stop 2023-10-14T18:47:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 shutdown_connections 2023-10-14T18:47:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcaec066f30 0x7fcaec0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb08159c30 0x7fcb081522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0806c380 0x7fcb0815bba0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 --2- 172.21.15.79:0/3401626981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb0806ecc0 0x7fcb0815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 >> 172.21.15.79:0/3401626981 conn(0x7fcb080cb030 msgr2=0x7fcb080aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 shutdown_connections 2023-10-14T18:47:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.634+0000 7fcb1053f700 1 -- 172.21.15.79:0/3401626981 wait complete. 2023-10-14T18:47:03.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:47:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.806+0000 7f956033d700 1 Processor -- start 2023-10-14T18:47:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.806+0000 7f956033d700 1 -- start start 2023-10-14T18:47:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f956033d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9558070d20 0x7f955806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f956033d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95580c8640 con 0x7f95581431f0 2023-10-14T18:47:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f956033d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95580c8e80 con 0x7f9558070950 2023-10-14T18:47:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f956033d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955806f630 con 0x7f9558070d20 2023-10-14T18:47:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f955e8da700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95581431f0 0x7f9558143650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39768/0 (socket says 172.21.15.79:39768) 2023-10-14T18:47:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.807+0000 7f955e8da700 1 -- 172.21.15.79:0/3376908471 learned_addr learned my addr 172.21.15.79:0/3376908471 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453841219 0 0) 0x7f95580c8640 con 0x7f95581431f0 2023-10-14T18:47:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d8d8700 1 --2- 172.21.15.79:0/3376908471 >> v2:172.21.15.144:3300/0 conn(0x7f9558070d20 0x7f955806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9544003570 con 0x7f95581431f0 2023-10-14T18:47:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 169543609 0 0) 0x7f9544003570 con 0x7f95581431f0 2023-10-14T18:47:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 >> v2:172.21.15.144:3300/0 conn(0x7f9558070d20 msgr2=0x7f955806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 --2- 172.21.15.79:0/3376908471 >> v2:172.21.15.144:3300/0 conn(0x7f9558070d20 0x7f955806ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 >> v1:172.21.15.144:6789/0 conn(0x7f9558070950 legacy=0x7f9558067e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580c8870 con 0x7f95581431f0 2023-10-14T18:47:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f95500017f0 con 0x7f95581431f0 2023-10-14T18:47:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 >> v1:172.21.15.79:6789/0 conn(0x7f95581431f0 legacy=0x7f9558143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f9544003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9544004810 0x7f9544004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440051c0 0x7f954400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955806f630 con 0x7f9544003a60 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954400c0d0 con 0x7f95440051c0 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954400c290 con 0x7f9544004810 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f9544003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e8da700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440051c0 0x7f954400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955d8d8700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9544004810 0x7f9544004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 -- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9544004810 msgr2=0x7f9544004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9544004810 0x7f9544004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 -- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440051c0 msgr2=0x7f954400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440051c0 0x7f954400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e8da700 1 -- 172.21.15.79:0/3376908471 reap_dead start 2023-10-14T18:47:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.808+0000 7f955e0d9700 1 -- 172.21.15.79:0/3376908471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544003570 con 0x7f9544003a60 2023-10-14T18:47:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f955e0d9700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f9544003e70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f95540018e0 tx=0x7f9554007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a039a1a9d1b6bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554012420 con 0x7f9544003a60 2023-10-14T18:47:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540125a0 con 0x7f9544003a60 2023-10-14T18:47:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f955d0d7700 1 -- 172.21.15.79:0/3376908471 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554012960 con 0x7f9544003a60 2023-10-14T18:47:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 -- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 msgr2=0x7f9544003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f9544003e70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f95540018e0 tx=0x7f9554007d30 comp rx=0 tx=0).stop 2023-10-14T18:47:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 -- 172.21.15.79:0/3376908471 shutdown_connections 2023-10-14T18:47:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 --2- 172.21.15.79:0/3376908471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f9544003e70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 -- 172.21.15.79:0/3376908471 >> 172.21.15.79:0/3376908471 conn(0x7f95580ce570 msgr2=0x7f95580ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 -- 172.21.15.79:0/3376908471 shutdown_connections 2023-10-14T18:47:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.809+0000 7f956033d700 1 -- 172.21.15.79:0/3376908471 wait complete. 2023-10-14T18:47:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.810+0000 7f956033d700 1 Processor -- start 2023-10-14T18:47:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.810+0000 7f956033d700 1 -- start start 2023-10-14T18:47:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955815f7e0 0x7f95580b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95581596f0 0x7f95580b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955815f350 con 0x7f9544003a60 2023-10-14T18:47:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580b39a0 con 0x7f955815f7e0 2023-10-14T18:47:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f956033d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955815e740 con 0x7f95581596f0 2023-10-14T18:47:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f955e0d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f955e0d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55346/0 (socket says 172.21.15.79:55346) 2023-10-14T18:47:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.811+0000 7f955e0d9700 1 -- 172.21.15.79:0/1545028783 learned_addr learned my addr 172.21.15.79:0/1545028783 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 -- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95581596f0 msgr2=0x7f95580b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95581596f0 0x7f95580b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955d8d8700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955815f7e0 0x7f95580b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 -- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955815f7e0 msgr2=0x7f95580b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955815f7e0 0x7f95580b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 -- 172.21.15.79:0/1545028783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955815ea20 con 0x7f9544003a60 2023-10-14T18:47:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f955e0d9700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9554012ad0 tx=0x7f9554015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:03.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400cac0 con 0x7f9544003a60 2023-10-14T18:47:03.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400cc20 con 0x7f9544003a60 2023-10-14T18:47:03.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955815ed00 con 0x7f9544003a60 2023-10-14T18:47:03.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554006820 con 0x7f9544003a60 2023-10-14T18:47:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.812+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558159b90 con 0x7f9544003a60 2023-10-14T18:47:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.813+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9558159db0 con 0x7f9544003a60 2023-10-14T18:47:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.813+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9554019030 con 0x7f9544003a60 2023-10-14T18:47:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.813+0000 7f954e7fc700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.813+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f9554085ce0 con 0x7f9544003a60 2023-10-14T18:47:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.814+0000 7f955d8d8700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.814+0000 7f955d8d8700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 0x7f953c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95480093f0 tx=0x7f9548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.818+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9554052ec0 con 0x7f9544003a60 2023-10-14T18:47:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:03.998+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f955804c3c0 con 0x7f9544003a60 2023-10-14T18:47:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.636+0000 7f954e7fc700 1 -- 172.21.15.79:0/1545028783 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f955402c020 con 0x7f9544003a60 2023-10-14T18:47:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 msgr2=0x7f953c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 0x7f953c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95480093f0 tx=0x7f9548008040 comp rx=0 tx=0).stop 2023-10-14T18:47:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 msgr2=0x7f955815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9554012ad0 tx=0x7f9554015000 comp rx=0 tx=0).stop 2023-10-14T18:47:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 shutdown_connections 2023-10-14T18:47:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f953c066f30 0x7f953c0693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95581596f0 0x7f95580b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9544003a60 0x7f955815e0b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 --2- 172.21.15.79:0/1545028783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955815f7e0 0x7f95580b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 >> 172.21.15.79:0/1545028783 conn(0x7f95580ce570 msgr2=0x7f95580c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 shutdown_connections 2023-10-14T18:47:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.641+0000 7f956033d700 1 -- 172.21.15.79:0/1545028783 wait complete. 2023-10-14T18:47:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:47:04.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:47:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.777+0000 7fad99a59700 1 Processor -- start 2023-10-14T18:47:04.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.777+0000 7fad99a59700 1 -- start start 2023-10-14T18:47:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad99a59700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad940b6a10 0x7fad9415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad99a59700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad940b46f0 0x7fad940b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad99a59700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940b17b0 con 0x7fad94159ef0 2023-10-14T18:47:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad99a59700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940b5020 con 0x7fad940b46f0 2023-10-14T18:47:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad99a59700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940b1a60 con 0x7fad940b6a10 2023-10-14T18:47:04.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad92ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fad94159ef0 0x7fad940b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39772/0 (socket says 172.21.15.79:39772) 2023-10-14T18:47:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad92ffd700 1 -- 172.21.15.79:0/534480217 learned_addr learned my addr 172.21.15.79:0/534480217 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 --2- 172.21.15.79:0/534480217 >> v2:172.21.15.79:3300/0 conn(0x7fad940b46f0 0x7fad940b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad927fc700 1 -- 172.21.15.79:0/534480217 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97206379 0 0) 0x7fad940b17b0 con 0x7fad94159ef0 2023-10-14T18:47:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad927fc700 1 -- 172.21.15.79:0/534480217 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad80003570 con 0x7fad94159ef0 2023-10-14T18:47:04.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 -- 172.21.15.79:0/534480217 >> v2:172.21.15.144:3300/0 conn(0x7fad940b6a10 msgr2=0x7fad9415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad8a7fc700 1 --2- 172.21.15.79:0/534480217 >> v2:172.21.15.144:3300/0 conn(0x7fad940b6a10 0x7fad9415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 --2- 172.21.15.79:0/534480217 >> v2:172.21.15.144:3300/0 conn(0x7fad940b6a10 0x7fad9415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 -- 172.21.15.79:0/534480217 >> v1:172.21.15.79:6789/0 conn(0x7fad94159ef0 legacy=0x7fad940b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 -- 172.21.15.79:0/534480217 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940b1d40 con 0x7fad940b46f0 2023-10-14T18:47:04.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.778+0000 7fad937fe700 1 --2- 172.21.15.79:0/534480217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad940b46f0 0x7fad940b4ae0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad94089550 tx=0x7fad8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6138d3382ebe986 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad927fc700 1 -- 172.21.15.79:0/534480217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00e070 con 0x7fad940b46f0 2023-10-14T18:47:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad927fc700 1 -- 172.21.15.79:0/534480217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00bb60 con 0x7fad940b46f0 2023-10-14T18:47:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad927fc700 1 -- 172.21.15.79:0/534480217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c012430 con 0x7fad940b46f0 2023-10-14T18:47:04.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 -- 172.21.15.79:0/534480217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad940b46f0 msgr2=0x7fad940b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 --2- 172.21.15.79:0/534480217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad940b46f0 0x7fad940b4ae0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad94089550 tx=0x7fad8c009780 comp rx=0 tx=0).stop 2023-10-14T18:47:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 -- 172.21.15.79:0/534480217 shutdown_connections 2023-10-14T18:47:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 --2- 172.21.15.79:0/534480217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad940b46f0 0x7fad940b4ae0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 --2- 172.21.15.79:0/534480217 >> v2:172.21.15.144:3300/0 conn(0x7fad940b6a10 0x7fad9415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 -- 172.21.15.79:0/534480217 >> 172.21.15.79:0/534480217 conn(0x7fad9409a0a0 msgr2=0x7fad94067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 -- 172.21.15.79:0/534480217 shutdown_connections 2023-10-14T18:47:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.779+0000 7fad99a59700 1 -- 172.21.15.79:0/534480217 wait complete. 2023-10-14T18:47:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.780+0000 7fad99a59700 1 Processor -- start 2023-10-14T18:47:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.780+0000 7fad99a59700 1 -- start start 2023-10-14T18:47:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad940b46f0 0x7fad9416dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad940b6a10 0x7fad9406a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94154f10 con 0x7fad94159ef0 2023-10-14T18:47:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94155d70 con 0x7fad940b6a10 2023-10-14T18:47:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad99a59700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9416e0f0 con 0x7fad940b46f0 2023-10-14T18:47:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55362/0 (socket says 172.21.15.79:55362) 2023-10-14T18:47:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.781+0000 7fad937fe700 1 -- 172.21.15.79:0/133027236 learned_addr learned my addr 172.21.15.79:0/133027236 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad8a7fc700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad940b6a10 0x7fad9406a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 -- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad940b46f0 msgr2=0x7fad9416dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad940b46f0 0x7fad9416dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 -- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad940b6a10 msgr2=0x7fad9406a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad940b6a10 0x7fad9406a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 -- 172.21.15.79:0/133027236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c009a20 con 0x7fad94159ef0 2023-10-14T18:47:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad937fe700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fad94071f80 tx=0x7fad8c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c012e00 con 0x7fad94159ef0 2023-10-14T18:47:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c01e630 con 0x7fad94159ef0 2023-10-14T18:47:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad94155160 con 0x7fad94159ef0 2023-10-14T18:47:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c01e9f0 con 0x7fad94159ef0 2023-10-14T18:47:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.782+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad94155720 con 0x7fad94159ef0 2023-10-14T18:47:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.783+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9404c3c0 con 0x7fad94159ef0 2023-10-14T18:47:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.783+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad8c024070 con 0x7fad94159ef0 2023-10-14T18:47:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.783+0000 7fad8b7fe700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 0x7fad740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.784+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fad8c086bb0 con 0x7fad94159ef0 2023-10-14T18:47:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.784+0000 7fad92ffd700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 0x7fad740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.784+0000 7fad92ffd700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 0x7fad740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad84001360 tx=0x7fad840078a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.788+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad8c053f40 con 0x7fad94159ef0 2023-10-14T18:47:04.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:04.973+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad94155eb0 con 0x7fad94159ef0 2023-10-14T18:47:05.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.641+0000 7fad8b7fe700 1 -- 172.21.15.79:0/133027236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fad8c057560 con 0x7fad94159ef0 2023-10-14T18:47:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 msgr2=0x7fad740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 0x7fad740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad84001360 tx=0x7fad840078a0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 msgr2=0x7fad94150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fad94071f80 tx=0x7fad8c019000 comp rx=0 tx=0).stop 2023-10-14T18:47:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 shutdown_connections 2023-10-14T18:47:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fad74066f30 0x7fad740693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad94159ef0 0x7fad94150f40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad940b46f0 0x7fad9416dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 --2- 172.21.15.79:0/133027236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad940b6a10 0x7fad9406a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.644+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 >> 172.21.15.79:0/133027236 conn(0x7fad9409a0a0 msgr2=0x7fad940b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.645+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 shutdown_connections 2023-10-14T18:47:05.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.645+0000 7fad99a59700 1 -- 172.21.15.79:0/133027236 wait complete. 2023-10-14T18:47:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:47:05.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:47:05.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.777+0000 7f6d7898b700 1 Processor -- start 2023-10-14T18:47:05.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.777+0000 7f6d7898b700 1 -- start start 2023-10-14T18:47:05.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7898b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d7415a290 0x7f6d7406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7898b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d7406aae0 0x7f6d740cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7898b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740b0790 con 0x7f6d74159ec0 2023-10-14T18:47:05.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7898b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7406af20 con 0x7f6d7406aae0 2023-10-14T18:47:05.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7898b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740ce1f0 con 0x7f6d7415a290 2023-10-14T18:47:05.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d72d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d7406aae0 0x7f6d740cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:05.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6d74159ec0 0x7f6d740af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39774/0 (socket says 172.21.15.79:39774) 2023-10-14T18:47:05.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d7259c700 1 -- 172.21.15.79:0/4062312448 learned_addr learned my addr 172.21.15.79:0/4062312448 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d72d9d700 1 -- 172.21.15.79:0/4062312448 >> v2:172.21.15.144:3300/0 conn(0x7f6d7415a290 msgr2=0x7f6d7406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d72d9d700 1 --2- 172.21.15.79:0/4062312448 >> v2:172.21.15.144:3300/0 conn(0x7f6d7415a290 0x7f6d7406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d72d9d700 1 -- 172.21.15.79:0/4062312448 >> v1:172.21.15.79:6789/0 conn(0x7f6d74159ec0 legacy=0x7f6d740af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.778+0000 7f6d71d9b700 1 -- 172.21.15.79:0/4062312448 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333458510 0 0) 0x7f6d740b0790 con 0x7f6d74159ec0 2023-10-14T18:47:05.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d72d9d700 1 -- 172.21.15.79:0/4062312448 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740b0b20 con 0x7f6d7406aae0 2023-10-14T18:47:05.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d72d9d700 1 --2- 172.21.15.79:0/4062312448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d740cf590 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6d74089910 tx=0x7f6d6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69690099b3aa6d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:05.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d71d9b700 1 -- 172.21.15.79:0/4062312448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00e070 con 0x7f6d7406aae0 2023-10-14T18:47:05.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d71d9b700 1 -- 172.21.15.79:0/4062312448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c00bc30 con 0x7f6d7406aae0 2023-10-14T18:47:05.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d71d9b700 1 -- 172.21.15.79:0/4062312448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c012430 con 0x7f6d7406aae0 2023-10-14T18:47:05.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 -- 172.21.15.79:0/4062312448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 msgr2=0x7f6d740cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 --2- 172.21.15.79:0/4062312448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d740cf590 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6d74089910 tx=0x7f6d6c009780 comp rx=0 tx=0).stop 2023-10-14T18:47:05.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 -- 172.21.15.79:0/4062312448 shutdown_connections 2023-10-14T18:47:05.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 --2- 172.21.15.79:0/4062312448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d740cf590 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 --2- 172.21.15.79:0/4062312448 >> v2:172.21.15.144:3300/0 conn(0x7f6d7415a290 0x7f6d7406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 -- 172.21.15.79:0/4062312448 >> 172.21.15.79:0/4062312448 conn(0x7f6d740d1880 msgr2=0x7f6d740cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:05.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 -- 172.21.15.79:0/4062312448 shutdown_connections 2023-10-14T18:47:05.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.779+0000 7f6d7898b700 1 -- 172.21.15.79:0/4062312448 wait complete. 2023-10-14T18:47:05.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 Processor -- start 2023-10-14T18:47:05.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 -- start start 2023-10-14T18:47:05.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74159ec0 0x7f6d7416a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d7415a290 0x7f6d740caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d741554b0 con 0x7f6d7406aae0 2023-10-14T18:47:05.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c7f00 con 0x7f6d74159ec0 2023-10-14T18:47:05.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7898b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c81e0 con 0x7f6d7415a290 2023-10-14T18:47:05.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:05.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55374/0 (socket says 172.21.15.79:55374) 2023-10-14T18:47:05.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.781+0000 7f6d7259c700 1 -- 172.21.15.79:0/3948571548 learned_addr learned my addr 172.21.15.79:0/3948571548 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:05.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d72d9d700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d7415a290 0x7f6d740caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:05.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 -- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d7415a290 msgr2=0x7f6d740caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d7415a290 0x7f6d740caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 -- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74159ec0 msgr2=0x7f6d7416a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d69d9b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74159ec0 0x7f6d7416a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:05.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74159ec0 0x7f6d7416a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 -- 172.21.15.79:0/3948571548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c009a20 con 0x7f6d7406aae0 2023-10-14T18:47:05.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7259c700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400c7e0 tx=0x7f6d64007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:05.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64005b30 con 0x7f6d7406aae0 2023-10-14T18:47:05.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d64005c90 con 0x7f6d7406aae0 2023-10-14T18:47:05.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740c84c0 con 0x7f6d7406aae0 2023-10-14T18:47:05.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64007300 con 0x7f6d7406aae0 2023-10-14T18:47:05.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.782+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740c8a80 con 0x7f6d7406aae0 2023-10-14T18:47:05.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.783+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7404c3c0 con 0x7f6d7406aae0 2023-10-14T18:47:05.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.783+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d6401b400 con 0x7f6d7406aae0 2023-10-14T18:47:05.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.784+0000 7f6d6affd700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 0x7f6d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:05.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.784+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6d64083ce0 con 0x7f6d7406aae0 2023-10-14T18:47:05.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.784+0000 7f6d69d9b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 0x7f6d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:05.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.784+0000 7f6d69d9b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 0x7f6d540693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006fd0 tx=0x7f6d5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:05.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.788+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d640512d0 con 0x7f6d7406aae0 2023-10-14T18:47:05.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.978+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d740b04b0 con 0x7f6d7406aae0 2023-10-14T18:47:05.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.982+0000 7f6d6affd700 1 -- 172.21.15.79:0/3948571548 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d640548f0 con 0x7f6d7406aae0 2023-10-14T18:47:05.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 msgr2=0x7f6d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 0x7f6d540693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006fd0 tx=0x7f6d5c008040 comp rx=0 tx=0).stop 2023-10-14T18:47:05.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 msgr2=0x7f6d74154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:05.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400c7e0 tx=0x7f6d64007df0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 shutdown_connections 2023-10-14T18:47:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d54066f30 0x7f6d540693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d7415a290 0x7f6d740caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d7406aae0 0x7f6d74154f70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 --2- 172.21.15.79:0/3948571548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d74159ec0 0x7f6d7416a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:05.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 >> 172.21.15.79:0/3948571548 conn(0x7f6d740d1880 msgr2=0x7f6d740c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:05.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 shutdown_connections 2023-10-14T18:47:05.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:05.984+0000 7f6d7898b700 1 -- 172.21.15.79:0/3948571548 wait complete. 2023-10-14T18:47:05.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-14T18:47:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.110+0000 7fe10431c700 1 Processor -- start 2023-10-14T18:47:06.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.111+0000 7fe10431c700 1 -- start start 2023-10-14T18:47:06.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe10431c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0fc15a620 0x7fe0fc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe10431c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc15cbb0 con 0x7fe0fc15d580 2023-10-14T18:47:06.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe10431c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc15bfa0 con 0x7fe0fc157870 2023-10-14T18:47:06.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe10431c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc15bdb0 con 0x7fe0fc15a620 2023-10-14T18:47:06.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1028b9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe0fc15d580 0x7fe0fc158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39784/0 (socket says 172.21.15.79:39784) 2023-10-14T18:47:06.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1028b9700 1 -- 172.21.15.79:0/2627668708 learned_addr learned my addr 172.21.15.79:0/2627668708 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1018b7700 1 --2- 172.21.15.79:0/2627668708 >> v2:172.21.15.144:3300/0 conn(0x7fe0fc15a620 0x7fe0fc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965372 0 0) 0x7fe0fc15cbb0 con 0x7fe0fc15d580 2023-10-14T18:47:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e8003570 con 0x7fe0fc15d580 2023-10-14T18:47:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233439801 0 0) 0x7fe0e8003570 con 0x7fe0fc15d580 2023-10-14T18:47:06.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 >> v2:172.21.15.144:3300/0 conn(0x7fe0fc15a620 msgr2=0x7fe0fc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 --2- 172.21.15.79:0/2627668708 >> v2:172.21.15.144:3300/0 conn(0x7fe0fc15a620 0x7fe0fc15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 >> v1:172.21.15.144:6789/0 conn(0x7fe0fc157870 legacy=0x7fe0fc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc15c280 con 0x7fe0fc15d580 2023-10-14T18:47:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe0f40017f0 con 0x7fe0fc15d580 2023-10-14T18:47:06.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 >> v1:172.21.15.79:6789/0 conn(0x7fe0fc15d580 legacy=0x7fe0fc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 0x7fe0e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8004810 0x7fe0e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e80051c0 0x7fe0e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e800c130 con 0x7fe0e8003a60 2023-10-14T18:47:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e800c2a0 con 0x7fe0e8004810 2023-10-14T18:47:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e800c460 con 0x7fe0e80051c0 2023-10-14T18:47:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.112+0000 7fe1020b8700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 0x7fe0e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1018b7700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8004810 0x7fe0e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1028b9700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e80051c0 0x7fe0e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 -- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e80051c0 msgr2=0x7fe0e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e80051c0 0x7fe0e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 -- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8004810 msgr2=0x7fe0e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8004810 0x7fe0e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 -- 172.21.15.79:0/2627668708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e8003570 con 0x7fe0e8003a60 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1028b9700 1 -- 172.21.15.79:0/2627668708 reap_dead start 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1020b8700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 0x7fe0e8003e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80018b0 tx=0x7fe0f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b944489efee92630 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8012420 con 0x7fe0e8003a60 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f80125a0 con 0x7fe0e8003a60 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe1010b6700 1 -- 172.21.15.79:0/2627668708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8012960 con 0x7fe0e8003a60 2023-10-14T18:47:06.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe10431c700 1 -- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 msgr2=0x7fe0e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.113+0000 7fe10431c700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 0x7fe0e8003e70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80018b0 tx=0x7fe0f8007d30 comp rx=0 tx=0).stop 2023-10-14T18:47:06.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.114+0000 7fe10431c700 1 -- 172.21.15.79:0/2627668708 shutdown_connections 2023-10-14T18:47:06.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.114+0000 7fe10431c700 1 --2- 172.21.15.79:0/2627668708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e8003a60 0x7fe0e8003e70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.114+0000 7fe10431c700 1 -- 172.21.15.79:0/2627668708 >> 172.21.15.79:0/2627668708 conn(0x7fe0fc068ce0 msgr2=0x7fe0fc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:06.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.114+0000 7fe10431c700 1 -- 172.21.15.79:0/2627668708 shutdown_connections 2023-10-14T18:47:06.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.114+0000 7fe10431c700 1 -- 172.21.15.79:0/2627668708 wait complete. 2023-10-14T18:47:06.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 Processor -- start 2023-10-14T18:47:06.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 -- start start 2023-10-14T18:47:06.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e8003a60 0x7fe0fc0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 0x7fe0fc158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc16e4c0 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b1080 con 0x7fe0fc157ef0 2023-10-14T18:47:06.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe10431c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b1360 con 0x7fe0e8003a60 2023-10-14T18:47:06.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.115+0000 7fe1018b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55390/0 (socket says 172.21.15.79:55390) 2023-10-14T18:47:06.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 -- 172.21.15.79:0/3015186018 learned_addr learned my addr 172.21.15.79:0/3015186018 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:06.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1020b8700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e8003a60 0x7fe0fc0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1028b9700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 0x7fe0fc158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 -- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e8003a60 msgr2=0x7fe0fc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e8003a60 0x7fe0fc0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 -- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 msgr2=0x7fe0fc158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 0x7fe0fc158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 -- 172.21.15.79:0/3015186018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0b1640 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1028b9700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 0x7fe0fc158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe1018b7700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec011b40 tx=0x7fe0ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00fa10 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00fb70 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0b1920 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec014440 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.116+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc153300 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.117+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc0b1b60 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.117+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0ec014870 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.118+0000 7fe0f27fc700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 0x7fe0e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.118+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe0ec018030 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.118+0000 7fe1020b8700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 0x7fe0e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.118+0000 7fe1020b8700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 0x7fe0e0069410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001010 tx=0x7fe0f8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.122+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0fc0b1b60 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.380+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fe0fc0b1b60 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.642+0000 7fe0f27fc700 1 -- 172.21.15.79:0/3015186018 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v129) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe0fc0b1b60 con 0x7fe0fc16dfd0 2023-10-14T18:47:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 msgr2=0x7fe0e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 0x7fe0e0069410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8001010 tx=0x7fe0f8015000 comp rx=0 tx=0).stop 2023-10-14T18:47:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 msgr2=0x7fe0fc152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec011b40 tx=0x7fe0ec0091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 shutdown_connections 2023-10-14T18:47:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0e0066f60 0x7fe0e0069410 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0fc157ef0 0x7fe0fc158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0e8003a60 0x7fe0fc0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.644+0000 7fe10431c700 1 --2- 172.21.15.79:0/3015186018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0fc16dfd0 0x7fe0fc152940 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.645+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 >> 172.21.15.79:0/3015186018 conn(0x7fe0fc068ce0 msgr2=0x7fe0fc0b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.645+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 shutdown_connections 2023-10-14T18:47:06.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.645+0000 7fe10431c700 1 -- 172.21.15.79:0/3015186018 wait complete. 2023-10-14T18:47:06.657 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-14T18:47:06.658 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-14T18:47:06.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-14T18:47:06.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.772+0000 7f7e4f650700 1 Processor -- start 2023-10-14T18:47:06.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.772+0000 7f7e4f650700 1 -- start start 2023-10-14T18:47:06.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4f650700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815a620 0x7f7e4815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4f650700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e4815d580 0x7f7e48158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4f650700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4815cbb0 con 0x7f7e48157870 2023-10-14T18:47:06.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4f650700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4815bdb0 con 0x7f7e4815d580 2023-10-14T18:47:06.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4f650700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815bfa0 con 0x7f7e4815a620 2023-10-14T18:47:06.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4dbed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e4815d580 0x7f7e48158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4d3ec700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e48157870 0x7f7e4815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39790/0 (socket says 172.21.15.79:39790) 2023-10-14T18:47:06.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4d3ec700 1 -- 172.21.15.79:0/4088362020 learned_addr learned my addr 172.21.15.79:0/4088362020 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:06.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.773+0000 7f7e4cbeb700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815a620 0x7f7e4815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4dbed700 1 -- 172.21.15.79:0/4088362020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815a620 msgr2=0x7f7e4815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:06.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4dbed700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815a620 0x7f7e4815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4dbed700 1 -- 172.21.15.79:0/4088362020 >> v1:172.21.15.79:6789/0 conn(0x7f7e48157870 legacy=0x7f7e4815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e3ffff700 1 -- 172.21.15.79:0/4088362020 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278549325 0 0) 0x7f7e4815cbb0 con 0x7f7e48157870 2023-10-14T18:47:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4dbed700 1 -- 172.21.15.79:0/4088362020 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4815c280 con 0x7f7e4815d580 2023-10-14T18:47:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4dbed700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815d580 0x7f7e48158110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7e400098e0 tx=0x7f7e400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceea458d3152a67d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e3ffff700 1 -- 172.21.15.79:0/4088362020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40009e80 con 0x7f7e4815d580 2023-10-14T18:47:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e3ffff700 1 -- 172.21.15.79:0/4088362020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000b860 con 0x7f7e4815d580 2023-10-14T18:47:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e3ffff700 1 -- 172.21.15.79:0/4088362020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000bbe0 con 0x7f7e4815d580 2023-10-14T18:47:06.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 -- 172.21.15.79:0/4088362020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815d580 msgr2=0x7f7e48158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815d580 0x7f7e48158110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7e400098e0 tx=0x7f7e400091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 -- 172.21.15.79:0/4088362020 shutdown_connections 2023-10-14T18:47:06.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815d580 0x7f7e48158110 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 --2- 172.21.15.79:0/4088362020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815a620 0x7f7e4815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.774+0000 7f7e4f650700 1 -- 172.21.15.79:0/4088362020 >> 172.21.15.79:0/4088362020 conn(0x7f7e48068ce0 msgr2=0x7f7e480690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:06.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.775+0000 7f7e4f650700 1 -- 172.21.15.79:0/4088362020 shutdown_connections 2023-10-14T18:47:06.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.775+0000 7f7e4f650700 1 -- 172.21.15.79:0/4088362020 wait complete. 2023-10-14T18:47:06.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 Processor -- start 2023-10-14T18:47:06.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 -- start start 2023-10-14T18:47:06.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 0x7f7e480d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815d580 0x7f7e481592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48159800 con 0x7f7e4815a620 2023-10-14T18:47:06.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d0bc0 con 0x7f7e48157870 2023-10-14T18:47:06.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.776+0000 7f7e4f650700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d0ea0 con 0x7f7e4815d580 2023-10-14T18:47:06.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55420/0 (socket says 172.21.15.79:55420) 2023-10-14T18:47:06.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 -- 172.21.15.79:0/2325294494 learned_addr learned my addr 172.21.15.79:0/2325294494 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:06.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4d3ec700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 0x7f7e480d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4dbed700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815d580 0x7f7e481592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 -- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815d580 msgr2=0x7f7e481592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815d580 0x7f7e481592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 -- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 msgr2=0x7f7e480d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 0x7f7e480d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 -- 172.21.15.79:0/2325294494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009420 con 0x7f7e4815a620 2023-10-14T18:47:06.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4d3ec700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 0x7f7e480d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4cbeb700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800d860 tx=0x7f7e38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380125f0 con 0x7f7e4815a620 2023-10-14T18:47:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38012750 con 0x7f7e4815a620 2023-10-14T18:47:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e480d1180 con 0x7f7e4815a620 2023-10-14T18:47:06.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38012af0 con 0x7f7e4815a620 2023-10-14T18:47:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.777+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e481507b0 con 0x7f7e4815a620 2023-10-14T18:47:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.778+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e481509d0 con 0x7f7e4815a620 2023-10-14T18:47:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.779+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e3801e460 con 0x7f7e4815a620 2023-10-14T18:47:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.779+0000 7f7e3d7fa700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.779+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7e38084870 con 0x7f7e4815a620 2023-10-14T18:47:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.779+0000 7f7e4d3ec700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.780+0000 7f7e4d3ec700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001560 tx=0x7f7e44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:06.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:06.783+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e38055870 con 0x7f7e4815a620 2023-10-14T18:47:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.039+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f7e4804c3c0 con 0x7f7e4815a620 2023-10-14T18:47:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.645+0000 7f7e3d7fa700 1 -- 172.21.15.79:0/2325294494 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v130) v1 ==== 137+0+0 (secure 0 0 0) 0x7f7e38055400 con 0x7f7e4815a620 2023-10-14T18:47:07.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 msgr2=0x7f7e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7e44001560 tx=0x7f7e44009040 comp rx=0 tx=0).stop 2023-10-14T18:47:07.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 msgr2=0x7f7e4814bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800d860 tx=0x7f7e38008040 comp rx=0 tx=0).stop 2023-10-14T18:47:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 shutdown_connections 2023-10-14T18:47:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7e4815d580 0x7f7e481592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e48157870 0x7f7e480d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 --2- 172.21.15.79:0/2325294494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e4815a620 0x7f7e4814bd30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 >> 172.21.15.79:0/2325294494 conn(0x7f7e48068ce0 msgr2=0x7f7e480b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 shutdown_connections 2023-10-14T18:47:07.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.647+0000 7f7e4f650700 1 -- 172.21.15.79:0/2325294494 wait complete. 2023-10-14T18:47:07.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-14T18:47:07.789 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_objectstore":"memstore"} 2023-10-14T18:47:07.789 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-14T18:47:07.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:47:07.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.907+0000 7f6dd5ca7700 1 Processor -- start 2023-10-14T18:47:07.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.907+0000 7f6dd5ca7700 1 -- start start 2023-10-14T18:47:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dd5ca7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6dd015b990 0x7f6dd015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dd5ca7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00b14f0 con 0x7f6dd00b4860 2023-10-14T18:47:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dd5ca7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd00b17d0 con 0x7f6dd00b3570 2023-10-14T18:47:07.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dd5ca7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd00b1ab0 con 0x7f6dd015b990 2023-10-14T18:47:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dcf7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6dd00b4860 0x7f6dd0159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39794/0 (socket says 172.21.15.79:39794) 2023-10-14T18:47:07.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/2388571285 learned_addr learned my addr 172.21.15.79:0/2388571285 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dcffff700 1 --2- 172.21.15.79:0/2388571285 >> v2:172.21.15.144:3300/0 conn(0x7f6dd015b990 0x7f6dd015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008388513 0 0) 0x7f6dd00b14f0 con 0x7f6dd00b4860 2023-10-14T18:47:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.908+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db8003570 con 0x7f6dd00b4860 2023-10-14T18:47:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459797119 0 0) 0x7f6db8003570 con 0x7f6dd00b4860 2023-10-14T18:47:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 >> v2:172.21.15.144:3300/0 conn(0x7f6dd015b990 msgr2=0x7f6dd015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 --2- 172.21.15.79:0/2388571285 >> v2:172.21.15.144:3300/0 conn(0x7f6dd015b990 0x7f6dd015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 >> v1:172.21.15.144:6789/0 conn(0x7f6dd00b3570 legacy=0x7f6dd00cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00b1d90 con 0x7f6dd00b4860 2023-10-14T18:47:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f6dc0001970 con 0x7f6dd00b4860 2023-10-14T18:47:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 >> v1:172.21.15.79:6789/0 conn(0x7f6dd00b4860 legacy=0x7f6dd0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6db8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db8004810 0x7f6db8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db80051c0 0x7f6db800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b1ab0 con 0x7f6db8003a60 2023-10-14T18:47:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800c0d0 con 0x7f6db8004810 2023-10-14T18:47:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800c290 con 0x7f6db80051c0 2023-10-14T18:47:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6db8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dceffd700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db8004810 0x7f6db8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcffff700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db80051c0 0x7f6db800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db80051c0 msgr2=0x7f6db800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6db80051c0 0x7f6db800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db8004810 msgr2=0x7f6db8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db8004810 0x7f6db8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/2388571285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8003570 con 0x7f6db8003a60 2023-10-14T18:47:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcffff700 1 -- 172.21.15.79:0/2388571285 reap_dead start 2023-10-14T18:47:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dceffd700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6db8004810 0x7f6db8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6db8003e70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c670 tx=0x7f6dc0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcde12bcbbf6ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:07.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0005b70 con 0x7f6db8003a60 2023-10-14T18:47:07.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0005cf0 con 0x7f6db8003a60 2023-10-14T18:47:07.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.909+0000 7f6dce7fc700 1 -- 172.21.15.79:0/2388571285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0007360 con 0x7f6db8003a60 2023-10-14T18:47:07.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 msgr2=0x7f6db8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6db8003e70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c670 tx=0x7f6dc0007ca0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/2388571285 shutdown_connections 2023-10-14T18:47:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/2388571285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6db8003e70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/2388571285 >> 172.21.15.79:0/2388571285 conn(0x7f6dd009a0f0 msgr2=0x7f6dd0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/2388571285 shutdown_connections 2023-10-14T18:47:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.910+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/2388571285 wait complete. 2023-10-14T18:47:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.911+0000 7f6dd5ca7700 1 Processor -- start 2023-10-14T18:47:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.911+0000 7f6dd5ca7700 1 -- start start 2023-10-14T18:47:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dd00ac350 0x7f6dd00ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dd016a4a0 0x7f6dd016a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd009d5e0 con 0x7f6db8003a60 2023-10-14T18:47:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00acd00 con 0x7f6dd016a4a0 2023-10-14T18:47:07.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dd5ca7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00ad120 con 0x7f6dd00ac350 2023-10-14T18:47:07.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55438/0 (socket says 172.21.15.79:55438) 2023-10-14T18:47:07.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/212584309 learned_addr learned my addr 172.21.15.79:0/212584309 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:07.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dceffd700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dd00ac350 0x7f6dd00ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcffff700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dd016a4a0 0x7f6dd016a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dd00ac350 msgr2=0x7f6dd00ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dd00ac350 0x7f6dd00ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dd016a4a0 msgr2=0x7f6dd016a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:07.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dd016a4a0 0x7f6dd016a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:07.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.912+0000 7f6dcf7fe700 1 -- 172.21.15.79:0/212584309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd009c9d0 con 0x7f6db8003a60 2023-10-14T18:47:07.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6dcf7fe700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0007fd0 tx=0x7f6dc0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:07.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0007a30 con 0x7f6db8003a60 2023-10-14T18:47:07.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0001b40 con 0x7f6db8003a60 2023-10-14T18:47:07.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd009ccb0 con 0x7f6db8003a60 2023-10-14T18:47:07.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0003080 con 0x7f6db8003a60 2023-10-14T18:47:07.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.913+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd009d270 con 0x7f6db8003a60 2023-10-14T18:47:07.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.914+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd009d400 con 0x7f6db8003a60 2023-10-14T18:47:07.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.914+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dc00148e0 con 0x7f6db8003a60 2023-10-14T18:47:07.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.914+0000 7f6db77fe700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 0x7f6dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:07.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.914+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6dc0086590 con 0x7f6db8003a60 2023-10-14T18:47:07.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.915+0000 7f6dceffd700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 0x7f6dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:07.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.915+0000 7f6dceffd700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 0x7f6dbc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000c00 tx=0x7f6dc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:07.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:07.919+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dc0053b00 con 0x7f6db8003a60 2023-10-14T18:47:08.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.099+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6dd009d400 con 0x7f6db8003a60 2023-10-14T18:47:08.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.108+0000 7f6db77fe700 1 -- 172.21.15.79:0/212584309 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6dc0057120 con 0x7f6db8003a60 2023-10-14T18:47:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 msgr2=0x7f6dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 0x7f6dbc0693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000c00 tx=0x7f6dc4009040 comp rx=0 tx=0).stop 2023-10-14T18:47:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 msgr2=0x7f6dd016cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0007fd0 tx=0x7f6dc0015000 comp rx=0 tx=0).stop 2023-10-14T18:47:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 shutdown_connections 2023-10-14T18:47:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6dbc066f30 0x7f6dbc0693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6dd016a4a0 0x7f6dd016a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6db8003a60 0x7f6dd016cee0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 --2- 172.21.15.79:0/212584309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6dd00ac350 0x7f6dd00ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 >> 172.21.15.79:0/212584309 conn(0x7f6dd009a0f0 msgr2=0x7f6dd0069280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:08.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 shutdown_connections 2023-10-14T18:47:08.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.110+0000 7f6dd5ca7700 1 -- 172.21.15.79:0/212584309 wait complete. 2023-10-14T18:47:08.122 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:47:08.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:47:08.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:47:08.206 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:47:08.207 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:47:08.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.321+0000 7f51ccf7f700 1 Processor -- start 2023-10-14T18:47:08.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.321+0000 7f51ccf7f700 1 -- start start 2023-10-14T18:47:08.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51ccf7f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51c80abae0 0x7f51c80c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51ccf7f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c9cb0 con 0x7f51c80c8b10 2023-10-14T18:47:08.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51ccf7f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80c90a0 con 0x7f51c80abeb0 2023-10-14T18:47:08.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51ccf7f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c80c9380 con 0x7f51c80abae0 2023-10-14T18:47:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c6d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f51c80c8b10 0x7f51c80acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:39796/0 (socket says 172.21.15.79:39796) 2023-10-14T18:47:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c6d9d700 1 -- 172.21.15.79:0/1947164481 learned_addr learned my addr 172.21.15.79:0/1947164481 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:08.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c659c700 1 --2- 172.21.15.79:0/1947164481 >> v2:172.21.15.144:3300/0 conn(0x7f51c80abae0 0x7f51c80c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896809121 0 0) 0x7f51c80c9cb0 con 0x7f51c80c8b10 2023-10-14T18:47:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b0003570 con 0x7f51c80c8b10 2023-10-14T18:47:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473457694 0 0) 0x7f51b0003570 con 0x7f51c80c8b10 2023-10-14T18:47:08.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.322+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 >> v2:172.21.15.144:3300/0 conn(0x7f51c80abae0 msgr2=0x7f51c80c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 --2- 172.21.15.79:0/1947164481 >> v2:172.21.15.144:3300/0 conn(0x7f51c80abae0 0x7f51c80c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 >> v1:172.21.15.144:6789/0 conn(0x7f51c80abeb0 legacy=0x7f51c80c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80c9660 con 0x7f51c80c8b10 2023-10-14T18:47:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f51b8001470 con 0x7f51c80c8b10 2023-10-14T18:47:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 >> v1:172.21.15.79:6789/0 conn(0x7f51c80c8b10 legacy=0x7f51c80acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0003a60 0x7f51b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b0004810 0x7f51b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 0x7f51b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c9380 con 0x7f51b00051c0 2023-10-14T18:47:08.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b000c0d0 con 0x7f51b0003a60 2023-10-14T18:47:08.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b000c290 con 0x7f51b0004810 2023-10-14T18:47:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 0x7f51b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c659c700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0003a60 0x7f51b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c5d9b700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b0004810 0x7f51b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 -- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b0004810 msgr2=0x7f51b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:08.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b0004810 0x7f51b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 -- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0003a60 msgr2=0x7f51b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0003a60 0x7f51b0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 -- 172.21.15.79:0/1947164481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0003570 con 0x7f51b00051c0 2023-10-14T18:47:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 -- 172.21.15.79:0/1947164481 reap_dead start 2023-10-14T18:47:08.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c6d9d700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 0x7f51b000ba60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c3c0 tx=0x7f51b8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85714a958c2865e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b800cc90 con 0x7f51b00051c0 2023-10-14T18:47:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b800cdf0 con 0x7f51b00051c0 2023-10-14T18:47:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.323+0000 7f51c559a700 1 -- 172.21.15.79:0/1947164481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8005b50 con 0x7f51b00051c0 2023-10-14T18:47:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 -- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 msgr2=0x7f51b000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 0x7f51b000ba60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c3c0 tx=0x7f51b8001e50 comp rx=0 tx=0).stop 2023-10-14T18:47:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 -- 172.21.15.79:0/1947164481 shutdown_connections 2023-10-14T18:47:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/1947164481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51b00051c0 0x7f51b000ba60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 -- 172.21.15.79:0/1947164481 >> 172.21.15.79:0/1947164481 conn(0x7f51c8067660 msgr2=0x7f51c8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 -- 172.21.15.79:0/1947164481 shutdown_connections 2023-10-14T18:47:08.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.324+0000 7f51ccf7f700 1 -- 172.21.15.79:0/1947164481 wait complete. 2023-10-14T18:47:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.325+0000 7f51ccf7f700 1 Processor -- start 2023-10-14T18:47:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.325+0000 7f51ccf7f700 1 -- start start 2023-10-14T18:47:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b00051c0 0x7f51c8168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51c80c0850 0x7f51c80adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c0630 con 0x7f51c81659f0 2023-10-14T18:47:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8168d70 con 0x7f51c80c0850 2023-10-14T18:47:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8166fd0 con 0x7f51b00051c0 2023-10-14T18:47:08.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34696/0 (socket says 172.21.15.79:34696) 2023-10-14T18:47:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 -- 172.21.15.79:0/3077035615 learned_addr learned my addr 172.21.15.79:0/3077035615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c6d9d700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51c80c0850 0x7f51c80adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c659c700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b00051c0 0x7f51c8168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 -- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b00051c0 msgr2=0x7f51c8168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b00051c0 0x7f51c8168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 -- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51c80c0850 msgr2=0x7f51c80adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51c80c0850 0x7f51c80adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 -- 172.21.15.79:0/3077035615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8165e80 con 0x7f51c81659f0 2023-10-14T18:47:08.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51c5d9b700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007a80 tx=0x7f51bc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc002e30 con 0x7f51c81659f0 2023-10-14T18:47:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00f8d0 con 0x7f51c81659f0 2023-10-14T18:47:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00fc70 con 0x7f51c81659f0 2023-10-14T18:47:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8166160 con 0x7f51c81659f0 2023-10-14T18:47:08.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.326+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c8166720 con 0x7f51c81659f0 2023-10-14T18:47:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.327+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c804c3c0 con 0x7f51c81659f0 2023-10-14T18:47:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.328+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51bc01c400 con 0x7f51c81659f0 2023-10-14T18:47:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.328+0000 7f51b67fc700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.328+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f51bc084310 con 0x7f51c81659f0 2023-10-14T18:47:08.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.328+0000 7f51c659c700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.329+0000 7f51c659c700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51c00094a0 tx=0x7f51c000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.332+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51bc051880 con 0x7f51c81659f0 2023-10-14T18:47:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.556+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51c806aeb0 con 0x7f51c81659f0 2023-10-14T18:47:08.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.557+0000 7f51b67fc700 1 -- 172.21.15.79:0/3077035615 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f51bc054ea0 con 0x7f51c81659f0 2023-10-14T18:47:08.558 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:08.558 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/932870172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":932870172},{"type":"v1","addr":"172.21.15.144:6837","nonce":932870172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5176,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3117026482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3117026482},{"type":"v1","addr":"172.21.15.144:6836","nonce":3117026482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3901491749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3901491749},{"type":"v1","addr":"172.21.15.79:6834","nonce":3901491749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3173519451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3173519451},{"type":"v1","addr":"172.21.15.79:6835","nonce":3173519451}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-10-14T18:47:08.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 msgr2=0x7f51a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 0x7f51a80693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51c00094a0 tx=0x7f51c000b040 comp rx=0 tx=0).stop 2023-10-14T18:47:08.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 msgr2=0x7f51c8166a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f51bc007a80 tx=0x7f51bc007d30 comp rx=0 tx=0).stop 2023-10-14T18:47:08.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 shutdown_connections 2023-10-14T18:47:08.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f51a8066f30 0x7f51a80693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51c80c0850 0x7f51c80adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f51b00051c0 0x7f51c8168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 --2- 172.21.15.79:0/3077035615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51c81659f0 0x7f51c8166a90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 >> 172.21.15.79:0/3077035615 conn(0x7f51c8067660 msgr2=0x7f51c80c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:08.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 shutdown_connections 2023-10-14T18:47:08.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.559+0000 7f51ccf7f700 1 -- 172.21.15.79:0/3077035615 wait complete. 2023-10-14T18:47:08.562 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2023-10-14T18:47:08.572 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:47:08.572 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:47:08.573 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:47:08.573 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:47:08.573 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:47:08.574 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:47:08.574 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:47:08.574 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:47:08.575 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:47:08.575 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:47:08.575 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:47:08.576 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:47:08.576 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:47:08.577 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:47:08.577 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:47:08.577 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:47:08.580 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:47:08.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:47:08.582 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:47:08.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:47:08.586 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:47:08.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:47:08.588 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:47:08.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:47:08.624 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:47:08.625 DEBUG:teuthology.parallel:result is None 2023-10-14T18:47:08.626 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:47:08.626 DEBUG:teuthology.parallel:result is None 2023-10-14T18:47:08.629 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:47:08.630 DEBUG:teuthology.parallel:result is None 2023-10-14T18:47:08.631 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:47:08.631 DEBUG:teuthology.parallel:result is None 2023-10-14T18:47:08.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:47:08.697 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:47:08.697 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:47:08.712 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:47:08.713 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:47:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.752+0000 7f11c9a13700 1 Processor -- start 2023-10-14T18:47:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.752+0000 7f11c9a13700 1 -- start start 2023-10-14T18:47:08.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159be0 0x7f11c40cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c9a13700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c4159fb0 0x7f11c40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c9a13700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c415e9b0 con 0x7f11c40b3170 2023-10-14T18:47:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c9a13700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c415dda0 con 0x7f11c4159fb0 2023-10-14T18:47:08.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c9a13700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c415e080 con 0x7f11c4159be0 2023-10-14T18:47:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c4159fb0 0x7f11c40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11c4159fb0 0x7f11c40b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34742/0 (socket says 172.21.15.79:34742) 2023-10-14T18:47:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 -- 172.21.15.79:0/993112712 learned_addr learned my addr 172.21.15.79:0/993112712 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c8a11700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159be0 0x7f11c40cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 -- 172.21.15.79:0/993112712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159be0 msgr2=0x7f11c40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159be0 0x7f11c40cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 -- 172.21.15.79:0/993112712 >> v1:172.21.15.144:6789/0 conn(0x7f11c40b3170 legacy=0x7f11c40cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 -- 172.21.15.79:0/993112712 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c415e360 con 0x7f11c4159fb0 2023-10-14T18:47:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.753+0000 7f11c3fff700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c4159fb0 0x7f11c40b2c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f11b40099b0 tx=0x7f11b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a20d38459ba4e41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c37fe700 1 -- 172.21.15.79:0/993112712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4009ea0 con 0x7f11c4159fb0 2023-10-14T18:47:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c37fe700 1 -- 172.21.15.79:0/993112712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b400b860 con 0x7f11c4159fb0 2023-10-14T18:47:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c37fe700 1 -- 172.21.15.79:0/993112712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400bc00 con 0x7f11c4159fb0 2023-10-14T18:47:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 -- 172.21.15.79:0/993112712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c4159fb0 msgr2=0x7f11c40b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c4159fb0 0x7f11c40b2c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f11b40099b0 tx=0x7f11b4009250 comp rx=0 tx=0).stop 2023-10-14T18:47:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 -- 172.21.15.79:0/993112712 shutdown_connections 2023-10-14T18:47:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159be0 0x7f11c40cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 --2- 172.21.15.79:0/993112712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c4159fb0 0x7f11c40b2c30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 -- 172.21.15.79:0/993112712 >> 172.21.15.79:0/993112712 conn(0x7f11c4067660 msgr2=0x7f11c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 -- 172.21.15.79:0/993112712 shutdown_connections 2023-10-14T18:47:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.754+0000 7f11c9a13700 1 -- 172.21.15.79:0/993112712 wait complete. 2023-10-14T18:47:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.755+0000 7f11c9a13700 1 Processor -- start 2023-10-14T18:47:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.755+0000 7f11c9a13700 1 -- start start 2023-10-14T18:47:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11c4159be0 0x7f11c41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 0x7f11c415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c416f590 con 0x7f11c40b3170 2023-10-14T18:47:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c4157cb0 con 0x7f11c4159be0 2023-10-14T18:47:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9a13700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c416f380 con 0x7f11c4159fb0 2023-10-14T18:47:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34750/0 (socket says 172.21.15.79:34750) 2023-10-14T18:47:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 -- 172.21.15.79:0/464376382 learned_addr learned my addr 172.21.15.79:0/464376382 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c3fff700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11c4159be0 0x7f11c41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9212700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 0x7f11c415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 -- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 msgr2=0x7f11c415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 0x7f11c415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 -- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11c4159be0 msgr2=0x7f11c41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11c4159be0 0x7f11c41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c8a11700 1 -- 172.21.15.79:0/464376382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40094f0 con 0x7f11c40b3170 2023-10-14T18:47:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.756+0000 7f11c9212700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 0x7f11c415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c8a11700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009ef0 tx=0x7f11bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00cc20 con 0x7f11c40b3170 2023-10-14T18:47:08.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00f040 con 0x7f11c40b3170 2023-10-14T18:47:08.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c41570a0 con 0x7f11c40b3170 2023-10-14T18:47:08.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc014480 con 0x7f11c40b3170 2023-10-14T18:47:08.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.757+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c4157660 con 0x7f11c40b3170 2023-10-14T18:47:08.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.758+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c406b730 con 0x7f11c40b3170 2023-10-14T18:47:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.758+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11bc0147f0 con 0x7f11c40b3170 2023-10-14T18:47:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.758+0000 7f11c0ff9700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 0x7f11a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.759+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f11bc084c20 con 0x7f11c40b3170 2023-10-14T18:47:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.759+0000 7f11c3fff700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 0x7f11a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:08.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.759+0000 7f11c3fff700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 0x7f11a40693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11b40099b0 tx=0x7f11b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.763+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11bc052190 con 0x7f11c40b3170 2023-10-14T18:47:08.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:08.958+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f11c404bb80 con 0x7f11c40b3170 2023-10-14T18:47:09.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:09.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.132+0000 7f11c0ff9700 1 -- 172.21.15.79:0/464376382 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f11bc0557b0 con 0x7f11c40b3170 2023-10-14T18:47:10.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 msgr2=0x7f11a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 0x7f11a40693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11b40099b0 tx=0x7f11b4017000 comp rx=0 tx=0).stop 2023-10-14T18:47:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 msgr2=0x7f11c416ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009ef0 tx=0x7f11bc00b040 comp rx=0 tx=0).stop 2023-10-14T18:47:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 shutdown_connections 2023-10-14T18:47:10.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11a4066f30 0x7f11a40693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11c4159fb0 0x7f11c415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11c40b3170 0x7f11c416ee40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 --2- 172.21.15.79:0/464376382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11c4159be0 0x7f11c41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.134+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 >> 172.21.15.79:0/464376382 conn(0x7f11c4067660 msgr2=0x7f11c415c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.135+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 shutdown_connections 2023-10-14T18:47:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.135+0000 7f11c9a13700 1 -- 172.21.15.79:0/464376382 wait complete. 2023-10-14T18:47:10.138 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:47:10.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:47:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.261+0000 7f6373fff700 1 Processor -- start 2023-10-14T18:47:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.261+0000 7f6373fff700 1 -- start start 2023-10-14T18:47:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6373fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f637415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6373fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63740cb7c0 con 0x7f63740cdab0 2023-10-14T18:47:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6373fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637415e290 con 0x7f63740cd6e0 2023-10-14T18:47:10.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6373fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637415e850 con 0x7f637415cbd0 2023-10-14T18:47:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f63727fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f63740cdab0 0x7f637415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54892/0 (socket says 172.21.15.79:54892) 2023-10-14T18:47:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f63727fc700 1 -- 172.21.15.79:0/3977942028 learned_addr learned my addr 172.21.15.79:0/3977942028 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f63737fe700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f637415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441823422 0 0) 0x7f63740cb7c0 con 0x7f63740cdab0 2023-10-14T18:47:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6360003570 con 0x7f63740cdab0 2023-10-14T18:47:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2865939016 0 0) 0x7f6360003570 con 0x7f63740cdab0 2023-10-14T18:47:10.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 msgr2=0x7f637415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f637415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 >> v1:172.21.15.144:6789/0 conn(0x7f63740cd6e0 legacy=0x7f63740cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637415e570 con 0x7f63740cdab0 2023-10-14T18:47:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.262+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f635c001470 con 0x7f63740cdab0 2023-10-14T18:47:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 >> v1:172.21.15.79:6789/0 conn(0x7f63740cdab0 legacy=0x7f637415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6360003a90 0x7f6360003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6360004810 0x7f6360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f63600051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637415e850 con 0x7f6360003a90 2023-10-14T18:47:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636000bb60 con 0x7f6360004810 2023-10-14T18:47:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636000bd20 con 0x7f637415cbd0 2023-10-14T18:47:10.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6360003a90 0x7f6360003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f63727fc700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6360004810 0x7f6360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f63737fe700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f63600051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 -- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 msgr2=0x7f63600051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f637415cbd0 0x7f63600051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 -- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6360004810 msgr2=0x7f6360004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6360004810 0x7f6360004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 -- 172.21.15.79:0/3977942028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360003570 con 0x7f6360003a90 2023-10-14T18:47:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6372ffd700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6360003a90 0x7f6360003ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6364001fc0 tx=0x7f6364001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c10f1508c4b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364001950 con 0x7f6360003a90 2023-10-14T18:47:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636400c8b0 con 0x7f6360003a90 2023-10-14T18:47:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.263+0000 7f6371ffb700 1 -- 172.21.15.79:0/3977942028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400cc50 con 0x7f6360003a90 2023-10-14T18:47:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 -- 172.21.15.79:0/3977942028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6360003a90 msgr2=0x7f6360003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 --2- 172.21.15.79:0/3977942028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6360003a90 0x7f6360003ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6364001fc0 tx=0x7f6364001640 comp rx=0 tx=0).stop 2023-10-14T18:47:10.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f63737fe700 1 -- 172.21.15.79:0/3977942028 reap_dead start 2023-10-14T18:47:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 -- 172.21.15.79:0/3977942028 shutdown_connections 2023-10-14T18:47:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 -- 172.21.15.79:0/3977942028 >> 172.21.15.79:0/3977942028 conn(0x7f6374067660 msgr2=0x7f6374067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 -- 172.21.15.79:0/3977942028 shutdown_connections 2023-10-14T18:47:10.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.264+0000 7f6373fff700 1 -- 172.21.15.79:0/3977942028 wait complete. 2023-10-14T18:47:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.265+0000 7f6373fff700 1 Processor -- start 2023-10-14T18:47:10.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.265+0000 7f6373fff700 1 -- start start 2023-10-14T18:47:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6360003a90 0x7f6374169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63740b2950 0x7f637416db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740cc360 con 0x7f637416e0d0 2023-10-14T18:47:10.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740b68f0 con 0x7f63740b2950 2023-10-14T18:47:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6373fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637416e570 con 0x7f6360003a90 2023-10-14T18:47:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34782/0 (socket says 172.21.15.79:34782) 2023-10-14T18:47:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 -- 172.21.15.79:0/1016378072 learned_addr learned my addr 172.21.15.79:0/1016378072 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:10.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f6372ffd700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6360003a90 0x7f6374169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63727fc700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63740b2950 0x7f637416db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 -- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6360003a90 msgr2=0x7f6374169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6360003a90 0x7f6374169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 -- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63740b2950 msgr2=0x7f637416db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63740b2950 0x7f637416db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 -- 172.21.15.79:0/1016378072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740b24c0 con 0x7f637416e0d0 2023-10-14T18:47:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.266+0000 7f63737fe700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f63740c7cd0 tx=0x7f636c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.267+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c015670 con 0x7f637416e0d0 2023-10-14T18:47:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.267+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c0157d0 con 0x7f637416e0d0 2023-10-14T18:47:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.267+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63740b6610 con 0x7f637416e0d0 2023-10-14T18:47:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.267+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c015bd0 con 0x7f637416e0d0 2023-10-14T18:47:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.267+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63740b2150 con 0x7f637416e0d0 2023-10-14T18:47:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.268+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740b2650 con 0x7f637416e0d0 2023-10-14T18:47:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.268+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f636c020460 con 0x7f637416e0d0 2023-10-14T18:47:10.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.268+0000 7f636affd700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 0x7f63540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.268+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f636c084230 con 0x7f637416e0d0 2023-10-14T18:47:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.268+0000 7f6372ffd700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 0x7f63540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.269+0000 7f6372ffd700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 0x7f63540693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f63740b2e50 tx=0x7f6364015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.272+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f636c0517f0 con 0x7f637416e0d0 2023-10-14T18:47:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.531+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f63740c7fb0 con 0x7f637416e0d0 2023-10-14T18:47:10.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.531+0000 7f636affd700 1 -- 172.21.15.79:0/1016378072 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f636c054e10 con 0x7f637416e0d0 2023-10-14T18:47:10.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:10.533 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:47:10.534 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:47:10.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.534 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:47:10.535 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:47:10.535 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.535 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.535 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:47:10.536 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:47:10.536 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.537 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:47:10.538 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:47:10.538 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:47:10.539 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:47:10.539 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.540 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:47:10.541 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:47:10.541 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:47:10.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:47:10.543 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.544 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:47:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:47:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.546 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:47:10.546 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:47:10.547 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.549 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:47:10.549 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:47:10.549 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.550 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.552 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:47:10.552 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:47:10.553 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.554 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.555 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:47:10.556 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:47:10.556 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.556 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.557 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.557 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.559 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:47:10.559 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:47:10.560 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.560 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.560 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.561 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.562 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:47:10.563 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:47:10.563 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.563 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.564 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.564 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.566 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:47:10.566 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:47:10.566 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.567 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.567 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.567 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.569 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:47:10.569 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:47:10.569 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.570 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.570 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.571 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:47:10.571 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:47:10.571 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:47:10.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:47:10.572 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.572 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:47:10.573 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:47:10.573 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.573 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.573 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:47:10.574 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:47:10.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.574 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:47:10.575 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:47:10.575 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.575 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.575 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:47:10.575 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:47:10.576 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:47:10.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.577 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:47:10.577 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:47:10.577 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.578 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.578 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:47:10.578 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:47:10.578 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:47:10.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:47:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:47:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:47:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:47:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:47:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:47:10.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:47:10.581 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:47:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:47:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:47:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:47:10.582 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:47:10.583 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:47:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:47:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:47:10.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:10.585 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:47:10.585 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:47:10.585 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:47:10.585 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:47:10.586 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:47:10.586 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:47:10.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:10.586 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:47:10.587 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:47:10.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 msgr2=0x7f63540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 0x7f63540693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f63740b2e50 tx=0x7f6364015000 comp rx=0 tx=0).stop 2023-10-14T18:47:10.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 msgr2=0x7f63740b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f63740c7cd0 tx=0x7f636c008040 comp rx=0 tx=0).stop 2023-10-14T18:47:10.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 shutdown_connections 2023-10-14T18:47:10.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6354066f30 0x7f63540693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f637416e0d0 0x7f63740b3a10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6360003a90 0x7f6374169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 --2- 172.21.15.79:0/1016378072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63740b2950 0x7f637416db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 >> 172.21.15.79:0/1016378072 conn(0x7f6374067660 msgr2=0x7f637406af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:10.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 shutdown_connections 2023-10-14T18:47:10.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.533+0000 7f6373fff700 1 -- 172.21.15.79:0/1016378072 wait complete. 2023-10-14T18:47:10.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.707+0000 7f4943e43700 1 Processor -- start 2023-10-14T18:47:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.707+0000 7f4943e43700 1 -- start start 2023-10-14T18:47:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4943e43700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f493c157870 0x7f493c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4943e43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4943e43700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c15cbb0 con 0x7f493c15a620 2023-10-14T18:47:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4943e43700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c15bfa0 con 0x7f493c157870 2023-10-14T18:47:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4943e43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15c280 con 0x7f493c157c40 2023-10-14T18:47:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f4941bdf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f493c157870 0x7f493c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f49423e0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.708+0000 7f49413de700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f493c15a620 0x7f493c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:49642/0 (socket says 172.21.15.79:49642) 2023-10-14T18:47:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f49413de700 1 -- 172.21.15.79:0/603734662 learned_addr learned my addr 172.21.15.79:0/603734662 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4940bdd700 1 -- 172.21.15.79:0/603734662 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524928556 0 0) 0x7f493c15cbb0 con 0x7f493c15a620 2023-10-14T18:47:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4940bdd700 1 -- 172.21.15.79:0/603734662 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4928003570 con 0x7f493c15a620 2023-10-14T18:47:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4941bdf700 1 -- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 msgr2=0x7f493c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:10.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4941bdf700 1 --2- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4941bdf700 1 -- 172.21.15.79:0/603734662 >> v1:172.21.15.144:6789/0 conn(0x7f493c15a620 legacy=0x7f493c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4941bdf700 1 -- 172.21.15.79:0/603734662 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c15c560 con 0x7f493c157870 2023-10-14T18:47:10.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4941bdf700 1 --2- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c157870 0x7f493c15b6a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4938009e60 tx=0x7f4938009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31829bec25be52c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4940bdd700 1 -- 172.21.15.79:0/603734662 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800e070 con 0x7f493c157870 2023-10-14T18:47:10.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4940bdd700 1 -- 172.21.15.79:0/603734662 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800bab0 con 0x7f493c157870 2023-10-14T18:47:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.709+0000 7f4940bdd700 1 -- 172.21.15.79:0/603734662 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800be70 con 0x7f493c157870 2023-10-14T18:47:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 -- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c157870 msgr2=0x7f493c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 --2- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c157870 0x7f493c15b6a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4938009e60 tx=0x7f4938009780 comp rx=0 tx=0).stop 2023-10-14T18:47:10.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 -- 172.21.15.79:0/603734662 shutdown_connections 2023-10-14T18:47:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 --2- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 --2- 172.21.15.79:0/603734662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c157870 0x7f493c15b6a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 -- 172.21.15.79:0/603734662 >> 172.21.15.79:0/603734662 conn(0x7f493c068ce0 msgr2=0x7f493c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:10.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 -- 172.21.15.79:0/603734662 shutdown_connections 2023-10-14T18:47:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.710+0000 7f4943e43700 1 -- 172.21.15.79:0/603734662 wait complete. 2023-10-14T18:47:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.711+0000 7f4943e43700 1 Processor -- start 2023-10-14T18:47:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.711+0000 7f4943e43700 1 -- start start 2023-10-14T18:47:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c16d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a620 0x7f493c16dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c151cb0 con 0x7f493c157870 2023-10-14T18:47:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c151980 con 0x7f493c15a620 2023-10-14T18:47:10.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4943e43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0b2eb0 con 0x7f493c157c40 2023-10-14T18:47:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34798/0 (socket says 172.21.15.79:34798) 2023-10-14T18:47:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 -- 172.21.15.79:0/525631546 learned_addr learned my addr 172.21.15.79:0/525631546 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:10.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f49423e0700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a620 0x7f493c16dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f49413de700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c16d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 -- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 msgr2=0x7f493c16d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c16d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 -- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a620 msgr2=0x7f493c16dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a620 0x7f493c16dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.712+0000 7f4941bdf700 1 -- 172.21.15.79:0/525631546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009a20 con 0x7f493c157870 2023-10-14T18:47:10.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4941bdf700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f49380097c0 tx=0x7f4938019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938012ba0 con 0x7f493c157870 2023-10-14T18:47:10.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4938012d20 con 0x7f493c157870 2023-10-14T18:47:10.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c0b3190 con 0x7f493c157870 2023-10-14T18:47:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380276c0 con 0x7f493c157870 2023-10-14T18:47:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.713+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c13d4a0 con 0x7f493c157870 2023-10-14T18:47:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.714+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c04c3c0 con 0x7f493c157870 2023-10-14T18:47:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.714+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4938024070 con 0x7f493c157870 2023-10-14T18:47:10.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.714+0000 7f4931ffb700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.715+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4938086750 con 0x7f493c157870 2023-10-14T18:47:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.715+0000 7f49413de700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:10.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.715+0000 7f49413de700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 0x7f49200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f493c14d620 tx=0x7f492c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.719+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4938053c70 con 0x7f493c157870 2023-10-14T18:47:10.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.901+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f493c15c840 con 0x7f493c157870 2023-10-14T18:47:10.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.902+0000 7f4931ffb700 1 -- 172.21.15.79:0/525631546 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f4938057290 con 0x7f493c157870 2023-10-14T18:47:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:10.903 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":63,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:47:10.129716+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:10.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 msgr2=0x7f49200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 0x7f49200693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f493c14d620 tx=0x7f492c009040 comp rx=0 tx=0).stop 2023-10-14T18:47:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 msgr2=0x7f493c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f49380097c0 tx=0x7f4938019000 comp rx=0 tx=0).stop 2023-10-14T18:47:10.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 shutdown_connections 2023-10-14T18:47:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4920066f30 0x7f49200693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f493c15a620 0x7f493c16dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f493c157870 0x7f493c0b24f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 --2- 172.21.15.79:0/525631546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f493c157c40 0x7f493c16d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 >> 172.21.15.79:0/525631546 conn(0x7f493c068ce0 msgr2=0x7f493c159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 shutdown_connections 2023-10-14T18:47:10.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:10.904+0000 7f4943e43700 1 -- 172.21.15.79:0/525631546 wait complete. 2023-10-14T18:47:10.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:47:10.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:47:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.035+0000 7f728ffff700 1 Processor -- start 2023-10-14T18:47:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.035+0000 7f728ffff700 1 -- start start 2023-10-14T18:47:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f7290164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728ffff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900b4d70 con 0x7f72900cce30 2023-10-14T18:47:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728ffff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729015b3b0 con 0x7f72900b6580 2023-10-14T18:47:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72900cd8d0 con 0x7f729006aa00 2023-10-14T18:47:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f72900cce30 0x7f729015aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54896/0 (socket says 172.21.15.79:54896) 2023-10-14T18:47:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728effd700 1 -- 172.21.15.79:0/366843917 learned_addr learned my addr 172.21.15.79:0/366843917 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746284830 0 0) 0x7f72900b4d70 con 0x7f72900cce30 2023-10-14T18:47:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f727c003570 con 0x7f72900cce30 2023-10-14T18:47:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728f7fe700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f7290164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2944956788 0 0) 0x7f727c003570 con 0x7f72900cce30 2023-10-14T18:47:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 msgr2=0x7f7290164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f7290164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 >> v1:172.21.15.144:6789/0 conn(0x7f72900b6580 legacy=0x7f729006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.036+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900b4440 con 0x7f72900cce30 2023-10-14T18:47:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7280001470 con 0x7f72900cce30 2023-10-14T18:47:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 >> v1:172.21.15.79:6789/0 conn(0x7f72900cce30 legacy=0x7f729015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a90 0x7f727c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f727c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f727c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900cd8d0 con 0x7f727c004810 2023-10-14T18:47:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c00bb10 con 0x7f727c003a90 2023-10-14T18:47:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c00bcd0 con 0x7f729006aa00 2023-10-14T18:47:11.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f727c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728effd700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a90 0x7f727c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728f7fe700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f727c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 -- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 msgr2=0x7f727c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:11.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f727c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 -- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a90 msgr2=0x7f727c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:11.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f727c003a90 0x7f727c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 -- 172.21.15.79:0/366843917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c003570 con 0x7f727c004810 2023-10-14T18:47:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728f7fe700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729006aa00 0x7f727c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f72867fc700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f727c004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7278001960 tx=0x7f7278007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90bae59779afd5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800c5d0 con 0x7f727c004810 2023-10-14T18:47:11.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800c750 con 0x7f727c004810 2023-10-14T18:47:11.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.037+0000 7f728e7fc700 1 -- 172.21.15.79:0/366843917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800cb10 con 0x7f727c004810 2023-10-14T18:47:11.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 -- 172.21.15.79:0/366843917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 msgr2=0x7f727c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 --2- 172.21.15.79:0/366843917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f727c004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7278001960 tx=0x7f7278007d10 comp rx=0 tx=0).stop 2023-10-14T18:47:11.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728f7fe700 1 -- 172.21.15.79:0/366843917 reap_dead start 2023-10-14T18:47:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 -- 172.21.15.79:0/366843917 shutdown_connections 2023-10-14T18:47:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 -- 172.21.15.79:0/366843917 >> 172.21.15.79:0/366843917 conn(0x7f7290068cb0 msgr2=0x7f72900690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 -- 172.21.15.79:0/366843917 shutdown_connections 2023-10-14T18:47:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.038+0000 7f728ffff700 1 -- 172.21.15.79:0/366843917 wait complete. 2023-10-14T18:47:11.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.039+0000 7f728ffff700 1 Processor -- start 2023-10-14T18:47:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.039+0000 7f728ffff700 1 -- start start 2023-10-14T18:47:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729014ec00 0x7f72900d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900b13d0 0x7f72900b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900b2d40 con 0x7f727c004810 2023-10-14T18:47:11.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900b2130 con 0x7f72900b13d0 2023-10-14T18:47:11.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72900b2410 con 0x7f729014ec00 2023-10-14T18:47:11.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34812/0 (socket says 172.21.15.79:34812) 2023-10-14T18:47:11.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 -- 172.21.15.79:0/3267607942 learned_addr learned my addr 172.21.15.79:0/3267607942 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728f7fe700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900b13d0 0x7f72900b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f72867fc700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729014ec00 0x7f72900d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 -- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729014ec00 msgr2=0x7f72900d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729014ec00 0x7f72900d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 -- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900b13d0 msgr2=0x7f72900b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900b13d0 0x7f72900b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 -- 172.21.15.79:0/3267607942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900b26f0 con 0x7f727c004810 2023-10-14T18:47:11.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728effd700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7280007fd0 tx=0x7f72900ce820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280018030 con 0x7f727c004810 2023-10-14T18:47:11.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728000f850 con 0x7f727c004810 2023-10-14T18:47:11.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72900b29d0 con 0x7f727c004810 2023-10-14T18:47:11.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000fbf0 con 0x7f727c004810 2023-10-14T18:47:11.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.040+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72900b31d0 con 0x7f727c004810 2023-10-14T18:47:11.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.041+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72900b33f0 con 0x7f727c004810 2023-10-14T18:47:11.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.042+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f728001b070 con 0x7f727c004810 2023-10-14T18:47:11.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.042+0000 7f72877fe700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.042+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7280019070 con 0x7f727c004810 2023-10-14T18:47:11.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.042+0000 7f72867fc700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.043+0000 7f72867fc700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 0x7f72700693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72900b0e30 tx=0x7f7278015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.046+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72800517b0 con 0x7f727c004810 2023-10-14T18:47:11.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.231+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72900b3020 con 0x7f727c004810 2023-10-14T18:47:11.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.231+0000 7f72877fe700 1 -- 172.21.15.79:0/3267607942 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7280054dd0 con 0x7f727c004810 2023-10-14T18:47:11.233 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:47:11.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 msgr2=0x7f72700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 0x7f72700693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f72900b0e30 tx=0x7f7278015000 comp rx=0 tx=0).stop 2023-10-14T18:47:11.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 msgr2=0x7f72900d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7280007fd0 tx=0x7f72900ce820 comp rx=0 tx=0).stop 2023-10-14T18:47:11.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 shutdown_connections 2023-10-14T18:47:11.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7270066f30 0x7f72700693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900b13d0 0x7f72900b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f727c004810 0x7f72900d0070 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 --2- 172.21.15.79:0/3267607942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f729014ec00 0x7f72900d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 >> 172.21.15.79:0/3267607942 conn(0x7f7290068cb0 msgr2=0x7f729014f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 shutdown_connections 2023-10-14T18:47:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.233+0000 7f728ffff700 1 -- 172.21.15.79:0/3267607942 wait complete. 2023-10-14T18:47:11.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:47:11.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.359+0000 7fbbcb59e700 1 Processor -- start 2023-10-14T18:47:11.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.359+0000 7fbbcb59e700 1 -- start start 2023-10-14T18:47:11.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbcb59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbcb59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc0cdab0 0x7fbbcc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbcb59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc0cb7c0 con 0x7fbbcc15dda0 2023-10-14T18:47:11.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbcb59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc15e850 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbcb59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc0cd030 con 0x7fbbcc0cdab0 2023-10-14T18:47:11.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34818/0 (socket says 172.21.15.79:34818) 2023-10-14T18:47:11.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 -- 172.21.15.79:0/1326858408 learned_addr learned my addr 172.21.15.79:0/1326858408 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:11.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbc9d9b700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc0cdab0 0x7fbbcc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 -- 172.21.15.79:0/1326858408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc0cdab0 msgr2=0x7fbbcc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:11.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc0cdab0 0x7fbbcc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 -- 172.21.15.79:0/1326858408 >> v1:172.21.15.144:6789/0 conn(0x7fbbcc15dda0 legacy=0x7fbbcc15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 -- 172.21.15.79:0/1326858408 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc15e290 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbca59c700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0099b0 tx=0x7fbbbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6882734176b188e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.360+0000 7fbbc959a700 1 -- 172.21.15.79:0/1326858408 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00b860 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbc959a700 1 -- 172.21.15.79:0/1326858408 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc00b9c0 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbc959a700 1 -- 172.21.15.79:0/1326858408 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00bd60 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1326858408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 msgr2=0x7fbbcc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0099b0 tx=0x7fbbbc009250 comp rx=0 tx=0).stop 2023-10-14T18:47:11.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1326858408 shutdown_connections 2023-10-14T18:47:11.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc0cbc50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1326858408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc0cdab0 0x7fbbcc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1326858408 >> 172.21.15.79:0/1326858408 conn(0x7fbbcc067660 msgr2=0x7fbbcc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:11.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1326858408 shutdown_connections 2023-10-14T18:47:11.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.361+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1326858408 wait complete. 2023-10-14T18:47:11.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.362+0000 7fbbcb59e700 1 Processor -- start 2023-10-14T18:47:11.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.362+0000 7fbbcb59e700 1 -- start start 2023-10-14T18:47:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbcc0cdab0 0x7fbbcc158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc15dda0 0x7fbbcc0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc0b0090 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc15c390 con 0x7fbbcc0cdab0 2023-10-14T18:47:11.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcb59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc1562f0 con 0x7fbbcc15dda0 2023-10-14T18:47:11.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34830/0 (socket says 172.21.15.79:34830) 2023-10-14T18:47:11.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 -- 172.21.15.79:0/1181006542 learned_addr learned my addr 172.21.15.79:0/1181006542 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:11.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbc9d9b700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbcc0cdab0 0x7fbbcc158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbcad9d700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc15dda0 0x7fbbcc0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 -- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc15dda0 msgr2=0x7fbbcc0c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc15dda0 0x7fbbcc0c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 -- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbcc0cdab0 msgr2=0x7fbbcc158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbcc0cdab0 0x7fbbcc158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 -- 172.21.15.79:0/1181006542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc0094f0 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.363+0000 7fbbca59c700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0c7b10 tx=0x7fbbbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.364+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc024440 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.364+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc0245c0 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.364+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc15b780 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.364+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc024980 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.364+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc15bd40 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.365+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc089280 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.365+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbbc01a420 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.365+0000 7fbbba7fc700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.365+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbbbc085fa0 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.365+0000 7fbbc9d9b700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.366+0000 7fbbc9d9b700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc156a20 tx=0x7fbbc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.370+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbbc053560 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.555+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbbcc15e570 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.556+0000 7fbbba7fc700 1 -- 172.21.15.79:0/1181006542 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbbbc056b80 con 0x7fbbcc0cd6e0 2023-10-14T18:47:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:11.557 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:47:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:47:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:47:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:47:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:47:11.559 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:47:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 msgr2=0x7fbbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc156a20 tx=0x7fbbc0008040 comp rx=0 tx=0).stop 2023-10-14T18:47:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 msgr2=0x7fbbcc155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0c7b10 tx=0x7fbbbc017000 comp rx=0 tx=0).stop 2023-10-14T18:47:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 shutdown_connections 2023-10-14T18:47:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbcc15dda0 0x7fbbcc0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbcc0cd6e0 0x7fbbcc155db0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 --2- 172.21.15.79:0/1181006542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbcc0cdab0 0x7fbbcc158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 >> 172.21.15.79:0/1181006542 conn(0x7fbbcc067660 msgr2=0x7fbbcc0d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 shutdown_connections 2023-10-14T18:47:11.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.558+0000 7fbbcb59e700 1 -- 172.21.15.79:0/1181006542 wait complete. 2023-10-14T18:47:11.570 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:47:11.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:47:11.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.689+0000 7fd228505700 1 Processor -- start 2023-10-14T18:47:11.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.689+0000 7fd228505700 1 -- start start 2023-10-14T18:47:11.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd228505700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2200cc0a0 0x7fd220161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd228505700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200ac440 con 0x7fd220156a10 2023-10-14T18:47:11.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd228505700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2200abe80 con 0x7fd220156de0 2023-10-14T18:47:11.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd228505700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2200ac160 con 0x7fd2200cc0a0 2023-10-14T18:47:11.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd226aa2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd2200cc0a0 0x7fd220161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd2262a1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd220156a10 0x7fd2200ab6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54908/0 (socket says 172.21.15.79:54908) 2023-10-14T18:47:11.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.690+0000 7fd2262a1700 1 -- 172.21.15.79:0/832832012 learned_addr learned my addr 172.21.15.79:0/832832012 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:11.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd226aa2700 1 -- 172.21.15.79:0/832832012 >> v1:172.21.15.144:6789/0 conn(0x7fd220156de0 legacy=0x7fd2200cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:11.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd226aa2700 1 -- 172.21.15.79:0/832832012 >> v1:172.21.15.79:6789/0 conn(0x7fd220156a10 legacy=0x7fd2200ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd226aa2700 1 -- 172.21.15.79:0/832832012 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200c7050 con 0x7fd2200cc0a0 2023-10-14T18:47:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd22529f700 1 -- 172.21.15.79:0/832832012 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945613561 0 0) 0x7fd2200ac440 con 0x7fd220156a10 2023-10-14T18:47:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd226aa2700 1 --2- 172.21.15.79:0/832832012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd220161bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd2180098e0 tx=0x7fd2180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3657d362a6b8867 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd22529f700 1 -- 172.21.15.79:0/832832012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218009e80 con 0x7fd2200cc0a0 2023-10-14T18:47:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd22529f700 1 -- 172.21.15.79:0/832832012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21800b820 con 0x7fd2200cc0a0 2023-10-14T18:47:11.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd22529f700 1 -- 172.21.15.79:0/832832012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21800bba0 con 0x7fd2200cc0a0 2023-10-14T18:47:11.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd228505700 1 -- 172.21.15.79:0/832832012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 msgr2=0x7fd220161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.691+0000 7fd228505700 1 --2- 172.21.15.79:0/832832012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd220161bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd2180098e0 tx=0x7fd2180091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.692+0000 7fd228505700 1 -- 172.21.15.79:0/832832012 shutdown_connections 2023-10-14T18:47:11.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.692+0000 7fd228505700 1 --2- 172.21.15.79:0/832832012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd220161bb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.692+0000 7fd228505700 1 -- 172.21.15.79:0/832832012 >> 172.21.15.79:0/832832012 conn(0x7fd2200cd450 msgr2=0x7fd2200c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:11.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.692+0000 7fd228505700 1 -- 172.21.15.79:0/832832012 shutdown_connections 2023-10-14T18:47:11.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.692+0000 7fd228505700 1 -- 172.21.15.79:0/832832012 wait complete. 2023-10-14T18:47:11.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 Processor -- start 2023-10-14T18:47:11.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 -- start start 2023-10-14T18:47:11.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 0x7fd2200b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 0x7fd2200caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b1860 con 0x7fd2200cc0a0 2023-10-14T18:47:11.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b0fc0 con 0x7fd220156de0 2023-10-14T18:47:11.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd228505700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2200b12a0 con 0x7fd220156a10 2023-10-14T18:47:11.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.693+0000 7fd2262a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34852/0 (socket says 172.21.15.79:34852) 2023-10-14T18:47:11.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 -- 172.21.15.79:0/12868716 learned_addr learned my addr 172.21.15.79:0/12868716 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:11.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd226aa2700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 0x7fd2200caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 -- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 msgr2=0x7fd2200b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd225aa0700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 0x7fd2200b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 0x7fd2200b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 -- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 msgr2=0x7fd2200caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:11.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 0x7fd2200caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:11.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 -- 172.21.15.79:0/12868716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218009420 con 0x7fd2200cc0a0 2023-10-14T18:47:11.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd226aa2700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 0x7fd2200caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:47:11.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd225aa0700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 0x7fd2200b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:47:11.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2262a1700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00cc70 tx=0x7fd21c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00ce80 con 0x7fd2200cc0a0 2023-10-14T18:47:11.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00ab70 con 0x7fd2200cc0a0 2023-10-14T18:47:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2200b1580 con 0x7fd2200cc0a0 2023-10-14T18:47:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0070f0 con 0x7fd2200cc0a0 2023-10-14T18:47:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.694+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2200cb010 con 0x7fd2200cc0a0 2023-10-14T18:47:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.695+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2200c3d70 con 0x7fd2200cc0a0 2023-10-14T18:47:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.695+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd21c0074e0 con 0x7fd2200cc0a0 2023-10-14T18:47:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.696+0000 7fd2167fc700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.696+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd21c084680 con 0x7fd2200cc0a0 2023-10-14T18:47:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.696+0000 7fd225aa0700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.696+0000 7fd225aa0700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2200c6ea0 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.700+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd21c051cc0 con 0x7fd2200cc0a0 2023-10-14T18:47:11.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:11.883+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd22004c3c0 con 0x7fd2200cc0a0 2023-10-14T18:47:12.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.661+0000 7fd2167fc700 1 -- 172.21.15.79:0/12868716 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd21c0552e0 con 0x7fd2200cc0a0 2023-10-14T18:47:12.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.664+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 msgr2=0x7fd2040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.664+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 0x7fd2040693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd2200c6ea0 tx=0x7fd210009040 comp rx=0 tx=0).stop 2023-10-14T18:47:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.664+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 msgr2=0x7fd2200b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.664+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00cc70 tx=0x7fd21c001a30 comp rx=0 tx=0).stop 2023-10-14T18:47:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 shutdown_connections 2023-10-14T18:47:12.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd204066f30 0x7fd2040693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd220156de0 0x7fd2200caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200cc0a0 0x7fd2200b2180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 --2- 172.21.15.79:0/12868716 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd220156a10 0x7fd2200b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 >> 172.21.15.79:0/12868716 conn(0x7fd2200cd450 msgr2=0x7fd220155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:12.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 shutdown_connections 2023-10-14T18:47:12.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.665+0000 7fd228505700 1 -- 172.21.15.79:0/12868716 wait complete. 2023-10-14T18:47:12.668 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:47:12.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:47:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.802+0000 7f2e4cf39700 1 Processor -- start 2023-10-14T18:47:12.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.802+0000 7f2e4cf39700 1 -- start start 2023-10-14T18:47:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4cf39700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e48159ec0 0x7f2e480af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4cf39700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 0x7f2e480afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4cf39700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e480b0790 con 0x7f2e4815a290 2023-10-14T18:47:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4cf39700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480ce1f0 con 0x7f2e48159ec0 2023-10-14T18:47:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4cf39700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b0b20 con 0x7f2e4806acb0 2023-10-14T18:47:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e48159ec0 0x7f2e480af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e3dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2e4815a290 0x7f2e4806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54924/0 (socket says 172.21.15.79:54924) 2023-10-14T18:47:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2e48159ec0 0x7f2e480af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34854/0 (socket says 172.21.15.79:34854) 2023-10-14T18:47:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e3dd9b700 1 -- 172.21.15.79:0/1470546013 learned_addr learned my addr 172.21.15.79:0/1470546013 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e46d9d700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 0x7f2e480afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 -- 172.21.15.79:0/1470546013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 msgr2=0x7f2e480afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 0x7f2e480afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 -- 172.21.15.79:0/1470546013 >> v1:172.21.15.79:6789/0 conn(0x7f2e4815a290 legacy=0x7f2e4806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e4659c700 1 -- 172.21.15.79:0/1470546013 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480b04b0 con 0x7f2e48159ec0 2023-10-14T18:47:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e45d9b700 1 -- 172.21.15.79:0/1470546013 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514171298 0 0) 0x7f2e480b0790 con 0x7f2e4815a290 2023-10-14T18:47:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.803+0000 7f2e46d9d700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 0x7f2e480afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4659c700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e48159ec0 0x7f2e480af940 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2e380098e0 tx=0x7f2e380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eced0725c749281 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e45d9b700 1 -- 172.21.15.79:0/1470546013 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38009e80 con 0x7f2e48159ec0 2023-10-14T18:47:12.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e45d9b700 1 -- 172.21.15.79:0/1470546013 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3800b860 con 0x7f2e48159ec0 2023-10-14T18:47:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e45d9b700 1 -- 172.21.15.79:0/1470546013 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bbe0 con 0x7f2e48159ec0 2023-10-14T18:47:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 -- 172.21.15.79:0/1470546013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e48159ec0 msgr2=0x7f2e480af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e48159ec0 0x7f2e480af940 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2e380098e0 tx=0x7f2e380091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 -- 172.21.15.79:0/1470546013 shutdown_connections 2023-10-14T18:47:12.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4806acb0 0x7f2e480afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/1470546013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e48159ec0 0x7f2e480af940 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 -- 172.21.15.79:0/1470546013 >> 172.21.15.79:0/1470546013 conn(0x7f2e480d1880 msgr2=0x7f2e480cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 -- 172.21.15.79:0/1470546013 shutdown_connections 2023-10-14T18:47:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.804+0000 7f2e4cf39700 1 -- 172.21.15.79:0/1470546013 wait complete. 2023-10-14T18:47:12.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.805+0000 7f2e4cf39700 1 Processor -- start 2023-10-14T18:47:12.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 -- start start 2023-10-14T18:47:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 0x7f2e4816a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4815a290 0x7f2e48155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4816ad80 con 0x7f2e4806acb0 2023-10-14T18:47:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48157450 con 0x7f2e48159ec0 2023-10-14T18:47:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4cf39700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48155dd0 con 0x7f2e4815a290 2023-10-14T18:47:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34862/0 (socket says 172.21.15.79:34862) 2023-10-14T18:47:12.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.806+0000 7f2e4659c700 1 -- 172.21.15.79:0/905925837 learned_addr learned my addr 172.21.15.79:0/905925837 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e3dd9b700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 0x7f2e4816a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e46d9d700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4815a290 0x7f2e48155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 -- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4815a290 msgr2=0x7f2e48155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4815a290 0x7f2e48155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 -- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 msgr2=0x7f2e4816a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 0x7f2e4816a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 -- 172.21.15.79:0/905925837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38009420 con 0x7f2e4806acb0 2023-10-14T18:47:12.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e3dd9b700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 0x7f2e4816a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:47:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4659c700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2e48071eb0 tx=0x7f2e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bbe0 con 0x7f2e4806acb0 2023-10-14T18:47:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38011420 con 0x7f2e4806acb0 2023-10-14T18:47:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e48156840 con 0x7f2e4806acb0 2023-10-14T18:47:12.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380117a0 con 0x7f2e4806acb0 2023-10-14T18:47:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.807+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e48156e00 con 0x7f2e4806acb0 2023-10-14T18:47:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.808+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4804c3c0 con 0x7f2e4806acb0 2023-10-14T18:47:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.808+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e38011bd0 con 0x7f2e4806acb0 2023-10-14T18:47:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.809+0000 7f2e3effd700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 0x7f2e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:12.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.809+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2e380858e0 con 0x7f2e4806acb0 2023-10-14T18:47:12.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.809+0000 7f2e3dd9b700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 0x7f2e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:12.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.810+0000 7f2e3dd9b700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 0x7f2e280693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e4816b160 tx=0x7f2e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:12.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.813+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e38052e60 con 0x7f2e4806acb0 2023-10-14T18:47:12.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:12.994+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2e480ceab0 con 0x7f2e4806acb0 2023-10-14T18:47:13.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.665+0000 7f2e3effd700 1 -- 172.21.15.79:0/905925837 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2e38056480 con 0x7f2e4806acb0 2023-10-14T18:47:13.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 msgr2=0x7f2e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 0x7f2e280693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e4816b160 tx=0x7f2e30009040 comp rx=0 tx=0).stop 2023-10-14T18:47:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 msgr2=0x7f2e481578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2e48071eb0 tx=0x7f2e38017000 comp rx=0 tx=0).stop 2023-10-14T18:47:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 shutdown_connections 2023-10-14T18:47:13.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2e28066f30 0x7f2e280693e0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e4816b160 tx=0x7f2e30009040 comp rx=0 tx=0).stop 2023-10-14T18:47:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e4815a290 0x7f2e48155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e4806acb0 0x7f2e481578e0 secure :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2e48071eb0 tx=0x7f2e38017000 comp rx=0 tx=0).stop 2023-10-14T18:47:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 --2- 172.21.15.79:0/905925837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48159ec0 0x7f2e4816a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 >> 172.21.15.79:0/905925837 conn(0x7f2e480d1880 msgr2=0x7f2e480c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 shutdown_connections 2023-10-14T18:47:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.675+0000 7f2e4cf39700 1 -- 172.21.15.79:0/905925837 wait complete. 2023-10-14T18:47:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:47:13.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:47:13.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.809+0000 7f797e830700 1 Processor -- start 2023-10-14T18:47:13.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.809+0000 7f797e830700 1 -- start start 2023-10-14T18:47:13.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797e830700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 0x7f797806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797e830700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 0x7f79780cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797e830700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780b0790 con 0x7f7978159ec0 2023-10-14T18:47:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797e830700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797806af60 con 0x7f797806aae0 2023-10-14T18:47:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797e830700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780ce1f0 con 0x7f797815a290 2023-10-14T18:47:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f7977fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7978159ec0 0x7f79780af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54934/0 (socket says 172.21.15.79:54934) 2023-10-14T18:47:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f7977fff700 1 -- 172.21.15.79:0/688428239 learned_addr learned my addr 172.21.15.79:0/688428239 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:13.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797cdcd700 1 --2- 172.21.15.79:0/688428239 >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 0x7f79780cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f79777fe700 1 --2- 172.21.15.79:0/688428239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 0x7f797806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544476348 0 0) 0x7f79780b0790 con 0x7f7978159ec0 2023-10-14T18:47:13.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7960003570 con 0x7f7978159ec0 2023-10-14T18:47:13.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423808173 0 0) 0x7f7960003570 con 0x7f7978159ec0 2023-10-14T18:47:13.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f79777fe700 1 -- 172.21.15.79:0/688428239 >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 msgr2=0x7f79780cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:13.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f79777fe700 1 --2- 172.21.15.79:0/688428239 >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 0x7f79780cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f79777fe700 1 -- 172.21.15.79:0/688428239 >> v1:172.21.15.79:6789/0 conn(0x7f7978159ec0 legacy=0x7f79780af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f79777fe700 1 -- 172.21.15.79:0/688428239 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780b0b20 con 0x7f797815a290 2023-10-14T18:47:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.810+0000 7f797cdcd700 1 --2- 172.21.15.79:0/688428239 >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 0x7f79780cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f79777fe700 1 --2- 172.21.15.79:0/688428239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 0x7f797806a5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098e0 tx=0x7f796c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a22ab754bc51a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968001470 con 0x7f797815a290 2023-10-14T18:47:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c011420 con 0x7f797815a290 2023-10-14T18:47:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f7976ffd700 1 -- 172.21.15.79:0/688428239 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0117c0 con 0x7f797815a290 2023-10-14T18:47:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 -- 172.21.15.79:0/688428239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 msgr2=0x7f797806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 --2- 172.21.15.79:0/688428239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 0x7f797806a5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f796c0098e0 tx=0x7f796c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 -- 172.21.15.79:0/688428239 shutdown_connections 2023-10-14T18:47:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 --2- 172.21.15.79:0/688428239 >> v2:172.21.15.144:3300/0 conn(0x7f797806aae0 0x7f79780cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 --2- 172.21.15.79:0/688428239 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797815a290 0x7f797806a5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 -- 172.21.15.79:0/688428239 >> 172.21.15.79:0/688428239 conn(0x7f79780d1880 msgr2=0x7f79780cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 -- 172.21.15.79:0/688428239 shutdown_connections 2023-10-14T18:47:13.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.811+0000 7f797e830700 1 -- 172.21.15.79:0/688428239 wait complete. 2023-10-14T18:47:13.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.812+0000 7f797e830700 1 Processor -- start 2023-10-14T18:47:13.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.812+0000 7f797e830700 1 -- start start 2023-10-14T18:47:13.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797806aae0 0x7f79780c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7978159ec0 0x7f79780c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780cb340 con 0x7f797815a290 2023-10-14T18:47:13.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780ca730 con 0x7f7978159ec0 2023-10-14T18:47:13.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797e830700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780caa10 con 0x7f797806aae0 2023-10-14T18:47:13.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797cdcd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797cdcd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34864/0 (socket says 172.21.15.79:34864) 2023-10-14T18:47:13.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.813+0000 7f797cdcd700 1 -- 172.21.15.79:0/1250155507 learned_addr learned my addr 172.21.15.79:0/1250155507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:13.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f7977fff700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797806aae0 0x7f79780c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f79777fe700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7978159ec0 0x7f79780c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 -- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797806aae0 msgr2=0x7f79780c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797806aae0 0x7f79780c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 -- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7978159ec0 msgr2=0x7f79780c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:13.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7978159ec0 0x7f79780c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:13.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 -- 172.21.15.79:0/1250155507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009a20 con 0x7f797815a290 2023-10-14T18:47:13.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797cdcd700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7970009fc0 tx=0x7f797000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:13.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000cd30 con 0x7f797815a290 2023-10-14T18:47:13.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000f040 con 0x7f797815a290 2023-10-14T18:47:13.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c009420 con 0x7f797815a290 2023-10-14T18:47:13.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700146d0 con 0x7f797815a290 2023-10-14T18:47:13.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.814+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79780cafd0 con 0x7f797815a290 2023-10-14T18:47:13.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.815+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780cb4f0 con 0x7f797815a290 2023-10-14T18:47:13.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.815+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7970003020 con 0x7f797815a290 2023-10-14T18:47:13.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.816+0000 7f795ffff700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:13.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.816+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7970084f40 con 0x7f797815a290 2023-10-14T18:47:13.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.816+0000 7f7977fff700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:13.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.816+0000 7f7977fff700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f79680011e0 tx=0x7f7968001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:13.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:13.820+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79780cb4f0 con 0x7f797815a290 2023-10-14T18:47:14.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.042+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f79780cb4f0 con 0x7f797815a290 2023-10-14T18:47:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.689+0000 7f795ffff700 1 -- 172.21.15.79:0/1250155507 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f79780cb4f0 con 0x7f797815a290 2023-10-14T18:47:14.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.693+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 msgr2=0x7f79640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.693+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f79680011e0 tx=0x7f7968001490 comp rx=0 tx=0).stop 2023-10-14T18:47:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.693+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 msgr2=0x7f79780c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.693+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7970009fc0 tx=0x7f797000b040 comp rx=0 tx=0).stop 2023-10-14T18:47:14.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 shutdown_connections 2023-10-14T18:47:14.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a290 0x7f79780c83a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f797806aae0 0x7f79780c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 --2- 172.21.15.79:0/1250155507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7978159ec0 0x7f79780c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.695+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 >> 172.21.15.79:0/1250155507 conn(0x7f79780d1880 msgr2=0x7f79781557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:14.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.696+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 shutdown_connections 2023-10-14T18:47:14.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.696+0000 7f797e830700 1 -- 172.21.15.79:0/1250155507 wait complete. 2023-10-14T18:47:14.699 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 8 and data pool 9 2023-10-14T18:47:14.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.823+0000 7fa26eaea700 1 Processor -- start 2023-10-14T18:47:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.823+0000 7fa26eaea700 1 -- start start 2023-10-14T18:47:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26eaea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 0x7fa2680a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26eaea700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680aa9b0 con 0x7fa26806f8a0 2023-10-14T18:47:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26eaea700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680aac90 con 0x7fa26806a340 2023-10-14T18:47:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26eaea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26815a490 con 0x7fa26806f4d0 2023-10-14T18:47:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26d2e7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa26806f8a0 0x7fa268069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54948/0 (socket says 172.21.15.79:54948) 2023-10-14T18:47:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26d2e7700 1 -- 172.21.15.79:0/808641530 learned_addr learned my addr 172.21.15.79:0/808641530 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26dae8700 1 --2- 172.21.15.79:0/808641530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 0x7fa2680a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456734325 0 0) 0x7fa2680aa9b0 con 0x7fa26806f8a0 2023-10-14T18:47:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa254003570 con 0x7fa26806f8a0 2023-10-14T18:47:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042841652 0 0) 0x7fa2680aac90 con 0x7fa26806a340 2023-10-14T18:47:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.824+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2680aa9b0 con 0x7fa26806a340 2023-10-14T18:47:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26dae8700 1 -- 172.21.15.79:0/808641530 >> v1:172.21.15.144:6789/0 conn(0x7fa26806a340 legacy=0x7fa26806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26dae8700 1 -- 172.21.15.79:0/808641530 >> v1:172.21.15.79:6789/0 conn(0x7fa26806f8a0 legacy=0x7fa268069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26dae8700 1 -- 172.21.15.79:0/808641530 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680aaf70 con 0x7fa26806f4d0 2023-10-14T18:47:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26dae8700 1 --2- 172.21.15.79:0/808641530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 0x7fa2680a9d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa264009e90 tx=0x7fa264009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f1b54a45a496cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400e070 con 0x7fa26806f4d0 2023-10-14T18:47:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400bb80 con 0x7fa26806f4d0 2023-10-14T18:47:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26cae6700 1 -- 172.21.15.79:0/808641530 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264012430 con 0x7fa26806f4d0 2023-10-14T18:47:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26eaea700 1 -- 172.21.15.79:0/808641530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 msgr2=0x7fa2680a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26eaea700 1 --2- 172.21.15.79:0/808641530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 0x7fa2680a9d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa264009e90 tx=0x7fa264009780 comp rx=0 tx=0).stop 2023-10-14T18:47:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26eaea700 1 -- 172.21.15.79:0/808641530 shutdown_connections 2023-10-14T18:47:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26eaea700 1 --2- 172.21.15.79:0/808641530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806f4d0 0x7fa2680a9d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.825+0000 7fa26eaea700 1 -- 172.21.15.79:0/808641530 >> 172.21.15.79:0/808641530 conn(0x7fa2680cd050 msgr2=0x7fa2680cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.826+0000 7fa26eaea700 1 -- 172.21.15.79:0/808641530 shutdown_connections 2023-10-14T18:47:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.826+0000 7fa26eaea700 1 -- 172.21.15.79:0/808641530 wait complete. 2023-10-14T18:47:14.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 Processor -- start 2023-10-14T18:47:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 -- start start 2023-10-14T18:47:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806a340 0x7fa268158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26806f4d0 0x7fa26816bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:14.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268097aa0 con 0x7fa26806f8a0 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26816c210 con 0x7fa26806f4d0 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26eaea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa268097d40 con 0x7fa26806a340 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.827+0000 7fa26e2e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34878/0 (socket says 172.21.15.79:34878) 2023-10-14T18:47:14.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 -- 172.21.15.79:0/33257500 learned_addr learned my addr 172.21.15.79:0/33257500 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26d2e7700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26806f4d0 0x7fa26816bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26dae8700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806a340 0x7fa268158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 -- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806a340 msgr2=0x7fa268158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806a340 0x7fa268158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 -- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26806f4d0 msgr2=0x7fa26816bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26806f4d0 0x7fa26816bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 -- 172.21.15.79:0/33257500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009a20 con 0x7fa26806f8a0 2023-10-14T18:47:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26e2e9700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c4e0 tx=0x7fa260007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000ce90 con 0x7fa26806f8a0 2023-10-14T18:47:14.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260011590 con 0x7fa26806f8a0 2023-10-14T18:47:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa268098020 con 0x7fa26806f8a0 2023-10-14T18:47:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260011970 con 0x7fa26806f8a0 2023-10-14T18:47:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.828+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa268158930 con 0x7fa26806f8a0 2023-10-14T18:47:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.829+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26806c790 con 0x7fa26806f8a0 2023-10-14T18:47:14.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.830+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa260012420 con 0x7fa26806f8a0 2023-10-14T18:47:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.830+0000 7fa25dffb700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.830+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa260002030 con 0x7fa26806f8a0 2023-10-14T18:47:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.830+0000 7fa26dae8700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:14.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.830+0000 7fa26dae8700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2640099f0 tx=0x7fa264019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:14.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:14.834+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa260051190 con 0x7fa26806f8a0 2023-10-14T18:47:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.016+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2680ab250 con 0x7fa26806f8a0 2023-10-14T18:47:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.017+0000 7fa25dffb700 1 -- 172.21.15.79:0/33257500 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fa2600547b0 con 0x7fa26806f8a0 2023-10-14T18:47:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:15.018 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":66,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:47:14.043824+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 msgr2=0x7fa24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2640099f0 tx=0x7fa264019000 comp rx=0 tx=0).stop 2023-10-14T18:47:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 msgr2=0x7fa2680cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c4e0 tx=0x7fa260007d80 comp rx=0 tx=0).stop 2023-10-14T18:47:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 shutdown_connections 2023-10-14T18:47:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa26806f8a0 0x7fa2680cae70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa26806a340 0x7fa268158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.019+0000 7fa26eaea700 1 --2- 172.21.15.79:0/33257500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26806f4d0 0x7fa26816bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.020+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 >> 172.21.15.79:0/33257500 conn(0x7fa2680cd050 msgr2=0x7fa2681577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.020+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 shutdown_connections 2023-10-14T18:47:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.020+0000 7fa26eaea700 1 -- 172.21.15.79:0/33257500 wait complete. 2023-10-14T18:47:15.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.146+0000 7fe0bd5e2700 1 Processor -- start 2023-10-14T18:47:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.146+0000 7fe0bd5e2700 1 -- start start 2023-10-14T18:47:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bd5e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0b815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bd5e2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80cb7c0 con 0x7fe0b815dda0 2023-10-14T18:47:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bd5e2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b815e290 con 0x7fe0b80cd6e0 2023-10-14T18:47:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bd5e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815e850 con 0x7fe0b80cdab0 2023-10-14T18:47:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bcde1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe0b815dda0 0x7fe0b815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54960/0 (socket says 172.21.15.79:54960) 2023-10-14T18:47:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0bcde1700 1 -- 172.21.15.79:0/106719693 learned_addr learned my addr 172.21.15.79:0/106719693 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b77fe700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0b815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660118580 0 0) 0x7fe0b80cb7c0 con 0x7fe0b815dda0 2023-10-14T18:47:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a0003570 con 0x7fe0b815dda0 2023-10-14T18:47:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596941255 0 0) 0x7fe0a0003570 con 0x7fe0b815dda0 2023-10-14T18:47:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 msgr2=0x7fe0b815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:15.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0b815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 >> v1:172.21.15.144:6789/0 conn(0x7fe0b80cd6e0 legacy=0x7fe0b80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b815e570 con 0x7fe0b815dda0 2023-10-14T18:47:15.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe0b00017f0 con 0x7fe0b815dda0 2023-10-14T18:47:15.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 >> v1:172.21.15.79:6789/0 conn(0x7fe0b815dda0 legacy=0x7fe0b815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0a0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0a0003fd0 0x7fe0a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0a0004d50 0x7fe0a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815e850 con 0x7fe0a0004d50 2023-10-14T18:47:15.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0014350 con 0x7fe0a0003fd0 2023-10-14T18:47:15.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.147+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0014510 con 0x7fe0b80cdab0 2023-10-14T18:47:15.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0a0004d50 0x7fe0a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0b7fff700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0a0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0b77fe700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0a0003fd0 0x7fe0a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 -- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 msgr2=0x7fe0a0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:15.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0b80cdab0 0x7fe0a0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 -- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0a0003fd0 msgr2=0x7fe0a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:15.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0a0003fd0 0x7fe0a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 -- 172.21.15.79:0/106719693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0003570 con 0x7fe0a0004d50 2023-10-14T18:47:15.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0a0004d50 0x7fe0a00051c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000a950 tx=0x7fe0b00021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22901231b6f53d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00070d0 con 0x7fe0a0004d50 2023-10-14T18:47:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0007250 con 0x7fe0a0004d50 2023-10-14T18:47:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.148+0000 7fe0b6ffd700 1 -- 172.21.15.79:0/106719693 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0007610 con 0x7fe0a0004d50 2023-10-14T18:47:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/106719693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0a0004d50 msgr2=0x7fe0a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/106719693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0a0004d50 0x7fe0a00051c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000a950 tx=0x7fe0b00021f0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bcde1700 1 -- 172.21.15.79:0/106719693 reap_dead start 2023-10-14T18:47:15.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/106719693 shutdown_connections 2023-10-14T18:47:15.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/106719693 >> 172.21.15.79:0/106719693 conn(0x7fe0b8067660 msgr2=0x7fe0b8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:15.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/106719693 shutdown_connections 2023-10-14T18:47:15.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.149+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/106719693 wait complete. 2023-10-14T18:47:15.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.150+0000 7fe0bd5e2700 1 Processor -- start 2023-10-14T18:47:15.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.150+0000 7fe0bd5e2700 1 -- start start 2023-10-14T18:47:15.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0a0004d50 0x7fe0b8166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b80c9240 0x7fe0b80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80cc360 con 0x7fe0b8155030 2023-10-14T18:47:15.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b81559e0 con 0x7fe0b80c9240 2023-10-14T18:47:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80ca630 con 0x7fe0a0004d50 2023-10-14T18:47:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34886/0 (socket says 172.21.15.79:34886) 2023-10-14T18:47:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 -- 172.21.15.79:0/2701995516 learned_addr learned my addr 172.21.15.79:0/2701995516 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:15.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0b7fff700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0a0004d50 0x7fe0b8166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0b77fe700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b80c9240 0x7fe0b80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 -- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0a0004d50 msgr2=0x7fe0b8166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0a0004d50 0x7fe0b8166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 -- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b80c9240 msgr2=0x7fe0b80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b80c9240 0x7fe0b80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 -- 172.21.15.79:0/2701995516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b81677d0 con 0x7fe0b8155030 2023-10-14T18:47:15.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bcde1700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0012000 tx=0x7fe0b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0023070 con 0x7fe0b8155030 2023-10-14T18:47:15.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0004bb0 con 0x7fe0b8155030 2023-10-14T18:47:15.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b80c9d90 con 0x7fe0b8155030 2023-10-14T18:47:15.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b001e430 con 0x7fe0b8155030 2023-10-14T18:47:15.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.151+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b80ca350 con 0x7fe0b8155030 2023-10-14T18:47:15.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.152+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b8167960 con 0x7fe0b8155030 2023-10-14T18:47:15.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.153+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0b001e7a0 con 0x7fe0b8155030 2023-10-14T18:47:15.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.153+0000 7fe09ffff700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 0x7fe0a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.153+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0b00864f0 con 0x7fe0b8155030 2023-10-14T18:47:15.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.153+0000 7fe0b7fff700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 0x7fe0a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.154+0000 7fe0b7fff700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 0x7fe0a40693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0b814ce00 tx=0x7fe0ac007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.158+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0b0053760 con 0x7fe0b8155030 2023-10-14T18:47:15.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.341+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0b80ccf20 con 0x7fe0b8155030 2023-10-14T18:47:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.342+0000 7fe09ffff700 1 -- 172.21.15.79:0/2701995516 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fe0b0056d80 con 0x7fe0b8155030 2023-10-14T18:47:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:15.344 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":66,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:47:14.043824+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 msgr2=0x7fe0a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 0x7fe0a40693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0b814ce00 tx=0x7fe0ac007d10 comp rx=0 tx=0).stop 2023-10-14T18:47:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 msgr2=0x7fe0b81554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0012000 tx=0x7fe0b0016000 comp rx=0 tx=0).stop 2023-10-14T18:47:15.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 shutdown_connections 2023-10-14T18:47:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe0a4066f30 0x7fe0a40693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0b8155030 0x7fe0b81554a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0a0004d50 0x7fe0b8166fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 --2- 172.21.15.79:0/2701995516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0b80c9240 0x7fe0b80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 >> 172.21.15.79:0/2701995516 conn(0x7fe0b8067660 msgr2=0x7fe0b80cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:15.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 shutdown_connections 2023-10-14T18:47:15.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.344+0000 7fe0bd5e2700 1 -- 172.21.15.79:0/2701995516 wait complete. 2023-10-14T18:47:15.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:47:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.474+0000 7f1cf88e2700 1 Processor -- start 2023-10-14T18:47:15.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.474+0000 7f1cf88e2700 1 -- start start 2023-10-14T18:47:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf88e2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1cf4159ec0 0x7f1cf40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf88e2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40b0790 con 0x7f1cf415a290 2023-10-14T18:47:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf88e2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40ce1f0 con 0x7f1cf406acb0 2023-10-14T18:47:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf88e2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf40b0b20 con 0x7f1cf4159ec0 2023-10-14T18:47:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1cf4159ec0 0x7f1cf40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1cf4159ec0 0x7f1cf40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34902/0 (socket says 172.21.15.79:34902) 2023-10-14T18:47:15.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 -- 172.21.15.79:0/3190796977 learned_addr learned my addr 172.21.15.79:0/3190796977 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1ce9d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1cf415a290 0x7f1cf406a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54976/0 (socket says 172.21.15.79:54976) 2023-10-14T18:47:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 -- 172.21.15.79:0/3190796977 >> v1:172.21.15.144:6789/0 conn(0x7f1cf406acb0 legacy=0x7f1cf40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 -- 172.21.15.79:0/3190796977 >> v1:172.21.15.79:6789/0 conn(0x7f1cf415a290 legacy=0x7f1cf406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf1d9b700 1 -- 172.21.15.79:0/3190796977 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948318624 0 0) 0x7f1cf40b0790 con 0x7f1cf415a290 2023-10-14T18:47:15.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.475+0000 7f1cf259c700 1 -- 172.21.15.79:0/3190796977 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40b04b0 con 0x7f1cf4159ec0 2023-10-14T18:47:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf259c700 1 --2- 172.21.15.79:0/3190796977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40af940 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40099b0 tx=0x7f1ce4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9985b0f34a3429e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf1d9b700 1 -- 172.21.15.79:0/3190796977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400b860 con 0x7f1cf4159ec0 2023-10-14T18:47:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf1d9b700 1 -- 172.21.15.79:0/3190796977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400b9c0 con 0x7f1cf4159ec0 2023-10-14T18:47:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf1d9b700 1 -- 172.21.15.79:0/3190796977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400bd60 con 0x7f1cf4159ec0 2023-10-14T18:47:15.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 -- 172.21.15.79:0/3190796977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf4159ec0 msgr2=0x7f1cf40af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/3190796977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40af940 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40099b0 tx=0x7f1ce4009250 comp rx=0 tx=0).stop 2023-10-14T18:47:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 -- 172.21.15.79:0/3190796977 shutdown_connections 2023-10-14T18:47:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/3190796977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40af940 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 -- 172.21.15.79:0/3190796977 >> 172.21.15.79:0/3190796977 conn(0x7f1cf40d1880 msgr2=0x7f1cf40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:15.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 -- 172.21.15.79:0/3190796977 shutdown_connections 2023-10-14T18:47:15.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.476+0000 7f1cf88e2700 1 -- 172.21.15.79:0/3190796977 wait complete. 2023-10-14T18:47:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.477+0000 7f1cf88e2700 1 Processor -- start 2023-10-14T18:47:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 -- start start 2023-10-14T18:47:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1cf415a290 0x7f1cf416a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf416bdd0 con 0x7f1cf406acb0 2023-10-14T18:47:15.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf416b1b0 con 0x7f1cf4159ec0 2023-10-14T18:47:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf88e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf416b780 con 0x7f1cf415a290 2023-10-14T18:47:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34912/0 (socket says 172.21.15.79:34912) 2023-10-14T18:47:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.478+0000 7f1cf259c700 1 -- 172.21.15.79:0/2859140606 learned_addr learned my addr 172.21.15.79:0/2859140606 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:15.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1ce9d9b700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 -- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1cf415a290 msgr2=0x7f1cf416a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1cf415a290 0x7f1cf416a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 -- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf4159ec0 msgr2=0x7f1cf40ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:15.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 -- 172.21.15.79:0/2859140606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40094f0 con 0x7f1cf406acb0 2023-10-14T18:47:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf259c700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006f50 tx=0x7f1ce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4024430 con 0x7f1cf406acb0 2023-10-14T18:47:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4024590 con 0x7f1cf406acb0 2023-10-14T18:47:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4024950 con 0x7f1cf406acb0 2023-10-14T18:47:15.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf416ba60 con 0x7f1cf406acb0 2023-10-14T18:47:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.479+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf414ace0 con 0x7f1cf406acb0 2023-10-14T18:47:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.480+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf416b5e0 con 0x7f1cf406acb0 2023-10-14T18:47:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.480+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ce401a420 con 0x7f1cf406acb0 2023-10-14T18:47:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.480+0000 7f1ceaffd700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:15.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.481+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ce4086220 con 0x7f1cf406acb0 2023-10-14T18:47:15.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.481+0000 7f1ce9d9b700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:15.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.481+0000 7f1ce9d9b700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc007fd0 tx=0x7f1cdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:15.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.485+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cf416b5e0 con 0x7f1cf406acb0 2023-10-14T18:47:15.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:15.711+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1cf416b5e0 con 0x7f1cf406acb0 2023-10-14T18:47:16.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.700+0000 7f1ceaffd700 1 -- 172.21.15.79:0/2859140606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1cf416b5e0 con 0x7f1cf406acb0 2023-10-14T18:47:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 msgr2=0x7f1cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc007fd0 tx=0x7f1cdc009040 comp rx=0 tx=0).stop 2023-10-14T18:47:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 msgr2=0x7f1cf40c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006f50 tx=0x7f1ce4017000 comp rx=0 tx=0).stop 2023-10-14T18:47:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 shutdown_connections 2023-10-14T18:47:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1cf415a290 0x7f1cf416a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1cf406acb0 0x7f1cf40c9fb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 --2- 172.21.15.79:0/2859140606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1cf4159ec0 0x7f1cf40ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 >> 172.21.15.79:0/2859140606 conn(0x7f1cf40d1880 msgr2=0x7f1cf406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 shutdown_connections 2023-10-14T18:47:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.702+0000 7f1cf88e2700 1 -- 172.21.15.79:0/2859140606 wait complete. 2023-10-14T18:47:16.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:47:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.836+0000 7fd395d8a700 1 Processor -- start 2023-10-14T18:47:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.836+0000 7fd395d8a700 1 -- start start 2023-10-14T18:47:16.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395d8a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd390155450 0x7fd3900c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395d8a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395d8a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd390158440 con 0x7fd390155820 2023-10-14T18:47:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395d8a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3901580f0 con 0x7fd390155450 2023-10-14T18:47:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395d8a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015bed0 con 0x7fd3901588d0 2023-10-14T18:47:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395589700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd394d88700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd390155450 0x7fd3900c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd394d88700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd390155450 0x7fd3900c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:47670/0 (socket says 172.21.15.79:47670) 2023-10-14T18:47:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd394d88700 1 -- 172.21.15.79:0/1627579423 learned_addr learned my addr 172.21.15.79:0/1627579423 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.837+0000 7fd395589700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:53630/0 (socket says 172.21.15.79:53630) 2023-10-14T18:47:16.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd38f7fe700 1 -- 172.21.15.79:0/1627579423 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135001662 0 0) 0x7fd390158440 con 0x7fd390155820 2023-10-14T18:47:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd38f7fe700 1 -- 172.21.15.79:0/1627579423 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c003570 con 0x7fd390155820 2023-10-14T18:47:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd394d88700 1 -- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 msgr2=0x7fd3901592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd394d88700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd394d88700 1 -- 172.21.15.79:0/1627579423 >> v1:172.21.15.144:6789/0 conn(0x7fd390155820 legacy=0x7fd39015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd394d88700 1 -- 172.21.15.79:0/1627579423 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39015c1b0 con 0x7fd390155450 2023-10-14T18:47:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd395589700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd394d88700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd3900c97d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd380009990 tx=0x7fd380009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14d2ea0372b7c686 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd38f7fe700 1 -- 172.21.15.79:0/1627579423 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380005c10 con 0x7fd390155450 2023-10-14T18:47:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd38f7fe700 1 -- 172.21.15.79:0/1627579423 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380005d70 con 0x7fd390155450 2023-10-14T18:47:16.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.838+0000 7fd38f7fe700 1 -- 172.21.15.79:0/1627579423 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380006260 con 0x7fd390155450 2023-10-14T18:47:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 -- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 msgr2=0x7fd3900c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd3900c97d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd380009990 tx=0x7fd380009220 comp rx=0 tx=0).stop 2023-10-14T18:47:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 -- 172.21.15.79:0/1627579423 shutdown_connections 2023-10-14T18:47:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3901588d0 0x7fd3901592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1627579423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd3900c97d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 -- 172.21.15.79:0/1627579423 >> 172.21.15.79:0/1627579423 conn(0x7fd390067660 msgr2=0x7fd390067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 -- 172.21.15.79:0/1627579423 shutdown_connections 2023-10-14T18:47:16.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.839+0000 7fd395d8a700 1 -- 172.21.15.79:0/1627579423 wait complete. 2023-10-14T18:47:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.840+0000 7fd395d8a700 1 Processor -- start 2023-10-14T18:47:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.840+0000 7fd395d8a700 1 -- start start 2023-10-14T18:47:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd39014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd390155820 0x7fd3900b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015a830 con 0x7fd3901588d0 2023-10-14T18:47:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015afb0 con 0x7fd390155450 2023-10-14T18:47:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39014c4b0 con 0x7fd390155820 2023-10-14T18:47:16.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34918/0 (socket says 172.21.15.79:34918) 2023-10-14T18:47:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 -- 172.21.15.79:0/1675658601 learned_addr learned my addr 172.21.15.79:0/1675658601 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd394d88700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd39014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd38ffff700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd390155820 0x7fd3900b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 -- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd390155820 msgr2=0x7fd3900b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd390155820 0x7fd3900b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 -- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 msgr2=0x7fd39014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:16.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd39014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:16.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 -- 172.21.15.79:0/1675658601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009a20 con 0x7fd3901588d0 2023-10-14T18:47:16.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395589700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd388009f50 tx=0x7fd38800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800ccb0 con 0x7fd3901588d0 2023-10-14T18:47:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800f040 con 0x7fd3901588d0 2023-10-14T18:47:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380009480 con 0x7fd3901588d0 2023-10-14T18:47:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388014480 con 0x7fd3901588d0 2023-10-14T18:47:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.841+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39015a170 con 0x7fd3901588d0 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.842+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39006c890 con 0x7fd3901588d0 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.843+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd388003020 con 0x7fd3901588d0 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.843+0000 7fd38cff9700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 0x7fd3700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.843+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd388084f30 con 0x7fd3901588d0 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.843+0000 7fd394d88700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 0x7fd3700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:16.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.844+0000 7fd394d88700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 0x7fd3700693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd380007fd0 tx=0x7fd380016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:16.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:16.847+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3880521a0 con 0x7fd3901588d0 2023-10-14T18:47:17.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.068+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd3900cb8c0 con 0x7fd3901588d0 2023-10-14T18:47:17.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.701+0000 7fd38cff9700 1 -- 172.21.15.79:0/1675658601 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd3880557c0 con 0x7fd3901588d0 2023-10-14T18:47:17.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 msgr2=0x7fd3700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 0x7fd3700693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd380007fd0 tx=0x7fd380016000 comp rx=0 tx=0).stop 2023-10-14T18:47:17.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 msgr2=0x7fd390069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd388009f50 tx=0x7fd38800b040 comp rx=0 tx=0).stop 2023-10-14T18:47:17.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 shutdown_connections 2023-10-14T18:47:17.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd370066f30 0x7fd3700693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3901588d0 0x7fd390069ca0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd390155450 0x7fd39014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 --2- 172.21.15.79:0/1675658601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd390155820 0x7fd3900b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 >> 172.21.15.79:0/1675658601 conn(0x7fd390067660 msgr2=0x7fd390157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:17.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 shutdown_connections 2023-10-14T18:47:17.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.703+0000 7fd395d8a700 1 -- 172.21.15.79:0/1675658601 wait complete. 2023-10-14T18:47:17.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:17.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.829+0000 7fb9caae6700 1 Processor -- start 2023-10-14T18:47:17.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.829+0000 7fb9caae6700 1 -- start start 2023-10-14T18:47:17.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9caae6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9c4157c40 0x7fb9c4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9caae6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c415cbb0 con 0x7fb9c415a620 2023-10-14T18:47:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9caae6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c415bfa0 con 0x7fb9c4157870 2023-10-14T18:47:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9caae6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c415bdb0 con 0x7fb9c4157c40 2023-10-14T18:47:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9c9083700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb9c4157c40 0x7fb9c4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:17.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9bbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9c415a620 0x7fb9c415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:54982/0 (socket says 172.21.15.79:54982) 2023-10-14T18:47:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.830+0000 7fb9bbfff700 1 -- 172.21.15.79:0/618440279 learned_addr learned my addr 172.21.15.79:0/618440279 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9c9083700 1 -- 172.21.15.79:0/618440279 >> v1:172.21.15.144:6789/0 conn(0x7fb9c4157870 legacy=0x7fb9c415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9c9083700 1 -- 172.21.15.79:0/618440279 >> v1:172.21.15.79:6789/0 conn(0x7fb9c415a620 legacy=0x7fb9c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9c9083700 1 -- 172.21.15.79:0/618440279 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c415c280 con 0x7fb9c4157c40 2023-10-14T18:47:17.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9bb7fe700 1 -- 172.21.15.79:0/618440279 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011123076 0 0) 0x7fb9c415cbb0 con 0x7fb9c415a620 2023-10-14T18:47:17.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9c9083700 1 --2- 172.21.15.79:0/618440279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4157c40 0x7fb9c4158110 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a543b23369c9f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9bb7fe700 1 -- 172.21.15.79:0/618440279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc009e80 con 0x7fb9c4157c40 2023-10-14T18:47:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9bb7fe700 1 -- 172.21.15.79:0/618440279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00b860 con 0x7fb9c4157c40 2023-10-14T18:47:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9bb7fe700 1 -- 172.21.15.79:0/618440279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00bbe0 con 0x7fb9c4157c40 2023-10-14T18:47:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9caae6700 1 -- 172.21.15.79:0/618440279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4157c40 msgr2=0x7fb9c4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9caae6700 1 --2- 172.21.15.79:0/618440279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4157c40 0x7fb9c4158110 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9caae6700 1 -- 172.21.15.79:0/618440279 shutdown_connections 2023-10-14T18:47:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9caae6700 1 --2- 172.21.15.79:0/618440279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4157c40 0x7fb9c4158110 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.831+0000 7fb9caae6700 1 -- 172.21.15.79:0/618440279 >> 172.21.15.79:0/618440279 conn(0x7fb9c4068ce0 msgr2=0x7fb9c40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:17.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.832+0000 7fb9caae6700 1 -- 172.21.15.79:0/618440279 shutdown_connections 2023-10-14T18:47:17.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.832+0000 7fb9caae6700 1 -- 172.21.15.79:0/618440279 wait complete. 2023-10-14T18:47:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 Processor -- start 2023-10-14T18:47:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 -- start start 2023-10-14T18:47:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c4157870 0x7fb9c4160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:17.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9c4157c40 0x7fb9c415df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:17.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:17.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c415e740 con 0x7fb9c415a620 2023-10-14T18:47:17.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c415ea20 con 0x7fb9c4157870 2023-10-14T18:47:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.833+0000 7fb9caae6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c415ed00 con 0x7fb9c4157c40 2023-10-14T18:47:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34946/0 (socket says 172.21.15.79:34946) 2023-10-14T18:47:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 -- 172.21.15.79:0/1037332306 learned_addr learned my addr 172.21.15.79:0/1037332306 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:17.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 -- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9c4157c40 msgr2=0x7fb9c415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9c4157c40 0x7fb9c415df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 -- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c4157870 msgr2=0x7fb9c4160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:17.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c8882700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c4157870 0x7fb9c4160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:17.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c4157870 0x7fb9c4160c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:17.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 -- 172.21.15.79:0/1037332306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc009420 con 0x7fb9c415a620 2023-10-14T18:47:17.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9c9083700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc013000 tx=0x7fb9bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:17.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc01f070 con 0x7fb9c415a620 2023-10-14T18:47:17.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc011420 con 0x7fb9c415a620 2023-10-14T18:47:17.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c415efe0 con 0x7fb9c415a620 2023-10-14T18:47:17.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0117e0 con 0x7fb9c415a620 2023-10-14T18:47:17.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.834+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c415e450 con 0x7fb9c415a620 2023-10-14T18:47:17.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.835+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c415f500 con 0x7fb9c415a620 2023-10-14T18:47:17.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.836+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9bc011b50 con 0x7fb9c415a620 2023-10-14T18:47:17.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.836+0000 7fb9b8ff9700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 0x7fb9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:17.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.836+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9bc085d50 con 0x7fb9c415a620 2023-10-14T18:47:17.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.836+0000 7fb9c8882700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 0x7fb9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:17.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.837+0000 7fb9c8882700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 0x7fb9b00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0007fd0 tx=0x7fb9c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:17.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:17.840+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9c415f500 con 0x7fb9c415a620 2023-10-14T18:47:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.064+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c415f500 con 0x7fb9c415a620 2023-10-14T18:47:18.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.065+0000 7fb9b8ff9700 1 -- 172.21.15.79:0/1037332306 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fb9c415f500 con 0x7fb9c415a620 2023-10-14T18:47:18.066 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:18.066 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:47:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 msgr2=0x7fb9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 0x7fb9b00693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0007fd0 tx=0x7fb9c0009040 comp rx=0 tx=0).stop 2023-10-14T18:47:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 msgr2=0x7fb9c41486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc013000 tx=0x7fb9bc017000 comp rx=0 tx=0).stop 2023-10-14T18:47:18.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 shutdown_connections 2023-10-14T18:47:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb9b0066f30 0x7fb9b00693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c415a620 0x7fb9c41486e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c4157870 0x7fb9c4160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 --2- 172.21.15.79:0/1037332306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9c4157c40 0x7fb9c415df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 >> 172.21.15.79:0/1037332306 conn(0x7fb9c4068ce0 msgr2=0x7fb9c41580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 shutdown_connections 2023-10-14T18:47:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.067+0000 7fb9caae6700 1 -- 172.21.15.79:0/1037332306 wait complete. 2023-10-14T18:47:18.070 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:47:18.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:47:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.193+0000 7f4560517700 1 Processor -- start 2023-10-14T18:47:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.193+0000 7f4560517700 1 -- start start 2023-10-14T18:47:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.194+0000 7f4560517700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.194+0000 7f4560517700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 0x7f455815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.194+0000 7f4560517700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455815cbb0 con 0x7f455815d580 2023-10-14T18:47:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.194+0000 7f4560517700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455815bfa0 con 0x7f455815a620 2023-10-14T18:47:18.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.194+0000 7f4560517700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455815c280 con 0x7f4558157870 2023-10-14T18:47:18.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455dab2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 0x7f455815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:53654/0 (socket says 172.21.15.79:53654) 2023-10-14T18:47:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 -- 172.21.15.79:0/1338125590 learned_addr learned my addr 172.21.15.79:0/1338125590 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 -- 172.21.15.79:0/1338125590 >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 msgr2=0x7f455815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 --2- 172.21.15.79:0/1338125590 >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 0x7f455815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 -- 172.21.15.79:0/1338125590 >> v1:172.21.15.144:6789/0 conn(0x7f455815d580 legacy=0x7f4558158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 -- 172.21.15.79:0/1338125590 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455815c560 con 0x7f4558157870 2023-10-14T18:47:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455dab2700 1 --2- 172.21.15.79:0/1338125590 >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 0x7f455815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:18.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455e2b3700 1 --2- 172.21.15.79:0/1338125590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4554009f20 tx=0x7f4554009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203afc8d804a0dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455d2b1700 1 -- 172.21.15.79:0/1338125590 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455400e070 con 0x7f4558157870 2023-10-14T18:47:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455d2b1700 1 -- 172.21.15.79:0/1338125590 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455400b9d0 con 0x7f4558157870 2023-10-14T18:47:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.195+0000 7f455d2b1700 1 -- 172.21.15.79:0/1338125590 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540092e0 con 0x7f4558157870 2023-10-14T18:47:18.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 -- 172.21.15.79:0/1338125590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 msgr2=0x7f455815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 --2- 172.21.15.79:0/1338125590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4554009f20 tx=0x7f4554009840 comp rx=0 tx=0).stop 2023-10-14T18:47:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 -- 172.21.15.79:0/1338125590 shutdown_connections 2023-10-14T18:47:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 --2- 172.21.15.79:0/1338125590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f455815b6a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 --2- 172.21.15.79:0/1338125590 >> v2:172.21.15.144:3300/0 conn(0x7f455815a620 0x7f455815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 -- 172.21.15.79:0/1338125590 >> 172.21.15.79:0/1338125590 conn(0x7f4558068ce0 msgr2=0x7f45580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 -- 172.21.15.79:0/1338125590 shutdown_connections 2023-10-14T18:47:18.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.196+0000 7f4560517700 1 -- 172.21.15.79:0/1338125590 wait complete. 2023-10-14T18:47:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.197+0000 7f4560517700 1 Processor -- start 2023-10-14T18:47:18.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.197+0000 7f4560517700 1 -- start start 2023-10-14T18:47:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f4558149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455815a620 0x7f455815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580cf2b0 con 0x7f455815d580 2023-10-14T18:47:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580cf590 con 0x7f455815a620 2023-10-14T18:47:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f4560517700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455815f270 con 0x7f4558157870 2023-10-14T18:47:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34948/0 (socket says 172.21.15.79:34948) 2023-10-14T18:47:18.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 -- 172.21.15.79:0/601578210 learned_addr learned my addr 172.21.15.79:0/601578210 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455dab2700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455815a620 0x7f455815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455e2b3700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f4558149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 -- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 msgr2=0x7f4558149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f4558149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 -- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455815a620 msgr2=0x7f455815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455815a620 0x7f455815e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 -- 172.21.15.79:0/601578210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009420 con 0x7f455815d580 2023-10-14T18:47:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f455eab4700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f455000c490 tx=0x7f4550007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.198+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455000ce40 con 0x7f455815d580 2023-10-14T18:47:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.199+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4550011590 con 0x7f455815d580 2023-10-14T18:47:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.199+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4554009ae0 con 0x7f455815d580 2023-10-14T18:47:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.199+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550011950 con 0x7f455815d580 2023-10-14T18:47:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.199+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455815f830 con 0x7f455815d580 2023-10-14T18:47:18.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.199+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45580cf700 con 0x7f455815d580 2023-10-14T18:47:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.200+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4550011d00 con 0x7f455815d580 2023-10-14T18:47:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.200+0000 7f454e7fc700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 0x7f453c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.200+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4550083760 con 0x7f455815d580 2023-10-14T18:47:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.200+0000 7f455e2b3700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 0x7f453c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.201+0000 7f455e2b3700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 0x7f453c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4554009880 tx=0x7f4554018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.204+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45500509d0 con 0x7f455815d580 2023-10-14T18:47:18.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.388+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f455804c3c0 con 0x7f455815d580 2023-10-14T18:47:18.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.389+0000 7f454e7fc700 1 -- 172.21.15.79:0/601578210 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4550017020 con 0x7f455815d580 2023-10-14T18:47:18.390 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:18.390 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":67,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:47:15.676276+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:47:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 msgr2=0x7f453c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 0x7f453c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4554009880 tx=0x7f4554018000 comp rx=0 tx=0).stop 2023-10-14T18:47:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 msgr2=0x7f455814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f455000c490 tx=0x7f4550007f20 comp rx=0 tx=0).stop 2023-10-14T18:47:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 shutdown_connections 2023-10-14T18:47:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f453c066f30 0x7f453c0693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f455815d580 0x7f455814b2f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4558157870 0x7f4558149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 --2- 172.21.15.79:0/601578210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f455815a620 0x7f455815e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 >> 172.21.15.79:0/601578210 conn(0x7f4558068ce0 msgr2=0x7f4558159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 shutdown_connections 2023-10-14T18:47:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.391+0000 7f4560517700 1 -- 172.21.15.79:0/601578210 wait complete. 2023-10-14T18:47:18.404 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:47:18.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:47:18.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.519+0000 7fdee0853700 1 Processor -- start 2023-10-14T18:47:18.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.519+0000 7fdee0853700 1 -- start start 2023-10-14T18:47:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdee0853700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdedc0cd6e0 0x7fdedc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdee0853700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdedc15cbd0 0x7fdedc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdee0853700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0cb7c0 con 0x7fdedc0cdab0 2023-10-14T18:47:18.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdee0853700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc15e850 con 0x7fdedc15cbd0 2023-10-14T18:47:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdee0853700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc0cd030 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdedc15cbd0 0x7fdedc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedaffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdedc0cdab0 0x7fdedc15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45140/0 (socket says 172.21.15.79:45140) 2023-10-14T18:47:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedaffd700 1 -- 172.21.15.79:0/32394640 learned_addr learned my addr 172.21.15.79:0/32394640 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:18.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedb7fe700 1 --2- 172.21.15.79:0/32394640 >> v2:172.21.15.144:3300/0 conn(0x7fdedc0cd6e0 0x7fdedc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 -- 172.21.15.79:0/32394640 >> v2:172.21.15.144:3300/0 conn(0x7fdedc0cd6e0 msgr2=0x7fdedc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:18.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 --2- 172.21.15.79:0/32394640 >> v2:172.21.15.144:3300/0 conn(0x7fdedc0cd6e0 0x7fdedc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 -- 172.21.15.79:0/32394640 >> v1:172.21.15.79:6789/0 conn(0x7fdedc0cdab0 legacy=0x7fdedc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 -- 172.21.15.79:0/32394640 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc15e290 con 0x7fdedc15cbd0 2023-10-14T18:47:18.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdeda7fc700 1 -- 172.21.15.79:0/32394640 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033270647 0 0) 0x7fdedc0cb7c0 con 0x7fdedc0cdab0 2023-10-14T18:47:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdedbfff700 1 --2- 172.21.15.79:0/32394640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc15cbd0 0x7fdedc15d050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdedc06b730 tx=0x7fded40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117ea125db115a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.520+0000 7fdeda7fc700 1 -- 172.21.15.79:0/32394640 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400b6b0 con 0x7fdedc15cbd0 2023-10-14T18:47:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdeda7fc700 1 -- 172.21.15.79:0/32394640 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400b810 con 0x7fdedc15cbd0 2023-10-14T18:47:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdeda7fc700 1 -- 172.21.15.79:0/32394640 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400bbb0 con 0x7fdedc15cbd0 2023-10-14T18:47:18.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 -- 172.21.15.79:0/32394640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc15cbd0 msgr2=0x7fdedc15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 --2- 172.21.15.79:0/32394640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc15cbd0 0x7fdedc15d050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdedc06b730 tx=0x7fded40091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 -- 172.21.15.79:0/32394640 shutdown_connections 2023-10-14T18:47:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 --2- 172.21.15.79:0/32394640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc15cbd0 0x7fdedc15d050 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 --2- 172.21.15.79:0/32394640 >> v2:172.21.15.144:3300/0 conn(0x7fdedc0cd6e0 0x7fdedc0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 -- 172.21.15.79:0/32394640 >> 172.21.15.79:0/32394640 conn(0x7fdedc067660 msgr2=0x7fdedc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 -- 172.21.15.79:0/32394640 shutdown_connections 2023-10-14T18:47:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.521+0000 7fdee0853700 1 -- 172.21.15.79:0/32394640 wait complete. 2023-10-14T18:47:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.522+0000 7fdee0853700 1 Processor -- start 2023-10-14T18:47:18.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.522+0000 7fdee0853700 1 -- start start 2023-10-14T18:47:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdedc0cdab0 0x7fdedc16d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdedc15cbd0 0x7fdedc16ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c9bc0 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c8fb0 con 0x7fdedc15cbd0 2023-10-14T18:47:18.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdee0853700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c9290 con 0x7fdedc0cdab0 2023-10-14T18:47:18.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33018/0 (socket says 172.21.15.79:33018) 2023-10-14T18:47:18.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 -- 172.21.15.79:0/1752599207 learned_addr learned my addr 172.21.15.79:0/1752599207 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:18.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedaffd700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdedc0cdab0 0x7fdedc16d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedbfff700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdedc15cbd0 0x7fdedc16ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 -- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdedc0cdab0 msgr2=0x7fdedc16d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdedc0cdab0 0x7fdedc16d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 -- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdedc15cbd0 msgr2=0x7fdedc16ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdedc15cbd0 0x7fdedc16ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.523+0000 7fdedb7fe700 1 -- 172.21.15.79:0/1752599207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009420 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdedb7fe700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e190 tx=0x7fdecc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00ee30 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdecc014420 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0c9570 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0147e0 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.524+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc142990 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.525+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc089280 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.525+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdecc014b90 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.525+0000 7fdec37fe700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 0x7fdec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.525+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdecc084d90 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.526+0000 7fdedaffd700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 0x7fdec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.526+0000 7fdedaffd700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 0x7fdec80693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdedc1560d0 tx=0x7fded0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.530+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdecc052000 con 0x7fdedc0cd6e0 2023-10-14T18:47:18.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.711+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdedc0c9d00 con 0x7fdec8066f30 2023-10-14T18:47:18.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.720+0000 7fdec37fe700 1 -- 172.21.15.79:0/1752599207 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282282 (secure 0 0 0) 0x7fded00014f0 con 0x7fdec8066f30 2023-10-14T18:47:18.724 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 msgr2=0x7fdec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 0x7fdec80693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdedc1560d0 tx=0x7fded0009040 comp rx=0 tx=0).stop 2023-10-14T18:47:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 msgr2=0x7fdedc142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00e190 tx=0x7fdecc009920 comp rx=0 tx=0).stop 2023-10-14T18:47:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 shutdown_connections 2023-10-14T18:47:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdec8066f30 0x7fdec80693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdedc15cbd0 0x7fdedc16ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdedc0cd6e0 0x7fdedc142450 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 --2- 172.21.15.79:0/1752599207 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdedc0cdab0 0x7fdedc16d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 >> 172.21.15.79:0/1752599207 conn(0x7fdedc067660 msgr2=0x7fdedc156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 shutdown_connections 2023-10-14T18:47:18.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.723+0000 7fdee0853700 1 -- 172.21.15.79:0/1752599207 wait complete. 2023-10-14T18:47:18.729 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:47:18.735 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-14T18:47:18.363621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558788,"statfs":{"total":1600000000,"available":1596199239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699435"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670001+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:36.100956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668843+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.539759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666726+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671725+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.672315+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:18.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.675416+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670582+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666578+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666798+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:34.886255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671562+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670677+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:36.996729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670320+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667652+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667106+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670179+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674308+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666547+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666314+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673617+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:12.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665807+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666414+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666160+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665897+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668090+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671959+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:20.564718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669479+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674420+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670350+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:13:23.267395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665417+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667059+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669643+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:16.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673575+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673134+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675443+0000","last_change":"2023-10-14T18:47:13.675443+0000","last_active":"2023-10-14T18:47:13.675443+0000","last_peered":"2023-10-14T18:47:13.675443+0000","last_clean":"2023-10-14T18:47:13.675443+0000","last_became_active":"2023-10-14T18:47:13.675217+0000","last_became_peered":"2023-10-14T18:47:13.675217+0000","last_unstale":"2023-10-14T18:47:13.675443+0000","last_undegraded":"2023-10-14T18:47:13.675443+0000","last_fullsized":"2023-10-14T18:47:13.675443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670623+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:33.866557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670021+0000","last_change":"2023-10-14T18:47:13.670021+0000","last_active":"2023-10-14T18:47:13.670021+0000","last_peered":"2023-10-14T18:47:13.670021+0000","last_clean":"2023-10-14T18:47:13.670021+0000","last_became_active":"2023-10-14T18:47:13.669168+0000","last_became_peered":"2023-10-14T18:47:13.669168+0000","last_unstale":"2023-10-14T18:47:13.670021+0000","last_undegraded":"2023-10-14T18:47:13.670021+0000","last_fullsized":"2023-10-14T18:47:13.670021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:38.475719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671967+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675609+0000","last_change":"2023-10-14T18:47:13.675609+0000","last_active":"2023-10-14T18:47:13.675609+0000","last_peered":"2023-10-14T18:47:13.675609+0000","last_clean":"2023-10-14T18:47:13.675609+0000","last_became_active":"2023-10-14T18:47:13.675361+0000","last_became_peered":"2023-10-14T18:47:13.675361+0000","last_unstale":"2023-10-14T18:47:13.675609+0000","last_undegraded":"2023-10-14T18:47:13.675609+0000","last_fullsized":"2023-10-14T18:47:13.675609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674954+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675094+0000","last_change":"2023-10-14T18:47:13.675094+0000","last_active":"2023-10-14T18:47:13.675094+0000","last_peered":"2023-10-14T18:47:13.675094+0000","last_clean":"2023-10-14T18:47:13.675094+0000","last_became_active":"2023-10-14T18:47:13.674569+0000","last_became_peered":"2023-10-14T18:47:13.674569+0000","last_unstale":"2023-10-14T18:47:13.675094+0000","last_undegraded":"2023-10-14T18:47:13.675094+0000","last_fullsized":"2023-10-14T18:47:13.675094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665442+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672104+0000","last_change":"2023-10-14T18:47:13.672104+0000","last_active":"2023-10-14T18:47:13.672104+0000","last_peered":"2023-10-14T18:47:13.672104+0000","last_clean":"2023-10-14T18:47:13.672104+0000","last_became_active":"2023-10-14T18:47:13.671874+0000","last_became_peered":"2023-10-14T18:47:13.671874+0000","last_unstale":"2023-10-14T18:47:13.672104+0000","last_undegraded":"2023-10-14T18:47:13.672104+0000","last_fullsized":"2023-10-14T18:47:13.672104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:09.636514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665822+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677589+0000","last_change":"2023-10-14T18:47:13.677589+0000","last_active":"2023-10-14T18:47:13.677589+0000","last_peered":"2023-10-14T18:47:13.677589+0000","last_clean":"2023-10-14T18:47:13.677589+0000","last_became_active":"2023-10-14T18:47:13.677153+0000","last_became_peered":"2023-10-14T18:47:13.677153+0000","last_unstale":"2023-10-14T18:47:13.677589+0000","last_undegraded":"2023-10-14T18:47:13.677589+0000","last_fullsized":"2023-10-14T18:47:13.677589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668658+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676379+0000","last_change":"2023-10-14T18:47:13.676379+0000","last_active":"2023-10-14T18:47:13.676379+0000","last_peered":"2023-10-14T18:47:13.676379+0000","last_clean":"2023-10-14T18:47:13.676379+0000","last_became_active":"2023-10-14T18:47:13.675704+0000","last_became_peered":"2023-10-14T18:47:13.675704+0000","last_unstale":"2023-10-14T18:47:13.676379+0000","last_undegraded":"2023-10-14T18:47:13.676379+0000","last_fullsized":"2023-10-14T18:47:13.676379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.664918+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673613+0000","last_change":"2023-10-14T18:47:13.673613+0000","last_active":"2023-10-14T18:47:13.673613+0000","last_peered":"2023-10-14T18:47:13.673613+0000","last_clean":"2023-10-14T18:47:13.673613+0000","last_became_active":"2023-10-14T18:47:13.673392+0000","last_became_peered":"2023-10-14T18:47:13.673392+0000","last_unstale":"2023-10-14T18:47:13.673613+0000","last_undegraded":"2023-10-14T18:47:13.673613+0000","last_fullsized":"2023-10-14T18:47:13.673613+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:05.157312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672117+0000","last_change":"2023-10-14T18:47:13.672117+0000","last_active":"2023-10-14T18:47:13.672117+0000","last_peered":"2023-10-14T18:47:13.672117+0000","last_clean":"2023-10-14T18:47:13.672117+0000","last_became_active":"2023-10-14T18:47:13.670992+0000","last_became_peered":"2023-10-14T18:47:13.670992+0000","last_unstale":"2023-10-14T18:47:13.672117+0000","last_undegraded":"2023-10-14T18:47:13.672117+0000","last_fullsized":"2023-10-14T18:47:13.672117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:16.296747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666027+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670877+0000","last_change":"2023-10-14T18:47:13.670877+0000","last_active":"2023-10-14T18:47:13.670877+0000","last_peered":"2023-10-14T18:47:13.670877+0000","last_clean":"2023-10-14T18:47:13.670877+0000","last_became_active":"2023-10-14T18:47:13.670062+0000","last_became_peered":"2023-10-14T18:47:13.670062+0000","last_unstale":"2023-10-14T18:47:13.670877+0000","last_undegraded":"2023-10-14T18:47:13.670877+0000","last_fullsized":"2023-10-14T18:47:13.670877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:32.803430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670862+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:03.337393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671091+0000","last_change":"2023-10-14T18:47:13.671091+0000","last_active":"2023-10-14T18:47:13.671091+0000","last_peered":"2023-10-14T18:47:13.671091+0000","last_clean":"2023-10-14T18:47:13.671091+0000","last_became_active":"2023-10-14T18:47:13.669764+0000","last_became_peered":"2023-10-14T18:47:13.669764+0000","last_unstale":"2023-10-14T18:47:13.671091+0000","last_undegraded":"2023-10-14T18:47:13.671091+0000","last_fullsized":"2023-10-14T18:47:13.671091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:33.881152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665412+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676991+0000","last_change":"2023-10-14T18:47:13.676991+0000","last_active":"2023-10-14T18:47:13.676991+0000","last_peered":"2023-10-14T18:47:13.676991+0000","last_clean":"2023-10-14T18:47:13.676991+0000","last_became_active":"2023-10-14T18:47:13.676559+0000","last_became_peered":"2023-10-14T18:47:13.676559+0000","last_unstale":"2023-10-14T18:47:13.676991+0000","last_undegraded":"2023-10-14T18:47:13.676991+0000","last_fullsized":"2023-10-14T18:47:13.676991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:09.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669072+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.665940+0000","last_change":"2023-10-14T18:47:13.665940+0000","last_active":"2023-10-14T18:47:13.665940+0000","last_peered":"2023-10-14T18:47:13.665940+0000","last_clean":"2023-10-14T18:47:13.665940+0000","last_became_active":"2023-10-14T18:47:13.665381+0000","last_became_peered":"2023-10-14T18:47:13.665381+0000","last_unstale":"2023-10-14T18:47:13.665940+0000","last_undegraded":"2023-10-14T18:47:13.665940+0000","last_fullsized":"2023-10-14T18:47:13.665940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:29.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665847+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673936+0000","last_change":"2023-10-14T18:47:13.673936+0000","last_active":"2023-10-14T18:47:13.673936+0000","last_peered":"2023-10-14T18:47:13.673936+0000","last_clean":"2023-10-14T18:47:13.673936+0000","last_became_active":"2023-10-14T18:47:13.673715+0000","last_became_peered":"2023-10-14T18:47:13.673715+0000","last_unstale":"2023-10-14T18:47:13.673936+0000","last_undegraded":"2023-10-14T18:47:13.673936+0000","last_fullsized":"2023-10-14T18:47:13.673936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:02.332290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666997+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:06.555046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673972+0000","last_change":"2023-10-14T18:47:13.673972+0000","last_active":"2023-10-14T18:47:13.673972+0000","last_peered":"2023-10-14T18:47:13.673972+0000","last_clean":"2023-10-14T18:47:13.673972+0000","last_became_active":"2023-10-14T18:47:13.673741+0000","last_became_peered":"2023-10-14T18:47:13.673741+0000","last_unstale":"2023-10-14T18:47:13.673972+0000","last_undegraded":"2023-10-14T18:47:13.673972+0000","last_fullsized":"2023-10-14T18:47:13.673972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665007+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671263+0000","last_change":"2023-10-14T18:47:13.671263+0000","last_active":"2023-10-14T18:47:13.671263+0000","last_peered":"2023-10-14T18:47:13.671263+0000","last_clean":"2023-10-14T18:47:13.671263+0000","last_became_active":"2023-10-14T18:47:13.670844+0000","last_became_peered":"2023-10-14T18:47:13.670844+0000","last_unstale":"2023-10-14T18:47:13.671263+0000","last_undegraded":"2023-10-14T18:47:13.671263+0000","last_fullsized":"2023-10-14T18:47:13.671263+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:05.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665370+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670158+0000","last_change":"2023-10-14T18:47:13.670158+0000","last_active":"2023-10-14T18:47:13.670158+0000","last_peered":"2023-10-14T18:47:13.670158+0000","last_clean":"2023-10-14T18:47:13.670158+0000","last_became_active":"2023-10-14T18:47:13.669734+0000","last_became_peered":"2023-10-14T18:47:13.669734+0000","last_unstale":"2023-10-14T18:47:13.670158+0000","last_undegraded":"2023-10-14T18:47:13.670158+0000","last_fullsized":"2023-10-14T18:47:13.670158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:15.467750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671311+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.669664+0000","last_change":"2023-10-14T18:47:13.669664+0000","last_active":"2023-10-14T18:47:13.669664+0000","last_peered":"2023-10-14T18:47:13.669664+0000","last_clean":"2023-10-14T18:47:13.669664+0000","last_became_active":"2023-10-14T18:47:13.669445+0000","last_became_peered":"2023-10-14T18:47:13.669445+0000","last_unstale":"2023-10-14T18:47:13.669664+0000","last_undegraded":"2023-10-14T18:47:13.669664+0000","last_fullsized":"2023-10-14T18:47:13.669664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665444+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674946+0000","last_change":"2023-10-14T18:47:13.674946+0000","last_active":"2023-10-14T18:47:13.674946+0000","last_peered":"2023-10-14T18:47:13.674946+0000","last_clean":"2023-10-14T18:47:13.674946+0000","last_became_active":"2023-10-14T18:47:13.674266+0000","last_became_peered":"2023-10-14T18:47:13.674266+0000","last_unstale":"2023-10-14T18:47:13.674946+0000","last_undegraded":"2023-10-14T18:47:13.674946+0000","last_fullsized":"2023-10-14T18:47:13.674946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665622+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673226+0000","last_change":"2023-10-14T18:47:13.673226+0000","last_active":"2023-10-14T18:47:13.673226+0000","last_peered":"2023-10-14T18:47:13.673226+0000","last_clean":"2023-10-14T18:47:13.673226+0000","last_became_active":"2023-10-14T18:47:13.673009+0000","last_became_peered":"2023-10-14T18:47:13.673009+0000","last_unstale":"2023-10-14T18:47:13.673226+0000","last_undegraded":"2023-10-14T18:47:13.673226+0000","last_fullsized":"2023-10-14T18:47:13.673226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:18.790977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670887+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674003+0000","last_change":"2023-10-14T18:47:13.674003+0000","last_active":"2023-10-14T18:47:13.674003+0000","last_peered":"2023-10-14T18:47:13.674003+0000","last_clean":"2023-10-14T18:47:13.674003+0000","last_became_active":"2023-10-14T18:47:13.673498+0000","last_became_peered":"2023-10-14T18:47:13.673498+0000","last_unstale":"2023-10-14T18:47:13.674003+0000","last_undegraded":"2023-10-14T18:47:13.674003+0000","last_fullsized":"2023-10-14T18:47:13.674003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:36.421932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671999+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.667077+0000","last_change":"2023-10-14T18:47:13.667077+0000","last_active":"2023-10-14T18:47:13.667077+0000","last_peered":"2023-10-14T18:47:13.667077+0000","last_clean":"2023-10-14T18:47:13.667077+0000","last_became_active":"2023-10-14T18:47:13.666843+0000","last_became_peered":"2023-10-14T18:47:13.666843+0000","last_unstale":"2023-10-14T18:47:13.667077+0000","last_undegraded":"2023-10-14T18:47:13.667077+0000","last_fullsized":"2023-10-14T18:47:13.667077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:11.693401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674616+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673837+0000","last_change":"2023-10-14T18:47:13.673837+0000","last_active":"2023-10-14T18:47:13.673837+0000","last_peered":"2023-10-14T18:47:13.673837+0000","last_clean":"2023-10-14T18:47:13.673837+0000","last_became_active":"2023-10-14T18:47:13.672542+0000","last_became_peered":"2023-10-14T18:47:13.672542+0000","last_unstale":"2023-10-14T18:47:13.673837+0000","last_undegraded":"2023-10-14T18:47:13.673837+0000","last_fullsized":"2023-10-14T18:47:13.673837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:21.552032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668932+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.668077+0000","last_change":"2023-10-14T18:47:13.668077+0000","last_active":"2023-10-14T18:47:13.668077+0000","last_peered":"2023-10-14T18:47:13.668077+0000","last_clean":"2023-10-14T18:47:13.668077+0000","last_became_active":"2023-10-14T18:47:13.667849+0000","last_became_peered":"2023-10-14T18:47:13.667849+0000","last_unstale":"2023-10-14T18:47:13.668077+0000","last_undegraded":"2023-10-14T18:47:13.668077+0000","last_fullsized":"2023-10-14T18:47:13.668077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:32.176987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669755+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677720+0000","last_change":"2023-10-14T18:47:13.677720+0000","last_active":"2023-10-14T18:47:13.677720+0000","last_peered":"2023-10-14T18:47:13.677720+0000","last_clean":"2023-10-14T18:47:13.677720+0000","last_became_active":"2023-10-14T18:47:13.677414+0000","last_became_peered":"2023-10-14T18:47:13.677414+0000","last_unstale":"2023-10-14T18:47:13.677720+0000","last_undegraded":"2023-10-14T18:47:13.677720+0000","last_fullsized":"2023-10-14T18:47:13.677720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671176+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672788+0000","last_change":"2023-10-14T18:47:13.672788+0000","last_active":"2023-10-14T18:47:13.672788+0000","last_peered":"2023-10-14T18:47:13.672788+0000","last_clean":"2023-10-14T18:47:13.672788+0000","last_became_active":"2023-10-14T18:47:13.672541+0000","last_became_peered":"2023-10-14T18:47:13.672541+0000","last_unstale":"2023-10-14T18:47:13.672788+0000","last_undegraded":"2023-10-14T18:47:13.672788+0000","last_fullsized":"2023-10-14T18:47:13.672788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:35.991627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671916+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675914+0000","last_change":"2023-10-14T18:47:13.675914+0000","last_active":"2023-10-14T18:47:13.675914+0000","last_peered":"2023-10-14T18:47:13.675914+0000","last_clean":"2023-10-14T18:47:13.675914+0000","last_became_active":"2023-10-14T18:47:13.675698+0000","last_became_peered":"2023-10-14T18:47:13.675698+0000","last_unstale":"2023-10-14T18:47:13.675914+0000","last_undegraded":"2023-10-14T18:47:13.675914+0000","last_fullsized":"2023-10-14T18:47:13.675914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665026+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672325+0000","last_change":"2023-10-14T18:47:13.672325+0000","last_active":"2023-10-14T18:47:13.672325+0000","last_peered":"2023-10-14T18:47:13.672325+0000","last_clean":"2023-10-14T18:47:13.672325+0000","last_became_active":"2023-10-14T18:47:13.671853+0000","last_became_peered":"2023-10-14T18:47:13.671853+0000","last_unstale":"2023-10-14T18:47:13.672325+0000","last_undegraded":"2023-10-14T18:47:13.672325+0000","last_fullsized":"2023-10-14T18:47:13.672325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:59.573668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665227+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675741+0000","last_change":"2023-10-14T18:47:13.675741+0000","last_active":"2023-10-14T18:47:13.675741+0000","last_peered":"2023-10-14T18:47:13.675741+0000","last_clean":"2023-10-14T18:47:13.675741+0000","last_became_active":"2023-10-14T18:47:13.675512+0000","last_became_peered":"2023-10-14T18:47:13.675512+0000","last_unstale":"2023-10-14T18:47:13.675741+0000","last_undegraded":"2023-10-14T18:47:13.675741+0000","last_fullsized":"2023-10-14T18:47:13.675741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:11.998966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670255+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:11.270442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672746+0000","last_change":"2023-10-14T18:47:13.672746+0000","last_active":"2023-10-14T18:47:13.672746+0000","last_peered":"2023-10-14T18:47:13.672746+0000","last_clean":"2023-10-14T18:47:13.672746+0000","last_became_active":"2023-10-14T18:47:13.672525+0000","last_became_peered":"2023-10-14T18:47:13.672525+0000","last_unstale":"2023-10-14T18:47:13.672746+0000","last_undegraded":"2023-10-14T18:47:13.672746+0000","last_fullsized":"2023-10-14T18:47:13.672746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:35.663531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674811+0000","last_change":"2023-10-14T18:47:13.674811+0000","last_active":"2023-10-14T18:47:13.674811+0000","last_peered":"2023-10-14T18:47:13.674811+0000","last_clean":"2023-10-14T18:47:13.674811+0000","last_became_active":"2023-10-14T18:47:13.674555+0000","last_became_peered":"2023-10-14T18:47:13.674555+0000","last_unstale":"2023-10-14T18:47:13.674811+0000","last_undegraded":"2023-10-14T18:47:13.674811+0000","last_fullsized":"2023-10-14T18:47:13.674811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665086+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675697+0000","last_change":"2023-10-14T18:47:13.675697+0000","last_active":"2023-10-14T18:47:13.675697+0000","last_peered":"2023-10-14T18:47:13.675697+0000","last_clean":"2023-10-14T18:47:13.675697+0000","last_became_active":"2023-10-14T18:47:13.675477+0000","last_became_peered":"2023-10-14T18:47:13.675477+0000","last_unstale":"2023-10-14T18:47:13.675697+0000","last_undegraded":"2023-10-14T18:47:13.675697+0000","last_fullsized":"2023-10-14T18:47:13.675697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:32.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-14T18:47:12.664773+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:47:12.664773+0000","last_peered":"2023-10-14T18:47:12.664773+0000","last_clean":"2023-10-14T18:47:12.664773+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:47:12.664773+0000","last_undegraded":"2023-10-14T18:47:12.664773+0000","last_fullsized":"2023-10-14T18:47:12.664773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.84899999999999998,"15min":0.89900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":0.745},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.33200000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66000000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.753,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64000000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.32300000000000001,"15min":0.32700000000000001},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45300000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50800000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.309}]},{"osd":3,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.78500000000000003,"15min":0.85099999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":10.574,"15min":10.574},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.443,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.37}]},{"osd":4,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.91500000000000004,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.504},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":898,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194413,"statfs":{"total":200000000,"available":199079886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.315,"15min":0.317},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.501}]},{"osd":5,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56699999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.253},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.375,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69099999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.71099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56599999999999995}]}]}],"pool_statfs":[]}} 2023-10-14T18:47:18.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:47:18.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.888+0000 7f0a01608700 1 Processor -- start 2023-10-14T18:47:18.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.888+0000 7f0a01608700 1 -- start start 2023-10-14T18:47:18.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f0a01608700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09fc159cf0 0x7f09fc15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f0a01608700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09fc0cf1c0 0x7f09fc068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f0a01608700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0cca20 con 0x7f09fc15a0c0 2023-10-14T18:47:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f0a01608700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc15ea40 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f0a01608700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc067660 con 0x7f09fc159cf0 2023-10-14T18:47:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f09fb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09fc0cf1c0 0x7f09fc068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f09f27fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f09fc15a0c0 0x7f09fc0ceab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45144/0 (socket says 172.21.15.79:45144) 2023-10-14T18:47:18.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f09fb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f09fc0cf1c0 0x7f09fc068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33028/0 (socket says 172.21.15.79:33028) 2023-10-14T18:47:18.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.889+0000 7f09f27fc700 1 -- 172.21.15.79:0/3019861537 learned_addr learned my addr 172.21.15.79:0/3019861537 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:18.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09faffd700 1 --2- 172.21.15.79:0/3019861537 >> v2:172.21.15.144:3300/0 conn(0x7f09fc159cf0 0x7f09fc15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fb7fe700 1 -- 172.21.15.79:0/3019861537 >> v2:172.21.15.144:3300/0 conn(0x7f09fc159cf0 msgr2=0x7f09fc15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fb7fe700 1 --2- 172.21.15.79:0/3019861537 >> v2:172.21.15.144:3300/0 conn(0x7f09fc159cf0 0x7f09fc15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fb7fe700 1 -- 172.21.15.79:0/3019861537 >> v1:172.21.15.79:6789/0 conn(0x7f09fc15a0c0 legacy=0x7f09fc0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fa7fc700 1 -- 172.21.15.79:0/3019861537 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302429131 0 0) 0x7f09fc0cca20 con 0x7f09fc15a0c0 2023-10-14T18:47:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fb7fe700 1 -- 172.21.15.79:0/3019861537 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc067f00 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fb7fe700 1 --2- 172.21.15.79:0/3019861537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc068390 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0777e0 tx=0x7f09f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99672d8ea425c13c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fa7fc700 1 -- 172.21.15.79:0/3019861537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400e070 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fa7fc700 1 -- 172.21.15.79:0/3019861537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400bc30 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f09fa7fc700 1 -- 172.21.15.79:0/3019861537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4012430 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 -- 172.21.15.79:0/3019861537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc0cf1c0 msgr2=0x7f09fc068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 --2- 172.21.15.79:0/3019861537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc068390 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0777e0 tx=0x7f09f4009780 comp rx=0 tx=0).stop 2023-10-14T18:47:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 -- 172.21.15.79:0/3019861537 shutdown_connections 2023-10-14T18:47:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 --2- 172.21.15.79:0/3019861537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc068390 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 --2- 172.21.15.79:0/3019861537 >> v2:172.21.15.144:3300/0 conn(0x7f09fc159cf0 0x7f09fc15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.890+0000 7f0a01608700 1 -- 172.21.15.79:0/3019861537 >> 172.21.15.79:0/3019861537 conn(0x7f09fc06c6e0 msgr2=0x7f09fc069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.891+0000 7f0a01608700 1 -- 172.21.15.79:0/3019861537 shutdown_connections 2023-10-14T18:47:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.891+0000 7f0a01608700 1 -- 172.21.15.79:0/3019861537 wait complete. 2023-10-14T18:47:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 Processor -- start 2023-10-14T18:47:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 -- start start 2023-10-14T18:47:18.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09fc159cf0 0x7f09fc0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.892+0000 7f0a01608700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0ae580 con 0x7f09fc15a0c0 2023-10-14T18:47:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f0a01608700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0b1fe0 con 0x7f09fc0cf1c0 2023-10-14T18:47:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f0a01608700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0add70 con 0x7f09fc159cf0 2023-10-14T18:47:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33036/0 (socket says 172.21.15.79:33036) 2023-10-14T18:47:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 -- 172.21.15.79:0/1249855647 learned_addr learned my addr 172.21.15.79:0/1249855647 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 -- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09fc159cf0 msgr2=0x7f09fc0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09fc159cf0 0x7f09fc0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 -- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc0cf1c0 msgr2=0x7f09fc0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 -- 172.21.15.79:0/1249855647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009a20 con 0x7f09fc15a0c0 2023-10-14T18:47:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09fb7fe700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f09f400b6c0 tx=0x7f09f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4012e60 con 0x7f09fc15a0c0 2023-10-14T18:47:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f401d630 con 0x7f09fc15a0c0 2023-10-14T18:47:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f401d9f0 con 0x7f09fc15a0c0 2023-10-14T18:47:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc0ae7d0 con 0x7f09fc15a0c0 2023-10-14T18:47:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.893+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0b1990 con 0x7f09fc15a0c0 2023-10-14T18:47:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.894+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc04c3c0 con 0x7f09fc15a0c0 2023-10-14T18:47:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.895+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09f4024070 con 0x7f09fc15a0c0 2023-10-14T18:47:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.895+0000 7f09f37fe700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 0x7f09dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.895+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09f4086de0 con 0x7f09fc15a0c0 2023-10-14T18:47:18.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.895+0000 7f09faffd700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 0x7f09dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:18.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.896+0000 7f09faffd700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 0x7f09dc0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009a60 tx=0x7f09ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:18.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:18.899+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09f4054050 con 0x7f09fc15a0c0 2023-10-14T18:47:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.077+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09fc0b2120 con 0x7f09dc066f30 2023-10-14T18:47:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.086+0000 7f09f37fe700 1 -- 172.21.15.79:0/1249855647 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282282 (secure 0 0 0) 0x7f09fc0b2120 con 0x7f09dc066f30 2023-10-14T18:47:19.091 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 msgr2=0x7f09dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 0x7f09dc0693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009a60 tx=0x7f09ec008040 comp rx=0 tx=0).stop 2023-10-14T18:47:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 msgr2=0x7f09fc15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f09f400b6c0 tx=0x7f09f4019000 comp rx=0 tx=0).stop 2023-10-14T18:47:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 shutdown_connections 2023-10-14T18:47:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f09dc066f30 0x7f09dc0693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f09fc15a0c0 0x7f09fc15c670 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09fc0cf1c0 0x7f09fc0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 --2- 172.21.15.79:0/1249855647 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f09fc159cf0 0x7f09fc0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 >> 172.21.15.79:0/1249855647 conn(0x7f09fc06c6e0 msgr2=0x7f09fc0cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:19.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 shutdown_connections 2023-10-14T18:47:19.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.089+0000 7f0a01608700 1 -- 172.21.15.79:0/1249855647 wait complete. 2023-10-14T18:47:19.100 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:47:19.102 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-14T18:47:18.363621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558788,"statfs":{"total":1600000000,"available":1596199239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699435"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670001+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:36.100956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668843+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.539759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666726+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671725+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.672315+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:18.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.675416+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670582+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666578+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666798+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:34.886255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671562+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670677+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:36.996729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670320+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667652+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667106+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670179+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674308+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666547+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666314+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673617+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:12.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665807+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666414+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666160+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665897+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668090+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671959+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:20.564718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669479+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674420+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670350+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:13:23.267395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665417+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667059+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669643+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:16.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673575+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673134+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675443+0000","last_change":"2023-10-14T18:47:13.675443+0000","last_active":"2023-10-14T18:47:13.675443+0000","last_peered":"2023-10-14T18:47:13.675443+0000","last_clean":"2023-10-14T18:47:13.675443+0000","last_became_active":"2023-10-14T18:47:13.675217+0000","last_became_peered":"2023-10-14T18:47:13.675217+0000","last_unstale":"2023-10-14T18:47:13.675443+0000","last_undegraded":"2023-10-14T18:47:13.675443+0000","last_fullsized":"2023-10-14T18:47:13.675443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670623+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:33.866557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670021+0000","last_change":"2023-10-14T18:47:13.670021+0000","last_active":"2023-10-14T18:47:13.670021+0000","last_peered":"2023-10-14T18:47:13.670021+0000","last_clean":"2023-10-14T18:47:13.670021+0000","last_became_active":"2023-10-14T18:47:13.669168+0000","last_became_peered":"2023-10-14T18:47:13.669168+0000","last_unstale":"2023-10-14T18:47:13.670021+0000","last_undegraded":"2023-10-14T18:47:13.670021+0000","last_fullsized":"2023-10-14T18:47:13.670021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:38.475719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671967+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675609+0000","last_change":"2023-10-14T18:47:13.675609+0000","last_active":"2023-10-14T18:47:13.675609+0000","last_peered":"2023-10-14T18:47:13.675609+0000","last_clean":"2023-10-14T18:47:13.675609+0000","last_became_active":"2023-10-14T18:47:13.675361+0000","last_became_peered":"2023-10-14T18:47:13.675361+0000","last_unstale":"2023-10-14T18:47:13.675609+0000","last_undegraded":"2023-10-14T18:47:13.675609+0000","last_fullsized":"2023-10-14T18:47:13.675609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674954+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675094+0000","last_change":"2023-10-14T18:47:13.675094+0000","last_active":"2023-10-14T18:47:13.675094+0000","last_peered":"2023-10-14T18:47:13.675094+0000","last_clean":"2023-10-14T18:47:13.675094+0000","last_became_active":"2023-10-14T18:47:13.674569+0000","last_became_peered":"2023-10-14T18:47:13.674569+0000","last_unstale":"2023-10-14T18:47:13.675094+0000","last_undegraded":"2023-10-14T18:47:13.675094+0000","last_fullsized":"2023-10-14T18:47:13.675094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665442+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672104+0000","last_change":"2023-10-14T18:47:13.672104+0000","last_active":"2023-10-14T18:47:13.672104+0000","last_peered":"2023-10-14T18:47:13.672104+0000","last_clean":"2023-10-14T18:47:13.672104+0000","last_became_active":"2023-10-14T18:47:13.671874+0000","last_became_peered":"2023-10-14T18:47:13.671874+0000","last_unstale":"2023-10-14T18:47:13.672104+0000","last_undegraded":"2023-10-14T18:47:13.672104+0000","last_fullsized":"2023-10-14T18:47:13.672104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:09.636514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665822+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677589+0000","last_change":"2023-10-14T18:47:13.677589+0000","last_active":"2023-10-14T18:47:13.677589+0000","last_peered":"2023-10-14T18:47:13.677589+0000","last_clean":"2023-10-14T18:47:13.677589+0000","last_became_active":"2023-10-14T18:47:13.677153+0000","last_became_peered":"2023-10-14T18:47:13.677153+0000","last_unstale":"2023-10-14T18:47:13.677589+0000","last_undegraded":"2023-10-14T18:47:13.677589+0000","last_fullsized":"2023-10-14T18:47:13.677589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668658+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676379+0000","last_change":"2023-10-14T18:47:13.676379+0000","last_active":"2023-10-14T18:47:13.676379+0000","last_peered":"2023-10-14T18:47:13.676379+0000","last_clean":"2023-10-14T18:47:13.676379+0000","last_became_active":"2023-10-14T18:47:13.675704+0000","last_became_peered":"2023-10-14T18:47:13.675704+0000","last_unstale":"2023-10-14T18:47:13.676379+0000","last_undegraded":"2023-10-14T18:47:13.676379+0000","last_fullsized":"2023-10-14T18:47:13.676379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.664918+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673613+0000","last_change":"2023-10-14T18:47:13.673613+0000","last_active":"2023-10-14T18:47:13.673613+0000","last_peered":"2023-10-14T18:47:13.673613+0000","last_clean":"2023-10-14T18:47:13.673613+0000","last_became_active":"2023-10-14T18:47:13.673392+0000","last_became_peered":"2023-10-14T18:47:13.673392+0000","last_unstale":"2023-10-14T18:47:13.673613+0000","last_undegraded":"2023-10-14T18:47:13.673613+0000","last_fullsized":"2023-10-14T18:47:13.673613+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:05.157312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672117+0000","last_change":"2023-10-14T18:47:13.672117+0000","last_active":"2023-10-14T18:47:13.672117+0000","last_peered":"2023-10-14T18:47:13.672117+0000","last_clean":"2023-10-14T18:47:13.672117+0000","last_became_active":"2023-10-14T18:47:13.670992+0000","last_became_peered":"2023-10-14T18:47:13.670992+0000","last_unstale":"2023-10-14T18:47:13.672117+0000","last_undegraded":"2023-10-14T18:47:13.672117+0000","last_fullsized":"2023-10-14T18:47:13.672117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:16.296747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666027+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670877+0000","last_change":"2023-10-14T18:47:13.670877+0000","last_active":"2023-10-14T18:47:13.670877+0000","last_peered":"2023-10-14T18:47:13.670877+0000","last_clean":"2023-10-14T18:47:13.670877+0000","last_became_active":"2023-10-14T18:47:13.670062+0000","last_became_peered":"2023-10-14T18:47:13.670062+0000","last_unstale":"2023-10-14T18:47:13.670877+0000","last_undegraded":"2023-10-14T18:47:13.670877+0000","last_fullsized":"2023-10-14T18:47:13.670877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:32.803430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670862+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:03.337393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671091+0000","last_change":"2023-10-14T18:47:13.671091+0000","last_active":"2023-10-14T18:47:13.671091+0000","last_peered":"2023-10-14T18:47:13.671091+0000","last_clean":"2023-10-14T18:47:13.671091+0000","last_became_active":"2023-10-14T18:47:13.669764+0000","last_became_peered":"2023-10-14T18:47:13.669764+0000","last_unstale":"2023-10-14T18:47:13.671091+0000","last_undegraded":"2023-10-14T18:47:13.671091+0000","last_fullsized":"2023-10-14T18:47:13.671091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:33.881152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665412+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676991+0000","last_change":"2023-10-14T18:47:13.676991+0000","last_active":"2023-10-14T18:47:13.676991+0000","last_peered":"2023-10-14T18:47:13.676991+0000","last_clean":"2023-10-14T18:47:13.676991+0000","last_became_active":"2023-10-14T18:47:13.676559+0000","last_became_peered":"2023-10-14T18:47:13.676559+0000","last_unstale":"2023-10-14T18:47:13.676991+0000","last_undegraded":"2023-10-14T18:47:13.676991+0000","last_fullsized":"2023-10-14T18:47:13.676991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:09.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669072+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.665940+0000","last_change":"2023-10-14T18:47:13.665940+0000","last_active":"2023-10-14T18:47:13.665940+0000","last_peered":"2023-10-14T18:47:13.665940+0000","last_clean":"2023-10-14T18:47:13.665940+0000","last_became_active":"2023-10-14T18:47:13.665381+0000","last_became_peered":"2023-10-14T18:47:13.665381+0000","last_unstale":"2023-10-14T18:47:13.665940+0000","last_undegraded":"2023-10-14T18:47:13.665940+0000","last_fullsized":"2023-10-14T18:47:13.665940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:29.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665847+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673936+0000","last_change":"2023-10-14T18:47:13.673936+0000","last_active":"2023-10-14T18:47:13.673936+0000","last_peered":"2023-10-14T18:47:13.673936+0000","last_clean":"2023-10-14T18:47:13.673936+0000","last_became_active":"2023-10-14T18:47:13.673715+0000","last_became_peered":"2023-10-14T18:47:13.673715+0000","last_unstale":"2023-10-14T18:47:13.673936+0000","last_undegraded":"2023-10-14T18:47:13.673936+0000","last_fullsized":"2023-10-14T18:47:13.673936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:02.332290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666997+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:06.555046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673972+0000","last_change":"2023-10-14T18:47:13.673972+0000","last_active":"2023-10-14T18:47:13.673972+0000","last_peered":"2023-10-14T18:47:13.673972+0000","last_clean":"2023-10-14T18:47:13.673972+0000","last_became_active":"2023-10-14T18:47:13.673741+0000","last_became_peered":"2023-10-14T18:47:13.673741+0000","last_unstale":"2023-10-14T18:47:13.673972+0000","last_undegraded":"2023-10-14T18:47:13.673972+0000","last_fullsized":"2023-10-14T18:47:13.673972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665007+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671263+0000","last_change":"2023-10-14T18:47:13.671263+0000","last_active":"2023-10-14T18:47:13.671263+0000","last_peered":"2023-10-14T18:47:13.671263+0000","last_clean":"2023-10-14T18:47:13.671263+0000","last_became_active":"2023-10-14T18:47:13.670844+0000","last_became_peered":"2023-10-14T18:47:13.670844+0000","last_unstale":"2023-10-14T18:47:13.671263+0000","last_undegraded":"2023-10-14T18:47:13.671263+0000","last_fullsized":"2023-10-14T18:47:13.671263+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:05.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665370+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670158+0000","last_change":"2023-10-14T18:47:13.670158+0000","last_active":"2023-10-14T18:47:13.670158+0000","last_peered":"2023-10-14T18:47:13.670158+0000","last_clean":"2023-10-14T18:47:13.670158+0000","last_became_active":"2023-10-14T18:47:13.669734+0000","last_became_peered":"2023-10-14T18:47:13.669734+0000","last_unstale":"2023-10-14T18:47:13.670158+0000","last_undegraded":"2023-10-14T18:47:13.670158+0000","last_fullsized":"2023-10-14T18:47:13.670158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:15.467750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671311+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.669664+0000","last_change":"2023-10-14T18:47:13.669664+0000","last_active":"2023-10-14T18:47:13.669664+0000","last_peered":"2023-10-14T18:47:13.669664+0000","last_clean":"2023-10-14T18:47:13.669664+0000","last_became_active":"2023-10-14T18:47:13.669445+0000","last_became_peered":"2023-10-14T18:47:13.669445+0000","last_unstale":"2023-10-14T18:47:13.669664+0000","last_undegraded":"2023-10-14T18:47:13.669664+0000","last_fullsized":"2023-10-14T18:47:13.669664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665444+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674946+0000","last_change":"2023-10-14T18:47:13.674946+0000","last_active":"2023-10-14T18:47:13.674946+0000","last_peered":"2023-10-14T18:47:13.674946+0000","last_clean":"2023-10-14T18:47:13.674946+0000","last_became_active":"2023-10-14T18:47:13.674266+0000","last_became_peered":"2023-10-14T18:47:13.674266+0000","last_unstale":"2023-10-14T18:47:13.674946+0000","last_undegraded":"2023-10-14T18:47:13.674946+0000","last_fullsized":"2023-10-14T18:47:13.674946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665622+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673226+0000","last_change":"2023-10-14T18:47:13.673226+0000","last_active":"2023-10-14T18:47:13.673226+0000","last_peered":"2023-10-14T18:47:13.673226+0000","last_clean":"2023-10-14T18:47:13.673226+0000","last_became_active":"2023-10-14T18:47:13.673009+0000","last_became_peered":"2023-10-14T18:47:13.673009+0000","last_unstale":"2023-10-14T18:47:13.673226+0000","last_undegraded":"2023-10-14T18:47:13.673226+0000","last_fullsized":"2023-10-14T18:47:13.673226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:18.790977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670887+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674003+0000","last_change":"2023-10-14T18:47:13.674003+0000","last_active":"2023-10-14T18:47:13.674003+0000","last_peered":"2023-10-14T18:47:13.674003+0000","last_clean":"2023-10-14T18:47:13.674003+0000","last_became_active":"2023-10-14T18:47:13.673498+0000","last_became_peered":"2023-10-14T18:47:13.673498+0000","last_unstale":"2023-10-14T18:47:13.674003+0000","last_undegraded":"2023-10-14T18:47:13.674003+0000","last_fullsized":"2023-10-14T18:47:13.674003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:36.421932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671999+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.667077+0000","last_change":"2023-10-14T18:47:13.667077+0000","last_active":"2023-10-14T18:47:13.667077+0000","last_peered":"2023-10-14T18:47:13.667077+0000","last_clean":"2023-10-14T18:47:13.667077+0000","last_became_active":"2023-10-14T18:47:13.666843+0000","last_became_peered":"2023-10-14T18:47:13.666843+0000","last_unstale":"2023-10-14T18:47:13.667077+0000","last_undegraded":"2023-10-14T18:47:13.667077+0000","last_fullsized":"2023-10-14T18:47:13.667077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:11.693401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674616+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673837+0000","last_change":"2023-10-14T18:47:13.673837+0000","last_active":"2023-10-14T18:47:13.673837+0000","last_peered":"2023-10-14T18:47:13.673837+0000","last_clean":"2023-10-14T18:47:13.673837+0000","last_became_active":"2023-10-14T18:47:13.672542+0000","last_became_peered":"2023-10-14T18:47:13.672542+0000","last_unstale":"2023-10-14T18:47:13.673837+0000","last_undegraded":"2023-10-14T18:47:13.673837+0000","last_fullsized":"2023-10-14T18:47:13.673837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:21.552032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668932+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.668077+0000","last_change":"2023-10-14T18:47:13.668077+0000","last_active":"2023-10-14T18:47:13.668077+0000","last_peered":"2023-10-14T18:47:13.668077+0000","last_clean":"2023-10-14T18:47:13.668077+0000","last_became_active":"2023-10-14T18:47:13.667849+0000","last_became_peered":"2023-10-14T18:47:13.667849+0000","last_unstale":"2023-10-14T18:47:13.668077+0000","last_undegraded":"2023-10-14T18:47:13.668077+0000","last_fullsized":"2023-10-14T18:47:13.668077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:32.176987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669755+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677720+0000","last_change":"2023-10-14T18:47:13.677720+0000","last_active":"2023-10-14T18:47:13.677720+0000","last_peered":"2023-10-14T18:47:13.677720+0000","last_clean":"2023-10-14T18:47:13.677720+0000","last_became_active":"2023-10-14T18:47:13.677414+0000","last_became_peered":"2023-10-14T18:47:13.677414+0000","last_unstale":"2023-10-14T18:47:13.677720+0000","last_undegraded":"2023-10-14T18:47:13.677720+0000","last_fullsized":"2023-10-14T18:47:13.677720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671176+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672788+0000","last_change":"2023-10-14T18:47:13.672788+0000","last_active":"2023-10-14T18:47:13.672788+0000","last_peered":"2023-10-14T18:47:13.672788+0000","last_clean":"2023-10-14T18:47:13.672788+0000","last_became_active":"2023-10-14T18:47:13.672541+0000","last_became_peered":"2023-10-14T18:47:13.672541+0000","last_unstale":"2023-10-14T18:47:13.672788+0000","last_undegraded":"2023-10-14T18:47:13.672788+0000","last_fullsized":"2023-10-14T18:47:13.672788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:35.991627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671916+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675914+0000","last_change":"2023-10-14T18:47:13.675914+0000","last_active":"2023-10-14T18:47:13.675914+0000","last_peered":"2023-10-14T18:47:13.675914+0000","last_clean":"2023-10-14T18:47:13.675914+0000","last_became_active":"2023-10-14T18:47:13.675698+0000","last_became_peered":"2023-10-14T18:47:13.675698+0000","last_unstale":"2023-10-14T18:47:13.675914+0000","last_undegraded":"2023-10-14T18:47:13.675914+0000","last_fullsized":"2023-10-14T18:47:13.675914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665026+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672325+0000","last_change":"2023-10-14T18:47:13.672325+0000","last_active":"2023-10-14T18:47:13.672325+0000","last_peered":"2023-10-14T18:47:13.672325+0000","last_clean":"2023-10-14T18:47:13.672325+0000","last_became_active":"2023-10-14T18:47:13.671853+0000","last_became_peered":"2023-10-14T18:47:13.671853+0000","last_unstale":"2023-10-14T18:47:13.672325+0000","last_undegraded":"2023-10-14T18:47:13.672325+0000","last_fullsized":"2023-10-14T18:47:13.672325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:59.573668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665227+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675741+0000","last_change":"2023-10-14T18:47:13.675741+0000","last_active":"2023-10-14T18:47:13.675741+0000","last_peered":"2023-10-14T18:47:13.675741+0000","last_clean":"2023-10-14T18:47:13.675741+0000","last_became_active":"2023-10-14T18:47:13.675512+0000","last_became_peered":"2023-10-14T18:47:13.675512+0000","last_unstale":"2023-10-14T18:47:13.675741+0000","last_undegraded":"2023-10-14T18:47:13.675741+0000","last_fullsized":"2023-10-14T18:47:13.675741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:11.998966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670255+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:11.270442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672746+0000","last_change":"2023-10-14T18:47:13.672746+0000","last_active":"2023-10-14T18:47:13.672746+0000","last_peered":"2023-10-14T18:47:13.672746+0000","last_clean":"2023-10-14T18:47:13.672746+0000","last_became_active":"2023-10-14T18:47:13.672525+0000","last_became_peered":"2023-10-14T18:47:13.672525+0000","last_unstale":"2023-10-14T18:47:13.672746+0000","last_undegraded":"2023-10-14T18:47:13.672746+0000","last_fullsized":"2023-10-14T18:47:13.672746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:35.663531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674811+0000","last_change":"2023-10-14T18:47:13.674811+0000","last_active":"2023-10-14T18:47:13.674811+0000","last_peered":"2023-10-14T18:47:13.674811+0000","last_clean":"2023-10-14T18:47:13.674811+0000","last_became_active":"2023-10-14T18:47:13.674555+0000","last_became_peered":"2023-10-14T18:47:13.674555+0000","last_unstale":"2023-10-14T18:47:13.674811+0000","last_undegraded":"2023-10-14T18:47:13.674811+0000","last_fullsized":"2023-10-14T18:47:13.674811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665086+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675697+0000","last_change":"2023-10-14T18:47:13.675697+0000","last_active":"2023-10-14T18:47:13.675697+0000","last_peered":"2023-10-14T18:47:13.675697+0000","last_clean":"2023-10-14T18:47:13.675697+0000","last_became_active":"2023-10-14T18:47:13.675477+0000","last_became_peered":"2023-10-14T18:47:13.675477+0000","last_unstale":"2023-10-14T18:47:13.675697+0000","last_undegraded":"2023-10-14T18:47:13.675697+0000","last_fullsized":"2023-10-14T18:47:13.675697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:32.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-14T18:47:12.664773+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:47:12.664773+0000","last_peered":"2023-10-14T18:47:12.664773+0000","last_clean":"2023-10-14T18:47:12.664773+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:47:12.664773+0000","last_undegraded":"2023-10-14T18:47:12.664773+0000","last_fullsized":"2023-10-14T18:47:12.664773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.84899999999999998,"15min":0.89900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":0.745},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.33200000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66000000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.753,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64000000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.32300000000000001,"15min":0.32700000000000001},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45300000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50800000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.309}]},{"osd":3,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.78500000000000003,"15min":0.85099999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":10.574,"15min":10.574},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.443,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.37}]},{"osd":4,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.91500000000000004,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.504},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":898,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194413,"statfs":{"total":200000000,"available":199079886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.315,"15min":0.317},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.501}]},{"osd":5,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56699999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.253},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.375,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69099999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.71099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56599999999999995}]}]}],"pool_statfs":[]}} 2023-10-14T18:47:19.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:47:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.255+0000 7f3251c63700 1 Processor -- start 2023-10-14T18:47:19.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 -- start start 2023-10-14T18:47:19.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f324c152020 0x7f324c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f324c1523f0 0x7f324c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c15b7f0 0x7f324c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c15c1d0 con 0x7f324c1523f0 2023-10-14T18:47:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c0cbb10 con 0x7f324c152020 2023-10-14T18:47:19.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.256+0000 7f3251c63700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0cbfa0 con 0x7f324c15b7f0 2023-10-14T18:47:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f324c1523f0 0x7f324c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f324c1523f0 0x7f324c06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33044/0 (socket says 172.21.15.79:33044) 2023-10-14T18:47:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 -- 172.21.15.79:0/2717856744 learned_addr learned my addr 172.21.15.79:0/2717856744 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324bfff700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c15b7f0 0x7f324c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324b7fe700 1 --2- 172.21.15.79:0/2717856744 >> v2:172.21.15.144:3300/0 conn(0x7f324c152020 0x7f324c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 -- 172.21.15.79:0/2717856744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c15b7f0 msgr2=0x7f324c15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c15b7f0 0x7f324c15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 -- 172.21.15.79:0/2717856744 >> v2:172.21.15.144:3300/0 conn(0x7f324c152020 msgr2=0x7f324c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 --2- 172.21.15.79:0/2717856744 >> v2:172.21.15.144:3300/0 conn(0x7f324c152020 0x7f324c0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 -- 172.21.15.79:0/2717856744 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0caca0 con 0x7f324c1523f0 2023-10-14T18:47:19.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324affd700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c1523f0 0x7f324c06c7f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f324c0cfc10 tx=0x7f3240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb686fdf3d7c0ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324a7fc700 1 -- 172.21.15.79:0/2717856744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000b640 con 0x7f324c1523f0 2023-10-14T18:47:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324a7fc700 1 -- 172.21.15.79:0/2717856744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324000b7a0 con 0x7f324c1523f0 2023-10-14T18:47:19.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.257+0000 7f324a7fc700 1 -- 172.21.15.79:0/2717856744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000bb60 con 0x7f324c1523f0 2023-10-14T18:47:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 -- 172.21.15.79:0/2717856744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c1523f0 msgr2=0x7f324c06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c1523f0 0x7f324c06c7f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f324c0cfc10 tx=0x7f3240009250 comp rx=0 tx=0).stop 2023-10-14T18:47:19.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 -- 172.21.15.79:0/2717856744 shutdown_connections 2023-10-14T18:47:19.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c15b7f0 0x7f324c15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 --2- 172.21.15.79:0/2717856744 >> v2:172.21.15.144:3300/0 conn(0x7f324c152020 0x7f324c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 --2- 172.21.15.79:0/2717856744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c1523f0 0x7f324c06c7f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 -- 172.21.15.79:0/2717856744 >> 172.21.15.79:0/2717856744 conn(0x7f324c069870 msgr2=0x7f324c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 -- 172.21.15.79:0/2717856744 shutdown_connections 2023-10-14T18:47:19.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.258+0000 7f3251c63700 1 -- 172.21.15.79:0/2717856744 wait complete. 2023-10-14T18:47:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.259+0000 7f3251c63700 1 Processor -- start 2023-10-14T18:47:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.259+0000 7f3251c63700 1 -- start start 2023-10-14T18:47:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324c152020 0x7f324c141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c1523f0 0x7f324c149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c83c0 con 0x7f324c15b7f0 2023-10-14T18:47:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c86a0 con 0x7f324c152020 2023-10-14T18:47:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f3251c63700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c0c8980 con 0x7f324c1523f0 2023-10-14T18:47:19.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33058/0 (socket says 172.21.15.79:33058) 2023-10-14T18:47:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 -- 172.21.15.79:0/1255443675 learned_addr learned my addr 172.21.15.79:0/1255443675 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324b7fe700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324c152020 0x7f324c141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324affd700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c1523f0 0x7f324c149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 -- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c1523f0 msgr2=0x7f324c149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c1523f0 0x7f324c149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 -- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324c152020 msgr2=0x7f324c141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324c152020 0x7f324c141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.260+0000 7f324bfff700 1 -- 172.21.15.79:0/1255443675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400094f0 con 0x7f324c15b7f0 2023-10-14T18:47:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f324bfff700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f324400e8d0 tx=0x7f32440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244013680 con 0x7f324c15b7f0 2023-10-14T18:47:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3244013800 con 0x7f324c15b7f0 2023-10-14T18:47:19.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c0b1980 con 0x7f324c15b7f0 2023-10-14T18:47:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244013bc0 con 0x7f324c15b7f0 2023-10-14T18:47:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.261+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c141bc0 con 0x7f324c15b7f0 2023-10-14T18:47:19.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.262+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c04c3c0 con 0x7f324c15b7f0 2023-10-14T18:47:19.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.262+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32440123d0 con 0x7f324c15b7f0 2023-10-14T18:47:19.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.262+0000 7f32337fe700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 0x7f32380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.263+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32440844d0 con 0x7f324c15b7f0 2023-10-14T18:47:19.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.263+0000 7f324b7fe700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 0x7f32380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.263+0000 7f324b7fe700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 0x7f32380693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f323c00f570 tx=0x7f323c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.267+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3244051740 con 0x7f324c15b7f0 2023-10-14T18:47:19.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.448+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f324c0c8810 con 0x7f3238066f30 2023-10-14T18:47:19.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.456+0000 7f32337fe700 1 -- 172.21.15.79:0/1255443675 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282282 (secure 0 0 0) 0x7f324c0c8810 con 0x7f3238066f30 2023-10-14T18:47:19.461 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 msgr2=0x7f32380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 0x7f32380693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f323c00f570 tx=0x7f323c00b040 comp rx=0 tx=0).stop 2023-10-14T18:47:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 msgr2=0x7f324c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f324400e8d0 tx=0x7f32440091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 shutdown_connections 2023-10-14T18:47:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3238066f30 0x7f32380693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f324c15b7f0 0x7f324c14a4e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324c152020 0x7f324c141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 --2- 172.21.15.79:0/1255443675 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f324c1523f0 0x7f324c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.459+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 >> 172.21.15.79:0/1255443675 conn(0x7f324c069870 msgr2=0x7f324c14c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.460+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 shutdown_connections 2023-10-14T18:47:19.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.460+0000 7f3251c63700 1 -- 172.21.15.79:0/1255443675 wait complete. 2023-10-14T18:47:19.469 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:47:19.473 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-14T18:47:18.363621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558788,"statfs":{"total":1600000000,"available":1596199239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699435"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670001+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:36.100956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668843+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.539759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666726+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671725+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.672315+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:18.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.675416+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670582+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666578+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666798+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:34.886255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671562+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670677+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:36.996729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670320+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667652+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667106+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670179+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674308+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666547+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666314+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673617+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:12.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665807+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666414+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666160+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665897+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668090+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671959+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:20.564718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669479+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674420+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670350+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:13:23.267395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665417+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667059+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669643+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:16.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673575+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673134+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675443+0000","last_change":"2023-10-14T18:47:13.675443+0000","last_active":"2023-10-14T18:47:13.675443+0000","last_peered":"2023-10-14T18:47:13.675443+0000","last_clean":"2023-10-14T18:47:13.675443+0000","last_became_active":"2023-10-14T18:47:13.675217+0000","last_became_peered":"2023-10-14T18:47:13.675217+0000","last_unstale":"2023-10-14T18:47:13.675443+0000","last_undegraded":"2023-10-14T18:47:13.675443+0000","last_fullsized":"2023-10-14T18:47:13.675443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670623+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:33.866557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670021+0000","last_change":"2023-10-14T18:47:13.670021+0000","last_active":"2023-10-14T18:47:13.670021+0000","last_peered":"2023-10-14T18:47:13.670021+0000","last_clean":"2023-10-14T18:47:13.670021+0000","last_became_active":"2023-10-14T18:47:13.669168+0000","last_became_peered":"2023-10-14T18:47:13.669168+0000","last_unstale":"2023-10-14T18:47:13.670021+0000","last_undegraded":"2023-10-14T18:47:13.670021+0000","last_fullsized":"2023-10-14T18:47:13.670021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:38.475719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671967+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675609+0000","last_change":"2023-10-14T18:47:13.675609+0000","last_active":"2023-10-14T18:47:13.675609+0000","last_peered":"2023-10-14T18:47:13.675609+0000","last_clean":"2023-10-14T18:47:13.675609+0000","last_became_active":"2023-10-14T18:47:13.675361+0000","last_became_peered":"2023-10-14T18:47:13.675361+0000","last_unstale":"2023-10-14T18:47:13.675609+0000","last_undegraded":"2023-10-14T18:47:13.675609+0000","last_fullsized":"2023-10-14T18:47:13.675609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674954+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675094+0000","last_change":"2023-10-14T18:47:13.675094+0000","last_active":"2023-10-14T18:47:13.675094+0000","last_peered":"2023-10-14T18:47:13.675094+0000","last_clean":"2023-10-14T18:47:13.675094+0000","last_became_active":"2023-10-14T18:47:13.674569+0000","last_became_peered":"2023-10-14T18:47:13.674569+0000","last_unstale":"2023-10-14T18:47:13.675094+0000","last_undegraded":"2023-10-14T18:47:13.675094+0000","last_fullsized":"2023-10-14T18:47:13.675094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665442+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672104+0000","last_change":"2023-10-14T18:47:13.672104+0000","last_active":"2023-10-14T18:47:13.672104+0000","last_peered":"2023-10-14T18:47:13.672104+0000","last_clean":"2023-10-14T18:47:13.672104+0000","last_became_active":"2023-10-14T18:47:13.671874+0000","last_became_peered":"2023-10-14T18:47:13.671874+0000","last_unstale":"2023-10-14T18:47:13.672104+0000","last_undegraded":"2023-10-14T18:47:13.672104+0000","last_fullsized":"2023-10-14T18:47:13.672104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:09.636514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665822+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677589+0000","last_change":"2023-10-14T18:47:13.677589+0000","last_active":"2023-10-14T18:47:13.677589+0000","last_peered":"2023-10-14T18:47:13.677589+0000","last_clean":"2023-10-14T18:47:13.677589+0000","last_became_active":"2023-10-14T18:47:13.677153+0000","last_became_peered":"2023-10-14T18:47:13.677153+0000","last_unstale":"2023-10-14T18:47:13.677589+0000","last_undegraded":"2023-10-14T18:47:13.677589+0000","last_fullsized":"2023-10-14T18:47:13.677589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668658+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676379+0000","last_change":"2023-10-14T18:47:13.676379+0000","last_active":"2023-10-14T18:47:13.676379+0000","last_peered":"2023-10-14T18:47:13.676379+0000","last_clean":"2023-10-14T18:47:13.676379+0000","last_became_active":"2023-10-14T18:47:13.675704+0000","last_became_peered":"2023-10-14T18:47:13.675704+0000","last_unstale":"2023-10-14T18:47:13.676379+0000","last_undegraded":"2023-10-14T18:47:13.676379+0000","last_fullsized":"2023-10-14T18:47:13.676379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.664918+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673613+0000","last_change":"2023-10-14T18:47:13.673613+0000","last_active":"2023-10-14T18:47:13.673613+0000","last_peered":"2023-10-14T18:47:13.673613+0000","last_clean":"2023-10-14T18:47:13.673613+0000","last_became_active":"2023-10-14T18:47:13.673392+0000","last_became_peered":"2023-10-14T18:47:13.673392+0000","last_unstale":"2023-10-14T18:47:13.673613+0000","last_undegraded":"2023-10-14T18:47:13.673613+0000","last_fullsized":"2023-10-14T18:47:13.673613+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:05.157312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672117+0000","last_change":"2023-10-14T18:47:13.672117+0000","last_active":"2023-10-14T18:47:13.672117+0000","last_peered":"2023-10-14T18:47:13.672117+0000","last_clean":"2023-10-14T18:47:13.672117+0000","last_became_active":"2023-10-14T18:47:13.670992+0000","last_became_peered":"2023-10-14T18:47:13.670992+0000","last_unstale":"2023-10-14T18:47:13.672117+0000","last_undegraded":"2023-10-14T18:47:13.672117+0000","last_fullsized":"2023-10-14T18:47:13.672117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:16.296747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666027+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670877+0000","last_change":"2023-10-14T18:47:13.670877+0000","last_active":"2023-10-14T18:47:13.670877+0000","last_peered":"2023-10-14T18:47:13.670877+0000","last_clean":"2023-10-14T18:47:13.670877+0000","last_became_active":"2023-10-14T18:47:13.670062+0000","last_became_peered":"2023-10-14T18:47:13.670062+0000","last_unstale":"2023-10-14T18:47:13.670877+0000","last_undegraded":"2023-10-14T18:47:13.670877+0000","last_fullsized":"2023-10-14T18:47:13.670877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:32.803430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670862+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:03.337393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671091+0000","last_change":"2023-10-14T18:47:13.671091+0000","last_active":"2023-10-14T18:47:13.671091+0000","last_peered":"2023-10-14T18:47:13.671091+0000","last_clean":"2023-10-14T18:47:13.671091+0000","last_became_active":"2023-10-14T18:47:13.669764+0000","last_became_peered":"2023-10-14T18:47:13.669764+0000","last_unstale":"2023-10-14T18:47:13.671091+0000","last_undegraded":"2023-10-14T18:47:13.671091+0000","last_fullsized":"2023-10-14T18:47:13.671091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:33.881152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665412+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676991+0000","last_change":"2023-10-14T18:47:13.676991+0000","last_active":"2023-10-14T18:47:13.676991+0000","last_peered":"2023-10-14T18:47:13.676991+0000","last_clean":"2023-10-14T18:47:13.676991+0000","last_became_active":"2023-10-14T18:47:13.676559+0000","last_became_peered":"2023-10-14T18:47:13.676559+0000","last_unstale":"2023-10-14T18:47:13.676991+0000","last_undegraded":"2023-10-14T18:47:13.676991+0000","last_fullsized":"2023-10-14T18:47:13.676991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:09.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669072+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.665940+0000","last_change":"2023-10-14T18:47:13.665940+0000","last_active":"2023-10-14T18:47:13.665940+0000","last_peered":"2023-10-14T18:47:13.665940+0000","last_clean":"2023-10-14T18:47:13.665940+0000","last_became_active":"2023-10-14T18:47:13.665381+0000","last_became_peered":"2023-10-14T18:47:13.665381+0000","last_unstale":"2023-10-14T18:47:13.665940+0000","last_undegraded":"2023-10-14T18:47:13.665940+0000","last_fullsized":"2023-10-14T18:47:13.665940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:29.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665847+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673936+0000","last_change":"2023-10-14T18:47:13.673936+0000","last_active":"2023-10-14T18:47:13.673936+0000","last_peered":"2023-10-14T18:47:13.673936+0000","last_clean":"2023-10-14T18:47:13.673936+0000","last_became_active":"2023-10-14T18:47:13.673715+0000","last_became_peered":"2023-10-14T18:47:13.673715+0000","last_unstale":"2023-10-14T18:47:13.673936+0000","last_undegraded":"2023-10-14T18:47:13.673936+0000","last_fullsized":"2023-10-14T18:47:13.673936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:02.332290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666997+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:06.555046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673972+0000","last_change":"2023-10-14T18:47:13.673972+0000","last_active":"2023-10-14T18:47:13.673972+0000","last_peered":"2023-10-14T18:47:13.673972+0000","last_clean":"2023-10-14T18:47:13.673972+0000","last_became_active":"2023-10-14T18:47:13.673741+0000","last_became_peered":"2023-10-14T18:47:13.673741+0000","last_unstale":"2023-10-14T18:47:13.673972+0000","last_undegraded":"2023-10-14T18:47:13.673972+0000","last_fullsized":"2023-10-14T18:47:13.673972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665007+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671263+0000","last_change":"2023-10-14T18:47:13.671263+0000","last_active":"2023-10-14T18:47:13.671263+0000","last_peered":"2023-10-14T18:47:13.671263+0000","last_clean":"2023-10-14T18:47:13.671263+0000","last_became_active":"2023-10-14T18:47:13.670844+0000","last_became_peered":"2023-10-14T18:47:13.670844+0000","last_unstale":"2023-10-14T18:47:13.671263+0000","last_undegraded":"2023-10-14T18:47:13.671263+0000","last_fullsized":"2023-10-14T18:47:13.671263+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:05.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665370+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670158+0000","last_change":"2023-10-14T18:47:13.670158+0000","last_active":"2023-10-14T18:47:13.670158+0000","last_peered":"2023-10-14T18:47:13.670158+0000","last_clean":"2023-10-14T18:47:13.670158+0000","last_became_active":"2023-10-14T18:47:13.669734+0000","last_became_peered":"2023-10-14T18:47:13.669734+0000","last_unstale":"2023-10-14T18:47:13.670158+0000","last_undegraded":"2023-10-14T18:47:13.670158+0000","last_fullsized":"2023-10-14T18:47:13.670158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:15.467750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671311+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.669664+0000","last_change":"2023-10-14T18:47:13.669664+0000","last_active":"2023-10-14T18:47:13.669664+0000","last_peered":"2023-10-14T18:47:13.669664+0000","last_clean":"2023-10-14T18:47:13.669664+0000","last_became_active":"2023-10-14T18:47:13.669445+0000","last_became_peered":"2023-10-14T18:47:13.669445+0000","last_unstale":"2023-10-14T18:47:13.669664+0000","last_undegraded":"2023-10-14T18:47:13.669664+0000","last_fullsized":"2023-10-14T18:47:13.669664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665444+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674946+0000","last_change":"2023-10-14T18:47:13.674946+0000","last_active":"2023-10-14T18:47:13.674946+0000","last_peered":"2023-10-14T18:47:13.674946+0000","last_clean":"2023-10-14T18:47:13.674946+0000","last_became_active":"2023-10-14T18:47:13.674266+0000","last_became_peered":"2023-10-14T18:47:13.674266+0000","last_unstale":"2023-10-14T18:47:13.674946+0000","last_undegraded":"2023-10-14T18:47:13.674946+0000","last_fullsized":"2023-10-14T18:47:13.674946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665622+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673226+0000","last_change":"2023-10-14T18:47:13.673226+0000","last_active":"2023-10-14T18:47:13.673226+0000","last_peered":"2023-10-14T18:47:13.673226+0000","last_clean":"2023-10-14T18:47:13.673226+0000","last_became_active":"2023-10-14T18:47:13.673009+0000","last_became_peered":"2023-10-14T18:47:13.673009+0000","last_unstale":"2023-10-14T18:47:13.673226+0000","last_undegraded":"2023-10-14T18:47:13.673226+0000","last_fullsized":"2023-10-14T18:47:13.673226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:18.790977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670887+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674003+0000","last_change":"2023-10-14T18:47:13.674003+0000","last_active":"2023-10-14T18:47:13.674003+0000","last_peered":"2023-10-14T18:47:13.674003+0000","last_clean":"2023-10-14T18:47:13.674003+0000","last_became_active":"2023-10-14T18:47:13.673498+0000","last_became_peered":"2023-10-14T18:47:13.673498+0000","last_unstale":"2023-10-14T18:47:13.674003+0000","last_undegraded":"2023-10-14T18:47:13.674003+0000","last_fullsized":"2023-10-14T18:47:13.674003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:36.421932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671999+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.667077+0000","last_change":"2023-10-14T18:47:13.667077+0000","last_active":"2023-10-14T18:47:13.667077+0000","last_peered":"2023-10-14T18:47:13.667077+0000","last_clean":"2023-10-14T18:47:13.667077+0000","last_became_active":"2023-10-14T18:47:13.666843+0000","last_became_peered":"2023-10-14T18:47:13.666843+0000","last_unstale":"2023-10-14T18:47:13.667077+0000","last_undegraded":"2023-10-14T18:47:13.667077+0000","last_fullsized":"2023-10-14T18:47:13.667077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:11.693401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674616+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673837+0000","last_change":"2023-10-14T18:47:13.673837+0000","last_active":"2023-10-14T18:47:13.673837+0000","last_peered":"2023-10-14T18:47:13.673837+0000","last_clean":"2023-10-14T18:47:13.673837+0000","last_became_active":"2023-10-14T18:47:13.672542+0000","last_became_peered":"2023-10-14T18:47:13.672542+0000","last_unstale":"2023-10-14T18:47:13.673837+0000","last_undegraded":"2023-10-14T18:47:13.673837+0000","last_fullsized":"2023-10-14T18:47:13.673837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:21.552032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668932+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.668077+0000","last_change":"2023-10-14T18:47:13.668077+0000","last_active":"2023-10-14T18:47:13.668077+0000","last_peered":"2023-10-14T18:47:13.668077+0000","last_clean":"2023-10-14T18:47:13.668077+0000","last_became_active":"2023-10-14T18:47:13.667849+0000","last_became_peered":"2023-10-14T18:47:13.667849+0000","last_unstale":"2023-10-14T18:47:13.668077+0000","last_undegraded":"2023-10-14T18:47:13.668077+0000","last_fullsized":"2023-10-14T18:47:13.668077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:32.176987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669755+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677720+0000","last_change":"2023-10-14T18:47:13.677720+0000","last_active":"2023-10-14T18:47:13.677720+0000","last_peered":"2023-10-14T18:47:13.677720+0000","last_clean":"2023-10-14T18:47:13.677720+0000","last_became_active":"2023-10-14T18:47:13.677414+0000","last_became_peered":"2023-10-14T18:47:13.677414+0000","last_unstale":"2023-10-14T18:47:13.677720+0000","last_undegraded":"2023-10-14T18:47:13.677720+0000","last_fullsized":"2023-10-14T18:47:13.677720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671176+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672788+0000","last_change":"2023-10-14T18:47:13.672788+0000","last_active":"2023-10-14T18:47:13.672788+0000","last_peered":"2023-10-14T18:47:13.672788+0000","last_clean":"2023-10-14T18:47:13.672788+0000","last_became_active":"2023-10-14T18:47:13.672541+0000","last_became_peered":"2023-10-14T18:47:13.672541+0000","last_unstale":"2023-10-14T18:47:13.672788+0000","last_undegraded":"2023-10-14T18:47:13.672788+0000","last_fullsized":"2023-10-14T18:47:13.672788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:35.991627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671916+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675914+0000","last_change":"2023-10-14T18:47:13.675914+0000","last_active":"2023-10-14T18:47:13.675914+0000","last_peered":"2023-10-14T18:47:13.675914+0000","last_clean":"2023-10-14T18:47:13.675914+0000","last_became_active":"2023-10-14T18:47:13.675698+0000","last_became_peered":"2023-10-14T18:47:13.675698+0000","last_unstale":"2023-10-14T18:47:13.675914+0000","last_undegraded":"2023-10-14T18:47:13.675914+0000","last_fullsized":"2023-10-14T18:47:13.675914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665026+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672325+0000","last_change":"2023-10-14T18:47:13.672325+0000","last_active":"2023-10-14T18:47:13.672325+0000","last_peered":"2023-10-14T18:47:13.672325+0000","last_clean":"2023-10-14T18:47:13.672325+0000","last_became_active":"2023-10-14T18:47:13.671853+0000","last_became_peered":"2023-10-14T18:47:13.671853+0000","last_unstale":"2023-10-14T18:47:13.672325+0000","last_undegraded":"2023-10-14T18:47:13.672325+0000","last_fullsized":"2023-10-14T18:47:13.672325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:59.573668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665227+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675741+0000","last_change":"2023-10-14T18:47:13.675741+0000","last_active":"2023-10-14T18:47:13.675741+0000","last_peered":"2023-10-14T18:47:13.675741+0000","last_clean":"2023-10-14T18:47:13.675741+0000","last_became_active":"2023-10-14T18:47:13.675512+0000","last_became_peered":"2023-10-14T18:47:13.675512+0000","last_unstale":"2023-10-14T18:47:13.675741+0000","last_undegraded":"2023-10-14T18:47:13.675741+0000","last_fullsized":"2023-10-14T18:47:13.675741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:11.998966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670255+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:11.270442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672746+0000","last_change":"2023-10-14T18:47:13.672746+0000","last_active":"2023-10-14T18:47:13.672746+0000","last_peered":"2023-10-14T18:47:13.672746+0000","last_clean":"2023-10-14T18:47:13.672746+0000","last_became_active":"2023-10-14T18:47:13.672525+0000","last_became_peered":"2023-10-14T18:47:13.672525+0000","last_unstale":"2023-10-14T18:47:13.672746+0000","last_undegraded":"2023-10-14T18:47:13.672746+0000","last_fullsized":"2023-10-14T18:47:13.672746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:35.663531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674811+0000","last_change":"2023-10-14T18:47:13.674811+0000","last_active":"2023-10-14T18:47:13.674811+0000","last_peered":"2023-10-14T18:47:13.674811+0000","last_clean":"2023-10-14T18:47:13.674811+0000","last_became_active":"2023-10-14T18:47:13.674555+0000","last_became_peered":"2023-10-14T18:47:13.674555+0000","last_unstale":"2023-10-14T18:47:13.674811+0000","last_undegraded":"2023-10-14T18:47:13.674811+0000","last_fullsized":"2023-10-14T18:47:13.674811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665086+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675697+0000","last_change":"2023-10-14T18:47:13.675697+0000","last_active":"2023-10-14T18:47:13.675697+0000","last_peered":"2023-10-14T18:47:13.675697+0000","last_clean":"2023-10-14T18:47:13.675697+0000","last_became_active":"2023-10-14T18:47:13.675477+0000","last_became_peered":"2023-10-14T18:47:13.675477+0000","last_unstale":"2023-10-14T18:47:13.675697+0000","last_undegraded":"2023-10-14T18:47:13.675697+0000","last_fullsized":"2023-10-14T18:47:13.675697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:32.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-14T18:47:12.664773+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:47:12.664773+0000","last_peered":"2023-10-14T18:47:12.664773+0000","last_clean":"2023-10-14T18:47:12.664773+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:47:12.664773+0000","last_undegraded":"2023-10-14T18:47:12.664773+0000","last_fullsized":"2023-10-14T18:47:12.664773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.84899999999999998,"15min":0.89900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":0.745},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.33200000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66000000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.753,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64000000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.32300000000000001,"15min":0.32700000000000001},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45300000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50800000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.309}]},{"osd":3,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.78500000000000003,"15min":0.85099999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":10.574,"15min":10.574},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.443,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.37}]},{"osd":4,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.91500000000000004,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.504},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":898,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194413,"statfs":{"total":200000000,"available":199079886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.315,"15min":0.317},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.501}]},{"osd":5,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56699999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.253},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.375,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69099999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.71099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56599999999999995}]}]}],"pool_statfs":[]}} 2023-10-14T18:47:19.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-14T18:47:19.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670001+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:22:36.100956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-14T18:47:19.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.668843+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:20:07.539759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-14T18:47:19.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666726+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-14T18:47:19.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671725+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-14T18:47:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.672315+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:56:18.142472+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-14T18:47:19.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.675416+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-14T18:47:19.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670582+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-14T18:47:19.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666578+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-14T18:47:19.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666798+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:52:34.886255+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-14T18:47:19.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671562+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-14T18:47:19.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670677+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:24:36.996729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-14T18:47:19.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670320+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-14T18:47:19.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.667652+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:47:19.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-14T18:47:19.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.667106+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-14T18:47:19.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670179+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-14T18:47:19.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.674308+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-14T18:47:19.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666547+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-14T18:47:19.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666314+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-14T18:47:19.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.673617+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:36:12.187048+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-14T18:47:19.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665807+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-14T18:47:19.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666414+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-14T18:47:19.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666160+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-14T18:47:19.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665897+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-14T18:47:19.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.668090+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:47:19.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-14T18:47:19.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671959+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:30:20.564718+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-14T18:47:19.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.669479+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-14T18:47:19.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.674420+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-14T18:47:19.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670350+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:13:23.267395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-14T18:47:19.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665417+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-14T18:47:19.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.667059+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-14T18:47:19.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.669643+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:26:16.704470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:47:19.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-14T18:47:19.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.673575+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-14T18:47:19.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.673134+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-14T18:47:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670623+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:04:33.866557+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-14T18:47:19.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671967+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-14T18:47:19.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.674954+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-14T18:47:19.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665442+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-14T18:47:19.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665822+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-14T18:47:19.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.668658+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:47:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-14T18:47:19.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.664918+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-14T18:47:19.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670116+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-14T18:47:19.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666027+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-14T18:47:19.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670862+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:11:03.337393+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-14T18:47:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665412+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-14T18:47:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.669072+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-14T18:47:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665847+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-14T18:47:19.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.666997+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:00:06.555046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:47:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-14T18:47:19.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665007+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-14T18:47:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665370+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-14T18:47:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671311+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-14T18:47:19.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665444+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-14T18:47:19.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665622+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-14T18:47:19.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670887+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-14T18:47:19.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671999+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-14T18:47:19.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.674616+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-14T18:47:19.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.668932+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-14T18:47:19.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.669755+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:47:19.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-14T18:47:19.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671176+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:20:40.826879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-14T18:47:19.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.671916+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:47:19.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-14T18:47:19.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665026+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-14T18:47:19.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665227+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:47:19.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-14T18:47:19.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.670255+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:00:11.270442+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:47:19.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-14T18:47:19.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665116+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-14T18:47:19.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:47:13.660645+0000', 'last_change': '2023-10-14T18:47:13.665086+0000', 'last_active': '2023-10-14T18:47:13.660645+0000', 'last_peered': '2023-10-14T18:47:13.660645+0000', 'last_clean': '2023-10-14T18:47:13.660645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:47:13.660645+0000', 'last_undegraded': '2023-10-14T18:47:13.660645+0000', 'last_fullsized': '2023-10-14T18:47:13.660645+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'last_clean_scrub_stamp': '2023-10-14T18:47:13.660645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:47:19.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T18:47:19.657 INFO:tasks.ceph.mds.c.smithi079.stderr:2023-10-14T18:47:19.656+0000 7fe6a3912700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:47:19.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.674+0000 7fb59e7a2700 1 Processor -- start 2023-10-14T18:47:19.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 -- start start 2023-10-14T18:47:19.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5980cd6e0 0x7fb5980cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 0x7fb59815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5980cb7c0 con 0x7fb5980cdab0 2023-10-14T18:47:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59815e850 con 0x7fb5980cd6e0 2023-10-14T18:47:19.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.675+0000 7fb59e7a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5980cd030 con 0x7fb59815cbd0 2023-10-14T18:47:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb5980cd6e0 0x7fb5980cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59cf9f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb5980cdab0 0x7fb59815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45154/0 (socket says 172.21.15.79:45154) 2023-10-14T18:47:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59cf9f700 1 -- 172.21.15.79:0/2970129539 learned_addr learned my addr 172.21.15.79:0/2970129539 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 -- 172.21.15.79:0/2970129539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 msgr2=0x7fb59815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:19.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59dfa1700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 0x7fb59815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 0x7fb59815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb58ffff700 1 -- 172.21.15.79:0/2970129539 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706190405 0 0) 0x7fb5980cb7c0 con 0x7fb5980cdab0 2023-10-14T18:47:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 -- 172.21.15.79:0/2970129539 >> v1:172.21.15.79:6789/0 conn(0x7fb5980cdab0 legacy=0x7fb59815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 -- 172.21.15.79:0/2970129539 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59815e290 con 0x7fb5980cd6e0 2023-10-14T18:47:19.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59dfa1700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 0x7fb59815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:47:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb59d7a0700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5980cd6e0 0x7fb5980cbc50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb594009e60 tx=0x7fb594009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4061e346b3c3dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb58ffff700 1 -- 172.21.15.79:0/2970129539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400e070 con 0x7fb5980cd6e0 2023-10-14T18:47:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb58ffff700 1 -- 172.21.15.79:0/2970129539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59400bc30 con 0x7fb5980cd6e0 2023-10-14T18:47:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.676+0000 7fb58ffff700 1 -- 172.21.15.79:0/2970129539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594012430 con 0x7fb5980cd6e0 2023-10-14T18:47:19.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 -- 172.21.15.79:0/2970129539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5980cd6e0 msgr2=0x7fb5980cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5980cd6e0 0x7fb5980cbc50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb594009e60 tx=0x7fb594009780 comp rx=0 tx=0).stop 2023-10-14T18:47:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 -- 172.21.15.79:0/2970129539 shutdown_connections 2023-10-14T18:47:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb59815cbd0 0x7fb59815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/2970129539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb5980cd6e0 0x7fb5980cbc50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 -- 172.21.15.79:0/2970129539 >> 172.21.15.79:0/2970129539 conn(0x7fb598067660 msgr2=0x7fb598067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 -- 172.21.15.79:0/2970129539 shutdown_connections 2023-10-14T18:47:19.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.677+0000 7fb59e7a2700 1 -- 172.21.15.79:0/2970129539 wait complete. 2023-10-14T18:47:19.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.678+0000 7fb59e7a2700 1 Processor -- start 2023-10-14T18:47:19.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.678+0000 7fb59e7a2700 1 -- start start 2023-10-14T18:47:19.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5980cd6e0 0x7fb59815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5980cdab0 0x7fb598155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815bab0 con 0x7fb59815cbd0 2023-10-14T18:47:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815b1c0 con 0x7fb5980cd6e0 2023-10-14T18:47:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59e7a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59815c480 con 0x7fb5980cdab0 2023-10-14T18:47:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33078/0 (socket says 172.21.15.79:33078) 2023-10-14T18:47:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 -- 172.21.15.79:0/3792176660 learned_addr learned my addr 172.21.15.79:0/3792176660 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59cf9f700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5980cdab0 0x7fb598155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59d7a0700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5980cd6e0 0x7fb59815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 -- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5980cdab0 msgr2=0x7fb598155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5980cdab0 0x7fb598155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 -- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5980cd6e0 msgr2=0x7fb59815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5980cd6e0 0x7fb59815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 -- 172.21.15.79:0/3792176660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594009a20 con 0x7fb59815cbd0 2023-10-14T18:47:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.679+0000 7fb59dfa1700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c850 tx=0x7fb590008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011600 con 0x7fb59815cbd0 2023-10-14T18:47:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb590011760 con 0x7fb59815cbd0 2023-10-14T18:47:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5981560c0 con 0x7fb59815cbd0 2023-10-14T18:47:19.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590011b20 con 0x7fb59815cbd0 2023-10-14T18:47:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59815b460 con 0x7fb59815cbd0 2023-10-14T18:47:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.680+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb598089280 con 0x7fb59815cbd0 2023-10-14T18:47:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.681+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb590018350 con 0x7fb59815cbd0 2023-10-14T18:47:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.681+0000 7fb58d7fa700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.681+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5900843a0 con 0x7fb59815cbd0 2023-10-14T18:47:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.682+0000 7fb59d7a0700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.682+0000 7fb59d7a0700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 0x7fb57c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb594009e60 tx=0x7fb594019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.685+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5900550a0 con 0x7fb59815cbd0 2023-10-14T18:47:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.943+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb59815e570 con 0x7fb59815cbd0 2023-10-14T18:47:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.944+0000 7fb58d7fa700 1 -- 172.21.15.79:0/3792176660 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1577 (secure 0 0 0) 0x7fb590054c30 con 0x7fb59815cbd0 2023-10-14T18:47:19.945 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:19.946 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":147,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1697309098,"num_in_osds":8,"osd_in_since":1697309095,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":3800761,"bytes_avail":1596199239,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5694}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-14T18:46:00.345748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T18:47:19.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 msgr2=0x7fb57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 0x7fb57c0693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb594009e60 tx=0x7fb594019000 comp rx=0 tx=0).stop 2023-10-14T18:47:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 msgr2=0x7fb5980afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb59000c850 tx=0x7fb590008040 comp rx=0 tx=0).stop 2023-10-14T18:47:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 shutdown_connections 2023-10-14T18:47:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb59815cbd0 0x7fb5980afde0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5980cd6e0 0x7fb59815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 --2- 172.21.15.79:0/3792176660 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb5980cdab0 0x7fb598155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 >> 172.21.15.79:0/3792176660 conn(0x7fb598067660 msgr2=0x7fb5980d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 shutdown_connections 2023-10-14T18:47:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:19.946+0000 7fb59e7a2700 1 -- 172.21.15.79:0/3792176660 wait complete. 2023-10-14T18:47:19.959 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T18:47:19.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:47:20.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.074+0000 7fe3bfd7a700 1 Processor -- start 2023-10-14T18:47:20.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.074+0000 7fe3bfd7a700 1 -- start start 2023-10-14T18:47:20.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bfd7a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3b8157870 0x7fe3b815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bfd7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 0x7fe3b815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bfd7a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b815cbb0 con 0x7fe3b815d580 2023-10-14T18:47:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bfd7a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b815bfa0 con 0x7fe3b8157870 2023-10-14T18:47:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bfd7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b815c280 con 0x7fe3b815a620 2023-10-14T18:47:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3be317700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3b815d580 0x7fe3b8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45164/0 (socket says 172.21.15.79:45164) 2023-10-14T18:47:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3be317700 1 -- 172.21.15.79:0/2046350971 learned_addr learned my addr 172.21.15.79:0/2046350971 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bd315700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 0x7fe3b815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2046350971 >> v2:172.21.15.144:3300/0 conn(0x7fe3b8157870 0x7fe3b815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bcb14700 1 -- 172.21.15.79:0/2046350971 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411731558 0 0) 0x7fe3b815cbb0 con 0x7fe3b815d580 2023-10-14T18:47:20.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bcb14700 1 -- 172.21.15.79:0/2046350971 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a4003570 con 0x7fe3b815d580 2023-10-14T18:47:20.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bdb16700 1 -- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 msgr2=0x7fe3b815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:20.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 0x7fe3b815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bdb16700 1 -- 172.21.15.79:0/2046350971 >> v1:172.21.15.79:6789/0 conn(0x7fe3b815d580 legacy=0x7fe3b8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bdb16700 1 -- 172.21.15.79:0/2046350971 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b815c560 con 0x7fe3b8157870 2023-10-14T18:47:20.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.075+0000 7fe3bd315700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 0x7fe3b815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b8157870 0x7fe3b815b6a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009e60 tx=0x7fe3b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3080b779e3192c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bcb14700 1 -- 172.21.15.79:0/2046350971 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400e070 con 0x7fe3b8157870 2023-10-14T18:47:20.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bcb14700 1 -- 172.21.15.79:0/2046350971 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400bab0 con 0x7fe3b8157870 2023-10-14T18:47:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bcb14700 1 -- 172.21.15.79:0/2046350971 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400be30 con 0x7fe3b8157870 2023-10-14T18:47:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b8157870 msgr2=0x7fe3b815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b8157870 0x7fe3b815b6a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009e60 tx=0x7fe3b4009780 comp rx=0 tx=0).stop 2023-10-14T18:47:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2046350971 shutdown_connections 2023-10-14T18:47:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b8157870 0x7fe3b815b6a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2046350971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b815a620 0x7fe3b815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2046350971 >> 172.21.15.79:0/2046350971 conn(0x7fe3b8068ce0 msgr2=0x7fe3b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:20.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2046350971 shutdown_connections 2023-10-14T18:47:20.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.076+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2046350971 wait complete. 2023-10-14T18:47:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.077+0000 7fe3bfd7a700 1 Processor -- start 2023-10-14T18:47:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.077+0000 7fe3bfd7a700 1 -- start start 2023-10-14T18:47:20.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b8157870 0x7fe3b80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 0x7fe3b814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b816b6c0 con 0x7fe3b815a620 2023-10-14T18:47:20.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80d0200 con 0x7fe3b815d580 2023-10-14T18:47:20.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bfd7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b816aab0 con 0x7fe3b8157870 2023-10-14T18:47:20.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bd315700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bd315700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33092/0 (socket says 172.21.15.79:33092) 2023-10-14T18:47:20.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bd315700 1 -- 172.21.15.79:0/2647723143 learned_addr learned my addr 172.21.15.79:0/2647723143 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:20.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b8157870 0x7fe3b80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.078+0000 7fe3be317700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 0x7fe3b814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 -- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b8157870 msgr2=0x7fe3b80b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b8157870 0x7fe3b80b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 -- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 msgr2=0x7fe3b814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 0x7fe3b814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 -- 172.21.15.79:0/2647723143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8009420 con 0x7fe3b815a620 2023-10-14T18:47:20.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3be317700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 0x7fe3b814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bd315700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800ec80 tx=0x7fe3a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800c920 con 0x7fe3b815a620 2023-10-14T18:47:20.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800ca80 con 0x7fe3b815a620 2023-10-14T18:47:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b4009a20 con 0x7fe3b815a620 2023-10-14T18:47:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a800ce20 con 0x7fe3b815a620 2023-10-14T18:47:20.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.079+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b816b070 con 0x7fe3b815a620 2023-10-14T18:47:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.080+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b814cf70 con 0x7fe3b815a620 2023-10-14T18:47:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.080+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3a8013680 con 0x7fe3b815a620 2023-10-14T18:47:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.081+0000 7fe3adffb700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:20.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.081+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3a8084940 con 0x7fe3b815a620 2023-10-14T18:47:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.081+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:20.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.081+0000 7fe3bdb16700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097c0 tx=0x7fe3b4019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:20.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.085+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b814cf70 con 0x7fe3b815a620 2023-10-14T18:47:20.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.262+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3b814cf70 con 0x7fe39c066f30 2023-10-14T18:47:20.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.271+0000 7fe3adffb700 1 -- 172.21.15.79:0/2647723143 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282282 (secure 0 0 0) 0x7fe3b814cf70 con 0x7fe39c066f30 2023-10-14T18:47:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 msgr2=0x7fe39c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 0x7fe39c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097c0 tx=0x7fe3b4019000 comp rx=0 tx=0).stop 2023-10-14T18:47:20.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 msgr2=0x7fe3b80cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800ec80 tx=0x7fe3a80091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 shutdown_connections 2023-10-14T18:47:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe39c066f30 0x7fe39c0693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3b815d580 0x7fe3b814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3b8157870 0x7fe3b80b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 --2- 172.21.15.79:0/2647723143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3b815a620 0x7fe3b80cfcc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 >> 172.21.15.79:0/2647723143 conn(0x7fe3b8068ce0 msgr2=0x7fe3b814f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:20.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 shutdown_connections 2023-10-14T18:47:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:20.274+0000 7fe3bfd7a700 1 -- 172.21.15.79:0/2647723143 wait complete. 2023-10-14T18:47:20.282 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:47:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-14T18:47:18.363621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558788,"statfs":{"total":1600000000,"available":1596199239,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699435"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670001+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:22:36.100956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668843+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:20:07.539759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666726+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671725+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.672315+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:18.142472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.675416+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670582+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666578+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666798+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:34.886255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671562+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670677+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:36.996729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670320+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667652+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:03.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667106+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670179+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674308+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666547+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666314+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673617+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:12.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665807+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666414+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666160+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665897+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668090+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671959+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:20.564718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669479+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674420+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670350+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:13:23.267395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665417+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.667059+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669643+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:16.704470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673575+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.673134+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675443+0000","last_change":"2023-10-14T18:47:13.675443+0000","last_active":"2023-10-14T18:47:13.675443+0000","last_peered":"2023-10-14T18:47:13.675443+0000","last_clean":"2023-10-14T18:47:13.675443+0000","last_became_active":"2023-10-14T18:47:13.675217+0000","last_became_peered":"2023-10-14T18:47:13.675217+0000","last_unstale":"2023-10-14T18:47:13.675443+0000","last_undegraded":"2023-10-14T18:47:13.675443+0000","last_fullsized":"2023-10-14T18:47:13.675443+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670623+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:33.866557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670021+0000","last_change":"2023-10-14T18:47:13.670021+0000","last_active":"2023-10-14T18:47:13.670021+0000","last_peered":"2023-10-14T18:47:13.670021+0000","last_clean":"2023-10-14T18:47:13.670021+0000","last_became_active":"2023-10-14T18:47:13.669168+0000","last_became_peered":"2023-10-14T18:47:13.669168+0000","last_unstale":"2023-10-14T18:47:13.670021+0000","last_undegraded":"2023-10-14T18:47:13.670021+0000","last_fullsized":"2023-10-14T18:47:13.670021+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:38.475719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671967+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675609+0000","last_change":"2023-10-14T18:47:13.675609+0000","last_active":"2023-10-14T18:47:13.675609+0000","last_peered":"2023-10-14T18:47:13.675609+0000","last_clean":"2023-10-14T18:47:13.675609+0000","last_became_active":"2023-10-14T18:47:13.675361+0000","last_became_peered":"2023-10-14T18:47:13.675361+0000","last_unstale":"2023-10-14T18:47:13.675609+0000","last_undegraded":"2023-10-14T18:47:13.675609+0000","last_fullsized":"2023-10-14T18:47:13.675609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674954+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675094+0000","last_change":"2023-10-14T18:47:13.675094+0000","last_active":"2023-10-14T18:47:13.675094+0000","last_peered":"2023-10-14T18:47:13.675094+0000","last_clean":"2023-10-14T18:47:13.675094+0000","last_became_active":"2023-10-14T18:47:13.674569+0000","last_became_peered":"2023-10-14T18:47:13.674569+0000","last_unstale":"2023-10-14T18:47:13.675094+0000","last_undegraded":"2023-10-14T18:47:13.675094+0000","last_fullsized":"2023-10-14T18:47:13.675094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665442+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672104+0000","last_change":"2023-10-14T18:47:13.672104+0000","last_active":"2023-10-14T18:47:13.672104+0000","last_peered":"2023-10-14T18:47:13.672104+0000","last_clean":"2023-10-14T18:47:13.672104+0000","last_became_active":"2023-10-14T18:47:13.671874+0000","last_became_peered":"2023-10-14T18:47:13.671874+0000","last_unstale":"2023-10-14T18:47:13.672104+0000","last_undegraded":"2023-10-14T18:47:13.672104+0000","last_fullsized":"2023-10-14T18:47:13.672104+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:09.636514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665822+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677589+0000","last_change":"2023-10-14T18:47:13.677589+0000","last_active":"2023-10-14T18:47:13.677589+0000","last_peered":"2023-10-14T18:47:13.677589+0000","last_clean":"2023-10-14T18:47:13.677589+0000","last_became_active":"2023-10-14T18:47:13.677153+0000","last_became_peered":"2023-10-14T18:47:13.677153+0000","last_unstale":"2023-10-14T18:47:13.677589+0000","last_undegraded":"2023-10-14T18:47:13.677589+0000","last_fullsized":"2023-10-14T18:47:13.677589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668658+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676379+0000","last_change":"2023-10-14T18:47:13.676379+0000","last_active":"2023-10-14T18:47:13.676379+0000","last_peered":"2023-10-14T18:47:13.676379+0000","last_clean":"2023-10-14T18:47:13.676379+0000","last_became_active":"2023-10-14T18:47:13.675704+0000","last_became_peered":"2023-10-14T18:47:13.675704+0000","last_unstale":"2023-10-14T18:47:13.676379+0000","last_undegraded":"2023-10-14T18:47:13.676379+0000","last_fullsized":"2023-10-14T18:47:13.676379+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.664918+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673613+0000","last_change":"2023-10-14T18:47:13.673613+0000","last_active":"2023-10-14T18:47:13.673613+0000","last_peered":"2023-10-14T18:47:13.673613+0000","last_clean":"2023-10-14T18:47:13.673613+0000","last_became_active":"2023-10-14T18:47:13.673392+0000","last_became_peered":"2023-10-14T18:47:13.673392+0000","last_unstale":"2023-10-14T18:47:13.673613+0000","last_undegraded":"2023-10-14T18:47:13.673613+0000","last_fullsized":"2023-10-14T18:47:13.673613+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:05.157312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672117+0000","last_change":"2023-10-14T18:47:13.672117+0000","last_active":"2023-10-14T18:47:13.672117+0000","last_peered":"2023-10-14T18:47:13.672117+0000","last_clean":"2023-10-14T18:47:13.672117+0000","last_became_active":"2023-10-14T18:47:13.670992+0000","last_became_peered":"2023-10-14T18:47:13.670992+0000","last_unstale":"2023-10-14T18:47:13.672117+0000","last_undegraded":"2023-10-14T18:47:13.672117+0000","last_fullsized":"2023-10-14T18:47:13.672117+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:16.296747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666027+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670877+0000","last_change":"2023-10-14T18:47:13.670877+0000","last_active":"2023-10-14T18:47:13.670877+0000","last_peered":"2023-10-14T18:47:13.670877+0000","last_clean":"2023-10-14T18:47:13.670877+0000","last_became_active":"2023-10-14T18:47:13.670062+0000","last_became_peered":"2023-10-14T18:47:13.670062+0000","last_unstale":"2023-10-14T18:47:13.670877+0000","last_undegraded":"2023-10-14T18:47:13.670877+0000","last_fullsized":"2023-10-14T18:47:13.670877+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:32.803430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670862+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:03.337393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671091+0000","last_change":"2023-10-14T18:47:13.671091+0000","last_active":"2023-10-14T18:47:13.671091+0000","last_peered":"2023-10-14T18:47:13.671091+0000","last_clean":"2023-10-14T18:47:13.671091+0000","last_became_active":"2023-10-14T18:47:13.669764+0000","last_became_peered":"2023-10-14T18:47:13.669764+0000","last_unstale":"2023-10-14T18:47:13.671091+0000","last_undegraded":"2023-10-14T18:47:13.671091+0000","last_fullsized":"2023-10-14T18:47:13.671091+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:33.881152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665412+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:59.417901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.676991+0000","last_change":"2023-10-14T18:47:13.676991+0000","last_active":"2023-10-14T18:47:13.676991+0000","last_peered":"2023-10-14T18:47:13.676991+0000","last_clean":"2023-10-14T18:47:13.676991+0000","last_became_active":"2023-10-14T18:47:13.676559+0000","last_became_peered":"2023-10-14T18:47:13.676559+0000","last_unstale":"2023-10-14T18:47:13.676991+0000","last_undegraded":"2023-10-14T18:47:13.676991+0000","last_fullsized":"2023-10-14T18:47:13.676991+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:09.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669072+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:33.808532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.665940+0000","last_change":"2023-10-14T18:47:13.665940+0000","last_active":"2023-10-14T18:47:13.665940+0000","last_peered":"2023-10-14T18:47:13.665940+0000","last_clean":"2023-10-14T18:47:13.665940+0000","last_became_active":"2023-10-14T18:47:13.665381+0000","last_became_peered":"2023-10-14T18:47:13.665381+0000","last_unstale":"2023-10-14T18:47:13.665940+0000","last_undegraded":"2023-10-14T18:47:13.665940+0000","last_fullsized":"2023-10-14T18:47:13.665940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:29.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665847+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673936+0000","last_change":"2023-10-14T18:47:13.673936+0000","last_active":"2023-10-14T18:47:13.673936+0000","last_peered":"2023-10-14T18:47:13.673936+0000","last_clean":"2023-10-14T18:47:13.673936+0000","last_became_active":"2023-10-14T18:47:13.673715+0000","last_became_peered":"2023-10-14T18:47:13.673715+0000","last_unstale":"2023-10-14T18:47:13.673936+0000","last_undegraded":"2023-10-14T18:47:13.673936+0000","last_fullsized":"2023-10-14T18:47:13.673936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:02.332290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.666997+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:06.555046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673972+0000","last_change":"2023-10-14T18:47:13.673972+0000","last_active":"2023-10-14T18:47:13.673972+0000","last_peered":"2023-10-14T18:47:13.673972+0000","last_clean":"2023-10-14T18:47:13.673972+0000","last_became_active":"2023-10-14T18:47:13.673741+0000","last_became_peered":"2023-10-14T18:47:13.673741+0000","last_unstale":"2023-10-14T18:47:13.673972+0000","last_undegraded":"2023-10-14T18:47:13.673972+0000","last_fullsized":"2023-10-14T18:47:13.673972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665007+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:39.561727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.671263+0000","last_change":"2023-10-14T18:47:13.671263+0000","last_active":"2023-10-14T18:47:13.671263+0000","last_peered":"2023-10-14T18:47:13.671263+0000","last_clean":"2023-10-14T18:47:13.671263+0000","last_became_active":"2023-10-14T18:47:13.670844+0000","last_became_peered":"2023-10-14T18:47:13.670844+0000","last_unstale":"2023-10-14T18:47:13.671263+0000","last_undegraded":"2023-10-14T18:47:13.671263+0000","last_fullsized":"2023-10-14T18:47:13.671263+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:05.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665370+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.670158+0000","last_change":"2023-10-14T18:47:13.670158+0000","last_active":"2023-10-14T18:47:13.670158+0000","last_peered":"2023-10-14T18:47:13.670158+0000","last_clean":"2023-10-14T18:47:13.670158+0000","last_became_active":"2023-10-14T18:47:13.669734+0000","last_became_peered":"2023-10-14T18:47:13.669734+0000","last_unstale":"2023-10-14T18:47:13.670158+0000","last_undegraded":"2023-10-14T18:47:13.670158+0000","last_fullsized":"2023-10-14T18:47:13.670158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:15.467750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671311+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.669664+0000","last_change":"2023-10-14T18:47:13.669664+0000","last_active":"2023-10-14T18:47:13.669664+0000","last_peered":"2023-10-14T18:47:13.669664+0000","last_clean":"2023-10-14T18:47:13.669664+0000","last_became_active":"2023-10-14T18:47:13.669445+0000","last_became_peered":"2023-10-14T18:47:13.669445+0000","last_unstale":"2023-10-14T18:47:13.669664+0000","last_undegraded":"2023-10-14T18:47:13.669664+0000","last_fullsized":"2023-10-14T18:47:13.669664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665444+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674946+0000","last_change":"2023-10-14T18:47:13.674946+0000","last_active":"2023-10-14T18:47:13.674946+0000","last_peered":"2023-10-14T18:47:13.674946+0000","last_clean":"2023-10-14T18:47:13.674946+0000","last_became_active":"2023-10-14T18:47:13.674266+0000","last_became_peered":"2023-10-14T18:47:13.674266+0000","last_unstale":"2023-10-14T18:47:13.674946+0000","last_undegraded":"2023-10-14T18:47:13.674946+0000","last_fullsized":"2023-10-14T18:47:13.674946+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665622+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:54.643693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673226+0000","last_change":"2023-10-14T18:47:13.673226+0000","last_active":"2023-10-14T18:47:13.673226+0000","last_peered":"2023-10-14T18:47:13.673226+0000","last_clean":"2023-10-14T18:47:13.673226+0000","last_became_active":"2023-10-14T18:47:13.673009+0000","last_became_peered":"2023-10-14T18:47:13.673009+0000","last_unstale":"2023-10-14T18:47:13.673226+0000","last_undegraded":"2023-10-14T18:47:13.673226+0000","last_fullsized":"2023-10-14T18:47:13.673226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:18.790977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670887+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674003+0000","last_change":"2023-10-14T18:47:13.674003+0000","last_active":"2023-10-14T18:47:13.674003+0000","last_peered":"2023-10-14T18:47:13.674003+0000","last_clean":"2023-10-14T18:47:13.674003+0000","last_became_active":"2023-10-14T18:47:13.673498+0000","last_became_peered":"2023-10-14T18:47:13.673498+0000","last_unstale":"2023-10-14T18:47:13.674003+0000","last_undegraded":"2023-10-14T18:47:13.674003+0000","last_fullsized":"2023-10-14T18:47:13.674003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:36.421932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671999+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:39.480821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.667077+0000","last_change":"2023-10-14T18:47:13.667077+0000","last_active":"2023-10-14T18:47:13.667077+0000","last_peered":"2023-10-14T18:47:13.667077+0000","last_clean":"2023-10-14T18:47:13.667077+0000","last_became_active":"2023-10-14T18:47:13.666843+0000","last_became_peered":"2023-10-14T18:47:13.666843+0000","last_unstale":"2023-10-14T18:47:13.667077+0000","last_undegraded":"2023-10-14T18:47:13.667077+0000","last_fullsized":"2023-10-14T18:47:13.667077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:11.693401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.674616+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.673837+0000","last_change":"2023-10-14T18:47:13.673837+0000","last_active":"2023-10-14T18:47:13.673837+0000","last_peered":"2023-10-14T18:47:13.673837+0000","last_clean":"2023-10-14T18:47:13.673837+0000","last_became_active":"2023-10-14T18:47:13.672542+0000","last_became_peered":"2023-10-14T18:47:13.672542+0000","last_unstale":"2023-10-14T18:47:13.673837+0000","last_undegraded":"2023-10-14T18:47:13.673837+0000","last_fullsized":"2023-10-14T18:47:13.673837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:21.552032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.668932+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.668077+0000","last_change":"2023-10-14T18:47:13.668077+0000","last_active":"2023-10-14T18:47:13.668077+0000","last_peered":"2023-10-14T18:47:13.668077+0000","last_clean":"2023-10-14T18:47:13.668077+0000","last_became_active":"2023-10-14T18:47:13.667849+0000","last_became_peered":"2023-10-14T18:47:13.667849+0000","last_unstale":"2023-10-14T18:47:13.668077+0000","last_undegraded":"2023-10-14T18:47:13.668077+0000","last_fullsized":"2023-10-14T18:47:13.668077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:32.176987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.669755+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.677720+0000","last_change":"2023-10-14T18:47:13.677720+0000","last_active":"2023-10-14T18:47:13.677720+0000","last_peered":"2023-10-14T18:47:13.677720+0000","last_clean":"2023-10-14T18:47:13.677720+0000","last_became_active":"2023-10-14T18:47:13.677414+0000","last_became_peered":"2023-10-14T18:47:13.677414+0000","last_unstale":"2023-10-14T18:47:13.677720+0000","last_undegraded":"2023-10-14T18:47:13.677720+0000","last_fullsized":"2023-10-14T18:47:13.677720+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671176+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:40.826879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672788+0000","last_change":"2023-10-14T18:47:13.672788+0000","last_active":"2023-10-14T18:47:13.672788+0000","last_peered":"2023-10-14T18:47:13.672788+0000","last_clean":"2023-10-14T18:47:13.672788+0000","last_became_active":"2023-10-14T18:47:13.672541+0000","last_became_peered":"2023-10-14T18:47:13.672541+0000","last_unstale":"2023-10-14T18:47:13.672788+0000","last_undegraded":"2023-10-14T18:47:13.672788+0000","last_fullsized":"2023-10-14T18:47:13.672788+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:35.991627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.671916+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675914+0000","last_change":"2023-10-14T18:47:13.675914+0000","last_active":"2023-10-14T18:47:13.675914+0000","last_peered":"2023-10-14T18:47:13.675914+0000","last_clean":"2023-10-14T18:47:13.675914+0000","last_became_active":"2023-10-14T18:47:13.675698+0000","last_became_peered":"2023-10-14T18:47:13.675698+0000","last_unstale":"2023-10-14T18:47:13.675914+0000","last_undegraded":"2023-10-14T18:47:13.675914+0000","last_fullsized":"2023-10-14T18:47:13.675914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665026+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672325+0000","last_change":"2023-10-14T18:47:13.672325+0000","last_active":"2023-10-14T18:47:13.672325+0000","last_peered":"2023-10-14T18:47:13.672325+0000","last_clean":"2023-10-14T18:47:13.672325+0000","last_became_active":"2023-10-14T18:47:13.671853+0000","last_became_peered":"2023-10-14T18:47:13.671853+0000","last_unstale":"2023-10-14T18:47:13.672325+0000","last_undegraded":"2023-10-14T18:47:13.672325+0000","last_fullsized":"2023-10-14T18:47:13.672325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:59.573668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665227+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:19.796079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675741+0000","last_change":"2023-10-14T18:47:13.675741+0000","last_active":"2023-10-14T18:47:13.675741+0000","last_peered":"2023-10-14T18:47:13.675741+0000","last_clean":"2023-10-14T18:47:13.675741+0000","last_became_active":"2023-10-14T18:47:13.675512+0000","last_became_peered":"2023-10-14T18:47:13.675512+0000","last_unstale":"2023-10-14T18:47:13.675741+0000","last_undegraded":"2023-10-14T18:47:13.675741+0000","last_fullsized":"2023-10-14T18:47:13.675741+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:11.998966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.670255+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:11.270442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.672746+0000","last_change":"2023-10-14T18:47:13.672746+0000","last_active":"2023-10-14T18:47:13.672746+0000","last_peered":"2023-10-14T18:47:13.672746+0000","last_clean":"2023-10-14T18:47:13.672746+0000","last_became_active":"2023-10-14T18:47:13.672525+0000","last_became_peered":"2023-10-14T18:47:13.672525+0000","last_unstale":"2023-10-14T18:47:13.672746+0000","last_undegraded":"2023-10-14T18:47:13.672746+0000","last_fullsized":"2023-10-14T18:47:13.672746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:35.663531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665116+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.674811+0000","last_change":"2023-10-14T18:47:13.674811+0000","last_active":"2023-10-14T18:47:13.674811+0000","last_peered":"2023-10-14T18:47:13.674811+0000","last_clean":"2023-10-14T18:47:13.674811+0000","last_became_active":"2023-10-14T18:47:13.674555+0000","last_became_peered":"2023-10-14T18:47:13.674555+0000","last_unstale":"2023-10-14T18:47:13.674811+0000","last_undegraded":"2023-10-14T18:47:13.674811+0000","last_fullsized":"2023-10-14T18:47:13.674811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:47:13.660645+0000","last_change":"2023-10-14T18:47:13.665086+0000","last_active":"2023-10-14T18:47:13.660645+0000","last_peered":"2023-10-14T18:47:13.660645+0000","last_clean":"2023-10-14T18:47:13.660645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:47:13.660645+0000","last_undegraded":"2023-10-14T18:47:13.660645+0000","last_fullsized":"2023-10-14T18:47:13.660645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-10-14T18:47:13.675697+0000","last_change":"2023-10-14T18:47:13.675697+0000","last_active":"2023-10-14T18:47:13.675697+0000","last_peered":"2023-10-14T18:47:13.675697+0000","last_clean":"2023-10-14T18:47:13.675697+0000","last_became_active":"2023-10-14T18:47:13.675477+0000","last_became_peered":"2023-10-14T18:47:13.675477+0000","last_unstale":"2023-10-14T18:47:13.675697+0000","last_undegraded":"2023-10-14T18:47:13.675697+0000","last_fullsized":"2023-10-14T18:47:13.675697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:32.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":208,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-14T18:47:12.664773+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:47:12.664773+0000","last_peered":"2023-10-14T18:47:12.664773+0000","last_clean":"2023-10-14T18:47:12.664773+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:47:12.664773+0000","last_undegraded":"2023-10-14T18:47:12.664773+0000","last_fullsized":"2023-10-14T18:47:12.664773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078875,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.377}]},{"osd":1,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.84899999999999998,"15min":0.89900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.53700000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":0.745},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.432},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.33200000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66000000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.753,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64000000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.32300000000000001,"15min":0.32700000000000001},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45300000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50800000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.309}]},{"osd":3,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.78500000000000003,"15min":0.85099999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":10.574,"15min":10.574},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.443,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.37}]},{"osd":4,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.91500000000000004,"5min":1.125,"15min":1.125},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57299999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.504},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":898,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194413,"statfs":{"total":200000000,"available":199079886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.315,"15min":0.317},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.223},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.34100000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.501}]},{"osd":5,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.49199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56699999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.253},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.375,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.82199999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.31900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194989,"statfs":{"total":200000000,"available":199669243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69099999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.71099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57899999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194995,"statfs":{"total":200000000,"available":199675498,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.503},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628}]},{"osd":4,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56599999999999995}]}]}],"pool_statfs":[]}} 2023-10-14T18:47:23.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:47:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.415+0000 7f73018ca700 1 Processor -- start 2023-10-14T18:47:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.415+0000 7f73018ca700 1 -- start start 2023-10-14T18:47:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f73018ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72fc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f73018ca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc15cbb0 con 0x7f72fc15a620 2023-10-14T18:47:23.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f73018ca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc15bfa0 con 0x7f72fc157c40 2023-10-14T18:47:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f73018ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15c280 con 0x7f72fc157870 2023-10-14T18:47:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f72fa7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f72fc15a620 0x7f72fc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45172/0 (socket says 172.21.15.79:45172) 2023-10-14T18:47:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f72fa7fc700 1 -- 172.21.15.79:0/3875536448 learned_addr learned my addr 172.21.15.79:0/3875536448 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.416+0000 7f72faffd700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72fc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492231381 0 0) 0x7f72fc15cbb0 con 0x7f72fc15a620 2023-10-14T18:47:23.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e4003570 con 0x7f72fc15a620 2023-10-14T18:47:23.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433928099 0 0) 0x7f72fc15bfa0 con 0x7f72fc157c40 2023-10-14T18:47:23.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72fc15cbb0 con 0x7f72fc157c40 2023-10-14T18:47:23.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3588377529 0 0) 0x7f72e4003570 con 0x7f72fc15a620 2023-10-14T18:47:23.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 msgr2=0x7f72fc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72fc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 >> v1:172.21.15.144:6789/0 conn(0x7f72fc157c40 legacy=0x7f72fc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15c560 con 0x7f72fc15a620 2023-10-14T18:47:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f72f0001470 con 0x7f72fc15a620 2023-10-14T18:47:23.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 >> v1:172.21.15.79:6789/0 conn(0x7f72fc15a620 legacy=0x7f72fc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4003c20 0x7f72e4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72e4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15c280 con 0x7f72e4004810 2023-10-14T18:47:23.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400bbf0 con 0x7f72e4003c20 2023-10-14T18:47:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e400bdb0 con 0x7f72fc157870 2023-10-14T18:47:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72faffd700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4003c20 0x7f72e4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fb7fe700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72e4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 -- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 msgr2=0x7f72e4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc157870 0x7f72e4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 -- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4003c20 msgr2=0x7f72e4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4003c20 0x7f72e4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 -- 172.21.15.79:0/3875536448 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4003570 con 0x7f72e4004810 2023-10-14T18:47:23.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.417+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c1e0 tx=0x7f72f0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa5c66c3a78b93b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000cb10 con 0x7f72e4004810 2023-10-14T18:47:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000cc90 con 0x7f72e4004810 2023-10-14T18:47:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f72f9ffb700 1 -- 172.21.15.79:0/3875536448 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0005b70 con 0x7f72e4004810 2023-10-14T18:47:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 -- 172.21.15.79:0/3875536448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4004810 msgr2=0x7f72e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 --2- 172.21.15.79:0/3875536448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72e4004810 0x7f72e4004c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c1e0 tx=0x7f72f0001d40 comp rx=0 tx=0).stop 2023-10-14T18:47:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f72fb7fe700 1 -- 172.21.15.79:0/3875536448 reap_dead start 2023-10-14T18:47:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 -- 172.21.15.79:0/3875536448 shutdown_connections 2023-10-14T18:47:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 -- 172.21.15.79:0/3875536448 >> 172.21.15.79:0/3875536448 conn(0x7f72fc068ce0 msgr2=0x7f72fc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 -- 172.21.15.79:0/3875536448 shutdown_connections 2023-10-14T18:47:23.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.418+0000 7f73018ca700 1 -- 172.21.15.79:0/3875536448 wait complete. 2023-10-14T18:47:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.419+0000 7f73018ca700 1 Processor -- start 2023-10-14T18:47:23.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.419+0000 7f73018ca700 1 -- start start 2023-10-14T18:47:23.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4004810 0x7f72fc145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 0x7f72fc146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc1566c0 con 0x7f72fc146780 2023-10-14T18:47:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15e960 con 0x7f72e4004810 2023-10-14T18:47:23.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f73018ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15dd50 con 0x7f72fc155e10 2023-10-14T18:47:23.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f72fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f72fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33120/0 (socket says 172.21.15.79:33120) 2023-10-14T18:47:23.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f72fb7fe700 1 -- 172.21.15.79:0/3011568310 learned_addr learned my addr 172.21.15.79:0/3011568310 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:23.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f72faffd700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4004810 0x7f72fc145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.420+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 0x7f72fc146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 -- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 msgr2=0x7f72fc146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 0x7f72fc146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 -- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4004810 msgr2=0x7f72fc145750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4004810 0x7f72fc145750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 -- 172.21.15.79:0/3011568310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15e030 con 0x7f72fc146780 2023-10-14T18:47:23.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fa7fc700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 0x7f72fc146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:23.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72fb7fe700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b0380 tx=0x7f72f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400ee90 con 0x7f72fc146780 2023-10-14T18:47:23.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4012590 con 0x7f72fc146780 2023-10-14T18:47:23.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4012950 con 0x7f72fc146780 2023-10-14T18:47:23.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc15e310 con 0x7f72fc146780 2023-10-14T18:47:23.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.421+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc145c90 con 0x7f72fc146780 2023-10-14T18:47:23.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.422+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc15ead0 con 0x7f72fc146780 2023-10-14T18:47:23.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.422+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72f4012d40 con 0x7f72fc146780 2023-10-14T18:47:23.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.423+0000 7f72e2ffd700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.423+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72f40845e0 con 0x7f72fc146780 2023-10-14T18:47:23.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.423+0000 7f72faffd700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.423+0000 7f72faffd700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 0x7f72e80693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0094d0 tx=0x7f72ec00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.427+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f40517b0 con 0x7f72fc146780 2023-10-14T18:47:23.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.604+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72fc04c3c0 con 0x7f72e8066f30 2023-10-14T18:47:23.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.612+0000 7f72e2ffd700 1 -- 172.21.15.79:0/3011568310 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285123 (secure 0 0 0) 0x7f72fc04c3c0 con 0x7f72e8066f30 2023-10-14T18:47:23.616 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 msgr2=0x7f72e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 0x7f72e80693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0094d0 tx=0x7f72ec00b040 comp rx=0 tx=0).stop 2023-10-14T18:47:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 msgr2=0x7f72fc0a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b0380 tx=0x7f72f4009040 comp rx=0 tx=0).stop 2023-10-14T18:47:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 shutdown_connections 2023-10-14T18:47:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f72e8066f30 0x7f72e80693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72fc146780 0x7f72fc0a8fd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72e4004810 0x7f72fc145750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 --2- 172.21.15.79:0/3011568310 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72fc155e10 0x7f72fc146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 >> 172.21.15.79:0/3011568310 conn(0x7f72fc068ce0 msgr2=0x7f72fc0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.615+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 shutdown_connections 2023-10-14T18:47:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.616+0000 7f73018ca700 1 -- 172.21.15.79:0/3011568310 wait complete. 2023-10-14T18:47:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:47:23.628 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-10-14T18:47:22.364731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3842,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558657,"statfs":{"total":1600000000,"available":1596065199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002117"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.680379+0000","last_change":"2023-10-14T18:47:14.680319+0000","last_active":"2023-10-14T18:47:14.680379+0000","last_peered":"2023-10-14T18:47:14.680379+0000","last_clean":"2023-10-14T18:47:14.680379+0000","last_became_active":"2023-10-14T18:47:14.680114+0000","last_became_peered":"2023-10-14T18:47:14.680114+0000","last_unstale":"2023-10-14T18:47:14.680379+0000","last_undegraded":"2023-10-14T18:47:14.680379+0000","last_fullsized":"2023-10-14T18:47:14.680379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:52:37.902679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691836+0000","last_change":"2023-10-14T18:47:14.691777+0000","last_active":"2023-10-14T18:47:14.691836+0000","last_peered":"2023-10-14T18:47:14.691836+0000","last_clean":"2023-10-14T18:47:14.691836+0000","last_became_active":"2023-10-14T18:47:14.691116+0000","last_became_peered":"2023-10-14T18:47:14.691116+0000","last_unstale":"2023-10-14T18:47:14.691836+0000","last_undegraded":"2023-10-14T18:47:14.691836+0000","last_fullsized":"2023-10-14T18:47:14.691836+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:28:44.959946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.689581+0000","last_change":"2023-10-14T18:47:14.689058+0000","last_active":"2023-10-14T18:47:14.689581+0000","last_peered":"2023-10-14T18:47:14.689581+0000","last_clean":"2023-10-14T18:47:14.689581+0000","last_became_active":"2023-10-14T18:47:14.687763+0000","last_became_peered":"2023-10-14T18:47:14.687763+0000","last_unstale":"2023-10-14T18:47:14.689581+0000","last_undegraded":"2023-10-14T18:47:14.689581+0000","last_fullsized":"2023-10-14T18:47:14.689581+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687880+0000","last_change":"2023-10-14T18:47:14.686038+0000","last_active":"2023-10-14T18:47:14.687880+0000","last_peered":"2023-10-14T18:47:14.687880+0000","last_clean":"2023-10-14T18:47:14.687880+0000","last_became_active":"2023-10-14T18:47:14.685805+0000","last_became_peered":"2023-10-14T18:47:14.685805+0000","last_unstale":"2023-10-14T18:47:14.687880+0000","last_undegraded":"2023-10-14T18:47:14.687880+0000","last_fullsized":"2023-10-14T18:47:14.687880+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682259+0000","last_change":"2023-10-14T18:47:14.682203+0000","last_active":"2023-10-14T18:47:14.682259+0000","last_peered":"2023-10-14T18:47:14.682259+0000","last_clean":"2023-10-14T18:47:14.682259+0000","last_became_active":"2023-10-14T18:47:14.681987+0000","last_became_peered":"2023-10-14T18:47:14.681987+0000","last_unstale":"2023-10-14T18:47:14.682259+0000","last_undegraded":"2023-10-14T18:47:14.682259+0000","last_fullsized":"2023-10-14T18:47:14.682259+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:47:35.920522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.686946+0000","last_change":"2023-10-14T18:47:14.686747+0000","last_active":"2023-10-14T18:47:14.686946+0000","last_peered":"2023-10-14T18:47:14.686946+0000","last_clean":"2023-10-14T18:47:14.686946+0000","last_became_active":"2023-10-14T18:47:14.686532+0000","last_became_peered":"2023-10-14T18:47:14.686532+0000","last_unstale":"2023-10-14T18:47:14.686946+0000","last_undegraded":"2023-10-14T18:47:14.686946+0000","last_fullsized":"2023-10-14T18:47:14.686946+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687754+0000","last_change":"2023-10-14T18:47:14.686637+0000","last_active":"2023-10-14T18:47:14.687754+0000","last_peered":"2023-10-14T18:47:14.687754+0000","last_clean":"2023-10-14T18:47:14.687754+0000","last_became_active":"2023-10-14T18:47:14.686430+0000","last_became_peered":"2023-10-14T18:47:14.686430+0000","last_unstale":"2023-10-14T18:47:14.687754+0000","last_undegraded":"2023-10-14T18:47:14.687754+0000","last_fullsized":"2023-10-14T18:47:14.687754+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:16.472852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688532+0000","last_change":"2023-10-14T18:47:14.687271+0000","last_active":"2023-10-14T18:47:14.688532+0000","last_peered":"2023-10-14T18:47:14.688532+0000","last_clean":"2023-10-14T18:47:14.688532+0000","last_became_active":"2023-10-14T18:47:14.687048+0000","last_became_peered":"2023-10-14T18:47:14.687048+0000","last_unstale":"2023-10-14T18:47:14.688532+0000","last_undegraded":"2023-10-14T18:47:14.688532+0000","last_fullsized":"2023-10-14T18:47:14.688532+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:18:55.284684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688084+0000","last_change":"2023-10-14T18:47:14.687999+0000","last_active":"2023-10-14T18:47:14.688084+0000","last_peered":"2023-10-14T18:47:14.688084+0000","last_clean":"2023-10-14T18:47:14.688084+0000","last_became_active":"2023-10-14T18:47:14.687727+0000","last_became_peered":"2023-10-14T18:47:14.687727+0000","last_unstale":"2023-10-14T18:47:14.688084+0000","last_undegraded":"2023-10-14T18:47:14.688084+0000","last_fullsized":"2023-10-14T18:47:14.688084+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:30.661503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.689097+0000","last_change":"2023-10-14T18:47:14.689027+0000","last_active":"2023-10-14T18:47:14.689097+0000","last_peered":"2023-10-14T18:47:14.689097+0000","last_clean":"2023-10-14T18:47:14.689097+0000","last_became_active":"2023-10-14T18:47:14.688836+0000","last_became_peered":"2023-10-14T18:47:14.688836+0000","last_unstale":"2023-10-14T18:47:14.689097+0000","last_undegraded":"2023-10-14T18:47:14.689097+0000","last_fullsized":"2023-10-14T18:47:14.689097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:06.100015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.692734+0000","last_change":"2023-10-14T18:47:14.692674+0000","last_active":"2023-10-14T18:47:14.692734+0000","last_peered":"2023-10-14T18:47:14.692734+0000","last_clean":"2023-10-14T18:47:14.692734+0000","last_became_active":"2023-10-14T18:47:14.692453+0000","last_became_peered":"2023-10-14T18:47:14.692453+0000","last_unstale":"2023-10-14T18:47:14.692734+0000","last_undegraded":"2023-10-14T18:47:14.692734+0000","last_fullsized":"2023-10-14T18:47:14.692734+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:43.722083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688840+0000","last_change":"2023-10-14T18:47:14.688777+0000","last_active":"2023-10-14T18:47:14.688840+0000","last_peered":"2023-10-14T18:47:14.688840+0000","last_clean":"2023-10-14T18:47:14.688840+0000","last_became_active":"2023-10-14T18:47:14.688523+0000","last_became_peered":"2023-10-14T18:47:14.688523+0000","last_unstale":"2023-10-14T18:47:14.688840+0000","last_undegraded":"2023-10-14T18:47:14.688840+0000","last_fullsized":"2023-10-14T18:47:14.688840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687990+0000","last_change":"2023-10-14T18:47:14.687813+0000","last_active":"2023-10-14T18:47:14.687990+0000","last_peered":"2023-10-14T18:47:14.687990+0000","last_clean":"2023-10-14T18:47:14.687990+0000","last_became_active":"2023-10-14T18:47:14.687467+0000","last_became_peered":"2023-10-14T18:47:14.687467+0000","last_unstale":"2023-10-14T18:47:14.687990+0000","last_undegraded":"2023-10-14T18:47:14.687990+0000","last_fullsized":"2023-10-14T18:47:14.687990+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:06.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687727+0000","last_change":"2023-10-14T18:47:14.686054+0000","last_active":"2023-10-14T18:47:14.687727+0000","last_peered":"2023-10-14T18:47:14.687727+0000","last_clean":"2023-10-14T18:47:14.687727+0000","last_became_active":"2023-10-14T18:47:14.685841+0000","last_became_peered":"2023-10-14T18:47:14.685841+0000","last_unstale":"2023-10-14T18:47:14.687727+0000","last_undegraded":"2023-10-14T18:47:14.687727+0000","last_fullsized":"2023-10-14T18:47:14.687727+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:22.557134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690516+0000","last_change":"2023-10-14T18:47:14.690443+0000","last_active":"2023-10-14T18:47:14.690516+0000","last_peered":"2023-10-14T18:47:14.690516+0000","last_clean":"2023-10-14T18:47:14.690516+0000","last_became_active":"2023-10-14T18:47:14.690047+0000","last_became_peered":"2023-10-14T18:47:14.690047+0000","last_unstale":"2023-10-14T18:47:14.690516+0000","last_undegraded":"2023-10-14T18:47:14.690516+0000","last_fullsized":"2023-10-14T18:47:14.690516+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:43.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.686911+0000","last_change":"2023-10-14T18:47:14.686298+0000","last_active":"2023-10-14T18:47:14.686911+0000","last_peered":"2023-10-14T18:47:14.686911+0000","last_clean":"2023-10-14T18:47:14.686911+0000","last_became_active":"2023-10-14T18:47:14.685976+0000","last_became_peered":"2023-10-14T18:47:14.685976+0000","last_unstale":"2023-10-14T18:47:14.686911+0000","last_undegraded":"2023-10-14T18:47:14.686911+0000","last_fullsized":"2023-10-14T18:47:14.686911+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:33.301608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682463+0000","last_change":"2023-10-14T18:47:14.682066+0000","last_active":"2023-10-14T18:47:14.682463+0000","last_peered":"2023-10-14T18:47:14.682463+0000","last_clean":"2023-10-14T18:47:14.682463+0000","last_became_active":"2023-10-14T18:47:14.681850+0000","last_became_peered":"2023-10-14T18:47:14.681850+0000","last_unstale":"2023-10-14T18:47:14.682463+0000","last_undegraded":"2023-10-14T18:47:14.682463+0000","last_fullsized":"2023-10-14T18:47:14.682463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:12:13.675193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688335+0000","last_change":"2023-10-14T18:47:14.688272+0000","last_active":"2023-10-14T18:47:14.688335+0000","last_peered":"2023-10-14T18:47:14.688335+0000","last_clean":"2023-10-14T18:47:14.688335+0000","last_became_active":"2023-10-14T18:47:14.687347+0000","last_became_peered":"2023-10-14T18:47:14.687347+0000","last_unstale":"2023-10-14T18:47:14.688335+0000","last_undegraded":"2023-10-14T18:47:14.688335+0000","last_fullsized":"2023-10-14T18:47:14.688335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683913+0000","last_change":"2023-10-14T18:47:14.683811+0000","last_active":"2023-10-14T18:47:14.683913+0000","last_peered":"2023-10-14T18:47:14.683913+0000","last_clean":"2023-10-14T18:47:14.683913+0000","last_became_active":"2023-10-14T18:47:14.683596+0000","last_became_peered":"2023-10-14T18:47:14.683596+0000","last_unstale":"2023-10-14T18:47:14.683913+0000","last_undegraded":"2023-10-14T18:47:14.683913+0000","last_fullsized":"2023-10-14T18:47:14.683913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:29.662732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683299+0000","last_change":"2023-10-14T18:47:14.683244+0000","last_active":"2023-10-14T18:47:14.683299+0000","last_peered":"2023-10-14T18:47:14.683299+0000","last_clean":"2023-10-14T18:47:14.683299+0000","last_became_active":"2023-10-14T18:47:14.683039+0000","last_became_peered":"2023-10-14T18:47:14.683039+0000","last_unstale":"2023-10-14T18:47:14.683299+0000","last_undegraded":"2023-10-14T18:47:14.683299+0000","last_fullsized":"2023-10-14T18:47:14.683299+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:58:15.042679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687465+0000","last_change":"2023-10-14T18:47:14.685730+0000","last_active":"2023-10-14T18:47:14.687465+0000","last_peered":"2023-10-14T18:47:14.687465+0000","last_clean":"2023-10-14T18:47:14.687465+0000","last_became_active":"2023-10-14T18:47:14.685514+0000","last_became_peered":"2023-10-14T18:47:14.685514+0000","last_unstale":"2023-10-14T18:47:14.687465+0000","last_undegraded":"2023-10-14T18:47:14.687465+0000","last_fullsized":"2023-10-14T18:47:14.687465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.681218+0000","last_change":"2023-10-14T18:47:14.681081+0000","last_active":"2023-10-14T18:47:14.681218+0000","last_peered":"2023-10-14T18:47:14.681218+0000","last_clean":"2023-10-14T18:47:14.681218+0000","last_became_active":"2023-10-14T18:47:14.680808+0000","last_became_peered":"2023-10-14T18:47:14.680808+0000","last_unstale":"2023-10-14T18:47:14.681218+0000","last_undegraded":"2023-10-14T18:47:14.681218+0000","last_fullsized":"2023-10-14T18:47:14.681218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:54.658241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687499+0000","last_change":"2023-10-14T18:47:14.687051+0000","last_active":"2023-10-14T18:47:14.687499+0000","last_peered":"2023-10-14T18:47:14.687499+0000","last_clean":"2023-10-14T18:47:14.687499+0000","last_became_active":"2023-10-14T18:47:14.682732+0000","last_became_peered":"2023-10-14T18:47:14.682732+0000","last_unstale":"2023-10-14T18:47:14.687499+0000","last_undegraded":"2023-10-14T18:47:14.687499+0000","last_fullsized":"2023-10-14T18:47:14.687499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690550+0000","last_change":"2023-10-14T18:47:14.690481+0000","last_active":"2023-10-14T18:47:14.690550+0000","last_peered":"2023-10-14T18:47:14.690550+0000","last_clean":"2023-10-14T18:47:14.690550+0000","last_became_active":"2023-10-14T18:47:14.690258+0000","last_became_peered":"2023-10-14T18:47:14.690258+0000","last_unstale":"2023-10-14T18:47:14.690550+0000","last_undegraded":"2023-10-14T18:47:14.690550+0000","last_fullsized":"2023-10-14T18:47:14.690550+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:10.641616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.681817+0000","last_change":"2023-10-14T18:47:14.681756+0000","last_active":"2023-10-14T18:47:14.681817+0000","last_peered":"2023-10-14T18:47:14.681817+0000","last_clean":"2023-10-14T18:47:14.681817+0000","last_became_active":"2023-10-14T18:47:14.681537+0000","last_became_peered":"2023-10-14T18:47:14.681537+0000","last_unstale":"2023-10-14T18:47:14.681817+0000","last_undegraded":"2023-10-14T18:47:14.681817+0000","last_fullsized":"2023-10-14T18:47:14.681817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:33:58.570469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690332+0000","last_change":"2023-10-14T18:47:14.689340+0000","last_active":"2023-10-14T18:47:14.690332+0000","last_peered":"2023-10-14T18:47:14.690332+0000","last_clean":"2023-10-14T18:47:14.690332+0000","last_became_active":"2023-10-14T18:47:14.689118+0000","last_became_peered":"2023-10-14T18:47:14.689118+0000","last_unstale":"2023-10-14T18:47:14.690332+0000","last_undegraded":"2023-10-14T18:47:14.690332+0000","last_fullsized":"2023-10-14T18:47:14.690332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:37.877631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.685722+0000","last_change":"2023-10-14T18:47:14.685666+0000","last_active":"2023-10-14T18:47:14.685722+0000","last_peered":"2023-10-14T18:47:14.685722+0000","last_clean":"2023-10-14T18:47:14.685722+0000","last_became_active":"2023-10-14T18:47:14.685465+0000","last_became_peered":"2023-10-14T18:47:14.685465+0000","last_unstale":"2023-10-14T18:47:14.685722+0000","last_undegraded":"2023-10-14T18:47:14.685722+0000","last_fullsized":"2023-10-14T18:47:14.685722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:04.661707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.684078+0000","last_change":"2023-10-14T18:47:14.684022+0000","last_active":"2023-10-14T18:47:14.684078+0000","last_peered":"2023-10-14T18:47:14.684078+0000","last_clean":"2023-10-14T18:47:14.684078+0000","last_became_active":"2023-10-14T18:47:14.683806+0000","last_became_peered":"2023-10-14T18:47:14.683806+0000","last_unstale":"2023-10-14T18:47:14.684078+0000","last_undegraded":"2023-10-14T18:47:14.684078+0000","last_fullsized":"2023-10-14T18:47:14.684078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:17:17.958446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.686564+0000","last_change":"2023-10-14T18:47:14.686507+0000","last_active":"2023-10-14T18:47:14.686564+0000","last_peered":"2023-10-14T18:47:14.686564+0000","last_clean":"2023-10-14T18:47:14.686564+0000","last_became_active":"2023-10-14T18:47:14.686284+0000","last_became_peered":"2023-10-14T18:47:14.686284+0000","last_unstale":"2023-10-14T18:47:14.686564+0000","last_undegraded":"2023-10-14T18:47:14.686564+0000","last_fullsized":"2023-10-14T18:47:14.686564+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:13.039113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691498+0000","last_change":"2023-10-14T18:47:14.691427+0000","last_active":"2023-10-14T18:47:14.691498+0000","last_peered":"2023-10-14T18:47:14.691498+0000","last_clean":"2023-10-14T18:47:14.691498+0000","last_became_active":"2023-10-14T18:47:14.688721+0000","last_became_peered":"2023-10-14T18:47:14.688721+0000","last_unstale":"2023-10-14T18:47:14.691498+0000","last_undegraded":"2023-10-14T18:47:14.691498+0000","last_fullsized":"2023-10-14T18:47:14.691498+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688120+0000","last_change":"2023-10-14T18:47:14.688062+0000","last_active":"2023-10-14T18:47:14.688120+0000","last_peered":"2023-10-14T18:47:14.688120+0000","last_clean":"2023-10-14T18:47:14.688120+0000","last_became_active":"2023-10-14T18:47:14.687873+0000","last_became_peered":"2023-10-14T18:47:14.687873+0000","last_unstale":"2023-10-14T18:47:14.688120+0000","last_undegraded":"2023-10-14T18:47:14.688120+0000","last_fullsized":"2023-10-14T18:47:14.688120+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:04:11.047672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688534+0000","last_change":"2023-10-14T18:47:14.688160+0000","last_active":"2023-10-14T18:47:14.688534+0000","last_peered":"2023-10-14T18:47:14.688534+0000","last_clean":"2023-10-14T18:47:14.688534+0000","last_became_active":"2023-10-14T18:47:14.687863+0000","last_became_peered":"2023-10-14T18:47:14.687863+0000","last_unstale":"2023-10-14T18:47:14.688534+0000","last_undegraded":"2023-10-14T18:47:14.688534+0000","last_fullsized":"2023-10-14T18:47:14.688534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.317001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687226+0000","last_change":"2023-10-14T18:47:14.687143+0000","last_active":"2023-10-14T18:47:14.687226+0000","last_peered":"2023-10-14T18:47:14.687226+0000","last_clean":"2023-10-14T18:47:14.687226+0000","last_became_active":"2023-10-14T18:47:14.686907+0000","last_became_peered":"2023-10-14T18:47:14.686907+0000","last_unstale":"2023-10-14T18:47:14.687226+0000","last_undegraded":"2023-10-14T18:47:14.687226+0000","last_fullsized":"2023-10-14T18:47:14.687226+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:12.173381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.698147+0000","last_change":"2023-10-14T18:47:13.675443+0000","last_active":"2023-10-14T18:47:14.698147+0000","last_peered":"2023-10-14T18:47:14.698147+0000","last_clean":"2023-10-14T18:47:14.698147+0000","last_became_active":"2023-10-14T18:47:13.675217+0000","last_became_peered":"2023-10-14T18:47:13.675217+0000","last_unstale":"2023-10-14T18:47:14.698147+0000","last_undegraded":"2023-10-14T18:47:14.698147+0000","last_fullsized":"2023-10-14T18:47:14.698147+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.689082+0000","last_change":"2023-10-14T18:47:14.688687+0000","last_active":"2023-10-14T18:47:14.689082+0000","last_peered":"2023-10-14T18:47:14.689082+0000","last_clean":"2023-10-14T18:47:14.689082+0000","last_became_active":"2023-10-14T18:47:14.688338+0000","last_became_peered":"2023-10-14T18:47:14.688338+0000","last_unstale":"2023-10-14T18:47:14.689082+0000","last_undegraded":"2023-10-14T18:47:14.689082+0000","last_fullsized":"2023-10-14T18:47:14.689082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:13.004068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.695762+0000","last_change":"2023-10-14T18:47:13.670021+0000","last_active":"2023-10-14T18:47:14.695762+0000","last_peered":"2023-10-14T18:47:14.695762+0000","last_clean":"2023-10-14T18:47:14.695762+0000","last_became_active":"2023-10-14T18:47:13.669168+0000","last_became_peered":"2023-10-14T18:47:13.669168+0000","last_unstale":"2023-10-14T18:47:14.695762+0000","last_undegraded":"2023-10-14T18:47:14.695762+0000","last_fullsized":"2023-10-14T18:47:14.695762+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:38.475719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688081+0000","last_change":"2023-10-14T18:47:14.688013+0000","last_active":"2023-10-14T18:47:14.688081+0000","last_peered":"2023-10-14T18:47:14.688081+0000","last_clean":"2023-10-14T18:47:14.688081+0000","last_became_active":"2023-10-14T18:47:14.687802+0000","last_became_peered":"2023-10-14T18:47:14.687802+0000","last_unstale":"2023-10-14T18:47:14.688081+0000","last_undegraded":"2023-10-14T18:47:14.688081+0000","last_fullsized":"2023-10-14T18:47:14.688081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.697401+0000","last_change":"2023-10-14T18:47:13.675609+0000","last_active":"2023-10-14T18:47:14.697401+0000","last_peered":"2023-10-14T18:47:14.697401+0000","last_clean":"2023-10-14T18:47:14.697401+0000","last_became_active":"2023-10-14T18:47:13.675361+0000","last_became_peered":"2023-10-14T18:47:13.675361+0000","last_unstale":"2023-10-14T18:47:14.697401+0000","last_undegraded":"2023-10-14T18:47:14.697401+0000","last_fullsized":"2023-10-14T18:47:14.697401+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.685309+0000","last_change":"2023-10-14T18:47:14.685236+0000","last_active":"2023-10-14T18:47:14.685309+0000","last_peered":"2023-10-14T18:47:14.685309+0000","last_clean":"2023-10-14T18:47:14.685309+0000","last_became_active":"2023-10-14T18:47:14.685007+0000","last_became_peered":"2023-10-14T18:47:14.685007+0000","last_unstale":"2023-10-14T18:47:14.685309+0000","last_undegraded":"2023-10-14T18:47:14.685309+0000","last_fullsized":"2023-10-14T18:47:14.685309+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:57:29.660404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.695709+0000","last_change":"2023-10-14T18:47:13.675094+0000","last_active":"2023-10-14T18:47:14.695709+0000","last_peered":"2023-10-14T18:47:14.695709+0000","last_clean":"2023-10-14T18:47:14.695709+0000","last_became_active":"2023-10-14T18:47:13.674569+0000","last_became_peered":"2023-10-14T18:47:13.674569+0000","last_unstale":"2023-10-14T18:47:14.695709+0000","last_undegraded":"2023-10-14T18:47:14.695709+0000","last_fullsized":"2023-10-14T18:47:14.695709+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:13.281986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.680481+0000","last_change":"2023-10-14T18:47:14.679470+0000","last_active":"2023-10-14T18:47:14.680481+0000","last_peered":"2023-10-14T18:47:14.680481+0000","last_clean":"2023-10-14T18:47:14.680481+0000","last_became_active":"2023-10-14T18:47:14.679235+0000","last_became_peered":"2023-10-14T18:47:14.679235+0000","last_unstale":"2023-10-14T18:47:14.680481+0000","last_undegraded":"2023-10-14T18:47:14.680481+0000","last_fullsized":"2023-10-14T18:47:14.680481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:39:32.043538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.697498+0000","last_change":"2023-10-14T18:47:13.672104+0000","last_active":"2023-10-14T18:47:14.697498+0000","last_peered":"2023-10-14T18:47:14.697498+0000","last_clean":"2023-10-14T18:47:14.697498+0000","last_became_active":"2023-10-14T18:47:13.671874+0000","last_became_peered":"2023-10-14T18:47:13.671874+0000","last_unstale":"2023-10-14T18:47:14.697498+0000","last_undegraded":"2023-10-14T18:47:14.697498+0000","last_fullsized":"2023-10-14T18:47:14.697498+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:09.636514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.685039+0000","last_change":"2023-10-14T18:47:14.684980+0000","last_active":"2023-10-14T18:47:14.685039+0000","last_peered":"2023-10-14T18:47:14.685039+0000","last_clean":"2023-10-14T18:47:14.685039+0000","last_became_active":"2023-10-14T18:47:14.684626+0000","last_became_peered":"2023-10-14T18:47:14.684626+0000","last_unstale":"2023-10-14T18:47:14.685039+0000","last_undegraded":"2023-10-14T18:47:14.685039+0000","last_fullsized":"2023-10-14T18:47:14.685039+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:15.432571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.698402+0000","last_change":"2023-10-14T18:47:13.677589+0000","last_active":"2023-10-14T18:47:14.698402+0000","last_peered":"2023-10-14T18:47:14.698402+0000","last_clean":"2023-10-14T18:47:14.698402+0000","last_became_active":"2023-10-14T18:47:13.677153+0000","last_became_peered":"2023-10-14T18:47:13.677153+0000","last_unstale":"2023-10-14T18:47:14.698402+0000","last_undegraded":"2023-10-14T18:47:14.698402+0000","last_fullsized":"2023-10-14T18:47:14.698402+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687167+0000","last_change":"2023-10-14T18:47:14.685904+0000","last_active":"2023-10-14T18:47:14.687167+0000","last_peered":"2023-10-14T18:47:14.687167+0000","last_clean":"2023-10-14T18:47:14.687167+0000","last_became_active":"2023-10-14T18:47:14.685572+0000","last_became_peered":"2023-10-14T18:47:14.685572+0000","last_unstale":"2023-10-14T18:47:14.687167+0000","last_undegraded":"2023-10-14T18:47:14.687167+0000","last_fullsized":"2023-10-14T18:47:14.687167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:06.100015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.684714+0000","last_change":"2023-10-14T18:47:13.676379+0000","last_active":"2023-10-14T18:47:14.684714+0000","last_peered":"2023-10-14T18:47:14.684714+0000","last_clean":"2023-10-14T18:47:14.684714+0000","last_became_active":"2023-10-14T18:47:13.675704+0000","last_became_peered":"2023-10-14T18:47:13.675704+0000","last_unstale":"2023-10-14T18:47:14.684714+0000","last_undegraded":"2023-10-14T18:47:14.684714+0000","last_fullsized":"2023-10-14T18:47:14.684714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:53.638591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683566+0000","last_change":"2023-10-14T18:47:14.683375+0000","last_active":"2023-10-14T18:47:14.683566+0000","last_peered":"2023-10-14T18:47:14.683566+0000","last_clean":"2023-10-14T18:47:14.683566+0000","last_became_active":"2023-10-14T18:47:14.683154+0000","last_became_peered":"2023-10-14T18:47:14.683154+0000","last_unstale":"2023-10-14T18:47:14.683566+0000","last_undegraded":"2023-10-14T18:47:14.683566+0000","last_fullsized":"2023-10-14T18:47:14.683566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:14:57.556108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683039+0000","last_change":"2023-10-14T18:47:13.673613+0000","last_active":"2023-10-14T18:47:14.683039+0000","last_peered":"2023-10-14T18:47:14.683039+0000","last_clean":"2023-10-14T18:47:14.683039+0000","last_became_active":"2023-10-14T18:47:13.673392+0000","last_became_peered":"2023-10-14T18:47:13.673392+0000","last_unstale":"2023-10-14T18:47:14.683039+0000","last_undegraded":"2023-10-14T18:47:14.683039+0000","last_fullsized":"2023-10-14T18:47:14.683039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:05.157312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.689603+0000","last_change":"2023-10-14T18:47:14.689540+0000","last_active":"2023-10-14T18:47:14.689603+0000","last_peered":"2023-10-14T18:47:14.689603+0000","last_clean":"2023-10-14T18:47:14.689603+0000","last_became_active":"2023-10-14T18:47:14.689297+0000","last_became_peered":"2023-10-14T18:47:14.689297+0000","last_unstale":"2023-10-14T18:47:14.689603+0000","last_undegraded":"2023-10-14T18:47:14.689603+0000","last_fullsized":"2023-10-14T18:47:14.689603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:13:14.287088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.679273+0000","last_change":"2023-10-14T18:47:13.672117+0000","last_active":"2023-10-14T18:47:14.679273+0000","last_peered":"2023-10-14T18:47:14.679273+0000","last_clean":"2023-10-14T18:47:14.679273+0000","last_became_active":"2023-10-14T18:47:13.670992+0000","last_became_peered":"2023-10-14T18:47:13.670992+0000","last_unstale":"2023-10-14T18:47:14.679273+0000","last_undegraded":"2023-10-14T18:47:14.679273+0000","last_fullsized":"2023-10-14T18:47:14.679273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:16.296747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691081+0000","last_change":"2023-10-14T18:47:14.690112+0000","last_active":"2023-10-14T18:47:14.691081+0000","last_peered":"2023-10-14T18:47:14.691081+0000","last_clean":"2023-10-14T18:47:14.691081+0000","last_became_active":"2023-10-14T18:47:14.689565+0000","last_became_peered":"2023-10-14T18:47:14.689565+0000","last_unstale":"2023-10-14T18:47:14.691081+0000","last_undegraded":"2023-10-14T18:47:14.691081+0000","last_fullsized":"2023-10-14T18:47:14.691081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.679938+0000","last_change":"2023-10-14T18:47:13.670877+0000","last_active":"2023-10-14T18:47:14.679938+0000","last_peered":"2023-10-14T18:47:14.679938+0000","last_clean":"2023-10-14T18:47:14.679938+0000","last_became_active":"2023-10-14T18:47:13.670062+0000","last_became_peered":"2023-10-14T18:47:13.670062+0000","last_unstale":"2023-10-14T18:47:14.679938+0000","last_undegraded":"2023-10-14T18:47:14.679938+0000","last_fullsized":"2023-10-14T18:47:14.679938+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:32.803430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690117+0000","last_change":"2023-10-14T18:47:14.690003+0000","last_active":"2023-10-14T18:47:14.690117+0000","last_peered":"2023-10-14T18:47:14.690117+0000","last_clean":"2023-10-14T18:47:14.690117+0000","last_became_active":"2023-10-14T18:47:14.689550+0000","last_became_peered":"2023-10-14T18:47:14.689550+0000","last_unstale":"2023-10-14T18:47:14.690117+0000","last_undegraded":"2023-10-14T18:47:14.690117+0000","last_fullsized":"2023-10-14T18:47:14.690117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:54:10.641616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.701272+0000","last_change":"2023-10-14T18:47:13.671091+0000","last_active":"2023-10-14T18:47:14.701272+0000","last_peered":"2023-10-14T18:47:14.701272+0000","last_clean":"2023-10-14T18:47:14.701272+0000","last_became_active":"2023-10-14T18:47:13.669764+0000","last_became_peered":"2023-10-14T18:47:13.669764+0000","last_unstale":"2023-10-14T18:47:14.701272+0000","last_undegraded":"2023-10-14T18:47:14.701272+0000","last_fullsized":"2023-10-14T18:47:14.701272+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:33.881152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.689599+0000","last_change":"2023-10-14T18:47:14.689213+0000","last_active":"2023-10-14T18:47:14.689599+0000","last_peered":"2023-10-14T18:47:14.689599+0000","last_clean":"2023-10-14T18:47:14.689599+0000","last_became_active":"2023-10-14T18:47:14.688043+0000","last_became_peered":"2023-10-14T18:47:14.688043+0000","last_unstale":"2023-10-14T18:47:14.689599+0000","last_undegraded":"2023-10-14T18:47:14.689599+0000","last_fullsized":"2023-10-14T18:47:14.689599+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:25.146041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.700580+0000","last_change":"2023-10-14T18:47:13.676991+0000","last_active":"2023-10-14T18:47:14.700580+0000","last_peered":"2023-10-14T18:47:14.700580+0000","last_clean":"2023-10-14T18:47:14.700580+0000","last_became_active":"2023-10-14T18:47:13.676559+0000","last_became_peered":"2023-10-14T18:47:13.676559+0000","last_unstale":"2023-10-14T18:47:14.700580+0000","last_undegraded":"2023-10-14T18:47:14.700580+0000","last_fullsized":"2023-10-14T18:47:14.700580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:47:09.639139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.688975+0000","last_change":"2023-10-14T18:47:14.688898+0000","last_active":"2023-10-14T18:47:14.688975+0000","last_peered":"2023-10-14T18:47:14.688975+0000","last_clean":"2023-10-14T18:47:14.688975+0000","last_became_active":"2023-10-14T18:47:14.688637+0000","last_became_peered":"2023-10-14T18:47:14.688637+0000","last_unstale":"2023-10-14T18:47:14.688975+0000","last_undegraded":"2023-10-14T18:47:14.688975+0000","last_fullsized":"2023-10-14T18:47:14.688975+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.695795+0000","last_change":"2023-10-14T18:47:13.665940+0000","last_active":"2023-10-14T18:47:14.695795+0000","last_peered":"2023-10-14T18:47:14.695795+0000","last_clean":"2023-10-14T18:47:14.695795+0000","last_became_active":"2023-10-14T18:47:13.665381+0000","last_became_peered":"2023-10-14T18:47:13.665381+0000","last_unstale":"2023-10-14T18:47:14.695795+0000","last_undegraded":"2023-10-14T18:47:14.695795+0000","last_fullsized":"2023-10-14T18:47:14.695795+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:28:29.656401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687437+0000","last_change":"2023-10-14T18:47:14.684967+0000","last_active":"2023-10-14T18:47:14.687437+0000","last_peered":"2023-10-14T18:47:14.687437+0000","last_clean":"2023-10-14T18:47:14.687437+0000","last_became_active":"2023-10-14T18:47:14.683740+0000","last_became_peered":"2023-10-14T18:47:14.683740+0000","last_unstale":"2023-10-14T18:47:14.687437+0000","last_undegraded":"2023-10-14T18:47:14.687437+0000","last_fullsized":"2023-10-14T18:47:14.687437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:59:48.482126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.680794+0000","last_change":"2023-10-14T18:47:13.673936+0000","last_active":"2023-10-14T18:47:14.680794+0000","last_peered":"2023-10-14T18:47:14.680794+0000","last_clean":"2023-10-14T18:47:14.680794+0000","last_became_active":"2023-10-14T18:47:13.673715+0000","last_became_peered":"2023-10-14T18:47:13.673715+0000","last_unstale":"2023-10-14T18:47:14.680794+0000","last_undegraded":"2023-10-14T18:47:14.680794+0000","last_fullsized":"2023-10-14T18:47:14.680794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:11:02.332290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690500+0000","last_change":"2023-10-14T18:47:14.690342+0000","last_active":"2023-10-14T18:47:14.690500+0000","last_peered":"2023-10-14T18:47:14.690500+0000","last_clean":"2023-10-14T18:47:14.690500+0000","last_became_active":"2023-10-14T18:47:14.690011+0000","last_became_peered":"2023-10-14T18:47:14.690011+0000","last_unstale":"2023-10-14T18:47:14.690500+0000","last_undegraded":"2023-10-14T18:47:14.690500+0000","last_fullsized":"2023-10-14T18:47:14.690500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:17.434973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682039+0000","last_change":"2023-10-14T18:47:13.673972+0000","last_active":"2023-10-14T18:47:14.682039+0000","last_peered":"2023-10-14T18:47:14.682039+0000","last_clean":"2023-10-14T18:47:14.682039+0000","last_became_active":"2023-10-14T18:47:13.673741+0000","last_became_peered":"2023-10-14T18:47:13.673741+0000","last_unstale":"2023-10-14T18:47:14.682039+0000","last_undegraded":"2023-10-14T18:47:14.682039+0000","last_fullsized":"2023-10-14T18:47:14.682039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682831+0000","last_change":"2023-10-14T18:47:14.682612+0000","last_active":"2023-10-14T18:47:14.682831+0000","last_peered":"2023-10-14T18:47:14.682831+0000","last_clean":"2023-10-14T18:47:14.682831+0000","last_became_active":"2023-10-14T18:47:14.682351+0000","last_became_peered":"2023-10-14T18:47:14.682351+0000","last_unstale":"2023-10-14T18:47:14.682831+0000","last_undegraded":"2023-10-14T18:47:14.682831+0000","last_fullsized":"2023-10-14T18:47:14.682831+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:44:37.090638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.700780+0000","last_change":"2023-10-14T18:47:13.671263+0000","last_active":"2023-10-14T18:47:14.700780+0000","last_peered":"2023-10-14T18:47:14.700780+0000","last_clean":"2023-10-14T18:47:14.700780+0000","last_became_active":"2023-10-14T18:47:13.670844+0000","last_became_peered":"2023-10-14T18:47:13.670844+0000","last_unstale":"2023-10-14T18:47:14.700780+0000","last_undegraded":"2023-10-14T18:47:14.700780+0000","last_fullsized":"2023-10-14T18:47:14.700780+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:05.549944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691438+0000","last_change":"2023-10-14T18:47:14.691269+0000","last_active":"2023-10-14T18:47:14.691438+0000","last_peered":"2023-10-14T18:47:14.691438+0000","last_clean":"2023-10-14T18:47:14.691438+0000","last_became_active":"2023-10-14T18:47:14.688478+0000","last_became_peered":"2023-10-14T18:47:14.688478+0000","last_unstale":"2023-10-14T18:47:14.691438+0000","last_undegraded":"2023-10-14T18:47:14.691438+0000","last_fullsized":"2023-10-14T18:47:14.691438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.697002+0000","last_change":"2023-10-14T18:47:13.670158+0000","last_active":"2023-10-14T18:47:14.697002+0000","last_peered":"2023-10-14T18:47:14.697002+0000","last_clean":"2023-10-14T18:47:14.697002+0000","last_became_active":"2023-10-14T18:47:13.669734+0000","last_became_peered":"2023-10-14T18:47:13.669734+0000","last_unstale":"2023-10-14T18:47:14.697002+0000","last_undegraded":"2023-10-14T18:47:14.697002+0000","last_fullsized":"2023-10-14T18:47:14.697002+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:15.467750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690893+0000","last_change":"2023-10-14T18:47:14.690832+0000","last_active":"2023-10-14T18:47:14.690893+0000","last_peered":"2023-10-14T18:47:14.690893+0000","last_clean":"2023-10-14T18:47:14.690893+0000","last_became_active":"2023-10-14T18:47:14.690048+0000","last_became_peered":"2023-10-14T18:47:14.690048+0000","last_unstale":"2023-10-14T18:47:14.690893+0000","last_undegraded":"2023-10-14T18:47:14.690893+0000","last_fullsized":"2023-10-14T18:47:14.690893+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.697995+0000","last_change":"2023-10-14T18:47:13.669664+0000","last_active":"2023-10-14T18:47:14.697995+0000","last_peered":"2023-10-14T18:47:14.697995+0000","last_clean":"2023-10-14T18:47:14.697995+0000","last_became_active":"2023-10-14T18:47:13.669445+0000","last_became_peered":"2023-10-14T18:47:13.669445+0000","last_unstale":"2023-10-14T18:47:14.697995+0000","last_undegraded":"2023-10-14T18:47:14.697995+0000","last_fullsized":"2023-10-14T18:47:14.697995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691993+0000","last_change":"2023-10-14T18:47:14.691947+0000","last_active":"2023-10-14T18:47:14.691993+0000","last_peered":"2023-10-14T18:47:14.691993+0000","last_clean":"2023-10-14T18:47:14.691993+0000","last_became_active":"2023-10-14T18:47:14.691404+0000","last_became_peered":"2023-10-14T18:47:14.691404+0000","last_unstale":"2023-10-14T18:47:14.691993+0000","last_undegraded":"2023-10-14T18:47:14.691993+0000","last_fullsized":"2023-10-14T18:47:14.691993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:10.226926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.695900+0000","last_change":"2023-10-14T18:47:13.674946+0000","last_active":"2023-10-14T18:47:14.695900+0000","last_peered":"2023-10-14T18:47:14.695900+0000","last_clean":"2023-10-14T18:47:14.695900+0000","last_became_active":"2023-10-14T18:47:13.674266+0000","last_became_peered":"2023-10-14T18:47:13.674266+0000","last_unstale":"2023-10-14T18:47:14.695900+0000","last_undegraded":"2023-10-14T18:47:14.695900+0000","last_fullsized":"2023-10-14T18:47:14.695900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:16:42.738296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691097+0000","last_change":"2023-10-14T18:47:14.690267+0000","last_active":"2023-10-14T18:47:14.691097+0000","last_peered":"2023-10-14T18:47:14.691097+0000","last_clean":"2023-10-14T18:47:14.691097+0000","last_became_active":"2023-10-14T18:47:14.689865+0000","last_became_peered":"2023-10-14T18:47:14.689865+0000","last_unstale":"2023-10-14T18:47:14.691097+0000","last_undegraded":"2023-10-14T18:47:14.691097+0000","last_fullsized":"2023-10-14T18:47:14.691097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:57.632926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683494+0000","last_change":"2023-10-14T18:47:13.673226+0000","last_active":"2023-10-14T18:47:14.683494+0000","last_peered":"2023-10-14T18:47:14.683494+0000","last_clean":"2023-10-14T18:47:14.683494+0000","last_became_active":"2023-10-14T18:47:13.673009+0000","last_became_peered":"2023-10-14T18:47:13.673009+0000","last_unstale":"2023-10-14T18:47:14.683494+0000","last_undegraded":"2023-10-14T18:47:14.683494+0000","last_fullsized":"2023-10-14T18:47:14.683494+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:18.790977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691023+0000","last_change":"2023-10-14T18:47:14.690965+0000","last_active":"2023-10-14T18:47:14.691023+0000","last_peered":"2023-10-14T18:47:14.691023+0000","last_clean":"2023-10-14T18:47:14.691023+0000","last_became_active":"2023-10-14T18:47:14.690389+0000","last_became_peered":"2023-10-14T18:47:14.690389+0000","last_unstale":"2023-10-14T18:47:14.691023+0000","last_undegraded":"2023-10-14T18:47:14.691023+0000","last_fullsized":"2023-10-14T18:47:14.691023+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:49.330573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.696141+0000","last_change":"2023-10-14T18:47:13.674003+0000","last_active":"2023-10-14T18:47:14.696141+0000","last_peered":"2023-10-14T18:47:14.696141+0000","last_clean":"2023-10-14T18:47:14.696141+0000","last_became_active":"2023-10-14T18:47:13.673498+0000","last_became_peered":"2023-10-14T18:47:13.673498+0000","last_unstale":"2023-10-14T18:47:14.696141+0000","last_undegraded":"2023-10-14T18:47:14.696141+0000","last_fullsized":"2023-10-14T18:47:14.696141+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:36.421932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.686930+0000","last_change":"2023-10-14T18:47:14.686514+0000","last_active":"2023-10-14T18:47:14.686930+0000","last_peered":"2023-10-14T18:47:14.686930+0000","last_clean":"2023-10-14T18:47:14.686930+0000","last_became_active":"2023-10-14T18:47:14.686261+0000","last_became_peered":"2023-10-14T18:47:14.686261+0000","last_unstale":"2023-10-14T18:47:14.686930+0000","last_undegraded":"2023-10-14T18:47:14.686930+0000","last_fullsized":"2023-10-14T18:47:14.686930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:46.314149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.684965+0000","last_change":"2023-10-14T18:47:13.667077+0000","last_active":"2023-10-14T18:47:14.684965+0000","last_peered":"2023-10-14T18:47:14.684965+0000","last_clean":"2023-10-14T18:47:14.684965+0000","last_became_active":"2023-10-14T18:47:13.666843+0000","last_became_peered":"2023-10-14T18:47:13.666843+0000","last_unstale":"2023-10-14T18:47:14.684965+0000","last_undegraded":"2023-10-14T18:47:14.684965+0000","last_fullsized":"2023-10-14T18:47:14.684965+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:11.693401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690146+0000","last_change":"2023-10-14T18:47:14.689440+0000","last_active":"2023-10-14T18:47:14.690146+0000","last_peered":"2023-10-14T18:47:14.690146+0000","last_clean":"2023-10-14T18:47:14.690146+0000","last_became_active":"2023-10-14T18:47:14.689214+0000","last_became_peered":"2023-10-14T18:47:14.689214+0000","last_unstale":"2023-10-14T18:47:14.690146+0000","last_undegraded":"2023-10-14T18:47:14.690146+0000","last_fullsized":"2023-10-14T18:47:14.690146+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:09.154352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.683630+0000","last_change":"2023-10-14T18:47:13.673837+0000","last_active":"2023-10-14T18:47:14.683630+0000","last_peered":"2023-10-14T18:47:14.683630+0000","last_clean":"2023-10-14T18:47:14.683630+0000","last_became_active":"2023-10-14T18:47:13.672542+0000","last_became_peered":"2023-10-14T18:47:13.672542+0000","last_unstale":"2023-10-14T18:47:14.683630+0000","last_undegraded":"2023-10-14T18:47:14.683630+0000","last_fullsized":"2023-10-14T18:47:14.683630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:21.552032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687896+0000","last_change":"2023-10-14T18:47:14.686402+0000","last_active":"2023-10-14T18:47:14.687896+0000","last_peered":"2023-10-14T18:47:14.687896+0000","last_clean":"2023-10-14T18:47:14.687896+0000","last_became_active":"2023-10-14T18:47:14.685926+0000","last_became_peered":"2023-10-14T18:47:14.685926+0000","last_unstale":"2023-10-14T18:47:14.687896+0000","last_undegraded":"2023-10-14T18:47:14.687896+0000","last_fullsized":"2023-10-14T18:47:14.687896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:56.828824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.696736+0000","last_change":"2023-10-14T18:47:13.668077+0000","last_active":"2023-10-14T18:47:14.696736+0000","last_peered":"2023-10-14T18:47:14.696736+0000","last_clean":"2023-10-14T18:47:14.696736+0000","last_became_active":"2023-10-14T18:47:13.667849+0000","last_became_peered":"2023-10-14T18:47:13.667849+0000","last_unstale":"2023-10-14T18:47:14.696736+0000","last_undegraded":"2023-10-14T18:47:14.696736+0000","last_fullsized":"2023-10-14T18:47:14.696736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:32.176987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687856+0000","last_change":"2023-10-14T18:47:14.684838+0000","last_active":"2023-10-14T18:47:14.687856+0000","last_peered":"2023-10-14T18:47:14.687856+0000","last_clean":"2023-10-14T18:47:14.687856+0000","last_became_active":"2023-10-14T18:47:14.684593+0000","last_became_peered":"2023-10-14T18:47:14.684593+0000","last_unstale":"2023-10-14T18:47:14.687856+0000","last_undegraded":"2023-10-14T18:47:14.687856+0000","last_fullsized":"2023-10-14T18:47:14.687856+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.799181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-14T18:47:15.682664+0000","last_change":"2023-10-14T18:47:13.677720+0000","last_active":"2023-10-14T18:47:15.682664+0000","last_peered":"2023-10-14T18:47:15.682664+0000","last_clean":"2023-10-14T18:47:15.682664+0000","last_became_active":"2023-10-14T18:47:13.677414+0000","last_became_peered":"2023-10-14T18:47:13.677414+0000","last_unstale":"2023-10-14T18:47:15.682664+0000","last_undegraded":"2023-10-14T18:47:15.682664+0000","last_fullsized":"2023-10-14T18:47:15.682664+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:16.429871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691182+0000","last_change":"2023-10-14T18:47:14.690940+0000","last_active":"2023-10-14T18:47:14.691182+0000","last_peered":"2023-10-14T18:47:14.691182+0000","last_clean":"2023-10-14T18:47:14.691182+0000","last_became_active":"2023-10-14T18:47:14.690720+0000","last_became_peered":"2023-10-14T18:47:14.690720+0000","last_unstale":"2023-10-14T18:47:14.691182+0000","last_undegraded":"2023-10-14T18:47:14.691182+0000","last_fullsized":"2023-10-14T18:47:14.691182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:28:01.034865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.681273+0000","last_change":"2023-10-14T18:47:13.672788+0000","last_active":"2023-10-14T18:47:14.681273+0000","last_peered":"2023-10-14T18:47:14.681273+0000","last_clean":"2023-10-14T18:47:14.681273+0000","last_became_active":"2023-10-14T18:47:13.672541+0000","last_became_peered":"2023-10-14T18:47:13.672541+0000","last_unstale":"2023-10-14T18:47:14.681273+0000","last_undegraded":"2023-10-14T18:47:14.681273+0000","last_fullsized":"2023-10-14T18:47:14.681273+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:24:35.991627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.692064+0000","last_change":"2023-10-14T18:47:14.691830+0000","last_active":"2023-10-14T18:47:14.692064+0000","last_peered":"2023-10-14T18:47:14.692064+0000","last_clean":"2023-10-14T18:47:14.692064+0000","last_became_active":"2023-10-14T18:47:14.691436+0000","last_became_peered":"2023-10-14T18:47:14.691436+0000","last_unstale":"2023-10-14T18:47:14.692064+0000","last_undegraded":"2023-10-14T18:47:14.692064+0000","last_fullsized":"2023-10-14T18:47:14.692064+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:08:26.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.681312+0000","last_change":"2023-10-14T18:47:13.675914+0000","last_active":"2023-10-14T18:47:14.681312+0000","last_peered":"2023-10-14T18:47:14.681312+0000","last_clean":"2023-10-14T18:47:14.681312+0000","last_became_active":"2023-10-14T18:47:13.675698+0000","last_became_peered":"2023-10-14T18:47:13.675698+0000","last_unstale":"2023-10-14T18:47:14.681312+0000","last_undegraded":"2023-10-14T18:47:14.681312+0000","last_fullsized":"2023-10-14T18:47:14.681312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:58.412799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.691697+0000","last_change":"2023-10-14T18:47:14.691632+0000","last_active":"2023-10-14T18:47:14.691697+0000","last_peered":"2023-10-14T18:47:14.691697+0000","last_clean":"2023-10-14T18:47:14.691697+0000","last_became_active":"2023-10-14T18:47:14.690813+0000","last_became_peered":"2023-10-14T18:47:14.690813+0000","last_unstale":"2023-10-14T18:47:14.691697+0000","last_undegraded":"2023-10-14T18:47:14.691697+0000","last_fullsized":"2023-10-14T18:47:14.691697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:48:33.301608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.685365+0000","last_change":"2023-10-14T18:47:13.672325+0000","last_active":"2023-10-14T18:47:14.685365+0000","last_peered":"2023-10-14T18:47:14.685365+0000","last_clean":"2023-10-14T18:47:14.685365+0000","last_became_active":"2023-10-14T18:47:13.671853+0000","last_became_peered":"2023-10-14T18:47:13.671853+0000","last_unstale":"2023-10-14T18:47:14.685365+0000","last_undegraded":"2023-10-14T18:47:14.685365+0000","last_fullsized":"2023-10-14T18:47:14.685365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:58:59.573668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.687165+0000","last_change":"2023-10-14T18:47:14.684293+0000","last_active":"2023-10-14T18:47:14.687165+0000","last_peered":"2023-10-14T18:47:14.687165+0000","last_clean":"2023-10-14T18:47:14.687165+0000","last_became_active":"2023-10-14T18:47:14.683579+0000","last_became_peered":"2023-10-14T18:47:14.683579+0000","last_unstale":"2023-10-14T18:47:14.687165+0000","last_undegraded":"2023-10-14T18:47:14.687165+0000","last_fullsized":"2023-10-14T18:47:14.687165+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:37.427034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682890+0000","last_change":"2023-10-14T18:47:13.675741+0000","last_active":"2023-10-14T18:47:14.682890+0000","last_peered":"2023-10-14T18:47:14.682890+0000","last_clean":"2023-10-14T18:47:14.682890+0000","last_became_active":"2023-10-14T18:47:13.675512+0000","last_became_peered":"2023-10-14T18:47:13.675512+0000","last_unstale":"2023-10-14T18:47:14.682890+0000","last_undegraded":"2023-10-14T18:47:14.682890+0000","last_fullsized":"2023-10-14T18:47:14.682890+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:11.998966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.690135+0000","last_change":"2023-10-14T18:47:14.690100+0000","last_active":"2023-10-14T18:47:14.690135+0000","last_peered":"2023-10-14T18:47:14.690135+0000","last_clean":"2023-10-14T18:47:14.690135+0000","last_became_active":"2023-10-14T18:47:14.689833+0000","last_became_peered":"2023-10-14T18:47:14.689833+0000","last_unstale":"2023-10-14T18:47:14.690135+0000","last_undegraded":"2023-10-14T18:47:14.690135+0000","last_fullsized":"2023-10-14T18:47:14.690135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:06.162414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.680465+0000","last_change":"2023-10-14T18:47:13.672746+0000","last_active":"2023-10-14T18:47:14.680465+0000","last_peered":"2023-10-14T18:47:14.680465+0000","last_clean":"2023-10-14T18:47:14.680465+0000","last_became_active":"2023-10-14T18:47:13.672525+0000","last_became_peered":"2023-10-14T18:47:13.672525+0000","last_unstale":"2023-10-14T18:47:14.680465+0000","last_undegraded":"2023-10-14T18:47:14.680465+0000","last_fullsized":"2023-10-14T18:47:14.680465+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:35.663531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.685301+0000","last_change":"2023-10-14T18:47:14.685233+0000","last_active":"2023-10-14T18:47:14.685301+0000","last_peered":"2023-10-14T18:47:14.685301+0000","last_clean":"2023-10-14T18:47:14.685301+0000","last_became_active":"2023-10-14T18:47:14.684893+0000","last_became_peered":"2023-10-14T18:47:14.684893+0000","last_unstale":"2023-10-14T18:47:14.685301+0000","last_undegraded":"2023-10-14T18:47:14.685301+0000","last_fullsized":"2023-10-14T18:47:14.685301+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:59.202690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.682888+0000","last_change":"2023-10-14T18:47:13.674811+0000","last_active":"2023-10-14T18:47:14.682888+0000","last_peered":"2023-10-14T18:47:14.682888+0000","last_clean":"2023-10-14T18:47:14.682888+0000","last_became_active":"2023-10-14T18:47:13.674555+0000","last_became_peered":"2023-10-14T18:47:13.674555+0000","last_unstale":"2023-10-14T18:47:14.682888+0000","last_undegraded":"2023-10-14T18:47:14.682888+0000","last_fullsized":"2023-10-14T18:47:14.682888+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:22:24.140939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.684610+0000","last_change":"2023-10-14T18:47:14.684175+0000","last_active":"2023-10-14T18:47:14.684610+0000","last_peered":"2023-10-14T18:47:14.684610+0000","last_clean":"2023-10-14T18:47:14.684610+0000","last_became_active":"2023-10-14T18:47:14.683951+0000","last_became_peered":"2023-10-14T18:47:14.683951+0000","last_unstale":"2023-10-14T18:47:14.684610+0000","last_undegraded":"2023-10-14T18:47:14.684610+0000","last_fullsized":"2023-10-14T18:47:14.684610+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:13.660645+0000","last_clean_scrub_stamp":"2023-10-14T18:47:13.660645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:06.452577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.681331+0000","last_change":"2023-10-14T18:47:13.675697+0000","last_active":"2023-10-14T18:47:14.681331+0000","last_peered":"2023-10-14T18:47:14.681331+0000","last_clean":"2023-10-14T18:47:14.681331+0000","last_became_active":"2023-10-14T18:47:13.675477+0000","last_became_peered":"2023-10-14T18:47:13.675477+0000","last_unstale":"2023-10-14T18:47:14.681331+0000","last_undegraded":"2023-10-14T18:47:14.681331+0000","last_fullsized":"2023-10-14T18:47:14.681331+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:47:12.655543+0000","last_clean_scrub_stamp":"2023-10-14T18:47:12.655543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:32.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":210,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-10-14T18:47:14.678043+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:47:14.678043+0000","last_peered":"2023-10-14T18:47:14.678043+0000","last_clean":"2023-10-14T18:47:14.678043+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:47:14.678043+0000","last_undegraded":"2023-10-14T18:47:14.678043+0000","last_fullsized":"2023-10-14T18:47:14.678043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75700000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36199999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.64500000000000002,"15min":0.66700000000000004},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.84899999999999998,"15min":0.89900000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83999999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.437,"15min":0.438},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.376},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67500000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.438}]},{"osd":5,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67000000000000004,"5min":0.745,"15min":0.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.41999999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:47:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77500000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.40799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656192,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.33200000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66000000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.435}]},{"osd":1,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.753,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.40799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72499999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.89600000000000002,"15min":0.95999999999999996},"min":{"1min":0.38100000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64000000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34300000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72899999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.312}]},{"osd":7,"last update":"Sat Oct 14 18:47:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.32300000000000001,"15min":0.32700000000000001},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.45300000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24399999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.47899999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33700000000000002,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.46899999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.255,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.50800000000000001,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.441}]},{"osd":3,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.78500000000000003,"15min":0.85099999999999998},"min":{"1min":0.30599999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53100000000000003,"5min":10.574,"15min":10.574},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.371,"15min":0.375},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.443,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.27800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.57099999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.91500000000000004,"5min":1.125,"15min":1.125},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76100000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86799999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82099999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59399999999999997,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.73499999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.63400000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.81200000000000006,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.90700000000000003,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":913,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194399,"statfs":{"total":200000000,"available":199064745,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.315,"15min":0.317},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.24399999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.25,"5min":0.249,"15min":0.249},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.378}]},{"osd":3,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.26500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76400000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.58999999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:47:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.247},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34100000000000003,"15min":0.34300000000000003},"min":{"1min":0.23699999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56699999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.317}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.375,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77800000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.60299999999999998},"min":{"1min":0.41799999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.79800000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.497}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85599999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.62},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.42099999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":335,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199656136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.50700000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34200000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.38}]},{"osd":2,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.374,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54900000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.371},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36199999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.622},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60099999999999998,"15min":0.60699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.52700000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:47:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":337,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194975,"statfs":{"total":200000000,"available":199654656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.497,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57799999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.33900000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.50600000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.62,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.63100000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.374},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69099999999999995,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71399999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.71099999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.625},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68999999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:47:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79300000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.44400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":336,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194976,"statfs":{"total":200000000,"available":199655568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.66900000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.50800000000000001,"15min":0.503},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.68999999999999995}]},{"osd":1,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40699999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65500000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.40200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.52100000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55400000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.872,"15min":0.872},"last":0.377},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76200000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.42099999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72499999999999998,"5min":0.746,"15min":0.746},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77700000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.64200000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:47:23.634 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:47:23.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:47:23.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 Processor -- start 2023-10-14T18:47:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 -- start start 2023-10-14T18:47:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9d0159ec0 0x7fc9d00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d006acb0 0x7fc9d00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00b0790 con 0x7fc9d015a290 2023-10-14T18:47:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00ce1f0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.790+0000 7fc9d5222700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b0b20 con 0x7fc9d006acb0 2023-10-14T18:47:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9d0159ec0 0x7fc9d00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9d0159ec0 0x7fc9d00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33124/0 (socket says 172.21.15.79:33124) 2023-10-14T18:47:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 -- 172.21.15.79:0/951192181 learned_addr learned my addr 172.21.15.79:0/951192181 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 -- 172.21.15.79:0/951192181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d006acb0 msgr2=0x7fc9d00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 --2- 172.21.15.79:0/951192181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d006acb0 0x7fc9d00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 -- 172.21.15.79:0/951192181 >> v1:172.21.15.144:6789/0 conn(0x7fc9d015a290 legacy=0x7fc9d006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 -- 172.21.15.79:0/951192181 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00b04b0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ced9d700 1 --2- 172.21.15.79:0/951192181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d00af940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00099b0 tx=0x7fc9c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d956cdc03e7722f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ce59c700 1 -- 172.21.15.79:0/951192181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000b820 con 0x7fc9d0159ec0 2023-10-14T18:47:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ce59c700 1 -- 172.21.15.79:0/951192181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000b980 con 0x7fc9d0159ec0 2023-10-14T18:47:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.791+0000 7fc9ce59c700 1 -- 172.21.15.79:0/951192181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bd20 con 0x7fc9d0159ec0 2023-10-14T18:47:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 -- 172.21.15.79:0/951192181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 msgr2=0x7fc9d00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 --2- 172.21.15.79:0/951192181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d00af940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00099b0 tx=0x7fc9c0009250 comp rx=0 tx=0).stop 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 -- 172.21.15.79:0/951192181 shutdown_connections 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 --2- 172.21.15.79:0/951192181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d006acb0 0x7fc9d00afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 --2- 172.21.15.79:0/951192181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d00af940 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 -- 172.21.15.79:0/951192181 >> 172.21.15.79:0/951192181 conn(0x7fc9d00d1880 msgr2=0x7fc9d00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 -- 172.21.15.79:0/951192181 shutdown_connections 2023-10-14T18:47:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.792+0000 7fc9d5222700 1 -- 172.21.15.79:0/951192181 wait complete. 2023-10-14T18:47:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.793+0000 7fc9d5222700 1 Processor -- start 2023-10-14T18:47:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.793+0000 7fc9d5222700 1 -- start start 2023-10-14T18:47:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9d006acb0 0x7fc9d015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d015a290 0x7fc9d01545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0160400 con 0x7fc9d0159ec0 2023-10-14T18:47:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c86f0 con 0x7fc9d006acb0 2023-10-14T18:47:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00c89d0 con 0x7fc9d015a290 2023-10-14T18:47:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33134/0 (socket says 172.21.15.79:33134) 2023-10-14T18:47:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 -- 172.21.15.79:0/2420397467 learned_addr learned my addr 172.21.15.79:0/2420397467 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9ced9d700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9d006acb0 0x7fc9d015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9cf59e700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d015a290 0x7fc9d01545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 -- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d015a290 msgr2=0x7fc9d01545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d015a290 0x7fc9d01545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 -- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9d006acb0 msgr2=0x7fc9d015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9d006acb0 0x7fc9d015fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 -- 172.21.15.79:0/2420397467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00094f0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c659c700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b5e0 tx=0x7fc9b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800f510 con 0x7fc9d0159ec0 2023-10-14T18:47:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800f690 con 0x7fc9d0159ec0 2023-10-14T18:47:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00c8cb0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800fa50 con 0x7fc9d0159ec0 2023-10-14T18:47:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.794+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d01569e0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.795+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d00c8ef0 con 0x7fc9d0159ec0 2023-10-14T18:47:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.796+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9b801a400 con 0x7fc9d0159ec0 2023-10-14T18:47:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.796+0000 7fc9c77fe700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.796+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9b8083f20 con 0x7fc9d0159ec0 2023-10-14T18:47:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.797+0000 7fc9ced9d700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.797+0000 7fc9ced9d700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 0x7fc9b00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00099b0 tx=0x7fc9c0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:23.801+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9d00c8ef0 con 0x7fc9d0159ec0 2023-10-14T18:47:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.056+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc9d00c8ef0 con 0x7fc9d0159ec0 2023-10-14T18:47:24.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.060+0000 7fc9c77fe700 1 -- 172.21.15.79:0/2420397467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc9d00c8ef0 con 0x7fc9d0159ec0 2023-10-14T18:47:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 msgr2=0x7fc9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 0x7fc9b00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00099b0 tx=0x7fc9c0016000 comp rx=0 tx=0).stop 2023-10-14T18:47:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 msgr2=0x7fc9d01564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800b5e0 tx=0x7fc9b80090f0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 shutdown_connections 2023-10-14T18:47:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9d015a290 0x7fc9d01545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9d006acb0 0x7fc9d015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 --2- 172.21.15.79:0/2420397467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9d0159ec0 0x7fc9d01564a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 >> 172.21.15.79:0/2420397467 conn(0x7fc9d00d1880 msgr2=0x7fc9d00b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 shutdown_connections 2023-10-14T18:47:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.062+0000 7fc9d5222700 1 -- 172.21.15.79:0/2420397467 wait complete. 2023-10-14T18:47:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:47:24.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:24.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.188+0000 7fa65cf16700 1 Processor -- start 2023-10-14T18:47:24.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.188+0000 7fa65cf16700 1 -- start start 2023-10-14T18:47:24.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65cf16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 0x7fa65815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65cf16700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa65815d580 0x7fa658158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65cf16700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65815cbb0 con 0x7fa658157870 2023-10-14T18:47:24.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65cf16700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65815bdb0 con 0x7fa65815d580 2023-10-14T18:47:24.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65cf16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65815bfa0 con 0x7fa65815a620 2023-10-14T18:47:24.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa658157870 0x7fa65815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45180/0 (socket says 172.21.15.79:45180) 2023-10-14T18:47:24.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa65659c700 1 -- 172.21.15.79:0/4183140106 learned_addr learned my addr 172.21.15.79:0/4183140106 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:24.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/4183140106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 0x7fa65815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa656d9d700 1 --2- 172.21.15.79:0/4183140106 >> v2:172.21.15.144:3300/0 conn(0x7fa65815d580 0x7fa658158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa655d9b700 1 -- 172.21.15.79:0/4183140106 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496239964 0 0) 0x7fa65815cbb0 con 0x7fa658157870 2023-10-14T18:47:24.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.189+0000 7fa655d9b700 1 -- 172.21.15.79:0/4183140106 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa644003570 con 0x7fa658157870 2023-10-14T18:47:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa64dd9b700 1 -- 172.21.15.79:0/4183140106 >> v2:172.21.15.144:3300/0 conn(0x7fa65815d580 msgr2=0x7fa658158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/4183140106 >> v2:172.21.15.144:3300/0 conn(0x7fa65815d580 0x7fa658158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa64dd9b700 1 -- 172.21.15.79:0/4183140106 >> v1:172.21.15.79:6789/0 conn(0x7fa658157870 legacy=0x7fa65815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa64dd9b700 1 -- 172.21.15.79:0/4183140106 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65815c280 con 0x7fa65815a620 2023-10-14T18:47:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/4183140106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 0x7fa65815d040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa6400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efa6893dfe622de1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa655d9b700 1 -- 172.21.15.79:0/4183140106 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011630 con 0x7fa65815a620 2023-10-14T18:47:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa655d9b700 1 -- 172.21.15.79:0/4183140106 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640011790 con 0x7fa65815a620 2023-10-14T18:47:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa655d9b700 1 -- 172.21.15.79:0/4183140106 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011b30 con 0x7fa65815a620 2023-10-14T18:47:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa65cf16700 1 -- 172.21.15.79:0/4183140106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 msgr2=0x7fa65815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.190+0000 7fa65cf16700 1 --2- 172.21.15.79:0/4183140106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 0x7fa65815d040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa6400091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 -- 172.21.15.79:0/4183140106 shutdown_connections 2023-10-14T18:47:24.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 --2- 172.21.15.79:0/4183140106 >> v2:172.21.15.144:3300/0 conn(0x7fa65815d580 0x7fa658158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 --2- 172.21.15.79:0/4183140106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815a620 0x7fa65815d040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 -- 172.21.15.79:0/4183140106 >> 172.21.15.79:0/4183140106 conn(0x7fa658068ce0 msgr2=0x7fa6580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:24.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 -- 172.21.15.79:0/4183140106 shutdown_connections 2023-10-14T18:47:24.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.191+0000 7fa65cf16700 1 -- 172.21.15.79:0/4183140106 wait complete. 2023-10-14T18:47:24.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.192+0000 7fa65cf16700 1 Processor -- start 2023-10-14T18:47:24.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.192+0000 7fa65cf16700 1 -- start start 2023-10-14T18:47:24.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa658157870 0x7fa6580b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815d580 0x7fa6580b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65814d260 con 0x7fa65815a620 2023-10-14T18:47:24.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580b1b20 con 0x7fa658157870 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580b0f10 con 0x7fa65815d580 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33148/0 (socket says 172.21.15.79:33148) 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 -- 172.21.15.79:0/1151594276 learned_addr learned my addr 172.21.15.79:0/1151594276 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa656d9d700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815d580 0x7fa6580b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65659c700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa658157870 0x7fa6580b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 -- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815d580 msgr2=0x7fa6580b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815d580 0x7fa6580b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 -- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa658157870 msgr2=0x7fa6580b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa658157870 0x7fa6580b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 -- 172.21.15.79:0/1151594276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640009420 con 0x7fa65815a620 2023-10-14T18:47:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64dd9b700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa65815c0e0 tx=0x7fa640017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011b10 con 0x7fa65815a620 2023-10-14T18:47:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6400253f0 con 0x7fa65815a620 2023-10-14T18:47:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6400257b0 con 0x7fa65815a620 2023-10-14T18:47:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580b11f0 con 0x7fa65815a620 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.193+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6580b17b0 con 0x7fa65815a620 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.194+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65804c3c0 con 0x7fa65815a620 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.195+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa640025ba0 con 0x7fa65815a620 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.195+0000 7fa64effd700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 0x7fa638069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.195+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa640085e20 con 0x7fa65815a620 2023-10-14T18:47:24.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.195+0000 7fa65659c700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 0x7fa638069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.196+0000 7fa65659c700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 0x7fa638069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6480058d0 tx=0x7fa648009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.199+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa640053090 con 0x7fa65815a620 2023-10-14T18:47:24.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.425+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65815c560 con 0x7fa65815a620 2023-10-14T18:47:24.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.425+0000 7fa64effd700 1 -- 172.21.15.79:0/1151594276 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa6400566b0 con 0x7fa65815a620 2023-10-14T18:47:24.427 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:24.427 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:47:24.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 msgr2=0x7fa638069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 0x7fa638069410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6480058d0 tx=0x7fa648009040 comp rx=0 tx=0).stop 2023-10-14T18:47:24.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 msgr2=0x7fa65814cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa65815c0e0 tx=0x7fa640017000 comp rx=0 tx=0).stop 2023-10-14T18:47:24.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 shutdown_connections 2023-10-14T18:47:24.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa638066f60 0x7fa638069410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa65815d580 0x7fa6580b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa658157870 0x7fa6580b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 --2- 172.21.15.79:0/1151594276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa65815a620 0x7fa65814cd20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 >> 172.21.15.79:0/1151594276 conn(0x7fa658068ce0 msgr2=0x7fa65814fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:24.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 shutdown_connections 2023-10-14T18:47:24.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.428+0000 7fa65cf16700 1 -- 172.21.15.79:0/1151594276 wait complete. 2023-10-14T18:47:24.431 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:47:24.842 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:47:14.044149+0000', 'modified': '2023-10-14T18:47:17.699523+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5694}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5694': {'gid': 5694, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1574444833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 1574444833}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1574444833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:47:24.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:47:24.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T18:47:24.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 Processor -- start 2023-10-14T18:47:24.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 -- start start 2023-10-14T18:47:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32f0156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f0157c30 con 0x7f32f006da90 2023-10-14T18:47:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f01584f0 con 0x7f32f0156570 2023-10-14T18:47:24.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.960+0000 7f32f6084700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0157670 con 0x7f32f015a330 2023-10-14T18:47:24.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32effff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f32f006da90 0x7f32f0156e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45184/0 (socket says 172.21.15.79:45184) 2023-10-14T18:47:24.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32effff700 1 -- 172.21.15.79:0/3989167344 learned_addr learned my addr 172.21.15.79:0/3989167344 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:24.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333284302 0 0) 0x7f32f0157c30 con 0x7f32f006da90 2023-10-14T18:47:24.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d8003570 con 0x7f32f006da90 2023-10-14T18:47:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32eeffd700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32f0156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3929856945 0 0) 0x7f32d8003570 con 0x7f32f006da90 2023-10-14T18:47:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 msgr2=0x7f32f0156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32f0156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 >> v1:172.21.15.144:6789/0 conn(0x7f32f0156570 legacy=0x7f32f006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0157950 con 0x7f32f006da90 2023-10-14T18:47:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f32e8001470 con 0x7f32f006da90 2023-10-14T18:47:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 >> v1:172.21.15.79:6789/0 conn(0x7f32f006da90 legacy=0x7f32f0156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8003a90 0x7f32d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32d8004d50 0x7f32d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0157670 con 0x7f32d8004d50 2023-10-14T18:47:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d800bc20 con 0x7f32d8003a90 2023-10-14T18:47:24.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d800bde0 con 0x7f32f015a330 2023-10-14T18:47:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32effff700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32d8004d50 0x7f32d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8003a90 0x7f32d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.961+0000 7f32eeffd700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 -- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 msgr2=0x7f32d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f015a330 0x7f32d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 -- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8003a90 msgr2=0x7f32d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8003a90 0x7f32d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 -- 172.21.15.79:0/3989167344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8003570 con 0x7f32d8004d50 2023-10-14T18:47:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32d8004d50 0x7f32d80051c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f32f00af460 tx=0x7f32e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3658bf4d9f8caff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800cc00 con 0x7f32d8004d50 2023-10-14T18:47:24.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800cd60 con 0x7f32d8004d50 2023-10-14T18:47:24.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32ee7fc700 1 -- 172.21.15.79:0/3989167344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8005b70 con 0x7f32d8004d50 2023-10-14T18:47:24.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 -- 172.21.15.79:0/3989167344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32d8004d50 msgr2=0x7f32d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 --2- 172.21.15.79:0/3989167344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32d8004d50 0x7f32d80051c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f32f00af460 tx=0x7f32e8001e50 comp rx=0 tx=0).stop 2023-10-14T18:47:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32effff700 1 -- 172.21.15.79:0/3989167344 reap_dead start 2023-10-14T18:47:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 -- 172.21.15.79:0/3989167344 shutdown_connections 2023-10-14T18:47:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 -- 172.21.15.79:0/3989167344 >> 172.21.15.79:0/3989167344 conn(0x7f32f0067660 msgr2=0x7f32f0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 -- 172.21.15.79:0/3989167344 shutdown_connections 2023-10-14T18:47:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.962+0000 7f32f6084700 1 -- 172.21.15.79:0/3989167344 wait complete. 2023-10-14T18:47:24.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 Processor -- start 2023-10-14T18:47:24.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 -- start start 2023-10-14T18:47:24.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 0x7f32f016ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 0x7f32f00c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c9e20 con 0x7f32f00c8810 2023-10-14T18:47:24.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f016b140 con 0x7f32d8004d50 2023-10-14T18:47:24.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32f6084700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00c8380 con 0x7f32f00c9440 2023-10-14T18:47:24.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33172/0 (socket says 172.21.15.79:33172) 2023-10-14T18:47:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32eeffd700 1 -- 172.21.15.79:0/447068244 learned_addr learned my addr 172.21.15.79:0/447068244 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32effff700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 0x7f32f00c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.964+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 0x7f32f016ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 -- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 msgr2=0x7f32f00c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 0x7f32f00c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 -- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 msgr2=0x7f32f016ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 0x7f32f016ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 -- 172.21.15.79:0/447068244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00cc050 con 0x7f32f00c8810 2023-10-14T18:47:24.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32effff700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 0x7f32f00c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:24.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 0x7f32f016ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:24.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32eeffd700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f32e4011b70 tx=0x7f32e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32d77fe700 1 -- 172.21.15.79:0/447068244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400f9b0 con 0x7f32f00c8810 2023-10-14T18:47:24.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32d77fe700 1 -- 172.21.15.79:0/447068244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e400fb10 con 0x7f32f00c8810 2023-10-14T18:47:24.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f00cc330 con 0x7f32f00c8810 2023-10-14T18:47:24.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32d77fe700 1 -- 172.21.15.79:0/447068244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400fe90 con 0x7f32f00c8810 2023-10-14T18:47:24.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.965+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f00c8010 con 0x7f32f00c8810 2023-10-14T18:47:24.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.966+0000 7f32d77fe700 1 -- 172.21.15.79:0/447068244 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32e4014650 con 0x7f32f00c8810 2023-10-14T18:47:24.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.967+0000 7f32d77fe700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.967+0000 7f32d77fe700 1 -- 172.21.15.79:0/447068244 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32e4018030 con 0x7f32f00c8810 2023-10-14T18:47:24.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.967+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.967+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32e0001750 tx=0x7f32e0001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.968+0000 7f32ff37db80 1 Processor -- start 2023-10-14T18:47:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 -- start start 2023-10-14T18:47:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c055a50 0x555f0c055e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c07ef60 0x555f0c051cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0bfaca70 con 0x555f0c09fd00 2023-10-14T18:47:24.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0bfaa270 con 0x555f0c07ef60 2023-10-14T18:47:24.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.969+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0bfa6060 con 0x555f0c055a50 2023-10-14T18:47:24.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33176/0 (socket says 172.21.15.79:33176) 2023-10-14T18:47:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 -- 172.21.15.79:0/220615795 learned_addr learned my addr 172.21.15.79:0/220615795 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c055a50 0x555f0c055e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32effff700 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c07ef60 0x555f0c051cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 -- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c055a50 msgr2=0x555f0c055e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c055a50 0x555f0c055e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 -- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c07ef60 msgr2=0x555f0c051cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:24.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c07ef60 0x555f0c051cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 -- 172.21.15.79:0/220615795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f0be40270 con 0x555f0c09fd00 2023-10-14T18:47:24.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32eeffd700 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f32e4083790 tx=0x7f32e4083720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546ac9bb0c1a5e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:24.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32d4ff9700 1 -- 172.21.15.79:0/220615795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4054390 con 0x555f0c09fd00 2023-10-14T18:47:24.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32d4ff9700 1 -- 172.21.15.79:0/220615795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e40850d0 con 0x555f0c09fd00 2023-10-14T18:47:24.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.970+0000 7f32d4ff9700 1 -- 172.21.15.79:0/220615795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e40545f0 con 0x555f0c09fd00 2023-10-14T18:47:24.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- 172.21.15.79:0/220615795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 msgr2=0x555f0c07ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:24.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f32e4083790 tx=0x7f32e4083720 comp rx=0 tx=0).stop 2023-10-14T18:47:24.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- 172.21.15.79:0/220615795 shutdown_connections 2023-10-14T18:47:24.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c07ef60 0x555f0c051cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c055a50 0x555f0c055e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 --2- 172.21.15.79:0/220615795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c07ea20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:24.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- 172.21.15.79:0/220615795 >> 172.21.15.79:0/220615795 conn(0x555f0c057370 msgr2=0x555f0c057740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:24.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- 172.21.15.79:0/220615795 shutdown_connections 2023-10-14T18:47:24.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- 172.21.15.79:0/220615795 wait complete. 2023-10-14T18:47:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 -- start start 2023-10-14T18:47:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.971+0000 7f32ff37db80 1 Processor -- start 2023-10-14T18:47:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c07afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0bf51890 con 0x555f0c09fd00 2023-10-14T18:47:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0bf6cea0 con 0x555f0c055a50 2023-10-14T18:47:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0be28e30 con 0x555f0c07ef60 2023-10-14T18:47:24.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ff37db80 10 client.0 _ll_register_callbacks cb 0x555f0c019110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:47:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33182/0 (socket says 172.21.15.79:33182) 2023-10-14T18:47:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32effff700 1 -- 172.21.15.79:0/3662888503 learned_addr learned my addr 172.21.15.79:0/3662888503 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c07afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:24.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.972+0000 7f32eeffd700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 -- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 msgr2=0x555f0c09f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 -- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 msgr2=0x555f0c07afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c07afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 -- 172.21.15.79:0/3662888503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f00c8010 con 0x555f0c09fd00 2023-10-14T18:47:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32effff700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f32e8000c00 tx=0x7f32e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fba1353e3d6fc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:47:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800cc00 con 0x555f0c09fd00 2023-10-14T18:47:25.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32e8001430 con 0x555f0c09fd00 2023-10-14T18:47:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f0c04ab70 con 0x555f0c09fd00 2023-10-14T18:47:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e800ced0 con 0x555f0c09fd00 2023-10-14T18:47:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 10 client.5868 fetch_fsmap learned FSMap version 32 2023-10-14T18:47:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555f0bde2fe0 con 0x555f0c09fd00 2023-10-14T18:47:25.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f0c04ab70 con 0x555f0c09fd00 2023-10-14T18:47:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f32e80072e0 con 0x555f0c09fd00 2023-10-14T18:47:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 10 client.5868 fetch_fsmap finished waiting for FSMap version 32 2023-10-14T18:47:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 10 client.5868 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:47:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 20 client.5868 populate_metadata read hostname 'smithi079' 2023-10-14T18:47:25.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c095e70 0x555f0c096240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 4 client.5868 mds_command: new command op to 5694 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:47:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 --> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f0c027aa0 con 0x555f0c095e70 2023-10-14T18:47:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.973+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c095e70 0x555f0c096240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c095e70 0x555f0c096240 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dd4b84819cbd5b7 server_cookie=b52a40737d3482e8 in_seq=0 out_seq=0 2023-10-14T18:47:25.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32cdffb700 10 client.5868 ms_handle_connect on v2:172.21.15.79:6833/1574444833 2023-10-14T18:47:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32cdffb700 1 -- 172.21.15.79:0/3662888503 <== mds.0 v2:172.21.15.79:6833/1574444833 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555f0c027aa0 con 0x555f0c095e70 2023-10-14T18:47:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32cdffb700 10 client.5868 handle_command_reply: tid=0 2023-10-14T18:47:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 client.5868 shutdown 2023-10-14T18:47:25.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 msgr2=0x555f0c09f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f32e8000c00 tx=0x7f32e8015000 comp rx=0 tx=0).stop 2023-10-14T18:47:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 shutdown_connections 2023-10-14T18:47:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c095e70 0x555f0c096240 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f650 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32cdffb700 0 client.5868 ms_handle_reset on v2:172.21.15.79:6833/1574444833 2023-10-14T18:47:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c07afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 --2- 172.21.15.79:0/3662888503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.974+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 >> 172.21.15.79:0/3662888503 conn(0x555f0c057370 msgr2=0x555f0c0562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.975+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 shutdown_connections 2023-10-14T18:47:25.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.975+0000 7f32ff37db80 1 -- 172.21.15.79:0/3662888503 wait complete. 2023-10-14T18:47:25.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.975+0000 7f32ff37db80 20 client.5868 trim_cache size 0 max 16384 2023-10-14T18:47:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.991+0000 7f32ff37db80 1 Processor -- start 2023-10-14T18:47:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.991+0000 7f32ff37db80 1 -- start start 2023-10-14T18:47:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c09fd00 0x555f0c092560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c09c150 con 0x555f0c055a50 2023-10-14T18:47:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c059650 con 0x555f0c09fd00 2023-10-14T18:47:25.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0c0520e0 con 0x555f0c07ef60 2023-10-14T18:47:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33198/0 (socket says 172.21.15.79:33198) 2023-10-14T18:47:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 -- 172.21.15.79:0/230585532 learned_addr learned my addr 172.21.15.79:0/230585532 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32effff700 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c09fd00 0x555f0c092560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32eeffd700 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 -- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 msgr2=0x555f0c09f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 -- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c09fd00 msgr2=0x555f0c092560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c09fd00 0x555f0c092560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 -- 172.21.15.79:0/230585532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f0bf74780 con 0x555f0c055a50 2023-10-14T18:47:25.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.992+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f32e0010850 tx=0x7f32e002b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ead53282fcc9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32d57fa700 1 -- 172.21.15.79:0/230585532 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e002a070 con 0x555f0c055a50 2023-10-14T18:47:25.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32d57fa700 1 -- 172.21.15.79:0/230585532 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0017cd0 con 0x555f0c055a50 2023-10-14T18:47:25.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32d57fa700 1 -- 172.21.15.79:0/230585532 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0017e60 con 0x555f0c055a50 2023-10-14T18:47:25.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 -- 172.21.15.79:0/230585532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 msgr2=0x555f0c09f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f32e0010850 tx=0x7f32e002b250 comp rx=0 tx=0).stop 2023-10-14T18:47:25.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 -- 172.21.15.79:0/230585532 shutdown_connections 2023-10-14T18:47:25.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c09fd00 0x555f0c092560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c055a50 0x555f0c09f110 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 --2- 172.21.15.79:0/230585532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 -- 172.21.15.79:0/230585532 >> 172.21.15.79:0/230585532 conn(0x555f0c057370 msgr2=0x555f0c09d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 -- 172.21.15.79:0/230585532 shutdown_connections 2023-10-14T18:47:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.993+0000 7f32ff37db80 1 -- 172.21.15.79:0/230585532 wait complete. 2023-10-14T18:47:25.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 -- start start 2023-10-14T18:47:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 Processor -- start 2023-10-14T18:47:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c102020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c07a730 con 0x555f0c09fd00 2023-10-14T18:47:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f0c083c80 con 0x555f0c055a50 2023-10-14T18:47:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f0c081080 con 0x555f0c07ef60 2023-10-14T18:47:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.994+0000 7f32ff37db80 10 client.0 _ll_register_callbacks cb 0x555f0c097100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:47:25.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33212/0 (socket says 172.21.15.79:33212) 2023-10-14T18:47:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 -- 172.21.15.79:0/906982275 learned_addr learned my addr 172.21.15.79:0/906982275 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32eeffd700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 -- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 msgr2=0x555f0c09f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 -- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 msgr2=0x555f0c102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 -- 172.21.15.79:0/906982275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e000f040 con 0x555f0c09fd00 2023-10-14T18:47:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32eeffd700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32effff700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f32e80077c0 tx=0x7f32e8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e6d4b5919983e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:47:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8007840 con 0x555f0c09fd00 2023-10-14T18:47:25.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32e8000e40 con 0x555f0c09fd00 2023-10-14T18:47:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32e40850d0 con 0x555f0c09fd00 2023-10-14T18:47:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e8001430 con 0x555f0c09fd00 2023-10-14T18:47:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 10 client.5874 fetch_fsmap learned FSMap version 32 2023-10-14T18:47:25.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555f0bf5b470 con 0x555f0c09fd00 2023-10-14T18:47:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e40850d0 con 0x555f0c09fd00 2023-10-14T18:47:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f32e8028420 con 0x555f0c09fd00 2023-10-14T18:47:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 10 client.5874 fetch_fsmap finished waiting for FSMap version 32 2023-10-14T18:47:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 10 client.5874 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:47:25.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 20 client.5874 populate_metadata read hostname 'smithi079' 2023-10-14T18:47:25.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c082be0 0x555f0c082fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 4 client.5874 mds_command: new command op to 5694 tid=0[{"prefix": "status"}] 2023-10-14T18:47:25.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.995+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 --> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f0bf48e00 con 0x555f0c082be0 2023-10-14T18:47:25.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c082be0 0x555f0c082fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ef7fe700 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c082be0 0x555f0c082fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4ef9a45695740 server_cookie=627116af534dc8ce in_seq=0 out_seq=0 2023-10-14T18:47:25.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32cdffb700 10 client.5874 ms_handle_connect on v2:172.21.15.79:6833/1574444833 2023-10-14T18:47:25.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32cdffb700 1 -- 172.21.15.79:0/906982275 <== mds.0 v2:172.21.15.79:6833/1574444833 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555f0bf48e00 con 0x555f0c082be0 2023-10-14T18:47:25.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32cdffb700 10 client.5874 handle_command_reply: tid=0 2023-10-14T18:47:25.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 client.5874 shutdown 2023-10-14T18:47:25.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 msgr2=0x555f0c09f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f32e80077c0 tx=0x7f32e8007f90 comp rx=0 tx=0).stop 2023-10-14T18:47:25.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 shutdown_connections 2023-10-14T18:47:25.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:6833/1574444833,v1:172.21.15.79:6835/1574444833] conn(0x555f0c082be0 0x555f0c082fb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0c09fd00 0x555f0c09f5e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32cdffb700 0 client.5874 ms_handle_reset on v2:172.21.15.79:6833/1574444833 2023-10-14T18:47:25.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f0c055a50 0x555f0c102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 --2- 172.21.15.79:0/906982275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x555f0c07ef60 0x555f0c09f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 >> 172.21.15.79:0/906982275 conn(0x555f0c057370 msgr2=0x555f0c0ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 shutdown_connections 2023-10-14T18:47:25.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 1 -- 172.21.15.79:0/906982275 wait complete. 2023-10-14T18:47:25.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.996+0000 7f32ff37db80 20 client.5874 trim_cache size 0 max 16384 2023-10-14T18:47:25.033 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:47:25.034 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:47:25.034 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:47:25.034 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5694, 2023-10-14T18:47:25.034 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:47:25.035 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:47:25.035 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:47:25.035 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 10.309749827999999, 2023-10-14T18:47:25.035 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 32, 2023-10-14T18:47:25.035 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 67, 2023-10-14T18:47:25.036 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 67, 2023-10-14T18:47:25.036 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 16.298018157000001 2023-10-14T18:47:25.036 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:47:25.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 msgr2=0x7f32dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32e0001750 tx=0x7f32e0001640 comp rx=0 tx=0).stop 2023-10-14T18:47:25.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 msgr2=0x7f32f014ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f32e4011b70 tx=0x7f32e40091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 shutdown_connections 2023-10-14T18:47:25.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32f00c9440 0x7f32f00c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32d8004d50 0x7f32f016ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 --2- 172.21.15.79:0/447068244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32f00c8810 0x7f32f014ec10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 >> 172.21.15.79:0/447068244 conn(0x7f32f0067660 msgr2=0x7f32f0068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 shutdown_connections 2023-10-14T18:47:25.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:24.997+0000 7f32f6084700 1 -- 172.21.15.79:0/447068244 wait complete. 2023-10-14T18:47:25.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:47:25.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.155+0000 7fbbda326700 1 Processor -- start 2023-10-14T18:47:25.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.155+0000 7fbbda326700 1 -- start start 2023-10-14T18:47:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbda326700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbd40cd6e0 0x7fbbd40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbda326700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbbd40cdab0 0x7fbbd415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbda326700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40cb7c0 con 0x7fbbd415dda0 2023-10-14T18:47:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbda326700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd415e850 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbda326700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40cd030 con 0x7fbbd40cdab0 2023-10-14T18:47:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9324700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbd40cd6e0 0x7fbbd40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9b25700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbbd415dda0 0x7fbbd415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45192/0 (socket says 172.21.15.79:45192) 2023-10-14T18:47:25.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9b25700 1 -- 172.21.15.79:0/999192846 learned_addr learned my addr 172.21.15.79:0/999192846 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9324700 1 -- 172.21.15.79:0/999192846 >> v2:172.21.15.144:3300/0 conn(0x7fbbd40cdab0 msgr2=0x7fbbd415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd8b23700 1 --2- 172.21.15.79:0/999192846 >> v2:172.21.15.144:3300/0 conn(0x7fbbd40cdab0 0x7fbbd415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9324700 1 --2- 172.21.15.79:0/999192846 >> v2:172.21.15.144:3300/0 conn(0x7fbbd40cdab0 0x7fbbd415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9324700 1 -- 172.21.15.79:0/999192846 >> v1:172.21.15.79:6789/0 conn(0x7fbbd415dda0 legacy=0x7fbbd415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbcbfff700 1 -- 172.21.15.79:0/999192846 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893901923 0 0) 0x7fbbd40cb7c0 con 0x7fbbd415dda0 2023-10-14T18:47:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.156+0000 7fbbd9324700 1 -- 172.21.15.79:0/999192846 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd415e290 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbd9324700 1 --2- 172.21.15.79:0/999192846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd40cbc50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b6c70 tx=0x7fbbd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d77580e9694e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbcbfff700 1 -- 172.21.15.79:0/999192846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000e070 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbcbfff700 1 -- 172.21.15.79:0/999192846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000bc30 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbcbfff700 1 -- 172.21.15.79:0/999192846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0012430 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 -- 172.21.15.79:0/999192846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 msgr2=0x7fbbd40cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 --2- 172.21.15.79:0/999192846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd40cbc50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b6c70 tx=0x7fbbd0009780 comp rx=0 tx=0).stop 2023-10-14T18:47:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 -- 172.21.15.79:0/999192846 shutdown_connections 2023-10-14T18:47:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 --2- 172.21.15.79:0/999192846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd40cbc50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 --2- 172.21.15.79:0/999192846 >> v2:172.21.15.144:3300/0 conn(0x7fbbd40cdab0 0x7fbbd415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 -- 172.21.15.79:0/999192846 >> 172.21.15.79:0/999192846 conn(0x7fbbd4067660 msgr2=0x7fbbd4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 -- 172.21.15.79:0/999192846 shutdown_connections 2023-10-14T18:47:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.157+0000 7fbbda326700 1 -- 172.21.15.79:0/999192846 wait complete. 2023-10-14T18:47:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.158+0000 7fbbda326700 1 Processor -- start 2023-10-14T18:47:25.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 -- start start 2023-10-14T18:47:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbd40cdab0 0x7fbbd41586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd415dda0 0x7fbbd4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40b0130 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40b5430 con 0x7fbbd415dda0 2023-10-14T18:47:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbda326700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd415c0b0 con 0x7fbbd40cdab0 2023-10-14T18:47:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbd9324700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbd9324700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33242/0 (socket says 172.21.15.79:33242) 2023-10-14T18:47:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.159+0000 7fbbd9324700 1 -- 172.21.15.79:0/1628496360 learned_addr learned my addr 172.21.15.79:0/1628496360 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 -- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbd40cdab0 msgr2=0x7fbbd41586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbd40cdab0 0x7fbbd41586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 -- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd415dda0 msgr2=0x7fbbd4159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd415dda0 0x7fbbd4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 -- 172.21.15.79:0/1628496360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0009a20 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbd9324700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00099f0 tx=0x7fbbd0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0001090 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd001d630 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd415c390 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd001d9f0 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.160+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd40b50c0 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.161+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd4089280 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.161+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbd0024070 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.162+0000 7fbbc97fa700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:25.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.162+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbd0086d00 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.162+0000 7fbbd8b23700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:25.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.163+0000 7fbbd8b23700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 0x7fbbb80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b0600 tx=0x7fbbc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:25.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.166+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbd0053f70 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.390+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbbd415e570 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.391+0000 7fbbc97fa700 1 -- 172.21.15.79:0/1628496360 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbbd0057590 con 0x7fbbd40cd6e0 2023-10-14T18:47:25.392 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:47:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 msgr2=0x7fbbb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 0x7fbbb80693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40b0600 tx=0x7fbbc4008040 comp rx=0 tx=0).stop 2023-10-14T18:47:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 msgr2=0x7fbbd4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00099f0 tx=0x7fbbd0019000 comp rx=0 tx=0).stop 2023-10-14T18:47:25.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 shutdown_connections 2023-10-14T18:47:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbb8066f30 0x7fbbb80693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbd415dda0 0x7fbbd4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbd40cd6e0 0x7fbbd4155b80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 --2- 172.21.15.79:0/1628496360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbd40cdab0 0x7fbbd41586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:25.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 >> 172.21.15.79:0/1628496360 conn(0x7fbbd4067660 msgr2=0x7fbbd40b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:25.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 shutdown_connections 2023-10-14T18:47:25.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:25.393+0000 7fbbda326700 1 -- 172.21.15.79:0/1628496360 wait complete. 2023-10-14T18:47:25.405 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:47:25.406 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:47:25.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:47:25.406 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:47:25.407 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:47:25.407 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:47:25.407 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:47:25.408 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:47:25.408 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:47:25.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.409 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:47:25.425 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:47:25.425 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:47:25.425 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:47:25.425 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.426 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:47:25.426 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.426 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:25.426 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:25.427 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:47:25.427 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:25.427 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:25.428 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:47:25.428 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:25.428 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:25.428 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:47:25.428 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:25.429 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:47:25.429 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-10-14T18:47:25.429 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:47:25.429 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.429 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:47:25.430 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:25.430 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:47:25.430 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.430 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:47:25.430 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:47:25.431 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:47:25.432 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:47:25.432 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:25.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.433 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:47:25.488 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:47:25.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.490 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:47:25.547 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:47:25.548 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:47:25.548 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:47:25.548 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:47:25.549 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:47:25.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.550 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:47:25.551 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:47:25.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:47:25.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:47:25.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:47:25.553 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:47:25.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.647 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:47:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:47:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:47:25.662 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:47:25.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:47:25.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:47:25.728 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:47:25.782 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:47:25.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:47:25.783 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:47:25.837 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:47:25.838 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:47:25.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:47:25.917 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:47:25.917 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:47:25.917 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:47:25.925 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:47:25.925 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:47:25.926 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:47:25.926 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:47:25.926 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:47:25.947 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:47:25.948 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:47:25.948 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:47:25.948 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:47:25.948 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:47:25.949 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:47:25.949 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:47:25.949 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:47:25.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:47:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:25.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:47:26.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:47:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.168+0000 7f13f22e8700 1 Processor -- start 2023-10-14T18:47:26.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.168+0000 7f13f22e8700 1 -- start start 2023-10-14T18:47:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f22e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13ec156980 0x7f13ec0ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:26.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f22e8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec0ad5c0 con 0x7f13ec0cbf10 2023-10-14T18:47:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f22e8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec0ac9b0 con 0x7f13ec0cd420 2023-10-14T18:47:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f22e8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec0acc90 con 0x7f13ec156980 2023-10-14T18:47:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f12e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f13ec156980 0x7f13ec0ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f1ae7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f13ec0cbf10 0x7f13ec06d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45196/0 (socket says 172.21.15.79:45196) 2023-10-14T18:47:26.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f1ae7700 1 -- 172.21.15.79:0/2235400544 learned_addr learned my addr 172.21.15.79:0/2235400544 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:47:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f12e6700 1 -- 172.21.15.79:0/2235400544 >> v1:172.21.15.144:6789/0 conn(0x7f13ec0cd420 legacy=0x7f13ec0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f12e6700 1 -- 172.21.15.79:0/2235400544 >> v1:172.21.15.79:6789/0 conn(0x7f13ec0cbf10 legacy=0x7f13ec06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13e3fff700 1 -- 172.21.15.79:0/2235400544 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356981843 0 0) 0x7f13ec0ad5c0 con 0x7f13ec0cbf10 2023-10-14T18:47:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.169+0000 7f13f12e6700 1 -- 172.21.15.79:0/2235400544 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec0acf70 con 0x7f13ec156980 2023-10-14T18:47:26.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f12e6700 1 --2- 172.21.15.79:0/2235400544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec156980 0x7f13ec0ac0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f13e80098e0 tx=0x7f13e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0f6052b8bf743a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13e3fff700 1 -- 172.21.15.79:0/2235400544 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8009e80 con 0x7f13ec156980 2023-10-14T18:47:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13e3fff700 1 -- 172.21.15.79:0/2235400544 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e800b860 con 0x7f13ec156980 2023-10-14T18:47:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13e3fff700 1 -- 172.21.15.79:0/2235400544 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800bbe0 con 0x7f13ec156980 2023-10-14T18:47:26.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 -- 172.21.15.79:0/2235400544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec156980 msgr2=0x7f13ec0ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 --2- 172.21.15.79:0/2235400544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec156980 0x7f13ec0ac0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f13e80098e0 tx=0x7f13e80091a0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 -- 172.21.15.79:0/2235400544 shutdown_connections 2023-10-14T18:47:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 --2- 172.21.15.79:0/2235400544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec156980 0x7f13ec0ac0d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 -- 172.21.15.79:0/2235400544 >> 172.21.15.79:0/2235400544 conn(0x7f13ec0680e0 msgr2=0x7f13ec0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:26.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 -- 172.21.15.79:0/2235400544 shutdown_connections 2023-10-14T18:47:26.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.170+0000 7f13f22e8700 1 -- 172.21.15.79:0/2235400544 wait complete. 2023-10-14T18:47:26.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.171+0000 7f13f22e8700 1 Processor -- start 2023-10-14T18:47:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.171+0000 7f13f22e8700 1 -- start start 2023-10-14T18:47:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec0cbf10 0x7f13ec16c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 0x7f13ec159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:26.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec158c90 con 0x7f13ec0cd420 2023-10-14T18:47:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec158f70 con 0x7f13ec156980 2023-10-14T18:47:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f22e8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec159250 con 0x7f13ec0cbf10 2023-10-14T18:47:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f0ae5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f0ae5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33264/0 (socket says 172.21.15.79:33264) 2023-10-14T18:47:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.172+0000 7f13f0ae5700 1 -- 172.21.15.79:0/3662743901 learned_addr learned my addr 172.21.15.79:0/3662743901 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f12e6700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec0cbf10 0x7f13ec16c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f1ae7700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 0x7f13ec159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:26.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 -- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec0cbf10 msgr2=0x7f13ec16c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec0cbf10 0x7f13ec16c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 -- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 msgr2=0x7f13ec159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 0x7f13ec159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 -- 172.21.15.79:0/3662743901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8009420 con 0x7f13ec0cd420 2023-10-14T18:47:26.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f1ae7700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 0x7f13ec159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f0ae5700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c7c0 tx=0x7f13dc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc011590 con 0x7f13ec0cd420 2023-10-14T18:47:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc011710 con 0x7f13ec0cd420 2023-10-14T18:47:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec159530 con 0x7f13ec0cd420 2023-10-14T18:47:26.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc011ad0 con 0x7f13ec0cd420 2023-10-14T18:47:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.173+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec159f90 con 0x7f13ec0cd420 2023-10-14T18:47:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.174+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec159720 con 0x7f13ec0cd420 2023-10-14T18:47:26.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.174+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13dc01b3b0 con 0x7f13ec0cd420 2023-10-14T18:47:26.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.175+0000 7f13e17fa700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 0x7f13d0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:26.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.175+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13dc083980 con 0x7f13ec0cd420 2023-10-14T18:47:26.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.175+0000 7f13f12e6700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 0x7f13d0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:26.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.175+0000 7f13f12e6700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 0x7f13d0069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13e80093f0 tx=0x7f13e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:26.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.179+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13dc050bf0 con 0x7f13ec0cd420 2023-10-14T18:47:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.407+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13ec04bb80 con 0x7f13ec0cd420 2023-10-14T18:47:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.407+0000 7f13e17fa700 1 -- 172.21.15.79:0/3662743901 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f13dc017070 con 0x7f13ec0cd420 2023-10-14T18:47:26.408 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:47:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 msgr2=0x7f13d0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 0x7f13d0069410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f13e80093f0 tx=0x7f13e8017000 comp rx=0 tx=0).stop 2023-10-14T18:47:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 msgr2=0x7f13ec156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c7c0 tx=0x7f13dc007f50 comp rx=0 tx=0).stop 2023-10-14T18:47:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 shutdown_connections 2023-10-14T18:47:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13d0066f60 0x7f13d0069410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13ec156980 0x7f13ec159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13ec0cbf10 0x7f13ec16c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 --2- 172.21.15.79:0/3662743901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13ec0cd420 0x7f13ec156d50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 >> 172.21.15.79:0/3662743901 conn(0x7f13ec0680e0 msgr2=0x7f13ec151190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 shutdown_connections 2023-10-14T18:47:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:26.409+0000 7f13f22e8700 1 -- 172.21.15.79:0/3662743901 wait complete. 2023-10-14T18:47:26.422 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:47:26.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:47:26.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:47:26.423 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:47:26.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:47:26.423 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:47:26.424 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:47:26.424 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:47:26.424 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:47:26.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.425 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:47:26.445 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:47:26.446 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:47:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:47:26.447 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:47:26.448 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.448 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:26.449 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:47:26.450 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:26.450 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:47:26.451 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:47:26.451 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:26.452 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:47:26.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:47:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42380sec preferred_lft 42380sec 2023-10-14T18:47:26.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:47:26.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.454 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:47:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:47:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:47:26.455 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:47:26.456 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.457 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:47:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:47:26.457 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:47:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.458 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:47:26.458 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:47:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:47:26.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:47:26.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.461 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:47:26.513 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:47:26.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.516 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:47:26.572 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:47:26.572 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:47:26.573 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:47:26.573 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:47:26.573 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:47:26.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.574 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:47:26.574 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:47:26.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:47:26.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:47:26.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:47:26.576 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:47:26.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.679 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:47:26.695 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:47:26.695 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:47:26.695 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:47:26.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:47:26.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:47:26.762 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:47:26.816 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:47:26.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:47:26.817 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:47:26.871 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:47:26.871 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:47:26.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:47:26.950 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:47:26.950 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:47:26.951 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:47:26.959 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:47:26.959 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:47:26.959 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:47:26.959 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:47:26.959 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:47:26.980 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:47:26.980 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:47:26.981 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:47:26.981 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:47:26.981 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:47:26.981 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:47:26.981 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:47:26.982 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:47:26.983 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:47:26.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:47:26.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:47:27.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:47:27.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.162+0000 7f1a4ffff700 1 Processor -- start 2023-10-14T18:47:27.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.162+0000 7f1a4ffff700 1 -- start start 2023-10-14T18:47:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4ffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a5015aea0 0x7f1a500d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4ffff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a500cf0c0 con 0x7f1a50153e50 2023-10-14T18:47:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4ffff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5015e8f0 con 0x7f1a5015aea0 2023-10-14T18:47:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5015b340 con 0x7f1a500d0970 2023-10-14T18:47:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4e7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a5015aea0 0x7f1a500d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4e7fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a5015aea0 0x7f1a500d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:52788/0 (socket says 172.21.15.79:52788) 2023-10-14T18:47:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4f7fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1a50153e50 0x7f1a501542b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:59750/0 (socket says 172.21.15.79:59750) 2023-10-14T18:47:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4e7fc700 1 -- 172.21.15.79:0/633236270 learned_addr learned my addr 172.21.15.79:0/633236270 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.163+0000 7f1a4effd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:50910/0 (socket says 172.21.15.79:50910) 2023-10-14T18:47:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4e7fc700 1 -- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 msgr2=0x7f1a5015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:47:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4e7fc700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4e7fc700 1 -- 172.21.15.79:0/633236270 >> v1:172.21.15.144:6789/0 conn(0x7f1a50153e50 legacy=0x7f1a501542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4e7fc700 1 -- 172.21.15.79:0/633236270 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500d1280 con 0x7f1a5015aea0 2023-10-14T18:47:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4effd700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:47:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4dffb700 1 -- 172.21.15.79:0/633236270 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956819857 0 0) 0x7f1a500cf0c0 con 0x7f1a50153e50 2023-10-14T18:47:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4e7fc700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a5015aea0 0x7f1a500d0d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a380099b0 tx=0x7f1a38009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed9190bc295326c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4dffb700 1 -- 172.21.15.79:0/633236270 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38009ea0 con 0x7f1a5015aea0 2023-10-14T18:47:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4dffb700 1 -- 172.21.15.79:0/633236270 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800b860 con 0x7f1a5015aea0 2023-10-14T18:47:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.164+0000 7f1a4dffb700 1 -- 172.21.15.79:0/633236270 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bc00 con 0x7f1a5015aea0 2023-10-14T18:47:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 -- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a5015aea0 msgr2=0x7f1a500d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a5015aea0 0x7f1a500d0d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a380099b0 tx=0x7f1a38009250 comp rx=0 tx=0).stop 2023-10-14T18:47:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 -- 172.21.15.79:0/633236270 shutdown_connections 2023-10-14T18:47:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a500d0970 0x7f1a5015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/633236270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a5015aea0 0x7f1a500d0d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 -- 172.21.15.79:0/633236270 >> 172.21.15.79:0/633236270 conn(0x7f1a50068c00 msgr2=0x7f1a50069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 -- 172.21.15.79:0/633236270 shutdown_connections 2023-10-14T18:47:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.165+0000 7f1a4ffff700 1 -- 172.21.15.79:0/633236270 wait complete. 2023-10-14T18:47:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.166+0000 7f1a4ffff700 1 Processor -- start 2023-10-14T18:47:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.166+0000 7f1a4ffff700 1 -- start start 2023-10-14T18:47:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a500d0970 0x7f1a501504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 0x7f1a501573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501542b0 con 0x7f1a5015aea0 2023-10-14T18:47:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a50154b10 con 0x7f1a500d0970 2023-10-14T18:47:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501509e0 con 0x7f1a50153e50 2023-10-14T18:47:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33278/0 (socket says 172.21.15.79:33278) 2023-10-14T18:47:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 -- 172.21.15.79:0/1585584172 learned_addr learned my addr 172.21.15.79:0/1585584172 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:47:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4effd700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a500d0970 0x7f1a501504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4e7fc700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 0x7f1a501573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 -- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 msgr2=0x7f1a501573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 0x7f1a501573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 -- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a500d0970 msgr2=0x7f1a501504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a500d0970 0x7f1a501504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 -- 172.21.15.79:0/1585584172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a40009a20 con 0x7f1a5015aea0 2023-10-14T18:47:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4e7fc700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 0x7f1a501573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:47:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4f7fe700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c5e0 tx=0x7f1a48007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48005a70 con 0x7f1a5015aea0 2023-10-14T18:47:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48005bd0 con 0x7f1a5015aea0 2023-10-14T18:47:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480070d0 con 0x7f1a5015aea0 2023-10-14T18:47:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.167+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a380094f0 con 0x7f1a5015aea0 2023-10-14T18:47:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.168+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a501544c0 con 0x7f1a5015aea0 2023-10-14T18:47:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.168+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a50089290 con 0x7f1a5015aea0 2023-10-14T18:47:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.169+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a48007480 con 0x7f1a5015aea0 2023-10-14T18:47:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.169+0000 7f1a46ffd700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 0x7f1a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:47:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.169+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a48083a70 con 0x7f1a5015aea0 2023-10-14T18:47:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.169+0000 7f1a4effd700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 0x7f1a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:47:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.170+0000 7f1a4effd700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 0x7f1a300693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1a500b3260 tx=0x7f1a4000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:47:27.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.173+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a48050c40 con 0x7f1a5015aea0 2023-10-14T18:47:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.397+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a5015e050 con 0x7f1a5015aea0 2023-10-14T18:47:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.398+0000 7f1a46ffd700 1 -- 172.21.15.79:0/1585584172 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f1a48017070 con 0x7f1a5015aea0 2023-10-14T18:47:27.399 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:47:27.399 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:47:27.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 msgr2=0x7f1a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 0x7f1a300693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1a500b3260 tx=0x7f1a4000b040 comp rx=0 tx=0).stop 2023-10-14T18:47:27.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 msgr2=0x7f1a500b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:47:27.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c5e0 tx=0x7f1a48007d60 comp rx=0 tx=0).stop 2023-10-14T18:47:27.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 shutdown_connections 2023-10-14T18:47:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1a30066f30 0x7f1a300693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5015aea0 0x7f1a500b2570 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a500d0970 0x7f1a501504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 --2- 172.21.15.79:0/1585584172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a50153e50 0x7f1a501573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:47:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 >> 172.21.15.79:0/1585584172 conn(0x7f1a50068c00 msgr2=0x7f1a501527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:47:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 shutdown_connections 2023-10-14T18:47:27.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:47:27.400+0000 7f1a4ffff700 1 -- 172.21.15.79:0/1585584172 wait complete. 2023-10-14T18:47:27.404 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:47:27.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:47:27.546 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":5694,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.848791401,"mdsmap_epoch":32,"osdmap_epoch":67,"osdmap_epoch_barrier":67,"uptime":18.837060463} 2023-10-14T18:47:27.547 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 5694, "mdsmap_epoch": 32, "osdmap_epoch": 67, "osdmap_epoch_barrier": 67, "rank_uptime": 12.848791401, "state": "up:active", "uptime": 18.837060463, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:47:27.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:47:27.677 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:47:27.678 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:47:27.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-14T18:47:27.802 INFO:teuthology.orchestra.run.smithi079.stdout:{"mon_tick_interval":"5"} 2023-10-14T18:47:27.802 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-14T18:47:27.803 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-10-14T18:47:27.803 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:47:27.804 DEBUG:teuthology.orchestra.run.smithi079:> import time 2023-10-14T18:47:27.804 DEBUG:teuthology.orchestra.run.smithi079:> import datetime 2023-10-14T18:47:27.805 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-14T18:47:27.805 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:47:27.805 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.806 DEBUG:teuthology.orchestra.run.smithi079:> # Write some buffered data through before going full, all should be well 2023-10-14T18:47:27.806 DEBUG:teuthology.orchestra.run.smithi079:> print("writing some data through which we expect to succeed") 2023-10-14T18:47:27.806 DEBUG:teuthology.orchestra.run.smithi079:> bytes = 0 2023-10-14T18:47:27.807 DEBUG:teuthology.orchestra.run.smithi079:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-14T18:47:27.807 DEBUG:teuthology.orchestra.run.smithi079:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-14T18:47:27.807 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-14T18:47:27.808 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:47:27.808 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-14T18:47:27.808 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.809 DEBUG:teuthology.orchestra.run.smithi079:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-14T18:47:27.809 DEBUG:teuthology.orchestra.run.smithi079:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-14T18:47:27.809 DEBUG:teuthology.orchestra.run.smithi079:> # buffered IO, the error should always only appear from fsync and not 2023-10-14T18:47:27.810 DEBUG:teuthology.orchestra.run.smithi079:> # from write 2023-10-14T18:47:27.810 DEBUG:teuthology.orchestra.run.smithi079:> full = False 2023-10-14T18:47:27.810 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.811 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(531 * 0.9)): 2023-10-14T18:47:27.811 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:47:27.812 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-14T18:47:27.812 DEBUG:teuthology.orchestra.run.smithi079:> print("done writing {0} bytes".format(bytes)) 2023-10-14T18:47:27.812 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.813 DEBUG:teuthology.orchestra.run.smithi079:> # OK, now we should sneak in under the full condition 2023-10-14T18:47:27.813 DEBUG:teuthology.orchestra.run.smithi079:> # due to the time it takes the OSDs to report to the 2023-10-14T18:47:27.813 DEBUG:teuthology.orchestra.run.smithi079:> # mons, and get a successful fsync on our full-making data 2023-10-14T18:47:27.814 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:47:27.814 DEBUG:teuthology.orchestra.run.smithi079:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-14T18:47:27.814 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.815 DEBUG:teuthology.orchestra.run.smithi079:> # buffered write, add more dirty data to the buffer 2023-10-14T18:47:27.815 DEBUG:teuthology.orchestra.run.smithi079:> print("starting buffered write") 2023-10-14T18:47:27.816 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:47:27.816 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(531 * 0.2)): 2023-10-14T18:47:27.816 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:47:27.817 DEBUG:teuthology.orchestra.run.smithi079:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-14T18:47:27.817 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(15.0) 2023-10-14T18:47:27.817 DEBUG:teuthology.orchestra.run.smithi079:> except OSError: 2023-10-14T18:47:27.818 DEBUG:teuthology.orchestra.run.smithi079:> pass; 2023-10-14T18:47:27.818 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.818 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-14T18:47:27.819 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.819 DEBUG:teuthology.orchestra.run.smithi079:> # Wait long enough for a background flush that should fail 2023-10-14T18:47:27.819 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(30) 2023-10-14T18:47:27.820 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.820 DEBUG:teuthology.orchestra.run.smithi079:> if False: 2023-10-14T18:47:27.820 DEBUG:teuthology.orchestra.run.smithi079:> # ...and check that the failed background flush is reflected in fclose 2023-10-14T18:47:27.821 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:47:27.821 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:47:27.821 DEBUG:teuthology.orchestra.run.smithi079:> except OSError: 2023-10-14T18:47:27.822 DEBUG:teuthology.orchestra.run.smithi079:> print("close() returned an error as expected") 2023-10-14T18:47:27.822 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:47:27.822 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("close() failed to raise error") 2023-10-14T18:47:27.823 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:47:27.823 DEBUG:teuthology.orchestra.run.smithi079:> # The kernel cephfs client does not raise errors on fclose 2023-10-14T18:47:27.823 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:47:27.824 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:47:27.824 DEBUG:teuthology.orchestra.run.smithi079:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-14T18:47:27.824 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:47:28.764 INFO:teuthology.orchestra.run.smithi079.stdout:writing some data through which we expect to succeed 2023-10-14T18:47:28.764 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-14T18:47:28.764 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-14T18:47:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-14T18:47:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-14T18:47:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-14T18:47:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-14T18:47:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-14T18:47:28.766 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-14T18:47:28.766 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-14T18:47:28.766 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-14T18:47:28.766 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-14T18:47:28.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-14T18:47:28.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-14T18:47:28.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-14T18:47:28.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-14T18:47:28.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-14T18:47:28.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-14T18:47:28.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-14T18:47:28.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-14T18:47:28.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-14T18:47:28.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-14T18:47:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-14T18:47:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-14T18:47:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-14T18:47:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-14T18:47:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-14T18:47:28.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-14T18:47:28.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-14T18:47:28.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-14T18:47:28.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-14T18:47:28.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-14T18:47:28.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-14T18:47:28.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-14T18:47:28.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-14T18:47:28.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-14T18:47:28.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-14T18:47:28.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-14T18:47:28.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-14T18:47:28.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-14T18:47:28.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-14T18:47:28.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-14T18:47:28.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-14T18:47:28.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-14T18:47:28.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-14T18:47:28.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-14T18:47:28.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-14T18:47:28.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-14T18:47:28.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-14T18:47:28.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-14T18:47:28.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-14T18:47:28.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-14T18:47:28.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-14T18:47:28.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-14T18:47:28.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-14T18:47:28.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-14T18:47:28.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-14T18:47:28.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-14T18:47:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-14T18:47:28.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-14T18:47:28.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-14T18:47:28.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-14T18:47:28.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-14T18:47:28.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-14T18:47:28.779 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-14T18:47:28.779 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-14T18:47:28.779 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-14T18:47:28.779 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-14T18:47:28.779 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-14T18:47:28.780 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-14T18:47:28.780 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-14T18:47:28.780 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-14T18:47:28.780 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-14T18:47:28.780 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-14T18:47:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-14T18:47:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-14T18:47:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-14T18:47:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-14T18:47:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-14T18:47:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-14T18:47:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-14T18:47:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-14T18:47:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-14T18:47:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-14T18:47:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-14T18:47:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-14T18:47:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-14T18:47:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-14T18:47:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-14T18:47:28.784 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-14T18:47:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-14T18:47:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-14T18:47:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-14T18:47:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-14T18:47:28.785 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-14T18:47:28.786 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-14T18:47:28.786 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-14T18:47:28.786 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-14T18:47:28.786 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-14T18:47:28.786 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-14T18:47:28.787 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-14T18:47:28.787 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-14T18:47:28.787 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-14T18:47:28.787 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-14T18:47:28.787 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-14T18:47:28.788 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-14T18:47:28.788 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-14T18:47:28.788 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-14T18:47:28.788 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-14T18:47:28.788 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-14T18:47:28.789 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-14T18:47:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-14T18:47:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-14T18:47:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-14T18:47:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-14T18:47:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-14T18:47:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-14T18:47:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-14T18:47:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-14T18:47:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-14T18:47:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-14T18:47:28.792 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-14T18:47:28.792 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-14T18:47:28.792 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-14T18:47:28.792 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-14T18:47:28.792 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-14T18:47:28.793 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-14T18:47:28.794 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-14T18:47:28.794 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-14T18:47:28.794 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-14T18:47:28.794 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-14T18:47:28.812 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-14T18:47:28.812 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-14T18:47:28.813 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-14T18:47:28.813 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-14T18:47:28.813 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-14T18:47:28.813 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-14T18:47:28.813 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-14T18:47:28.814 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-14T18:47:28.814 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-14T18:47:28.814 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-14T18:47:28.814 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-14T18:47:28.815 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-14T18:47:28.815 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-14T18:47:28.815 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-14T18:47:28.815 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-14T18:47:28.815 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-14T18:47:28.816 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-14T18:47:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-14T18:47:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-14T18:47:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-14T18:47:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-14T18:47:28.817 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-14T18:47:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-14T18:47:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-14T18:47:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-14T18:47:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-14T18:47:28.818 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-14T18:47:28.819 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-14T18:47:28.819 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-14T18:47:28.819 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-14T18:47:28.819 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-14T18:47:28.819 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-14T18:47:28.820 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-14T18:47:28.820 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-14T18:47:28.820 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-14T18:47:28.820 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-14T18:47:28.820 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-14T18:47:28.821 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-14T18:47:28.821 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-14T18:47:28.821 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-14T18:47:28.821 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-14T18:47:28.821 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-14T18:47:28.822 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-14T18:47:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-14T18:47:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-14T18:47:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-14T18:47:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-14T18:47:28.823 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-14T18:47:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-14T18:47:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-14T18:47:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-14T18:47:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-14T18:47:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-14T18:47:28.825 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-14T18:47:28.825 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-14T18:47:28.825 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-14T18:47:28.825 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-14T18:47:28.825 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-14T18:47:28.826 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-14T18:47:28.826 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-14T18:47:28.826 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-14T18:47:28.826 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-14T18:47:28.826 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-14T18:47:28.827 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-14T18:47:28.827 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-14T18:47:28.827 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-14T18:47:28.827 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-14T18:47:28.827 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-14T18:47:28.828 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-14T18:47:28.828 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-14T18:47:28.828 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-14T18:47:28.828 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-14T18:47:28.828 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-14T18:47:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-14T18:47:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-14T18:47:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-14T18:47:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-14T18:47:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-14T18:47:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-14T18:47:28.831 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-14T18:47:28.831 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-14T18:47:28.831 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-14T18:47:28.831 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-14T18:47:28.831 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-14T18:47:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-14T18:47:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-14T18:47:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-14T18:47:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-14T18:47:28.832 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-14T18:47:28.833 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-14T18:47:28.833 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-14T18:47:28.833 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-14T18:47:28.833 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-14T18:47:28.833 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-14T18:47:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-14T18:47:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-14T18:47:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-14T18:47:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-14T18:47:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-14T18:47:28.835 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-14T18:47:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-14T18:47:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-14T18:47:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-14T18:47:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-14T18:47:28.836 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-14T18:47:28.837 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-14T18:47:28.837 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-14T18:47:28.837 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-14T18:47:28.837 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-14T18:47:28.837 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-14T18:47:28.838 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-14T18:47:28.838 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-14T18:47:28.838 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-14T18:47:28.838 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-14T18:47:28.838 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-14T18:47:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-14T18:47:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-14T18:47:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-14T18:47:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-14T18:47:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-14T18:47:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-14T18:47:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-14T18:47:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-14T18:47:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-14T18:47:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-14T18:47:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-14T18:47:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-14T18:47:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-14T18:47:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-14T18:47:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-14T18:47:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-14T18:47:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-14T18:47:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-14T18:47:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-14T18:47:28.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-14T18:47:28.860 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-14T18:47:28.860 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-14T18:47:28.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-14T18:47:28.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-14T18:47:28.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-14T18:47:28.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-14T18:47:28.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-14T18:47:28.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-14T18:47:28.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-14T18:47:28.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-14T18:47:28.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-14T18:47:28.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-14T18:47:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-14T18:47:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-14T18:47:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-14T18:47:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-14T18:47:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-14T18:47:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-14T18:47:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-14T18:47:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-14T18:47:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-14T18:47:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-14T18:47:28.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-14T18:47:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-14T18:47:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-14T18:47:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-14T18:47:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-14T18:47:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-14T18:47:28.867 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-14T18:47:28.867 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-14T18:47:28.867 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-14T18:47:28.867 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-14T18:47:28.867 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-14T18:47:28.868 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-14T18:47:28.868 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-14T18:47:28.868 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-14T18:47:28.868 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-14T18:47:28.868 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-14T18:47:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-14T18:47:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-14T18:47:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-14T18:47:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-14T18:47:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-14T18:47:28.870 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-14T18:47:28.870 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-14T18:47:28.870 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-14T18:47:28.870 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-14T18:47:28.870 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-14T18:47:28.871 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-14T18:47:28.871 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-14T18:47:28.871 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-14T18:47:28.871 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-14T18:47:28.871 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-14T18:47:28.872 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-14T18:47:28.872 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-14T18:47:28.872 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-14T18:47:28.872 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-14T18:47:28.872 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-14T18:47:28.873 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-14T18:47:28.874 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-14T18:47:28.874 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-14T18:47:28.874 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-14T18:47:28.874 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-14T18:47:28.874 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-14T18:47:28.875 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-14T18:47:28.875 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-14T18:47:28.875 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-14T18:47:28.875 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-14T18:47:28.875 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-14T18:47:28.876 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-14T18:47:28.876 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-14T18:47:28.876 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-14T18:47:28.876 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-14T18:47:28.876 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-14T18:47:28.877 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-14T18:47:28.877 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-14T18:47:28.877 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-14T18:47:28.877 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-14T18:47:28.877 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-14T18:47:28.878 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-14T18:47:28.879 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-14T18:47:28.879 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-14T18:47:28.879 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-14T18:47:28.879 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-14T18:47:28.879 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-14T18:47:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-14T18:47:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-14T18:47:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-14T18:47:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-14T18:47:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-14T18:47:28.881 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-14T18:47:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-14T18:47:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-14T18:47:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-14T18:47:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-14T18:47:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-14T18:47:28.883 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-14T18:47:28.883 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-14T18:47:28.883 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-14T18:47:28.883 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-14T18:47:28.883 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-14T18:47:28.884 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-14T18:47:28.884 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-14T18:47:28.884 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-14T18:47:28.884 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-14T18:47:28.884 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-14T18:47:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-14T18:47:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-14T18:47:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-14T18:47:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-14T18:47:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-14T18:47:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-14T18:47:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-14T18:47:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-14T18:47:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-14T18:47:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-14T18:47:28.887 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-14T18:47:28.887 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-14T18:47:28.887 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-14T18:47:28.887 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-14T18:47:28.887 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-14T18:47:28.888 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-14T18:47:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-14T18:47:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-14T18:47:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-14T18:47:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-14T18:47:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-14T18:47:28.890 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-14T18:47:28.890 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-14T18:47:28.890 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-14T18:47:30.728 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:47:30.728+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-10-14T18:47:37.493 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:47:37.494+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-14T18:47:39.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:39.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:09.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:09.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:39.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:39.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-14T18:48:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-14T18:48:44.301 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-14T18:48:44.301 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-14T18:48:44.301 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-14T18:48:44.301 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-14T18:48:44.302 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-14T18:48:44.302 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-14T18:48:44.302 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-14T18:48:44.302 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-14T18:48:44.302 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-14T18:48:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-14T18:48:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-14T18:48:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:done writing 500695040 bytes 2023-10-14T18:48:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:successfully fsync'ed prior to getting full state reported 2023-10-14T18:48:44.303 INFO:teuthology.orchestra.run.smithi079.stdout:starting buffered write 2023-10-14T18:48:44.304 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:48:44.304 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:48:44.304 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:48:44.304 INFO:teuthology.orchestra.run.smithi079.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-14T18:48:44.385 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:48:44.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:48:44.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:48:44.473 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:48:44.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:48:44.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:48:44.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:48:44.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:48:44.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:48:44.518 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:48:44.573 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:48:44.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:48:44.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:48:44.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:48:44.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:48:44.626 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:48:44.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:48:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.786+0000 7f2fdbd11700 1 Processor -- start 2023-10-14T18:48:44.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.787+0000 7f2fdbd11700 1 -- start start 2023-10-14T18:48:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fdbd11700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2fd40af1e0 0x7f2fd40b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fdbd11700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2fd40af5b0 0x7f2fd40b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fdbd11700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd40b2890 con 0x7f2fd406f470 2023-10-14T18:48:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fdbd11700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40b1c80 con 0x7f2fd40af5b0 2023-10-14T18:48:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fdbd11700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd40b1f60 con 0x7f2fd40af1e0 2023-10-14T18:48:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2fd40af5b0 0x7f2fd40b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2fd40af5b0 0x7f2fd40b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39376/0 (socket says 172.21.15.79:39376) 2023-10-14T18:48:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 -- 172.21.15.79:0/2345315611 learned_addr learned my addr 172.21.15.79:0/2345315611 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd9aad700 1 --2- 172.21.15.79:0/2345315611 >> v2:172.21.15.144:3300/0 conn(0x7f2fd40af1e0 0x7f2fd40b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 -- 172.21.15.79:0/2345315611 >> v2:172.21.15.144:3300/0 conn(0x7f2fd40af1e0 msgr2=0x7f2fd40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 --2- 172.21.15.79:0/2345315611 >> v2:172.21.15.144:3300/0 conn(0x7f2fd40af1e0 0x7f2fd40b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 -- 172.21.15.79:0/2345315611 >> v1:172.21.15.79:6789/0 conn(0x7f2fd406f470 legacy=0x7f2fd4159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.788+0000 7f2fd92ac700 1 -- 172.21.15.79:0/2345315611 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40b2240 con 0x7f2fd40af5b0 2023-10-14T18:48:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.789+0000 7f2fd92ac700 1 --2- 172.21.15.79:0/2345315611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd40b1680 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40afca0 tx=0x7f2fd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb0885b80d098ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:44.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.789+0000 7f2fd8aab700 1 -- 172.21.15.79:0/2345315611 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000b860 con 0x7f2fd40af5b0 2023-10-14T18:48:44.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.789+0000 7f2fd8aab700 1 -- 172.21.15.79:0/2345315611 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000b9c0 con 0x7f2fd40af5b0 2023-10-14T18:48:44.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.789+0000 7f2fd8aab700 1 -- 172.21.15.79:0/2345315611 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000bd40 con 0x7f2fd40af5b0 2023-10-14T18:48:44.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 -- 172.21.15.79:0/2345315611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 msgr2=0x7f2fd40b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:44.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/2345315611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd40b1680 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40afca0 tx=0x7f2fd0009250 comp rx=0 tx=0).stop 2023-10-14T18:48:44.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 -- 172.21.15.79:0/2345315611 shutdown_connections 2023-10-14T18:48:44.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/2345315611 >> v2:172.21.15.144:3300/0 conn(0x7f2fd40af1e0 0x7f2fd40b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:44.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/2345315611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd40b1680 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:44.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 -- 172.21.15.79:0/2345315611 >> 172.21.15.79:0/2345315611 conn(0x7f2fd40cd1e0 msgr2=0x7f2fd40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:44.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 -- 172.21.15.79:0/2345315611 shutdown_connections 2023-10-14T18:48:44.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.790+0000 7f2fdbd11700 1 -- 172.21.15.79:0/2345315611 wait complete. 2023-10-14T18:48:44.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.792+0000 7f2fdbd11700 1 Processor -- start 2023-10-14T18:48:44.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.792+0000 7f2fdbd11700 1 -- start start 2023-10-14T18:48:44.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 0x7f2fd4159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd40af1e0 0x7f2fd416da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd415abc0 con 0x7f2fd40af5b0 2023-10-14T18:48:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4159fb0 con 0x7f2fd40af1e0 2023-10-14T18:48:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.793+0000 7f2fdbd11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd415a290 con 0x7f2fd406f470 2023-10-14T18:48:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39388/0 (socket says 172.21.15.79:39388) 2023-10-14T18:48:44.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fd9aad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 0x7f2fd4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 -- 172.21.15.79:0/3456286802 learned_addr learned my addr 172.21.15.79:0/3456286802 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fd92ac700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd40af1e0 0x7f2fd416da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 -- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 msgr2=0x7f2fd4159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 0x7f2fd4159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 -- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd40af1e0 msgr2=0x7f2fd416da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd40af1e0 0x7f2fd416da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00094f0 con 0x7f2fd40af5b0 2023-10-14T18:48:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fd9aad700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 0x7f2fd4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:48:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.794+0000 7f2fda2ae700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c8e0 tx=0x7f2fcc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.795+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc012630 con 0x7f2fd40af5b0 2023-10-14T18:48:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.795+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc012790 con 0x7f2fd40af5b0 2023-10-14T18:48:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.795+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc012b10 con 0x7f2fd40af5b0 2023-10-14T18:48:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.795+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd415a570 con 0x7f2fd40af5b0 2023-10-14T18:48:44.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.796+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd415bf00 con 0x7f2fd40af5b0 2023-10-14T18:48:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.797+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd415ad30 con 0x7f2fd40af5b0 2023-10-14T18:48:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.798+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fcc01a3a0 con 0x7f2fd40af5b0 2023-10-14T18:48:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.798+0000 7f2fc9ffb700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 0x7f2fb80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:44.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.798+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fcc084630 con 0x7f2fd40af5b0 2023-10-14T18:48:44.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.798+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f2fb806eb20 con 0x7f2fd40af5b0 2023-10-14T18:48:44.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.799+0000 7f2fd9aad700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 0x7f2fb80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.804+0000 7f2fd9aad700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 0x7f2fb80694b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4006fd0 tx=0x7f2fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:44.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:44.806+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fcc051920 con 0x7f2fd40af5b0 2023-10-14T18:48:45.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.052+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fd404c3c0 con 0x7f2fd40af5b0 2023-10-14T18:48:45.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.053+0000 7f2fc9ffb700 1 -- 172.21.15.79:0/3456286802 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f2fcc054f40 con 0x7f2fd40af5b0 2023-10-14T18:48:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:45.054 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:48:45.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 msgr2=0x7f2fb80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 0x7f2fb80694b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4006fd0 tx=0x7f2fc4008040 comp rx=0 tx=0).stop 2023-10-14T18:48:45.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 msgr2=0x7f2fd416df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c8e0 tx=0x7f2fcc001710 comp rx=0 tx=0).stop 2023-10-14T18:48:45.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 shutdown_connections 2023-10-14T18:48:45.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2fb8067000 0x7f2fb80694b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fd40af5b0 0x7f2fd416df90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2fd406f470 0x7f2fd4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 --2- 172.21.15.79:0/3456286802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fd40af1e0 0x7f2fd416da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 >> 172.21.15.79:0/3456286802 conn(0x7f2fd40cd1e0 msgr2=0x7f2fd4154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.054+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 shutdown_connections 2023-10-14T18:48:45.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.055+0000 7f2fdbd11700 1 -- 172.21.15.79:0/3456286802 wait complete. 2023-10-14T18:48:45.058 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:48:45.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:48:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.181+0000 7fb229747700 1 Processor -- start 2023-10-14T18:48:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.181+0000 7fb229747700 1 -- start start 2023-10-14T18:48:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb229747700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2240cd6e0 0x7fb2240cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb229747700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240cb7c0 con 0x7fb22415cbd0 2023-10-14T18:48:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb229747700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22415e290 con 0x7fb2240cdab0 2023-10-14T18:48:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb229747700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415e850 con 0x7fb2240cd6e0 2023-10-14T18:48:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb228f46700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb22415cbd0 0x7fb22415d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51866/0 (socket says 172.21.15.79:51866) 2023-10-14T18:48:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb228f46700 1 -- 172.21.15.79:0/2471340019 learned_addr learned my addr 172.21.15.79:0/2471340019 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb223fff700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2240cd6e0 0x7fb2240cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63916797 0 0) 0x7fb2240cb7c0 con 0x7fb22415cbd0 2023-10-14T18:48:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb20c003570 con 0x7fb22415cbd0 2023-10-14T18:48:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262275261 0 0) 0x7fb22415e290 con 0x7fb2240cdab0 2023-10-14T18:48:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2240cb7c0 con 0x7fb2240cdab0 2023-10-14T18:48:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.182+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051503387 0 0) 0x7fb20c003570 con 0x7fb22415cbd0 2023-10-14T18:48:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2240cd6e0 msgr2=0x7fb2240cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2240cd6e0 0x7fb2240cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 >> v1:172.21.15.144:6789/0 conn(0x7fb2240cdab0 legacy=0x7fb22415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22415e570 con 0x7fb22415cbd0 2023-10-14T18:48:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb21c0017f0 con 0x7fb22415cbd0 2023-10-14T18:48:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 >> v1:172.21.15.79:6789/0 conn(0x7fb22415cbd0 legacy=0x7fb22415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb20c003c20 0x7fb20c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb20c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20c0051c0 0x7fb20c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415e850 con 0x7fb20c004810 2023-10-14T18:48:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c00c020 con 0x7fb20c0051c0 2023-10-14T18:48:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c00c1e0 con 0x7fb20c003c20 2023-10-14T18:48:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb223fff700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2240cd6e0 0x7fb2240cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:48:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb20c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb228f46700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20c0051c0 0x7fb20c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb223fff700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb20c003c20 0x7fb20c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 -- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb20c003c20 msgr2=0x7fb20c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb20c003c20 0x7fb20c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 -- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20c0051c0 msgr2=0x7fb20c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb20c0051c0 0x7fb20c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 -- 172.21.15.79:0/2471340019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c003570 con 0x7fb20c004810 2023-10-14T18:48:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb2237fe700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb20c004c80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb218001a10 tx=0x7fb218007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fb51ab93742f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800c5d0 con 0x7fb20c004810 2023-10-14T18:48:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21800c730 con 0x7fb20c004810 2023-10-14T18:48:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.183+0000 7fb222ffd700 1 -- 172.21.15.79:0/2471340019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800caf0 con 0x7fb20c004810 2023-10-14T18:48:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 -- 172.21.15.79:0/2471340019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 msgr2=0x7fb20c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 --2- 172.21.15.79:0/2471340019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb20c004c80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb218001a10 tx=0x7fb218007d10 comp rx=0 tx=0).stop 2023-10-14T18:48:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb228f46700 1 -- 172.21.15.79:0/2471340019 reap_dead start 2023-10-14T18:48:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 -- 172.21.15.79:0/2471340019 shutdown_connections 2023-10-14T18:48:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 -- 172.21.15.79:0/2471340019 >> 172.21.15.79:0/2471340019 conn(0x7fb224067660 msgr2=0x7fb224067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 -- 172.21.15.79:0/2471340019 shutdown_connections 2023-10-14T18:48:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.184+0000 7fb229747700 1 -- 172.21.15.79:0/2471340019 wait complete. 2023-10-14T18:48:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.185+0000 7fb229747700 1 Processor -- start 2023-10-14T18:48:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.185+0000 7fb229747700 1 -- start start 2023-10-14T18:48:45.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2241592b0 0x7fb2240b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2240b5460 0x7fb22416d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b5890 con 0x7fb20c004810 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240c8990 con 0x7fb2240b5460 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb229747700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415bf40 con 0x7fb2241592b0 2023-10-14T18:48:45.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39408/0 (socket says 172.21.15.79:39408) 2023-10-14T18:48:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 -- 172.21.15.79:0/3862816052 learned_addr learned my addr 172.21.15.79:0/3862816052 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb228f46700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2240b5460 0x7fb22416d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb2237fe700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2241592b0 0x7fb2240b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 -- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2241592b0 msgr2=0x7fb2240b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2241592b0 0x7fb2240b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 -- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2240b5460 msgr2=0x7fb22416d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2240b5460 0x7fb22416d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240c8c30 con 0x7fb20c004810 2023-10-14T18:48:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.186+0000 7fb223fff700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb214011910 tx=0x7fb214008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214015670 con 0x7fb20c004810 2023-10-14T18:48:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140157d0 con 0x7fb20c004810 2023-10-14T18:48:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240c8f10 con 0x7fb20c004810 2023-10-14T18:48:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214015b90 con 0x7fb20c004810 2023-10-14T18:48:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22416dd60 con 0x7fb20c004810 2023-10-14T18:48:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.187+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224089280 con 0x7fb20c004810 2023-10-14T18:48:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.188+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb214013410 con 0x7fb20c004810 2023-10-14T18:48:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.188+0000 7fb20bfff700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.188+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb214084c50 con 0x7fb20c004810 2023-10-14T18:48:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.188+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fb21006ea50 con 0x7fb20c004810 2023-10-14T18:48:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.188+0000 7fb2237fe700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.189+0000 7fb2237fe700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 0x7fb2100693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb218001ed0 tx=0x7fb218015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.192+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb21408a020 con 0x7fb20c004810 2023-10-14T18:48:45.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.375+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb22404bb80 con 0x7fb20c004810 2023-10-14T18:48:45.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.376+0000 7fb20bfff700 1 -- 172.21.15.79:0/3862816052 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+15408 (secure 0 0 0) 0x7fb214022070 con 0x7fb20c004810 2023-10-14T18:48:45.377 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:45.377 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":70,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:47:33.494805+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:48:45.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 msgr2=0x7fb2100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 0x7fb2100693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb218001ed0 tx=0x7fb218015000 comp rx=0 tx=0).stop 2023-10-14T18:48:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 msgr2=0x7fb2240b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb214011910 tx=0x7fb214008040 comp rx=0 tx=0).stop 2023-10-14T18:48:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 shutdown_connections 2023-10-14T18:48:45.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb210066f30 0x7fb2100693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2240b5460 0x7fb22416d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb20c004810 0x7fb2240b49e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 --2- 172.21.15.79:0/3862816052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb2241592b0 0x7fb2240b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 >> 172.21.15.79:0/3862816052 conn(0x7fb224067660 msgr2=0x7fb2240b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 shutdown_connections 2023-10-14T18:48:45.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.378+0000 7fb229747700 1 -- 172.21.15.79:0/3862816052 wait complete. 2023-10-14T18:48:45.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:47:11.901490+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:47:13.012436+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:48:45.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:48:45.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.508+0000 7f0af6243700 1 Processor -- start 2023-10-14T18:48:45.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.508+0000 7f0af6243700 1 -- start start 2023-10-14T18:48:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0af6243700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0af00d05a0 0x7f0af0164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0af6243700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b0790 con 0x7f0af0159ec0 2023-10-14T18:48:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0af6243700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00ce1f0 con 0x7f0af015a290 2023-10-14T18:48:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0af6243700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00b0b20 con 0x7f0af00d05a0 2023-10-14T18:48:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0aef7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0af0159ec0 0x7f0af00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51874/0 (socket says 172.21.15.79:51874) 2023-10-14T18:48:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0aef7fe700 1 -- 172.21.15.79:0/503845760 learned_addr learned my addr 172.21.15.79:0/503845760 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620558904 0 0) 0x7f0af00b0790 con 0x7f0af0159ec0 2023-10-14T18:48:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad8003570 con 0x7f0af0159ec0 2023-10-14T18:48:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.509+0000 7f0aeffff700 1 --2- 172.21.15.79:0/503845760 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d05a0 0x7f0af0164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568854934 0 0) 0x7f0ad8003570 con 0x7f0af0159ec0 2023-10-14T18:48:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d05a0 msgr2=0x7f0af0164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 --2- 172.21.15.79:0/503845760 >> v2:172.21.15.144:3300/0 conn(0x7f0af00d05a0 0x7f0af0164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 >> v1:172.21.15.144:6789/0 conn(0x7f0af015a290 legacy=0x7f0af006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00b04b0 con 0x7f0af0159ec0 2023-10-14T18:48:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0ae00017f0 con 0x7f0af0159ec0 2023-10-14T18:48:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 >> v1:172.21.15.79:6789/0 conn(0x7f0af0159ec0 legacy=0x7f0af00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ad80051c0 0x7f0ad800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b0b20 con 0x7f0ad8003a60 2023-10-14T18:48:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad800c160 con 0x7f0ad8004810 2023-10-14T18:48:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad800c320 con 0x7f0ad80051c0 2023-10-14T18:48:45.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aeeffd700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aeffff700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ad80051c0 0x7f0ad800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 -- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ad80051c0 msgr2=0x7f0ad800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ad80051c0 0x7f0ad800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 -- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8004810 msgr2=0x7f0ad8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8004810 0x7f0ad8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 -- 172.21.15.79:0/503845760 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad8003570 con 0x7f0ad8003a60 2023-10-14T18:48:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aeffff700 1 -- 172.21.15.79:0/503845760 reap_dead start 2023-10-14T18:48:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a930 tx=0x7f0ae00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf65fd4684195d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00070d0 con 0x7f0ad8003a60 2023-10-14T18:48:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0007230 con 0x7f0ad8003a60 2023-10-14T18:48:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.510+0000 7f0aee7fc700 1 -- 172.21.15.79:0/503845760 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00075d0 con 0x7f0ad8003a60 2023-10-14T18:48:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 -- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 msgr2=0x7f0ad8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a930 tx=0x7f0ae00021d0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 -- 172.21.15.79:0/503845760 shutdown_connections 2023-10-14T18:48:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 --2- 172.21.15.79:0/503845760 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ad8003a60 0x7f0ad8003e70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 -- 172.21.15.79:0/503845760 >> 172.21.15.79:0/503845760 conn(0x7f0af00d1880 msgr2=0x7f0af00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 -- 172.21.15.79:0/503845760 shutdown_connections 2023-10-14T18:48:45.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.511+0000 7f0af6243700 1 -- 172.21.15.79:0/503845760 wait complete. 2023-10-14T18:48:45.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.512+0000 7f0af6243700 1 Processor -- start 2023-10-14T18:48:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.512+0000 7f0af6243700 1 -- start start 2023-10-14T18:48:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 0x7f0af014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 0x7f0af00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0156730 con 0x7f0af0158ab0 2023-10-14T18:48:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00cfe40 con 0x7f0ad8003a60 2023-10-14T18:48:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0af6243700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b4800 con 0x7f0af00cf490 2023-10-14T18:48:45.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39432/0 (socket says 172.21.15.79:39432) 2023-10-14T18:48:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 -- 172.21.15.79:0/1046515069 learned_addr learned my addr 172.21.15.79:0/1046515069 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 0x7f0af014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeffff700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 0x7f0af00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 -- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 msgr2=0x7f0af00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 0x7f0af00cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 -- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 msgr2=0x7f0af014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 0x7f0af014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeeffd700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0157e40 con 0x7f0af0158ab0 2023-10-14T18:48:45.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 0x7f0af014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.513+0000 7f0aeffff700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 0x7f0af00cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0aeeffd700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4002950 tx=0x7f0ae4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400f8d0 con 0x7f0af0158ab0 2023-10-14T18:48:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400fa30 con 0x7f0af0158ab0 2023-10-14T18:48:45.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af00b3bf0 con 0x7f0af0158ab0 2023-10-14T18:48:45.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400fdd0 con 0x7f0af0158ab0 2023-10-14T18:48:45.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.514+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af00b41b0 con 0x7f0af0158ab0 2023-10-14T18:48:45.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.515+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af004c3c0 con 0x7f0af0158ab0 2023-10-14T18:48:45.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.515+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ae4013600 con 0x7f0af0158ab0 2023-10-14T18:48:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.515+0000 7f0ad77fe700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 0x7f0adc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.515+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ae4084a90 con 0x7f0af0158ab0 2023-10-14T18:48:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.516+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 0x7f0adc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.516+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f0adc06ea50 con 0x7f0af0158ab0 2023-10-14T18:48:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.516+0000 7f0aef7fe700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 0x7f0adc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a3f0 tx=0x7f0ae0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.519+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ae4051d00 con 0x7f0af0158ab0 2023-10-14T18:48:45.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.705+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af00b4940 con 0x7f0af0158ab0 2023-10-14T18:48:45.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.706+0000 7f0ad77fe700 1 -- 172.21.15.79:0/1046515069 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ae4055320 con 0x7f0af0158ab0 2023-10-14T18:48:45.707 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:48:45.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 msgr2=0x7f0adc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 0x7f0adc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a3f0 tx=0x7f0ae0016000 comp rx=0 tx=0).stop 2023-10-14T18:48:45.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 msgr2=0x7f0af0158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4002950 tx=0x7f0ae4007d30 comp rx=0 tx=0).stop 2023-10-14T18:48:45.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 shutdown_connections 2023-10-14T18:48:45.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0adc066f30 0x7f0adc0693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0af00cf490 0x7f0af00cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad8003a60 0x7f0af014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 --2- 172.21.15.79:0/1046515069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0af0158ab0 0x7f0af0158f20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 >> 172.21.15.79:0/1046515069 conn(0x7f0af00d1880 msgr2=0x7f0af00c7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 shutdown_connections 2023-10-14T18:48:45.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.708+0000 7f0af6243700 1 -- 172.21.15.79:0/1046515069 wait complete. 2023-10-14T18:48:45.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:48:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.837+0000 7f6c17fff700 1 Processor -- start 2023-10-14T18:48:45.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.837+0000 7f6c17fff700 1 -- start start 2023-10-14T18:48:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c17fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c17fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c180b4d70 con 0x7f6c1806a830 2023-10-14T18:48:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c17fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1806ac70 con 0x7f6c180b6580 2023-10-14T18:48:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c17fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180cd8d0 con 0x7f6c180cce30 2023-10-14T18:48:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c167fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46442/0 (socket says 172.21.15.79:46442) 2023-10-14T18:48:45.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c177fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6c1806a830 0x7f6c1815d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:44910/0 (socket says 172.21.15.79:44910) 2023-10-14T18:48:45.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c167fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60922/0 (socket says 172.21.15.79:60922) 2023-10-14T18:48:45.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 -- 172.21.15.79:0/2275155290 learned_addr learned my addr 172.21.15.79:0/2275155290 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:45.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 -- 172.21.15.79:0/2275155290 >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 msgr2=0x7f6c1806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:45.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 --2- 172.21.15.79:0/2275155290 >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 -- 172.21.15.79:0/2275155290 >> v1:172.21.15.144:6789/0 conn(0x7f6c1806a830 legacy=0x7f6c1815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.838+0000 7f6c16ffd700 1 -- 172.21.15.79:0/2275155290 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180b4440 con 0x7f6c180cce30 2023-10-14T18:48:45.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c167fc700 1 --2- 172.21.15.79:0/2275155290 >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:48:45.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c16ffd700 1 --2- 172.21.15.79:0/2275155290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009f20 tx=0x7f6c08009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7158dbe13c35b032 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c15ffb700 1 -- 172.21.15.79:0/2275155290 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800e070 con 0x7f6c180cce30 2023-10-14T18:48:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c15ffb700 1 -- 172.21.15.79:0/2275155290 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800b9d0 con 0x7f6c180cce30 2023-10-14T18:48:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c15ffb700 1 -- 172.21.15.79:0/2275155290 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080092e0 con 0x7f6c180cce30 2023-10-14T18:48:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 -- 172.21.15.79:0/2275155290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 msgr2=0x7f6c1815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 --2- 172.21.15.79:0/2275155290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009f20 tx=0x7f6c08009840 comp rx=0 tx=0).stop 2023-10-14T18:48:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 -- 172.21.15.79:0/2275155290 shutdown_connections 2023-10-14T18:48:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 --2- 172.21.15.79:0/2275155290 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c180cce30 0x7f6c1815aca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 --2- 172.21.15.79:0/2275155290 >> v2:172.21.15.144:3300/0 conn(0x7f6c180b6580 0x7f6c1806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 -- 172.21.15.79:0/2275155290 >> 172.21.15.79:0/2275155290 conn(0x7f6c18068cb0 msgr2=0x7f6c180690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 -- 172.21.15.79:0/2275155290 shutdown_connections 2023-10-14T18:48:45.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.839+0000 7f6c17fff700 1 -- 172.21.15.79:0/2275155290 wait complete. 2023-10-14T18:48:45.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 Processor -- start 2023-10-14T18:48:45.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 -- start start 2023-10-14T18:48:45.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c1806a830 0x7f6c1814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c180b6580 0x7f6c181512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181588f0 con 0x7f6c180cce30 2023-10-14T18:48:45.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18157ce0 con 0x7f6c180b6580 2023-10-14T18:48:45.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.841+0000 7f6c17fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18157fc0 con 0x7f6c1806a830 2023-10-14T18:48:45.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39434/0 (socket says 172.21.15.79:39434) 2023-10-14T18:48:45.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 -- 172.21.15.79:0/3602120980 learned_addr learned my addr 172.21.15.79:0/3602120980 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:45.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c167fc700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c180b6580 0x7f6c181512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c16ffd700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c1806a830 0x7f6c1814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 -- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c1806a830 msgr2=0x7f6c1814e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c1806a830 0x7f6c1814e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 -- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c180b6580 msgr2=0x7f6c181512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c180b6580 0x7f6c181512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009420 con 0x7f6c180cce30 2023-10-14T18:48:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c177fe700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c590 tx=0x7f6c10007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10005a70 con 0x7f6c180cce30 2023-10-14T18:48:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10005bf0 con 0x7f6c180cce30 2023-10-14T18:48:45.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c08009ae0 con 0x7f6c180cce30 2023-10-14T18:48:45.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100070d0 con 0x7f6c180cce30 2023-10-14T18:48:45.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.842+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c18158580 con 0x7f6c180cce30 2023-10-14T18:48:45.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.843+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c18089550 con 0x7f6c180cce30 2023-10-14T18:48:45.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.844+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c100074c0 con 0x7f6c180cce30 2023-10-14T18:48:45.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.844+0000 7f6c0effd700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 0x7f6bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:45.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.844+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c10083a60 con 0x7f6c180cce30 2023-10-14T18:48:45.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.844+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f6bf806ea50 con 0x7f6c180cce30 2023-10-14T18:48:45.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.844+0000 7f6c16ffd700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 0x7f6bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:45.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.845+0000 7f6c16ffd700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 0x7f6bf80693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009880 tx=0x7f6c08018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:45.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:45.848+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c10017070 con 0x7f6c180cce30 2023-10-14T18:48:46.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.028+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c180b4720 con 0x7f6c180cce30 2023-10-14T18:48:46.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.028+0000 7f6c0effd700 1 -- 172.21.15.79:0/3602120980 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c10050cd0 con 0x7f6c180cce30 2023-10-14T18:48:46.029 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:48:46.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 msgr2=0x7f6bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 0x7f6bf80693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009880 tx=0x7f6c08018000 comp rx=0 tx=0).stop 2023-10-14T18:48:46.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 msgr2=0x7f6c181551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c590 tx=0x7f6c10007ef0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 shutdown_connections 2023-10-14T18:48:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6bf8066f30 0x7f6bf80693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c180cce30 0x7f6c181551c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6c1806a830 0x7f6c1814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 --2- 172.21.15.79:0/3602120980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c180b6580 0x7f6c181512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 >> 172.21.15.79:0/3602120980 conn(0x7f6c18068cb0 msgr2=0x7f6c18150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 shutdown_connections 2023-10-14T18:48:46.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.030+0000 7f6c17fff700 1 -- 172.21.15.79:0/3602120980 wait complete. 2023-10-14T18:48:46.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:48:46.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.159+0000 7fe76228f700 1 Processor -- start 2023-10-14T18:48:46.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.159+0000 7fe76228f700 1 -- start start 2023-10-14T18:48:46.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76228f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe75c0d05a0 0x7fe75c164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76228f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c0b0790 con 0x7fe75c15a290 2023-10-14T18:48:46.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76228f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75c0ce1f0 con 0x7fe75c159ec0 2023-10-14T18:48:46.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76228f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75c0b0b20 con 0x7fe75c0d05a0 2023-10-14T18:48:46.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76082c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe75c0d05a0 0x7fe75c164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe75b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe75c15a290 0x7fe75c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51882/0 (socket says 172.21.15.79:51882) 2023-10-14T18:48:46.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe75b7fe700 1 -- 172.21.15.79:0/1150710155 learned_addr learned my addr 172.21.15.79:0/1150710155 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:46.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76082c700 1 -- 172.21.15.79:0/1150710155 >> v1:172.21.15.144:6789/0 conn(0x7fe75c159ec0 legacy=0x7fe75c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76082c700 1 -- 172.21.15.79:0/1150710155 >> v1:172.21.15.79:6789/0 conn(0x7fe75c15a290 legacy=0x7fe75c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe76082c700 1 -- 172.21.15.79:0/1150710155 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c0b04b0 con 0x7fe75c0d05a0 2023-10-14T18:48:46.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.160+0000 7fe75affd700 1 -- 172.21.15.79:0/1150710155 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513091616 0 0) 0x7fe75c0b0790 con 0x7fe75c15a290 2023-10-14T18:48:46.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76082c700 1 --2- 172.21.15.79:0/1150710155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c0d05a0 0x7fe75c164ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe754009e60 tx=0x7fe754009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d95d595599cf65e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe75affd700 1 -- 172.21.15.79:0/1150710155 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400e070 con 0x7fe75c0d05a0 2023-10-14T18:48:46.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe75affd700 1 -- 172.21.15.79:0/1150710155 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400bc30 con 0x7fe75c0d05a0 2023-10-14T18:48:46.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe75affd700 1 -- 172.21.15.79:0/1150710155 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754012430 con 0x7fe75c0d05a0 2023-10-14T18:48:46.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 -- 172.21.15.79:0/1150710155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c0d05a0 msgr2=0x7fe75c164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 --2- 172.21.15.79:0/1150710155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c0d05a0 0x7fe75c164ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe754009e60 tx=0x7fe754009780 comp rx=0 tx=0).stop 2023-10-14T18:48:46.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 -- 172.21.15.79:0/1150710155 shutdown_connections 2023-10-14T18:48:46.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 --2- 172.21.15.79:0/1150710155 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c0d05a0 0x7fe75c164ed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 -- 172.21.15.79:0/1150710155 >> 172.21.15.79:0/1150710155 conn(0x7fe75c0d1880 msgr2=0x7fe75c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 -- 172.21.15.79:0/1150710155 shutdown_connections 2023-10-14T18:48:46.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.161+0000 7fe76228f700 1 -- 172.21.15.79:0/1150710155 wait complete. 2023-10-14T18:48:46.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.162+0000 7fe76228f700 1 Processor -- start 2023-10-14T18:48:46.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 -- start start 2023-10-14T18:48:46.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe75c0d05a0 0x7fe75c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe75c159ec0 0x7fe75c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0b1f40 con 0x7fe75c15a290 2023-10-14T18:48:46.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c155c60 con 0x7fe75c159ec0 2023-10-14T18:48:46.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76228f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c0b1330 con 0x7fe75c0d05a0 2023-10-14T18:48:46.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76082c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76082c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39448/0 (socket says 172.21.15.79:39448) 2023-10-14T18:48:46.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.163+0000 7fe76082c700 1 -- 172.21.15.79:0/3602710613 learned_addr learned my addr 172.21.15.79:0/3602710613 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:46.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe75b7fe700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe75c159ec0 0x7fe75c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe75bfff700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe75c0d05a0 0x7fe75c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 -- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe75c0d05a0 msgr2=0x7fe75c0b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe75c0d05a0 0x7fe75c0b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 -- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe75c159ec0 msgr2=0x7fe75c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe75c159ec0 0x7fe75c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009a20 con 0x7fe75c15a290 2023-10-14T18:48:46.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76082c700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe754013000 tx=0x7fe754019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75401b420 con 0x7fe75c15a290 2023-10-14T18:48:46.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75401b580 con 0x7fe75c15a290 2023-10-14T18:48:46.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75401b920 con 0x7fe75c15a290 2023-10-14T18:48:46.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c0b1610 con 0x7fe75c15a290 2023-10-14T18:48:46.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.164+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c0b1bd0 con 0x7fe75c15a290 2023-10-14T18:48:46.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.165+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0b20f0 con 0x7fe75c15a290 2023-10-14T18:48:46.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe75401bc90 con 0x7fe75c15a290 2023-10-14T18:48:46.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe743fff700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe754086290 con 0x7fe75c15a290 2023-10-14T18:48:46.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe75bfff700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fe74806ea50 con 0x7fe75c15a290 2023-10-14T18:48:46.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.166+0000 7fe75bfff700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe74c003a80 tx=0x7fe74c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.170+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe75402a060 con 0x7fe75c15a290 2023-10-14T18:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.351+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe75c04c3c0 con 0x7fe75c15a290 2023-10-14T18:48:46.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.352+0000 7fe743fff700 1 -- 172.21.15.79:0/3602710613 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe75c0b20f0 con 0x7fe75c15a290 2023-10-14T18:48:46.353 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:48:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 msgr2=0x7fe7480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe74c003a80 tx=0x7fe74c007ec0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 msgr2=0x7fe75c151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe754013000 tx=0x7fe754019000 comp rx=0 tx=0).stop 2023-10-14T18:48:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 shutdown_connections 2023-10-14T18:48:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe748066f30 0x7fe7480693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe75c15a290 0x7fe75c151ba0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe75c0d05a0 0x7fe75c0b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 --2- 172.21.15.79:0/3602710613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe75c159ec0 0x7fe75c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.353+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 >> 172.21.15.79:0/3602710613 conn(0x7fe75c0d1880 msgr2=0x7fe75c0c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.354+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 shutdown_connections 2023-10-14T18:48:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.354+0000 7fe76228f700 1 -- 172.21.15.79:0/3602710613 wait complete. 2023-10-14T18:48:46.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:48:46.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.481+0000 7fb824c36700 1 Processor -- start 2023-10-14T18:48:46.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.481+0000 7fb824c36700 1 -- start start 2023-10-14T18:48:46.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb824c36700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 0x7fb82015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb824c36700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb820157c40 0x7fb820158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb824c36700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82015cbb0 con 0x7fb82015a620 2023-10-14T18:48:46.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb824c36700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82015bfa0 con 0x7fb820157c40 2023-10-14T18:48:46.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb824c36700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82015c280 con 0x7fb820157870 2023-10-14T18:48:46.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb820157c40 0x7fb820158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb82015a620 0x7fb82015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51892/0 (socket says 172.21.15.79:51892) 2023-10-14T18:48:46.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81dd9b700 1 -- 172.21.15.79:0/4252895712 learned_addr learned my addr 172.21.15.79:0/4252895712 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:46.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81e59c700 1 --2- 172.21.15.79:0/4252895712 >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 0x7fb82015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 -- 172.21.15.79:0/4252895712 >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 msgr2=0x7fb82015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:46.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 --2- 172.21.15.79:0/4252895712 >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 0x7fb82015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 -- 172.21.15.79:0/4252895712 >> v1:172.21.15.79:6789/0 conn(0x7fb82015a620 legacy=0x7fb82015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81d59a700 1 -- 172.21.15.79:0/4252895712 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773810216 0 0) 0x7fb82015cbb0 con 0x7fb82015a620 2023-10-14T18:48:46.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 -- 172.21.15.79:0/4252895712 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82015c560 con 0x7fb820157c40 2023-10-14T18:48:46.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81e59c700 1 --2- 172.21.15.79:0/4252895712 >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 0x7fb82015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:46.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.482+0000 7fb81ed9d700 1 --2- 172.21.15.79:0/4252895712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157c40 0x7fb820158110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb820069d80 tx=0x7fb818009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0cb68347152daf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb81d59a700 1 -- 172.21.15.79:0/4252895712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800e070 con 0x7fb820157c40 2023-10-14T18:48:46.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb81d59a700 1 -- 172.21.15.79:0/4252895712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800bc30 con 0x7fb820157c40 2023-10-14T18:48:46.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb81d59a700 1 -- 172.21.15.79:0/4252895712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818012430 con 0x7fb820157c40 2023-10-14T18:48:46.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 -- 172.21.15.79:0/4252895712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157c40 msgr2=0x7fb820158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 --2- 172.21.15.79:0/4252895712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157c40 0x7fb820158110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb820069d80 tx=0x7fb818009780 comp rx=0 tx=0).stop 2023-10-14T18:48:46.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 -- 172.21.15.79:0/4252895712 shutdown_connections 2023-10-14T18:48:46.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 --2- 172.21.15.79:0/4252895712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157c40 0x7fb820158110 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 --2- 172.21.15.79:0/4252895712 >> v2:172.21.15.144:3300/0 conn(0x7fb820157870 0x7fb82015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 -- 172.21.15.79:0/4252895712 >> 172.21.15.79:0/4252895712 conn(0x7fb820068ce0 msgr2=0x7fb8200690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 -- 172.21.15.79:0/4252895712 shutdown_connections 2023-10-14T18:48:46.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.483+0000 7fb824c36700 1 -- 172.21.15.79:0/4252895712 wait complete. 2023-10-14T18:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.484+0000 7fb824c36700 1 Processor -- start 2023-10-14T18:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.484+0000 7fb824c36700 1 -- start start 2023-10-14T18:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 0x7fb820150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb82015a620 0x7fb8200b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82014e600 con 0x7fb820157870 2023-10-14T18:48:46.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82014dff0 con 0x7fb820157c40 2023-10-14T18:48:46.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb824c36700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb820153a10 con 0x7fb82015a620 2023-10-14T18:48:46.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39458/0 (socket says 172.21.15.79:39458) 2023-10-14T18:48:46.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 -- 172.21.15.79:0/1466286082 learned_addr learned my addr 172.21.15.79:0/1466286082 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:46.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81dd9b700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 0x7fb820150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 -- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb82015a620 msgr2=0x7fb8200b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb82015a620 0x7fb8200b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 -- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 msgr2=0x7fb820150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 0x7fb820150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.485+0000 7fb81e59c700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818009a20 con 0x7fb820157870 2023-10-14T18:48:46.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb81dd9b700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 0x7fb820150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:46.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb81e59c700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb81000e8d0 tx=0x7fb810008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000ee70 con 0x7fb820157870 2023-10-14T18:48:46.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000c5e0 con 0x7fb820157870 2023-10-14T18:48:46.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82014e290 con 0x7fb820157870 2023-10-14T18:48:46.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000c980 con 0x7fb820157870 2023-10-14T18:48:46.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.486+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82014cf40 con 0x7fb820157870 2023-10-14T18:48:46.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.487+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82004c3c0 con 0x7fb820157870 2023-10-14T18:48:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.487+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb810013410 con 0x7fb820157870 2023-10-14T18:48:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.488+0000 7fb80e7fc700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 0x7fb800069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.488+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8100842f0 con 0x7fb820157870 2023-10-14T18:48:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.488+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fb80006ea80 con 0x7fb820157870 2023-10-14T18:48:46.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.488+0000 7fb81dd9b700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 0x7fb800069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.488+0000 7fb81dd9b700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 0x7fb800069410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8200b33e0 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.492+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb810051560 con 0x7fb820157870 2023-10-14T18:48:46.594 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:48:46.593+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-14T18:48:46.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.598+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 296+0+0 (secure 0 0 0) 0x7fb810055920 con 0x7fb820157870 2023-10-14T18:48:46.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.598+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fb80006f370 con 0x7fb820157870 2023-10-14T18:48:46.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.717+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb82015c840 con 0x7fb820157870 2023-10-14T18:48:46.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.718+0000 7fb80e7fc700 1 -- 172.21.15.79:0/1466286082 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fb810020060 con 0x7fb820157870 2023-10-14T18:48:46.719 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:46.719 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:48:46.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 msgr2=0x7fb800069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 0x7fb800069410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8200b33e0 tx=0x7fb814009040 comp rx=0 tx=0).stop 2023-10-14T18:48:46.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 msgr2=0x7fb82014c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb81000e8d0 tx=0x7fb810008040 comp rx=0 tx=0).stop 2023-10-14T18:48:46.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 shutdown_connections 2023-10-14T18:48:46.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb800066f60 0x7fb800069410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb82015a620 0x7fb8200b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb820157870 0x7fb82014c980 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 --2- 172.21.15.79:0/1466286082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb820157c40 0x7fb820150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 >> 172.21.15.79:0/1466286082 conn(0x7fb820068ce0 msgr2=0x7fb8200d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 shutdown_connections 2023-10-14T18:48:46.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.720+0000 7fb824c36700 1 -- 172.21.15.79:0/1466286082 wait complete. 2023-10-14T18:48:46.724 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:48:46.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:48:46.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.846+0000 7f3c5d83c700 1 Processor -- start 2023-10-14T18:48:46.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.846+0000 7f3c5d83c700 1 -- start start 2023-10-14T18:48:46.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c58157870 0x7f3c5815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 0x7f3c5815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 0x7f3c58158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5815cbb0 con 0x7f3c58157870 2023-10-14T18:48:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5815bfa0 con 0x7f3c5815d580 2023-10-14T18:48:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c5d83c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5815c280 con 0x7f3c5815a620 2023-10-14T18:48:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c58157870 0x7f3c5815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c58157870 0x7f3c5815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39470/0 (socket says 172.21.15.79:39470) 2023-10-14T18:48:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 -- 172.21.15.79:0/2134990317 learned_addr learned my addr 172.21.15.79:0/2134990317 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:46.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c567fc700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 0x7f3c5815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c577fe700 1 --2- 172.21.15.79:0/2134990317 >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 0x7f3c58158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 -- 172.21.15.79:0/2134990317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 msgr2=0x7f3c5815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 0x7f3c5815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 -- 172.21.15.79:0/2134990317 >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 msgr2=0x7f3c58158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:46.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/2134990317 >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 0x7f3c58158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c56ffd700 1 -- 172.21.15.79:0/2134990317 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5815c560 con 0x7f3c58157870 2023-10-14T18:48:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c567fc700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 0x7f3c5815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.847+0000 7f3c577fe700 1 --2- 172.21.15.79:0/2134990317 >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 0x7f3c58158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c5815b6a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3c580b03b0 tx=0x7f3c48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535314df99b3c32c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c55ffb700 1 -- 172.21.15.79:0/2134990317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800e070 con 0x7f3c58157870 2023-10-14T18:48:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c55ffb700 1 -- 172.21.15.79:0/2134990317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800ba50 con 0x7f3c58157870 2023-10-14T18:48:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c55ffb700 1 -- 172.21.15.79:0/2134990317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480092e0 con 0x7f3c58157870 2023-10-14T18:48:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 -- 172.21.15.79:0/2134990317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 msgr2=0x7f3c5815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c5815b6a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3c580b03b0 tx=0x7f3c48009840 comp rx=0 tx=0).stop 2023-10-14T18:48:46.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 -- 172.21.15.79:0/2134990317 shutdown_connections 2023-10-14T18:48:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/2134990317 >> v2:172.21.15.144:3300/0 conn(0x7f3c5815d580 0x7f3c58158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c5815b6a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/2134990317 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815a620 0x7f3c5815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 -- 172.21.15.79:0/2134990317 >> 172.21.15.79:0/2134990317 conn(0x7f3c58068ce0 msgr2=0x7f3c580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:46.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 -- 172.21.15.79:0/2134990317 shutdown_connections 2023-10-14T18:48:46.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.848+0000 7f3c5d83c700 1 -- 172.21.15.79:0/2134990317 wait complete. 2023-10-14T18:48:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 Processor -- start 2023-10-14T18:48:46.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 -- start start 2023-10-14T18:48:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5815a620 0x7f3c580b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815d580 0x7f3c580b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58159610 con 0x7f3c58157870 2023-10-14T18:48:46.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5814fb10 con 0x7f3c5815a620 2023-10-14T18:48:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c5d83c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580b58c0 con 0x7f3c5815d580 2023-10-14T18:48:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c56ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.850+0000 7f3c56ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39476/0 (socket says 172.21.15.79:39476) 2023-10-14T18:48:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 -- 172.21.15.79:0/152093104 learned_addr learned my addr 172.21.15.79:0/152093104 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:46.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c567fc700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5815a620 0x7f3c580b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c577fe700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815d580 0x7f3c580b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 -- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815d580 msgr2=0x7f3c580b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815d580 0x7f3c580b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 -- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5815a620 msgr2=0x7f3c580b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:46.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5815a620 0x7f3c580b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009ae0 con 0x7f3c58157870 2023-10-14T18:48:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c56ffd700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806b530 tx=0x7f3c48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48008b70 con 0x7f3c58157870 2023-10-14T18:48:46.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48008d10 con 0x7f3c58157870 2023-10-14T18:48:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c580b6b50 con 0x7f3c58157870 2023-10-14T18:48:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480266b0 con 0x7f3c58157870 2023-10-14T18:48:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.851+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c580b5300 con 0x7f3c58157870 2023-10-14T18:48:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.852+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5814fc50 con 0x7f3c58157870 2023-10-14T18:48:46.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.853+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c48003040 con 0x7f3c58157870 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.853+0000 7f3c3effd700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.853+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c48086200 con 0x7f3c58157870 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.853+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f3c4406ea50 con 0x7f3c58157870 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.853+0000 7f3c567fc700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.854+0000 7f3c567fc700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c006f00 tx=0x7f3c4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:46.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:46.857+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c5814fc50 con 0x7f3c58157870 2023-10-14T18:48:47.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.041+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5814fc50 con 0x7f3c58157870 2023-10-14T18:48:47.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.042+0000 7f3c3effd700 1 -- 172.21.15.79:0/152093104 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+15386 (secure 0 0 0) 0x7f3c48021090 con 0x7f3c58157870 2023-10-14T18:48:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:47.043 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":71,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:48:46.594635+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:48:47.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 msgr2=0x7f3c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 0x7f3c440693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c006f00 tx=0x7f3c4c008040 comp rx=0 tx=0).stop 2023-10-14T18:48:47.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 msgr2=0x7f3c580b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3c5806b530 tx=0x7f3c48018000 comp rx=0 tx=0).stop 2023-10-14T18:48:47.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 shutdown_connections 2023-10-14T18:48:47.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3c44066f30 0x7f3c440693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c5815d580 0x7f3c580b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c58157870 0x7f3c580b49b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 --2- 172.21.15.79:0/152093104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c5815a620 0x7f3c580b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 >> 172.21.15.79:0/152093104 conn(0x7f3c58068ce0 msgr2=0x7f3c581581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 shutdown_connections 2023-10-14T18:48:47.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.044+0000 7f3c5d83c700 1 -- 172.21.15.79:0/152093104 wait complete. 2023-10-14T18:48:47.057 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:48:47.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:48:47.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.171+0000 7f63531f4700 1 Processor -- start 2023-10-14T18:48:47.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.171+0000 7f63531f4700 1 -- start start 2023-10-14T18:48:47.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63531f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63531f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63531f4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cb7c0 con 0x7f634c15dda0 2023-10-14T18:48:47.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63531f4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c15e850 con 0x7f634c0cdab0 2023-10-14T18:48:47.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63531f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0cd030 con 0x7f634c0cd6e0 2023-10-14T18:48:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63521f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63519f1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63519f1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60978/0 (socket says 172.21.15.79:60978) 2023-10-14T18:48:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63519f1700 1 -- 172.21.15.79:0/152251707 learned_addr learned my addr 172.21.15.79:0/152251707 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:47.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.172+0000 7f63521f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46486/0 (socket says 172.21.15.79:46486) 2023-10-14T18:48:47.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63521f2700 1 -- 172.21.15.79:0/152251707 >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 msgr2=0x7f634c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63521f2700 1 --2- 172.21.15.79:0/152251707 >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63521f2700 1 -- 172.21.15.79:0/152251707 >> v1:172.21.15.144:6789/0 conn(0x7f634c15dda0 legacy=0x7f634c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63521f2700 1 -- 172.21.15.79:0/152251707 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c15e290 con 0x7f634c0cd6e0 2023-10-14T18:48:47.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63519f1700 1 --2- 172.21.15.79:0/152251707 >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63511f0700 1 -- 172.21.15.79:0/152251707 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220660247 0 0) 0x7f634c0cb7c0 con 0x7f634c15dda0 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63521f2700 1 --2- 172.21.15.79:0/152251707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63480098e0 tx=0x7f63480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89721f54a107a474 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63511f0700 1 -- 172.21.15.79:0/152251707 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800b640 con 0x7f634c0cd6e0 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63511f0700 1 -- 172.21.15.79:0/152251707 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634800b7a0 con 0x7f634c0cd6e0 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63511f0700 1 -- 172.21.15.79:0/152251707 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634800bb40 con 0x7f634c0cd6e0 2023-10-14T18:48:47.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63531f4700 1 -- 172.21.15.79:0/152251707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 msgr2=0x7f634c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.173+0000 7f63531f4700 1 --2- 172.21.15.79:0/152251707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63480098e0 tx=0x7f63480091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 -- 172.21.15.79:0/152251707 shutdown_connections 2023-10-14T18:48:47.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 --2- 172.21.15.79:0/152251707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c0cd6e0 0x7f634c0cbc50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 --2- 172.21.15.79:0/152251707 >> v2:172.21.15.144:3300/0 conn(0x7f634c0cdab0 0x7f634c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 -- 172.21.15.79:0/152251707 >> 172.21.15.79:0/152251707 conn(0x7f634c067660 msgr2=0x7f634c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 -- 172.21.15.79:0/152251707 shutdown_connections 2023-10-14T18:48:47.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.174+0000 7f63531f4700 1 -- 172.21.15.79:0/152251707 wait complete. 2023-10-14T18:48:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 Processor -- start 2023-10-14T18:48:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 -- start start 2023-10-14T18:48:47.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 0x7f634c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 0x7f634c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c9110 con 0x7f634c0cdab0 2023-10-14T18:48:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c9ae0 con 0x7f634c0cd6e0 2023-10-14T18:48:47.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.175+0000 7f63531f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c8260 con 0x7f634c15dda0 2023-10-14T18:48:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39490/0 (socket says 172.21.15.79:39490) 2023-10-14T18:48:47.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 -- 172.21.15.79:0/643406733 learned_addr learned my addr 172.21.15.79:0/643406733 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63521f2700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 0x7f634c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63529f3700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 0x7f634c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 -- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 msgr2=0x7f634c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 0x7f634c0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 -- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 msgr2=0x7f634c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 0x7f634c0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0094f0 con 0x7f634c0cdab0 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63521f2700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 0x7f634c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63529f3700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 0x7f634c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63519f1700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ec50 tx=0x7f633c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00c9d0 con 0x7f634c0cdab0 2023-10-14T18:48:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00cb30 con 0x7f634c0cdab0 2023-10-14T18:48:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348009420 con 0x7f634c0cdab0 2023-10-14T18:48:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c013470 con 0x7f634c0cdab0 2023-10-14T18:48:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.176+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0c87e0 con 0x7f634c0cdab0 2023-10-14T18:48:47.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.177+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c0c9280 con 0x7f634c0cdab0 2023-10-14T18:48:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.177+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f633c013860 con 0x7f634c0cdab0 2023-10-14T18:48:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.178+0000 7f63427fc700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.178+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f633c084cc0 con 0x7f634c0cdab0 2023-10-14T18:48:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.178+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f633006ea50 con 0x7f634c0cdab0 2023-10-14T18:48:47.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.178+0000 7f63521f2700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.179+0000 7f63521f2700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 0x7f63300693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6348003080 tx=0x7f6348017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.182+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f633c051f30 con 0x7f634c0cdab0 2023-10-14T18:48:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.407+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f634c15e570 con 0x7f634c0cdab0 2023-10-14T18:48:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.408+0000 7f63427fc700 1 -- 172.21.15.79:0/643406733 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f633c021020 con 0x7f634c0cdab0 2023-10-14T18:48:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:47.412 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:48:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 msgr2=0x7f63300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 0x7f63300693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6348003080 tx=0x7f6348017000 comp rx=0 tx=0).stop 2023-10-14T18:48:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 msgr2=0x7f634c0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f633c00ec50 tx=0x7f633c009250 comp rx=0 tx=0).stop 2023-10-14T18:48:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 shutdown_connections 2023-10-14T18:48:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6330066f30 0x7f63300693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f634c15dda0 0x7f634c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f634c0cd6e0 0x7f634c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 --2- 172.21.15.79:0/643406733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f634c0cdab0 0x7f634c0c95a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 >> 172.21.15.79:0/643406733 conn(0x7f634c067660 msgr2=0x7f634c0c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 shutdown_connections 2023-10-14T18:48:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.410+0000 7f63531f4700 1 -- 172.21.15.79:0/643406733 wait complete. 2023-10-14T18:48:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:48:47.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:48:47.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.537+0000 7f6a0d558700 1 Processor -- start 2023-10-14T18:48:47.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.537+0000 7f6a0d558700 1 -- start start 2023-10-14T18:48:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0d558700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f6a0815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0d558700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a080ac1b0 0x7f6a08157900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0d558700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a081582c0 con 0x7f6a08157e40 2023-10-14T18:48:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0d558700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0815c830 con 0x7f6a080ac1b0 2023-10-14T18:48:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0d558700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080ac690 con 0x7f6a0815bb80 2023-10-14T18:48:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0cd57700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6a08157e40 0x7f6a080caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51904/0 (socket says 172.21.15.79:51904) 2023-10-14T18:48:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a0cd57700 1 -- 172.21.15.79:0/2048992802 learned_addr learned my addr 172.21.15.79:0/2048992802 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a07fff700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f6a0815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a077fe700 1 --2- 172.21.15.79:0/2048992802 >> v2:172.21.15.144:3300/0 conn(0x7f6a080ac1b0 0x7f6a08157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827409234 0 0) 0x7f6a081582c0 con 0x7f6a08157e40 2023-10-14T18:48:47.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69f0003570 con 0x7f6a08157e40 2023-10-14T18:48:47.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2710655796 0 0) 0x7f69f0003570 con 0x7f6a08157e40 2023-10-14T18:48:47.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 msgr2=0x7f6a0815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f6a0815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 >> v2:172.21.15.144:3300/0 conn(0x7f6a080ac1b0 msgr2=0x7f6a08157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 --2- 172.21.15.79:0/2048992802 >> v2:172.21.15.144:3300/0 conn(0x7f6a080ac1b0 0x7f6a08157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080ac970 con 0x7f6a08157e40 2023-10-14T18:48:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f6a000017f0 con 0x7f6a08157e40 2023-10-14T18:48:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.538+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 >> v1:172.21.15.79:6789/0 conn(0x7f6a08157e40 legacy=0x7f6a080caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0003a60 0x7f69f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f69f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0004d50 0x7f69f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0815c830 con 0x7f69f0003a60 2023-10-14T18:48:47.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080ac690 con 0x7f69f0004d50 2023-10-14T18:48:47.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f000ba60 con 0x7f6a0815bb80 2023-10-14T18:48:47.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0003a60 0x7f69f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a0cd57700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0004d50 0x7f69f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a077fe700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f69f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 -- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 msgr2=0x7f69f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a0815bb80 0x7f69f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 -- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0004d50 msgr2=0x7f69f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0004d50 0x7f69f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 -- 172.21.15.79:0/2048992802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0003570 con 0x7f69f0003a60 2023-10-14T18:48:47.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a07fff700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0003a60 0x7f69f0003e70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009c00 tx=0x7f69f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3efbbfef09ce37 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800e6b0 con 0x7f69f0003a60 2023-10-14T18:48:47.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800e810 con 0x7f69f0003a60 2023-10-14T18:48:47.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.539+0000 7f6a06ffd700 1 -- 172.21.15.79:0/2048992802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800ebd0 con 0x7f69f0003a60 2023-10-14T18:48:47.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 -- 172.21.15.79:0/2048992802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0003a60 msgr2=0x7f69f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 --2- 172.21.15.79:0/2048992802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69f0003a60 0x7f69f0003e70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009c00 tx=0x7f69f80091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0cd57700 1 -- 172.21.15.79:0/2048992802 reap_dead start 2023-10-14T18:48:47.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 -- 172.21.15.79:0/2048992802 shutdown_connections 2023-10-14T18:48:47.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 -- 172.21.15.79:0/2048992802 >> 172.21.15.79:0/2048992802 conn(0x7f6a080680e0 msgr2=0x7f6a080cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 -- 172.21.15.79:0/2048992802 shutdown_connections 2023-10-14T18:48:47.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.540+0000 7f6a0d558700 1 -- 172.21.15.79:0/2048992802 wait complete. 2023-10-14T18:48:47.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.541+0000 7f6a0d558700 1 Processor -- start 2023-10-14T18:48:47.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.541+0000 7f6a0d558700 1 -- start start 2023-10-14T18:48:47.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0003a60 0x7f6a08144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 0x7f6a080aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08144ed0 con 0x7f6a080b1980 2023-10-14T18:48:47.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081438f0 con 0x7f69f0003a60 2023-10-14T18:48:47.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08143bd0 con 0x7f6a080b1df0 2023-10-14T18:48:47.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39502/0 (socket says 172.21.15.79:39502) 2023-10-14T18:48:47.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 -- 172.21.15.79:0/1663141703 learned_addr learned my addr 172.21.15.79:0/1663141703 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a07fff700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0003a60 0x7f6a08144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0cd57700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 0x7f6a080aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 -- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 msgr2=0x7f6a080aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 0x7f6a080aa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 -- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0003a60 msgr2=0x7f6a08144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0003a60 0x7f6a08144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a08143eb0 con 0x7f6a080b1980 2023-10-14T18:48:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0cd57700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 0x7f6a080aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a077fe700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f69fc011990 tx=0x7f69fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00f6d0 con 0x7f6a080b1980 2023-10-14T18:48:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc00f830 con 0x7f6a080b1980 2023-10-14T18:48:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08144190 con 0x7f6a080b1980 2023-10-14T18:48:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00fbf0 con 0x7f6a080b1980 2023-10-14T18:48:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.542+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a08153760 con 0x7f6a080b1980 2023-10-14T18:48:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.543+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0806bc70 con 0x7f6a080b1980 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.544+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69fc015460 con 0x7f6a080b1980 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.544+0000 7f69effff700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.544+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69fc084680 con 0x7f6a080b1980 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.544+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f69f406ea50 con 0x7f6a080b1980 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.544+0000 7f6a07fff700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.545+0000 7f6a07fff700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f69f80091e0 tx=0x7f69f801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.548+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69fc0518f0 con 0x7f6a080b1980 2023-10-14T18:48:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.603+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(72..72 src has 1..72) v4 ==== 288+0+0 (secure 0 0 0) 0x7f69fc055cb0 con 0x7f6a080b1980 2023-10-14T18:48:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.604+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f69f406f340 con 0x7f6a080b1980 2023-10-14T18:48:47.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.777+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a0804bb80 con 0x7f6a080b1980 2023-10-14T18:48:47.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.778+0000 7f69effff700 1 -- 172.21.15.79:0/1663141703 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f69fc022020 con 0x7f6a080b1980 2023-10-14T18:48:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:47.779 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:47:14.044149+0000","modified":"2023-10-14T18:47:17.699523+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5694},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5694":{"gid":5694,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1574444833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1574444833},{"type":"v1","addr":"172.21.15.79:6835","nonce":1574444833}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-14T18:48:47.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 msgr2=0x7f69f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 0x7f69f40693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f69f80091e0 tx=0x7f69f801a000 comp rx=0 tx=0).stop 2023-10-14T18:48:47.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 msgr2=0x7f6a080a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f69fc011990 tx=0x7f69fc008040 comp rx=0 tx=0).stop 2023-10-14T18:48:47.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 shutdown_connections 2023-10-14T18:48:47.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69f4066f30 0x7f69f40693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6a080b1df0 0x7f6a080aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69f0003a60 0x7f6a08144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 --2- 172.21.15.79:0/1663141703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a080b1980 0x7f6a080a9cb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 >> 172.21.15.79:0/1663141703 conn(0x7f6a080680e0 msgr2=0x7f6a080b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 shutdown_connections 2023-10-14T18:48:47.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.780+0000 7f6a0d558700 1 -- 172.21.15.79:0/1663141703 wait complete. 2023-10-14T18:48:47.784 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2023-10-14T18:48:47.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:48:47.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.906+0000 7fd8c98e5700 1 Processor -- start 2023-10-14T18:48:47.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.906+0000 7fd8c98e5700 1 -- start start 2023-10-14T18:48:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c98e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c4157870 0x7fd8c415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c98e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8c4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c98e5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c415cbb0 con 0x7fd8c415a620 2023-10-14T18:48:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c98e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c415bfa0 con 0x7fd8c4157870 2023-10-14T18:48:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c98e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415c280 con 0x7fd8c4157c40 2023-10-14T18:48:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8ba7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8c415a620 0x7fd8c415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51914/0 (socket says 172.21.15.79:51914) 2023-10-14T18:48:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8ba7fc700 1 -- 172.21.15.79:0/2660302602 learned_addr learned my addr 172.21.15.79:0/2660302602 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484077320 0 0) 0x7fd8c415cbb0 con 0x7fd8c415a620 2023-10-14T18:48:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c2ffd700 1 --2- 172.21.15.79:0/2660302602 >> v2:172.21.15.144:3300/0 conn(0x7fd8c4157870 0x7fd8c415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8c4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b0003570 con 0x7fd8c415a620 2023-10-14T18:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071117951 0 0) 0x7fd8b0003570 con 0x7fd8c415a620 2023-10-14T18:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 msgr2=0x7fd8c4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8c4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 >> v2:172.21.15.144:3300/0 conn(0x7fd8c4157870 msgr2=0x7fd8c415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 --2- 172.21.15.79:0/2660302602 >> v2:172.21.15.144:3300/0 conn(0x7fd8c4157870 0x7fd8c415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c415c560 con 0x7fd8c415a620 2023-10-14T18:48:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd8ac001470 con 0x7fd8c415a620 2023-10-14T18:48:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 >> v1:172.21.15.79:6789/0 conn(0x7fd8c415a620 legacy=0x7fd8c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8b0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8b0003fe0 0x7fd8b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b0004d50 0x7fd8b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415bfa0 con 0x7fd8b0004d50 2023-10-14T18:48:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415c280 con 0x7fd8b0003fe0 2023-10-14T18:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b000bb40 con 0x7fd8c4157c40 2023-10-14T18:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.907+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b0004d50 0x7fd8b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8ba7fc700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8b0003fe0 0x7fd8b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c2ffd700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8b0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 -- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 msgr2=0x7fd8b0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c4157c40 0x7fd8b0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 -- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8b0003fe0 msgr2=0x7fd8b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8b0003fe0 0x7fd8b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 -- 172.21.15.79:0/2660302602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b0003570 con 0x7fd8b0004d50 2023-10-14T18:48:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b0004d50 0x7fd8b00051c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd8c41580c0 tx=0x7fd8bc009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0aee0170f5ef34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc009a40 con 0x7fd8b0004d50 2023-10-14T18:48:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc007c90 con 0x7fd8b0004d50 2023-10-14T18:48:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.908+0000 7fd8c27fc700 1 -- 172.21.15.79:0/2660302602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc014630 con 0x7fd8b0004d50 2023-10-14T18:48:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 -- 172.21.15.79:0/2660302602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b0004d50 msgr2=0x7fd8b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/2660302602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8b0004d50 0x7fd8b00051c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd8c41580c0 tx=0x7fd8bc009710 comp rx=0 tx=0).stop 2023-10-14T18:48:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c37fe700 1 -- 172.21.15.79:0/2660302602 reap_dead start 2023-10-14T18:48:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 -- 172.21.15.79:0/2660302602 shutdown_connections 2023-10-14T18:48:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 -- 172.21.15.79:0/2660302602 >> 172.21.15.79:0/2660302602 conn(0x7fd8c4068ce0 msgr2=0x7fd8c40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 -- 172.21.15.79:0/2660302602 shutdown_connections 2023-10-14T18:48:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.909+0000 7fd8c98e5700 1 -- 172.21.15.79:0/2660302602 wait complete. 2023-10-14T18:48:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.910+0000 7fd8c98e5700 1 Processor -- start 2023-10-14T18:48:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.910+0000 7fd8c98e5700 1 -- start start 2023-10-14T18:48:47.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c416a740 0x7fd8c416abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c414e500 0x7fd8c414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414f570 con 0x7fd8c41536a0 2023-10-14T18:48:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c416b0f0 con 0x7fd8c416a740 2023-10-14T18:48:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414f810 con 0x7fd8c414e500 2023-10-14T18:48:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39518/0 (socket says 172.21.15.79:39518) 2023-10-14T18:48:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 -- 172.21.15.79:0/1402803720 learned_addr learned my addr 172.21.15.79:0/1402803720 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8ba7fc700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c416a740 0x7fd8c416abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c37fe700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c414e500 0x7fd8c414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 -- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c414e500 msgr2=0x7fd8c414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c414e500 0x7fd8c414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 -- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c416a740 msgr2=0x7fd8c416abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c416a740 0x7fd8c416abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c414faf0 con 0x7fd8c41536a0 2023-10-14T18:48:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c2ffd700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4006ac0 tx=0x7fd8b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4011ec0 con 0x7fd8c41536a0 2023-10-14T18:48:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400f940 con 0x7fd8c41536a0 2023-10-14T18:48:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400fcc0 con 0x7fd8c41536a0 2023-10-14T18:48:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c414fdd0 con 0x7fd8c41536a0 2023-10-14T18:48:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.911+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c4150b10 con 0x7fd8c41536a0 2023-10-14T18:48:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.912+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c404c3c0 con 0x7fd8c41536a0 2023-10-14T18:48:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.913+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8b4014650 con 0x7fd8c41536a0 2023-10-14T18:48:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.913+0000 7fd8bb7fe700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 0x7fd8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.913+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8b4018030 con 0x7fd8c41536a0 2023-10-14T18:48:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.913+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fd8a406ea50 con 0x7fd8c41536a0 2023-10-14T18:48:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.913+0000 7fd8ba7fc700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 0x7fd8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.914+0000 7fd8ba7fc700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 0x7fd8a40693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0079e0 tx=0x7fd8ac001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:47.917+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8b4022060 con 0x7fd8c41536a0 2023-10-14T18:48:48.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.100+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c415c840 con 0x7fd8c41536a0 2023-10-14T18:48:48.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.101+0000 7fd8bb7fe700 1 -- 172.21.15.79:0/1402803720 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+15379 (secure 0 0 0) 0x7fd8b408a020 con 0x7fd8c41536a0 2023-10-14T18:48:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:48.102 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:48:47.598900+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:47:11.901490+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-14T18:47:13.012436+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:48:48.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 msgr2=0x7fd8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 0x7fd8a40693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0079e0 tx=0x7fd8ac001e90 comp rx=0 tx=0).stop 2023-10-14T18:48:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 msgr2=0x7fd8c41505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4006ac0 tx=0x7fd8b40091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 shutdown_connections 2023-10-14T18:48:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd8a4066f30 0x7fd8a40693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd8c414e500 0x7fd8c414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8c41536a0 0x7fd8c41505d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 --2- 172.21.15.79:0/1402803720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c416a740 0x7fd8c416abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 >> 172.21.15.79:0/1402803720 conn(0x7fd8c4068ce0 msgr2=0x7fd8c40cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:48.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 shutdown_connections 2023-10-14T18:48:48.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.103+0000 7fd8c98e5700 1 -- 172.21.15.79:0/1402803720 wait complete. 2023-10-14T18:48:48.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:48:48.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.229+0000 7fd039548700 1 Processor -- start 2023-10-14T18:48:48.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.229+0000 7fd039548700 1 -- start start 2023-10-14T18:48:48.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd039548700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd034159e10 0x7fd0340b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd039548700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0340cde50 0x7fd0340b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd039548700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03415db80 con 0x7fd03415a1e0 2023-10-14T18:48:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd039548700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03415e800 con 0x7fd0340cde50 2023-10-14T18:48:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd039548700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03415de60 con 0x7fd034159e10 2023-10-14T18:48:48.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0340cde50 0x7fd0340b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0340cde50 0x7fd0340b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39520/0 (socket says 172.21.15.79:39520) 2023-10-14T18:48:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 -- 172.21.15.79:0/2223843677 learned_addr learned my addr 172.21.15.79:0/2223843677 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd032ffd700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd034159e10 0x7fd0340b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 -- 172.21.15.79:0/2223843677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd034159e10 msgr2=0x7fd0340b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd034159e10 0x7fd0340b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 -- 172.21.15.79:0/2223843677 >> v1:172.21.15.144:6789/0 conn(0x7fd03415a1e0 legacy=0x7fd0340cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.230+0000 7fd0337fe700 1 -- 172.21.15.79:0/2223843677 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03415e140 con 0x7fd0340cde50 2023-10-14T18:48:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd0337fe700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0340cde50 0x7fd0340b3260 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0340c7ce0 tx=0x7fd02c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d099df6f0da44f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd031ffb700 1 -- 172.21.15.79:0/2223843677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00b820 con 0x7fd0340cde50 2023-10-14T18:48:48.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd031ffb700 1 -- 172.21.15.79:0/2223843677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c00b980 con 0x7fd0340cde50 2023-10-14T18:48:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd031ffb700 1 -- 172.21.15.79:0/2223843677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00bd20 con 0x7fd0340cde50 2023-10-14T18:48:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 -- 172.21.15.79:0/2223843677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0340cde50 msgr2=0x7fd0340b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0340cde50 0x7fd0340b3260 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0340c7ce0 tx=0x7fd02c009250 comp rx=0 tx=0).stop 2023-10-14T18:48:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 -- 172.21.15.79:0/2223843677 shutdown_connections 2023-10-14T18:48:48.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0340cde50 0x7fd0340b3260 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 --2- 172.21.15.79:0/2223843677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd034159e10 0x7fd0340b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 -- 172.21.15.79:0/2223843677 >> 172.21.15.79:0/2223843677 conn(0x7fd034067660 msgr2=0x7fd034067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 -- 172.21.15.79:0/2223843677 shutdown_connections 2023-10-14T18:48:48.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.231+0000 7fd039548700 1 -- 172.21.15.79:0/2223843677 wait complete. 2023-10-14T18:48:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 Processor -- start 2023-10-14T18:48:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 -- start start 2023-10-14T18:48:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0340cde50 0x7fd0340c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd03415a1e0 0x7fd03414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03415a670 con 0x7fd034159e10 2023-10-14T18:48:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03415a950 con 0x7fd0340cde50 2023-10-14T18:48:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.233+0000 7fd039548700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03415ac30 con 0x7fd03415a1e0 2023-10-14T18:48:48.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39532/0 (socket says 172.21.15.79:39532) 2023-10-14T18:48:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 -- 172.21.15.79:0/1678763449 learned_addr learned my addr 172.21.15.79:0/1678763449 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd032ffd700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0340cde50 0x7fd0340c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0337fe700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd03415a1e0 0x7fd03414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 -- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd03415a1e0 msgr2=0x7fd03414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd03415a1e0 0x7fd03414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 -- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0340cde50 msgr2=0x7fd0340c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0340cde50 0x7fd0340c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c0094f0 con 0x7fd034159e10 2023-10-14T18:48:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd0327fc700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b5e0 tx=0x7fd01c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00f510 con 0x7fd034159e10 2023-10-14T18:48:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c00f670 con 0x7fd034159e10 2023-10-14T18:48:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03415af10 con 0x7fd034159e10 2023-10-14T18:48:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00fa30 con 0x7fd034159e10 2023-10-14T18:48:48.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.234+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0340c7a20 con 0x7fd034159e10 2023-10-14T18:48:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.235+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03415b430 con 0x7fd034159e10 2023-10-14T18:48:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.235+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd01c01a400 con 0x7fd034159e10 2023-10-14T18:48:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.236+0000 7fd02affd700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.236+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd01c084060 con 0x7fd034159e10 2023-10-14T18:48:48.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.236+0000 7fd032ffd700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.236+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fd01406ea50 con 0x7fd034159e10 2023-10-14T18:48:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.237+0000 7fd032ffd700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 0x7fd0140693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e4d0 tx=0x7fd024007680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.240+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd03415b430 con 0x7fd034159e10 2023-10-14T18:48:48.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.464+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd03415b430 con 0x7fd034159e10 2023-10-14T18:48:48.465 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:48:48.464+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:48:48.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.466+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(73..73 src has 1..73) v4 ==== 366+0+0 (secure 0 0 0) 0x7fd01c055010 con 0x7fd034159e10 2023-10-14T18:48:48.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.466+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7fd01406f3a0 con 0x7fd034159e10 2023-10-14T18:48:48.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.470+0000 7fd02affd700 1 -- 172.21.15.79:0/1678763449 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd03415b430 con 0x7fd034159e10 2023-10-14T18:48:48.471 INFO:tasks.ceph.mds.c.smithi079.stderr: -9306> 2023-10-14T18:47:19.656+0000 7fe6a3912700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:48:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 msgr2=0x7fd0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 0x7fd0140693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd02400e4d0 tx=0x7fd024007680 comp rx=0 tx=0).stop 2023-10-14T18:48:48.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 msgr2=0x7fd0340c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00b5e0 tx=0x7fd01c009120 comp rx=0 tx=0).stop 2023-10-14T18:48:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 shutdown_connections 2023-10-14T18:48:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd03415a1e0 0x7fd03414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0340cde50 0x7fd0340c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 --2- 172.21.15.79:0/1678763449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd034159e10 0x7fd0340c9990 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 >> 172.21.15.79:0/1678763449 conn(0x7fd034067660 msgr2=0x7fd0341592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 shutdown_connections 2023-10-14T18:48:48.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.472+0000 7fd039548700 1 -- 172.21.15.79:0/1678763449 wait complete. 2023-10-14T18:48:48.476 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:48:48.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:48:48.502 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:48:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.601+0000 7f42d2c15700 1 Processor -- start 2023-10-14T18:48:48.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.601+0000 7f42d2c15700 1 -- start start 2023-10-14T18:48:48.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d2c15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42cc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d2c15700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42cc0697c0 0x7f42cc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d2c15700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc15ea90 con 0x7f42cc15a230 2023-10-14T18:48:48.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d2c15700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc0d1cf0 con 0x7f42cc0697c0 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d2c15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0b3100 con 0x7f42cc159e60 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42cbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42cc15a230 0x7f42cc0690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38152/0 (socket says 172.21.15.79:38152) 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42cbfff700 1 -- 172.21.15.79:0/1603026265 learned_addr learned my addr 172.21.15.79:0/1603026265 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124317778 0 0) 0x7f42cc15ea90 con 0x7f42cc15a230 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d11b2700 1 --2- 172.21.15.79:0/1603026265 >> v2:172.21.15.144:3300/0 conn(0x7f42cc0697c0 0x7f42cc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42d09b1700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42cc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.602+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42bc003570 con 0x7f42cc15a230 2023-10-14T18:48:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276555304 0 0) 0x7f42bc003570 con 0x7f42cc15a230 2023-10-14T18:48:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 msgr2=0x7f42cc15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42cc15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 >> v2:172.21.15.144:3300/0 conn(0x7f42cc0697c0 msgr2=0x7f42cc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 --2- 172.21.15.79:0/1603026265 >> v2:172.21.15.144:3300/0 conn(0x7f42cc0697c0 0x7f42cc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0d10e0 con 0x7f42cc15a230 2023-10-14T18:48:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f42b8001470 con 0x7f42cc15a230 2023-10-14T18:48:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 >> v1:172.21.15.79:6789/0 conn(0x7f42cc15a230 legacy=0x7f42cc0690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc003a60 0x7f42bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42bc004d50 0x7f42bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0d1cf0 con 0x7f42bc004d50 2023-10-14T18:48:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc0b3100 con 0x7f42bc003a60 2023-10-14T18:48:48.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc00ba60 con 0x7f42cc159e60 2023-10-14T18:48:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42bc004d50 0x7f42bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d09b1700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc003a60 0x7f42bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42cbfff700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 -- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 msgr2=0x7f42bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc159e60 0x7f42bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 -- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc003a60 msgr2=0x7f42bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc003a60 0x7f42bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 -- 172.21.15.79:0/1603026265 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc003570 con 0x7f42bc004d50 2023-10-14T18:48:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.603+0000 7f42d11b2700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42bc004d50 0x7f42bc0051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0c46b0 tx=0x7f42c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742a80a3541f9fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400ea00 con 0x7f42bc004d50 2023-10-14T18:48:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c400f040 con 0x7f42bc004d50 2023-10-14T18:48:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42cb7fe700 1 -- 172.21.15.79:0/1603026265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400edb0 con 0x7f42bc004d50 2023-10-14T18:48:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 -- 172.21.15.79:0/1603026265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42bc004d50 msgr2=0x7f42bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 --2- 172.21.15.79:0/1603026265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42bc004d50 0x7f42bc0051c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0c46b0 tx=0x7f42c400b040 comp rx=0 tx=0).stop 2023-10-14T18:48:48.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d11b2700 1 -- 172.21.15.79:0/1603026265 reap_dead start 2023-10-14T18:48:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 -- 172.21.15.79:0/1603026265 shutdown_connections 2023-10-14T18:48:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 -- 172.21.15.79:0/1603026265 >> 172.21.15.79:0/1603026265 conn(0x7f42cc070700 msgr2=0x7f42cc070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 -- 172.21.15.79:0/1603026265 shutdown_connections 2023-10-14T18:48:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.604+0000 7f42d2c15700 1 -- 172.21.15.79:0/1603026265 wait complete. 2023-10-14T18:48:48.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.605+0000 7f42d2c15700 1 Processor -- start 2023-10-14T18:48:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 -- start start 2023-10-14T18:48:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc004d50 0x7f42cc15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc15fc70 0x7f42cc1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc15aca0 con 0x7f42cc15e220 2023-10-14T18:48:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc159690 con 0x7f42bc004d50 2023-10-14T18:48:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d2c15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc15dd90 con 0x7f42cc15fc70 2023-10-14T18:48:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.606+0000 7f42d11b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52180/0 (socket says 172.21.15.79:52180) 2023-10-14T18:48:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d09b1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc004d50 0x7f42cc15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 -- 172.21.15.79:0/4072428922 learned_addr learned my addr 172.21.15.79:0/4072428922 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42cbfff700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc15fc70 0x7f42cc1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 -- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc15fc70 msgr2=0x7f42cc1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc15fc70 0x7f42cc1600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 -- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc004d50 msgr2=0x7f42cc15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc004d50 0x7f42cc15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc160620 con 0x7f42cc15e220 2023-10-14T18:48:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d11b2700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f42c4016000 tx=0x7f42c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400ee80 con 0x7f42cc15e220 2023-10-14T18:48:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4022070 con 0x7f42cc15e220 2023-10-14T18:48:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc1608a0 con 0x7f42cc15e220 2023-10-14T18:48:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c401e890 con 0x7f42cc15e220 2023-10-14T18:48:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.607+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc15da20 con 0x7f42cc15e220 2023-10-14T18:48:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.608+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc04c3c0 con 0x7f42cc15e220 2023-10-14T18:48:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.609+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42c4003040 con 0x7f42cc15e220 2023-10-14T18:48:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.609+0000 7f42c8ff9700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 0x7f42b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.609+0000 7f42d09b1700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 0x7f42b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.609+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f42c4024070 con 0x7f42cc15e220 2023-10-14T18:48:48.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.609+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f42b006eaf0 con 0x7f42cc15e220 2023-10-14T18:48:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.610+0000 7f42d09b1700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 0x7f42b00693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006f00 tx=0x7f42c00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.614+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42c4018060 con 0x7f42cc15e220 2023-10-14T18:48:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:48.838+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42cc15ded0 con 0x7f42cc15e220 2023-10-14T18:48:49.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.468+0000 7f42c8ff9700 1 -- 172.21.15.79:0/4072428922 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f42c4053c90 con 0x7f42cc15e220 2023-10-14T18:48:49.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 msgr2=0x7f42b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:49.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 0x7f42b00693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006f00 tx=0x7f42c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 msgr2=0x7f42cc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:49.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f42c4016000 tx=0x7f42c401a000 comp rx=0 tx=0).stop 2023-10-14T18:48:49.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 shutdown_connections 2023-10-14T18:48:49.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f42b0066f30 0x7f42b00693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42cc15e220 0x7f42cc15e690 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc004d50 0x7f42cc15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 --2- 172.21.15.79:0/4072428922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42cc15fc70 0x7f42cc1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 >> 172.21.15.79:0/4072428922 conn(0x7f42cc070700 msgr2=0x7f42cc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:49.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 shutdown_connections 2023-10-14T18:48:49.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.470+0000 7f42d2c15700 1 -- 172.21.15.79:0/4072428922 wait complete. 2023-10-14T18:48:49.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:48:49.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.646+0000 7f198b3b7700 1 Processor -- start 2023-10-14T18:48:49.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.646+0000 7f198b3b7700 1 -- start start 2023-10-14T18:48:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.646+0000 7f198b3b7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1984159ef0 0x7f198415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.646+0000 7f198b3b7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19840b46f0 0x7f19840b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f198b3b7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b17b0 con 0x7f19840b6a10 2023-10-14T18:48:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f198b3b7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840b5020 con 0x7f1984159ef0 2023-10-14T18:48:49.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f198b3b7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840b1a60 con 0x7f19840b46f0 2023-10-14T18:48:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1984159ef0 0x7f198415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1984159ef0 0x7f198415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52188/0 (socket says 172.21.15.79:52188) 2023-10-14T18:48:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 -- 172.21.15.79:0/1618117447 learned_addr learned my addr 172.21.15.79:0/1618117447 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 -- 172.21.15.79:0/1618117447 >> v2:172.21.15.144:3300/0 conn(0x7f19840b46f0 msgr2=0x7f19840b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 --2- 172.21.15.79:0/1618117447 >> v2:172.21.15.144:3300/0 conn(0x7f19840b46f0 0x7f19840b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 -- 172.21.15.79:0/1618117447 >> v1:172.21.15.144:6789/0 conn(0x7f19840b6a10 legacy=0x7f19840b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 -- 172.21.15.79:0/1618117447 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840b1d40 con 0x7f1984159ef0 2023-10-14T18:48:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f1989153700 1 --2- 172.21.15.79:0/1618117447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f198415a2c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f198415a800 tx=0x7f1980009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e31fdf58f6a14cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f197bfff700 1 -- 172.21.15.79:0/1618117447 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000e070 con 0x7f1984159ef0 2023-10-14T18:48:49.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f197bfff700 1 -- 172.21.15.79:0/1618117447 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198000ba90 con 0x7f1984159ef0 2023-10-14T18:48:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.647+0000 7f197bfff700 1 -- 172.21.15.79:0/1618117447 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800092e0 con 0x7f1984159ef0 2023-10-14T18:48:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 -- 172.21.15.79:0/1618117447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 msgr2=0x7f198415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 --2- 172.21.15.79:0/1618117447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f198415a2c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f198415a800 tx=0x7f1980009840 comp rx=0 tx=0).stop 2023-10-14T18:48:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 -- 172.21.15.79:0/1618117447 shutdown_connections 2023-10-14T18:48:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 --2- 172.21.15.79:0/1618117447 >> v2:172.21.15.144:3300/0 conn(0x7f19840b46f0 0x7f19840b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 --2- 172.21.15.79:0/1618117447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f198415a2c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 -- 172.21.15.79:0/1618117447 >> 172.21.15.79:0/1618117447 conn(0x7f198409a0a0 msgr2=0x7f1984067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 -- 172.21.15.79:0/1618117447 shutdown_connections 2023-10-14T18:48:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.648+0000 7f198b3b7700 1 -- 172.21.15.79:0/1618117447 wait complete. 2023-10-14T18:48:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.649+0000 7f198b3b7700 1 Processor -- start 2023-10-14T18:48:49.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.649+0000 7f198b3b7700 1 -- start start 2023-10-14T18:48:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840b46f0 0x7f19841564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 0x7f19841541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841576e0 con 0x7f1984159ef0 2023-10-14T18:48:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984156ad0 con 0x7f19840b46f0 2023-10-14T18:48:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f198b3b7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1984156db0 con 0x7f19840b6a10 2023-10-14T18:48:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52192/0 (socket says 172.21.15.79:52192) 2023-10-14T18:48:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 -- 172.21.15.79:0/288265933 learned_addr learned my addr 172.21.15.79:0/288265933 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989153700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840b46f0 0x7f19841564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1988952700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 0x7f19841541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 -- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 msgr2=0x7f19841541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 0x7f19841541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 -- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840b46f0 msgr2=0x7f19841564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840b46f0 0x7f19841564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009ae0 con 0x7f1984159ef0 2023-10-14T18:48:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1988952700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 0x7f19841541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.650+0000 7f1989954700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b810 tx=0x7f197c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.651+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00f510 con 0x7f1984159ef0 2023-10-14T18:48:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.651+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00f690 con 0x7f1984159ef0 2023-10-14T18:48:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.651+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1984157090 con 0x7f1984159ef0 2023-10-14T18:48:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.651+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00fa50 con 0x7f1984159ef0 2023-10-14T18:48:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.651+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1984154720 con 0x7f1984159ef0 2023-10-14T18:48:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.652+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984157890 con 0x7f1984159ef0 2023-10-14T18:48:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.652+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f197c01a400 con 0x7f1984159ef0 2023-10-14T18:48:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.652+0000 7f19797fa700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.652+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f197c0840b0 con 0x7f1984159ef0 2023-10-14T18:48:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.653+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f196806eaf0 con 0x7f1984159ef0 2023-10-14T18:48:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.653+0000 7f1989153700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.653+0000 7f1989153700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 0x7f19680693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1980009880 tx=0x7f1980017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.657+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1984157890 con 0x7f1984159ef0 2023-10-14T18:48:49.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:49.842+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f198404c3c0 con 0x7f1984159ef0 2023-10-14T18:48:50.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.618+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(75..75 src has 1..75) v4 ==== 1057+0+0 (secure 0 0 0) 0x7f197c055710 con 0x7f1984159ef0 2023-10-14T18:48:50.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.618+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7f196806cf20 con 0x7f1984159ef0 2023-10-14T18:48:50.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.623+0000 7f19797fa700 1 -- 172.21.15.79:0/288265933 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f197c051350 con 0x7f1984159ef0 2023-10-14T18:48:50.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 msgr2=0x7f19680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 0x7f19680693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1980009880 tx=0x7f1980017000 comp rx=0 tx=0).stop 2023-10-14T18:48:50.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 msgr2=0x7f1984155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b810 tx=0x7f197c0091d0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 shutdown_connections 2023-10-14T18:48:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1968066f30 0x7f19680693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1984159ef0 0x7f1984155390 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19840b46f0 0x7f19841564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 --2- 172.21.15.79:0/288265933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f19840b6a10 0x7f19841541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.626+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 >> 172.21.15.79:0/288265933 conn(0x7f198409a0a0 msgr2=0x7f19841526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.627+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 shutdown_connections 2023-10-14T18:48:50.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.627+0000 7f198b3b7700 1 -- 172.21.15.79:0/288265933 wait complete. 2023-10-14T18:48:50.630 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:48:50.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:48:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.760+0000 7fa1fa3be700 1 Processor -- start 2023-10-14T18:48:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.760+0000 7fa1fa3be700 1 -- start start 2023-10-14T18:48:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1fa3be700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1f406ec90 0x7fa1f41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1fa3be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f40cdd20 0x7fa1f40acac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1fa3be700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f40b2340 con 0x7fa1f40b2e10 2023-10-14T18:48:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1fa3be700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40b1730 con 0x7fa1f406ec90 2023-10-14T18:48:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1fa3be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40b1a10 con 0x7fa1f40cdd20 2023-10-14T18:48:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1f3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1f406ec90 0x7fa1f41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1f37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa1f40b2e10 0x7fa1f4159df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38168/0 (socket says 172.21.15.79:38168) 2023-10-14T18:48:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1f3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa1f406ec90 0x7fa1f41598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52208/0 (socket says 172.21.15.79:52208) 2023-10-14T18:48:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1f37fe700 1 -- 172.21.15.79:0/245140052 learned_addr learned my addr 172.21.15.79:0/245140052 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.761+0000 7fa1f895b700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f40cdd20 0x7fa1f40acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f3fff700 1 -- 172.21.15.79:0/245140052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f40cdd20 msgr2=0x7fa1f40acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f3fff700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f40cdd20 0x7fa1f40acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f3fff700 1 -- 172.21.15.79:0/245140052 >> v1:172.21.15.79:6789/0 conn(0x7fa1f40b2e10 legacy=0x7fa1f4159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f3fff700 1 -- 172.21.15.79:0/245140052 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40b1cf0 con 0x7fa1f406ec90 2023-10-14T18:48:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f2ffd700 1 -- 172.21.15.79:0/245140052 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943653347 0 0) 0x7fa1f40b2340 con 0x7fa1f40b2e10 2023-10-14T18:48:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f3fff700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f406ec90 0x7fa1f41598b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40098e0 tx=0x7fa1e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b500ce8fbbf22c7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f2ffd700 1 -- 172.21.15.79:0/245140052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4009e80 con 0x7fa1f406ec90 2023-10-14T18:48:50.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f2ffd700 1 -- 172.21.15.79:0/245140052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400b8f0 con 0x7fa1f406ec90 2023-10-14T18:48:50.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1f2ffd700 1 -- 172.21.15.79:0/245140052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400bc70 con 0x7fa1f406ec90 2023-10-14T18:48:50.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 -- 172.21.15.79:0/245140052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f406ec90 msgr2=0x7fa1f41598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f406ec90 0x7fa1f41598b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40098e0 tx=0x7fa1e40091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 -- 172.21.15.79:0/245140052 shutdown_connections 2023-10-14T18:48:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f40cdd20 0x7fa1f40acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/245140052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f406ec90 0x7fa1f41598b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 -- 172.21.15.79:0/245140052 >> 172.21.15.79:0/245140052 conn(0x7fa1f4068130 msgr2=0x7fa1f40cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 -- 172.21.15.79:0/245140052 shutdown_connections 2023-10-14T18:48:50.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.762+0000 7fa1fa3be700 1 -- 172.21.15.79:0/245140052 wait complete. 2023-10-14T18:48:50.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.763+0000 7fa1fa3be700 1 Processor -- start 2023-10-14T18:48:50.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 -- start start 2023-10-14T18:48:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f406ec90 0x7fa1f415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f40cdd20 0x7fa1f4154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4169dd0 con 0x7fa1f40b2e10 2023-10-14T18:48:50.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40998d0 con 0x7fa1f40cdd20 2023-10-14T18:48:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1fa3be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f409a380 con 0x7fa1f406ec90 2023-10-14T18:48:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.764+0000 7fa1f37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52212/0 (socket says 172.21.15.79:52212) 2023-10-14T18:48:50.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 -- 172.21.15.79:0/3093955440 learned_addr learned my addr 172.21.15.79:0/3093955440 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f3fff700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f406ec90 0x7fa1f415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 -- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f406ec90 msgr2=0x7fa1f415ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f895b700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f40cdd20 0x7fa1f4154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f406ec90 0x7fa1f415ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 -- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f40cdd20 msgr2=0x7fa1f4154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f40cdd20 0x7fa1f4154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 -- 172.21.15.79:0/3093955440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4009420 con 0x7fa1f40b2e10 2023-10-14T18:48:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1f37fe700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c7e0 tx=0x7fa1e8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8005b30 con 0x7fa1f40b2e10 2023-10-14T18:48:50.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8005c90 con 0x7fa1f40b2e10 2023-10-14T18:48:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8007300 con 0x7fa1f40b2e10 2023-10-14T18:48:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f416a050 con 0x7fa1f40b2e10 2023-10-14T18:48:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.765+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f4099ae0 con 0x7fa1f40b2e10 2023-10-14T18:48:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.766+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f416a1e0 con 0x7fa1f40b2e10 2023-10-14T18:48:50.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.766+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1e801b400 con 0x7fa1f40b2e10 2023-10-14T18:48:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.767+0000 7fa1dbfff700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.767+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fa1e8083e80 con 0x7fa1f40b2e10 2023-10-14T18:48:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.767+0000 7fa1f3fff700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.767+0000 7fa1f3fff700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 0x7fa1e00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4003080 tx=0x7fa1e4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:50.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.771+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1e80512d0 con 0x7fa1f40b2e10 2023-10-14T18:48:50.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:50.953+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1f404c3c0 con 0x7fa1f40b2e10 2023-10-14T18:48:51.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.629+0000 7fa1dbfff700 1 -- 172.21.15.79:0/3093955440 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa1e80548f0 con 0x7fa1f40b2e10 2023-10-14T18:48:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.633+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 msgr2=0x7fa1e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.633+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 0x7fa1e00693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4003080 tx=0x7fa1e4017000 comp rx=0 tx=0).stop 2023-10-14T18:48:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.633+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 msgr2=0x7fa1f4099390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.633+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800c7e0 tx=0x7fa1e8007df0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 shutdown_connections 2023-10-14T18:48:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa1e0066f30 0x7fa1e00693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f40cdd20 0x7fa1f4154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa1f406ec90 0x7fa1f415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 --2- 172.21.15.79:0/3093955440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1f40b2e10 0x7fa1f4099390 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 >> 172.21.15.79:0/3093955440 conn(0x7fa1f4068130 msgr2=0x7fa1f4158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:51.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.636+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 shutdown_connections 2023-10-14T18:48:51.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.637+0000 7fa1fa3be700 1 -- 172.21.15.79:0/3093955440 wait complete. 2023-10-14T18:48:51.638 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:48:51.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:48:51.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.769+0000 7f6d4d711700 1 Processor -- start 2023-10-14T18:48:51.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.769+0000 7f6d4d711700 1 -- start start 2023-10-14T18:48:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d4815a300 0x7f6d4815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d4815ac10 0x7f6d480cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480cc760 con 0x7f6d4815ac10 2023-10-14T18:48:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4815b460 con 0x7f6d4815a300 2023-10-14T18:48:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d4d711700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815ba20 con 0x7f6d480cb970 2023-10-14T18:48:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d477fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d4815ac10 0x7f6d480cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d477fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d4815ac10 0x7f6d480cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52222/0 (socket says 172.21.15.79:52222) 2023-10-14T18:48:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.770+0000 7f6d477fe700 1 -- 172.21.15.79:0/3367515233 learned_addr learned my addr 172.21.15.79:0/3367515233 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d47fff700 1 --2- 172.21.15.79:0/3367515233 >> v2:172.21.15.144:3300/0 conn(0x7f6d4815a300 0x7f6d4815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d4cf10700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 -- 172.21.15.79:0/3367515233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 msgr2=0x7f6d4815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:51.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 -- 172.21.15.79:0/3367515233 >> v2:172.21.15.144:3300/0 conn(0x7f6d4815a300 msgr2=0x7f6d4815a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 --2- 172.21.15.79:0/3367515233 >> v2:172.21.15.144:3300/0 conn(0x7f6d4815a300 0x7f6d4815a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 -- 172.21.15.79:0/3367515233 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480cc1a0 con 0x7f6d4815ac10 2023-10-14T18:48:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d477fe700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480cb430 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6d48064440 tx=0x7f6d3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276897ace9da0abb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:51.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d46ffd700 1 -- 172.21.15.79:0/3367515233 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00b860 con 0x7f6d4815ac10 2023-10-14T18:48:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d46ffd700 1 -- 172.21.15.79:0/3367515233 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b9c0 con 0x7f6d4815ac10 2023-10-14T18:48:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d46ffd700 1 -- 172.21.15.79:0/3367515233 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00bd60 con 0x7f6d4815ac10 2023-10-14T18:48:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d4d711700 1 -- 172.21.15.79:0/3367515233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 msgr2=0x7f6d480cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.771+0000 7f6d4d711700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480cb430 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6d48064440 tx=0x7f6d3c009250 comp rx=0 tx=0).stop 2023-10-14T18:48:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 -- 172.21.15.79:0/3367515233 shutdown_connections 2023-10-14T18:48:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 --2- 172.21.15.79:0/3367515233 >> v2:172.21.15.144:3300/0 conn(0x7f6d4815a300 0x7f6d4815a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 --2- 172.21.15.79:0/3367515233 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480cb430 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 -- 172.21.15.79:0/3367515233 >> 172.21.15.79:0/3367515233 conn(0x7f6d48099f50 msgr2=0x7f6d48067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 -- 172.21.15.79:0/3367515233 shutdown_connections 2023-10-14T18:48:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.772+0000 7f6d4d711700 1 -- 172.21.15.79:0/3367515233 wait complete. 2023-10-14T18:48:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.773+0000 7f6d4d711700 1 Processor -- start 2023-10-14T18:48:51.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.773+0000 7f6d4d711700 1 -- start start 2023-10-14T18:48:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4815a300 0x7f6d480b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48150160 con 0x7f6d4815ac10 2023-10-14T18:48:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c4710 con 0x7f6d4815a300 2023-10-14T18:48:51.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480b05f0 con 0x7f6d480cb970 2023-10-14T18:48:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52232/0 (socket says 172.21.15.79:52232) 2023-10-14T18:48:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 -- 172.21.15.79:0/2922363238 learned_addr learned my addr 172.21.15.79:0/2922363238 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d47fff700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d477fe700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4815a300 0x7f6d480b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 -- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 msgr2=0x7f6d4814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 -- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4815a300 msgr2=0x7f6d480b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4815a300 0x7f6d480b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 -- 172.21.15.79:0/2922363238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0094f0 con 0x7f6d4815ac10 2023-10-14T18:48:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4cf10700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6d40007f20 tx=0x7f6d40009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000eb90 con 0x7f6d4815ac10 2023-10-14T18:48:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000ed10 con 0x7f6d4815ac10 2023-10-14T18:48:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480ca2b0 con 0x7f6d4815ac10 2023-10-14T18:48:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40014670 con 0x7f6d4815ac10 2023-10-14T18:48:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.774+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480ca870 con 0x7f6d4815ac10 2023-10-14T18:48:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.775+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d480b0760 con 0x7f6d4815ac10 2023-10-14T18:48:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.776+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d400149e0 con 0x7f6d4815ac10 2023-10-14T18:48:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.776+0000 7f6d2ffff700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.776+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6d400847e0 con 0x7f6d4815ac10 2023-10-14T18:48:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.776+0000 7f6d47fff700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.777+0000 7f6d47fff700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 0x7f6d340693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6d38006aa0 tx=0x7f6d38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.780+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d40051d50 con 0x7f6d4815ac10 2023-10-14T18:48:51.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.964+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d480caa60 con 0x7f6d4815ac10 2023-10-14T18:48:51.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.968+0000 7f6d2ffff700 1 -- 172.21.15.79:0/2922363238 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d40055370 con 0x7f6d4815ac10 2023-10-14T18:48:51.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 msgr2=0x7f6d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 0x7f6d340693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6d38006aa0 tx=0x7f6d38008040 comp rx=0 tx=0).stop 2023-10-14T18:48:51.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 msgr2=0x7f6d480b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:51.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6d40007f20 tx=0x7f6d40009860 comp rx=0 tx=0).stop 2023-10-14T18:48:51.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 shutdown_connections 2023-10-14T18:48:51.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d4815ac10 0x7f6d480b5b00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d480cb970 0x7f6d4814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 --2- 172.21.15.79:0/2922363238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4815a300 0x7f6d480b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:51.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 >> 172.21.15.79:0/2922363238 conn(0x7f6d48099f50 msgr2=0x7f6d480cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:51.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 shutdown_connections 2023-10-14T18:48:51.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:51.970+0000 7f6d4d711700 1 -- 172.21.15.79:0/2922363238 wait complete. 2023-10-14T18:48:51.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-14T18:48:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.098+0000 7fba694b6700 1 Processor -- start 2023-10-14T18:48:52.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.098+0000 7fba694b6700 1 -- start start 2023-10-14T18:48:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba694b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640cc9a0 0x7fba6406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba694b6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba640ccd70 0x7fba640c3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba694b6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6406f320 con 0x7fba640c7a30 2023-10-14T18:48:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba694b6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6406e530 con 0x7fba640ccd70 2023-10-14T18:48:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba694b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6406e710 con 0x7fba640cc9a0 2023-10-14T18:48:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba640ccd70 0x7fba640c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba640ccd70 0x7fba640c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52242/0 (socket says 172.21.15.79:52242) 2023-10-14T18:48:52.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 -- 172.21.15.79:0/4100411563 learned_addr learned my addr 172.21.15.79:0/4100411563 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:52.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba62ffd700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640cc9a0 0x7fba6406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 -- 172.21.15.79:0/4100411563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640cc9a0 msgr2=0x7fba6406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640cc9a0 0x7fba6406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.099+0000 7fba5a7fc700 1 -- 172.21.15.79:0/4100411563 >> v1:172.21.15.144:6789/0 conn(0x7fba640c7a30 legacy=0x7fba6415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba5a7fc700 1 -- 172.21.15.79:0/4100411563 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6406e9f0 con 0x7fba640ccd70 2023-10-14T18:48:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba5a7fc700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640ccd70 0x7fba640c3090 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0099b0 tx=0x7fba4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fbcc0c22356f51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba627fc700 1 -- 172.21.15.79:0/4100411563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00b860 con 0x7fba640ccd70 2023-10-14T18:48:52.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba627fc700 1 -- 172.21.15.79:0/4100411563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00b9c0 con 0x7fba640ccd70 2023-10-14T18:48:52.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba627fc700 1 -- 172.21.15.79:0/4100411563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00bd60 con 0x7fba640ccd70 2023-10-14T18:48:52.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 -- 172.21.15.79:0/4100411563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640ccd70 msgr2=0x7fba640c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640ccd70 0x7fba640c3090 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0099b0 tx=0x7fba4c009250 comp rx=0 tx=0).stop 2023-10-14T18:48:52.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 -- 172.21.15.79:0/4100411563 shutdown_connections 2023-10-14T18:48:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640cc9a0 0x7fba6406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 --2- 172.21.15.79:0/4100411563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640ccd70 0x7fba640c3090 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 -- 172.21.15.79:0/4100411563 >> 172.21.15.79:0/4100411563 conn(0x7fba640cd1e0 msgr2=0x7fba640cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 -- 172.21.15.79:0/4100411563 shutdown_connections 2023-10-14T18:48:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.100+0000 7fba694b6700 1 -- 172.21.15.79:0/4100411563 wait complete. 2023-10-14T18:48:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 Processor -- start 2023-10-14T18:48:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 -- start start 2023-10-14T18:48:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 0x7fba6414e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 0x7fba6406a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640c4c60 con 0x7fba640cc9a0 2023-10-14T18:48:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6414e730 con 0x7fba640c7a30 2023-10-14T18:48:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba694b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b21d0 con 0x7fba640ccd70 2023-10-14T18:48:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba5a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba5a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52252/0 (socket says 172.21.15.79:52252) 2023-10-14T18:48:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.102+0000 7fba5a7fc700 1 -- 172.21.15.79:0/2513486810 learned_addr learned my addr 172.21.15.79:0/2513486810 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba62ffd700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 0x7fba6414e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba637fe700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 0x7fba6406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 -- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 msgr2=0x7fba6406a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 0x7fba6406a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 -- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 msgr2=0x7fba6414e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 0x7fba6414e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 -- 172.21.15.79:0/2513486810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0094f0 con 0x7fba640cc9a0 2023-10-14T18:48:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba62ffd700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 0x7fba6414e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba637fe700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 0x7fba6406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5a7fc700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fba4c006fd0 tx=0x7fba4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c01a420 con 0x7fba640cc9a0 2023-10-14T18:48:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c01a5a0 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba640c4330 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c01a960 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.103+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba640c48f0 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.104+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6404c3c0 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.104+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba4c01ad10 con 0x7fba640cc9a0 2023-10-14T18:48:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.105+0000 7fba5b7fe700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 0x7fba440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.105+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fba4c085c10 con 0x7fba640cc9a0 2023-10-14T18:48:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.105+0000 7fba62ffd700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 0x7fba440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.105+0000 7fba62ffd700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 0x7fba440693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.109+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba4c053180 con 0x7fba640cc9a0 2023-10-14T18:48:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.364+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fba6406ecd0 con 0x7fba640cc9a0 2023-10-14T18:48:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.627+0000 7fba5b7fe700 1 -- 172.21.15.79:0/2513486810 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v197) v1 ==== 134+0+0 (secure 0 0 0) 0x7fba4c0567a0 con 0x7fba640cc9a0 2023-10-14T18:48:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 msgr2=0x7fba440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 0x7fba440693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54008040 comp rx=0 tx=0).stop 2023-10-14T18:48:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 msgr2=0x7fba640b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fba4c006fd0 tx=0x7fba4c017000 comp rx=0 tx=0).stop 2023-10-14T18:48:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 shutdown_connections 2023-10-14T18:48:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba44066f30 0x7fba440693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba640ccd70 0x7fba6406a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba640c7a30 0x7fba6414e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 --2- 172.21.15.79:0/2513486810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba640cc9a0 0x7fba640b1860 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 >> 172.21.15.79:0/2513486810 conn(0x7fba640cd1e0 msgr2=0x7fba640c1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:52.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 shutdown_connections 2023-10-14T18:48:52.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.630+0000 7fba694b6700 1 -- 172.21.15.79:0/2513486810 wait complete. 2023-10-14T18:48:52.642 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-14T18:48:52.643 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-14T18:48:52.643 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-14T18:48:52.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-14T18:48:52.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.758+0000 7f37af5cc700 1 Processor -- start 2023-10-14T18:48:52.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 -- start start 2023-10-14T18:48:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 0x7f37a806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a815de60 con 0x7f37a806dad0 2023-10-14T18:48:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a815e140 con 0x7f37a80b1220 2023-10-14T18:48:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.759+0000 7f37af5cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a815e420 con 0x7f37a80b0e50 2023-10-14T18:48:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37acb67700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 0x7f37a806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37adb69700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f37a806dad0 0x7f37a80cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54602/0 (socket says 172.21.15.79:54602) 2023-10-14T18:48:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37adb69700 1 -- 172.21.15.79:0/1833662616 learned_addr learned my addr 172.21.15.79:0/1833662616 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46680/0 (socket says 172.21.15.79:46680) 2023-10-14T18:48:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 -- 172.21.15.79:0/1833662616 >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 msgr2=0x7f37a806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 --2- 172.21.15.79:0/1833662616 >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 0x7f37a806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 -- 172.21.15.79:0/1833662616 >> v1:172.21.15.144:6789/0 conn(0x7f37a806dad0 legacy=0x7f37a80cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37ad368700 1 -- 172.21.15.79:0/1833662616 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a815e700 con 0x7f37a80b0e50 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.760+0000 7f37acb67700 1 --2- 172.21.15.79:0/1833662616 >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 0x7f37a806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37ad368700 1 --2- 172.21.15.79:0/1833662616 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009e90 tx=0x7f37a4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3287f1bc2bffcb79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f379ffff700 1 -- 172.21.15.79:0/1833662616 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400e070 con 0x7f37a80b0e50 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f379ffff700 1 -- 172.21.15.79:0/1833662616 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400bbf0 con 0x7f37a80b0e50 2023-10-14T18:48:52.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f379ffff700 1 -- 172.21.15.79:0/1833662616 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4012430 con 0x7f37a80b0e50 2023-10-14T18:48:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 -- 172.21.15.79:0/1833662616 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 msgr2=0x7f37a80c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 --2- 172.21.15.79:0/1833662616 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009e90 tx=0x7f37a4009780 comp rx=0 tx=0).stop 2023-10-14T18:48:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 -- 172.21.15.79:0/1833662616 shutdown_connections 2023-10-14T18:48:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 --2- 172.21.15.79:0/1833662616 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b0e50 0x7f37a80c9180 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 --2- 172.21.15.79:0/1833662616 >> v2:172.21.15.144:3300/0 conn(0x7f37a80b1220 0x7f37a806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 -- 172.21.15.79:0/1833662616 >> 172.21.15.79:0/1833662616 conn(0x7f37a8069870 msgr2=0x7f37a8069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:52.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 -- 172.21.15.79:0/1833662616 shutdown_connections 2023-10-14T18:48:52.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.761+0000 7f37af5cc700 1 -- 172.21.15.79:0/1833662616 wait complete. 2023-10-14T18:48:52.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.762+0000 7f37af5cc700 1 Processor -- start 2023-10-14T18:48:52.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.762+0000 7f37af5cc700 1 -- start start 2023-10-14T18:48:52.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80b0e50 0x7f37a8148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b1220 0x7f37a80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a816a180 con 0x7f37a806dad0 2023-10-14T18:48:52.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a815b380 con 0x7f37a80b0e50 2023-10-14T18:48:52.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37af5cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80b2c60 con 0x7f37a80b1220 2023-10-14T18:48:52.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37ad368700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37ad368700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52260/0 (socket says 172.21.15.79:52260) 2023-10-14T18:48:52.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.763+0000 7f37ad368700 1 -- 172.21.15.79:0/3205874236 learned_addr learned my addr 172.21.15.79:0/3205874236 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:52.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37acb67700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80b0e50 0x7f37a8148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37adb69700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b1220 0x7f37a80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 -- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b1220 msgr2=0x7f37a80c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b1220 0x7f37a80c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 -- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80b0e50 msgr2=0x7f37a8148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:52.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80b0e50 0x7f37a8148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:52.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 -- 172.21.15.79:0/3205874236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009420 con 0x7f37a806dad0 2023-10-14T18:48:52.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37ad368700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f37a400b6c0 tx=0x7f37a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4007060 con 0x7f37a806dad0 2023-10-14T18:48:52.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4012c30 con 0x7f37a806dad0 2023-10-14T18:48:52.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a4009a20 con 0x7f37a806dad0 2023-10-14T18:48:52.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40263f0 con 0x7f37a806dad0 2023-10-14T18:48:52.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.764+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a815b0a0 con 0x7f37a806dad0 2023-10-14T18:48:52.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.765+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a804c3c0 con 0x7f37a806dad0 2023-10-14T18:48:52.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.766+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37a4026840 con 0x7f37a806dad0 2023-10-14T18:48:52.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.766+0000 7f379d7fa700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 0x7f378c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:52.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.766+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f37a40860e0 con 0x7f37a806dad0 2023-10-14T18:48:52.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.766+0000 7f37acb67700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 0x7f378c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:52.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.767+0000 7f37acb67700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 0x7f378c0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a80b1c70 tx=0x7f37980091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:52.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:52.770+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37a4053650 con 0x7f37a806dad0 2023-10-14T18:48:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.030+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f37a8158010 con 0x7f37a806dad0 2023-10-14T18:48:53.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.629+0000 7f379d7fa700 1 -- 172.21.15.79:0/3205874236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v198) v1 ==== 136+0+0 (secure 0 0 0) 0x7f37a4056c70 con 0x7f37a806dad0 2023-10-14T18:48:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 msgr2=0x7f378c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 0x7f378c0693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a80b1c70 tx=0x7f37980091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 msgr2=0x7f37a80b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f37a400b6c0 tx=0x7f37a4019000 comp rx=0 tx=0).stop 2023-10-14T18:48:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 shutdown_connections 2023-10-14T18:48:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f378c066f30 0x7f378c0693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37a80b1220 0x7f37a80c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37a806dad0 0x7f37a80b4510 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 --2- 172.21.15.79:0/3205874236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37a80b0e50 0x7f37a8148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 >> 172.21.15.79:0/3205874236 conn(0x7f37a8069870 msgr2=0x7f37a80c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 shutdown_connections 2023-10-14T18:48:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.632+0000 7f37af5cc700 1 -- 172.21.15.79:0/3205874236 wait complete. 2023-10-14T18:48:53.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-14T18:48:53.780 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_objectstore":"memstore"} 2023-10-14T18:48:53.780 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-14T18:48:53.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:48:53.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.897+0000 7f775c8be700 1 Processor -- start 2023-10-14T18:48:53.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.897+0000 7f775c8be700 1 -- start start 2023-10-14T18:48:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f775c8be700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77580cf0f0 0x7f77580b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f775c8be700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580b1850 con 0x7f77580adc80 2023-10-14T18:48:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f775c8be700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580b20f0 con 0x7f77580b0b70 2023-10-14T18:48:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f775c8be700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77580cf530 con 0x7f77580cf0f0 2023-10-14T18:48:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f7757fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f77580cf0f0 0x7f77580b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77577fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f77580adc80 0x7f77580b0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38182/0 (socket says 172.21.15.79:38182) 2023-10-14T18:48:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77577fe700 1 -- 172.21.15.79:0/2676603153 learned_addr learned my addr 172.21.15.79:0/2676603153 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f7757fff700 1 -- 172.21.15.79:0/2676603153 >> v1:172.21.15.144:6789/0 conn(0x7f77580b0b70 legacy=0x7f77580ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f7757fff700 1 -- 172.21.15.79:0/2676603153 >> v1:172.21.15.79:6789/0 conn(0x7f77580adc80 legacy=0x7f77580b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f7757fff700 1 -- 172.21.15.79:0/2676603153 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580cf750 con 0x7f77580cf0f0 2023-10-14T18:48:53.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77567fc700 1 -- 172.21.15.79:0/2676603153 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898376945 0 0) 0x7f77580b1850 con 0x7f77580adc80 2023-10-14T18:48:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f7757fff700 1 --2- 172.21.15.79:0/2676603153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580cf0f0 0x7f77580b2580 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f77500098e0 tx=0x7f77500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65370de96e0a3210 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77567fc700 1 -- 172.21.15.79:0/2676603153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750009e80 con 0x7f77580cf0f0 2023-10-14T18:48:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77567fc700 1 -- 172.21.15.79:0/2676603153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000b820 con 0x7f77580cf0f0 2023-10-14T18:48:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.898+0000 7f77567fc700 1 -- 172.21.15.79:0/2676603153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000bba0 con 0x7f77580cf0f0 2023-10-14T18:48:53.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 -- 172.21.15.79:0/2676603153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580cf0f0 msgr2=0x7f77580b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 --2- 172.21.15.79:0/2676603153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580cf0f0 0x7f77580b2580 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f77500098e0 tx=0x7f77500091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 -- 172.21.15.79:0/2676603153 shutdown_connections 2023-10-14T18:48:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 --2- 172.21.15.79:0/2676603153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580cf0f0 0x7f77580b2580 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 -- 172.21.15.79:0/2676603153 >> 172.21.15.79:0/2676603153 conn(0x7f775806c700 msgr2=0x7f7758069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 -- 172.21.15.79:0/2676603153 shutdown_connections 2023-10-14T18:48:53.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.899+0000 7f775c8be700 1 -- 172.21.15.79:0/2676603153 wait complete. 2023-10-14T18:48:53.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.900+0000 7f775c8be700 1 Processor -- start 2023-10-14T18:48:53.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.900+0000 7f775c8be700 1 -- start start 2023-10-14T18:48:53.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 0x7f7758159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:53.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:53.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77580cf0f0 0x7f775815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:53.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7758154080 con 0x7f77580b0b70 2023-10-14T18:48:53.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7758151ce0 con 0x7f77580cf0f0 2023-10-14T18:48:53.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f775c8be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77581510d0 con 0x7f77580adc80 2023-10-14T18:48:53.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:53.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52264/0 (socket says 172.21.15.79:52264) 2023-10-14T18:48:53.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 -- 172.21.15.79:0/1548596986 learned_addr learned my addr 172.21.15.79:0/1548596986 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:53.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7757fff700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77580cf0f0 0x7f775815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:53.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f77577fe700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 0x7f7758159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:53.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 -- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 msgr2=0x7f7758159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 0x7f7758159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 -- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77580cf0f0 msgr2=0x7f775815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:53.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77580cf0f0 0x7f775815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:53.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f7756ffd700 1 -- 172.21.15.79:0/1548596986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009420 con 0x7f77580b0b70 2023-10-14T18:48:53.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.901+0000 7f77577fe700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 0x7f7758159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:53.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f7756ffd700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b7e0 tx=0x7f774c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:53.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c00f510 con 0x7f77580b0b70 2023-10-14T18:48:53.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c00f670 con 0x7f77580b0b70 2023-10-14T18:48:53.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c00fa10 con 0x7f77580b0b70 2023-10-14T18:48:53.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77581513b0 con 0x7f77580b0b70 2023-10-14T18:48:53.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.902+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7758151970 con 0x7f77580b0b70 2023-10-14T18:48:53.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.903+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775804c3c0 con 0x7f77580b0b70 2023-10-14T18:48:53.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.903+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f774c01a400 con 0x7f77580b0b70 2023-10-14T18:48:53.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.903+0000 7f773f7fe700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:53.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.903+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f774c083d10 con 0x7f77580b0b70 2023-10-14T18:48:53.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.904+0000 7f77577fe700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:53.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.904+0000 7f77577fe700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 0x7f77440693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7748001560 tx=0x7f7748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:53.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:53.907+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f774c089020 con 0x7f77580b0b70 2023-10-14T18:48:54.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.087+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7758151e20 con 0x7f77580b0b70 2023-10-14T18:48:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.091+0000 7f773f7fe700 1 -- 172.21.15.79:0/1548596986 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7758151e20 con 0x7f77580b0b70 2023-10-14T18:48:54.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 msgr2=0x7f77440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 0x7f77440693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7748001560 tx=0x7f7748009040 comp rx=0 tx=0).stop 2023-10-14T18:48:54.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 msgr2=0x7f775813d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f774c00b7e0 tx=0x7f774c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 shutdown_connections 2023-10-14T18:48:54.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7744066f30 0x7f77440693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77580cf0f0 0x7f775815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f77580adc80 0x7f7758159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 --2- 172.21.15.79:0/1548596986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77580b0b70 0x7f775813d430 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 >> 172.21.15.79:0/1548596986 conn(0x7f775806c700 msgr2=0x7f77580b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:54.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 shutdown_connections 2023-10-14T18:48:54.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.093+0000 7f775c8be700 1 -- 172.21.15.79:0/1548596986 wait complete. 2023-10-14T18:48:54.105 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:48:54.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:48:54.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:48:54.190 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:48:54.191 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:48:54.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:48:54.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.305+0000 7f966e9a7700 1 Processor -- start 2023-10-14T18:48:54.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.305+0000 7f966e9a7700 1 -- start start 2023-10-14T18:48:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966e9a7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9668157870 0x7f966815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966e9a7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9668157c40 0x7f9668158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966e9a7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966815cbb0 con 0x7f966815a620 2023-10-14T18:48:54.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966e9a7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966815bfa0 con 0x7f9668157870 2023-10-14T18:48:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966e9a7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966815c280 con 0x7f9668157c40 2023-10-14T18:48:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f9667fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9668157870 0x7f966815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f9667fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9668157870 0x7f966815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52278/0 (socket says 172.21.15.79:52278) 2023-10-14T18:48:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f9667fff700 1 -- 172.21.15.79:0/1460463028 learned_addr learned my addr 172.21.15.79:0/1460463028 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:54.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.306+0000 7f966cf44700 1 --2- 172.21.15.79:0/1460463028 >> v2:172.21.15.144:3300/0 conn(0x7f9668157c40 0x7f9668158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9667fff700 1 -- 172.21.15.79:0/1460463028 >> v2:172.21.15.144:3300/0 conn(0x7f9668157c40 msgr2=0x7f9668158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9667fff700 1 --2- 172.21.15.79:0/1460463028 >> v2:172.21.15.144:3300/0 conn(0x7f9668157c40 0x7f9668158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9667fff700 1 -- 172.21.15.79:0/1460463028 >> v1:172.21.15.144:6789/0 conn(0x7f966815a620 legacy=0x7f966815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9667fff700 1 -- 172.21.15.79:0/1460463028 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966815c560 con 0x7f9668157870 2023-10-14T18:48:54.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9667fff700 1 --2- 172.21.15.79:0/1460463028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966815b6a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f966806b4e0 tx=0x7f9658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b55358261049318 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9666ffd700 1 -- 172.21.15.79:0/1460463028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800b820 con 0x7f9668157870 2023-10-14T18:48:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9666ffd700 1 -- 172.21.15.79:0/1460463028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965800b980 con 0x7f9668157870 2023-10-14T18:48:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f9666ffd700 1 -- 172.21.15.79:0/1460463028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800bd20 con 0x7f9668157870 2023-10-14T18:48:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 -- 172.21.15.79:0/1460463028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 msgr2=0x7f966815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 --2- 172.21.15.79:0/1460463028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966815b6a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f966806b4e0 tx=0x7f9658009250 comp rx=0 tx=0).stop 2023-10-14T18:48:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 -- 172.21.15.79:0/1460463028 shutdown_connections 2023-10-14T18:48:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 --2- 172.21.15.79:0/1460463028 >> v2:172.21.15.144:3300/0 conn(0x7f9668157c40 0x7f9668158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 --2- 172.21.15.79:0/1460463028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966815b6a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 -- 172.21.15.79:0/1460463028 >> 172.21.15.79:0/1460463028 conn(0x7f9668068ce0 msgr2=0x7f96680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:54.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 -- 172.21.15.79:0/1460463028 shutdown_connections 2023-10-14T18:48:54.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.307+0000 7f966e9a7700 1 -- 172.21.15.79:0/1460463028 wait complete. 2023-10-14T18:48:54.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.308+0000 7f966e9a7700 1 Processor -- start 2023-10-14T18:48:54.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 -- start start 2023-10-14T18:48:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9668157c40 0x7f96681510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f966815a620 0x7f9668151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966814edb0 con 0x7f9668157870 2023-10-14T18:48:54.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680b3000 con 0x7f9668157c40 2023-10-14T18:48:54.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f966e9a7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680b2d20 con 0x7f966815a620 2023-10-14T18:48:54.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f9667fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f9667fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52288/0 (socket says 172.21.15.79:52288) 2023-10-14T18:48:54.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.309+0000 7f9667fff700 1 -- 172.21.15.79:0/3203603224 learned_addr learned my addr 172.21.15.79:0/3203603224 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:54.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f966cf44700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f966815a620 0x7f9668151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f96677fe700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9668157c40 0x7f96681510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 -- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f966815a620 msgr2=0x7f9668151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f966815a620 0x7f9668151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 -- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9668157c40 msgr2=0x7f96681510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9668157c40 0x7f96681510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 -- 172.21.15.79:0/3203603224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580094f0 con 0x7f9668157870 2023-10-14T18:48:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f9667fff700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f966806b530 tx=0x7f9658016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800bd10 con 0x7f9668157870 2023-10-14T18:48:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658006bc0 con 0x7f9668157870 2023-10-14T18:48:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966814e760 con 0x7f9668157870 2023-10-14T18:48:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965801b8d0 con 0x7f9668157870 2023-10-14T18:48:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.310+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966813ba40 con 0x7f9668157870 2023-10-14T18:48:54.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.311+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966804c3c0 con 0x7f9668157870 2023-10-14T18:48:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.311+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f965801bc80 con 0x7f9668157870 2023-10-14T18:48:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.312+0000 7f964ffff700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 0x7f96540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.312+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9658086060 con 0x7f9668157870 2023-10-14T18:48:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.312+0000 7f96677fe700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 0x7f96540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.312+0000 7f96677fe700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 0x7f96540693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.316+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96580535d0 con 0x7f9668157870 2023-10-14T18:48:54.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.538+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f966815c840 con 0x7f9668157870 2023-10-14T18:48:54.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.539+0000 7f964ffff700 1 -- 172.21.15.79:0/3203603224 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f965802ade0 con 0x7f9668157870 2023-10-14T18:48:54.540 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:54.540 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/396251736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":396251736},{"type":"v1","addr":"172.21.15.144:6837","nonce":396251736}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5437,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/743157534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":743157534},{"type":"v1","addr":"172.21.15.144:6836","nonce":743157534}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2422568815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2422568815},{"type":"v1","addr":"172.21.15.79:6834","nonce":2422568815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5970,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1145251302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1145251302},{"type":"v1","addr":"172.21.15.79:6835","nonce":1145251302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-10-14T18:48:54.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 msgr2=0x7f96540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 0x7f96540693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f965c006fd0 tx=0x7f965c008040 comp rx=0 tx=0).stop 2023-10-14T18:48:54.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 msgr2=0x7f966813b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f966806b530 tx=0x7f9658016000 comp rx=0 tx=0).stop 2023-10-14T18:48:54.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 shutdown_connections 2023-10-14T18:48:54.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9654066f30 0x7f96540693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f966815a620 0x7f9668151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9668157870 0x7f966813b500 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 --2- 172.21.15.79:0/3203603224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9668157c40 0x7f96681510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 >> 172.21.15.79:0/3203603224 conn(0x7f9668068ce0 msgr2=0x7f96680b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:54.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 shutdown_connections 2023-10-14T18:48:54.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.541+0000 7f966e9a7700 1 -- 172.21.15.79:0/3203603224 wait complete. 2023-10-14T18:48:54.544 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2023-10-14T18:48:54.554 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:48:54.554 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:48:54.554 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:48:54.555 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:48:54.555 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:48:54.555 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:48:54.555 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:48:54.556 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:48:54.556 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:48:54.556 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:48:54.557 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:48:54.557 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:48:54.557 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:48:54.558 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:48:54.558 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:48:54.558 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:48:54.563 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:48:54.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:48:54.564 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:48:54.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:48:54.568 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:48:54.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:48:54.569 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:48:54.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:48:54.606 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:48:54.606 DEBUG:teuthology.parallel:result is None 2023-10-14T18:48:54.607 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:48:54.607 DEBUG:teuthology.parallel:result is None 2023-10-14T18:48:54.611 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:48:54.611 DEBUG:teuthology.parallel:result is None 2023-10-14T18:48:54.612 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:48:54.612 DEBUG:teuthology.parallel:result is None 2023-10-14T18:48:54.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:48:54.679 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:48:54.680 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:48:54.693 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:48:54.694 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:48:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.734+0000 7fdb239eb700 1 Processor -- start 2023-10-14T18:48:54.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.734+0000 7fdb239eb700 1 -- start start 2023-10-14T18:48:54.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 0x7fdb1c06d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c15de60 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c15e140 con 0x7fdb1c0b1220 2023-10-14T18:48:54.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb239eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c15e420 con 0x7fdb1c06dad0 2023-10-14T18:48:54.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb21787700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb21787700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52330/0 (socket says 172.21.15.79:52330) 2023-10-14T18:48:54.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.735+0000 7fdb21787700 1 -- 172.21.15.79:0/1007286003 learned_addr learned my addr 172.21.15.79:0/1007286003 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:54.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb20f86700 1 --2- 172.21.15.79:0/1007286003 >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 0x7fdb1c06d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21f88700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 -- 172.21.15.79:0/1007286003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 msgr2=0x7fdb1c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:54.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c0cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 -- 172.21.15.79:0/1007286003 >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 msgr2=0x7fdb1c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:54.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 --2- 172.21.15.79:0/1007286003 >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 0x7fdb1c06d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 -- 172.21.15.79:0/1007286003 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c15e700 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb20f86700 1 --2- 172.21.15.79:0/1007286003 >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 0x7fdb1c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb21787700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06cd30 tx=0x7fdb18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad4c45721fbf228 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb13fff700 1 -- 172.21.15.79:0/1007286003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800b860 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb13fff700 1 -- 172.21.15.79:0/1007286003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1800b9c0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb13fff700 1 -- 172.21.15.79:0/1007286003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800bd80 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb239eb700 1 -- 172.21.15.79:0/1007286003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 msgr2=0x7fdb1c0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.736+0000 7fdb239eb700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06cd30 tx=0x7fdb18009250 comp rx=0 tx=0).stop 2023-10-14T18:48:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 -- 172.21.15.79:0/1007286003 shutdown_connections 2023-10-14T18:48:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c0cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 --2- 172.21.15.79:0/1007286003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0c9180 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 --2- 172.21.15.79:0/1007286003 >> v2:172.21.15.144:3300/0 conn(0x7fdb1c0b1220 0x7fdb1c06d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 -- 172.21.15.79:0/1007286003 >> 172.21.15.79:0/1007286003 conn(0x7fdb1c069870 msgr2=0x7fdb1c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 -- 172.21.15.79:0/1007286003 shutdown_connections 2023-10-14T18:48:54.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.737+0000 7fdb239eb700 1 -- 172.21.15.79:0/1007286003 wait complete. 2023-10-14T18:48:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.738+0000 7fdb239eb700 1 Processor -- start 2023-10-14T18:48:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.738+0000 7fdb239eb700 1 -- start start 2023-10-14T18:48:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c16d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb1c0b1220 0x7fdb1c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c16b4e0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c16de00 con 0x7fdb1c0b1220 2023-10-14T18:48:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c16e0e0 con 0x7fdb1c06dad0 2023-10-14T18:48:54.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52338/0 (socket says 172.21.15.79:52338) 2023-10-14T18:48:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 -- 172.21.15.79:0/560252072 learned_addr learned my addr 172.21.15.79:0/560252072 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb21787700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c16d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb21f88700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb1c0b1220 0x7fdb1c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 -- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 msgr2=0x7fdb1c16d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c16d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 -- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb1c0b1220 msgr2=0x7fdb1c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb1c0b1220 0x7fdb1c069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 -- 172.21.15.79:0/560252072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180094f0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb20f86700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d890 tx=0x7fdb0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0125f0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c012750 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c16e3c0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c012b10 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.739+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c0b2a30 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.740+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c16b650 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.741+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb0c014430 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.741+0000 7fdb117fa700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.741+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdb0c0844d0 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.741+0000 7fdb21787700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.742+0000 7fdb21787700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06cd30 tx=0x7fdb18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:54.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.745+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb1c16b650 con 0x7fdb1c0b0e50 2023-10-14T18:48:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:54.943+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdb1c16b620 con 0x7fdb1c0b0e50 2023-10-14T18:48:56.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.107+0000 7fdb117fa700 1 -- 172.21.15.79:0/560252072 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdb0c0554d0 con 0x7fdb1c0b0e50 2023-10-14T18:48:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 msgr2=0x7fdb000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c06cd30 tx=0x7fdb18017000 comp rx=0 tx=0).stop 2023-10-14T18:48:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 msgr2=0x7fdb1c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d890 tx=0x7fdb0c008040 comp rx=0 tx=0).stop 2023-10-14T18:48:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 shutdown_connections 2023-10-14T18:48:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb1c0b1220 0x7fdb1c069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdb1c06dad0 0x7fdb1c16d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 --2- 172.21.15.79:0/560252072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb1c0b0e50 0x7fdb1c0b24f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 >> 172.21.15.79:0/560252072 conn(0x7fdb1c069870 msgr2=0x7fdb1c158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 shutdown_connections 2023-10-14T18:48:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.110+0000 7fdb239eb700 1 -- 172.21.15.79:0/560252072 wait complete. 2023-10-14T18:48:56.113 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:48:56.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:48:56.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.237+0000 7f5779ae8700 1 Processor -- start 2023-10-14T18:48:56.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.237+0000 7f5779ae8700 1 -- start start 2023-10-14T18:48:56.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f5779ae8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f5779ae8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577415cbb0 con 0x7f5774157870 2023-10-14T18:48:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f5779ae8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577415bfa0 con 0x7f577415a620 2023-10-14T18:48:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f5779ae8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577415bdb0 con 0x7f5774157c40 2023-10-14T18:48:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f57737fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5774157870 0x7f577415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38198/0 (socket says 172.21.15.79:38198) 2023-10-14T18:48:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f57737fe700 1 -- 172.21.15.79:0/334524313 learned_addr learned my addr 172.21.15.79:0/334524313 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.238+0000 7f5773fff700 1 --2- 172.21.15.79:0/334524313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042030433 0 0) 0x7f577415cbb0 con 0x7f5774157870 2023-10-14T18:48:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003570 con 0x7f5774157870 2023-10-14T18:48:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608738159 0 0) 0x7f577415bfa0 con 0x7f577415a620 2023-10-14T18:48:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577415cbb0 con 0x7f577415a620 2023-10-14T18:48:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f5773fff700 1 -- 172.21.15.79:0/334524313 >> v1:172.21.15.144:6789/0 conn(0x7f577415a620 legacy=0x7f577415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f5773fff700 1 -- 172.21.15.79:0/334524313 >> v1:172.21.15.79:6789/0 conn(0x7f5774157870 legacy=0x7f577415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144736381 0 0) 0x7f575c003570 con 0x7f5774157870 2023-10-14T18:48:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f5773fff700 1 -- 172.21.15.79:0/334524313 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577415c280 con 0x7f5774157c40 2023-10-14T18:48:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f5773fff700 1 --2- 172.21.15.79:0/334524313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774158110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e90 tx=0x7f576c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3a5d0606795457 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00e070 con 0x7f5774157c40 2023-10-14T18:48:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00b870 con 0x7f5774157c40 2023-10-14T18:48:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.239+0000 7f57727fc700 1 -- 172.21.15.79:0/334524313 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764001470 con 0x7f5774157c40 2023-10-14T18:48:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 -- 172.21.15.79:0/334524313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 msgr2=0x7f5774158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 --2- 172.21.15.79:0/334524313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774158110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e90 tx=0x7f576c009780 comp rx=0 tx=0).stop 2023-10-14T18:48:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 -- 172.21.15.79:0/334524313 shutdown_connections 2023-10-14T18:48:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 --2- 172.21.15.79:0/334524313 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774158110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 -- 172.21.15.79:0/334524313 >> 172.21.15.79:0/334524313 conn(0x7f5774068ce0 msgr2=0x7f57740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 -- 172.21.15.79:0/334524313 shutdown_connections 2023-10-14T18:48:56.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.240+0000 7f5779ae8700 1 -- 172.21.15.79:0/334524313 wait complete. 2023-10-14T18:48:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.241+0000 7f5779ae8700 1 Processor -- start 2023-10-14T18:48:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.241+0000 7f5779ae8700 1 -- start start 2023-10-14T18:48:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5774157870 0x7f577414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774152650 con 0x7f577415a620 2023-10-14T18:48:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774150170 con 0x7f5774157870 2023-10-14T18:48:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5774151a40 con 0x7f5774157c40 2023-10-14T18:48:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52346/0 (socket says 172.21.15.79:52346) 2023-10-14T18:48:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 -- 172.21.15.79:0/3185937931 learned_addr learned my addr 172.21.15.79:0/3185937931 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f57737fe700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5774157870 0x7f577414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5772ffd700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 -- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 msgr2=0x7f5774150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 -- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5774157870 msgr2=0x7f577414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5774157870 0x7f577414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 -- 172.21.15.79:0/3185937931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009a20 con 0x7f577415a620 2023-10-14T18:48:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5773fff700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f576c003000 tx=0x7f576c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012d40 con 0x7f577415a620 2023-10-14T18:48:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c01e450 con 0x7f577415a620 2023-10-14T18:48:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5774151d20 con 0x7f577415a620 2023-10-14T18:48:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c012ea0 con 0x7f577415a620 2023-10-14T18:48:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.242+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57741522e0 con 0x7f577415a620 2023-10-14T18:48:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.243+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577404c3c0 con 0x7f577415a620 2023-10-14T18:48:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.244+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f576c01eae0 con 0x7f577415a620 2023-10-14T18:48:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.244+0000 7f575b7fe700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 0x7f57600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.244+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f576c086160 con 0x7f577415a620 2023-10-14T18:48:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.244+0000 7f57737fe700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 0x7f57600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.245+0000 7f57737fe700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 0x7f57600693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57640015a0 tx=0x7f5764000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.248+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f576c053720 con 0x7f577415a620 2023-10-14T18:48:56.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.503+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f577415c560 con 0x7f577415a620 2023-10-14T18:48:56.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.503+0000 7f575b7fe700 1 -- 172.21.15.79:0/3185937931 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f576c056d40 con 0x7f577415a620 2023-10-14T18:48:56.505 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:56.505 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:48:56.505 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:48:56.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.506 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:48:56.506 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:48:56.506 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.507 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.507 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:48:56.507 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:48:56.507 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.508 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:48:56.509 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:48:56.509 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.509 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.509 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:48:56.509 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:48:56.510 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.511 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:48:56.511 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:48:56.511 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.511 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.511 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:48:56.512 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:48:56.512 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.513 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:48:56.513 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:48:56.513 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.513 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:48:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:48:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.515 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:48:56.515 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:48:56.515 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.517 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:48:56.517 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:48:56.517 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:48:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:48:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:48:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:48:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:48:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:48:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.524 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.524 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:48:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:48:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.527 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:48:56.527 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:48:56.528 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.528 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.528 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.528 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:48:56.529 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:48:56.530 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.530 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:48:56.530 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:48:56.530 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.531 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:48:56.532 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:48:56.532 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.532 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.532 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:48:56.533 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:48:56.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.534 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:48:56.535 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:48:56.535 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.535 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.535 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:48:56.536 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:48:56.536 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:48:56.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.537 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:48:56.537 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:48:56.537 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.537 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:48:56.538 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:48:56.538 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:48:56.538 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.539 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:48:56.539 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:48:56.539 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.540 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:48:56.540 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:48:56.540 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:48:56.540 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:48:56.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.541 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:48:56.542 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:48:56.542 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:48:56.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:48:56.542 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:48:56.543 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.544 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:48:56.544 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:48:56.545 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:48:56.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:48:56.545 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:48:56.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:56.546 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:48:56.546 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:48:56.547 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:48:56.547 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:48:56.547 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:48:56.547 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:48:56.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:56.548 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:48:56.548 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:48:56.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 msgr2=0x7f57600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 0x7f57600693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57640015a0 tx=0x7f5764000bc0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 msgr2=0x7f5774151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f576c003000 tx=0x7f576c017000 comp rx=0 tx=0).stop 2023-10-14T18:48:56.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 shutdown_connections 2023-10-14T18:48:56.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5760066f30 0x7f57600693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f577415a620 0x7f5774151410 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5774157870 0x7f577414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 --2- 172.21.15.79:0/3185937931 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5774157c40 0x7f5774150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 >> 172.21.15.79:0/3185937931 conn(0x7f5774068ce0 msgr2=0x7f57740b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.505+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 shutdown_connections 2023-10-14T18:48:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.506+0000 7f5779ae8700 1 -- 172.21.15.79:0/3185937931 wait complete. 2023-10-14T18:48:56.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:48:56.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.668+0000 7f4d85b3c700 1 Processor -- start 2023-10-14T18:48:56.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 -- start start 2023-10-14T18:48:56.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d80157520 0x7f4d80067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d801578f0 0x7f4d80070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d80070c40 0x7f4d800ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8015a270 con 0x7f4d80070c40 2023-10-14T18:48:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8015b050 con 0x7f4d80157520 2023-10-14T18:48:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d85b3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80071080 con 0x7f4d801578f0 2023-10-14T18:48:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d8533b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d80070c40 0x7f4d800ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d8533b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4d80070c40 0x7f4d800ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52356/0 (socket says 172.21.15.79:52356) 2023-10-14T18:48:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.669+0000 7f4d8533b700 1 -- 172.21.15.79:0/3197658187 learned_addr learned my addr 172.21.15.79:0/3197658187 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d84b3a700 1 --2- 172.21.15.79:0/3197658187 >> v2:172.21.15.144:3300/0 conn(0x7f4d80157520 0x7f4d80067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 -- 172.21.15.79:0/3197658187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d801578f0 msgr2=0x7f4d80070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 --2- 172.21.15.79:0/3197658187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d801578f0 0x7f4d80070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 -- 172.21.15.79:0/3197658187 >> v2:172.21.15.144:3300/0 conn(0x7f4d80157520 msgr2=0x7f4d80067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 --2- 172.21.15.79:0/3197658187 >> v2:172.21.15.144:3300/0 conn(0x7f4d80157520 0x7f4d80067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 -- 172.21.15.79:0/3197658187 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8015a480 con 0x7f4d80070c40 2023-10-14T18:48:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d8533b700 1 --2- 172.21.15.79:0/3197658187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d800ccc80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4d8006dda0 tx=0x7f4d78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b315afafdd517e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d777fe700 1 -- 172.21.15.79:0/3197658187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7800e070 con 0x7f4d80070c40 2023-10-14T18:48:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d777fe700 1 -- 172.21.15.79:0/3197658187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7800ba50 con 0x7f4d80070c40 2023-10-14T18:48:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.670+0000 7f4d777fe700 1 -- 172.21.15.79:0/3197658187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780092e0 con 0x7f4d80070c40 2023-10-14T18:48:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3197658187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 msgr2=0x7f4d800ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3197658187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d800ccc80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4d8006dda0 tx=0x7f4d78009840 comp rx=0 tx=0).stop 2023-10-14T18:48:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3197658187 shutdown_connections 2023-10-14T18:48:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3197658187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d800ccc80 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3197658187 >> v2:172.21.15.144:3300/0 conn(0x7f4d80157520 0x7f4d80067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3197658187 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d801578f0 0x7f4d80070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3197658187 >> 172.21.15.79:0/3197658187 conn(0x7f4d800cd8f0 msgr2=0x7f4d800cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:56.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3197658187 shutdown_connections 2023-10-14T18:48:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.671+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3197658187 wait complete. 2023-10-14T18:48:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.672+0000 7f4d85b3c700 1 Processor -- start 2023-10-14T18:48:56.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.672+0000 7f4d85b3c700 1 -- start start 2023-10-14T18:48:56.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d80157520 0x7f4d8015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d801578f0 0x7f4d80154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80153610 con 0x7f4d80070c40 2023-10-14T18:48:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801538f0 con 0x7f4d801578f0 2023-10-14T18:48:56.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80153bd0 con 0x7f4d80157520 2023-10-14T18:48:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52364/0 (socket says 172.21.15.79:52364) 2023-10-14T18:48:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 -- 172.21.15.79:0/3751707504 learned_addr learned my addr 172.21.15.79:0/3751707504 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 -- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d80157520 msgr2=0x7f4d8015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d80157520 0x7f4d8015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 -- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d801578f0 msgr2=0x7f4d80154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d801578f0 0x7f4d80154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 -- 172.21.15.79:0/3751707504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009ae0 con 0x7f4d80070c40 2023-10-14T18:48:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d84b3a700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c7d0 tx=0x7f4d7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c011600 con 0x7f4d80070c40 2023-10-14T18:48:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c011760 con 0x7f4d80070c40 2023-10-14T18:48:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d80153eb0 con 0x7f4d80070c40 2023-10-14T18:48:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c011b20 con 0x7f4d80070c40 2023-10-14T18:48:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.673+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d801546b0 con 0x7f4d80070c40 2023-10-14T18:48:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.674+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d801543d0 con 0x7f4d80070c40 2023-10-14T18:48:56.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.674+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d7c0193f0 con 0x7f4d80070c40 2023-10-14T18:48:56.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.675+0000 7f4d74ff9700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:56.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.675+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4d7c084660 con 0x7f4d80070c40 2023-10-14T18:48:56.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.675+0000 7f4d77fff700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.676+0000 7f4d77fff700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 0x7f4d6c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d70006fd0 tx=0x7f4d70006db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.679+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d7c051c20 con 0x7f4d80070c40 2023-10-14T18:48:56.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.863+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d800b02e0 con 0x7f4d80070c40 2023-10-14T18:48:56.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.864+0000 7f4d74ff9700 1 -- 172.21.15.79:0/3751707504 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f4d7c055240 con 0x7f4d80070c40 2023-10-14T18:48:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:56.865 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":81,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:48:56.102513+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:48:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 msgr2=0x7f4d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 0x7f4d6c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4d70006fd0 tx=0x7f4d70006db0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 msgr2=0x7f4d8014a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c7d0 tx=0x7f4d7c008040 comp rx=0 tx=0).stop 2023-10-14T18:48:56.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 shutdown_connections 2023-10-14T18:48:56.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4d6c066f30 0x7f4d6c0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d801578f0 0x7f4d80154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d80070c40 0x7f4d8014a680 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 --2- 172.21.15.79:0/3751707504 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4d80157520 0x7f4d8015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:56.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 >> 172.21.15.79:0/3751707504 conn(0x7f4d800cd8f0 msgr2=0x7f4d800c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:56.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 shutdown_connections 2023-10-14T18:48:56.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.866+0000 7f4d85b3c700 1 -- 172.21.15.79:0/3751707504 wait complete. 2023-10-14T18:48:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:48:56.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:48:56.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.996+0000 7fef6dcbc700 1 Processor -- start 2023-10-14T18:48:56.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.996+0000 7fef6dcbc700 1 -- start start 2023-10-14T18:48:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef6dcbc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef68164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef6dcbc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680b0790 con 0x7fef68159ec0 2023-10-14T18:48:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef6dcbc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef680ce1f0 con 0x7fef6815a290 2023-10-14T18:48:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef6dcbc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680b0b20 con 0x7fef680d05a0 2023-10-14T18:48:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef677fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fef68159ec0 0x7fef680af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38214/0 (socket says 172.21.15.79:38214) 2023-10-14T18:48:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef677fe700 1 -- 172.21.15.79:0/696211078 learned_addr learned my addr 172.21.15.79:0/696211078 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef67fff700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef68164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293803557 0 0) 0x7fef680b0790 con 0x7fef68159ec0 2023-10-14T18:48:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.997+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef50003570 con 0x7fef68159ec0 2023-10-14T18:48:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279628449 0 0) 0x7fef50003570 con 0x7fef68159ec0 2023-10-14T18:48:57.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 msgr2=0x7fef68164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef68164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 >> v1:172.21.15.144:6789/0 conn(0x7fef6815a290 legacy=0x7fef6806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680b04b0 con 0x7fef68159ec0 2023-10-14T18:48:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fef580017f0 con 0x7fef68159ec0 2023-10-14T18:48:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 >> v1:172.21.15.79:6789/0 conn(0x7fef68159ec0 legacy=0x7fef680af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef50003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef50003fd0 0x7fef50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef680b0b20 con 0x7fef50003fd0 2023-10-14T18:48:57.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5000bb40 con 0x7fef50004d50 2023-10-14T18:48:57.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5000bd00 con 0x7fef680d05a0 2023-10-14T18:48:57.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef50003fd0 0x7fef50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef677fe700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef50003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef67fff700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 -- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 msgr2=0x7fef50003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef680d05a0 0x7fef50003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 -- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef50004d50 msgr2=0x7fef500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef50004d50 0x7fef500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 -- 172.21.15.79:0/696211078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50003570 con 0x7fef50003fd0 2023-10-14T18:48:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef66ffd700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef50003fd0 0x7fef50004810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0019a0 tx=0x7fef5c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02aca5ed1f0e4f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00c5d0 con 0x7fef50003fd0 2023-10-14T18:48:57.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00c750 con 0x7fef50003fd0 2023-10-14T18:48:57.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.998+0000 7fef667fc700 1 -- 172.21.15.79:0/696211078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00cb10 con 0x7fef50003fd0 2023-10-14T18:48:57.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 -- 172.21.15.79:0/696211078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef50003fd0 msgr2=0x7fef50004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/696211078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef50003fd0 0x7fef50004810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0019a0 tx=0x7fef5c007d10 comp rx=0 tx=0).stop 2023-10-14T18:48:57.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef67fff700 1 -- 172.21.15.79:0/696211078 reap_dead start 2023-10-14T18:48:57.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 -- 172.21.15.79:0/696211078 shutdown_connections 2023-10-14T18:48:57.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 -- 172.21.15.79:0/696211078 >> 172.21.15.79:0/696211078 conn(0x7fef680d1880 msgr2=0x7fef680cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:57.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 -- 172.21.15.79:0/696211078 shutdown_connections 2023-10-14T18:48:57.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:56.999+0000 7fef6dcbc700 1 -- 172.21.15.79:0/696211078 wait complete. 2023-10-14T18:48:57.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.000+0000 7fef6dcbc700 1 Processor -- start 2023-10-14T18:48:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.000+0000 7fef6dcbc700 1 -- start start 2023-10-14T18:48:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 0x7fef68147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef6816a1f0 0x7fef6816a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6816d850 con 0x7fef680c67f0 2023-10-14T18:48:57.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6816ddd0 con 0x7fef6816a1f0 2023-10-14T18:48:57.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef6dcbc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680c7180 con 0x7fef50003fd0 2023-10-14T18:48:57.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52382/0 (socket says 172.21.15.79:52382) 2023-10-14T18:48:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 -- 172.21.15.79:0/2378324211 learned_addr learned my addr 172.21.15.79:0/2378324211 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef66ffd700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef6816a1f0 0x7fef6816a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef677fe700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 0x7fef68147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 -- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 msgr2=0x7fef68147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 0x7fef68147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 -- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef6816a1f0 msgr2=0x7fef6816a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef6816a1f0 0x7fef6816a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 -- 172.21.15.79:0/2378324211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6816acf0 con 0x7fef680c67f0 2023-10-14T18:48:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef677fe700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 0x7fef68147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:57.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.001+0000 7fef67fff700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fef680cbc50 tx=0x7fef60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.002+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60015670 con 0x7fef680c67f0 2023-10-14T18:48:57.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.002+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef600157d0 con 0x7fef680c67f0 2023-10-14T18:48:57.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.002+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60015bd0 con 0x7fef680c67f0 2023-10-14T18:48:57.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.002+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6816afd0 con 0x7fef680c67f0 2023-10-14T18:48:57.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.002+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68153d10 con 0x7fef680c67f0 2023-10-14T18:48:57.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.003+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6816df80 con 0x7fef680c67f0 2023-10-14T18:48:57.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.003+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef60020460 con 0x7fef680c67f0 2023-10-14T18:48:57.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.003+0000 7fef4f7fe700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 0x7fef540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.003+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fef60084300 con 0x7fef680c67f0 2023-10-14T18:48:57.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.003+0000 7fef677fe700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 0x7fef540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.004+0000 7fef677fe700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 0x7fef540693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef58001190 tx=0x7fef58006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.008+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef6816df80 con 0x7fef680c67f0 2023-10-14T18:48:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.192+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef6816df80 con 0x7fef680c67f0 2023-10-14T18:48:57.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.192+0000 7fef4f7fe700 1 -- 172.21.15.79:0/2378324211 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef6816df80 con 0x7fef680c67f0 2023-10-14T18:48:57.193 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:48:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 msgr2=0x7fef540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 0x7fef540693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fef58001190 tx=0x7fef58006040 comp rx=0 tx=0).stop 2023-10-14T18:48:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 msgr2=0x7fef680c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fef680cbc50 tx=0x7fef60008040 comp rx=0 tx=0).stop 2023-10-14T18:48:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 shutdown_connections 2023-10-14T18:48:57.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.194+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fef54066f30 0x7fef540693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef680c67f0 0x7fef680c6c40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef50003fd0 0x7fef68147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 --2- 172.21.15.79:0/2378324211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef6816a1f0 0x7fef6816a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 >> 172.21.15.79:0/2378324211 conn(0x7fef680d1880 msgr2=0x7fef681558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 shutdown_connections 2023-10-14T18:48:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.195+0000 7fef6dcbc700 1 -- 172.21.15.79:0/2378324211 wait complete. 2023-10-14T18:48:57.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:48:57.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.321+0000 7f722a6c6700 1 Processor -- start 2023-10-14T18:48:57.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.321+0000 7f722a6c6700 1 -- start start 2023-10-14T18:48:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f722a6c6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72240cf060 0x7f72240b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f722a6c6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240cb0b0 con 0x7f7224157a90 2023-10-14T18:48:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f722a6c6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240b0830 con 0x7f7224157e60 2023-10-14T18:48:57.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f722a6c6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240b0ad0 con 0x7f72240cf060 2023-10-14T18:48:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f72296c4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7224157a90 0x7f72240b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38222/0 (socket says 172.21.15.79:38222) 2023-10-14T18:48:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.322+0000 7f72296c4700 1 -- 172.21.15.79:0/1416361527 learned_addr learned my addr 172.21.15.79:0/1416361527 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 --2- 172.21.15.79:0/1416361527 >> v2:172.21.15.144:3300/0 conn(0x7f72240cf060 0x7f72240b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809464893 0 0) 0x7f72240cb0b0 con 0x7f7224157a90 2023-10-14T18:48:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7210003570 con 0x7f7224157a90 2023-10-14T18:48:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4074174011 0 0) 0x7f7210003570 con 0x7f7224157a90 2023-10-14T18:48:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 >> v2:172.21.15.144:3300/0 conn(0x7f72240cf060 msgr2=0x7f72240b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 --2- 172.21.15.79:0/1416361527 >> v2:172.21.15.144:3300/0 conn(0x7f72240cf060 0x7f72240b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 >> v1:172.21.15.144:6789/0 conn(0x7f7224157e60 legacy=0x7f72240ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240ca780 con 0x7f7224157a90 2023-10-14T18:48:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7220001470 con 0x7f7224157a90 2023-10-14T18:48:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 >> v1:172.21.15.79:6789/0 conn(0x7f7224157a90 legacy=0x7f72240b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7210003a60 0x7f7210003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210004810 0x7f7210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 0x7f721000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240b0ad0 con 0x7f72100051c0 2023-10-14T18:48:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721000c160 con 0x7f7210003a60 2023-10-14T18:48:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721000c320 con 0x7f7210004810 2023-10-14T18:48:57.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 0x7f721000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f72296c4700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7210003a60 0x7f7210003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7228ec3700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210004810 0x7f7210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 -- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210004810 msgr2=0x7f7210004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210004810 0x7f7210004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 -- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7210003a60 msgr2=0x7f7210003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.323+0000 7f7229ec5700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7210003a60 0x7f7210003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f7229ec5700 1 -- 172.21.15.79:0/1416361527 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210003570 con 0x7f72100051c0 2023-10-14T18:48:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f7229ec5700 1 -- 172.21.15.79:0/1416361527 reap_dead start 2023-10-14T18:48:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f7229ec5700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 0x7f721000ba60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f72240cf460 tx=0x7f721c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b42ccc9501b0ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c00ea90 con 0x7f72100051c0 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c00f040 con 0x7f72100051c0 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f721bfff700 1 -- 172.21.15.79:0/1416361527 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c00ee40 con 0x7f72100051c0 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 -- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 msgr2=0x7f721000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 0x7f721000ba60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f72240cf460 tx=0x7f721c00b040 comp rx=0 tx=0).stop 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 -- 172.21.15.79:0/1416361527 shutdown_connections 2023-10-14T18:48:57.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 --2- 172.21.15.79:0/1416361527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72100051c0 0x7f721000ba60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 -- 172.21.15.79:0/1416361527 >> 172.21.15.79:0/1416361527 conn(0x7f722406bc70 msgr2=0x7f722406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 -- 172.21.15.79:0/1416361527 shutdown_connections 2023-10-14T18:48:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.324+0000 7f722a6c6700 1 -- 172.21.15.79:0/1416361527 wait complete. 2023-10-14T18:48:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.325+0000 7f722a6c6700 1 Processor -- start 2023-10-14T18:48:57.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 -- start start 2023-10-14T18:48:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 0x7f72240c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f722415aed0 0x7f72240c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240c2c30 con 0x7f72240c5090 2023-10-14T18:48:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72240c2420 con 0x7f722415aed0 2023-10-14T18:48:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.326+0000 7f722a6c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7224159d00 con 0x7f72100051c0 2023-10-14T18:48:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52402/0 (socket says 172.21.15.79:52402) 2023-10-14T18:48:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 -- 172.21.15.79:0/3000960303 learned_addr learned my addr 172.21.15.79:0/3000960303 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7228ec3700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f722415aed0 0x7f72240c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f72296c4700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 0x7f72240c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 -- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 msgr2=0x7f72240c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 0x7f72240c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 -- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f722415aed0 msgr2=0x7f72240c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f722415aed0 0x7f72240c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 -- 172.21.15.79:0/3000960303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240c3350 con 0x7f72240c5090 2023-10-14T18:48:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f72296c4700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 0x7f72240c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:57.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f7229ec5700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f72240c5850 tx=0x7f721c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c01d660 con 0x7f72240c5090 2023-10-14T18:48:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c022070 con 0x7f72240c5090 2023-10-14T18:48:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72240c2670 con 0x7f72240c5090 2023-10-14T18:48:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c01da10 con 0x7f72240c5090 2023-10-14T18:48:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.327+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7224159990 con 0x7f72240c5090 2023-10-14T18:48:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.328+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722406e3e0 con 0x7f72240c5090 2023-10-14T18:48:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.329+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f721c003020 con 0x7f72240c5090 2023-10-14T18:48:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.329+0000 7f72197fa700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.329+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f721c024070 con 0x7f72240c5090 2023-10-14T18:48:57.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.329+0000 7f72296c4700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.329+0000 7f72296c4700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 0x7f72080693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f72200015a0 tx=0x7f7220009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.333+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f721c053da0 con 0x7f72240c5090 2023-10-14T18:48:57.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.517+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f722415a090 con 0x7f72240c5090 2023-10-14T18:48:57.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.517+0000 7f72197fa700 1 -- 172.21.15.79:0/3000960303 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f721c018060 con 0x7f72240c5090 2023-10-14T18:48:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:48:57.518 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:48:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:48:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:48:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:48:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:48:57.519 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:48:57.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 msgr2=0x7f72080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 0x7f72080693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f72200015a0 tx=0x7f7220009040 comp rx=0 tx=0).stop 2023-10-14T18:48:57.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 msgr2=0x7f7224153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f72240c5850 tx=0x7f721c019000 comp rx=0 tx=0).stop 2023-10-14T18:48:57.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 shutdown_connections 2023-10-14T18:48:57.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72240c5090 0x7f7224153140 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f72100051c0 0x7f72240c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 --2- 172.21.15.79:0/3000960303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f722415aed0 0x7f72240c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 >> 172.21.15.79:0/3000960303 conn(0x7f722406bc70 msgr2=0x7f72241559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:57.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 shutdown_connections 2023-10-14T18:48:57.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.519+0000 7f722a6c6700 1 -- 172.21.15.79:0/3000960303 wait complete. 2023-10-14T18:48:57.532 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:48:57.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:48:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.650+0000 7f99dd0e5700 1 Processor -- start 2023-10-14T18:48:57.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.650+0000 7f99dd0e5700 1 -- start start 2023-10-14T18:48:57.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99dd0e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99d806f0b0 0x7f99d806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99dd0e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 0x7f99d806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99dd0e5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80687f0 con 0x7f99d8156a30 2023-10-14T18:48:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99dd0e5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d8067be0 con 0x7f99d806f0b0 2023-10-14T18:48:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99dd0e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d8067ec0 con 0x7f99d8156e00 2023-10-14T18:48:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99ce59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99d806f0b0 0x7f99d806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99d6d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f99d8156a30 0x7f99d80cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38232/0 (socket says 172.21.15.79:38232) 2023-10-14T18:48:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99d6d9d700 1 -- 172.21.15.79:0/3319996451 learned_addr learned my addr 172.21.15.79:0/3319996451 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.651+0000 7f99ce59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f99d806f0b0 0x7f99d806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52418/0 (socket says 172.21.15.79:52418) 2023-10-14T18:48:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99ce59c700 1 -- 172.21.15.79:0/3319996451 >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 msgr2=0x7f99d806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d759e700 1 --2- 172.21.15.79:0/3319996451 >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 0x7f99d806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d659c700 1 -- 172.21.15.79:0/3319996451 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510367247 0 0) 0x7f99d80687f0 con 0x7f99d8156a30 2023-10-14T18:48:57.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99ce59c700 1 --2- 172.21.15.79:0/3319996451 >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 0x7f99d806c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99ce59c700 1 -- 172.21.15.79:0/3319996451 >> v1:172.21.15.79:6789/0 conn(0x7f99d8156a30 legacy=0x7f99d80cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99ce59c700 1 -- 172.21.15.79:0/3319996451 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d80681a0 con 0x7f99d806f0b0 2023-10-14T18:48:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d759e700 1 --2- 172.21.15.79:0/3319996451 >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 0x7f99d806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99ce59c700 1 --2- 172.21.15.79:0/3319996451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d806f0b0 0x7f99d806bc70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f99d815a750 tx=0x7f99c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e054c4f239686fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d659c700 1 -- 172.21.15.79:0/3319996451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0009e80 con 0x7f99d806f0b0 2023-10-14T18:48:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d659c700 1 -- 172.21.15.79:0/3319996451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000b820 con 0x7f99d806f0b0 2023-10-14T18:48:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99d659c700 1 -- 172.21.15.79:0/3319996451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000bba0 con 0x7f99d806f0b0 2023-10-14T18:48:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 -- 172.21.15.79:0/3319996451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d806f0b0 msgr2=0x7f99d806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/3319996451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d806f0b0 0x7f99d806bc70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f99d815a750 tx=0x7f99c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 -- 172.21.15.79:0/3319996451 shutdown_connections 2023-10-14T18:48:57.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/3319996451 >> v2:172.21.15.144:3300/0 conn(0x7f99d8156e00 0x7f99d806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/3319996451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d806f0b0 0x7f99d806bc70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 -- 172.21.15.79:0/3319996451 >> 172.21.15.79:0/3319996451 conn(0x7f99d80cdae0 msgr2=0x7f99d80cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:57.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 -- 172.21.15.79:0/3319996451 shutdown_connections 2023-10-14T18:48:57.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.652+0000 7f99dd0e5700 1 -- 172.21.15.79:0/3319996451 wait complete. 2023-10-14T18:48:57.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 Processor -- start 2023-10-14T18:48:57.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 -- start start 2023-10-14T18:48:57.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 0x7f99d8148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99d8156e00 0x7f99d80c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8147390 con 0x7f99d8156a30 2023-10-14T18:48:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8147670 con 0x7f99d8156e00 2023-10-14T18:48:57.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.654+0000 7f99dd0e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8147950 con 0x7f99d806f0b0 2023-10-14T18:48:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52432/0 (socket says 172.21.15.79:52432) 2023-10-14T18:48:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 -- 172.21.15.79:0/1621317072 learned_addr learned my addr 172.21.15.79:0/1621317072 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99d759e700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99d8156e00 0x7f99d80c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99d6d9d700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 0x7f99d8148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 -- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 msgr2=0x7f99d8148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 0x7f99d8148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 -- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99d8156e00 msgr2=0x7f99d80c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99d8156e00 0x7f99d80c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:57.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 -- 172.21.15.79:0/1621317072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009420 con 0x7f99d8156a30 2023-10-14T18:48:57.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99d6d9d700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 0x7f99d8148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:48:57.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99ce59c700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ce6e0 tx=0x7f99c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000bba0 con 0x7f99d8156a30 2023-10-14T18:48:57.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c0011420 con 0x7f99d8156a30 2023-10-14T18:48:57.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d8147c30 con 0x7f99d8156a30 2023-10-14T18:48:57.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00117e0 con 0x7f99d8156a30 2023-10-14T18:48:57.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.655+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d813ebe0 con 0x7f99d8156a30 2023-10-14T18:48:57.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.656+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d8148150 con 0x7f99d8156a30 2023-10-14T18:48:57.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.656+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99c0011b50 con 0x7f99d8156a30 2023-10-14T18:48:57.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.657+0000 7f99cf7fe700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 0x7f99b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.657+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f99c0085bb0 con 0x7f99d8156a30 2023-10-14T18:48:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.657+0000 7f99d6d9d700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 0x7f99b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.658+0000 7f99d6d9d700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 0x7f99b80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99d80c5780 tx=0x7f99c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.661+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99d8148150 con 0x7f99d8156a30 2023-10-14T18:48:57.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:57.843+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f99d8148150 con 0x7f99d8156a30 2023-10-14T18:48:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.646+0000 7f99cf7fe700 1 -- 172.21.15.79:0/1621317072 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f99d8148150 con 0x7f99d8156a30 2023-10-14T18:48:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 msgr2=0x7f99b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 0x7f99b80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f99d80c5780 tx=0x7f99c8009040 comp rx=0 tx=0).stop 2023-10-14T18:48:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 msgr2=0x7f99d813f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ce6e0 tx=0x7f99c0017000 comp rx=0 tx=0).stop 2023-10-14T18:48:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 shutdown_connections 2023-10-14T18:48:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f99b8066f30 0x7f99b80693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99d8156e00 0x7f99d80c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f99d806f0b0 0x7f99d8148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 --2- 172.21.15.79:0/1621317072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99d8156a30 0x7f99d813f8e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.649+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 >> 172.21.15.79:0/1621317072 conn(0x7f99d80cdae0 msgr2=0x7f99d814d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.650+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 shutdown_connections 2023-10-14T18:48:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.650+0000 7f99dd0e5700 1 -- 172.21.15.79:0/1621317072 wait complete. 2023-10-14T18:48:58.653 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:48:58.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:48:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.785+0000 7f3db96dc700 1 Processor -- start 2023-10-14T18:48:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.785+0000 7f3db96dc700 1 -- start start 2023-10-14T18:48:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3db40678b0 0x7f3db415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 0x7f3db415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 0x7f3db415e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db40cae70 con 0x7f3db40678b0 2023-10-14T18:48:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db40cb150 con 0x7f3db40c9390 2023-10-14T18:48:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db96dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40cb430 con 0x7f3db40cbf10 2023-10-14T18:48:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3db40678b0 0x7f3db415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3db40678b0 0x7f3db415db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37254/0 (socket says 172.21.15.79:37254) 2023-10-14T18:48:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.786+0000 7f3db2ffd700 1 -- 172.21.15.79:0/648592064 learned_addr learned my addr 172.21.15.79:0/648592064 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3daa7fc700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 0x7f3db415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db37fe700 1 --2- 172.21.15.79:0/648592064 >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 0x7f3db415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 -- 172.21.15.79:0/648592064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 msgr2=0x7f3db415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 0x7f3db415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 -- 172.21.15.79:0/648592064 >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 msgr2=0x7f3db415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/648592064 >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 0x7f3db415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 -- 172.21.15.79:0/648592064 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40cb710 con 0x7f3db40678b0 2023-10-14T18:48:58.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db37fe700 1 --2- 172.21.15.79:0/648592064 >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 0x7f3db415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:58.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3daa7fc700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 0x7f3db415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:58.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40678b0 0x7f3db415db80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3da40099b0 tx=0x7f3da4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669b85153e0fe890 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:58.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db27fc700 1 -- 172.21.15.79:0/648592064 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400b820 con 0x7f3db40678b0 2023-10-14T18:48:58.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db27fc700 1 -- 172.21.15.79:0/648592064 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400b980 con 0x7f3db40678b0 2023-10-14T18:48:58.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db27fc700 1 -- 172.21.15.79:0/648592064 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400bd20 con 0x7f3db40678b0 2023-10-14T18:48:58.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db96dc700 1 -- 172.21.15.79:0/648592064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40678b0 msgr2=0x7f3db415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:58.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.787+0000 7f3db96dc700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40678b0 0x7f3db415db80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3da40099b0 tx=0x7f3da4009250 comp rx=0 tx=0).stop 2023-10-14T18:48:58.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 -- 172.21.15.79:0/648592064 shutdown_connections 2023-10-14T18:48:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 --2- 172.21.15.79:0/648592064 >> v2:172.21.15.144:3300/0 conn(0x7f3db40c9390 0x7f3db415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40678b0 0x7f3db415db80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 --2- 172.21.15.79:0/648592064 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40cbf10 0x7f3db415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 -- 172.21.15.79:0/648592064 >> 172.21.15.79:0/648592064 conn(0x7f3db4069870 msgr2=0x7f3db4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 -- 172.21.15.79:0/648592064 shutdown_connections 2023-10-14T18:48:58.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.788+0000 7f3db96dc700 1 -- 172.21.15.79:0/648592064 wait complete. 2023-10-14T18:48:58.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.789+0000 7f3db96dc700 1 Processor -- start 2023-10-14T18:48:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.789+0000 7f3db96dc700 1 -- start start 2023-10-14T18:48:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 0x7f3db40ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 0x7f3db40c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4150cb0 con 0x7f3db40cbf10 2023-10-14T18:48:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40c8cd0 con 0x7f3db40678b0 2023-10-14T18:48:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40aba10 con 0x7f3db40c9390 2023-10-14T18:48:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37256/0 (socket says 172.21.15.79:37256) 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 -- 172.21.15.79:0/1581098356 learned_addr learned my addr 172.21.15.79:0/1581098356 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 0x7f3db40ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3daa7fc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 0x7f3db40c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 -- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 msgr2=0x7f3db40c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 0x7f3db40c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 -- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 msgr2=0x7f3db40ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:58.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 0x7f3db40ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:58.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 -- 172.21.15.79:0/1581098356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40094f0 con 0x7f3db40cbf10 2023-10-14T18:48:58.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 0x7f3db40ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:58.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3daa7fc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 0x7f3db40c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:58.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db37fe700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00cf60 tx=0x7f3dac007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:58.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac015440 con 0x7f3db40cbf10 2023-10-14T18:48:58.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac0155c0 con 0x7f3db40cbf10 2023-10-14T18:48:58.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac015980 con 0x7f3db40cbf10 2023-10-14T18:48:58.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db40ac3a0 con 0x7f3db40cbf10 2023-10-14T18:48:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.790+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db40abf40 con 0x7f3db40cbf10 2023-10-14T18:48:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.791+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db404c3c0 con 0x7f3db40cbf10 2023-10-14T18:48:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.792+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3dac00d440 con 0x7f3db40cbf10 2023-10-14T18:48:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.792+0000 7f3dab7fe700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 0x7f3d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:58.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.792+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3dac084ec0 con 0x7f3db40cbf10 2023-10-14T18:48:58.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.792+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 0x7f3d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:58.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.793+0000 7f3db2ffd700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 0x7f3d940693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3da40099b0 tx=0x7f3da4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:58.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.797+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dac052310 con 0x7f3db40cbf10 2023-10-14T18:48:58.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:58.978+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3db4068da0 con 0x7f3db40cbf10 2023-10-14T18:48:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.650+0000 7f3dab7fe700 1 -- 172.21.15.79:0/1581098356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3dac055930 con 0x7f3db40cbf10 2023-10-14T18:48:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 msgr2=0x7f3d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 0x7f3d940693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3da40099b0 tx=0x7f3da4017000 comp rx=0 tx=0).stop 2023-10-14T18:48:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 msgr2=0x7f3db40cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00cf60 tx=0x7f3dac007870 comp rx=0 tx=0).stop 2023-10-14T18:48:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 shutdown_connections 2023-10-14T18:48:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d94066f30 0x7f3d940693e0 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3da40099b0 tx=0x7f3da4017000 comp rx=0 tx=0).stop 2023-10-14T18:48:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3db40cbf10 0x7f3db40cc730 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3db40678b0 0x7f3db40ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 --2- 172.21.15.79:0/1581098356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3db40c9390 0x7f3db40c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.658+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 >> 172.21.15.79:0/1581098356 conn(0x7f3db4069870 msgr2=0x7f3db406d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.660+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 shutdown_connections 2023-10-14T18:48:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.660+0000 7f3db96dc700 1 -- 172.21.15.79:0/1581098356 wait complete. 2023-10-14T18:48:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:48:59.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:48:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.793+0000 7fdfff417700 1 Processor -- start 2023-10-14T18:48:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.793+0000 7fdfff417700 1 -- start start 2023-10-14T18:48:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdfff417700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 0x7fdff815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdfff417700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdff80b6580 0x7fdff806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdfff417700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff80b4d70 con 0x7fdff806a830 2023-10-14T18:48:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdfff417700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff806ac70 con 0x7fdff80b6580 2023-10-14T18:48:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdfff417700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80cd8d0 con 0x7fdff80cce30 2023-10-14T18:48:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffdc14700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdff80b6580 0x7fdff806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffec16700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdff806a830 0x7fdff815d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45550/0 (socket says 172.21.15.79:45550) 2023-10-14T18:48:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffec16700 1 -- 172.21.15.79:0/261127282 learned_addr learned my addr 172.21.15.79:0/261127282 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:48:59.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffe415700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 0x7fdff815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:59.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffdc14700 1 -- 172.21.15.79:0/261127282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 msgr2=0x7fdff815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:48:59.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffdc14700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 0x7fdff815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffdc14700 1 -- 172.21.15.79:0/261127282 >> v1:172.21.15.79:6789/0 conn(0x7fdff806a830 legacy=0x7fdff815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffdc14700 1 -- 172.21.15.79:0/261127282 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff80b4440 con 0x7fdff80b6580 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffd413700 1 -- 172.21.15.79:0/261127282 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723679449 0 0) 0x7fdff80b4d70 con 0x7fdff806a830 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.794+0000 7fdffe415700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 0x7fdff815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdffdc14700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80b6580 0x7fdff806a2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098e0 tx=0x7fdfe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c962b98fbee0e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdffd413700 1 -- 172.21.15.79:0/261127282 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8009e80 con 0x7fdff80b6580 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdffd413700 1 -- 172.21.15.79:0/261127282 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe800b860 con 0x7fdff80b6580 2023-10-14T18:48:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdffd413700 1 -- 172.21.15.79:0/261127282 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800bbe0 con 0x7fdff80b6580 2023-10-14T18:48:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 -- 172.21.15.79:0/261127282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80b6580 msgr2=0x7fdff806a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80b6580 0x7fdff806a2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098e0 tx=0x7fdfe80091a0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 -- 172.21.15.79:0/261127282 shutdown_connections 2023-10-14T18:48:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80cce30 0x7fdff815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 --2- 172.21.15.79:0/261127282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff80b6580 0x7fdff806a2f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 -- 172.21.15.79:0/261127282 >> 172.21.15.79:0/261127282 conn(0x7fdff8068cb0 msgr2=0x7fdff80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:48:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 -- 172.21.15.79:0/261127282 shutdown_connections 2023-10-14T18:48:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.795+0000 7fdfff417700 1 -- 172.21.15.79:0/261127282 wait complete. 2023-10-14T18:48:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.796+0000 7fdfff417700 1 Processor -- start 2023-10-14T18:48:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.796+0000 7fdfff417700 1 -- start start 2023-10-14T18:48:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80b6580 0x7fdff80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff80cce30 0x7fdff80b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80b32f0 con 0x7fdff806a830 2023-10-14T18:48:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff8153c80 con 0x7fdff80cce30 2023-10-14T18:48:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdfff417700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff813c1b0 con 0x7fdff80b6580 2023-10-14T18:48:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdffe415700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdffe415700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37284/0 (socket says 172.21.15.79:37284) 2023-10-14T18:48:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.797+0000 7fdffe415700 1 -- 172.21.15.79:0/2179300395 learned_addr learned my addr 172.21.15.79:0/2179300395 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:48:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 -- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80b6580 msgr2=0x7fdff80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80b6580 0x7fdff80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 -- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff80cce30 msgr2=0x7fdff80b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:48:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff80cce30 0x7fdff80b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:48:59.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 -- 172.21.15.79:0/2179300395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe8009420 con 0x7fdff806a830 2023-10-14T18:48:59.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdffe415700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c880 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:59.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011600 con 0x7fdff806a830 2023-10-14T18:48:59.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4011760 con 0x7fdff806a830 2023-10-14T18:48:59.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff80b1d90 con 0x7fdff806a830 2023-10-14T18:48:59.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011b00 con 0x7fdff806a830 2023-10-14T18:48:59.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.798+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff80b1180 con 0x7fdff806a830 2023-10-14T18:48:59.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.799+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff80b2070 con 0x7fdff806a830 2023-10-14T18:48:59.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.799+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdff4018350 con 0x7fdff806a830 2023-10-14T18:48:59.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.800+0000 7fdfee7fc700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 0x7fdfdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:48:59.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.800+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fdff40844f0 con 0x7fdff806a830 2023-10-14T18:48:59.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.800+0000 7fdffdc14700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 0x7fdfdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:48:59.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.800+0000 7fdffdc14700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 0x7fdfdc0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b6990 tx=0x7fdfe8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:48:59.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:48:59.804+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdff4055250 con 0x7fdff806a830 2023-10-14T18:49:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.027+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdff80b4720 con 0x7fdff806a830 2023-10-14T18:49:00.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.676+0000 7fdfee7fc700 1 -- 172.21.15.79:0/2179300395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdff4054de0 con 0x7fdff806a830 2023-10-14T18:49:00.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 msgr2=0x7fdfdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 0x7fdfdc0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdff80b6990 tx=0x7fdfe8017000 comp rx=0 tx=0).stop 2023-10-14T18:49:00.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 msgr2=0x7fdff813c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdff400c880 tx=0x7fdff4008040 comp rx=0 tx=0).stop 2023-10-14T18:49:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 shutdown_connections 2023-10-14T18:49:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfdc066f30 0x7fdfdc0693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdff80cce30 0x7fdff80b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff806a830 0x7fdff813c440 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 --2- 172.21.15.79:0/2179300395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff80b6580 0x7fdff80b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.679+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 >> 172.21.15.79:0/2179300395 conn(0x7fdff8068cb0 msgr2=0x7fdff8150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:00.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.680+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 shutdown_connections 2023-10-14T18:49:00.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.680+0000 7fdfff417700 1 -- 172.21.15.79:0/2179300395 wait complete. 2023-10-14T18:49:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 10 and data pool 11 2023-10-14T18:49:00.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.809+0000 7f8e1d8fb700 1 Processor -- start 2023-10-14T18:49:00.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.809+0000 7f8e1d8fb700 1 -- start start 2023-10-14T18:49:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d8fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e180cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d8fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180cb7c0 con 0x7f8e1815cbd0 2023-10-14T18:49:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d8fb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1815e290 con 0x7f8e180cdab0 2023-10-14T18:49:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d8fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1815e850 con 0x7f8e180cd6e0 2023-10-14T18:49:00.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d0fa700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8e1815cbd0 0x7f8e1815d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45558/0 (socket says 172.21.15.79:45558) 2023-10-14T18:49:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1d0fa700 1 -- 172.21.15.79:0/3990389511 learned_addr learned my addr 172.21.15.79:0/3990389511 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829003090 0 0) 0x7f8e180cb7c0 con 0x7f8e1815cbd0 2023-10-14T18:49:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e180cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e08003570 con 0x7f8e1815cbd0 2023-10-14T18:49:00.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684043731 0 0) 0x7f8e08003570 con 0x7f8e1815cbd0 2023-10-14T18:49:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 msgr2=0x7f8e180cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e180cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 >> v1:172.21.15.144:6789/0 conn(0x7f8e180cdab0 legacy=0x7f8e1815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.810+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1815e570 con 0x7f8e1815cbd0 2023-10-14T18:49:00.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f8e100017f0 con 0x7f8e1815cbd0 2023-10-14T18:49:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 >> v1:172.21.15.79:6789/0 conn(0x7f8e1815cbd0 legacy=0x7f8e1815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e08003a90 0x7f8e08003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08004810 0x7f8e08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1815e850 con 0x7f8e08003a90 2023-10-14T18:49:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0800bb10 con 0x7f8e08004810 2023-10-14T18:49:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0800bcd0 con 0x7f8e180cd6e0 2023-10-14T18:49:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e08003a90 0x7f8e08003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e17fff700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08004810 0x7f8e08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1d0fa700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 -- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 msgr2=0x7f8e080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:00.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180cd6e0 0x7f8e080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 -- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08004810 msgr2=0x7f8e08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:00.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08004810 0x7f8e08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 -- 172.21.15.79:0/3990389511 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08003570 con 0x7f8e08003a90 2023-10-14T18:49:00.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e08003a90 0x7f8e08003e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009c00 tx=0x7f8e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa0dff7571ec2ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:00.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00e710 con 0x7f8e08003a90 2023-10-14T18:49:00.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00e870 con 0x7f8e08003a90 2023-10-14T18:49:00.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.811+0000 7f8e177fe700 1 -- 172.21.15.79:0/3990389511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00ec30 con 0x7f8e08003a90 2023-10-14T18:49:00.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/3990389511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e08003a90 msgr2=0x7f8e08003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/3990389511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e08003a90 0x7f8e08003e60 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009c00 tx=0x7f8e0c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d0fa700 1 -- 172.21.15.79:0/3990389511 reap_dead start 2023-10-14T18:49:00.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/3990389511 shutdown_connections 2023-10-14T18:49:00.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/3990389511 >> 172.21.15.79:0/3990389511 conn(0x7f8e18067660 msgr2=0x7f8e18067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:00.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/3990389511 shutdown_connections 2023-10-14T18:49:00.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.812+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/3990389511 wait complete. 2023-10-14T18:49:00.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.813+0000 7f8e1d8fb700 1 Processor -- start 2023-10-14T18:49:00.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.813+0000 7f8e1d8fb700 1 -- start start 2023-10-14T18:49:00.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 0x7f8e1816d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180b4340 0x7f8e180b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1816e700 con 0x7f8e180b2f80 2023-10-14T18:49:00.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b3eb0 con 0x7f8e08003a90 2023-10-14T18:49:00.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d8fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1816e140 con 0x7f8e180b4340 2023-10-14T18:49:00.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37296/0 (socket says 172.21.15.79:37296) 2023-10-14T18:49:00.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1c8f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 0x7f8e1816d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 -- 172.21.15.79:0/2954218384 learned_addr learned my addr 172.21.15.79:0/2954218384 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:00.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1d0fa700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180b4340 0x7f8e180b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 -- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180b4340 msgr2=0x7f8e180b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180b4340 0x7f8e180b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 -- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 msgr2=0x7f8e1816d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:00.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 0x7f8e1816d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:00.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 -- 172.21.15.79:0/2954218384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1816e420 con 0x7f8e180b2f80 2023-10-14T18:49:00.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 0x7f8e1816d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:49:00.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.814+0000 7f8e17fff700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8e04002ad0 tx=0x7f8e04007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:00.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400f8d0 con 0x7f8e180b2f80 2023-10-14T18:49:00.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400fa30 con 0x7f8e180b2f80 2023-10-14T18:49:00.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e180b3b40 con 0x7f8e180b2f80 2023-10-14T18:49:00.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400fdd0 con 0x7f8e180b2f80 2023-10-14T18:49:00.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18154ed0 con 0x7f8e180b2f80 2023-10-14T18:49:00.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.815+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e180b4020 con 0x7f8e180b2f80 2023-10-14T18:49:00.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.816+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e04013600 con 0x7f8e180b2f80 2023-10-14T18:49:00.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.816+0000 7f8e14ff9700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 0x7f8dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:00.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.816+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e04084a60 con 0x7f8e180b2f80 2023-10-14T18:49:00.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.816+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 0x7f8dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:00.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.817+0000 7f8e1c8f9700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 0x7f8dfc0693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0091e0 tx=0x7f8e0c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:00.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:00.820+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e04051cd0 con 0x7f8e180b2f80 2023-10-14T18:49:01.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.003+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e1804bb80 con 0x7f8e180b2f80 2023-10-14T18:49:01.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.004+0000 7f8e14ff9700 1 -- 172.21.15.79:0/2954218384 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f8e04017090 con 0x7f8e180b2f80 2023-10-14T18:49:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:01.005 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:00.028980+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:01.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 msgr2=0x7f8dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 0x7f8dfc0693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0091e0 tx=0x7f8e0c01a000 comp rx=0 tx=0).stop 2023-10-14T18:49:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 msgr2=0x7f8e18154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8e04002ad0 tx=0x7f8e04007d10 comp rx=0 tx=0).stop 2023-10-14T18:49:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 shutdown_connections 2023-10-14T18:49:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8dfc066f30 0x7f8dfc0693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8e180b4340 0x7f8e180b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e08003a90 0x7f8e1816d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 --2- 172.21.15.79:0/2954218384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e180b2f80 0x7f8e18154990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 >> 172.21.15.79:0/2954218384 conn(0x7f8e18067660 msgr2=0x7f8e180c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 shutdown_connections 2023-10-14T18:49:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.006+0000 7f8e1d8fb700 1 -- 172.21.15.79:0/2954218384 wait complete. 2023-10-14T18:49:01.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.134+0000 7f400acf6700 1 Processor -- start 2023-10-14T18:49:01.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.134+0000 7f400acf6700 1 -- start start 2023-10-14T18:49:01.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f400acf6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40041568d0 0x7f4004069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f400acf6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40040ad9b0 0x7f400406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f400acf6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4004067ba0 con 0x7f4004156ca0 2023-10-14T18:49:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f400acf6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400415aa90 con 0x7f40040ad9b0 2023-10-14T18:49:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f400acf6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4004067870 con 0x7f40041568d0 2023-10-14T18:49:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f4003fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40040ad9b0 0x7f400406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f4003fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40040ad9b0 0x7f400406a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37308/0 (socket says 172.21.15.79:37308) 2023-10-14T18:49:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.135+0000 7f4003fff700 1 -- 172.21.15.79:0/2094032185 learned_addr learned my addr 172.21.15.79:0/2094032185 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4008a92700 1 --2- 172.21.15.79:0/2094032185 >> v2:172.21.15.144:3300/0 conn(0x7f40041568d0 0x7f4004069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4003fff700 1 -- 172.21.15.79:0/2094032185 >> v2:172.21.15.144:3300/0 conn(0x7f40041568d0 msgr2=0x7f4004069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4003fff700 1 --2- 172.21.15.79:0/2094032185 >> v2:172.21.15.144:3300/0 conn(0x7f40041568d0 0x7f4004069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4003fff700 1 -- 172.21.15.79:0/2094032185 >> v1:172.21.15.144:6789/0 conn(0x7f4004156ca0 legacy=0x7f40040c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4003fff700 1 -- 172.21.15.79:0/2094032185 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40040c8ca0 con 0x7f40040ad9b0 2023-10-14T18:49:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f4003fff700 1 --2- 172.21.15.79:0/2094032185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40040ad9b0 0x7f400406a360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f40040b3bd0 tx=0x7f3ff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8d2865b28cb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f40037fe700 1 -- 172.21.15.79:0/2094032185 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800b860 con 0x7f40040ad9b0 2023-10-14T18:49:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f40037fe700 1 -- 172.21.15.79:0/2094032185 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800b9c0 con 0x7f40040ad9b0 2023-10-14T18:49:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f40037fe700 1 -- 172.21.15.79:0/2094032185 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800bd60 con 0x7f40040ad9b0 2023-10-14T18:49:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 -- 172.21.15.79:0/2094032185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40040ad9b0 msgr2=0x7f400406a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 --2- 172.21.15.79:0/2094032185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40040ad9b0 0x7f400406a360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f40040b3bd0 tx=0x7f3ff8009250 comp rx=0 tx=0).stop 2023-10-14T18:49:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 -- 172.21.15.79:0/2094032185 shutdown_connections 2023-10-14T18:49:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 --2- 172.21.15.79:0/2094032185 >> v2:172.21.15.144:3300/0 conn(0x7f40041568d0 0x7f4004069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 --2- 172.21.15.79:0/2094032185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40040ad9b0 0x7f400406a360 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.136+0000 7f400acf6700 1 -- 172.21.15.79:0/2094032185 >> 172.21.15.79:0/2094032185 conn(0x7f40040cda50 msgr2=0x7f40040cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.137+0000 7f400acf6700 1 -- 172.21.15.79:0/2094032185 shutdown_connections 2023-10-14T18:49:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.137+0000 7f400acf6700 1 -- 172.21.15.79:0/2094032185 wait complete. 2023-10-14T18:49:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 Processor -- start 2023-10-14T18:49:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 -- start start 2023-10-14T18:49:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 0x7f4004154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 0x7f40040b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40040c4380 con 0x7f40041568d0 2023-10-14T18:49:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40040c3770 con 0x7f4004156ca0 2023-10-14T18:49:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.138+0000 7f400acf6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40040c3a50 con 0x7f40040ad9b0 2023-10-14T18:49:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37310/0 (socket says 172.21.15.79:37310) 2023-10-14T18:49:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 -- 172.21.15.79:0/3268547175 learned_addr learned my addr 172.21.15.79:0/3268547175 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4008a92700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 0x7f4004154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4009293700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 0x7f40040b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 -- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 msgr2=0x7f4004154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 0x7f4004154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 -- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 msgr2=0x7f40040b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 0x7f40040b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 -- 172.21.15.79:0/3268547175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80094f0 con 0x7f40041568d0 2023-10-14T18:49:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4009293700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 0x7f40040b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:01.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4008a92700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 0x7f4004154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4003fff700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f40040ce880 tx=0x7f3ff8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8011e60 con 0x7f40041568d0 2023-10-14T18:49:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff801a630 con 0x7f40041568d0 2023-10-14T18:49:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40040c3d30 con 0x7f40041568d0 2023-10-14T18:49:01.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801a9f0 con 0x7f40041568d0 2023-10-14T18:49:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.139+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4004154bc0 con 0x7f40041568d0 2023-10-14T18:49:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.140+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400415a3f0 con 0x7f40041568d0 2023-10-14T18:49:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.140+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ff802d440 con 0x7f40041568d0 2023-10-14T18:49:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.141+0000 7f4000ff9700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.141+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ff8086110 con 0x7f40041568d0 2023-10-14T18:49:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.141+0000 7f4008a92700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.141+0000 7f4008a92700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 0x7f3ff00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40075e0 tx=0x7f3ff40097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.145+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ff8053380 con 0x7f40041568d0 2023-10-14T18:49:01.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.331+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f400404c3c0 con 0x7f40041568d0 2023-10-14T18:49:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.332+0000 7f4000ff9700 1 -- 172.21.15.79:0/3268547175 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f3ff80569a0 con 0x7f40041568d0 2023-10-14T18:49:01.333 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:01.334 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":84,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:00.028980+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:01.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 msgr2=0x7f3ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 0x7f3ff00693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ff40075e0 tx=0x7f3ff40097e0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 msgr2=0x7f40040c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f40040ce880 tx=0x7f3ff8017000 comp rx=0 tx=0).stop 2023-10-14T18:49:01.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 shutdown_connections 2023-10-14T18:49:01.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3ff0066f30 0x7f3ff00693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4004156ca0 0x7f40040b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40040ad9b0 0x7f4004154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 --2- 172.21.15.79:0/3268547175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40041568d0 0x7f40040c2cf0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 >> 172.21.15.79:0/3268547175 conn(0x7f40040cda50 msgr2=0x7f4004067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:01.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 shutdown_connections 2023-10-14T18:49:01.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.334+0000 7f400acf6700 1 -- 172.21.15.79:0/3268547175 wait complete. 2023-10-14T18:49:01.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:49:01.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.464+0000 7f68a046b700 1 Processor -- start 2023-10-14T18:49:01.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.464+0000 7f68a046b700 1 -- start start 2023-10-14T18:49:01.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.465+0000 7f68a046b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f68980678b0 0x7f689815db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.465+0000 7f68a046b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68980cae70 con 0x7f68980cbf10 2023-10-14T18:49:01.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.465+0000 7f68a046b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68980cb150 con 0x7f68980c9390 2023-10-14T18:49:01.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.465+0000 7f68a046b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68980cb430 con 0x7f68980678b0 2023-10-14T18:49:01.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689da06700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f68980cbf10 0x7f689815e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45570/0 (socket says 172.21.15.79:45570) 2023-10-14T18:49:01.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689da06700 1 -- 172.21.15.79:0/2180590077 learned_addr learned my addr 172.21.15.79:0/2180590077 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:01.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 --2- 172.21.15.79:0/2180590077 >> v2:172.21.15.144:3300/0 conn(0x7f68980678b0 0x7f689815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720180567 0 0) 0x7f68980cae70 con 0x7f68980cbf10 2023-10-14T18:49:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6884003570 con 0x7f68980cbf10 2023-10-14T18:49:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967402174 0 0) 0x7f6884003570 con 0x7f68980cbf10 2023-10-14T18:49:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 >> v2:172.21.15.144:3300/0 conn(0x7f68980678b0 msgr2=0x7f689815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:01.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 --2- 172.21.15.79:0/2180590077 >> v2:172.21.15.144:3300/0 conn(0x7f68980678b0 0x7f689815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 >> v1:172.21.15.144:6789/0 conn(0x7f68980c9390 legacy=0x7f689815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980cb710 con 0x7f68980cbf10 2023-10-14T18:49:01.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f6888001470 con 0x7f68980cbf10 2023-10-14T18:49:01.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 >> v1:172.21.15.79:6789/0 conn(0x7f68980cbf10 legacy=0x7f689815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 0x7f6884003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884004810 0x7f6884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68840051c0 0x7f688400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68980cb430 con 0x7f6884003a60 2023-10-14T18:49:01.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688400c0d0 con 0x7f6884004810 2023-10-14T18:49:01.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688400c290 con 0x7f68840051c0 2023-10-14T18:49:01.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 0x7f6884003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689da06700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884004810 0x7f6884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689ea08700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68840051c0 0x7f688400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 -- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68840051c0 msgr2=0x7f688400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:01.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68840051c0 0x7f688400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 -- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884004810 msgr2=0x7f6884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:01.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884004810 0x7f6884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.466+0000 7f689e207700 1 -- 172.21.15.79:0/2180590077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884003570 con 0x7f6884003a60 2023-10-14T18:49:01.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689da06700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884004810 0x7f6884004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:01.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689ea08700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68840051c0 0x7f688400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:01.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689ea08700 1 -- 172.21.15.79:0/2180590077 reap_dead start 2023-10-14T18:49:01.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689e207700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 0x7f6884003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6894009c00 tx=0x7f68940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae2a0fbfde54323 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400e710 con 0x7f6884003a60 2023-10-14T18:49:01.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400e870 con 0x7f6884003a60 2023-10-14T18:49:01.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f689d205700 1 -- 172.21.15.79:0/2180590077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400ec30 con 0x7f6884003a60 2023-10-14T18:49:01.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 -- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 msgr2=0x7f6884003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 0x7f6884003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6894009c00 tx=0x7f68940091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 -- 172.21.15.79:0/2180590077 shutdown_connections 2023-10-14T18:49:01.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 --2- 172.21.15.79:0/2180590077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6884003a60 0x7f6884003e70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 -- 172.21.15.79:0/2180590077 >> 172.21.15.79:0/2180590077 conn(0x7f6898069870 msgr2=0x7f6898069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:01.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 -- 172.21.15.79:0/2180590077 shutdown_connections 2023-10-14T18:49:01.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.467+0000 7f68a046b700 1 -- 172.21.15.79:0/2180590077 wait complete. 2023-10-14T18:49:01.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.468+0000 7f68a046b700 1 Processor -- start 2023-10-14T18:49:01.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.468+0000 7f68a046b700 1 -- start start 2023-10-14T18:49:01.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6884003a60 0x7f689816d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980ce7b0 0x7f6898147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68980cf290 con 0x7f689816d9d0 2023-10-14T18:49:01.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689816de40 con 0x7f68980ce7b0 2023-10-14T18:49:01.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f68a046b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68980cefb0 con 0x7f6884003a60 2023-10-14T18:49:01.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37334/0 (socket says 172.21.15.79:37334) 2023-10-14T18:49:01.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 -- 172.21.15.79:0/3550601467 learned_addr learned my addr 172.21.15.79:0/3550601467 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689e207700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6884003a60 0x7f689816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689ea08700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980ce7b0 0x7f6898147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 -- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6884003a60 msgr2=0x7f689816d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6884003a60 0x7f689816d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 -- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980ce7b0 msgr2=0x7f6898147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.469+0000 7f689da06700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980ce7b0 0x7f6898147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f689da06700 1 -- 172.21.15.79:0/3550601467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689816b190 con 0x7f689816d9d0 2023-10-14T18:49:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f689da06700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f688800eb90 tx=0x7f6888000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800c7e0 con 0x7f689816d9d0 2023-10-14T18:49:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800c940 con 0x7f689816d9d0 2023-10-14T18:49:01.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689816b470 con 0x7f689816d9d0 2023-10-14T18:49:01.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800ccc0 con 0x7f689816d9d0 2023-10-14T18:49:01.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.470+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68980cec20 con 0x7f689816d9d0 2023-10-14T18:49:01.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.471+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689804c3c0 con 0x7f689816d9d0 2023-10-14T18:49:01.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.471+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f688801d460 con 0x7f689816d9d0 2023-10-14T18:49:01.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.471+0000 7f688e7fc700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 0x7f687c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:01.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.472+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6888084660 con 0x7f689816d9d0 2023-10-14T18:49:01.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.472+0000 7f689e207700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 0x7f687c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:01.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.472+0000 7f689e207700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 0x7f687c0693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f68940091e0 tx=0x7f689401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:01.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.475+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68880518d0 con 0x7f689816d9d0 2023-10-14T18:49:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:01.703+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6898068da0 con 0x7f689816d9d0 2023-10-14T18:49:02.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.685+0000 7f688e7fc700 1 -- 172.21.15.79:0/3550601467 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6888054ef0 con 0x7f689816d9d0 2023-10-14T18:49:02.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 msgr2=0x7f687c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 0x7f687c0693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f68940091e0 tx=0x7f689401a000 comp rx=0 tx=0).stop 2023-10-14T18:49:02.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 msgr2=0x7f68980ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f688800eb90 tx=0x7f6888000bc0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 shutdown_connections 2023-10-14T18:49:02.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f687c066f30 0x7f687c0693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980ce7b0 0x7f6898147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6884003a60 0x7f689816d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 --2- 172.21.15.79:0/3550601467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f689816d9d0 0x7f68980ce270 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 >> 172.21.15.79:0/3550601467 conn(0x7f6898069870 msgr2=0x7f68980c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:02.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 shutdown_connections 2023-10-14T18:49:02.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.687+0000 7f68a046b700 1 -- 172.21.15.79:0/3550601467 wait complete. 2023-10-14T18:49:02.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:49:02.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.820+0000 7f39a8344700 1 Processor -- start 2023-10-14T18:49:02.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.820+0000 7f39a8344700 1 -- start start 2023-10-14T18:49:02.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a8344700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f39a0164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a8344700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a00b0790 con 0x7f39a0159ec0 2023-10-14T18:49:02.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a8344700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a00ce1f0 con 0x7f39a015a290 2023-10-14T18:49:02.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a8344700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00b0b20 con 0x7f39a00d05a0 2023-10-14T18:49:02.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a60e0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39a0159ec0 0x7f39a00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45576/0 (socket says 172.21.15.79:45576) 2023-10-14T18:49:02.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.821+0000 7f39a60e0700 1 -- 172.21.15.79:0/1242442969 learned_addr learned my addr 172.21.15.79:0/1242442969 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:02.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a68e1700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f39a0164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228555697 0 0) 0x7f39a00b0790 con 0x7f39a0159ec0 2023-10-14T18:49:02.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c003570 con 0x7f39a0159ec0 2023-10-14T18:49:02.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767178926 0 0) 0x7f39a00ce1f0 con 0x7f39a015a290 2023-10-14T18:49:02.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a00b0790 con 0x7f39a015a290 2023-10-14T18:49:02.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990151074 0 0) 0x7f398c003570 con 0x7f39a0159ec0 2023-10-14T18:49:02.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 msgr2=0x7f39a0164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:02.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f39a0164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 >> v1:172.21.15.144:6789/0 conn(0x7f39a015a290 legacy=0x7f39a006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00b04b0 con 0x7f39a0159ec0 2023-10-14T18:49:02.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f399c001470 con 0x7f39a0159ec0 2023-10-14T18:49:02.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 >> v1:172.21.15.79:6789/0 conn(0x7f39a0159ec0 legacy=0x7f39a00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f398c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f398c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398c004d50 0x7f398c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00b0b20 con 0x7f398c003c20 2023-10-14T18:49:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c00bb40 con 0x7f398c004d50 2023-10-14T18:49:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c00bd00 con 0x7f39a00d05a0 2023-10-14T18:49:02.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f398c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a68e1700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398c004d50 0x7f398c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a58df700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f398c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 -- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 msgr2=0x7f398c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:02.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00d05a0 0x7f398c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 -- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398c004d50 msgr2=0x7f398c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:02.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f398c004d50 0x7f398c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 -- 172.21.15.79:0/1242442969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c003570 con 0x7f398c003c20 2023-10-14T18:49:02.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.822+0000 7f39a60e0700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f398c004010 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c2d0 tx=0x7f399c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80aeb9d29bc2bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:02.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00cba0 con 0x7f398c003c20 2023-10-14T18:49:02.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c00cd00 con 0x7f398c003c20 2023-10-14T18:49:02.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a50de700 1 -- 172.21.15.79:0/1242442969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c005b70 con 0x7f398c003c20 2023-10-14T18:49:02.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 -- 172.21.15.79:0/1242442969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 msgr2=0x7f398c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 --2- 172.21.15.79:0/1242442969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f398c004010 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c2d0 tx=0x7f399c001e10 comp rx=0 tx=0).stop 2023-10-14T18:49:02.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a68e1700 1 -- 172.21.15.79:0/1242442969 reap_dead start 2023-10-14T18:49:02.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 -- 172.21.15.79:0/1242442969 shutdown_connections 2023-10-14T18:49:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 -- 172.21.15.79:0/1242442969 >> 172.21.15.79:0/1242442969 conn(0x7f39a00d1880 msgr2=0x7f39a00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 -- 172.21.15.79:0/1242442969 shutdown_connections 2023-10-14T18:49:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.823+0000 7f39a8344700 1 -- 172.21.15.79:0/1242442969 wait complete. 2023-10-14T18:49:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.824+0000 7f39a8344700 1 Processor -- start 2023-10-14T18:49:02.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.824+0000 7f39a8344700 1 -- start start 2023-10-14T18:49:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00c9fb0 0x7f39a014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a016ac50 0x7f39a006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a016a7c0 con 0x7f398c003c20 2023-10-14T18:49:02.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00ca4b0 con 0x7f39a016ac50 2023-10-14T18:49:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a8344700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00ca790 con 0x7f39a00c9fb0 2023-10-14T18:49:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37354/0 (socket says 172.21.15.79:37354) 2023-10-14T18:49:02.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 -- 172.21.15.79:0/3363214615 learned_addr learned my addr 172.21.15.79:0/3363214615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a58df700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00c9fb0 0x7f39a014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a68e1700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a016ac50 0x7f39a006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 -- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00c9fb0 msgr2=0x7f39a014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00c9fb0 0x7f39a014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 -- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a016ac50 msgr2=0x7f39a006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:02.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a016ac50 0x7f39a006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:02.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.825+0000 7f39a60e0700 1 -- 172.21.15.79:0/3363214615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00caa70 con 0x7f398c003c20 2023-10-14T18:49:02.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39a60e0700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f399c007c90 tx=0x7f399c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:02.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00ce70 con 0x7f398c003c20 2023-10-14T18:49:02.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c001640 con 0x7f398c003c20 2023-10-14T18:49:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c007320 con 0x7f398c003c20 2023-10-14T18:49:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a016a400 con 0x7f398c003c20 2023-10-14T18:49:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.826+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a014cc30 con 0x7f398c003c20 2023-10-14T18:49:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.827+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a016a590 con 0x7f398c003c20 2023-10-14T18:49:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.827+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f399c019030 con 0x7f398c003c20 2023-10-14T18:49:02.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.827+0000 7f39967fc700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 0x7f3984069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.827+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f399c085600 con 0x7f398c003c20 2023-10-14T18:49:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.828+0000 7f39a58df700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 0x7f3984069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.828+0000 7f39a58df700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 0x7f3984069410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39a016eb10 tx=0x7f3990007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:02.832+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39a016a590 con 0x7f398c003c20 2023-10-14T18:49:03.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.054+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f39a016a590 con 0x7f398c003c20 2023-10-14T18:49:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.688+0000 7f39967fc700 1 -- 172.21.15.79:0/3363214615 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f39a016a590 con 0x7f398c003c20 2023-10-14T18:49:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 msgr2=0x7f3984069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 0x7f3984069410 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f39a016eb10 tx=0x7f3990007d30 comp rx=0 tx=0).stop 2023-10-14T18:49:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 msgr2=0x7f39a015efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f399c007c90 tx=0x7f399c015000 comp rx=0 tx=0).stop 2023-10-14T18:49:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 shutdown_connections 2023-10-14T18:49:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3984066f60 0x7f3984069410 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a016ac50 0x7f39a006a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f398c003c20 0x7f39a015efa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 --2- 172.21.15.79:0/3363214615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39a00c9fb0 0x7f39a014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 >> 172.21.15.79:0/3363214615 conn(0x7f39a00d1880 msgr2=0x7f39a00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 shutdown_connections 2023-10-14T18:49:03.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.690+0000 7f39a8344700 1 -- 172.21.15.79:0/3363214615 wait complete. 2023-10-14T18:49:03.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.818+0000 7f4c6b7d1700 1 Processor -- start 2023-10-14T18:49:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.818+0000 7f4c6b7d1700 1 -- start start 2023-10-14T18:49:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6b7d1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c6415a620 0x7f4c6415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6b7d1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c6415d580 0x7f4c64158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6b7d1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6415cbb0 con 0x7f4c64157870 2023-10-14T18:49:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6b7d1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6415bdb0 con 0x7f4c6415d580 2023-10-14T18:49:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6b7d1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6415bfa0 con 0x7f4c6415a620 2023-10-14T18:49:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c69d6e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c6415d580 0x7f4c64158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6956d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4c64157870 0x7f4c6415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45580/0 (socket says 172.21.15.79:45580) 2023-10-14T18:49:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c6956d700 1 -- 172.21.15.79:0/1446737544 learned_addr learned my addr 172.21.15.79:0/1446737544 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c69d6e700 1 -- 172.21.15.79:0/1446737544 >> v2:172.21.15.144:3300/0 conn(0x7f4c6415a620 msgr2=0x7f4c6415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c69d6e700 1 --2- 172.21.15.79:0/1446737544 >> v2:172.21.15.144:3300/0 conn(0x7f4c6415a620 0x7f4c6415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c69d6e700 1 -- 172.21.15.79:0/1446737544 >> v1:172.21.15.79:6789/0 conn(0x7f4c64157870 legacy=0x7f4c6415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c5bfff700 1 -- 172.21.15.79:0/1446737544 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053653491 0 0) 0x7f4c6415cbb0 con 0x7f4c64157870 2023-10-14T18:49:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.819+0000 7f4c69d6e700 1 -- 172.21.15.79:0/1446737544 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6415c280 con 0x7f4c6415d580 2023-10-14T18:49:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c69d6e700 1 --2- 172.21.15.79:0/1446737544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6415d580 0x7f4c64158110 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415cb20 tx=0x7f4c5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220b30d7113ac95e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c5bfff700 1 -- 172.21.15.79:0/1446737544 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c00e070 con 0x7f4c6415d580 2023-10-14T18:49:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c5bfff700 1 -- 172.21.15.79:0/1446737544 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c00bc30 con 0x7f4c6415d580 2023-10-14T18:49:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c5bfff700 1 -- 172.21.15.79:0/1446737544 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c012430 con 0x7f4c6415d580 2023-10-14T18:49:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/1446737544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6415d580 msgr2=0x7f4c64158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/1446737544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6415d580 0x7f4c64158110 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415cb20 tx=0x7f4c5c009780 comp rx=0 tx=0).stop 2023-10-14T18:49:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/1446737544 shutdown_connections 2023-10-14T18:49:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/1446737544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c6415d580 0x7f4c64158110 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/1446737544 >> v2:172.21.15.144:3300/0 conn(0x7f4c6415a620 0x7f4c6415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/1446737544 >> 172.21.15.79:0/1446737544 conn(0x7f4c64068ce0 msgr2=0x7f4c640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:03.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/1446737544 shutdown_connections 2023-10-14T18:49:03.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.820+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/1446737544 wait complete. 2023-10-14T18:49:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.821+0000 7f4c6b7d1700 1 Processor -- start 2023-10-14T18:49:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.821+0000 7f4c6b7d1700 1 -- start start 2023-10-14T18:49:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c6415a620 0x7f4c640cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c6415d580 0x7f4c6414b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c640b0760 con 0x7f4c64157870 2023-10-14T18:49:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c640d0920 con 0x7f4c6415a620 2023-10-14T18:49:03.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6b7d1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c640d0c00 con 0x7f4c6415d580 2023-10-14T18:49:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6956d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6956d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37366/0 (socket says 172.21.15.79:37366) 2023-10-14T18:49:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.822+0000 7f4c6956d700 1 -- 172.21.15.79:0/410718970 learned_addr learned my addr 172.21.15.79:0/410718970 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c68d6c700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c6415a620 0x7f4c640cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:03.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c69d6e700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c6415d580 0x7f4c6414b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 -- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c6415d580 msgr2=0x7f4c6414b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c6415d580 0x7f4c6414b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 -- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c6415a620 msgr2=0x7f4c640cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c6415a620 0x7f4c640cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:03.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 -- 172.21.15.79:0/410718970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c009a20 con 0x7f4c64157870 2023-10-14T18:49:03.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6956d700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7e0 tx=0x7f4c60007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:03.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60005b30 con 0x7f4c64157870 2023-10-14T18:49:03.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c60005c90 con 0x7f4c64157870 2023-10-14T18:49:03.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007300 con 0x7f4c64157870 2023-10-14T18:49:03.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c640b09d0 con 0x7f4c64157870 2023-10-14T18:49:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.823+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c64152f70 con 0x7f4c64157870 2023-10-14T18:49:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.824+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c640b0bf0 con 0x7f4c64157870 2023-10-14T18:49:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.824+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c6001b400 con 0x7f4c64157870 2023-10-14T18:49:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.824+0000 7f4c597fa700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 0x7f4c480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.825+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c60084040 con 0x7f4c64157870 2023-10-14T18:49:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.825+0000 7f4c68d6c700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 0x7f4c480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.825+0000 7f4c68d6c700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 0x7f4c480693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4c54006fd0 tx=0x7f4c54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:03.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:03.829+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c60051330 con 0x7f4c64157870 2023-10-14T18:49:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.053+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c6404c3c0 con 0x7f4c64157870 2023-10-14T18:49:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.053+0000 7f4c597fa700 1 -- 172.21.15.79:0/410718970 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f4c60054950 con 0x7f4c64157870 2023-10-14T18:49:04.054 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:04.054 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:04.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 msgr2=0x7f4c480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 0x7f4c480693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4c54006fd0 tx=0x7f4c54008040 comp rx=0 tx=0).stop 2023-10-14T18:49:04.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 msgr2=0x7f4c64154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c7e0 tx=0x7f4c60007df0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 shutdown_connections 2023-10-14T18:49:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c48066f30 0x7f4c480693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c6415d580 0x7f4c6414b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c64157870 0x7f4c64154b10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 --2- 172.21.15.79:0/410718970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c6415a620 0x7f4c640cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 >> 172.21.15.79:0/410718970 conn(0x7f4c64068ce0 msgr2=0x7f4c640b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 shutdown_connections 2023-10-14T18:49:04.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.055+0000 7f4c6b7d1700 1 -- 172.21.15.79:0/410718970 wait complete. 2023-10-14T18:49:04.059 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:04.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:04.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.181+0000 7f6fb1775700 1 Processor -- start 2023-10-14T18:49:04.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.181+0000 7f6fb1775700 1 -- start start 2023-10-14T18:49:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6fb1775700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fac158140 0x7f6fac0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6fb1775700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0b0ce0 con 0x7f6fac157d70 2023-10-14T18:49:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6fb1775700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0ca070 con 0x7f6fac0b0880 2023-10-14T18:49:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6fb1775700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac067800 con 0x7f6fac158140 2023-10-14T18:49:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6faaffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6fac157d70 0x7f6fac06ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45584/0 (socket says 172.21.15.79:45584) 2023-10-14T18:49:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6faaffd700 1 -- 172.21.15.79:0/101249921 learned_addr learned my addr 172.21.15.79:0/101249921 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.182+0000 7f6faa7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fac158140 0x7f6fac0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6faa7fc700 1 -- 172.21.15.79:0/101249921 >> v1:172.21.15.144:6789/0 conn(0x7f6fac0b0880 legacy=0x7f6fac070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6faa7fc700 1 -- 172.21.15.79:0/101249921 >> v1:172.21.15.79:6789/0 conn(0x7f6fac157d70 legacy=0x7f6fac06ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6faa7fc700 1 -- 172.21.15.79:0/101249921 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac067ae0 con 0x7f6fac158140 2023-10-14T18:49:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fa9ffb700 1 -- 172.21.15.79:0/101249921 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242479245 0 0) 0x7f6fac0b0ce0 con 0x7f6fac157d70 2023-10-14T18:49:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6faa7fc700 1 --2- 172.21.15.79:0/101249921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac158140 0x7f6fac0c9a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00098e0 tx=0x7f6fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7ed84bdb59c7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fa9ffb700 1 -- 172.21.15.79:0/101249921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0009e80 con 0x7f6fac158140 2023-10-14T18:49:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fa9ffb700 1 -- 172.21.15.79:0/101249921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000b860 con 0x7f6fac158140 2023-10-14T18:49:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fa9ffb700 1 -- 172.21.15.79:0/101249921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000bbe0 con 0x7f6fac158140 2023-10-14T18:49:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 -- 172.21.15.79:0/101249921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac158140 msgr2=0x7f6fac0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 --2- 172.21.15.79:0/101249921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac158140 0x7f6fac0c9a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6fa00098e0 tx=0x7f6fa00091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 -- 172.21.15.79:0/101249921 shutdown_connections 2023-10-14T18:49:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 --2- 172.21.15.79:0/101249921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac158140 0x7f6fac0c9a70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 -- 172.21.15.79:0/101249921 >> 172.21.15.79:0/101249921 conn(0x7f6fac0ca4f0 msgr2=0x7f6fac0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.183+0000 7f6fb1775700 1 -- 172.21.15.79:0/101249921 shutdown_connections 2023-10-14T18:49:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.184+0000 7f6fb1775700 1 -- 172.21.15.79:0/101249921 wait complete. 2023-10-14T18:49:04.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 Processor -- start 2023-10-14T18:49:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 -- start start 2023-10-14T18:49:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 0x7f6fac16b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6fac158140 0x7f6fac0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0c7970 con 0x7f6fac157d70 2023-10-14T18:49:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac15bfe0 con 0x7f6fac0b0880 2023-10-14T18:49:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.185+0000 7f6fb1775700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac16c820 con 0x7f6fac158140 2023-10-14T18:49:04.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37392/0 (socket says 172.21.15.79:37392) 2023-10-14T18:49:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 -- 172.21.15.79:0/2913184998 learned_addr learned my addr 172.21.15.79:0/2913184998 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faaffd700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 0x7f6fac16b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6fab7fe700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6fac158140 0x7f6fac0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 -- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6fac158140 msgr2=0x7f6fac0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6fac158140 0x7f6fac0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 -- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 msgr2=0x7f6fac16b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 0x7f6fac16b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 -- 172.21.15.79:0/2913184998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0009420 con 0x7f6fac157d70 2023-10-14T18:49:04.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faaffd700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 0x7f6fac16b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6faa7fc700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000b3c0 tx=0x7f6fa0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011420 con 0x7f6fac157d70 2023-10-14T18:49:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0011580 con 0x7f6fac157d70 2023-10-14T18:49:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac15c2a0 con 0x7f6fac157d70 2023-10-14T18:49:04.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0011920 con 0x7f6fac157d70 2023-10-14T18:49:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.186+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac16c260 con 0x7f6fac157d70 2023-10-14T18:49:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.187+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac04c3c0 con 0x7f6fac157d70 2023-10-14T18:49:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.187+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fa0011c90 con 0x7f6fac157d70 2023-10-14T18:49:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.188+0000 7f6f92ffd700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.188+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6fa0085c10 con 0x7f6fac157d70 2023-10-14T18:49:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.188+0000 7f6faaffd700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.189+0000 7f6faaffd700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 0x7f6f980693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000f80 tx=0x7f6f9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.192+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa0052f00 con 0x7f6fac157d70 2023-10-14T18:49:04.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.376+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fac06b620 con 0x7f6fac157d70 2023-10-14T18:49:04.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.377+0000 7f6f92ffd700 1 -- 172.21.15.79:0/2913184998 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f6fa0056520 con 0x7f6fac157d70 2023-10-14T18:49:04.378 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:04.378 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":85,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:01.658667+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 msgr2=0x7f6f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 0x7f6f980693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000f80 tx=0x7f6f9c009040 comp rx=0 tx=0).stop 2023-10-14T18:49:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 msgr2=0x7f6fac0c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000b3c0 tx=0x7f6fa0017000 comp rx=0 tx=0).stop 2023-10-14T18:49:04.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 shutdown_connections 2023-10-14T18:49:04.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6f98066f30 0x7f6f980693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6fac158140 0x7f6fac0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fac0b0880 0x7f6fac16b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 --2- 172.21.15.79:0/2913184998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fac157d70 0x7f6fac0c4b30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 >> 172.21.15.79:0/2913184998 conn(0x7f6fac0ca4f0 msgr2=0x7f6fac157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 shutdown_connections 2023-10-14T18:49:04.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.379+0000 7f6fb1775700 1 -- 172.21.15.79:0/2913184998 wait complete. 2023-10-14T18:49:04.392 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:49:04.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:49:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.506+0000 7fce90f51700 1 Processor -- start 2023-10-14T18:49:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.506+0000 7fce90f51700 1 -- start start 2023-10-14T18:49:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce90f51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce8c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce90f51700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce8c15a620 0x7fce8c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce90f51700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c15cbb0 con 0x7fce8c15d580 2023-10-14T18:49:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce90f51700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c15bfa0 con 0x7fce8c15a620 2023-10-14T18:49:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce90f51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15c280 con 0x7fce8c157870 2023-10-14T18:49:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce8ad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fce8c15d580 0x7fce8c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45594/0 (socket says 172.21.15.79:45594) 2023-10-14T18:49:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce8ad9d700 1 -- 172.21.15.79:0/702546781 learned_addr learned my addr 172.21.15.79:0/702546781 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce81d9b700 1 --2- 172.21.15.79:0/702546781 >> v2:172.21.15.144:3300/0 conn(0x7fce8c15a620 0x7fce8c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce8a59c700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce8c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015947282 0 0) 0x7fce8c15cbb0 con 0x7fce8c15d580 2023-10-14T18:49:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce78003570 con 0x7fce8c15d580 2023-10-14T18:49:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2617362691 0 0) 0x7fce78003570 con 0x7fce8c15d580 2023-10-14T18:49:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 msgr2=0x7fce8c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce8c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 >> v2:172.21.15.144:3300/0 conn(0x7fce8c15a620 msgr2=0x7fce8c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 --2- 172.21.15.79:0/702546781 >> v2:172.21.15.144:3300/0 conn(0x7fce8c15a620 0x7fce8c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c15c560 con 0x7fce8c15d580 2023-10-14T18:49:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fce840017f0 con 0x7fce8c15d580 2023-10-14T18:49:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 >> v1:172.21.15.79:6789/0 conn(0x7fce8c15d580 legacy=0x7fce8c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce78003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce78004d50 0x7fce780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15bfa0 con 0x7fce78003fe0 2023-10-14T18:49:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15c280 con 0x7fce78004d50 2023-10-14T18:49:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7800ba90 con 0x7fce8c157870 2023-10-14T18:49:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.507+0000 7fce81d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce8ad9d700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce78004d50 0x7fce780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce8a59c700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce78003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 -- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 msgr2=0x7fce78003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c157870 0x7fce78003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 -- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce78004d50 msgr2=0x7fce780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce78004d50 0x7fce780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 -- 172.21.15.79:0/702546781 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78003570 con 0x7fce78003fe0 2023-10-14T18:49:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce81d9b700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce78004810 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fce74009c00 tx=0x7fce740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7defb27e0fa5b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400e6b0 con 0x7fce78003fe0 2023-10-14T18:49:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7400e810 con 0x7fce78003fe0 2023-10-14T18:49:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.508+0000 7fce89d9b700 1 -- 172.21.15.79:0/702546781 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7400ebd0 con 0x7fce78003fe0 2023-10-14T18:49:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 -- 172.21.15.79:0/702546781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 msgr2=0x7fce78004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 --2- 172.21.15.79:0/702546781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce78004810 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fce74009c00 tx=0x7fce740091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce8ad9d700 1 -- 172.21.15.79:0/702546781 reap_dead start 2023-10-14T18:49:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 -- 172.21.15.79:0/702546781 shutdown_connections 2023-10-14T18:49:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 -- 172.21.15.79:0/702546781 >> 172.21.15.79:0/702546781 conn(0x7fce8c068ce0 msgr2=0x7fce8c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 -- 172.21.15.79:0/702546781 shutdown_connections 2023-10-14T18:49:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.509+0000 7fce90f51700 1 -- 172.21.15.79:0/702546781 wait complete. 2023-10-14T18:49:04.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.510+0000 7fce90f51700 1 Processor -- start 2023-10-14T18:49:04.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.510+0000 7fce90f51700 1 -- start start 2023-10-14T18:49:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.510+0000 7fce90f51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.510+0000 7fce90f51700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce8c15e420 0x7fce8c0a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c0a7b50 0x7fce8c16a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0a7ff0 con 0x7fce78003fe0 2023-10-14T18:49:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15e950 con 0x7fce8c15e420 2023-10-14T18:49:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c15ec30 con 0x7fce8c0a7b50 2023-10-14T18:49:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37408/0 (socket says 172.21.15.79:37408) 2023-10-14T18:49:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 -- 172.21.15.79:0/2274148951 learned_addr learned my addr 172.21.15.79:0/2274148951 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce81d9b700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce8c15e420 0x7fce8c0a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8ad9d700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c0a7b50 0x7fce8c16a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 -- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c0a7b50 msgr2=0x7fce8c16a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c0a7b50 0x7fce8c16a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 -- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce8c15e420 msgr2=0x7fce8c0a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce8c15e420 0x7fce8c0a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 -- 172.21.15.79:0/2274148951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c15ef10 con 0x7fce78003fe0 2023-10-14T18:49:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce8a59c700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fce7c011d40 tx=0x7fce7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c00fa10 con 0x7fce78003fe0 2023-10-14T18:49:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c00fb70 con 0x7fce78003fe0 2023-10-14T18:49:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c15f1f0 con 0x7fce78003fe0 2023-10-14T18:49:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c014440 con 0x7fce78003fe0 2023-10-14T18:49:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.511+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c0af420 con 0x7fce78003fe0 2023-10-14T18:49:04.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.512+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c04c3c0 con 0x7fce78003fe0 2023-10-14T18:49:04.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.513+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7c014870 con 0x7fce78003fe0 2023-10-14T18:49:04.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.513+0000 7fce82ffd700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.513+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce7c018030 con 0x7fce78003fe0 2023-10-14T18:49:04.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.513+0000 7fce81d9b700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.514+0000 7fce81d9b700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fce740091e0 tx=0x7fce7401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.517+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce7c0520d0 con 0x7fce78003fe0 2023-10-14T18:49:04.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.696+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce8c15c840 con 0x7fce6c066f30 2023-10-14T18:49:04.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.705+0000 7fce82ffd700 1 -- 172.21.15.79:0/2274148951 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284989 (secure 0 0 0) 0x7fce8c15c840 con 0x7fce6c066f30 2023-10-14T18:49:04.709 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 msgr2=0x7fce6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fce740091e0 tx=0x7fce7401a000 comp rx=0 tx=0).stop 2023-10-14T18:49:04.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 msgr2=0x7fce8c0aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fce7c011d40 tx=0x7fce7c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 shutdown_connections 2023-10-14T18:49:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fce8c0a7b50 0x7fce8c16a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce78003fe0 0x7fce8c0aeee0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 --2- 172.21.15.79:0/2274148951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce8c15e420 0x7fce8c0a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 >> 172.21.15.79:0/2274148951 conn(0x7fce8c068ce0 msgr2=0x7fce8c159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 shutdown_connections 2023-10-14T18:49:04.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.708+0000 7fce90f51700 1 -- 172.21.15.79:0/2274148951 wait complete. 2023-10-14T18:49:04.714 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:49:04.720 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-10-14T18:49:04.390457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557830,"statfs":{"total":1600000000,"available":1595218383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.744087"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669367+0000","last_change":"2023-10-14T18:49:00.669147+0000","last_active":"2023-10-14T18:49:00.669367+0000","last_peered":"2023-10-14T18:49:00.669367+0000","last_clean":"2023-10-14T18:49:00.669367+0000","last_became_active":"2023-10-14T18:49:00.668637+0000","last_became_peered":"2023-10-14T18:49:00.668637+0000","last_unstale":"2023-10-14T18:49:00.669367+0000","last_undegraded":"2023-10-14T18:49:00.669367+0000","last_fullsized":"2023-10-14T18:49:00.669367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:58.299683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670838+0000","last_change":"2023-10-14T18:49:00.670471+0000","last_active":"2023-10-14T18:49:00.670838+0000","last_peered":"2023-10-14T18:49:00.670838+0000","last_clean":"2023-10-14T18:49:00.670838+0000","last_became_active":"2023-10-14T18:49:00.670226+0000","last_became_peered":"2023-10-14T18:49:00.670226+0000","last_unstale":"2023-10-14T18:49:00.670838+0000","last_undegraded":"2023-10-14T18:49:00.670838+0000","last_fullsized":"2023-10-14T18:49:00.670838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:35.315328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666370+0000","last_change":"2023-10-14T18:49:00.666319+0000","last_active":"2023-10-14T18:49:00.666370+0000","last_peered":"2023-10-14T18:49:00.666370+0000","last_clean":"2023-10-14T18:49:00.666370+0000","last_became_active":"2023-10-14T18:49:00.666099+0000","last_became_peered":"2023-10-14T18:49:00.666099+0000","last_unstale":"2023-10-14T18:49:00.666370+0000","last_undegraded":"2023-10-14T18:49:00.666370+0000","last_fullsized":"2023-10-14T18:49:00.666370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672121+0000","last_change":"2023-10-14T18:49:00.672063+0000","last_active":"2023-10-14T18:49:00.672121+0000","last_peered":"2023-10-14T18:49:00.672121+0000","last_clean":"2023-10-14T18:49:00.672121+0000","last_became_active":"2023-10-14T18:49:00.671817+0000","last_became_peered":"2023-10-14T18:49:00.671817+0000","last_unstale":"2023-10-14T18:49:00.672121+0000","last_undegraded":"2023-10-14T18:49:00.672121+0000","last_fullsized":"2023-10-14T18:49:00.672121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:40:55.611834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668632+0000","last_change":"2023-10-14T18:49:00.668575+0000","last_active":"2023-10-14T18:49:00.668632+0000","last_peered":"2023-10-14T18:49:00.668632+0000","last_clean":"2023-10-14T18:49:00.668632+0000","last_became_active":"2023-10-14T18:49:00.668159+0000","last_became_peered":"2023-10-14T18:49:00.668159+0000","last_unstale":"2023-10-14T18:49:00.668632+0000","last_undegraded":"2023-10-14T18:49:00.668632+0000","last_fullsized":"2023-10-14T18:49:00.668632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:36.176407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673803+0000","last_change":"2023-10-14T18:49:00.673722+0000","last_active":"2023-10-14T18:49:00.673803+0000","last_peered":"2023-10-14T18:49:00.673803+0000","last_clean":"2023-10-14T18:49:00.673803+0000","last_became_active":"2023-10-14T18:49:00.672737+0000","last_became_peered":"2023-10-14T18:49:00.672737+0000","last_unstale":"2023-10-14T18:49:00.673803+0000","last_undegraded":"2023-10-14T18:49:00.673803+0000","last_fullsized":"2023-10-14T18:49:00.673803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:24.940753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673647+0000","last_change":"2023-10-14T18:49:00.673588+0000","last_active":"2023-10-14T18:49:00.673647+0000","last_peered":"2023-10-14T18:49:00.673647+0000","last_clean":"2023-10-14T18:49:00.673647+0000","last_became_active":"2023-10-14T18:49:00.672859+0000","last_became_peered":"2023-10-14T18:49:00.672859+0000","last_unstale":"2023-10-14T18:49:00.673647+0000","last_undegraded":"2023-10-14T18:49:00.673647+0000","last_fullsized":"2023-10-14T18:49:00.673647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:03.509368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675640+0000","last_change":"2023-10-14T18:49:00.675544+0000","last_active":"2023-10-14T18:49:00.675640+0000","last_peered":"2023-10-14T18:49:00.675640+0000","last_clean":"2023-10-14T18:49:00.675640+0000","last_became_active":"2023-10-14T18:49:00.674685+0000","last_became_peered":"2023-10-14T18:49:00.674685+0000","last_unstale":"2023-10-14T18:49:00.675640+0000","last_undegraded":"2023-10-14T18:49:00.675640+0000","last_fullsized":"2023-10-14T18:49:00.675640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:54.917856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667279+0000","last_change":"2023-10-14T18:49:00.667114+0000","last_active":"2023-10-14T18:49:00.667279+0000","last_peered":"2023-10-14T18:49:00.667279+0000","last_clean":"2023-10-14T18:49:00.667279+0000","last_became_active":"2023-10-14T18:49:00.666840+0000","last_became_peered":"2023-10-14T18:49:00.666840+0000","last_unstale":"2023-10-14T18:49:00.667279+0000","last_undegraded":"2023-10-14T18:49:00.667279+0000","last_fullsized":"2023-10-14T18:49:00.667279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:44.103822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.674202+0000","last_change":"2023-10-14T18:49:00.671766+0000","last_active":"2023-10-14T18:49:00.674202+0000","last_peered":"2023-10-14T18:49:00.674202+0000","last_clean":"2023-10-14T18:49:00.674202+0000","last_became_active":"2023-10-14T18:49:00.671387+0000","last_became_peered":"2023-10-14T18:49:00.671387+0000","last_unstale":"2023-10-14T18:49:00.674202+0000","last_undegraded":"2023-10-14T18:49:00.674202+0000","last_fullsized":"2023-10-14T18:49:00.674202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:07.175239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662711+0000","last_change":"2023-10-14T18:49:00.662656+0000","last_active":"2023-10-14T18:49:00.662711+0000","last_peered":"2023-10-14T18:49:00.662711+0000","last_clean":"2023-10-14T18:49:00.662711+0000","last_became_active":"2023-10-14T18:49:00.662436+0000","last_became_peered":"2023-10-14T18:49:00.662436+0000","last_unstale":"2023-10-14T18:49:00.662711+0000","last_undegraded":"2023-10-14T18:49:00.662711+0000","last_fullsized":"2023-10-14T18:49:00.662711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669827+0000","last_change":"2023-10-14T18:49:00.669028+0000","last_active":"2023-10-14T18:49:00.669827+0000","last_peered":"2023-10-14T18:49:00.669827+0000","last_clean":"2023-10-14T18:49:00.669827+0000","last_became_active":"2023-10-14T18:49:00.668652+0000","last_became_peered":"2023-10-14T18:49:00.668652+0000","last_unstale":"2023-10-14T18:49:00.669827+0000","last_undegraded":"2023-10-14T18:49:00.669827+0000","last_fullsized":"2023-10-14T18:49:00.669827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:46.420360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672194+0000","last_change":"2023-10-14T18:49:00.672124+0000","last_active":"2023-10-14T18:49:00.672194+0000","last_peered":"2023-10-14T18:49:00.672194+0000","last_clean":"2023-10-14T18:49:00.672194+0000","last_became_active":"2023-10-14T18:49:00.671755+0000","last_became_peered":"2023-10-14T18:49:00.671755+0000","last_unstale":"2023-10-14T18:49:00.672194+0000","last_undegraded":"2023-10-14T18:49:00.672194+0000","last_fullsized":"2023-10-14T18:49:00.672194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670314+0000","last_change":"2023-10-14T18:49:00.670274+0000","last_active":"2023-10-14T18:49:00.670314+0000","last_peered":"2023-10-14T18:49:00.670314+0000","last_clean":"2023-10-14T18:49:00.670314+0000","last_became_active":"2023-10-14T18:49:00.670130+0000","last_became_peered":"2023-10-14T18:49:00.670130+0000","last_unstale":"2023-10-14T18:49:00.670314+0000","last_undegraded":"2023-10-14T18:49:00.670314+0000","last_fullsized":"2023-10-14T18:49:00.670314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:05.276186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667420+0000","last_change":"2023-10-14T18:49:00.667366+0000","last_active":"2023-10-14T18:49:00.667420+0000","last_peered":"2023-10-14T18:49:00.667420+0000","last_clean":"2023-10-14T18:49:00.667420+0000","last_became_active":"2023-10-14T18:49:00.667202+0000","last_became_peered":"2023-10-14T18:49:00.667202+0000","last_unstale":"2023-10-14T18:49:00.667420+0000","last_undegraded":"2023-10-14T18:49:00.667420+0000","last_fullsized":"2023-10-14T18:49:00.667420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:58.299683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.674221+0000","last_change":"2023-10-14T18:49:00.671850+0000","last_active":"2023-10-14T18:49:00.674221+0000","last_peered":"2023-10-14T18:49:00.674221+0000","last_clean":"2023-10-14T18:49:00.674221+0000","last_became_active":"2023-10-14T18:49:00.671593+0000","last_became_peered":"2023-10-14T18:49:00.671593+0000","last_unstale":"2023-10-14T18:49:00.674221+0000","last_undegraded":"2023-10-14T18:49:00.674221+0000","last_fullsized":"2023-10-14T18:49:00.674221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:14.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666596+0000","last_change":"2023-10-14T18:49:00.665392+0000","last_active":"2023-10-14T18:49:00.666596+0000","last_peered":"2023-10-14T18:49:00.666596+0000","last_clean":"2023-10-14T18:49:00.666596+0000","last_became_active":"2023-10-14T18:49:00.664609+0000","last_became_peered":"2023-10-14T18:49:00.664609+0000","last_unstale":"2023-10-14T18:49:00.666596+0000","last_undegraded":"2023-10-14T18:49:00.666596+0000","last_fullsized":"2023-10-14T18:49:00.666596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:33.715016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672525+0000","last_change":"2023-10-14T18:49:00.672465+0000","last_active":"2023-10-14T18:49:00.672525+0000","last_peered":"2023-10-14T18:49:00.672525+0000","last_clean":"2023-10-14T18:49:00.672525+0000","last_became_active":"2023-10-14T18:49:00.672162+0000","last_became_peered":"2023-10-14T18:49:00.672162+0000","last_unstale":"2023-10-14T18:49:00.672525+0000","last_undegraded":"2023-10-14T18:49:00.672525+0000","last_fullsized":"2023-10-14T18:49:00.672525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:10:09.889592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675065+0000","last_change":"2023-10-14T18:49:00.674838+0000","last_active":"2023-10-14T18:49:00.675065+0000","last_peered":"2023-10-14T18:49:00.675065+0000","last_clean":"2023-10-14T18:49:00.675065+0000","last_became_active":"2023-10-14T18:49:00.673939+0000","last_became_peered":"2023-10-14T18:49:00.673939+0000","last_unstale":"2023-10-14T18:49:00.675065+0000","last_undegraded":"2023-10-14T18:49:00.675065+0000","last_fullsized":"2023-10-14T18:49:00.675065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:01.914783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666677+0000","last_change":"2023-10-14T18:49:00.666615+0000","last_active":"2023-10-14T18:49:00.666677+0000","last_peered":"2023-10-14T18:49:00.666677+0000","last_clean":"2023-10-14T18:49:00.666677+0000","last_became_active":"2023-10-14T18:49:00.666390+0000","last_became_peered":"2023-10-14T18:49:00.666390+0000","last_unstale":"2023-10-14T18:49:00.666677+0000","last_undegraded":"2023-10-14T18:49:00.666677+0000","last_fullsized":"2023-10-14T18:49:00.666677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668587+0000","last_change":"2023-10-14T18:49:00.667530+0000","last_active":"2023-10-14T18:49:00.668587+0000","last_peered":"2023-10-14T18:49:00.668587+0000","last_clean":"2023-10-14T18:49:00.668587+0000","last_became_active":"2023-10-14T18:49:00.667298+0000","last_became_peered":"2023-10-14T18:49:00.667298+0000","last_unstale":"2023-10-14T18:49:00.668587+0000","last_undegraded":"2023-10-14T18:49:00.668587+0000","last_fullsized":"2023-10-14T18:49:00.668587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:56.757517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670751+0000","last_change":"2023-10-14T18:49:00.669909+0000","last_active":"2023-10-14T18:49:00.670751+0000","last_peered":"2023-10-14T18:49:00.670751+0000","last_clean":"2023-10-14T18:49:00.670751+0000","last_became_active":"2023-10-14T18:49:00.669645+0000","last_became_peered":"2023-10-14T18:49:00.669645+0000","last_unstale":"2023-10-14T18:49:00.670751+0000","last_undegraded":"2023-10-14T18:49:00.670751+0000","last_fullsized":"2023-10-14T18:49:00.670751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:35.315328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669351+0000","last_change":"2023-10-14T18:49:00.668932+0000","last_active":"2023-10-14T18:49:00.669351+0000","last_peered":"2023-10-14T18:49:00.669351+0000","last_clean":"2023-10-14T18:49:00.669351+0000","last_became_active":"2023-10-14T18:49:00.668652+0000","last_became_peered":"2023-10-14T18:49:00.668652+0000","last_unstale":"2023-10-14T18:49:00.669351+0000","last_undegraded":"2023-10-14T18:49:00.669351+0000","last_fullsized":"2023-10-14T18:49:00.669351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:47.006049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673984+0000","last_change":"2023-10-14T18:49:00.672758+0000","last_active":"2023-10-14T18:49:00.673984+0000","last_peered":"2023-10-14T18:49:00.673984+0000","last_clean":"2023-10-14T18:49:00.673984+0000","last_became_active":"2023-10-14T18:49:00.672410+0000","last_became_peered":"2023-10-14T18:49:00.672410+0000","last_unstale":"2023-10-14T18:49:00.673984+0000","last_undegraded":"2023-10-14T18:49:00.673984+0000","last_fullsized":"2023-10-14T18:49:00.673984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668606+0000","last_change":"2023-10-14T18:49:00.667933+0000","last_active":"2023-10-14T18:49:00.668606+0000","last_peered":"2023-10-14T18:49:00.668606+0000","last_clean":"2023-10-14T18:49:00.668606+0000","last_became_active":"2023-10-14T18:49:00.666604+0000","last_became_peered":"2023-10-14T18:49:00.666604+0000","last_unstale":"2023-10-14T18:49:00.668606+0000","last_undegraded":"2023-10-14T18:49:00.668606+0000","last_fullsized":"2023-10-14T18:49:00.668606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:35.159153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671864+0000","last_change":"2023-10-14T18:49:00.671607+0000","last_active":"2023-10-14T18:49:00.671864+0000","last_peered":"2023-10-14T18:49:00.671864+0000","last_clean":"2023-10-14T18:49:00.671864+0000","last_became_active":"2023-10-14T18:49:00.671395+0000","last_became_peered":"2023-10-14T18:49:00.671395+0000","last_unstale":"2023-10-14T18:49:00.671864+0000","last_undegraded":"2023-10-14T18:49:00.671864+0000","last_fullsized":"2023-10-14T18:49:00.671864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:35.487422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662454+0000","last_change":"2023-10-14T18:49:00.662394+0000","last_active":"2023-10-14T18:49:00.662454+0000","last_peered":"2023-10-14T18:49:00.662454+0000","last_clean":"2023-10-14T18:49:00.662454+0000","last_became_active":"2023-10-14T18:49:00.662153+0000","last_became_peered":"2023-10-14T18:49:00.662153+0000","last_unstale":"2023-10-14T18:49:00.662454+0000","last_undegraded":"2023-10-14T18:49:00.662454+0000","last_fullsized":"2023-10-14T18:49:00.662454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.231369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670731+0000","last_change":"2023-10-14T18:49:00.669742+0000","last_active":"2023-10-14T18:49:00.670731+0000","last_peered":"2023-10-14T18:49:00.670731+0000","last_clean":"2023-10-14T18:49:00.670731+0000","last_became_active":"2023-10-14T18:49:00.669503+0000","last_became_peered":"2023-10-14T18:49:00.669503+0000","last_unstale":"2023-10-14T18:49:00.670731+0000","last_undegraded":"2023-10-14T18:49:00.670731+0000","last_fullsized":"2023-10-14T18:49:00.670731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:01.914783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668926+0000","last_change":"2023-10-14T18:49:00.668880+0000","last_active":"2023-10-14T18:49:00.668926+0000","last_peered":"2023-10-14T18:49:00.668926+0000","last_clean":"2023-10-14T18:49:00.668926+0000","last_became_active":"2023-10-14T18:49:00.668667+0000","last_became_peered":"2023-10-14T18:49:00.668667+0000","last_unstale":"2023-10-14T18:49:00.668926+0000","last_undegraded":"2023-10-14T18:49:00.668926+0000","last_fullsized":"2023-10-14T18:49:00.668926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:21.708701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671208+0000","last_change":"2023-10-14T18:49:00.671139+0000","last_active":"2023-10-14T18:49:00.671208+0000","last_peered":"2023-10-14T18:49:00.671208+0000","last_clean":"2023-10-14T18:49:00.671208+0000","last_became_active":"2023-10-14T18:49:00.670901+0000","last_became_peered":"2023-10-14T18:49:00.670901+0000","last_unstale":"2023-10-14T18:49:00.671208+0000","last_undegraded":"2023-10-14T18:49:00.671208+0000","last_fullsized":"2023-10-14T18:49:00.671208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:12.875138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670298+0000","last_change":"2023-10-14T18:49:00.670231+0000","last_active":"2023-10-14T18:49:00.670298+0000","last_peered":"2023-10-14T18:49:00.670298+0000","last_clean":"2023-10-14T18:49:00.670298+0000","last_became_active":"2023-10-14T18:49:00.670042+0000","last_became_peered":"2023-10-14T18:49:00.670042+0000","last_unstale":"2023-10-14T18:49:00.670298+0000","last_undegraded":"2023-10-14T18:49:00.670298+0000","last_fullsized":"2023-10-14T18:49:00.670298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:19.537247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672176+0000","last_change":"2023-10-14T18:49:00.672105+0000","last_active":"2023-10-14T18:49:00.672176+0000","last_peered":"2023-10-14T18:49:00.672176+0000","last_clean":"2023-10-14T18:49:00.672176+0000","last_became_active":"2023-10-14T18:49:00.671832+0000","last_became_peered":"2023-10-14T18:49:00.671832+0000","last_unstale":"2023-10-14T18:49:00.672176+0000","last_undegraded":"2023-10-14T18:49:00.672176+0000","last_fullsized":"2023-10-14T18:49:00.672176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:20.489696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673965+0000","last_change":"2023-10-14T18:49:00.672622+0000","last_active":"2023-10-14T18:49:00.673965+0000","last_peered":"2023-10-14T18:49:00.673965+0000","last_clean":"2023-10-14T18:49:00.673965+0000","last_became_active":"2023-10-14T18:49:00.672117+0000","last_became_peered":"2023-10-14T18:49:00.672117+0000","last_unstale":"2023-10-14T18:49:00.673965+0000","last_undegraded":"2023-10-14T18:49:00.673965+0000","last_fullsized":"2023-10-14T18:49:00.673965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684107+0000","last_change":"2023-10-14T18:48:59.661798+0000","last_active":"2023-10-14T18:49:00.684107+0000","last_peered":"2023-10-14T18:49:00.684107+0000","last_clean":"2023-10-14T18:49:00.684107+0000","last_became_active":"2023-10-14T18:48:59.661263+0000","last_became_peered":"2023-10-14T18:48:59.661263+0000","last_unstale":"2023-10-14T18:49:00.684107+0000","last_undegraded":"2023-10-14T18:49:00.684107+0000","last_fullsized":"2023-10-14T18:49:00.684107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:34.310881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668725+0000","last_change":"2023-10-14T18:49:00.668683+0000","last_active":"2023-10-14T18:49:00.668725+0000","last_peered":"2023-10-14T18:49:00.668725+0000","last_clean":"2023-10-14T18:49:00.668725+0000","last_became_active":"2023-10-14T18:49:00.668410+0000","last_became_peered":"2023-10-14T18:49:00.668410+0000","last_unstale":"2023-10-14T18:49:00.668725+0000","last_undegraded":"2023-10-14T18:49:00.668725+0000","last_fullsized":"2023-10-14T18:49:00.668725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:34.412606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683368+0000","last_change":"2023-10-14T18:48:59.660385+0000","last_active":"2023-10-14T18:49:00.683368+0000","last_peered":"2023-10-14T18:49:00.683368+0000","last_clean":"2023-10-14T18:49:00.683368+0000","last_became_active":"2023-10-14T18:48:59.660064+0000","last_became_peered":"2023-10-14T18:48:59.660064+0000","last_unstale":"2023-10-14T18:49:00.683368+0000","last_undegraded":"2023-10-14T18:49:00.683368+0000","last_fullsized":"2023-10-14T18:49:00.683368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:22.446468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670863+0000","last_change":"2023-10-14T18:49:00.670790+0000","last_active":"2023-10-14T18:49:00.670863+0000","last_peered":"2023-10-14T18:49:00.670863+0000","last_clean":"2023-10-14T18:49:00.670863+0000","last_became_active":"2023-10-14T18:49:00.669886+0000","last_became_peered":"2023-10-14T18:49:00.669886+0000","last_unstale":"2023-10-14T18:49:00.670863+0000","last_undegraded":"2023-10-14T18:49:00.670863+0000","last_fullsized":"2023-10-14T18:49:00.670863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:29.684802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684455+0000","last_change":"2023-10-14T18:48:59.663334+0000","last_active":"2023-10-14T18:49:00.684455+0000","last_peered":"2023-10-14T18:49:00.684455+0000","last_clean":"2023-10-14T18:49:00.684455+0000","last_became_active":"2023-10-14T18:48:59.662923+0000","last_became_peered":"2023-10-14T18:48:59.662923+0000","last_unstale":"2023-10-14T18:49:00.684455+0000","last_undegraded":"2023-10-14T18:49:00.684455+0000","last_fullsized":"2023-10-14T18:49:00.684455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:36.693936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663597+0000","last_change":"2023-10-14T18:49:00.663289+0000","last_active":"2023-10-14T18:49:00.663597+0000","last_peered":"2023-10-14T18:49:00.663597+0000","last_clean":"2023-10-14T18:49:00.663597+0000","last_became_active":"2023-10-14T18:49:00.663074+0000","last_became_peered":"2023-10-14T18:49:00.663074+0000","last_unstale":"2023-10-14T18:49:00.663597+0000","last_undegraded":"2023-10-14T18:49:00.663597+0000","last_fullsized":"2023-10-14T18:49:00.663597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.246960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683163+0000","last_change":"2023-10-14T18:48:59.661372+0000","last_active":"2023-10-14T18:49:00.683163+0000","last_peered":"2023-10-14T18:49:00.683163+0000","last_clean":"2023-10-14T18:49:00.683163+0000","last_became_active":"2023-10-14T18:48:59.658737+0000","last_became_peered":"2023-10-14T18:48:59.658737+0000","last_unstale":"2023-10-14T18:49:00.683163+0000","last_undegraded":"2023-10-14T18:49:00.683163+0000","last_fullsized":"2023-10-14T18:49:00.683163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:09:15.378785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670907+0000","last_change":"2023-10-14T18:49:00.670480+0000","last_active":"2023-10-14T18:49:00.670907+0000","last_peered":"2023-10-14T18:49:00.670907+0000","last_clean":"2023-10-14T18:49:00.670907+0000","last_became_active":"2023-10-14T18:49:00.670185+0000","last_became_peered":"2023-10-14T18:49:00.670185+0000","last_unstale":"2023-10-14T18:49:00.670907+0000","last_undegraded":"2023-10-14T18:49:00.670907+0000","last_fullsized":"2023-10-14T18:49:00.670907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.246960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684298+0000","last_change":"2023-10-14T18:48:59.657763+0000","last_active":"2023-10-14T18:49:00.684298+0000","last_peered":"2023-10-14T18:49:00.684298+0000","last_clean":"2023-10-14T18:49:00.684298+0000","last_became_active":"2023-10-14T18:48:59.657556+0000","last_became_peered":"2023-10-14T18:48:59.657556+0000","last_unstale":"2023-10-14T18:49:00.684298+0000","last_undegraded":"2023-10-14T18:49:00.684298+0000","last_fullsized":"2023-10-14T18:49:00.684298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:25.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668648+0000","last_change":"2023-10-14T18:49:00.668118+0000","last_active":"2023-10-14T18:49:00.668648+0000","last_peered":"2023-10-14T18:49:00.668648+0000","last_clean":"2023-10-14T18:49:00.668648+0000","last_became_active":"2023-10-14T18:49:00.667399+0000","last_became_peered":"2023-10-14T18:49:00.667399+0000","last_unstale":"2023-10-14T18:49:00.668648+0000","last_undegraded":"2023-10-14T18:49:00.668648+0000","last_fullsized":"2023-10-14T18:49:00.668648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:04.947838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683988+0000","last_change":"2023-10-14T18:48:59.660792+0000","last_active":"2023-10-14T18:49:00.683988+0000","last_peered":"2023-10-14T18:49:00.683988+0000","last_clean":"2023-10-14T18:49:00.683988+0000","last_became_active":"2023-10-14T18:48:59.660557+0000","last_became_peered":"2023-10-14T18:48:59.660557+0000","last_unstale":"2023-10-14T18:49:00.683988+0000","last_undegraded":"2023-10-14T18:49:00.683988+0000","last_fullsized":"2023-10-14T18:49:00.683988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:49.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672681+0000","last_change":"2023-10-14T18:49:00.672634+0000","last_active":"2023-10-14T18:49:00.672681+0000","last_peered":"2023-10-14T18:49:00.672681+0000","last_clean":"2023-10-14T18:49:00.672681+0000","last_became_active":"2023-10-14T18:49:00.672445+0000","last_became_peered":"2023-10-14T18:49:00.672445+0000","last_unstale":"2023-10-14T18:49:00.672681+0000","last_undegraded":"2023-10-14T18:49:00.672681+0000","last_fullsized":"2023-10-14T18:49:00.672681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:51.611939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664301+0000","last_change":"2023-10-14T18:48:59.656556+0000","last_active":"2023-10-14T18:49:00.664301+0000","last_peered":"2023-10-14T18:49:00.664301+0000","last_clean":"2023-10-14T18:49:00.664301+0000","last_became_active":"2023-10-14T18:48:59.656332+0000","last_became_peered":"2023-10-14T18:48:59.656332+0000","last_unstale":"2023-10-14T18:49:00.664301+0000","last_undegraded":"2023-10-14T18:49:00.664301+0000","last_fullsized":"2023-10-14T18:49:00.664301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:16:11.301635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663066+0000","last_change":"2023-10-14T18:49:00.663007+0000","last_active":"2023-10-14T18:49:00.663066+0000","last_peered":"2023-10-14T18:49:00.663066+0000","last_clean":"2023-10-14T18:49:00.663066+0000","last_became_active":"2023-10-14T18:49:00.662794+0000","last_became_peered":"2023-10-14T18:49:00.662794+0000","last_unstale":"2023-10-14T18:49:00.663066+0000","last_undegraded":"2023-10-14T18:49:00.663066+0000","last_fullsized":"2023-10-14T18:49:00.663066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663628+0000","last_change":"2023-10-14T18:48:59.655886+0000","last_active":"2023-10-14T18:49:00.663628+0000","last_peered":"2023-10-14T18:49:00.663628+0000","last_clean":"2023-10-14T18:49:00.663628+0000","last_became_active":"2023-10-14T18:48:59.655625+0000","last_became_peered":"2023-10-14T18:48:59.655625+0000","last_unstale":"2023-10-14T18:49:00.663628+0000","last_undegraded":"2023-10-14T18:49:00.663628+0000","last_fullsized":"2023-10-14T18:49:00.663628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:49.975968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673772+0000","last_change":"2023-10-14T18:49:00.673717+0000","last_active":"2023-10-14T18:49:00.673772+0000","last_peered":"2023-10-14T18:49:00.673772+0000","last_clean":"2023-10-14T18:49:00.673772+0000","last_became_active":"2023-10-14T18:49:00.673197+0000","last_became_peered":"2023-10-14T18:49:00.673197+0000","last_unstale":"2023-10-14T18:49:00.673772+0000","last_undegraded":"2023-10-14T18:49:00.673772+0000","last_fullsized":"2023-10-14T18:49:00.673772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663891+0000","last_change":"2023-10-14T18:48:59.657710+0000","last_active":"2023-10-14T18:49:00.663891+0000","last_peered":"2023-10-14T18:49:00.663891+0000","last_clean":"2023-10-14T18:49:00.663891+0000","last_became_active":"2023-10-14T18:48:59.657481+0000","last_became_peered":"2023-10-14T18:48:59.657481+0000","last_unstale":"2023-10-14T18:49:00.663891+0000","last_undegraded":"2023-10-14T18:49:00.663891+0000","last_fullsized":"2023-10-14T18:49:00.663891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:01:25.740867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673999+0000","last_change":"2023-10-14T18:49:00.673252+0000","last_active":"2023-10-14T18:49:00.673999+0000","last_peered":"2023-10-14T18:49:00.673999+0000","last_clean":"2023-10-14T18:49:00.673999+0000","last_became_active":"2023-10-14T18:49:00.672933+0000","last_became_peered":"2023-10-14T18:49:00.672933+0000","last_unstale":"2023-10-14T18:49:00.673999+0000","last_undegraded":"2023-10-14T18:49:00.673999+0000","last_fullsized":"2023-10-14T18:49:00.673999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:11.661727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664794+0000","last_change":"2023-10-14T18:48:59.661722+0000","last_active":"2023-10-14T18:49:00.664794+0000","last_peered":"2023-10-14T18:49:00.664794+0000","last_clean":"2023-10-14T18:49:00.664794+0000","last_became_active":"2023-10-14T18:48:59.661446+0000","last_became_peered":"2023-10-14T18:48:59.661446+0000","last_unstale":"2023-10-14T18:49:00.664794+0000","last_undegraded":"2023-10-14T18:49:00.664794+0000","last_fullsized":"2023-10-14T18:49:00.664794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:46.932996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675046+0000","last_change":"2023-10-14T18:49:00.674523+0000","last_active":"2023-10-14T18:49:00.675046+0000","last_peered":"2023-10-14T18:49:00.675046+0000","last_clean":"2023-10-14T18:49:00.675046+0000","last_became_active":"2023-10-14T18:49:00.673643+0000","last_became_peered":"2023-10-14T18:49:00.673643+0000","last_unstale":"2023-10-14T18:49:00.675046+0000","last_undegraded":"2023-10-14T18:49:00.675046+0000","last_fullsized":"2023-10-14T18:49:00.675046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:04.947838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682972+0000","last_change":"2023-10-14T18:48:59.659707+0000","last_active":"2023-10-14T18:49:00.682972+0000","last_peered":"2023-10-14T18:49:00.682972+0000","last_clean":"2023-10-14T18:49:00.682972+0000","last_became_active":"2023-10-14T18:48:59.659490+0000","last_became_peered":"2023-10-14T18:48:59.659490+0000","last_unstale":"2023-10-14T18:49:00.682972+0000","last_undegraded":"2023-10-14T18:49:00.682972+0000","last_fullsized":"2023-10-14T18:49:00.682972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:11.870691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668649+0000","last_change":"2023-10-14T18:49:00.668594+0000","last_active":"2023-10-14T18:49:00.668649+0000","last_peered":"2023-10-14T18:49:00.668649+0000","last_clean":"2023-10-14T18:49:00.668649+0000","last_became_active":"2023-10-14T18:49:00.668066+0000","last_became_peered":"2023-10-14T18:49:00.668066+0000","last_unstale":"2023-10-14T18:49:00.668649+0000","last_undegraded":"2023-10-14T18:49:00.668649+0000","last_fullsized":"2023-10-14T18:49:00.668649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:38.215924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.685123+0000","last_change":"2023-10-14T18:48:59.660756+0000","last_active":"2023-10-14T18:49:00.685123+0000","last_peered":"2023-10-14T18:49:00.685123+0000","last_clean":"2023-10-14T18:49:00.685123+0000","last_became_active":"2023-10-14T18:48:59.660608+0000","last_became_peered":"2023-10-14T18:48:59.660608+0000","last_unstale":"2023-10-14T18:49:00.685123+0000","last_undegraded":"2023-10-14T18:49:00.685123+0000","last_fullsized":"2023-10-14T18:49:00.685123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:51.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669386+0000","last_change":"2023-10-14T18:49:00.669285+0000","last_active":"2023-10-14T18:49:00.669386+0000","last_peered":"2023-10-14T18:49:00.669386+0000","last_clean":"2023-10-14T18:49:00.669386+0000","last_became_active":"2023-10-14T18:49:00.668934+0000","last_became_peered":"2023-10-14T18:49:00.668934+0000","last_unstale":"2023-10-14T18:49:00.669386+0000","last_undegraded":"2023-10-14T18:49:00.669386+0000","last_fullsized":"2023-10-14T18:49:00.669386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:02.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683827+0000","last_change":"2023-10-14T18:48:59.660437+0000","last_active":"2023-10-14T18:49:00.683827+0000","last_peered":"2023-10-14T18:49:00.683827+0000","last_clean":"2023-10-14T18:49:00.683827+0000","last_became_active":"2023-10-14T18:48:59.660208+0000","last_became_peered":"2023-10-14T18:48:59.660208+0000","last_unstale":"2023-10-14T18:49:00.683827+0000","last_undegraded":"2023-10-14T18:49:00.683827+0000","last_fullsized":"2023-10-14T18:49:00.683827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:49.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672788+0000","last_change":"2023-10-14T18:49:00.672721+0000","last_active":"2023-10-14T18:49:00.672788+0000","last_peered":"2023-10-14T18:49:00.672788+0000","last_clean":"2023-10-14T18:49:00.672788+0000","last_became_active":"2023-10-14T18:49:00.672468+0000","last_became_peered":"2023-10-14T18:49:00.672468+0000","last_unstale":"2023-10-14T18:49:00.672788+0000","last_undegraded":"2023-10-14T18:49:00.672788+0000","last_fullsized":"2023-10-14T18:49:00.672788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:26.567047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666436+0000","last_change":"2023-10-14T18:48:59.662397+0000","last_active":"2023-10-14T18:49:00.666436+0000","last_peered":"2023-10-14T18:49:00.666436+0000","last_clean":"2023-10-14T18:49:00.666436+0000","last_became_active":"2023-10-14T18:48:59.661599+0000","last_became_peered":"2023-10-14T18:48:59.661599+0000","last_unstale":"2023-10-14T18:49:00.666436+0000","last_undegraded":"2023-10-14T18:49:00.666436+0000","last_fullsized":"2023-10-14T18:49:00.666436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:51.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672178+0000","last_change":"2023-10-14T18:49:00.671980+0000","last_active":"2023-10-14T18:49:00.672178+0000","last_peered":"2023-10-14T18:49:00.672178+0000","last_clean":"2023-10-14T18:49:00.672178+0000","last_became_active":"2023-10-14T18:49:00.671444+0000","last_became_peered":"2023-10-14T18:49:00.671444+0000","last_unstale":"2023-10-14T18:49:00.672178+0000","last_undegraded":"2023-10-14T18:49:00.672178+0000","last_fullsized":"2023-10-14T18:49:00.672178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:02.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669100+0000","last_change":"2023-10-14T18:48:59.659388+0000","last_active":"2023-10-14T18:49:00.669100+0000","last_peered":"2023-10-14T18:49:00.669100+0000","last_clean":"2023-10-14T18:49:00.669100+0000","last_became_active":"2023-10-14T18:48:59.658780+0000","last_became_peered":"2023-10-14T18:48:59.658780+0000","last_unstale":"2023-10-14T18:49:00.669100+0000","last_undegraded":"2023-10-14T18:49:00.669100+0000","last_fullsized":"2023-10-14T18:49:00.669100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:19.485248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667297+0000","last_change":"2023-10-14T18:49:00.667157+0000","last_active":"2023-10-14T18:49:00.667297+0000","last_peered":"2023-10-14T18:49:00.667297+0000","last_clean":"2023-10-14T18:49:00.667297+0000","last_became_active":"2023-10-14T18:49:00.666516+0000","last_became_peered":"2023-10-14T18:49:00.666516+0000","last_unstale":"2023-10-14T18:49:00.667297+0000","last_undegraded":"2023-10-14T18:49:00.667297+0000","last_fullsized":"2023-10-14T18:49:00.667297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:00.791343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.685064+0000","last_change":"2023-10-14T18:48:59.661068+0000","last_active":"2023-10-14T18:49:00.685064+0000","last_peered":"2023-10-14T18:49:00.685064+0000","last_clean":"2023-10-14T18:49:00.685064+0000","last_became_active":"2023-10-14T18:48:59.660469+0000","last_became_peered":"2023-10-14T18:48:59.660469+0000","last_unstale":"2023-10-14T18:49:00.685064+0000","last_undegraded":"2023-10-14T18:49:00.685064+0000","last_fullsized":"2023-10-14T18:49:00.685064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:36.856337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668632+0000","last_change":"2023-10-14T18:49:00.668071+0000","last_active":"2023-10-14T18:49:00.668632+0000","last_peered":"2023-10-14T18:49:00.668632+0000","last_clean":"2023-10-14T18:49:00.668632+0000","last_became_active":"2023-10-14T18:49:00.666883+0000","last_became_peered":"2023-10-14T18:49:00.666883+0000","last_unstale":"2023-10-14T18:49:00.668632+0000","last_undegraded":"2023-10-14T18:49:00.668632+0000","last_fullsized":"2023-10-14T18:49:00.668632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:24.940753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682768+0000","last_change":"2023-10-14T18:48:59.662786+0000","last_active":"2023-10-14T18:49:00.682768+0000","last_peered":"2023-10-14T18:49:00.682768+0000","last_clean":"2023-10-14T18:49:00.682768+0000","last_became_active":"2023-10-14T18:48:59.662248+0000","last_became_peered":"2023-10-14T18:48:59.662248+0000","last_unstale":"2023-10-14T18:49:00.682768+0000","last_undegraded":"2023-10-14T18:49:00.682768+0000","last_fullsized":"2023-10-14T18:49:00.682768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:04.004495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666822+0000","last_change":"2023-10-14T18:49:00.666714+0000","last_active":"2023-10-14T18:49:00.666822+0000","last_peered":"2023-10-14T18:49:00.666822+0000","last_clean":"2023-10-14T18:49:00.666822+0000","last_became_active":"2023-10-14T18:49:00.666358+0000","last_became_peered":"2023-10-14T18:49:00.666358+0000","last_unstale":"2023-10-14T18:49:00.666822+0000","last_undegraded":"2023-10-14T18:49:00.666822+0000","last_fullsized":"2023-10-14T18:49:00.666822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:21.708701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684593+0000","last_change":"2023-10-14T18:48:59.663214+0000","last_active":"2023-10-14T18:49:00.684593+0000","last_peered":"2023-10-14T18:49:00.684593+0000","last_clean":"2023-10-14T18:49:00.684593+0000","last_became_active":"2023-10-14T18:48:59.662562+0000","last_became_peered":"2023-10-14T18:48:59.662562+0000","last_unstale":"2023-10-14T18:49:00.684593+0000","last_undegraded":"2023-10-14T18:49:00.684593+0000","last_fullsized":"2023-10-14T18:49:00.684593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:22.611043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669857+0000","last_change":"2023-10-14T18:49:00.669467+0000","last_active":"2023-10-14T18:49:00.669857+0000","last_peered":"2023-10-14T18:49:00.669857+0000","last_clean":"2023-10-14T18:49:00.669857+0000","last_became_active":"2023-10-14T18:49:00.668827+0000","last_became_peered":"2023-10-14T18:49:00.668827+0000","last_unstale":"2023-10-14T18:49:00.669857+0000","last_undegraded":"2023-10-14T18:49:00.669857+0000","last_fullsized":"2023-10-14T18:49:00.669857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:40.552180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684179+0000","last_change":"2023-10-14T18:48:59.662803+0000","last_active":"2023-10-14T18:49:00.684179+0000","last_peered":"2023-10-14T18:49:00.684179+0000","last_clean":"2023-10-14T18:49:00.684179+0000","last_became_active":"2023-10-14T18:48:59.662119+0000","last_became_peered":"2023-10-14T18:48:59.662119+0000","last_unstale":"2023-10-14T18:49:00.684179+0000","last_undegraded":"2023-10-14T18:49:00.684179+0000","last_fullsized":"2023-10-14T18:49:00.684179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:56.949836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671416+0000","last_change":"2023-10-14T18:49:00.671338+0000","last_active":"2023-10-14T18:49:00.671416+0000","last_peered":"2023-10-14T18:49:00.671416+0000","last_clean":"2023-10-14T18:49:00.671416+0000","last_became_active":"2023-10-14T18:49:00.671112+0000","last_became_peered":"2023-10-14T18:49:00.671112+0000","last_unstale":"2023-10-14T18:49:00.671416+0000","last_undegraded":"2023-10-14T18:49:00.671416+0000","last_fullsized":"2023-10-14T18:49:00.671416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:12.836668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660313+0000","last_change":"2023-10-14T18:48:59.660580+0000","last_active":"2023-10-14T18:49:00.660313+0000","last_peered":"2023-10-14T18:49:00.660313+0000","last_clean":"2023-10-14T18:49:00.660313+0000","last_became_active":"2023-10-14T18:48:59.660350+0000","last_became_peered":"2023-10-14T18:48:59.660350+0000","last_unstale":"2023-10-14T18:49:00.660313+0000","last_undegraded":"2023-10-14T18:49:00.660313+0000","last_fullsized":"2023-10-14T18:49:00.660313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:03.943391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667324+0000","last_change":"2023-10-14T18:49:00.666751+0000","last_active":"2023-10-14T18:49:00.667324+0000","last_peered":"2023-10-14T18:49:00.667324+0000","last_clean":"2023-10-14T18:49:00.667324+0000","last_became_active":"2023-10-14T18:49:00.666531+0000","last_became_peered":"2023-10-14T18:49:00.666531+0000","last_unstale":"2023-10-14T18:49:00.667324+0000","last_undegraded":"2023-10-14T18:49:00.667324+0000","last_fullsized":"2023-10-14T18:49:00.667324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666951+0000","last_change":"2023-10-14T18:48:59.662460+0000","last_active":"2023-10-14T18:49:00.666951+0000","last_peered":"2023-10-14T18:49:00.666951+0000","last_clean":"2023-10-14T18:49:00.666951+0000","last_became_active":"2023-10-14T18:48:59.660350+0000","last_became_peered":"2023-10-14T18:48:59.660350+0000","last_unstale":"2023-10-14T18:49:00.666951+0000","last_undegraded":"2023-10-14T18:49:00.666951+0000","last_fullsized":"2023-10-14T18:49:00.666951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:16:11.301635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672355+0000","last_change":"2023-10-14T18:49:00.672290+0000","last_active":"2023-10-14T18:49:00.672355+0000","last_peered":"2023-10-14T18:49:00.672355+0000","last_clean":"2023-10-14T18:49:00.672355+0000","last_became_active":"2023-10-14T18:49:00.672088+0000","last_became_peered":"2023-10-14T18:49:00.672088+0000","last_unstale":"2023-10-14T18:49:00.672355+0000","last_undegraded":"2023-10-14T18:49:00.672355+0000","last_fullsized":"2023-10-14T18:49:00.672355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:11.661727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665573+0000","last_change":"2023-10-14T18:48:59.659833+0000","last_active":"2023-10-14T18:49:00.665573+0000","last_peered":"2023-10-14T18:49:00.665573+0000","last_clean":"2023-10-14T18:49:00.665573+0000","last_became_active":"2023-10-14T18:48:59.659611+0000","last_became_peered":"2023-10-14T18:48:59.659611+0000","last_unstale":"2023-10-14T18:49:00.665573+0000","last_undegraded":"2023-10-14T18:49:00.665573+0000","last_fullsized":"2023-10-14T18:49:00.665573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:28.680355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665429+0000","last_change":"2023-10-14T18:49:00.664806+0000","last_active":"2023-10-14T18:49:00.665429+0000","last_peered":"2023-10-14T18:49:00.665429+0000","last_clean":"2023-10-14T18:49:00.665429+0000","last_became_active":"2023-10-14T18:49:00.664596+0000","last_became_peered":"2023-10-14T18:49:00.664596+0000","last_unstale":"2023-10-14T18:49:00.665429+0000","last_undegraded":"2023-10-14T18:49:00.665429+0000","last_fullsized":"2023-10-14T18:49:00.665429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660356+0000","last_change":"2023-10-14T18:48:59.655013+0000","last_active":"2023-10-14T18:49:00.660356+0000","last_peered":"2023-10-14T18:49:00.660356+0000","last_clean":"2023-10-14T18:49:00.660356+0000","last_became_active":"2023-10-14T18:48:59.654784+0000","last_became_peered":"2023-10-14T18:48:59.654784+0000","last_unstale":"2023-10-14T18:49:00.660356+0000","last_undegraded":"2023-10-14T18:49:00.660356+0000","last_fullsized":"2023-10-14T18:49:00.660356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:09:20.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668873+0000","last_change":"2023-10-14T18:49:00.668802+0000","last_active":"2023-10-14T18:49:00.668873+0000","last_peered":"2023-10-14T18:49:00.668873+0000","last_clean":"2023-10-14T18:49:00.668873+0000","last_became_active":"2023-10-14T18:49:00.668566+0000","last_became_peered":"2023-10-14T18:49:00.668566+0000","last_unstale":"2023-10-14T18:49:00.668873+0000","last_undegraded":"2023-10-14T18:49:00.668873+0000","last_fullsized":"2023-10-14T18:49:00.668873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682296+0000","last_change":"2023-10-14T18:48:59.658881+0000","last_active":"2023-10-14T18:49:00.682296+0000","last_peered":"2023-10-14T18:49:00.682296+0000","last_clean":"2023-10-14T18:49:00.682296+0000","last_became_active":"2023-10-14T18:48:59.658413+0000","last_became_peered":"2023-10-14T18:48:59.658413+0000","last_unstale":"2023-10-14T18:49:00.682296+0000","last_undegraded":"2023-10-14T18:49:00.682296+0000","last_fullsized":"2023-10-14T18:49:00.682296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:58.017318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673483+0000","last_change":"2023-10-14T18:49:00.673420+0000","last_active":"2023-10-14T18:49:00.673483+0000","last_peered":"2023-10-14T18:49:00.673483+0000","last_clean":"2023-10-14T18:49:00.673483+0000","last_became_active":"2023-10-14T18:49:00.672558+0000","last_became_peered":"2023-10-14T18:49:00.672558+0000","last_unstale":"2023-10-14T18:49:00.673483+0000","last_undegraded":"2023-10-14T18:49:00.673483+0000","last_fullsized":"2023-10-14T18:49:00.673483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:56:22.827021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665434+0000","last_change":"2023-10-14T18:48:59.660863+0000","last_active":"2023-10-14T18:49:00.665434+0000","last_peered":"2023-10-14T18:49:00.665434+0000","last_clean":"2023-10-14T18:49:00.665434+0000","last_became_active":"2023-10-14T18:48:59.660537+0000","last_became_peered":"2023-10-14T18:48:59.660537+0000","last_unstale":"2023-10-14T18:49:00.665434+0000","last_undegraded":"2023-10-14T18:49:00.665434+0000","last_fullsized":"2023-10-14T18:49:00.665434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:55.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665412+0000","last_change":"2023-10-14T18:49:00.665290+0000","last_active":"2023-10-14T18:49:00.665412+0000","last_peered":"2023-10-14T18:49:00.665412+0000","last_clean":"2023-10-14T18:49:00.665412+0000","last_became_active":"2023-10-14T18:49:00.664969+0000","last_became_peered":"2023-10-14T18:49:00.664969+0000","last_unstale":"2023-10-14T18:49:00.665412+0000","last_undegraded":"2023-10-14T18:49:00.665412+0000","last_fullsized":"2023-10-14T18:49:00.665412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664997+0000","last_change":"2023-10-14T18:48:59.659643+0000","last_active":"2023-10-14T18:49:00.664997+0000","last_peered":"2023-10-14T18:49:00.664997+0000","last_clean":"2023-10-14T18:49:00.664997+0000","last_became_active":"2023-10-14T18:48:59.659397+0000","last_became_peered":"2023-10-14T18:48:59.659397+0000","last_unstale":"2023-10-14T18:49:00.664997+0000","last_undegraded":"2023-10-14T18:49:00.664997+0000","last_fullsized":"2023-10-14T18:49:00.664997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:09.725554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666805+0000","last_change":"2023-10-14T18:49:00.666580+0000","last_active":"2023-10-14T18:49:00.666805+0000","last_peered":"2023-10-14T18:49:00.666805+0000","last_clean":"2023-10-14T18:49:00.666805+0000","last_became_active":"2023-10-14T18:49:00.665946+0000","last_became_peered":"2023-10-14T18:49:00.665946+0000","last_unstale":"2023-10-14T18:49:00.666805+0000","last_undegraded":"2023-10-14T18:49:00.666805+0000","last_fullsized":"2023-10-14T18:49:00.666805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.231369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660540+0000","last_change":"2023-10-14T18:48:59.662201+0000","last_active":"2023-10-14T18:49:00.660540+0000","last_peered":"2023-10-14T18:49:00.660540+0000","last_clean":"2023-10-14T18:49:00.660540+0000","last_became_active":"2023-10-14T18:48:59.662014+0000","last_became_peered":"2023-10-14T18:48:59.662014+0000","last_unstale":"2023-10-14T18:49:00.660540+0000","last_undegraded":"2023-10-14T18:49:00.660540+0000","last_fullsized":"2023-10-14T18:49:00.660540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:13.562087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667470+0000","last_change":"2023-10-14T18:49:00.667411+0000","last_active":"2023-10-14T18:49:00.667470+0000","last_peered":"2023-10-14T18:49:00.667470+0000","last_clean":"2023-10-14T18:49:00.667470+0000","last_became_active":"2023-10-14T18:49:00.666938+0000","last_became_peered":"2023-10-14T18:49:00.666938+0000","last_unstale":"2023-10-14T18:49:00.667470+0000","last_undegraded":"2023-10-14T18:49:00.667470+0000","last_fullsized":"2023-10-14T18:49:00.667470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:14.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663545+0000","last_change":"2023-10-14T18:48:59.659067+0000","last_active":"2023-10-14T18:49:00.663545+0000","last_peered":"2023-10-14T18:49:00.663545+0000","last_clean":"2023-10-14T18:49:00.663545+0000","last_became_active":"2023-10-14T18:48:59.658613+0000","last_became_peered":"2023-10-14T18:48:59.658613+0000","last_unstale":"2023-10-14T18:49:00.663545+0000","last_undegraded":"2023-10-14T18:49:00.663545+0000","last_fullsized":"2023-10-14T18:49:00.663545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:07.324055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673919+0000","last_change":"2023-10-14T18:49:00.673858+0000","last_active":"2023-10-14T18:49:00.673919+0000","last_peered":"2023-10-14T18:49:00.673919+0000","last_clean":"2023-10-14T18:49:00.673919+0000","last_became_active":"2023-10-14T18:49:00.673021+0000","last_became_peered":"2023-10-14T18:49:00.673021+0000","last_unstale":"2023-10-14T18:49:00.673919+0000","last_undegraded":"2023-10-14T18:49:00.673919+0000","last_fullsized":"2023-10-14T18:49:00.673919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:09.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662798+0000","last_change":"2023-10-14T18:48:59.657666+0000","last_active":"2023-10-14T18:49:00.662798+0000","last_peered":"2023-10-14T18:49:00.662798+0000","last_clean":"2023-10-14T18:49:00.662798+0000","last_became_active":"2023-10-14T18:48:59.657058+0000","last_became_peered":"2023-10-14T18:48:59.657058+0000","last_unstale":"2023-10-14T18:49:00.662798+0000","last_undegraded":"2023-10-14T18:49:00.662798+0000","last_fullsized":"2023-10-14T18:49:00.662798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:04.004495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668501+0000","last_change":"2023-10-14T18:49:00.668435+0000","last_active":"2023-10-14T18:49:00.668501+0000","last_peered":"2023-10-14T18:49:00.668501+0000","last_clean":"2023-10-14T18:49:00.668501+0000","last_became_active":"2023-10-14T18:49:00.668259+0000","last_became_peered":"2023-10-14T18:49:00.668259+0000","last_unstale":"2023-10-14T18:49:00.668501+0000","last_undegraded":"2023-10-14T18:49:00.668501+0000","last_fullsized":"2023-10-14T18:49:00.668501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:37.860784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663413+0000","last_change":"2023-10-14T18:48:59.660921+0000","last_active":"2023-10-14T18:49:00.663413+0000","last_peered":"2023-10-14T18:49:00.663413+0000","last_clean":"2023-10-14T18:49:00.663413+0000","last_became_active":"2023-10-14T18:48:59.660163+0000","last_became_peered":"2023-10-14T18:48:59.660163+0000","last_unstale":"2023-10-14T18:49:00.663413+0000","last_undegraded":"2023-10-14T18:49:00.663413+0000","last_fullsized":"2023-10-14T18:49:00.663413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:05.121552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675781+0000","last_change":"2023-10-14T18:49:00.675725+0000","last_active":"2023-10-14T18:49:00.675781+0000","last_peered":"2023-10-14T18:49:00.675781+0000","last_clean":"2023-10-14T18:49:00.675781+0000","last_became_active":"2023-10-14T18:49:00.675326+0000","last_became_peered":"2023-10-14T18:49:00.675326+0000","last_unstale":"2023-10-14T18:49:00.675781+0000","last_undegraded":"2023-10-14T18:49:00.675781+0000","last_fullsized":"2023-10-14T18:49:00.675781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:56.757517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667041+0000","last_change":"2023-10-14T18:48:59.662611+0000","last_active":"2023-10-14T18:49:00.667041+0000","last_peered":"2023-10-14T18:49:00.667041+0000","last_clean":"2023-10-14T18:49:00.667041+0000","last_became_active":"2023-10-14T18:48:59.660667+0000","last_became_peered":"2023-10-14T18:48:59.660667+0000","last_unstale":"2023-10-14T18:49:00.667041+0000","last_undegraded":"2023-10-14T18:49:00.667041+0000","last_fullsized":"2023-10-14T18:49:00.667041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:36:48.266994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672093+0000","last_change":"2023-10-14T18:49:00.672026+0000","last_active":"2023-10-14T18:49:00.672093+0000","last_peered":"2023-10-14T18:49:00.672093+0000","last_clean":"2023-10-14T18:49:00.672093+0000","last_became_active":"2023-10-14T18:49:00.671784+0000","last_became_peered":"2023-10-14T18:49:00.671784+0000","last_unstale":"2023-10-14T18:49:00.672093+0000","last_undegraded":"2023-10-14T18:49:00.672093+0000","last_fullsized":"2023-10-14T18:49:00.672093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:47.006049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683119+0000","last_change":"2023-10-14T18:48:59.655793+0000","last_active":"2023-10-14T18:49:00.683119+0000","last_peered":"2023-10-14T18:49:00.683119+0000","last_clean":"2023-10-14T18:49:00.683119+0000","last_became_active":"2023-10-14T18:48:59.655559+0000","last_became_peered":"2023-10-14T18:48:59.655559+0000","last_unstale":"2023-10-14T18:49:00.683119+0000","last_undegraded":"2023-10-14T18:49:00.683119+0000","last_fullsized":"2023-10-14T18:49:00.683119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:12.669739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":228,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.661586+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:49:00.661586+0000","last_peered":"2023-10-14T18:49:00.661586+0000","last_clean":"2023-10-14T18:49:00.661586+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:49:00.661586+0000","last_undegraded":"2023-10-14T18:49:00.661586+0000","last_fullsized":"2023-10-14T18:49:00.661586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.5}]},{"osd":1,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.61899999999999999,"15min":0.65800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74199999999999999,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66200000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.78000000000000003,"15min":0.876},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.46600000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67600000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.379},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.441,"15min":0.439},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.33400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":0.745,"15min":0.745},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.63700000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.625,"15min":0.67300000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73799999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.80400000000000005,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.441},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63600000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.37}]},{"osd":5,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46700000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":441,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194871,"statfs":{"total":200000000,"available":199548216,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.223,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55600000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52500000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57999999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.68999999999999995,"15min":0.81999999999999995},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54800000000000004,"5min":10.574,"15min":10.574},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72299999999999998,"5min":1.125,"15min":1.125},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.39800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58699999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76400000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.496}]},{"osd":7,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.28499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.316}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58299999999999996},"min":{"1min":0.45300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.54200000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.42999999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89400000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59099999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":440,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194871,"statfs":{"total":200000000,"available":199548804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.249},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.52900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.61099999999999999,"5min":1.006,"15min":1.006},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.28799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81299999999999994,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86499999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550228,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48099999999999998,"5min":0.5,"15min":0.5},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54800000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.378,"15min":0.375},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.439},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77900000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77000000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.47599999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.62},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.33000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.5}]},{"osd":1,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.499},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38}]},{"osd":6,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.496,"15min":0.504},"min":{"1min":0.312,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.443},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77400000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.872,"15min":0.872},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550250,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.625}]},{"osd":2,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.748},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60999999999999999,"5min":0.872,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.746,"15min":0.746},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70499999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38800000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495}]}]}],"pool_statfs":[]}} 2023-10-14T18:49:04.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:49:04.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.874+0000 7f4fdf2a1700 1 Processor -- start 2023-10-14T18:49:04.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.874+0000 7f4fdf2a1700 1 -- start start 2023-10-14T18:49:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdf2a1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fd815a620 0x7f4fd815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdf2a1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd815cbb0 con 0x7f4fd815d580 2023-10-14T18:49:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdf2a1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd815bfa0 con 0x7f4fd8157870 2023-10-14T18:49:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdf2a1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd815bdb0 con 0x7f4fd815a620 2023-10-14T18:49:04.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdc83c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4fd815a620 0x7f4fd815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdd83e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4fd815d580 0x7f4fd8158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45602/0 (socket says 172.21.15.79:45602) 2023-10-14T18:49:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdd83e700 1 -- 172.21.15.79:0/1920305343 learned_addr learned my addr 172.21.15.79:0/1920305343 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdc83c700 1 -- 172.21.15.79:0/1920305343 >> v1:172.21.15.144:6789/0 conn(0x7f4fd8157870 legacy=0x7f4fd815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:04.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdc83c700 1 -- 172.21.15.79:0/1920305343 >> v1:172.21.15.79:6789/0 conn(0x7f4fd815d580 legacy=0x7f4fd8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fd7fff700 1 -- 172.21.15.79:0/1920305343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508874430 0 0) 0x7f4fd815cbb0 con 0x7f4fd815d580 2023-10-14T18:49:04.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdc83c700 1 -- 172.21.15.79:0/1920305343 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd815c280 con 0x7f4fd815a620 2023-10-14T18:49:04.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fdc83c700 1 --2- 172.21.15.79:0/1920305343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd815a620 0x7f4fd815d040 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009e60 tx=0x7f4fcc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c545c97bbc59f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fd7fff700 1 -- 172.21.15.79:0/1920305343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00e070 con 0x7f4fd815a620 2023-10-14T18:49:04.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fd7fff700 1 -- 172.21.15.79:0/1920305343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00bbf0 con 0x7f4fd815a620 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.875+0000 7f4fd7fff700 1 -- 172.21.15.79:0/1920305343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc012430 con 0x7f4fd815a620 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/1920305343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd815a620 msgr2=0x7f4fd815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/1920305343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd815a620 0x7f4fd815d040 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009e60 tx=0x7f4fcc009780 comp rx=0 tx=0).stop 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/1920305343 shutdown_connections 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/1920305343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd815a620 0x7f4fd815d040 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/1920305343 >> 172.21.15.79:0/1920305343 conn(0x7f4fd8068ce0 msgr2=0x7f4fd80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:04.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/1920305343 shutdown_connections 2023-10-14T18:49:04.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.876+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/1920305343 wait complete. 2023-10-14T18:49:04.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.877+0000 7f4fdf2a1700 1 Processor -- start 2023-10-14T18:49:04.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.877+0000 7f4fdf2a1700 1 -- start start 2023-10-14T18:49:04.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd815a620 0x7f4fd80cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fd815d580 0x7f4fd8153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80d01d0 con 0x7f4fd8157870 2023-10-14T18:49:04.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8153aa0 con 0x7f4fd815a620 2023-10-14T18:49:04.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdf2a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81513e0 con 0x7f4fd815d580 2023-10-14T18:49:04.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37426/0 (socket says 172.21.15.79:37426) 2023-10-14T18:49:04.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 -- 172.21.15.79:0/163807836 learned_addr learned my addr 172.21.15.79:0/163807836 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:04.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdc83c700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd815a620 0x7f4fd80cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd83e700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fd815d580 0x7f4fd8153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 -- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fd815d580 msgr2=0x7f4fd8153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fd815d580 0x7f4fd8153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 -- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd815a620 msgr2=0x7f4fd80cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd815a620 0x7f4fd80cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.878+0000 7f4fdd03d700 1 -- 172.21.15.79:0/163807836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009a20 con 0x7f4fd8157870 2023-10-14T18:49:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fdd03d700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000b600 tx=0x7f4fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000f510 con 0x7f4fd8157870 2023-10-14T18:49:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd000f690 con 0x7f4fd8157870 2023-10-14T18:49:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd80b0ca0 con 0x7f4fd8157870 2023-10-14T18:49:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000fa50 con 0x7f4fd8157870 2023-10-14T18:49:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.879+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80b1260 con 0x7f4fd8157870 2023-10-14T18:49:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.880+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd804c3c0 con 0x7f4fd8157870 2023-10-14T18:49:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.880+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fd001a400 con 0x7f4fd8157870 2023-10-14T18:49:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.880+0000 7f4fd57fa700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 0x7f4fc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.880+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fd0083f60 con 0x7f4fd8157870 2023-10-14T18:49:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.881+0000 7f4fdc83c700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 0x7f4fc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:04.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.881+0000 7f4fdc83c700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 0x7f4fc40693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4fd815aa20 tx=0x7f4fcc018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:04.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:04.885+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fd0051250 con 0x7f4fd8157870 2023-10-14T18:49:05.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.062+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fd8151520 con 0x7f4fc4066f30 2023-10-14T18:49:05.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.071+0000 7f4fd57fa700 1 -- 172.21.15.79:0/163807836 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284989 (secure 0 0 0) 0x7f4fcc012830 con 0x7f4fc4066f30 2023-10-14T18:49:05.074 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 msgr2=0x7f4fc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 0x7f4fc40693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4fd815aa20 tx=0x7f4fcc018000 comp rx=0 tx=0).stop 2023-10-14T18:49:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 msgr2=0x7f4fd80b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000b600 tx=0x7f4fd00091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 shutdown_connections 2023-10-14T18:49:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4fc4066f30 0x7f4fc40693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4fd815d580 0x7f4fd8153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fd8157870 0x7f4fd80b06c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 --2- 172.21.15.79:0/163807836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fd815a620 0x7f4fd80cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 >> 172.21.15.79:0/163807836 conn(0x7f4fd8068ce0 msgr2=0x7f4fd8159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 shutdown_connections 2023-10-14T18:49:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.074+0000 7f4fdf2a1700 1 -- 172.21.15.79:0/163807836 wait complete. 2023-10-14T18:49:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:49:05.086 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2023-10-14T18:49:04.390457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4669,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557830,"statfs":{"total":1600000000,"available":1595218383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.744087"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669367+0000","last_change":"2023-10-14T18:49:00.669147+0000","last_active":"2023-10-14T18:49:00.669367+0000","last_peered":"2023-10-14T18:49:00.669367+0000","last_clean":"2023-10-14T18:49:00.669367+0000","last_became_active":"2023-10-14T18:49:00.668637+0000","last_became_peered":"2023-10-14T18:49:00.668637+0000","last_unstale":"2023-10-14T18:49:00.669367+0000","last_undegraded":"2023-10-14T18:49:00.669367+0000","last_fullsized":"2023-10-14T18:49:00.669367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:58.299683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670838+0000","last_change":"2023-10-14T18:49:00.670471+0000","last_active":"2023-10-14T18:49:00.670838+0000","last_peered":"2023-10-14T18:49:00.670838+0000","last_clean":"2023-10-14T18:49:00.670838+0000","last_became_active":"2023-10-14T18:49:00.670226+0000","last_became_peered":"2023-10-14T18:49:00.670226+0000","last_unstale":"2023-10-14T18:49:00.670838+0000","last_undegraded":"2023-10-14T18:49:00.670838+0000","last_fullsized":"2023-10-14T18:49:00.670838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:35.315328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666370+0000","last_change":"2023-10-14T18:49:00.666319+0000","last_active":"2023-10-14T18:49:00.666370+0000","last_peered":"2023-10-14T18:49:00.666370+0000","last_clean":"2023-10-14T18:49:00.666370+0000","last_became_active":"2023-10-14T18:49:00.666099+0000","last_became_peered":"2023-10-14T18:49:00.666099+0000","last_unstale":"2023-10-14T18:49:00.666370+0000","last_undegraded":"2023-10-14T18:49:00.666370+0000","last_fullsized":"2023-10-14T18:49:00.666370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672121+0000","last_change":"2023-10-14T18:49:00.672063+0000","last_active":"2023-10-14T18:49:00.672121+0000","last_peered":"2023-10-14T18:49:00.672121+0000","last_clean":"2023-10-14T18:49:00.672121+0000","last_became_active":"2023-10-14T18:49:00.671817+0000","last_became_peered":"2023-10-14T18:49:00.671817+0000","last_unstale":"2023-10-14T18:49:00.672121+0000","last_undegraded":"2023-10-14T18:49:00.672121+0000","last_fullsized":"2023-10-14T18:49:00.672121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:40:55.611834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668632+0000","last_change":"2023-10-14T18:49:00.668575+0000","last_active":"2023-10-14T18:49:00.668632+0000","last_peered":"2023-10-14T18:49:00.668632+0000","last_clean":"2023-10-14T18:49:00.668632+0000","last_became_active":"2023-10-14T18:49:00.668159+0000","last_became_peered":"2023-10-14T18:49:00.668159+0000","last_unstale":"2023-10-14T18:49:00.668632+0000","last_undegraded":"2023-10-14T18:49:00.668632+0000","last_fullsized":"2023-10-14T18:49:00.668632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:36.176407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673803+0000","last_change":"2023-10-14T18:49:00.673722+0000","last_active":"2023-10-14T18:49:00.673803+0000","last_peered":"2023-10-14T18:49:00.673803+0000","last_clean":"2023-10-14T18:49:00.673803+0000","last_became_active":"2023-10-14T18:49:00.672737+0000","last_became_peered":"2023-10-14T18:49:00.672737+0000","last_unstale":"2023-10-14T18:49:00.673803+0000","last_undegraded":"2023-10-14T18:49:00.673803+0000","last_fullsized":"2023-10-14T18:49:00.673803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:24.940753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673647+0000","last_change":"2023-10-14T18:49:00.673588+0000","last_active":"2023-10-14T18:49:00.673647+0000","last_peered":"2023-10-14T18:49:00.673647+0000","last_clean":"2023-10-14T18:49:00.673647+0000","last_became_active":"2023-10-14T18:49:00.672859+0000","last_became_peered":"2023-10-14T18:49:00.672859+0000","last_unstale":"2023-10-14T18:49:00.673647+0000","last_undegraded":"2023-10-14T18:49:00.673647+0000","last_fullsized":"2023-10-14T18:49:00.673647+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:12:03.509368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675640+0000","last_change":"2023-10-14T18:49:00.675544+0000","last_active":"2023-10-14T18:49:00.675640+0000","last_peered":"2023-10-14T18:49:00.675640+0000","last_clean":"2023-10-14T18:49:00.675640+0000","last_became_active":"2023-10-14T18:49:00.674685+0000","last_became_peered":"2023-10-14T18:49:00.674685+0000","last_unstale":"2023-10-14T18:49:00.675640+0000","last_undegraded":"2023-10-14T18:49:00.675640+0000","last_fullsized":"2023-10-14T18:49:00.675640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:05:54.917856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667279+0000","last_change":"2023-10-14T18:49:00.667114+0000","last_active":"2023-10-14T18:49:00.667279+0000","last_peered":"2023-10-14T18:49:00.667279+0000","last_clean":"2023-10-14T18:49:00.667279+0000","last_became_active":"2023-10-14T18:49:00.666840+0000","last_became_peered":"2023-10-14T18:49:00.666840+0000","last_unstale":"2023-10-14T18:49:00.667279+0000","last_undegraded":"2023-10-14T18:49:00.667279+0000","last_fullsized":"2023-10-14T18:49:00.667279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:44.103822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.674202+0000","last_change":"2023-10-14T18:49:00.671766+0000","last_active":"2023-10-14T18:49:00.674202+0000","last_peered":"2023-10-14T18:49:00.674202+0000","last_clean":"2023-10-14T18:49:00.674202+0000","last_became_active":"2023-10-14T18:49:00.671387+0000","last_became_peered":"2023-10-14T18:49:00.671387+0000","last_unstale":"2023-10-14T18:49:00.674202+0000","last_undegraded":"2023-10-14T18:49:00.674202+0000","last_fullsized":"2023-10-14T18:49:00.674202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:07.175239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662711+0000","last_change":"2023-10-14T18:49:00.662656+0000","last_active":"2023-10-14T18:49:00.662711+0000","last_peered":"2023-10-14T18:49:00.662711+0000","last_clean":"2023-10-14T18:49:00.662711+0000","last_became_active":"2023-10-14T18:49:00.662436+0000","last_became_peered":"2023-10-14T18:49:00.662436+0000","last_unstale":"2023-10-14T18:49:00.662711+0000","last_undegraded":"2023-10-14T18:49:00.662711+0000","last_fullsized":"2023-10-14T18:49:00.662711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669827+0000","last_change":"2023-10-14T18:49:00.669028+0000","last_active":"2023-10-14T18:49:00.669827+0000","last_peered":"2023-10-14T18:49:00.669827+0000","last_clean":"2023-10-14T18:49:00.669827+0000","last_became_active":"2023-10-14T18:49:00.668652+0000","last_became_peered":"2023-10-14T18:49:00.668652+0000","last_unstale":"2023-10-14T18:49:00.669827+0000","last_undegraded":"2023-10-14T18:49:00.669827+0000","last_fullsized":"2023-10-14T18:49:00.669827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:46.420360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672194+0000","last_change":"2023-10-14T18:49:00.672124+0000","last_active":"2023-10-14T18:49:00.672194+0000","last_peered":"2023-10-14T18:49:00.672194+0000","last_clean":"2023-10-14T18:49:00.672194+0000","last_became_active":"2023-10-14T18:49:00.671755+0000","last_became_peered":"2023-10-14T18:49:00.671755+0000","last_unstale":"2023-10-14T18:49:00.672194+0000","last_undegraded":"2023-10-14T18:49:00.672194+0000","last_fullsized":"2023-10-14T18:49:00.672194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670314+0000","last_change":"2023-10-14T18:49:00.670274+0000","last_active":"2023-10-14T18:49:00.670314+0000","last_peered":"2023-10-14T18:49:00.670314+0000","last_clean":"2023-10-14T18:49:00.670314+0000","last_became_active":"2023-10-14T18:49:00.670130+0000","last_became_peered":"2023-10-14T18:49:00.670130+0000","last_unstale":"2023-10-14T18:49:00.670314+0000","last_undegraded":"2023-10-14T18:49:00.670314+0000","last_fullsized":"2023-10-14T18:49:00.670314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:05.276186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667420+0000","last_change":"2023-10-14T18:49:00.667366+0000","last_active":"2023-10-14T18:49:00.667420+0000","last_peered":"2023-10-14T18:49:00.667420+0000","last_clean":"2023-10-14T18:49:00.667420+0000","last_became_active":"2023-10-14T18:49:00.667202+0000","last_became_peered":"2023-10-14T18:49:00.667202+0000","last_unstale":"2023-10-14T18:49:00.667420+0000","last_undegraded":"2023-10-14T18:49:00.667420+0000","last_fullsized":"2023-10-14T18:49:00.667420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:58.299683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.674221+0000","last_change":"2023-10-14T18:49:00.671850+0000","last_active":"2023-10-14T18:49:00.674221+0000","last_peered":"2023-10-14T18:49:00.674221+0000","last_clean":"2023-10-14T18:49:00.674221+0000","last_became_active":"2023-10-14T18:49:00.671593+0000","last_became_peered":"2023-10-14T18:49:00.671593+0000","last_unstale":"2023-10-14T18:49:00.674221+0000","last_undegraded":"2023-10-14T18:49:00.674221+0000","last_fullsized":"2023-10-14T18:49:00.674221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:14.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666596+0000","last_change":"2023-10-14T18:49:00.665392+0000","last_active":"2023-10-14T18:49:00.666596+0000","last_peered":"2023-10-14T18:49:00.666596+0000","last_clean":"2023-10-14T18:49:00.666596+0000","last_became_active":"2023-10-14T18:49:00.664609+0000","last_became_peered":"2023-10-14T18:49:00.664609+0000","last_unstale":"2023-10-14T18:49:00.666596+0000","last_undegraded":"2023-10-14T18:49:00.666596+0000","last_fullsized":"2023-10-14T18:49:00.666596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:36:33.715016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672525+0000","last_change":"2023-10-14T18:49:00.672465+0000","last_active":"2023-10-14T18:49:00.672525+0000","last_peered":"2023-10-14T18:49:00.672525+0000","last_clean":"2023-10-14T18:49:00.672525+0000","last_became_active":"2023-10-14T18:49:00.672162+0000","last_became_peered":"2023-10-14T18:49:00.672162+0000","last_unstale":"2023-10-14T18:49:00.672525+0000","last_undegraded":"2023-10-14T18:49:00.672525+0000","last_fullsized":"2023-10-14T18:49:00.672525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:10:09.889592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675065+0000","last_change":"2023-10-14T18:49:00.674838+0000","last_active":"2023-10-14T18:49:00.675065+0000","last_peered":"2023-10-14T18:49:00.675065+0000","last_clean":"2023-10-14T18:49:00.675065+0000","last_became_active":"2023-10-14T18:49:00.673939+0000","last_became_peered":"2023-10-14T18:49:00.673939+0000","last_unstale":"2023-10-14T18:49:00.675065+0000","last_undegraded":"2023-10-14T18:49:00.675065+0000","last_fullsized":"2023-10-14T18:49:00.675065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:01.914783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666677+0000","last_change":"2023-10-14T18:49:00.666615+0000","last_active":"2023-10-14T18:49:00.666677+0000","last_peered":"2023-10-14T18:49:00.666677+0000","last_clean":"2023-10-14T18:49:00.666677+0000","last_became_active":"2023-10-14T18:49:00.666390+0000","last_became_peered":"2023-10-14T18:49:00.666390+0000","last_unstale":"2023-10-14T18:49:00.666677+0000","last_undegraded":"2023-10-14T18:49:00.666677+0000","last_fullsized":"2023-10-14T18:49:00.666677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668587+0000","last_change":"2023-10-14T18:49:00.667530+0000","last_active":"2023-10-14T18:49:00.668587+0000","last_peered":"2023-10-14T18:49:00.668587+0000","last_clean":"2023-10-14T18:49:00.668587+0000","last_became_active":"2023-10-14T18:49:00.667298+0000","last_became_peered":"2023-10-14T18:49:00.667298+0000","last_unstale":"2023-10-14T18:49:00.668587+0000","last_undegraded":"2023-10-14T18:49:00.668587+0000","last_fullsized":"2023-10-14T18:49:00.668587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:56.757517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670751+0000","last_change":"2023-10-14T18:49:00.669909+0000","last_active":"2023-10-14T18:49:00.670751+0000","last_peered":"2023-10-14T18:49:00.670751+0000","last_clean":"2023-10-14T18:49:00.670751+0000","last_became_active":"2023-10-14T18:49:00.669645+0000","last_became_peered":"2023-10-14T18:49:00.669645+0000","last_unstale":"2023-10-14T18:49:00.670751+0000","last_undegraded":"2023-10-14T18:49:00.670751+0000","last_fullsized":"2023-10-14T18:49:00.670751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:35.315328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669351+0000","last_change":"2023-10-14T18:49:00.668932+0000","last_active":"2023-10-14T18:49:00.669351+0000","last_peered":"2023-10-14T18:49:00.669351+0000","last_clean":"2023-10-14T18:49:00.669351+0000","last_became_active":"2023-10-14T18:49:00.668652+0000","last_became_peered":"2023-10-14T18:49:00.668652+0000","last_unstale":"2023-10-14T18:49:00.669351+0000","last_undegraded":"2023-10-14T18:49:00.669351+0000","last_fullsized":"2023-10-14T18:49:00.669351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:47.006049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673984+0000","last_change":"2023-10-14T18:49:00.672758+0000","last_active":"2023-10-14T18:49:00.673984+0000","last_peered":"2023-10-14T18:49:00.673984+0000","last_clean":"2023-10-14T18:49:00.673984+0000","last_became_active":"2023-10-14T18:49:00.672410+0000","last_became_peered":"2023-10-14T18:49:00.672410+0000","last_unstale":"2023-10-14T18:49:00.673984+0000","last_undegraded":"2023-10-14T18:49:00.673984+0000","last_fullsized":"2023-10-14T18:49:00.673984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668606+0000","last_change":"2023-10-14T18:49:00.667933+0000","last_active":"2023-10-14T18:49:00.668606+0000","last_peered":"2023-10-14T18:49:00.668606+0000","last_clean":"2023-10-14T18:49:00.668606+0000","last_became_active":"2023-10-14T18:49:00.666604+0000","last_became_peered":"2023-10-14T18:49:00.666604+0000","last_unstale":"2023-10-14T18:49:00.668606+0000","last_undegraded":"2023-10-14T18:49:00.668606+0000","last_fullsized":"2023-10-14T18:49:00.668606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:45:35.159153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671864+0000","last_change":"2023-10-14T18:49:00.671607+0000","last_active":"2023-10-14T18:49:00.671864+0000","last_peered":"2023-10-14T18:49:00.671864+0000","last_clean":"2023-10-14T18:49:00.671864+0000","last_became_active":"2023-10-14T18:49:00.671395+0000","last_became_peered":"2023-10-14T18:49:00.671395+0000","last_unstale":"2023-10-14T18:49:00.671864+0000","last_undegraded":"2023-10-14T18:49:00.671864+0000","last_fullsized":"2023-10-14T18:49:00.671864+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:35.487422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662454+0000","last_change":"2023-10-14T18:49:00.662394+0000","last_active":"2023-10-14T18:49:00.662454+0000","last_peered":"2023-10-14T18:49:00.662454+0000","last_clean":"2023-10-14T18:49:00.662454+0000","last_became_active":"2023-10-14T18:49:00.662153+0000","last_became_peered":"2023-10-14T18:49:00.662153+0000","last_unstale":"2023-10-14T18:49:00.662454+0000","last_undegraded":"2023-10-14T18:49:00.662454+0000","last_fullsized":"2023-10-14T18:49:00.662454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.231369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670731+0000","last_change":"2023-10-14T18:49:00.669742+0000","last_active":"2023-10-14T18:49:00.670731+0000","last_peered":"2023-10-14T18:49:00.670731+0000","last_clean":"2023-10-14T18:49:00.670731+0000","last_became_active":"2023-10-14T18:49:00.669503+0000","last_became_peered":"2023-10-14T18:49:00.669503+0000","last_unstale":"2023-10-14T18:49:00.670731+0000","last_undegraded":"2023-10-14T18:49:00.670731+0000","last_fullsized":"2023-10-14T18:49:00.670731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:01.914783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668926+0000","last_change":"2023-10-14T18:49:00.668880+0000","last_active":"2023-10-14T18:49:00.668926+0000","last_peered":"2023-10-14T18:49:00.668926+0000","last_clean":"2023-10-14T18:49:00.668926+0000","last_became_active":"2023-10-14T18:49:00.668667+0000","last_became_peered":"2023-10-14T18:49:00.668667+0000","last_unstale":"2023-10-14T18:49:00.668926+0000","last_undegraded":"2023-10-14T18:49:00.668926+0000","last_fullsized":"2023-10-14T18:49:00.668926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:21.708701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671208+0000","last_change":"2023-10-14T18:49:00.671139+0000","last_active":"2023-10-14T18:49:00.671208+0000","last_peered":"2023-10-14T18:49:00.671208+0000","last_clean":"2023-10-14T18:49:00.671208+0000","last_became_active":"2023-10-14T18:49:00.670901+0000","last_became_peered":"2023-10-14T18:49:00.670901+0000","last_unstale":"2023-10-14T18:49:00.671208+0000","last_undegraded":"2023-10-14T18:49:00.671208+0000","last_fullsized":"2023-10-14T18:49:00.671208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:12.875138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670298+0000","last_change":"2023-10-14T18:49:00.670231+0000","last_active":"2023-10-14T18:49:00.670298+0000","last_peered":"2023-10-14T18:49:00.670298+0000","last_clean":"2023-10-14T18:49:00.670298+0000","last_became_active":"2023-10-14T18:49:00.670042+0000","last_became_peered":"2023-10-14T18:49:00.670042+0000","last_unstale":"2023-10-14T18:49:00.670298+0000","last_undegraded":"2023-10-14T18:49:00.670298+0000","last_fullsized":"2023-10-14T18:49:00.670298+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:19.537247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672176+0000","last_change":"2023-10-14T18:49:00.672105+0000","last_active":"2023-10-14T18:49:00.672176+0000","last_peered":"2023-10-14T18:49:00.672176+0000","last_clean":"2023-10-14T18:49:00.672176+0000","last_became_active":"2023-10-14T18:49:00.671832+0000","last_became_peered":"2023-10-14T18:49:00.671832+0000","last_unstale":"2023-10-14T18:49:00.672176+0000","last_undegraded":"2023-10-14T18:49:00.672176+0000","last_fullsized":"2023-10-14T18:49:00.672176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:20.489696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673965+0000","last_change":"2023-10-14T18:49:00.672622+0000","last_active":"2023-10-14T18:49:00.673965+0000","last_peered":"2023-10-14T18:49:00.673965+0000","last_clean":"2023-10-14T18:49:00.673965+0000","last_became_active":"2023-10-14T18:49:00.672117+0000","last_became_peered":"2023-10-14T18:49:00.672117+0000","last_unstale":"2023-10-14T18:49:00.673965+0000","last_undegraded":"2023-10-14T18:49:00.673965+0000","last_fullsized":"2023-10-14T18:49:00.673965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684107+0000","last_change":"2023-10-14T18:48:59.661798+0000","last_active":"2023-10-14T18:49:00.684107+0000","last_peered":"2023-10-14T18:49:00.684107+0000","last_clean":"2023-10-14T18:49:00.684107+0000","last_became_active":"2023-10-14T18:48:59.661263+0000","last_became_peered":"2023-10-14T18:48:59.661263+0000","last_unstale":"2023-10-14T18:49:00.684107+0000","last_undegraded":"2023-10-14T18:49:00.684107+0000","last_fullsized":"2023-10-14T18:49:00.684107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:34.310881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668725+0000","last_change":"2023-10-14T18:49:00.668683+0000","last_active":"2023-10-14T18:49:00.668725+0000","last_peered":"2023-10-14T18:49:00.668725+0000","last_clean":"2023-10-14T18:49:00.668725+0000","last_became_active":"2023-10-14T18:49:00.668410+0000","last_became_peered":"2023-10-14T18:49:00.668410+0000","last_unstale":"2023-10-14T18:49:00.668725+0000","last_undegraded":"2023-10-14T18:49:00.668725+0000","last_fullsized":"2023-10-14T18:49:00.668725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:38:34.412606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683368+0000","last_change":"2023-10-14T18:48:59.660385+0000","last_active":"2023-10-14T18:49:00.683368+0000","last_peered":"2023-10-14T18:49:00.683368+0000","last_clean":"2023-10-14T18:49:00.683368+0000","last_became_active":"2023-10-14T18:48:59.660064+0000","last_became_peered":"2023-10-14T18:48:59.660064+0000","last_unstale":"2023-10-14T18:49:00.683368+0000","last_undegraded":"2023-10-14T18:49:00.683368+0000","last_fullsized":"2023-10-14T18:49:00.683368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:22.446468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670863+0000","last_change":"2023-10-14T18:49:00.670790+0000","last_active":"2023-10-14T18:49:00.670863+0000","last_peered":"2023-10-14T18:49:00.670863+0000","last_clean":"2023-10-14T18:49:00.670863+0000","last_became_active":"2023-10-14T18:49:00.669886+0000","last_became_peered":"2023-10-14T18:49:00.669886+0000","last_unstale":"2023-10-14T18:49:00.670863+0000","last_undegraded":"2023-10-14T18:49:00.670863+0000","last_fullsized":"2023-10-14T18:49:00.670863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:29.684802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684455+0000","last_change":"2023-10-14T18:48:59.663334+0000","last_active":"2023-10-14T18:49:00.684455+0000","last_peered":"2023-10-14T18:49:00.684455+0000","last_clean":"2023-10-14T18:49:00.684455+0000","last_became_active":"2023-10-14T18:48:59.662923+0000","last_became_peered":"2023-10-14T18:48:59.662923+0000","last_unstale":"2023-10-14T18:49:00.684455+0000","last_undegraded":"2023-10-14T18:49:00.684455+0000","last_fullsized":"2023-10-14T18:49:00.684455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:36.693936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663597+0000","last_change":"2023-10-14T18:49:00.663289+0000","last_active":"2023-10-14T18:49:00.663597+0000","last_peered":"2023-10-14T18:49:00.663597+0000","last_clean":"2023-10-14T18:49:00.663597+0000","last_became_active":"2023-10-14T18:49:00.663074+0000","last_became_peered":"2023-10-14T18:49:00.663074+0000","last_unstale":"2023-10-14T18:49:00.663597+0000","last_undegraded":"2023-10-14T18:49:00.663597+0000","last_fullsized":"2023-10-14T18:49:00.663597+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.246960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683163+0000","last_change":"2023-10-14T18:48:59.661372+0000","last_active":"2023-10-14T18:49:00.683163+0000","last_peered":"2023-10-14T18:49:00.683163+0000","last_clean":"2023-10-14T18:49:00.683163+0000","last_became_active":"2023-10-14T18:48:59.658737+0000","last_became_peered":"2023-10-14T18:48:59.658737+0000","last_unstale":"2023-10-14T18:49:00.683163+0000","last_undegraded":"2023-10-14T18:49:00.683163+0000","last_fullsized":"2023-10-14T18:49:00.683163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:09:15.378785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.670907+0000","last_change":"2023-10-14T18:49:00.670480+0000","last_active":"2023-10-14T18:49:00.670907+0000","last_peered":"2023-10-14T18:49:00.670907+0000","last_clean":"2023-10-14T18:49:00.670907+0000","last_became_active":"2023-10-14T18:49:00.670185+0000","last_became_peered":"2023-10-14T18:49:00.670185+0000","last_unstale":"2023-10-14T18:49:00.670907+0000","last_undegraded":"2023-10-14T18:49:00.670907+0000","last_fullsized":"2023-10-14T18:49:00.670907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:32:20.246960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684298+0000","last_change":"2023-10-14T18:48:59.657763+0000","last_active":"2023-10-14T18:49:00.684298+0000","last_peered":"2023-10-14T18:49:00.684298+0000","last_clean":"2023-10-14T18:49:00.684298+0000","last_became_active":"2023-10-14T18:48:59.657556+0000","last_became_peered":"2023-10-14T18:48:59.657556+0000","last_unstale":"2023-10-14T18:49:00.684298+0000","last_undegraded":"2023-10-14T18:49:00.684298+0000","last_fullsized":"2023-10-14T18:49:00.684298+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:25.562600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668648+0000","last_change":"2023-10-14T18:49:00.668118+0000","last_active":"2023-10-14T18:49:00.668648+0000","last_peered":"2023-10-14T18:49:00.668648+0000","last_clean":"2023-10-14T18:49:00.668648+0000","last_became_active":"2023-10-14T18:49:00.667399+0000","last_became_peered":"2023-10-14T18:49:00.667399+0000","last_unstale":"2023-10-14T18:49:00.668648+0000","last_undegraded":"2023-10-14T18:49:00.668648+0000","last_fullsized":"2023-10-14T18:49:00.668648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:04.947838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683988+0000","last_change":"2023-10-14T18:48:59.660792+0000","last_active":"2023-10-14T18:49:00.683988+0000","last_peered":"2023-10-14T18:49:00.683988+0000","last_clean":"2023-10-14T18:49:00.683988+0000","last_became_active":"2023-10-14T18:48:59.660557+0000","last_became_peered":"2023-10-14T18:48:59.660557+0000","last_unstale":"2023-10-14T18:49:00.683988+0000","last_undegraded":"2023-10-14T18:49:00.683988+0000","last_fullsized":"2023-10-14T18:49:00.683988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:49.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672681+0000","last_change":"2023-10-14T18:49:00.672634+0000","last_active":"2023-10-14T18:49:00.672681+0000","last_peered":"2023-10-14T18:49:00.672681+0000","last_clean":"2023-10-14T18:49:00.672681+0000","last_became_active":"2023-10-14T18:49:00.672445+0000","last_became_peered":"2023-10-14T18:49:00.672445+0000","last_unstale":"2023-10-14T18:49:00.672681+0000","last_undegraded":"2023-10-14T18:49:00.672681+0000","last_fullsized":"2023-10-14T18:49:00.672681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:44:51.611939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664301+0000","last_change":"2023-10-14T18:48:59.656556+0000","last_active":"2023-10-14T18:49:00.664301+0000","last_peered":"2023-10-14T18:49:00.664301+0000","last_clean":"2023-10-14T18:49:00.664301+0000","last_became_active":"2023-10-14T18:48:59.656332+0000","last_became_peered":"2023-10-14T18:48:59.656332+0000","last_unstale":"2023-10-14T18:49:00.664301+0000","last_undegraded":"2023-10-14T18:49:00.664301+0000","last_fullsized":"2023-10-14T18:49:00.664301+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:16:11.301635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663066+0000","last_change":"2023-10-14T18:49:00.663007+0000","last_active":"2023-10-14T18:49:00.663066+0000","last_peered":"2023-10-14T18:49:00.663066+0000","last_clean":"2023-10-14T18:49:00.663066+0000","last_became_active":"2023-10-14T18:49:00.662794+0000","last_became_peered":"2023-10-14T18:49:00.662794+0000","last_unstale":"2023-10-14T18:49:00.663066+0000","last_undegraded":"2023-10-14T18:49:00.663066+0000","last_fullsized":"2023-10-14T18:49:00.663066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663628+0000","last_change":"2023-10-14T18:48:59.655886+0000","last_active":"2023-10-14T18:49:00.663628+0000","last_peered":"2023-10-14T18:49:00.663628+0000","last_clean":"2023-10-14T18:49:00.663628+0000","last_became_active":"2023-10-14T18:48:59.655625+0000","last_became_peered":"2023-10-14T18:48:59.655625+0000","last_unstale":"2023-10-14T18:49:00.663628+0000","last_undegraded":"2023-10-14T18:49:00.663628+0000","last_fullsized":"2023-10-14T18:49:00.663628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:49.975968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673772+0000","last_change":"2023-10-14T18:49:00.673717+0000","last_active":"2023-10-14T18:49:00.673772+0000","last_peered":"2023-10-14T18:49:00.673772+0000","last_clean":"2023-10-14T18:49:00.673772+0000","last_became_active":"2023-10-14T18:49:00.673197+0000","last_became_peered":"2023-10-14T18:49:00.673197+0000","last_unstale":"2023-10-14T18:49:00.673772+0000","last_undegraded":"2023-10-14T18:49:00.673772+0000","last_fullsized":"2023-10-14T18:49:00.673772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663891+0000","last_change":"2023-10-14T18:48:59.657710+0000","last_active":"2023-10-14T18:49:00.663891+0000","last_peered":"2023-10-14T18:49:00.663891+0000","last_clean":"2023-10-14T18:49:00.663891+0000","last_became_active":"2023-10-14T18:48:59.657481+0000","last_became_peered":"2023-10-14T18:48:59.657481+0000","last_unstale":"2023-10-14T18:49:00.663891+0000","last_undegraded":"2023-10-14T18:49:00.663891+0000","last_fullsized":"2023-10-14T18:49:00.663891+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:01:25.740867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673999+0000","last_change":"2023-10-14T18:49:00.673252+0000","last_active":"2023-10-14T18:49:00.673999+0000","last_peered":"2023-10-14T18:49:00.673999+0000","last_clean":"2023-10-14T18:49:00.673999+0000","last_became_active":"2023-10-14T18:49:00.672933+0000","last_became_peered":"2023-10-14T18:49:00.672933+0000","last_unstale":"2023-10-14T18:49:00.673999+0000","last_undegraded":"2023-10-14T18:49:00.673999+0000","last_fullsized":"2023-10-14T18:49:00.673999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:11.661727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664794+0000","last_change":"2023-10-14T18:48:59.661722+0000","last_active":"2023-10-14T18:49:00.664794+0000","last_peered":"2023-10-14T18:49:00.664794+0000","last_clean":"2023-10-14T18:49:00.664794+0000","last_became_active":"2023-10-14T18:48:59.661446+0000","last_became_peered":"2023-10-14T18:48:59.661446+0000","last_unstale":"2023-10-14T18:49:00.664794+0000","last_undegraded":"2023-10-14T18:49:00.664794+0000","last_fullsized":"2023-10-14T18:49:00.664794+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:46.932996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675046+0000","last_change":"2023-10-14T18:49:00.674523+0000","last_active":"2023-10-14T18:49:00.675046+0000","last_peered":"2023-10-14T18:49:00.675046+0000","last_clean":"2023-10-14T18:49:00.675046+0000","last_became_active":"2023-10-14T18:49:00.673643+0000","last_became_peered":"2023-10-14T18:49:00.673643+0000","last_unstale":"2023-10-14T18:49:00.675046+0000","last_undegraded":"2023-10-14T18:49:00.675046+0000","last_fullsized":"2023-10-14T18:49:00.675046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:04.947838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682972+0000","last_change":"2023-10-14T18:48:59.659707+0000","last_active":"2023-10-14T18:49:00.682972+0000","last_peered":"2023-10-14T18:49:00.682972+0000","last_clean":"2023-10-14T18:49:00.682972+0000","last_became_active":"2023-10-14T18:48:59.659490+0000","last_became_peered":"2023-10-14T18:48:59.659490+0000","last_unstale":"2023-10-14T18:49:00.682972+0000","last_undegraded":"2023-10-14T18:49:00.682972+0000","last_fullsized":"2023-10-14T18:49:00.682972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:07:11.870691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668649+0000","last_change":"2023-10-14T18:49:00.668594+0000","last_active":"2023-10-14T18:49:00.668649+0000","last_peered":"2023-10-14T18:49:00.668649+0000","last_clean":"2023-10-14T18:49:00.668649+0000","last_became_active":"2023-10-14T18:49:00.668066+0000","last_became_peered":"2023-10-14T18:49:00.668066+0000","last_unstale":"2023-10-14T18:49:00.668649+0000","last_undegraded":"2023-10-14T18:49:00.668649+0000","last_fullsized":"2023-10-14T18:49:00.668649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:38.215924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.685123+0000","last_change":"2023-10-14T18:48:59.660756+0000","last_active":"2023-10-14T18:49:00.685123+0000","last_peered":"2023-10-14T18:49:00.685123+0000","last_clean":"2023-10-14T18:49:00.685123+0000","last_became_active":"2023-10-14T18:48:59.660608+0000","last_became_peered":"2023-10-14T18:48:59.660608+0000","last_unstale":"2023-10-14T18:49:00.685123+0000","last_undegraded":"2023-10-14T18:49:00.685123+0000","last_fullsized":"2023-10-14T18:49:00.685123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:51.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669386+0000","last_change":"2023-10-14T18:49:00.669285+0000","last_active":"2023-10-14T18:49:00.669386+0000","last_peered":"2023-10-14T18:49:00.669386+0000","last_clean":"2023-10-14T18:49:00.669386+0000","last_became_active":"2023-10-14T18:49:00.668934+0000","last_became_peered":"2023-10-14T18:49:00.668934+0000","last_unstale":"2023-10-14T18:49:00.669386+0000","last_undegraded":"2023-10-14T18:49:00.669386+0000","last_fullsized":"2023-10-14T18:49:00.669386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:02.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683827+0000","last_change":"2023-10-14T18:48:59.660437+0000","last_active":"2023-10-14T18:49:00.683827+0000","last_peered":"2023-10-14T18:49:00.683827+0000","last_clean":"2023-10-14T18:49:00.683827+0000","last_became_active":"2023-10-14T18:48:59.660208+0000","last_became_peered":"2023-10-14T18:48:59.660208+0000","last_unstale":"2023-10-14T18:49:00.683827+0000","last_undegraded":"2023-10-14T18:49:00.683827+0000","last_fullsized":"2023-10-14T18:49:00.683827+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:53:49.275463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672788+0000","last_change":"2023-10-14T18:49:00.672721+0000","last_active":"2023-10-14T18:49:00.672788+0000","last_peered":"2023-10-14T18:49:00.672788+0000","last_clean":"2023-10-14T18:49:00.672788+0000","last_became_active":"2023-10-14T18:49:00.672468+0000","last_became_peered":"2023-10-14T18:49:00.672468+0000","last_unstale":"2023-10-14T18:49:00.672788+0000","last_undegraded":"2023-10-14T18:49:00.672788+0000","last_fullsized":"2023-10-14T18:49:00.672788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:26.567047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666436+0000","last_change":"2023-10-14T18:48:59.662397+0000","last_active":"2023-10-14T18:49:00.666436+0000","last_peered":"2023-10-14T18:49:00.666436+0000","last_clean":"2023-10-14T18:49:00.666436+0000","last_became_active":"2023-10-14T18:48:59.661599+0000","last_became_peered":"2023-10-14T18:48:59.661599+0000","last_unstale":"2023-10-14T18:49:00.666436+0000","last_undegraded":"2023-10-14T18:49:00.666436+0000","last_fullsized":"2023-10-14T18:49:00.666436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:51.611413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672178+0000","last_change":"2023-10-14T18:49:00.671980+0000","last_active":"2023-10-14T18:49:00.672178+0000","last_peered":"2023-10-14T18:49:00.672178+0000","last_clean":"2023-10-14T18:49:00.672178+0000","last_became_active":"2023-10-14T18:49:00.671444+0000","last_became_peered":"2023-10-14T18:49:00.671444+0000","last_unstale":"2023-10-14T18:49:00.672178+0000","last_undegraded":"2023-10-14T18:49:00.672178+0000","last_fullsized":"2023-10-14T18:49:00.672178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:02.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669100+0000","last_change":"2023-10-14T18:48:59.659388+0000","last_active":"2023-10-14T18:49:00.669100+0000","last_peered":"2023-10-14T18:49:00.669100+0000","last_clean":"2023-10-14T18:49:00.669100+0000","last_became_active":"2023-10-14T18:48:59.658780+0000","last_became_peered":"2023-10-14T18:48:59.658780+0000","last_unstale":"2023-10-14T18:49:00.669100+0000","last_undegraded":"2023-10-14T18:49:00.669100+0000","last_fullsized":"2023-10-14T18:49:00.669100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:18:19.485248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667297+0000","last_change":"2023-10-14T18:49:00.667157+0000","last_active":"2023-10-14T18:49:00.667297+0000","last_peered":"2023-10-14T18:49:00.667297+0000","last_clean":"2023-10-14T18:49:00.667297+0000","last_became_active":"2023-10-14T18:49:00.666516+0000","last_became_peered":"2023-10-14T18:49:00.666516+0000","last_unstale":"2023-10-14T18:49:00.667297+0000","last_undegraded":"2023-10-14T18:49:00.667297+0000","last_fullsized":"2023-10-14T18:49:00.667297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:00.791343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.685064+0000","last_change":"2023-10-14T18:48:59.661068+0000","last_active":"2023-10-14T18:49:00.685064+0000","last_peered":"2023-10-14T18:49:00.685064+0000","last_clean":"2023-10-14T18:49:00.685064+0000","last_became_active":"2023-10-14T18:48:59.660469+0000","last_became_peered":"2023-10-14T18:48:59.660469+0000","last_unstale":"2023-10-14T18:49:00.685064+0000","last_undegraded":"2023-10-14T18:49:00.685064+0000","last_fullsized":"2023-10-14T18:49:00.685064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:36.856337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668632+0000","last_change":"2023-10-14T18:49:00.668071+0000","last_active":"2023-10-14T18:49:00.668632+0000","last_peered":"2023-10-14T18:49:00.668632+0000","last_clean":"2023-10-14T18:49:00.668632+0000","last_became_active":"2023-10-14T18:49:00.666883+0000","last_became_peered":"2023-10-14T18:49:00.666883+0000","last_unstale":"2023-10-14T18:49:00.668632+0000","last_undegraded":"2023-10-14T18:49:00.668632+0000","last_fullsized":"2023-10-14T18:49:00.668632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:24.940753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682768+0000","last_change":"2023-10-14T18:48:59.662786+0000","last_active":"2023-10-14T18:49:00.682768+0000","last_peered":"2023-10-14T18:49:00.682768+0000","last_clean":"2023-10-14T18:49:00.682768+0000","last_became_active":"2023-10-14T18:48:59.662248+0000","last_became_peered":"2023-10-14T18:48:59.662248+0000","last_unstale":"2023-10-14T18:49:00.682768+0000","last_undegraded":"2023-10-14T18:49:00.682768+0000","last_fullsized":"2023-10-14T18:49:00.682768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:04.004495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666822+0000","last_change":"2023-10-14T18:49:00.666714+0000","last_active":"2023-10-14T18:49:00.666822+0000","last_peered":"2023-10-14T18:49:00.666822+0000","last_clean":"2023-10-14T18:49:00.666822+0000","last_became_active":"2023-10-14T18:49:00.666358+0000","last_became_peered":"2023-10-14T18:49:00.666358+0000","last_unstale":"2023-10-14T18:49:00.666822+0000","last_undegraded":"2023-10-14T18:49:00.666822+0000","last_fullsized":"2023-10-14T18:49:00.666822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:21.708701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684593+0000","last_change":"2023-10-14T18:48:59.663214+0000","last_active":"2023-10-14T18:49:00.684593+0000","last_peered":"2023-10-14T18:49:00.684593+0000","last_clean":"2023-10-14T18:49:00.684593+0000","last_became_active":"2023-10-14T18:48:59.662562+0000","last_became_peered":"2023-10-14T18:48:59.662562+0000","last_unstale":"2023-10-14T18:49:00.684593+0000","last_undegraded":"2023-10-14T18:49:00.684593+0000","last_fullsized":"2023-10-14T18:49:00.684593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:22.611043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.669857+0000","last_change":"2023-10-14T18:49:00.669467+0000","last_active":"2023-10-14T18:49:00.669857+0000","last_peered":"2023-10-14T18:49:00.669857+0000","last_clean":"2023-10-14T18:49:00.669857+0000","last_became_active":"2023-10-14T18:49:00.668827+0000","last_became_peered":"2023-10-14T18:49:00.668827+0000","last_unstale":"2023-10-14T18:49:00.669857+0000","last_undegraded":"2023-10-14T18:49:00.669857+0000","last_fullsized":"2023-10-14T18:49:00.669857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:51:40.552180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.684179+0000","last_change":"2023-10-14T18:48:59.662803+0000","last_active":"2023-10-14T18:49:00.684179+0000","last_peered":"2023-10-14T18:49:00.684179+0000","last_clean":"2023-10-14T18:49:00.684179+0000","last_became_active":"2023-10-14T18:48:59.662119+0000","last_became_peered":"2023-10-14T18:48:59.662119+0000","last_unstale":"2023-10-14T18:49:00.684179+0000","last_undegraded":"2023-10-14T18:49:00.684179+0000","last_fullsized":"2023-10-14T18:49:00.684179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:25:56.949836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.671416+0000","last_change":"2023-10-14T18:49:00.671338+0000","last_active":"2023-10-14T18:49:00.671416+0000","last_peered":"2023-10-14T18:49:00.671416+0000","last_clean":"2023-10-14T18:49:00.671416+0000","last_became_active":"2023-10-14T18:49:00.671112+0000","last_became_peered":"2023-10-14T18:49:00.671112+0000","last_unstale":"2023-10-14T18:49:00.671416+0000","last_undegraded":"2023-10-14T18:49:00.671416+0000","last_fullsized":"2023-10-14T18:49:00.671416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:12.836668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660313+0000","last_change":"2023-10-14T18:48:59.660580+0000","last_active":"2023-10-14T18:49:00.660313+0000","last_peered":"2023-10-14T18:49:00.660313+0000","last_clean":"2023-10-14T18:49:00.660313+0000","last_became_active":"2023-10-14T18:48:59.660350+0000","last_became_peered":"2023-10-14T18:48:59.660350+0000","last_unstale":"2023-10-14T18:49:00.660313+0000","last_undegraded":"2023-10-14T18:49:00.660313+0000","last_fullsized":"2023-10-14T18:49:00.660313+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:21:03.943391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667324+0000","last_change":"2023-10-14T18:49:00.666751+0000","last_active":"2023-10-14T18:49:00.667324+0000","last_peered":"2023-10-14T18:49:00.667324+0000","last_clean":"2023-10-14T18:49:00.667324+0000","last_became_active":"2023-10-14T18:49:00.666531+0000","last_became_peered":"2023-10-14T18:49:00.666531+0000","last_unstale":"2023-10-14T18:49:00.667324+0000","last_undegraded":"2023-10-14T18:49:00.667324+0000","last_fullsized":"2023-10-14T18:49:00.667324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:49.987417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666951+0000","last_change":"2023-10-14T18:48:59.662460+0000","last_active":"2023-10-14T18:49:00.666951+0000","last_peered":"2023-10-14T18:49:00.666951+0000","last_clean":"2023-10-14T18:49:00.666951+0000","last_became_active":"2023-10-14T18:48:59.660350+0000","last_became_peered":"2023-10-14T18:48:59.660350+0000","last_unstale":"2023-10-14T18:49:00.666951+0000","last_undegraded":"2023-10-14T18:49:00.666951+0000","last_fullsized":"2023-10-14T18:49:00.666951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:16:11.301635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672355+0000","last_change":"2023-10-14T18:49:00.672290+0000","last_active":"2023-10-14T18:49:00.672355+0000","last_peered":"2023-10-14T18:49:00.672355+0000","last_clean":"2023-10-14T18:49:00.672355+0000","last_became_active":"2023-10-14T18:49:00.672088+0000","last_became_peered":"2023-10-14T18:49:00.672088+0000","last_unstale":"2023-10-14T18:49:00.672355+0000","last_undegraded":"2023-10-14T18:49:00.672355+0000","last_fullsized":"2023-10-14T18:49:00.672355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:11.661727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665573+0000","last_change":"2023-10-14T18:48:59.659833+0000","last_active":"2023-10-14T18:49:00.665573+0000","last_peered":"2023-10-14T18:49:00.665573+0000","last_clean":"2023-10-14T18:49:00.665573+0000","last_became_active":"2023-10-14T18:48:59.659611+0000","last_became_peered":"2023-10-14T18:48:59.659611+0000","last_unstale":"2023-10-14T18:49:00.665573+0000","last_undegraded":"2023-10-14T18:49:00.665573+0000","last_fullsized":"2023-10-14T18:49:00.665573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:28.680355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665429+0000","last_change":"2023-10-14T18:49:00.664806+0000","last_active":"2023-10-14T18:49:00.665429+0000","last_peered":"2023-10-14T18:49:00.665429+0000","last_clean":"2023-10-14T18:49:00.665429+0000","last_became_active":"2023-10-14T18:49:00.664596+0000","last_became_peered":"2023-10-14T18:49:00.664596+0000","last_unstale":"2023-10-14T18:49:00.665429+0000","last_undegraded":"2023-10-14T18:49:00.665429+0000","last_fullsized":"2023-10-14T18:49:00.665429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:15.695573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660356+0000","last_change":"2023-10-14T18:48:59.655013+0000","last_active":"2023-10-14T18:49:00.660356+0000","last_peered":"2023-10-14T18:49:00.660356+0000","last_clean":"2023-10-14T18:49:00.660356+0000","last_became_active":"2023-10-14T18:48:59.654784+0000","last_became_peered":"2023-10-14T18:48:59.654784+0000","last_unstale":"2023-10-14T18:49:00.660356+0000","last_undegraded":"2023-10-14T18:49:00.660356+0000","last_fullsized":"2023-10-14T18:49:00.660356+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:09:20.199318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668873+0000","last_change":"2023-10-14T18:49:00.668802+0000","last_active":"2023-10-14T18:49:00.668873+0000","last_peered":"2023-10-14T18:49:00.668873+0000","last_clean":"2023-10-14T18:49:00.668873+0000","last_became_active":"2023-10-14T18:49:00.668566+0000","last_became_peered":"2023-10-14T18:49:00.668566+0000","last_unstale":"2023-10-14T18:49:00.668873+0000","last_undegraded":"2023-10-14T18:49:00.668873+0000","last_fullsized":"2023-10-14T18:49:00.668873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:40:40.802201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.682296+0000","last_change":"2023-10-14T18:48:59.658881+0000","last_active":"2023-10-14T18:49:00.682296+0000","last_peered":"2023-10-14T18:49:00.682296+0000","last_clean":"2023-10-14T18:49:00.682296+0000","last_became_active":"2023-10-14T18:48:59.658413+0000","last_became_peered":"2023-10-14T18:48:59.658413+0000","last_unstale":"2023-10-14T18:49:00.682296+0000","last_undegraded":"2023-10-14T18:49:00.682296+0000","last_fullsized":"2023-10-14T18:49:00.682296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:58.017318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673483+0000","last_change":"2023-10-14T18:49:00.673420+0000","last_active":"2023-10-14T18:49:00.673483+0000","last_peered":"2023-10-14T18:49:00.673483+0000","last_clean":"2023-10-14T18:49:00.673483+0000","last_became_active":"2023-10-14T18:49:00.672558+0000","last_became_peered":"2023-10-14T18:49:00.672558+0000","last_unstale":"2023-10-14T18:49:00.673483+0000","last_undegraded":"2023-10-14T18:49:00.673483+0000","last_fullsized":"2023-10-14T18:49:00.673483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:56:22.827021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665434+0000","last_change":"2023-10-14T18:48:59.660863+0000","last_active":"2023-10-14T18:49:00.665434+0000","last_peered":"2023-10-14T18:49:00.665434+0000","last_clean":"2023-10-14T18:49:00.665434+0000","last_became_active":"2023-10-14T18:48:59.660537+0000","last_became_peered":"2023-10-14T18:48:59.660537+0000","last_unstale":"2023-10-14T18:49:00.665434+0000","last_undegraded":"2023-10-14T18:49:00.665434+0000","last_fullsized":"2023-10-14T18:49:00.665434+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:55.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.665412+0000","last_change":"2023-10-14T18:49:00.665290+0000","last_active":"2023-10-14T18:49:00.665412+0000","last_peered":"2023-10-14T18:49:00.665412+0000","last_clean":"2023-10-14T18:49:00.665412+0000","last_became_active":"2023-10-14T18:49:00.664969+0000","last_became_peered":"2023-10-14T18:49:00.664969+0000","last_unstale":"2023-10-14T18:49:00.665412+0000","last_undegraded":"2023-10-14T18:49:00.665412+0000","last_fullsized":"2023-10-14T18:49:00.665412+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:43.507077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.664997+0000","last_change":"2023-10-14T18:48:59.659643+0000","last_active":"2023-10-14T18:49:00.664997+0000","last_peered":"2023-10-14T18:49:00.664997+0000","last_clean":"2023-10-14T18:49:00.664997+0000","last_became_active":"2023-10-14T18:48:59.659397+0000","last_became_peered":"2023-10-14T18:48:59.659397+0000","last_unstale":"2023-10-14T18:49:00.664997+0000","last_undegraded":"2023-10-14T18:49:00.664997+0000","last_fullsized":"2023-10-14T18:49:00.664997+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:09.725554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.666805+0000","last_change":"2023-10-14T18:49:00.666580+0000","last_active":"2023-10-14T18:49:00.666805+0000","last_peered":"2023-10-14T18:49:00.666805+0000","last_clean":"2023-10-14T18:49:00.666805+0000","last_became_active":"2023-10-14T18:49:00.665946+0000","last_became_peered":"2023-10-14T18:49:00.665946+0000","last_unstale":"2023-10-14T18:49:00.666805+0000","last_undegraded":"2023-10-14T18:49:00.666805+0000","last_fullsized":"2023-10-14T18:49:00.666805+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:00.231369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.660540+0000","last_change":"2023-10-14T18:48:59.662201+0000","last_active":"2023-10-14T18:49:00.660540+0000","last_peered":"2023-10-14T18:49:00.660540+0000","last_clean":"2023-10-14T18:49:00.660540+0000","last_became_active":"2023-10-14T18:48:59.662014+0000","last_became_peered":"2023-10-14T18:48:59.662014+0000","last_unstale":"2023-10-14T18:49:00.660540+0000","last_undegraded":"2023-10-14T18:49:00.660540+0000","last_fullsized":"2023-10-14T18:49:00.660540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:30:13.562087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667470+0000","last_change":"2023-10-14T18:49:00.667411+0000","last_active":"2023-10-14T18:49:00.667470+0000","last_peered":"2023-10-14T18:49:00.667470+0000","last_clean":"2023-10-14T18:49:00.667470+0000","last_became_active":"2023-10-14T18:49:00.666938+0000","last_became_peered":"2023-10-14T18:49:00.666938+0000","last_unstale":"2023-10-14T18:49:00.667470+0000","last_undegraded":"2023-10-14T18:49:00.667470+0000","last_fullsized":"2023-10-14T18:49:00.667470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:14.011336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663545+0000","last_change":"2023-10-14T18:48:59.659067+0000","last_active":"2023-10-14T18:49:00.663545+0000","last_peered":"2023-10-14T18:49:00.663545+0000","last_clean":"2023-10-14T18:49:00.663545+0000","last_became_active":"2023-10-14T18:48:59.658613+0000","last_became_peered":"2023-10-14T18:48:59.658613+0000","last_unstale":"2023-10-14T18:49:00.663545+0000","last_undegraded":"2023-10-14T18:49:00.663545+0000","last_fullsized":"2023-10-14T18:49:00.663545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:38:07.324055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.673919+0000","last_change":"2023-10-14T18:49:00.673858+0000","last_active":"2023-10-14T18:49:00.673919+0000","last_peered":"2023-10-14T18:49:00.673919+0000","last_clean":"2023-10-14T18:49:00.673919+0000","last_became_active":"2023-10-14T18:49:00.673021+0000","last_became_peered":"2023-10-14T18:49:00.673021+0000","last_unstale":"2023-10-14T18:49:00.673919+0000","last_undegraded":"2023-10-14T18:49:00.673919+0000","last_fullsized":"2023-10-14T18:49:00.673919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:09.948505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.662798+0000","last_change":"2023-10-14T18:48:59.657666+0000","last_active":"2023-10-14T18:49:00.662798+0000","last_peered":"2023-10-14T18:49:00.662798+0000","last_clean":"2023-10-14T18:49:00.662798+0000","last_became_active":"2023-10-14T18:48:59.657058+0000","last_became_peered":"2023-10-14T18:48:59.657058+0000","last_unstale":"2023-10-14T18:49:00.662798+0000","last_undegraded":"2023-10-14T18:49:00.662798+0000","last_fullsized":"2023-10-14T18:49:00.662798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:04.004495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.668501+0000","last_change":"2023-10-14T18:49:00.668435+0000","last_active":"2023-10-14T18:49:00.668501+0000","last_peered":"2023-10-14T18:49:00.668501+0000","last_clean":"2023-10-14T18:49:00.668501+0000","last_became_active":"2023-10-14T18:49:00.668259+0000","last_became_peered":"2023-10-14T18:49:00.668259+0000","last_unstale":"2023-10-14T18:49:00.668501+0000","last_undegraded":"2023-10-14T18:49:00.668501+0000","last_fullsized":"2023-10-14T18:49:00.668501+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:37.860784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.663413+0000","last_change":"2023-10-14T18:48:59.660921+0000","last_active":"2023-10-14T18:49:00.663413+0000","last_peered":"2023-10-14T18:49:00.663413+0000","last_clean":"2023-10-14T18:49:00.663413+0000","last_became_active":"2023-10-14T18:48:59.660163+0000","last_became_peered":"2023-10-14T18:48:59.660163+0000","last_unstale":"2023-10-14T18:49:00.663413+0000","last_undegraded":"2023-10-14T18:49:00.663413+0000","last_fullsized":"2023-10-14T18:49:00.663413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:05.121552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.675781+0000","last_change":"2023-10-14T18:49:00.675725+0000","last_active":"2023-10-14T18:49:00.675781+0000","last_peered":"2023-10-14T18:49:00.675781+0000","last_clean":"2023-10-14T18:49:00.675781+0000","last_became_active":"2023-10-14T18:49:00.675326+0000","last_became_peered":"2023-10-14T18:49:00.675326+0000","last_unstale":"2023-10-14T18:49:00.675781+0000","last_undegraded":"2023-10-14T18:49:00.675781+0000","last_fullsized":"2023-10-14T18:49:00.675781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:45:56.757517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.667041+0000","last_change":"2023-10-14T18:48:59.662611+0000","last_active":"2023-10-14T18:49:00.667041+0000","last_peered":"2023-10-14T18:49:00.667041+0000","last_clean":"2023-10-14T18:49:00.667041+0000","last_became_active":"2023-10-14T18:48:59.660667+0000","last_became_peered":"2023-10-14T18:48:59.660667+0000","last_unstale":"2023-10-14T18:49:00.667041+0000","last_undegraded":"2023-10-14T18:49:00.667041+0000","last_fullsized":"2023-10-14T18:49:00.667041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:36:48.266994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.672093+0000","last_change":"2023-10-14T18:49:00.672026+0000","last_active":"2023-10-14T18:49:00.672093+0000","last_peered":"2023-10-14T18:49:00.672093+0000","last_clean":"2023-10-14T18:49:00.672093+0000","last_became_active":"2023-10-14T18:49:00.671784+0000","last_became_peered":"2023-10-14T18:49:00.671784+0000","last_unstale":"2023-10-14T18:49:00.672093+0000","last_undegraded":"2023-10-14T18:49:00.672093+0000","last_fullsized":"2023-10-14T18:49:00.672093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:59.645660+0000","last_clean_scrub_stamp":"2023-10-14T18:48:59.645660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:55:47.006049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.683119+0000","last_change":"2023-10-14T18:48:59.655793+0000","last_active":"2023-10-14T18:49:00.683119+0000","last_peered":"2023-10-14T18:49:00.683119+0000","last_clean":"2023-10-14T18:49:00.683119+0000","last_became_active":"2023-10-14T18:48:59.655559+0000","last_became_peered":"2023-10-14T18:48:59.655559+0000","last_unstale":"2023-10-14T18:49:00.683119+0000","last_undegraded":"2023-10-14T18:49:00.683119+0000","last_fullsized":"2023-10-14T18:49:00.683119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:48:58.641213+0000","last_clean_scrub_stamp":"2023-10-14T18:48:58.641213+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:14:12.669739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":228,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T18:49:00.661586+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:49:00.661586+0000","last_peered":"2023-10-14T18:49:00.661586+0000","last_clean":"2023-10-14T18:49:00.661586+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:49:00.661586+0000","last_undegraded":"2023-10-14T18:49:00.661586+0000","last_fullsized":"2023-10-14T18:49:00.661586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959384,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68999999999999995,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.5}]},{"osd":1,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.61899999999999999,"15min":0.65800000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74199999999999999,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66200000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.78000000000000003,"15min":0.876},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.46600000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.377,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67600000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.379},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.78200000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.441,"15min":0.439},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63300000000000001,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.33400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50700000000000001,"15min":0.50800000000000001},"min":{"1min":0.35799999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73499999999999999,"5min":0.745,"15min":0.745},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.41299999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:48:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71699999999999997,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.63700000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.443},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.625,"15min":0.67300000000000004},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73799999999999999,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72199999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.80400000000000005,"15min":0.92900000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70399999999999996,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61799999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.441},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63600000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.34300000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.65000000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.37}]},{"osd":5,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68600000000000005,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68899999999999995,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46700000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:48:07 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67400000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.39500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71699999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":441,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194871,"statfs":{"total":200000000,"available":199548216,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.223,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55600000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"min":{"1min":0.245,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.45800000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34100000000000003},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52500000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57999999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.68999999999999995,"15min":0.81999999999999995},"min":{"1min":0.30099999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54800000000000004,"5min":10.574,"15min":10.574},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.374,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52700000000000002,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.374,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72299999999999998,"5min":1.125,"15min":1.125},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.50600000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74099999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.39800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58699999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76400000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59299999999999997,"15min":0.60199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.496}]},{"osd":7,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61399999999999999,"15min":0.62},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.33200000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.28499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.316}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58299999999999996},"min":{"1min":0.45300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73699999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.54200000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.42999999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89400000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65100000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59099999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":440,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194871,"statfs":{"total":200000000,"available":199548804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.249},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36199999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.52900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.61099999999999999,"5min":1.006,"15min":1.006},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.28799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.499}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81299999999999994,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57799999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86499999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550228,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49199999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"min":{"1min":0.249,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48099999999999998,"5min":0.5,"15min":0.5},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.376,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54800000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.378,"15min":0.375},"min":{"1min":0.30299999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53300000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.439},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.373,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51500000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76400000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.45200000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58699999999999997,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.60699999999999998},"min":{"1min":0.435,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.77900000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:48:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42699999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77000000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.47599999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81299999999999994,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550270,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.62},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.33000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.5}]},{"osd":1,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.503,"15min":0.499},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.755,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38}]},{"osd":6,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.496,"15min":0.504},"min":{"1min":0.312,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76800000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.443},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80400000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71899999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:48:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77400000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.872,"15min":0.872},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194873,"statfs":{"total":200000000,"available":199550250,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.625}]},{"osd":2,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.748},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60999999999999999,"5min":0.872,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.746,"15min":0.746},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70499999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38800000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495}]}]}],"pool_statfs":[]}} 2023-10-14T18:49:05.092 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:49:05.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:49:05.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.249+0000 7f9461635700 1 Processor -- start 2023-10-14T18:49:05.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.249+0000 7f9461635700 1 -- start start 2023-10-14T18:49:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9461635700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f945c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9461635700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f945c06aae0 0x7f945c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9461635700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0b0790 con 0x7f945c159ec0 2023-10-14T18:49:05.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9461635700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c06af60 con 0x7f945c06aae0 2023-10-14T18:49:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9461635700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0ce1f0 con 0x7f945c15a290 2023-10-14T18:49:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f945c159ec0 0x7f945c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45604/0 (socket says 172.21.15.79:45604) 2023-10-14T18:49:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945affd700 1 -- 172.21.15.79:0/1344958343 learned_addr learned my addr 172.21.15.79:0/1344958343 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:05.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225380748 0 0) 0x7f945c0b0790 con 0x7f945c159ec0 2023-10-14T18:49:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9448003570 con 0x7f945c159ec0 2023-10-14T18:49:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945b7fe700 1 --2- 172.21.15.79:0/1344958343 >> v2:172.21.15.144:3300/0 conn(0x7f945c06aae0 0x7f945c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f9453fff700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f945c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1919637779 0 0) 0x7f9448003570 con 0x7f945c159ec0 2023-10-14T18:49:05.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 msgr2=0x7f945c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f945c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 >> v2:172.21.15.144:3300/0 conn(0x7f945c06aae0 msgr2=0x7f945c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 --2- 172.21.15.79:0/1344958343 >> v2:172.21.15.144:3300/0 conn(0x7f945c06aae0 0x7f945c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0b0b20 con 0x7f945c159ec0 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f944c001470 con 0x7f945c159ec0 2023-10-14T18:49:05.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 >> v1:172.21.15.79:6789/0 conn(0x7f945c159ec0 legacy=0x7f945c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f9448004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9448004d50 0x7f94480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c06af60 con 0x7f9448004d50 2023-10-14T18:49:05.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0ce1f0 con 0x7f9448003a60 2023-10-14T18:49:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944800ba60 con 0x7f945c15a290 2023-10-14T18:49:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.250+0000 7f945b7fe700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9448004d50 0x7f94480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945affd700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f9453fff700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f9448004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 -- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 msgr2=0x7f9448004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c15a290 0x7f9448004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 -- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448003a60 msgr2=0x7f9448003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448003a60 0x7f9448003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 -- 172.21.15.79:0/1344958343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448003570 con 0x7f9448004d50 2023-10-14T18:49:05.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945b7fe700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9448004d50 0x7f94480051c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f945400e210 tx=0x7f945400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf76c903c1364ace server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400ea60 con 0x7f9448004d50 2023-10-14T18:49:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945400f040 con 0x7f9448004d50 2023-10-14T18:49:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.251+0000 7f945a7fc700 1 -- 172.21.15.79:0/1344958343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400ee10 con 0x7f9448004d50 2023-10-14T18:49:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 -- 172.21.15.79:0/1344958343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9448004d50 msgr2=0x7f94480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 --2- 172.21.15.79:0/1344958343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9448004d50 0x7f94480051c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f945400e210 tx=0x7f945400b040 comp rx=0 tx=0).stop 2023-10-14T18:49:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f945b7fe700 1 -- 172.21.15.79:0/1344958343 reap_dead start 2023-10-14T18:49:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 -- 172.21.15.79:0/1344958343 shutdown_connections 2023-10-14T18:49:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 -- 172.21.15.79:0/1344958343 >> 172.21.15.79:0/1344958343 conn(0x7f945c0d1880 msgr2=0x7f945c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 -- 172.21.15.79:0/1344958343 shutdown_connections 2023-10-14T18:49:05.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.252+0000 7f9461635700 1 -- 172.21.15.79:0/1344958343 wait complete. 2023-10-14T18:49:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.253+0000 7f9461635700 1 Processor -- start 2023-10-14T18:49:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.253+0000 7f9461635700 1 -- start start 2023-10-14T18:49:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448004d50 0x7f945c14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c0b5190 0x7f945c0a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c14ee60 con 0x7f945c0b3b50 2023-10-14T18:49:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b4d00 con 0x7f9448004d50 2023-10-14T18:49:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0b40f0 con 0x7f945c0b5190 2023-10-14T18:49:05.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37444/0 (socket says 172.21.15.79:37444) 2023-10-14T18:49:05.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 -- 172.21.15.79:0/3270485534 learned_addr learned my addr 172.21.15.79:0/3270485534 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:05.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f945affd700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448004d50 0x7f945c14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f945b7fe700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c0b5190 0x7f945c0a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 -- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c0b5190 msgr2=0x7f945c0a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c0b5190 0x7f945c0a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 -- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448004d50 msgr2=0x7f945c14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448004d50 0x7f945c14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 -- 172.21.15.79:0/3270485534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0b43d0 con 0x7f945c0b3b50 2023-10-14T18:49:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9453fff700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9444006ac0 tx=0x7f94440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400f8e0 con 0x7f945c0b3b50 2023-10-14T18:49:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400fa40 con 0x7f945c0b3b50 2023-10-14T18:49:05.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c0b46b0 con 0x7f945c0b3b50 2023-10-14T18:49:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400fdc0 con 0x7f945c0b3b50 2023-10-14T18:49:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.254+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c16aa40 con 0x7f945c0b3b50 2023-10-14T18:49:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.255+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c04c3c0 con 0x7f945c0b3b50 2023-10-14T18:49:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.256+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9444014650 con 0x7f945c0b3b50 2023-10-14T18:49:05.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.256+0000 7f9452ffd700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.256+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9444018030 con 0x7f945c0b3b50 2023-10-14T18:49:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.256+0000 7f945affd700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.256+0000 7f945affd700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f945c0cb550 tx=0x7f944c001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.260+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94440520d0 con 0x7f945c0b3b50 2023-10-14T18:49:05.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.514+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f945c0b4e40 con 0x7f945c0b3b50 2023-10-14T18:49:05.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.517+0000 7f9452ffd700 1 -- 172.21.15.79:0/3270485534 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f94440220e0 con 0x7f945c0b3b50 2023-10-14T18:49:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 msgr2=0x7f943c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 0x7f943c0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f945c0cb550 tx=0x7f944c001e90 comp rx=0 tx=0).stop 2023-10-14T18:49:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 msgr2=0x7f945c16a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9444006ac0 tx=0x7f94440091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 shutdown_connections 2023-10-14T18:49:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f943c066f30 0x7f943c0693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f945c0b5190 0x7f945c0a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9448004d50 0x7f945c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.519+0000 7f9461635700 1 --2- 172.21.15.79:0/3270485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f945c0b3b50 0x7f945c16a500 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.520+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 >> 172.21.15.79:0/3270485534 conn(0x7f945c0d1880 msgr2=0x7f945c0b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:05.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.520+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 shutdown_connections 2023-10-14T18:49:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.520+0000 7f9461635700 1 -- 172.21.15.79:0/3270485534 wait complete. 2023-10-14T18:49:05.523 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:49:05.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:05.642 INFO:tasks.ceph.mds.a.smithi079.stderr:2023-10-14T18:49:05.642+0000 7fe2c6a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:49:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.645+0000 7efd2ea4c700 1 Processor -- start 2023-10-14T18:49:05.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.645+0000 7efd2ea4c700 1 -- start start 2023-10-14T18:49:05.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2ea4c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd28156980 0x7efd280ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2ea4c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280ad5c0 con 0x7efd280cbf10 2023-10-14T18:49:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2ea4c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280ac9b0 con 0x7efd280cd420 2023-10-14T18:49:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2ea4c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd280acc90 con 0x7efd28156980 2023-10-14T18:49:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2e24b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efd280cbf10 0x7efd2806d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45614/0 (socket says 172.21.15.79:45614) 2023-10-14T18:49:05.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.646+0000 7efd2e24b700 1 -- 172.21.15.79:0/698192153 learned_addr learned my addr 172.21.15.79:0/698192153 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 --2- 172.21.15.79:0/698192153 >> v2:172.21.15.144:3300/0 conn(0x7efd28156980 0x7efd280ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453848091 0 0) 0x7efd280ad5c0 con 0x7efd280cbf10 2023-10-14T18:49:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd14003570 con 0x7efd280cbf10 2023-10-14T18:49:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596904387 0 0) 0x7efd14003570 con 0x7efd280cbf10 2023-10-14T18:49:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 >> v2:172.21.15.144:3300/0 conn(0x7efd28156980 msgr2=0x7efd280ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 --2- 172.21.15.79:0/698192153 >> v2:172.21.15.144:3300/0 conn(0x7efd28156980 0x7efd280ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 >> v1:172.21.15.144:6789/0 conn(0x7efd280cd420 legacy=0x7efd280cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280acf70 con 0x7efd280cbf10 2023-10-14T18:49:05.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7efd20001470 con 0x7efd280cbf10 2023-10-14T18:49:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 >> v1:172.21.15.79:6789/0 conn(0x7efd280cbf10 legacy=0x7efd2806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 0x7efd14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd14004810 0x7efd14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd140051c0 0x7efd1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280acc90 con 0x7efd14003a60 2023-10-14T18:49:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400c0d0 con 0x7efd140051c0 2023-10-14T18:49:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400c290 con 0x7efd14004810 2023-10-14T18:49:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 0x7efd14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2e24b700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd140051c0 0x7efd1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2d249700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd14004810 0x7efd14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 -- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd14004810 msgr2=0x7efd14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd14004810 0x7efd14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 -- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd140051c0 msgr2=0x7efd1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd140051c0 0x7efd1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 -- 172.21.15.79:0/698192153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14003570 con 0x7efd14003a60 2023-10-14T18:49:05.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2e24b700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd140051c0 0x7efd1400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:05.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2e24b700 1 -- 172.21.15.79:0/698192153 reap_dead start 2023-10-14T18:49:05.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.647+0000 7efd2da4a700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 0x7efd14003e70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd2400e210 tx=0x7efd2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff74fefa364fbc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2400eac0 con 0x7efd14003a60 2023-10-14T18:49:05.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2400f040 con 0x7efd14003a60 2023-10-14T18:49:05.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ca48700 1 -- 172.21.15.79:0/698192153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2400ee70 con 0x7efd14003a60 2023-10-14T18:49:05.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 -- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 msgr2=0x7efd14003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 0x7efd14003e70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efd2400e210 tx=0x7efd2400b040 comp rx=0 tx=0).stop 2023-10-14T18:49:05.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 -- 172.21.15.79:0/698192153 shutdown_connections 2023-10-14T18:49:05.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/698192153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd14003a60 0x7efd14003e70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 -- 172.21.15.79:0/698192153 >> 172.21.15.79:0/698192153 conn(0x7efd280680e0 msgr2=0x7efd280cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:05.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 -- 172.21.15.79:0/698192153 shutdown_connections 2023-10-14T18:49:05.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.648+0000 7efd2ea4c700 1 -- 172.21.15.79:0/698192153 wait complete. 2023-10-14T18:49:05.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.649+0000 7efd2ea4c700 1 Processor -- start 2023-10-14T18:49:05.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.649+0000 7efd2ea4c700 1 -- start start 2023-10-14T18:49:05.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd14003a60 0x7efd281571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 0x7efd281594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280cb0d0 con 0x7efd280ca6f0 2023-10-14T18:49:05.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280b0720 con 0x7efd14003a60 2023-10-14T18:49:05.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2ea4c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd281683c0 con 0x7efd28167f50 2023-10-14T18:49:05.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37466/0 (socket says 172.21.15.79:37466) 2023-10-14T18:49:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 -- 172.21.15.79:0/880361773 learned_addr learned my addr 172.21.15.79:0/880361773 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2da4a700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd14003a60 0x7efd281571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2d249700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 0x7efd281594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 -- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 msgr2=0x7efd281594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 0x7efd281594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 -- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd14003a60 msgr2=0x7efd281571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd14003a60 0x7efd281571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2e24b700 1 -- 172.21.15.79:0/880361773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2815a050 con 0x7efd280ca6f0 2023-10-14T18:49:05.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.650+0000 7efd2d249700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 0x7efd281594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:05.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd2e24b700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd2806cc60 tx=0x7efd280ad530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000c650 con 0x7efd280ca6f0 2023-10-14T18:49:05.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000c7d0 con 0x7efd280ca6f0 2023-10-14T18:49:05.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd28159d70 con 0x7efd280ca6f0 2023-10-14T18:49:05.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000cb90 con 0x7efd280ca6f0 2023-10-14T18:49:05.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.651+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280b03b0 con 0x7efd280ca6f0 2023-10-14T18:49:05.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.652+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd280b08b0 con 0x7efd280ca6f0 2023-10-14T18:49:05.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.652+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd200133e0 con 0x7efd280ca6f0 2023-10-14T18:49:05.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.652+0000 7efd1dffb700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:05.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.653+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd20083d80 con 0x7efd280ca6f0 2023-10-14T18:49:05.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.653+0000 7efd2da4a700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:05.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.653+0000 7efd2da4a700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 0x7efd0c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efd2400afd0 tx=0x7efd2401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:05.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.657+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd20050f50 con 0x7efd280ca6f0 2023-10-14T18:49:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.883+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd2804bb80 con 0x7efd280ca6f0 2023-10-14T18:49:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.883+0000 7efd1dffb700 1 -- 172.21.15.79:0/880361773 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7efd20054570 con 0x7efd280ca6f0 2023-10-14T18:49:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:05.884 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:05.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 msgr2=0x7efd0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 0x7efd0c0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efd2400afd0 tx=0x7efd2401a000 comp rx=0 tx=0).stop 2023-10-14T18:49:05.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 msgr2=0x7efd280cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:05.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd2806cc60 tx=0x7efd280ad530 comp rx=0 tx=0).stop 2023-10-14T18:49:05.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 shutdown_connections 2023-10-14T18:49:05.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd0c066f30 0x7efd0c0693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd280ca6f0 0x7efd280cab90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd14003a60 0x7efd281571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 --2- 172.21.15.79:0/880361773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd28167f50 0x7efd281594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:05.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 >> 172.21.15.79:0/880361773 conn(0x7efd280680e0 msgr2=0x7efd280c8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:05.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 shutdown_connections 2023-10-14T18:49:05.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:05.885+0000 7efd2ea4c700 1 -- 172.21.15.79:0/880361773 wait complete. 2023-10-14T18:49:05.889 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:06.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:49:00.029287+0000', 'modified': '2023-10-14T18:49:03.686926+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6033}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6033': {'gid': 6033, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/4032643414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 4032643414}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 4032643414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:49:06.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:49:06.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T18:49:06.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.417+0000 7ff17a8c3700 1 Processor -- start 2023-10-14T18:49:06.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.417+0000 7ff17a8c3700 1 -- start start 2023-10-14T18:49:06.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a8c3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff174159da0 0x7ff1740b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a8c3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff1740af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a8c3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17415ea70 con 0x7ff17415a170 2023-10-14T18:49:06.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a8c3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1740b3990 con 0x7ff174159da0 2023-10-14T18:49:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a8c3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740b0b70 con 0x7ff174069210 2023-10-14T18:49:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff17a0c2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff1740af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff1798c1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff174159da0 0x7ff1740b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff1790c0700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff17415a170 0x7ff174068b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:59432/0 (socket says 172.21.15.79:59432) 2023-10-14T18:49:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.418+0000 7ff1790c0700 1 -- 172.21.15.79:0/1520273040 learned_addr learned my addr 172.21.15.79:0/1520273040 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:06.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1788bf700 1 -- 172.21.15.79:0/1520273040 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041957085 0 0) 0x7ff17415ea70 con 0x7ff17415a170 2023-10-14T18:49:06.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1788bf700 1 -- 172.21.15.79:0/1520273040 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff160003570 con 0x7ff17415a170 2023-10-14T18:49:06.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1798c1700 1 -- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 msgr2=0x7ff1740af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff1740af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1798c1700 1 -- 172.21.15.79:0/1520273040 >> v1:172.21.15.144:6789/0 conn(0x7ff17415a170 legacy=0x7ff174068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1798c1700 1 -- 172.21.15.79:0/1520273040 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17415def0 con 0x7ff174159da0 2023-10-14T18:49:06.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff1740af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:49:06.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff174159da0 0x7ff1740b2da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098e0 tx=0x7ff1700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae387d07445b379 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1788bf700 1 -- 172.21.15.79:0/1520273040 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011630 con 0x7ff174159da0 2023-10-14T18:49:06.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1788bf700 1 -- 172.21.15.79:0/1520273040 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170011790 con 0x7ff174159da0 2023-10-14T18:49:06.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.419+0000 7ff1788bf700 1 -- 172.21.15.79:0/1520273040 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170011b30 con 0x7ff174159da0 2023-10-14T18:49:06.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff174159da0 msgr2=0x7ff1740b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff174159da0 0x7ff1740b2da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098e0 tx=0x7ff1700091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1520273040 shutdown_connections 2023-10-14T18:49:06.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff1740af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1520273040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff174159da0 0x7ff1740b2da0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1520273040 >> 172.21.15.79:0/1520273040 conn(0x7ff1740d0bc0 msgr2=0x7ff1740d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1520273040 shutdown_connections 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.420+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1520273040 wait complete. 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.421+0000 7ff17a8c3700 1 Processor -- start 2023-10-14T18:49:06.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.421+0000 7ff17a8c3700 1 -- start start 2023-10-14T18:49:06.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff17415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415a170 0x7ff1740af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c5fc0 con 0x7ff174159da0 2023-10-14T18:49:06.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c8b70 con 0x7ff17415a170 2023-10-14T18:49:06.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740afdd0 con 0x7ff174069210 2023-10-14T18:49:06.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37472/0 (socket says 172.21.15.79:37472) 2023-10-14T18:49:06.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 -- 172.21.15.79:0/1460268922 learned_addr learned my addr 172.21.15.79:0/1460268922 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415a170 0x7ff1740af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff17415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 -- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 msgr2=0x7ff17415ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff17415ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 -- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415a170 msgr2=0x7ff1740af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415a170 0x7ff1740af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 -- 172.21.15.79:0/1460268922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c009a20 con 0x7ff174159da0 2023-10-14T18:49:06.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c590 tx=0x7ff164007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff169ffb700 1 -- 172.21.15.79:0/1460268922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164005b30 con 0x7ff174159da0 2023-10-14T18:49:06.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff169ffb700 1 -- 172.21.15.79:0/1460268922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164005c90 con 0x7ff174159da0 2023-10-14T18:49:06.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff170009420 con 0x7ff174159da0 2023-10-14T18:49:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.422+0000 7ff169ffb700 1 -- 172.21.15.79:0/1460268922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164007320 con 0x7ff174159da0 2023-10-14T18:49:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.423+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740c5970 con 0x7ff174159da0 2023-10-14T18:49:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.424+0000 7ff169ffb700 1 -- 172.21.15.79:0/1460268922 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff16401b3b0 con 0x7ff174159da0 2023-10-14T18:49:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.424+0000 7ff169ffb700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.424+0000 7ff169ffb700 1 -- 172.21.15.79:0/1460268922 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1640838b0 con 0x7ff174159da0 2023-10-14T18:49:06.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.424+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.425+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 0x7ff1580693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098e0 tx=0x7ff170017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.426+0000 7ff184e1eb80 1 Processor -- start 2023-10-14T18:49:06.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.426+0000 7ff184e1eb80 1 -- start start 2023-10-14T18:49:06.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f9538cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f953822a70 con 0x55f9538c95f0 2023-10-14T18:49:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f953820270 con 0x55f9538cbb80 2023-10-14T18:49:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f95381c060 con 0x55f953916480 2023-10-14T18:49:06.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37482/0 (socket says 172.21.15.79:37482) 2023-10-14T18:49:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 -- 172.21.15.79:0/703077768 learned_addr learned my addr 172.21.15.79:0/703077768 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1798c1700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f9538cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 -- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 msgr2=0x55f9538f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 -- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 msgr2=0x55f9538cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f9538cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 -- 172.21.15.79:0/703077768 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9536b6270 con 0x55f9538c95f0 2023-10-14T18:49:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f9538cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.427+0000 7ff1790c0700 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff164081e00 tx=0x7ff164081d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaa3520206620c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff15effd700 1 -- 172.21.15.79:0/703077768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16405b840 con 0x55f9538c95f0 2023-10-14T18:49:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff15effd700 1 -- 172.21.15.79:0/703077768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164005e00 con 0x55f9538c95f0 2023-10-14T18:49:06.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff15effd700 1 -- 172.21.15.79:0/703077768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164052a90 con 0x55f9538c95f0 2023-10-14T18:49:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 -- 172.21.15.79:0/703077768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 msgr2=0x55f953916850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff164081e00 tx=0x7ff164081d30 comp rx=0 tx=0).stop 2023-10-14T18:49:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 -- 172.21.15.79:0/703077768 shutdown_connections 2023-10-14T18:49:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f9538cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/703077768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953916850 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 -- 172.21.15.79:0/703077768 >> 172.21.15.79:0/703077768 conn(0x55f9538cd0c0 msgr2=0x55f9538cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 -- 172.21.15.79:0/703077768 shutdown_connections 2023-10-14T18:49:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.428+0000 7ff184e1eb80 1 -- 172.21.15.79:0/703077768 wait complete. 2023-10-14T18:49:06.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.429+0000 7ff184e1eb80 1 -- start start 2023-10-14T18:49:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.429+0000 7ff184e1eb80 1 Processor -- start 2023-10-14T18:49:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9539152e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9537c7890 con 0x55f9538cbb80 2023-10-14T18:49:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9537e2ea0 con 0x55f9538c95f0 2023-10-14T18:49:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f95369ee30 con 0x55f953916480 2023-10-14T18:49:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 10 client.0 _ll_register_callbacks cb 0x55f95388f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:49:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37494/0 (socket says 172.21.15.79:37494) 2023-10-14T18:49:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 -- 172.21.15.79:0/1850597483 learned_addr learned my addr 172.21.15.79:0/1850597483 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 -- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 msgr2=0x55f9539152e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9539152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 -- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 msgr2=0x55f9538f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 -- 172.21.15.79:0/1850597483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1740c5970 con 0x55f9538cbb80 2023-10-14T18:49:06.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c560 tx=0x7ff16406c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669161720ae53268 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff153fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:49:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164053e40 con 0x55f9538cbb80 2023-10-14T18:49:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff164053fa0 con 0x55f9538cbb80 2023-10-14T18:49:06.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.430+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9538c0cd0 con 0x55f9538cbb80 2023-10-14T18:49:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff16405b5c0 con 0x55f9538cbb80 2023-10-14T18:49:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 10 client.6171 fetch_fsmap learned FSMap version 40 2023-10-14T18:49:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55f953658fe0 con 0x55f9538cbb80 2023-10-14T18:49:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9538c0cd0 con 0x55f9538cbb80 2023-10-14T18:49:06.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff164007480 con 0x55f9538cbb80 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 10 client.6171 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 10 client.6171 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 20 client.6171 populate_metadata read hostname 'smithi079' 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9538f72e0 0x55f9538cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 4 client.6171 mds_command: new command op to 6033 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:49:06.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 --> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f95389daa0 con 0x55f9538f72e0 2023-10-14T18:49:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9538f72e0 0x55f9538cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff153fff700 10 client.6171 ms_handle_connect on v2:172.21.15.79:6833/4032643414 2023-10-14T18:49:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.431+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9538f72e0 0x55f9538cbff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abd387ac69953ace server_cookie=faccb3babf287873 in_seq=0 out_seq=0 2023-10-14T18:49:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff153fff700 1 -- 172.21.15.79:0/1850597483 <== mds.0 v2:172.21.15.79:6833/4032643414 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f95389daa0 con 0x55f9538f72e0 2023-10-14T18:49:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff153fff700 10 client.6171 handle_command_reply: tid=0 2023-10-14T18:49:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 client.6171 shutdown 2023-10-14T18:49:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 msgr2=0x55f9538efea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c560 tx=0x7ff16406c000 comp rx=0 tx=0).stop 2023-10-14T18:49:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 shutdown_connections 2023-10-14T18:49:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9538f72e0 0x55f9538cbff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9539152e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1850597483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538cbb80 0x55f9538efea0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff153fff700 0 client.6171 ms_handle_reset on v2:172.21.15.79:6833/4032643414 2023-10-14T18:49:06.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 >> 172.21.15.79:0/1850597483 conn(0x55f9538cd0c0 msgr2=0x55f9538c2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 shutdown_connections 2023-10-14T18:49:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1850597483 wait complete. 2023-10-14T18:49:06.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.432+0000 7ff184e1eb80 20 client.6171 trim_cache size 0 max 16384 2023-10-14T18:49:06.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 Processor -- start 2023-10-14T18:49:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 -- start start 2023-10-14T18:49:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f9538cbb80 0x55f9538cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9538c9f70 con 0x55f953916480 2023-10-14T18:49:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9538ef8b0 con 0x55f9538c95f0 2023-10-14T18:49:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9538cb570 con 0x55f9538cbb80 2023-10-14T18:49:06.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff17a0c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.449+0000 7ff17a0c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37510/0 (socket says 172.21.15.79:37510) 2023-10-14T18:49:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 -- 172.21.15.79:0/1754618739 learned_addr learned my addr 172.21.15.79:0/1754618739 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 -- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f9538cbb80 msgr2=0x55f9538cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff1790c0700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f9538cbb80 0x55f9538cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f9538cbb80 0x55f9538cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 -- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 msgr2=0x55f9538cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 -- 172.21.15.79:0/1754618739 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17415d410 con 0x55f953916480 2023-10-14T18:49:06.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff1798c1700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff16c007870 tx=0x7ff16c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b3c13e43dbee20 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff15f7fe700 1 -- 172.21.15.79:0/1754618739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c00e040 con 0x55f953916480 2023-10-14T18:49:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff15f7fe700 1 -- 172.21.15.79:0/1754618739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c00f040 con 0x55f953916480 2023-10-14T18:49:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff15f7fe700 1 -- 172.21.15.79:0/1754618739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c016850 con 0x55f953916480 2023-10-14T18:49:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1754618739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 msgr2=0x55f9538f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.450+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ff16c007870 tx=0x7ff16c00b040 comp rx=0 tx=0).stop 2023-10-14T18:49:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1754618739 shutdown_connections 2023-10-14T18:49:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f953916480 0x55f9538f4c10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538c95f0 0x55f9538cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/1754618739 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f9538cbb80 0x55f9538cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1754618739 >> 172.21.15.79:0/1754618739 conn(0x55f9538cd0c0 msgr2=0x55f9538fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1754618739 shutdown_connections 2023-10-14T18:49:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 -- 172.21.15.79:0/1754618739 wait complete. 2023-10-14T18:49:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 -- start start 2023-10-14T18:49:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.451+0000 7ff184e1eb80 1 Processor -- start 2023-10-14T18:49:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f953911460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f953910aa0 con 0x55f9538c95f0 2023-10-14T18:49:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95397bc70 con 0x55f9538cbb80 2023-10-14T18:49:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f95397b140 con 0x55f953916480 2023-10-14T18:49:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff184e1eb80 10 client.0 _ll_register_callbacks cb 0x55f95388f2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:49:06.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37526/0 (socket says 172.21.15.79:37526) 2023-10-14T18:49:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 -- 172.21.15.79:0/2218486770 learned_addr learned my addr 172.21.15.79:0/2218486770 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1790c0700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f953911460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff17a0c2700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 -- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 msgr2=0x55f9538cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 -- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 msgr2=0x55f953911460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f953911460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.452+0000 7ff1798c1700 1 -- 172.21.15.79:0/2218486770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c0075a0 con 0x55f9538c95f0 2023-10-14T18:49:06.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff1798c1700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff170013000 tx=0x7ff17002a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2deaa084584f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:49:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170021070 con 0x55f9538c95f0 2023-10-14T18:49:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff17001aad0 con 0x55f9538c95f0 2023-10-14T18:49:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff164005e00 con 0x55f9538c95f0 2023-10-14T18:49:06.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff17001aea0 con 0x55f9538c95f0 2023-10-14T18:49:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 10 client.6177 fetch_fsmap learned FSMap version 40 2023-10-14T18:49:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55f9537ea780 con 0x55f9538c95f0 2023-10-14T18:49:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164005e00 con 0x55f9538c95f0 2023-10-14T18:49:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff1700354b0 con 0x55f9538c95f0 2023-10-14T18:49:06.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 10 client.6177 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T18:49:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 10 client.6177 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:49:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 20 client.6177 populate_metadata read hostname 'smithi079' 2023-10-14T18:49:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9539607c0 0x55f953960b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 4 client.6177 mds_command: new command op to 6033 tid=0[{"prefix": "status"}] 2023-10-14T18:49:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 --> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9537bee00 con 0x55f9539607c0 2023-10-14T18:49:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff1790c0700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9539607c0 0x55f953960b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.453+0000 7ff153fff700 10 client.6177 ms_handle_connect on v2:172.21.15.79:6833/4032643414 2023-10-14T18:49:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff1790c0700 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9539607c0 0x55f953960b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d9932a5b36868 server_cookie=cc669e4d18ae8b69 in_seq=0 out_seq=0 2023-10-14T18:49:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff153fff700 1 -- 172.21.15.79:0/2218486770 <== mds.0 v2:172.21.15.79:6833/4032643414 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f9537bee00 con 0x55f9539607c0 2023-10-14T18:49:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff153fff700 10 client.6177 handle_command_reply: tid=0 2023-10-14T18:49:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 client.6177 shutdown 2023-10-14T18:49:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 msgr2=0x55f953977980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7ff170013000 tx=0x7ff17002a040 comp rx=0 tx=0).stop 2023-10-14T18:49:06.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 shutdown_connections 2023-10-14T18:49:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:6833/4032643414,v1:172.21.15.79:6835/4032643414] conn(0x55f9539607c0 0x55f953960b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55f953916480 0x55f9538cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff153fff700 0 client.6177 ms_handle_reset on v2:172.21.15.79:6833/4032643414 2023-10-14T18:49:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f9538c95f0 0x55f953977980 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 --2- 172.21.15.79:0/2218486770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f9538cbb80 0x55f953911460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 >> 172.21.15.79:0/2218486770 conn(0x55f9538cd0c0 msgr2=0x55f9538f12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 shutdown_connections 2023-10-14T18:49:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 1 -- 172.21.15.79:0/2218486770 wait complete. 2023-10-14T18:49:06.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.454+0000 7ff184e1eb80 20 client.6177 trim_cache size 0 max 16384 2023-10-14T18:49:06.482 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:49:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:49:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:49:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6033, 2023-10-14T18:49:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:49:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:49:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:49:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.7795363350000004, 2023-10-14T18:49:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 40, 2023-10-14T18:49:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 85, 2023-10-14T18:49:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 85, 2023-10-14T18:49:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.773452950999999 2023-10-14T18:49:06.484 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:49:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 msgr2=0x7ff1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 0x7ff1580693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff1700098e0 tx=0x7ff170017000 comp rx=0 tx=0).stop 2023-10-14T18:49:06.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 msgr2=0x7ff1740c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c590 tx=0x7ff164007e00 comp rx=0 tx=0).stop 2023-10-14T18:49:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 shutdown_connections 2023-10-14T18:49:06.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff158066f30 0x7ff1580693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff17415a170 0x7ff1740af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff174069210 0x7ff17415ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 --2- 172.21.15.79:0/1460268922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff174159da0 0x7ff1740c8630 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 >> 172.21.15.79:0/1460268922 conn(0x7ff1740d0bc0 msgr2=0x7ff1740ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 shutdown_connections 2023-10-14T18:49:06.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.455+0000 7ff17a8c3700 1 -- 172.21.15.79:0/1460268922 wait complete. 2023-10-14T18:49:06.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:49:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.603+0000 7ff94759e700 1 Processor -- start 2023-10-14T18:49:06.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.603+0000 7ff94759e700 1 -- start start 2023-10-14T18:49:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9480cd6e0 0x7ff9480cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94759e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff94815cbd0 0x7ff94815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94759e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9480cb7c0 con 0x7ff9480cdab0 2023-10-14T18:49:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94759e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94815e850 con 0x7ff94815cbd0 2023-10-14T18:49:06.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480cd030 con 0x7ff9480cd6e0 2023-10-14T18:49:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff946d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff94815cbd0 0x7ff94815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff945d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9480cdab0 0x7ff94815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45628/0 (socket says 172.21.15.79:45628) 2023-10-14T18:49:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff945d9b700 1 -- 172.21.15.79:0/745543317 learned_addr learned my addr 172.21.15.79:0/745543317 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.604+0000 7ff94659c700 1 --2- 172.21.15.79:0/745543317 >> v2:172.21.15.144:3300/0 conn(0x7ff9480cd6e0 0x7ff9480cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff946d9d700 1 -- 172.21.15.79:0/745543317 >> v2:172.21.15.144:3300/0 conn(0x7ff9480cd6e0 msgr2=0x7ff9480cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff946d9d700 1 --2- 172.21.15.79:0/745543317 >> v2:172.21.15.144:3300/0 conn(0x7ff9480cd6e0 0x7ff9480cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff946d9d700 1 -- 172.21.15.79:0/745543317 >> v1:172.21.15.79:6789/0 conn(0x7ff9480cdab0 legacy=0x7ff94815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff946d9d700 1 -- 172.21.15.79:0/745543317 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94815e290 con 0x7ff94815cbd0 2023-10-14T18:49:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94559a700 1 -- 172.21.15.79:0/745543317 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126403803 0 0) 0x7ff9480cb7c0 con 0x7ff9480cdab0 2023-10-14T18:49:06.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff946d9d700 1 --2- 172.21.15.79:0/745543317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff94815d050 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff94806b730 tx=0x7ff9400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfc390b9c1ab66a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94559a700 1 -- 172.21.15.79:0/745543317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000b6b0 con 0x7ff94815cbd0 2023-10-14T18:49:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94559a700 1 -- 172.21.15.79:0/745543317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000b810 con 0x7ff94815cbd0 2023-10-14T18:49:06.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94559a700 1 -- 172.21.15.79:0/745543317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000bbb0 con 0x7ff94815cbd0 2023-10-14T18:49:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 -- 172.21.15.79:0/745543317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 msgr2=0x7ff94815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 --2- 172.21.15.79:0/745543317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff94815d050 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff94806b730 tx=0x7ff9400091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 -- 172.21.15.79:0/745543317 shutdown_connections 2023-10-14T18:49:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 --2- 172.21.15.79:0/745543317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff94815d050 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 --2- 172.21.15.79:0/745543317 >> v2:172.21.15.144:3300/0 conn(0x7ff9480cd6e0 0x7ff9480cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 -- 172.21.15.79:0/745543317 >> 172.21.15.79:0/745543317 conn(0x7ff948067660 msgr2=0x7ff948067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 -- 172.21.15.79:0/745543317 shutdown_connections 2023-10-14T18:49:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.605+0000 7ff94759e700 1 -- 172.21.15.79:0/745543317 wait complete. 2023-10-14T18:49:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.606+0000 7ff94759e700 1 Processor -- start 2023-10-14T18:49:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 -- start start 2023-10-14T18:49:06.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9480cd6e0 0x7ff94814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9480cdab0 0x7ff9480b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b31b0 con 0x7ff94815cbd0 2023-10-14T18:49:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b25a0 con 0x7ff9480cdab0 2023-10-14T18:49:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff94759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480b2880 con 0x7ff9480cd6e0 2023-10-14T18:49:06.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37538/0 (socket says 172.21.15.79:37538) 2023-10-14T18:49:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.607+0000 7ff946d9d700 1 -- 172.21.15.79:0/1971516615 learned_addr learned my addr 172.21.15.79:0/1971516615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:06.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 -- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9480cd6e0 msgr2=0x7ff94814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9480cd6e0 0x7ff94814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 -- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9480cdab0 msgr2=0x7ff9480b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9480cdab0 0x7ff9480b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 -- 172.21.15.79:0/1971516615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009420 con 0x7ff94815cbd0 2023-10-14T18:49:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff946d9d700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff9480c7b10 tx=0x7ff940017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000bb50 con 0x7ff94815cbd0 2023-10-14T18:49:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940011630 con 0x7ff94815cbd0 2023-10-14T18:49:06.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480b2b60 con 0x7ff94815cbd0 2023-10-14T18:49:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400119f0 con 0x7ff94815cbd0 2023-10-14T18:49:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.608+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94814cd20 con 0x7ff94815cbd0 2023-10-14T18:49:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.609+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480b3490 con 0x7ff94815cbd0 2023-10-14T18:49:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.609+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9400253f0 con 0x7ff94815cbd0 2023-10-14T18:49:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.610+0000 7ff9367fc700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 0x7ff9280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.610+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9400860d0 con 0x7ff94815cbd0 2023-10-14T18:49:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.610+0000 7ff94659c700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 0x7ff9280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:06.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.610+0000 7ff94659c700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 0x7ff9280693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff938007460 tx=0x7ff938009a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.614+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff940053340 con 0x7ff94815cbd0 2023-10-14T18:49:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.842+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9480b32f0 con 0x7ff94815cbd0 2023-10-14T18:49:06.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.842+0000 7ff9367fc700 1 -- 172.21.15.79:0/1971516615 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff9480b32f0 con 0x7ff94815cbd0 2023-10-14T18:49:06.844 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:49:06.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 msgr2=0x7ff9280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 0x7ff9280693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff938007460 tx=0x7ff938009a10 comp rx=0 tx=0).stop 2023-10-14T18:49:06.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 msgr2=0x7ff948155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:06.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff9480c7b10 tx=0x7ff940017000 comp rx=0 tx=0).stop 2023-10-14T18:49:06.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 shutdown_connections 2023-10-14T18:49:06.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff928066f30 0x7ff9280693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff94815cbd0 0x7ff948155870 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9480cd6e0 0x7ff94814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.844+0000 7ff94759e700 1 --2- 172.21.15.79:0/1971516615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9480cdab0 0x7ff9480b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.845+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 >> 172.21.15.79:0/1971516615 conn(0x7ff948067660 msgr2=0x7ff9480c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.845+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 shutdown_connections 2023-10-14T18:49:06.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:06.845+0000 7ff94759e700 1 -- 172.21.15.79:0/1971516615 wait complete. 2023-10-14T18:49:06.858 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:49:06.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:49:06.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:49:06.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:49:06.860 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:49:06.860 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:49:06.860 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:49:06.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:49:06.861 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:49:06.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:06.862 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:49:06.877 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:49:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:49:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:49:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:49:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:49:06.879 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:49:06.880 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:06.880 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:49:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:49:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-10-14T18:49:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:49:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.881 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:49:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:49:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:49:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.883 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:49:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:49:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:49:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.883 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:49:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:49:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:49:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:06.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:06.885 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:49:06.941 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:49:06.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:06.942 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:49:06.998 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:49:06.999 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:49:06.999 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:49:06.999 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:49:06.999 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:49:07.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.000 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:49:07.000 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:49:07.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:49:07.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:49:07.002 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:49:07.002 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:49:07.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.099 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:49:07.114 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:49:07.114 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:49:07.114 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:49:07.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:49:07.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:49:07.179 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:49:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:49:07.233 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:49:07.233 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:49:07.288 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:49:07.288 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:49:07.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:49:07.368 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:49:07.368 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:49:07.368 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:49:07.376 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:49:07.377 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:49:07.377 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:49:07.377 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:49:07.377 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:49:07.397 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:49:07.398 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:49:07.398 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:49:07.398 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:49:07.398 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:49:07.399 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:49:07.399 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:49:07.399 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:49:07.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:49:07.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:49:07.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:49:07.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.620+0000 7fc76e0a4700 1 Processor -- start 2023-10-14T18:49:07.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.620+0000 7fc76e0a4700 1 -- start start 2023-10-14T18:49:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76e0a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc7680cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76e0a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc76815cbd0 0x7fc76815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76e0a4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680cb7c0 con 0x7fc7680cdab0 2023-10-14T18:49:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76e0a4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76815e850 con 0x7fc76815cbd0 2023-10-14T18:49:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76e0a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680cd030 con 0x7fc7680cd6e0 2023-10-14T18:49:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc76815cbd0 0x7fc76815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc76815cbd0 0x7fc76815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37554/0 (socket says 172.21.15.79:37554) 2023-10-14T18:49:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 -- 172.21.15.79:0/4244464151 learned_addr learned my addr 172.21.15.79:0/4244464151 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d0a2700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc7680cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 -- 172.21.15.79:0/4244464151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 msgr2=0x7fc7680cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:07.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc7680cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 -- 172.21.15.79:0/4244464151 >> v1:172.21.15.144:6789/0 conn(0x7fc7680cdab0 legacy=0x7fc76815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:07.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d8a3700 1 -- 172.21.15.79:0/4244464151 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76815e290 con 0x7fc76815cbd0 2023-10-14T18:49:07.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.621+0000 7fc76d0a2700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc7680cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:07.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76d8a3700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc76815d020 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc7600099b0 tx=0x7fc760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6b0d9d94eadbfc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:07.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc75ffff700 1 -- 172.21.15.79:0/4244464151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000b860 con 0x7fc76815cbd0 2023-10-14T18:49:07.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc75ffff700 1 -- 172.21.15.79:0/4244464151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76000b9c0 con 0x7fc76815cbd0 2023-10-14T18:49:07.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc75ffff700 1 -- 172.21.15.79:0/4244464151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000bd60 con 0x7fc76815cbd0 2023-10-14T18:49:07.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 -- 172.21.15.79:0/4244464151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 msgr2=0x7fc76815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:07.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc76815d020 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc7600099b0 tx=0x7fc760009250 comp rx=0 tx=0).stop 2023-10-14T18:49:07.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 -- 172.21.15.79:0/4244464151 shutdown_connections 2023-10-14T18:49:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc76815d020 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/4244464151 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc7680cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 -- 172.21.15.79:0/4244464151 >> 172.21.15.79:0/4244464151 conn(0x7fc768067660 msgr2=0x7fc768067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 -- 172.21.15.79:0/4244464151 shutdown_connections 2023-10-14T18:49:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.622+0000 7fc76e0a4700 1 -- 172.21.15.79:0/4244464151 wait complete. 2023-10-14T18:49:07.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.623+0000 7fc76e0a4700 1 Processor -- start 2023-10-14T18:49:07.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.623+0000 7fc76e0a4700 1 -- start start 2023-10-14T18:49:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc76814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7680cdab0 0x7fc7680b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768155060 con 0x7fc76815cbd0 2023-10-14T18:49:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768154450 con 0x7fc7680cdab0 2023-10-14T18:49:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76e0a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc768154730 con 0x7fc7680cd6e0 2023-10-14T18:49:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76d8a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76d8a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37564/0 (socket says 172.21.15.79:37564) 2023-10-14T18:49:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.624+0000 7fc76d8a3700 1 -- 172.21.15.79:0/2875914136 learned_addr learned my addr 172.21.15.79:0/2875914136 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:07.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d0a2700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc76814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76c8a1700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7680cdab0 0x7fc7680b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 -- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 msgr2=0x7fc76814ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:07.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc76814ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 -- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7680cdab0 msgr2=0x7fc7680b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7680cdab0 0x7fc7680b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 -- 172.21.15.79:0/2875914136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600094f0 con 0x7fc76815cbd0 2023-10-14T18:49:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76d8a3700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc7680c7b10 tx=0x7fc760017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76001a700 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76001a8a0 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc768154a10 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76001ac60 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.625+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc768153f90 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.626+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7680b1a40 con 0x7fc76815cbd0 2023-10-14T18:49:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.626+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc76002d440 con 0x7fc76815cbd0 2023-10-14T18:49:07.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.627+0000 7fc75d7fa700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 0x7fc74c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:07.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.627+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7600862e0 con 0x7fc76815cbd0 2023-10-14T18:49:07.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.627+0000 7fc76d0a2700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 0x7fc74c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:07.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.627+0000 7fc76d0a2700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 0x7fc74c069410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e650 tx=0x7fc764007710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:07.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.631+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7680b1a40 con 0x7fc76815cbd0 2023-10-14T18:49:07.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.859+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7680b1a40 con 0x7fc76815cbd0 2023-10-14T18:49:07.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.859+0000 7fc75d7fa700 1 -- 172.21.15.79:0/2875914136 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc7680b1a40 con 0x7fc76815cbd0 2023-10-14T18:49:07.861 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:49:07.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 msgr2=0x7fc74c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:07.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 0x7fc74c069410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e650 tx=0x7fc764007710 comp rx=0 tx=0).stop 2023-10-14T18:49:07.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 msgr2=0x7fc7680b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:07.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc7680c7b10 tx=0x7fc760017000 comp rx=0 tx=0).stop 2023-10-14T18:49:07.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 shutdown_connections 2023-10-14T18:49:07.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc74c066f60 0x7fc74c069410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc76815cbd0 0x7fc7680b49f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7680cd6e0 0x7fc76814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 --2- 172.21.15.79:0/2875914136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7680cdab0 0x7fc7680b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:07.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 >> 172.21.15.79:0/2875914136 conn(0x7fc768067660 msgr2=0x7fc7680c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:07.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 shutdown_connections 2023-10-14T18:49:07.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:07.861+0000 7fc76e0a4700 1 -- 172.21.15.79:0/2875914136 wait complete. 2023-10-14T18:49:07.875 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:49:07.875 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:49:07.875 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:49:07.876 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:49:07.876 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:49:07.876 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:49:07.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:49:07.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:49:07.877 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:49:07.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.878 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:49:07.897 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:49:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:49:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:49:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:49:07.898 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.899 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:49:07.899 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:07.899 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:49:07.900 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:49:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:07.900 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:49:07.900 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:49:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42278sec preferred_lft 42278sec 2023-10-14T18:49:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:49:07.901 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.901 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:49:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:49:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:49:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:49:07.902 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.903 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:49:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:49:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:49:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.903 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:49:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:49:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:49:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:49:07.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.905 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:49:07.965 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:49:07.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:07.968 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:49:08.024 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:49:08.024 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:49:08.025 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:49:08.025 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:49:08.025 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:49:08.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:08.026 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:49:08.026 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:49:08.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:49:08.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:49:08.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:49:08.028 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:49:08.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:08.129 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:49:08.144 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:49:08.145 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:49:08.145 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:49:08.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:08.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:49:08.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:49:08.210 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:49:08.265 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:49:08.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:49:08.265 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:49:08.320 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:49:08.321 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:49:08.321 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:49:08.400 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:49:08.401 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:49:08.401 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:49:08.409 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:49:08.409 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:49:08.409 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:49:08.410 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:49:08.410 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:49:08.431 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:49:08.431 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:49:08.431 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:49:08.432 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:49:08.432 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:49:08.432 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:49:08.432 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:49:08.432 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:49:08.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:49:08.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:08.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:49:08.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:08.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.614+0000 7f9ceb9b2700 1 Processor -- start 2023-10-14T18:49:08.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.614+0000 7f9ceb9b2700 1 -- start start 2023-10-14T18:49:08.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ceb9b2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ce4156570 0x7f9ce406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ceb9b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 0x7f9ce406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ceb9b2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce4157c30 con 0x7f9ce40c9380 2023-10-14T18:49:08.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ceb9b2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce41584f0 con 0x7f9ce4156570 2023-10-14T18:49:08.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ceb9b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4157670 con 0x7f9ce415a330 2023-10-14T18:49:08.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ce974e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ce4156570 0x7f9ce406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ce974e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ce4156570 0x7f9ce406d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46656/0 (socket says 172.21.15.79:46656) 2023-10-14T18:49:08.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ce974e700 1 -- 172.21.15.79:0/1491560289 learned_addr learned my addr 172.21.15.79:0/1491560289 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:08.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.615+0000 7f9ce8f4d700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 0x7f9ce406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce974e700 1 -- 172.21.15.79:0/1491560289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 msgr2=0x7f9ce406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:08.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce974e700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 0x7f9ce406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce974e700 1 -- 172.21.15.79:0/1491560289 >> v1:172.21.15.144:6789/0 conn(0x7f9ce40c9380 legacy=0x7f9ce4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce974e700 1 -- 172.21.15.79:0/1491560289 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4157950 con 0x7f9ce4156570 2023-10-14T18:49:08.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce8f4d700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 0x7f9ce406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:08.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ce974e700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce4156570 0x7f9ce406d380 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009f20 tx=0x7f9ce0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff15857ebf8c6b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:08.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9cdbfff700 1 -- 172.21.15.79:0/1491560289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000e070 con 0x7f9ce4156570 2023-10-14T18:49:08.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9cdbfff700 1 -- 172.21.15.79:0/1491560289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000ba80 con 0x7f9ce4156570 2023-10-14T18:49:08.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9cdbfff700 1 -- 172.21.15.79:0/1491560289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00092e0 con 0x7f9ce4156570 2023-10-14T18:49:08.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1491560289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce4156570 msgr2=0x7f9ce406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce4156570 0x7f9ce406d380 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009f20 tx=0x7f9ce0009840 comp rx=0 tx=0).stop 2023-10-14T18:49:08.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1491560289 shutdown_connections 2023-10-14T18:49:08.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce4156570 0x7f9ce406d380 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.616+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1491560289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce415a330 0x7f9ce406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.617+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1491560289 >> 172.21.15.79:0/1491560289 conn(0x7f9ce4067660 msgr2=0x7f9ce4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:08.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.617+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1491560289 shutdown_connections 2023-10-14T18:49:08.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.617+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1491560289 wait complete. 2023-10-14T18:49:08.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.618+0000 7f9ceb9b2700 1 Processor -- start 2023-10-14T18:49:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.618+0000 7f9ceb9b2700 1 -- start start 2023-10-14T18:49:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.618+0000 7f9ceb9b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40c9380 0x7f9ce40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce4156570 0x7f9ce41689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c39e0 con 0x7f9ce415a330 2023-10-14T18:49:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce416c540 con 0x7f9ce40c9380 2023-10-14T18:49:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce416c820 con 0x7f9ce4156570 2023-10-14T18:49:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46660/0 (socket says 172.21.15.79:46660) 2023-10-14T18:49:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 -- 172.21.15.79:0/1398234698 learned_addr learned my addr 172.21.15.79:0/1398234698 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce8f4d700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce4156570 0x7f9ce41689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce974e700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40c9380 0x7f9ce40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 -- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce4156570 msgr2=0x7f9ce41689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce4156570 0x7f9ce41689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 -- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40c9380 msgr2=0x7f9ce40b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40c9380 0x7f9ce40b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 -- 172.21.15.79:0/1398234698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009ae0 con 0x7f9ce415a330 2023-10-14T18:49:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ce9f4f700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c4c0 tx=0x7f9cdc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:08.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00ce70 con 0x7f9ce415a330 2023-10-14T18:49:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc011590 con 0x7f9ce415a330 2023-10-14T18:49:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce416cb00 con 0x7f9ce415a330 2023-10-14T18:49:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011970 con 0x7f9ce415a330 2023-10-14T18:49:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.619+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce40b23e0 con 0x7f9ce415a330 2023-10-14T18:49:08.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.620+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce40c3b90 con 0x7f9ce415a330 2023-10-14T18:49:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.621+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cdc011d20 con 0x7f9ce415a330 2023-10-14T18:49:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.621+0000 7f9cd97fa700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 0x7f9cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.621+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cdc083770 con 0x7f9ce415a330 2023-10-14T18:49:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.621+0000 7f9ce974e700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 0x7f9cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.622+0000 7f9ce974e700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 0x7f9cc80693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009f20 tx=0x7f9ce0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:08.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.625+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cdc0509e0 con 0x7f9ce415a330 2023-10-14T18:49:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.853+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ce404c3c0 con 0x7f9ce415a330 2023-10-14T18:49:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.853+0000 7f9cd97fa700 1 -- 172.21.15.79:0/1398234698 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9cdc017090 con 0x7f9ce415a330 2023-10-14T18:49:08.855 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:08.855 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 msgr2=0x7f9cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 0x7f9cc80693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009f20 tx=0x7f9ce0018000 comp rx=0 tx=0).stop 2023-10-14T18:49:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 msgr2=0x7f9ce414abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c4c0 tx=0x7f9cdc007f50 comp rx=0 tx=0).stop 2023-10-14T18:49:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 shutdown_connections 2023-10-14T18:49:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9cc8066f30 0x7f9cc80693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ce415a330 0x7f9ce414abd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40c9380 0x7f9ce40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 --2- 172.21.15.79:0/1398234698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9ce4156570 0x7f9ce41689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 >> 172.21.15.79:0/1398234698 conn(0x7f9ce4067660 msgr2=0x7f9ce4156940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 shutdown_connections 2023-10-14T18:49:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:08.855+0000 7f9ceb9b2700 1 -- 172.21.15.79:0/1398234698 wait complete. 2023-10-14T18:49:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:08.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:49:09.002 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":6033,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3175765169999991,"mdsmap_epoch":40,"osdmap_epoch":85,"osdmap_epoch_barrier":85,"uptime":14.311494129} 2023-10-14T18:49:09.003 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 6033, "mdsmap_epoch": 40, "osdmap_epoch": 85, "osdmap_epoch_barrier": 85, "rank_uptime": 8.317576517, "state": "up:active", "uptime": 14.311494129, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:49:09.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:49:09.131 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:49:09.131 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:49:09.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-14T18:49:09.255 INFO:teuthology.orchestra.run.smithi079.stdout:{"mon_tick_interval":"5"} 2023-10-14T18:49:09.255 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-14T18:49:09.256 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-10-14T18:49:09.256 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:49:09.256 DEBUG:teuthology.orchestra.run.smithi079:> import time 2023-10-14T18:49:09.257 DEBUG:teuthology.orchestra.run.smithi079:> import datetime 2023-10-14T18:49:09.257 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-14T18:49:09.258 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:49:09.258 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.259 DEBUG:teuthology.orchestra.run.smithi079:> # Write some buffered data through before going full, all should be well 2023-10-14T18:49:09.259 DEBUG:teuthology.orchestra.run.smithi079:> print("writing some data through which we expect to succeed") 2023-10-14T18:49:09.259 DEBUG:teuthology.orchestra.run.smithi079:> bytes = 0 2023-10-14T18:49:09.260 DEBUG:teuthology.orchestra.run.smithi079:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-14T18:49:09.260 DEBUG:teuthology.orchestra.run.smithi079:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-14T18:49:09.260 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-14T18:49:09.261 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:49:09.261 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-14T18:49:09.261 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.262 DEBUG:teuthology.orchestra.run.smithi079:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-14T18:49:09.262 DEBUG:teuthology.orchestra.run.smithi079:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-14T18:49:09.262 DEBUG:teuthology.orchestra.run.smithi079:> # buffered IO, the error should always only appear from fsync and not 2023-10-14T18:49:09.263 DEBUG:teuthology.orchestra.run.smithi079:> # from write 2023-10-14T18:49:09.263 DEBUG:teuthology.orchestra.run.smithi079:> full = False 2023-10-14T18:49:09.263 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.264 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(531 * 1.1)): 2023-10-14T18:49:09.264 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:49:09.265 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:49:09.265 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-14T18:49:09.265 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2023-10-14T18:49:09.266 DEBUG:teuthology.orchestra.run.smithi079:> if False: 2023-10-14T18:49:09.266 DEBUG:teuthology.orchestra.run.smithi079:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-14T18:49:09.267 DEBUG:teuthology.orchestra.run.smithi079:> raise 2023-10-14T18:49:09.267 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:49:09.267 DEBUG:teuthology.orchestra.run.smithi079:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:49:09.268 DEBUG:teuthology.orchestra.run.smithi079:> full = True 2023-10-14T18:49:09.268 DEBUG:teuthology.orchestra.run.smithi079:> break 2023-10-14T18:49:09.268 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.269 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:49:09.269 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:49:09.269 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed successfully") 2023-10-14T18:49:09.270 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2023-10-14T18:49:09.270 DEBUG:teuthology.orchestra.run.smithi079:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:49:09.270 DEBUG:teuthology.orchestra.run.smithi079:> full = True 2023-10-14T18:49:09.271 DEBUG:teuthology.orchestra.run.smithi079:> break 2023-10-14T18:49:09.271 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:49:09.271 DEBUG:teuthology.orchestra.run.smithi079:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:49:09.272 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.272 DEBUG:teuthology.orchestra.run.smithi079:> if n > 531 * 0.9: 2023-10-14T18:49:09.273 DEBUG:teuthology.orchestra.run.smithi079:> # Be cautious in the last region where we expect to hit 2023-10-14T18:49:09.273 DEBUG:teuthology.orchestra.run.smithi079:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-14T18:49:09.273 DEBUG:teuthology.orchestra.run.smithi079:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-14T18:49:09.274 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(15.0) 2023-10-14T18:49:09.274 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.274 DEBUG:teuthology.orchestra.run.smithi079:> if not full: 2023-10-14T18:49:09.275 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-14T18:49:09.275 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.276 DEBUG:teuthology.orchestra.run.smithi079:> # close() should not raise an error because we already caught it in 2023-10-14T18:49:09.276 DEBUG:teuthology.orchestra.run.smithi079:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-14T18:49:09.276 DEBUG:teuthology.orchestra.run.smithi079:> # since then because all IOs got cancelled on the full flag. 2023-10-14T18:49:09.277 DEBUG:teuthology.orchestra.run.smithi079:> print("calling close") 2023-10-14T18:49:09.277 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:49:09.277 DEBUG:teuthology.orchestra.run.smithi079:> print("close() did not raise error") 2023-10-14T18:49:09.278 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:49:09.278 DEBUG:teuthology.orchestra.run.smithi079:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-14T18:49:09.278 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:49:09.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:09.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:09.910 INFO:teuthology.orchestra.run.smithi079.stdout:writing some data through which we expect to succeed 2023-10-14T18:49:09.910 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-14T18:49:09.910 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.911 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.911 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 1.00 MB 2023-10-14T18:49:09.911 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.911 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.911 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 2.00 MB 2023-10-14T18:49:09.912 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.912 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.912 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 3.00 MB 2023-10-14T18:49:09.912 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.913 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.913 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 4.00 MB 2023-10-14T18:49:09.913 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.913 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.913 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 5.00 MB 2023-10-14T18:49:09.914 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.914 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.914 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 6.00 MB 2023-10-14T18:49:09.914 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.914 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.915 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 7.00 MB 2023-10-14T18:49:09.915 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.915 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.915 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 8.00 MB 2023-10-14T18:49:09.915 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.916 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.916 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 9.00 MB 2023-10-14T18:49:09.916 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.916 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.916 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 10.00 MB 2023-10-14T18:49:09.917 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.917 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.917 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 11.00 MB 2023-10-14T18:49:09.917 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.917 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.918 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 12.00 MB 2023-10-14T18:49:09.918 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.919 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.919 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 13.00 MB 2023-10-14T18:49:09.919 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.919 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.919 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 14.00 MB 2023-10-14T18:49:09.920 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.920 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.920 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 15.00 MB 2023-10-14T18:49:09.920 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.920 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.921 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 16.00 MB 2023-10-14T18:49:09.921 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.921 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.922 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 17.00 MB 2023-10-14T18:49:09.922 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.922 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.922 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 18.00 MB 2023-10-14T18:49:09.922 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.923 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.923 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 19.00 MB 2023-10-14T18:49:09.923 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.923 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.923 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 20.00 MB 2023-10-14T18:49:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 21.00 MB 2023-10-14T18:49:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.925 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 22.00 MB 2023-10-14T18:49:09.925 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.925 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.925 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 23.00 MB 2023-10-14T18:49:09.925 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.926 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.926 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 24.00 MB 2023-10-14T18:49:09.926 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.926 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.926 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 25.00 MB 2023-10-14T18:49:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 26.00 MB 2023-10-14T18:49:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.928 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 27.00 MB 2023-10-14T18:49:09.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.928 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.928 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 28.00 MB 2023-10-14T18:49:09.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.929 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.929 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 29.00 MB 2023-10-14T18:49:09.929 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.929 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.929 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 30.00 MB 2023-10-14T18:49:09.930 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.930 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.930 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 31.00 MB 2023-10-14T18:49:09.930 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 32.00 MB 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 33.00 MB 2023-10-14T18:49:09.931 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 34.00 MB 2023-10-14T18:49:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.932 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 35.00 MB 2023-10-14T18:49:09.933 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.933 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.933 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 36.00 MB 2023-10-14T18:49:09.933 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.933 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 37.00 MB 2023-10-14T18:49:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 38.00 MB 2023-10-14T18:49:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.935 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.935 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 39.00 MB 2023-10-14T18:49:09.935 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.935 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.935 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 40.00 MB 2023-10-14T18:49:09.936 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.936 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.936 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 41.00 MB 2023-10-14T18:49:09.936 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.936 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 42.00 MB 2023-10-14T18:49:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.937 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 43.00 MB 2023-10-14T18:49:09.938 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.938 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.938 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 44.00 MB 2023-10-14T18:49:09.938 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.938 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.939 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 45.00 MB 2023-10-14T18:49:09.939 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.939 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.939 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 46.00 MB 2023-10-14T18:49:09.940 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.940 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.940 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 47.00 MB 2023-10-14T18:49:09.940 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.941 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.941 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 48.00 MB 2023-10-14T18:49:09.941 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.941 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.941 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 49.00 MB 2023-10-14T18:49:09.942 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.942 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.942 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 50.00 MB 2023-10-14T18:49:09.942 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.942 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.943 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 51.00 MB 2023-10-14T18:49:09.943 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.943 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.943 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 52.00 MB 2023-10-14T18:49:09.943 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 53.00 MB 2023-10-14T18:49:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.944 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 54.00 MB 2023-10-14T18:49:09.945 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.945 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.945 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 55.00 MB 2023-10-14T18:49:09.945 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.946 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.946 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 56.00 MB 2023-10-14T18:49:09.946 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.946 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.946 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 57.00 MB 2023-10-14T18:49:09.947 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.947 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.947 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 58.00 MB 2023-10-14T18:49:09.947 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.947 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.948 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 59.00 MB 2023-10-14T18:49:09.948 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.948 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.948 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 60.00 MB 2023-10-14T18:49:09.949 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.949 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.949 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 61.00 MB 2023-10-14T18:49:09.949 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.949 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.950 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 62.00 MB 2023-10-14T18:49:09.950 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.950 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.950 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 63.00 MB 2023-10-14T18:49:09.951 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.951 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.951 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 64.00 MB 2023-10-14T18:49:09.951 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.951 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.952 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 65.00 MB 2023-10-14T18:49:09.952 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.952 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.952 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 66.00 MB 2023-10-14T18:49:09.952 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.953 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.953 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 67.00 MB 2023-10-14T18:49:09.953 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.953 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.953 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 68.00 MB 2023-10-14T18:49:09.954 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.954 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.954 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 69.00 MB 2023-10-14T18:49:09.954 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.954 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 70.00 MB 2023-10-14T18:49:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 71.00 MB 2023-10-14T18:49:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 72.00 MB 2023-10-14T18:49:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.956 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 73.00 MB 2023-10-14T18:49:09.957 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.957 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.957 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 74.00 MB 2023-10-14T18:49:09.957 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 75.00 MB 2023-10-14T18:49:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 76.00 MB 2023-10-14T18:49:09.959 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.959 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.959 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 77.00 MB 2023-10-14T18:49:09.959 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.959 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.960 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 78.00 MB 2023-10-14T18:49:09.960 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.960 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.960 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 79.00 MB 2023-10-14T18:49:09.960 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:09.961 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:09.961 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 80.00 MB 2023-10-14T18:49:10.118 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 81.00 MB 2023-10-14T18:49:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 82.00 MB 2023-10-14T18:49:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 83.00 MB 2023-10-14T18:49:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 84.00 MB 2023-10-14T18:49:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.121 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 85.00 MB 2023-10-14T18:49:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 86.00 MB 2023-10-14T18:49:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 87.00 MB 2023-10-14T18:49:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 88.00 MB 2023-10-14T18:49:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 89.00 MB 2023-10-14T18:49:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 90.00 MB 2023-10-14T18:49:10.125 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.125 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.125 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 91.00 MB 2023-10-14T18:49:10.125 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.125 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 92.00 MB 2023-10-14T18:49:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 93.00 MB 2023-10-14T18:49:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.127 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.127 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 94.00 MB 2023-10-14T18:49:10.127 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.127 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.127 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 95.00 MB 2023-10-14T18:49:10.128 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.128 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.128 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 96.00 MB 2023-10-14T18:49:10.128 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.129 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.129 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 97.00 MB 2023-10-14T18:49:10.129 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.129 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.129 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 98.00 MB 2023-10-14T18:49:10.130 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.130 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.130 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 99.00 MB 2023-10-14T18:49:10.130 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.130 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 100.00 MB 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 101.00 MB 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.131 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.132 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 102.00 MB 2023-10-14T18:49:10.132 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.132 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.132 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 103.00 MB 2023-10-14T18:49:10.132 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.133 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.133 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 104.00 MB 2023-10-14T18:49:10.133 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.133 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 105.00 MB 2023-10-14T18:49:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 106.00 MB 2023-10-14T18:49:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.135 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.135 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 107.00 MB 2023-10-14T18:49:10.135 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.135 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.135 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 108.00 MB 2023-10-14T18:49:10.137 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.137 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.137 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 109.00 MB 2023-10-14T18:49:10.137 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.138 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.138 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 110.00 MB 2023-10-14T18:49:10.138 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.138 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.138 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 111.00 MB 2023-10-14T18:49:10.139 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.139 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.139 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 112.00 MB 2023-10-14T18:49:10.139 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.139 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 113.00 MB 2023-10-14T18:49:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 114.00 MB 2023-10-14T18:49:10.140 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.141 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.141 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 115.00 MB 2023-10-14T18:49:10.141 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.141 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.142 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 116.00 MB 2023-10-14T18:49:10.142 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.142 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.142 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 117.00 MB 2023-10-14T18:49:10.142 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.143 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.143 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 118.00 MB 2023-10-14T18:49:10.143 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.143 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.143 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 119.00 MB 2023-10-14T18:49:10.144 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.144 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.144 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 120.00 MB 2023-10-14T18:49:10.144 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.144 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.145 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 121.00 MB 2023-10-14T18:49:10.145 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.145 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.145 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 122.00 MB 2023-10-14T18:49:10.145 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.146 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.146 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 123.00 MB 2023-10-14T18:49:10.146 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.146 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.146 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 124.00 MB 2023-10-14T18:49:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 125.00 MB 2023-10-14T18:49:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.148 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 126.00 MB 2023-10-14T18:49:10.148 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.148 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.148 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 127.00 MB 2023-10-14T18:49:10.148 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.149 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.149 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 128.00 MB 2023-10-14T18:49:10.149 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.149 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.150 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 129.00 MB 2023-10-14T18:49:10.150 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.150 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.150 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 130.00 MB 2023-10-14T18:49:10.150 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.151 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.151 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 131.00 MB 2023-10-14T18:49:10.151 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.151 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.151 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 132.00 MB 2023-10-14T18:49:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 133.00 MB 2023-10-14T18:49:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.152 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.153 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 134.00 MB 2023-10-14T18:49:10.153 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.153 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.153 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 135.00 MB 2023-10-14T18:49:10.153 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.154 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.154 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 136.00 MB 2023-10-14T18:49:10.154 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.154 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 137.00 MB 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 138.00 MB 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.155 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.156 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 139.00 MB 2023-10-14T18:49:10.156 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.156 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.156 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 140.00 MB 2023-10-14T18:49:10.156 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.157 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.157 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 141.00 MB 2023-10-14T18:49:10.157 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.157 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.157 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 142.00 MB 2023-10-14T18:49:10.158 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.158 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.158 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 143.00 MB 2023-10-14T18:49:10.158 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.158 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 144.00 MB 2023-10-14T18:49:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 145.00 MB 2023-10-14T18:49:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.160 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.160 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 146.00 MB 2023-10-14T18:49:10.160 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.160 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.160 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 147.00 MB 2023-10-14T18:49:10.161 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.161 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.161 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 148.00 MB 2023-10-14T18:49:10.161 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.161 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 149.00 MB 2023-10-14T18:49:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 150.00 MB 2023-10-14T18:49:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 151.00 MB 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 152.00 MB 2023-10-14T18:49:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.164 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.164 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 153.00 MB 2023-10-14T18:49:10.164 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.164 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.164 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 154.00 MB 2023-10-14T18:49:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 155.00 MB 2023-10-14T18:49:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.165 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.166 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 156.00 MB 2023-10-14T18:49:10.166 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.166 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.166 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 157.00 MB 2023-10-14T18:49:10.166 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 158.00 MB 2023-10-14T18:49:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 159.00 MB 2023-10-14T18:49:10.168 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.168 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.168 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 160.00 MB 2023-10-14T18:49:10.168 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.168 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.169 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 161.00 MB 2023-10-14T18:49:10.318 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 162.00 MB 2023-10-14T18:49:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.319 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 163.00 MB 2023-10-14T18:49:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 164.00 MB 2023-10-14T18:49:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 165.00 MB 2023-10-14T18:49:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 166.00 MB 2023-10-14T18:49:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 167.00 MB 2023-10-14T18:49:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.322 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 168.00 MB 2023-10-14T18:49:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 169.00 MB 2023-10-14T18:49:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 170.00 MB 2023-10-14T18:49:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.324 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 171.00 MB 2023-10-14T18:49:10.325 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.325 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.325 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 172.00 MB 2023-10-14T18:49:10.325 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.325 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 173.00 MB 2023-10-14T18:49:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 174.00 MB 2023-10-14T18:49:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 175.00 MB 2023-10-14T18:49:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 176.00 MB 2023-10-14T18:49:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 177.00 MB 2023-10-14T18:49:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.328 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 178.00 MB 2023-10-14T18:49:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 179.00 MB 2023-10-14T18:49:10.329 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 180.00 MB 2023-10-14T18:49:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 181.00 MB 2023-10-14T18:49:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 182.00 MB 2023-10-14T18:49:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.331 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 183.00 MB 2023-10-14T18:49:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 184.00 MB 2023-10-14T18:49:10.332 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 185.00 MB 2023-10-14T18:49:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.333 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 186.00 MB 2023-10-14T18:49:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 187.00 MB 2023-10-14T18:49:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.334 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 188.00 MB 2023-10-14T18:49:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 189.00 MB 2023-10-14T18:49:10.335 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 190.00 MB 2023-10-14T18:49:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 191.00 MB 2023-10-14T18:49:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 192.00 MB 2023-10-14T18:49:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.337 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 193.00 MB 2023-10-14T18:49:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 194.00 MB 2023-10-14T18:49:10.338 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 195.00 MB 2023-10-14T18:49:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 196.00 MB 2023-10-14T18:49:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 197.00 MB 2023-10-14T18:49:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.340 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 198.00 MB 2023-10-14T18:49:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 199.00 MB 2023-10-14T18:49:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 200.00 MB 2023-10-14T18:49:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.342 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 201.00 MB 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 202.00 MB 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.343 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 203.00 MB 2023-10-14T18:49:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 204.00 MB 2023-10-14T18:49:10.344 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.345 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 205.00 MB 2023-10-14T18:49:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 206.00 MB 2023-10-14T18:49:10.346 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 207.00 MB 2023-10-14T18:49:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.347 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 208.00 MB 2023-10-14T18:49:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 209.00 MB 2023-10-14T18:49:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.348 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 210.00 MB 2023-10-14T18:49:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 211.00 MB 2023-10-14T18:49:10.349 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 212.00 MB 2023-10-14T18:49:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 213.00 MB 2023-10-14T18:49:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 214.00 MB 2023-10-14T18:49:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.351 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 215.00 MB 2023-10-14T18:49:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 216.00 MB 2023-10-14T18:49:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 217.00 MB 2023-10-14T18:49:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.353 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 218.00 MB 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 219.00 MB 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.354 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 220.00 MB 2023-10-14T18:49:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 221.00 MB 2023-10-14T18:49:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.355 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 222.00 MB 2023-10-14T18:49:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 223.00 MB 2023-10-14T18:49:10.356 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 224.00 MB 2023-10-14T18:49:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.357 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 225.00 MB 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 226.00 MB 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 227.00 MB 2023-10-14T18:49:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 228.00 MB 2023-10-14T18:49:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.359 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 229.00 MB 2023-10-14T18:49:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 230.00 MB 2023-10-14T18:49:10.360 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 231.00 MB 2023-10-14T18:49:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.361 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 232.00 MB 2023-10-14T18:49:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 233.00 MB 2023-10-14T18:49:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.362 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 234.00 MB 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 235.00 MB 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.363 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 236.00 MB 2023-10-14T18:49:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 237.00 MB 2023-10-14T18:49:10.364 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 238.00 MB 2023-10-14T18:49:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.365 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 239.00 MB 2023-10-14T18:49:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 240.00 MB 2023-10-14T18:49:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.366 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.367 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 241.00 MB 2023-10-14T18:49:10.517 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 242.00 MB 2023-10-14T18:49:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.519 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 243.00 MB 2023-10-14T18:49:10.519 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.519 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.519 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 244.00 MB 2023-10-14T18:49:10.519 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.520 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.520 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 245.00 MB 2023-10-14T18:49:10.520 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.520 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.520 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 246.00 MB 2023-10-14T18:49:10.521 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.521 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.521 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 247.00 MB 2023-10-14T18:49:10.521 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.521 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.522 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 248.00 MB 2023-10-14T18:49:10.522 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.522 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 249.00 MB 2023-10-14T18:49:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.524 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 250.00 MB 2023-10-14T18:49:10.524 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.524 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.525 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 251.00 MB 2023-10-14T18:49:10.525 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.525 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.526 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 252.00 MB 2023-10-14T18:49:10.526 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.526 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.527 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 253.00 MB 2023-10-14T18:49:10.527 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.528 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.528 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 254.00 MB 2023-10-14T18:49:10.528 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.529 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.529 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 255.00 MB 2023-10-14T18:49:10.530 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.530 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.530 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 256.00 MB 2023-10-14T18:49:10.531 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.531 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.532 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 257.00 MB 2023-10-14T18:49:10.532 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.532 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.533 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 258.00 MB 2023-10-14T18:49:10.533 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.533 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.533 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 259.00 MB 2023-10-14T18:49:10.534 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.534 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.534 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 260.00 MB 2023-10-14T18:49:10.534 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.535 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.535 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 261.00 MB 2023-10-14T18:49:10.535 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.535 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.535 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 262.00 MB 2023-10-14T18:49:10.536 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.536 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.536 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 263.00 MB 2023-10-14T18:49:10.536 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.536 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.537 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 264.00 MB 2023-10-14T18:49:10.537 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.537 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.537 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 265.00 MB 2023-10-14T18:49:10.537 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.538 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.538 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 266.00 MB 2023-10-14T18:49:10.538 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.538 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.539 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 267.00 MB 2023-10-14T18:49:10.539 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.539 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.539 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 268.00 MB 2023-10-14T18:49:10.539 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.540 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.540 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 269.00 MB 2023-10-14T18:49:10.540 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.540 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.540 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 270.00 MB 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 271.00 MB 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.541 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 272.00 MB 2023-10-14T18:49:10.542 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.542 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.542 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 273.00 MB 2023-10-14T18:49:10.542 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.543 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.543 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 274.00 MB 2023-10-14T18:49:10.543 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.543 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 275.00 MB 2023-10-14T18:49:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 276.00 MB 2023-10-14T18:49:10.544 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 277.00 MB 2023-10-14T18:49:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.545 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 278.00 MB 2023-10-14T18:49:10.546 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.546 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.546 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 279.00 MB 2023-10-14T18:49:10.546 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.546 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.547 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 280.00 MB 2023-10-14T18:49:10.547 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.547 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.547 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 281.00 MB 2023-10-14T18:49:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 282.00 MB 2023-10-14T18:49:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.549 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 283.00 MB 2023-10-14T18:49:10.549 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.549 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.550 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 284.00 MB 2023-10-14T18:49:10.550 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.550 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.551 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 285.00 MB 2023-10-14T18:49:10.551 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.551 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.551 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 286.00 MB 2023-10-14T18:49:10.553 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.553 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.553 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 287.00 MB 2023-10-14T18:49:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 288.00 MB 2023-10-14T18:49:10.554 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 289.00 MB 2023-10-14T18:49:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.555 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 290.00 MB 2023-10-14T18:49:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 291.00 MB 2023-10-14T18:49:10.556 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 292.00 MB 2023-10-14T18:49:10.557 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 293.00 MB 2023-10-14T18:49:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.559 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.559 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 294.00 MB 2023-10-14T18:49:10.560 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.560 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.560 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 295.00 MB 2023-10-14T18:49:10.561 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.561 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.561 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 296.00 MB 2023-10-14T18:49:10.562 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.562 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.562 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 297.00 MB 2023-10-14T18:49:10.563 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.563 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.563 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 298.00 MB 2023-10-14T18:49:10.564 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.564 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.564 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 299.00 MB 2023-10-14T18:49:10.564 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.564 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 300.00 MB 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 301.00 MB 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.565 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.566 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 302.00 MB 2023-10-14T18:49:10.566 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.566 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.566 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 303.00 MB 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 304.00 MB 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.567 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 305.00 MB 2023-10-14T18:49:10.568 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.568 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.568 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 306.00 MB 2023-10-14T18:49:10.569 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.569 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.569 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 307.00 MB 2023-10-14T18:49:10.569 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.570 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.570 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 308.00 MB 2023-10-14T18:49:10.570 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.570 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.570 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 309.00 MB 2023-10-14T18:49:10.571 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.571 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.571 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 310.00 MB 2023-10-14T18:49:10.572 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.572 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.572 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 311.00 MB 2023-10-14T18:49:10.572 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.572 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.573 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 312.00 MB 2023-10-14T18:49:10.573 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.573 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.573 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 313.00 MB 2023-10-14T18:49:10.573 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.574 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.574 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 314.00 MB 2023-10-14T18:49:10.574 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.574 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.575 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 315.00 MB 2023-10-14T18:49:10.575 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.575 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.575 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 316.00 MB 2023-10-14T18:49:10.575 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 317.00 MB 2023-10-14T18:49:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 318.00 MB 2023-10-14T18:49:10.577 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.577 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.577 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 319.00 MB 2023-10-14T18:49:10.577 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.578 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.578 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 320.00 MB 2023-10-14T18:49:10.578 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.578 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.578 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 321.00 MB 2023-10-14T18:49:10.579 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.579 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.726 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 322.00 MB 2023-10-14T18:49:10.726 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.726 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 323.00 MB 2023-10-14T18:49:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 324.00 MB 2023-10-14T18:49:10.727 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 325.00 MB 2023-10-14T18:49:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.728 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 326.00 MB 2023-10-14T18:49:10.729 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.729 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 327.00 MB 2023-10-14T18:49:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.730 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 328.00 MB 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 329.00 MB 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.731 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 330.00 MB 2023-10-14T18:49:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 331.00 MB 2023-10-14T18:49:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.732 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.733 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 332.00 MB 2023-10-14T18:49:10.733 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.733 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.733 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 333.00 MB 2023-10-14T18:49:10.733 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.734 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.734 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 334.00 MB 2023-10-14T18:49:10.734 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.734 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 335.00 MB 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 336.00 MB 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.735 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.736 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 337.00 MB 2023-10-14T18:49:10.736 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.736 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.736 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 338.00 MB 2023-10-14T18:49:10.737 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.737 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.737 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 339.00 MB 2023-10-14T18:49:10.737 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.737 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.738 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 340.00 MB 2023-10-14T18:49:10.738 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.738 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.738 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 341.00 MB 2023-10-14T18:49:10.739 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.739 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.739 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 342.00 MB 2023-10-14T18:49:10.739 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.739 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.740 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 343.00 MB 2023-10-14T18:49:10.740 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.740 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.740 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 344.00 MB 2023-10-14T18:49:10.740 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.741 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.741 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 345.00 MB 2023-10-14T18:49:10.741 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.741 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.742 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 346.00 MB 2023-10-14T18:49:10.742 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.743 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.743 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 347.00 MB 2023-10-14T18:49:10.743 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.743 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.744 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 348.00 MB 2023-10-14T18:49:10.744 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.744 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.744 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 349.00 MB 2023-10-14T18:49:10.744 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.745 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.745 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 350.00 MB 2023-10-14T18:49:10.745 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.745 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.745 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 351.00 MB 2023-10-14T18:49:10.746 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.746 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.746 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 352.00 MB 2023-10-14T18:49:10.746 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.746 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 353.00 MB 2023-10-14T18:49:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 354.00 MB 2023-10-14T18:49:10.747 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 355.00 MB 2023-10-14T18:49:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 356.00 MB 2023-10-14T18:49:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 357.00 MB 2023-10-14T18:49:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 358.00 MB 2023-10-14T18:49:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 359.00 MB 2023-10-14T18:49:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 360.00 MB 2023-10-14T18:49:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 361.00 MB 2023-10-14T18:49:10.752 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.752 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.752 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 362.00 MB 2023-10-14T18:49:10.752 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.752 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 363.00 MB 2023-10-14T18:49:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 364.00 MB 2023-10-14T18:49:10.753 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 365.00 MB 2023-10-14T18:49:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.754 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 366.00 MB 2023-10-14T18:49:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 367.00 MB 2023-10-14T18:49:10.758 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 368.00 MB 2023-10-14T18:49:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 369.00 MB 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 370.00 MB 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.760 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 371.00 MB 2023-10-14T18:49:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 372.00 MB 2023-10-14T18:49:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.761 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 373.00 MB 2023-10-14T18:49:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 374.00 MB 2023-10-14T18:49:10.762 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 375.00 MB 2023-10-14T18:49:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.763 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 376.00 MB 2023-10-14T18:49:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 377.00 MB 2023-10-14T18:49:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.764 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 378.00 MB 2023-10-14T18:49:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 379.00 MB 2023-10-14T18:49:10.765 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 380.00 MB 2023-10-14T18:49:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 381.00 MB 2023-10-14T18:49:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 382.00 MB 2023-10-14T18:49:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 383.00 MB 2023-10-14T18:49:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 384.00 MB 2023-10-14T18:49:10.768 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 385.00 MB 2023-10-14T18:49:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 386.00 MB 2023-10-14T18:49:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 387.00 MB 2023-10-14T18:49:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.770 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 388.00 MB 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 389.00 MB 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.771 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 390.00 MB 2023-10-14T18:49:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 391.00 MB 2023-10-14T18:49:10.772 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 392.00 MB 2023-10-14T18:49:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.773 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 393.00 MB 2023-10-14T18:49:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 394.00 MB 2023-10-14T18:49:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.774 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 395.00 MB 2023-10-14T18:49:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 396.00 MB 2023-10-14T18:49:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.776 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.776 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 397.00 MB 2023-10-14T18:49:10.776 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.776 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.776 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 398.00 MB 2023-10-14T18:49:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 399.00 MB 2023-10-14T18:49:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.777 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 400.00 MB 2023-10-14T18:49:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 401.00 MB 2023-10-14T18:49:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 402.00 MB 2023-10-14T18:49:13.722 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:49:13.721+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-14T18:49:22.512 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:49:22.512+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-14T18:49:39.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:39.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:40.980 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.981 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.981 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 403.00 MB 2023-10-14T18:49:40.981 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.981 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.981 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 404.00 MB 2023-10-14T18:49:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 405.00 MB 2023-10-14T18:49:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 406.00 MB 2023-10-14T18:49:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 407.00 MB 2023-10-14T18:49:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 408.00 MB 2023-10-14T18:49:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.984 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 409.00 MB 2023-10-14T18:49:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 410.00 MB 2023-10-14T18:49:40.985 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 411.00 MB 2023-10-14T18:49:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.986 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 412.00 MB 2023-10-14T18:49:40.987 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.987 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.987 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 413.00 MB 2023-10-14T18:49:40.987 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.987 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 414.00 MB 2023-10-14T18:49:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 415.00 MB 2023-10-14T18:49:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 416.00 MB 2023-10-14T18:49:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 417.00 MB 2023-10-14T18:49:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 418.00 MB 2023-10-14T18:49:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.990 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 419.00 MB 2023-10-14T18:49:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 420.00 MB 2023-10-14T18:49:40.991 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 421.00 MB 2023-10-14T18:49:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 422.00 MB 2023-10-14T18:49:40.993 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.993 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.993 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 423.00 MB 2023-10-14T18:49:40.993 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.993 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.994 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 424.00 MB 2023-10-14T18:49:40.994 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.994 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.994 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 425.00 MB 2023-10-14T18:49:40.994 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 426.00 MB 2023-10-14T18:49:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.995 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 427.00 MB 2023-10-14T18:49:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 428.00 MB 2023-10-14T18:49:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 429.00 MB 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 430.00 MB 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 431.00 MB 2023-10-14T18:49:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 432.00 MB 2023-10-14T18:49:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.999 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.999 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 433.00 MB 2023-10-14T18:49:40.999 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:40.999 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:40.999 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 434.00 MB 2023-10-14T18:49:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 435.00 MB 2023-10-14T18:49:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.000 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.001 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 436.00 MB 2023-10-14T18:49:41.001 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.001 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.001 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 437.00 MB 2023-10-14T18:49:41.001 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.002 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.002 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 438.00 MB 2023-10-14T18:49:41.002 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.002 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.002 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 439.00 MB 2023-10-14T18:49:41.003 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.003 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.003 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 440.00 MB 2023-10-14T18:49:41.003 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.003 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.004 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 441.00 MB 2023-10-14T18:49:41.004 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.004 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.004 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 442.00 MB 2023-10-14T18:49:41.004 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.005 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.005 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 443.00 MB 2023-10-14T18:49:41.005 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.005 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.005 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 444.00 MB 2023-10-14T18:49:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 445.00 MB 2023-10-14T18:49:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.006 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.007 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 446.00 MB 2023-10-14T18:49:41.007 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.007 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.007 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 447.00 MB 2023-10-14T18:49:41.007 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.008 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.008 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 448.00 MB 2023-10-14T18:49:41.008 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.008 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.008 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 449.00 MB 2023-10-14T18:49:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 450.00 MB 2023-10-14T18:49:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.009 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 451.00 MB 2023-10-14T18:49:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 452.00 MB 2023-10-14T18:49:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.011 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.011 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 453.00 MB 2023-10-14T18:49:41.011 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.011 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.011 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 454.00 MB 2023-10-14T18:49:41.012 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.012 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.012 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 455.00 MB 2023-10-14T18:49:41.012 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 456.00 MB 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 457.00 MB 2023-10-14T18:49:41.013 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 458.00 MB 2023-10-14T18:49:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 459.00 MB 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 460.00 MB 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.015 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.016 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 461.00 MB 2023-10-14T18:49:41.016 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.016 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.016 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 462.00 MB 2023-10-14T18:49:41.016 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.017 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.017 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 463.00 MB 2023-10-14T18:49:41.017 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.017 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.017 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 464.00 MB 2023-10-14T18:49:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 465.00 MB 2023-10-14T18:49:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.018 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 466.00 MB 2023-10-14T18:49:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 467.00 MB 2023-10-14T18:49:41.019 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.020 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.020 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 468.00 MB 2023-10-14T18:49:41.020 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.020 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.020 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 469.00 MB 2023-10-14T18:49:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 470.00 MB 2023-10-14T18:49:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.022 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 471.00 MB 2023-10-14T18:49:41.022 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.022 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.022 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 472.00 MB 2023-10-14T18:49:41.022 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.023 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.023 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 473.00 MB 2023-10-14T18:49:41.023 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.023 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.023 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 474.00 MB 2023-10-14T18:49:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 475.00 MB 2023-10-14T18:49:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 476.00 MB 2023-10-14T18:49:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 477.00 MB 2023-10-14T18:49:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.026 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.026 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 478.00 MB 2023-10-14T18:49:41.026 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.026 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.026 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 479.00 MB 2023-10-14T18:49:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:49:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:49:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:49:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 480.00 MB 2023-10-14T18:49:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:49:41.028 INFO:teuthology.orchestra.run.smithi079.stdout:Reached fullness after 480.00 MB 2023-10-14T18:49:41.028 INFO:teuthology.orchestra.run.smithi079.stdout:calling close 2023-10-14T18:49:41.028 INFO:teuthology.orchestra.run.smithi079.stdout:close() did not raise error 2023-10-14T18:49:41.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:49:41.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:49:41.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:49:41.276 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:49:41.277 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:49:41.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:49:41.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:49:41.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:49:41.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:41.320 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:49:41.374 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:49:41.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:49:41.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:49:41.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:49:41.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:49:41.421 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:49:41.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:41.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.552+0000 7f1b4844b700 1 Processor -- start 2023-10-14T18:49:41.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.552+0000 7f1b4844b700 1 -- start start 2023-10-14T18:49:41.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b4844b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b40157870 0x7f1b4015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b4844b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4015a620 0x7f1b4015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b4844b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015cbb0 con 0x7f1b4015d580 2023-10-14T18:49:41.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b4844b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4015bfa0 con 0x7f1b4015a620 2023-10-14T18:49:41.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b459e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4015a620 0x7f1b4015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b4844b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b4015c280 con 0x7f1b40157870 2023-10-14T18:49:41.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b459e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b4015a620 0x7f1b4015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34404/0 (socket says 172.21.15.79:34404) 2023-10-14T18:49:41.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b459e6700 1 -- 172.21.15.79:0/2468595012 learned_addr learned my addr 172.21.15.79:0/2468595012 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:41.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.553+0000 7f1b461e7700 1 --2- 172.21.15.79:0/2468595012 >> v2:172.21.15.144:3300/0 conn(0x7f1b40157870 0x7f1b4015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b459e6700 1 -- 172.21.15.79:0/2468595012 >> v2:172.21.15.144:3300/0 conn(0x7f1b40157870 msgr2=0x7f1b4015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:41.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b459e6700 1 --2- 172.21.15.79:0/2468595012 >> v2:172.21.15.144:3300/0 conn(0x7f1b40157870 0x7f1b4015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b459e6700 1 -- 172.21.15.79:0/2468595012 >> v1:172.21.15.79:6789/0 conn(0x7f1b4015d580 legacy=0x7f1b40158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b459e6700 1 -- 172.21.15.79:0/2468595012 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4015c560 con 0x7f1b4015a620 2023-10-14T18:49:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b451e5700 1 -- 172.21.15.79:0/2468595012 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634469104 0 0) 0x7f1b4015cbb0 con 0x7f1b4015d580 2023-10-14T18:49:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b459e6700 1 --2- 172.21.15.79:0/2468595012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b4015d040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b40069d80 tx=0x7f1b30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ba1652353a2988 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b451e5700 1 -- 172.21.15.79:0/2468595012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30009e70 con 0x7f1b4015a620 2023-10-14T18:49:41.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b451e5700 1 -- 172.21.15.79:0/2468595012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3000b860 con 0x7f1b4015a620 2023-10-14T18:49:41.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b451e5700 1 -- 172.21.15.79:0/2468595012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000bc00 con 0x7f1b4015a620 2023-10-14T18:49:41.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b4844b700 1 -- 172.21.15.79:0/2468595012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 msgr2=0x7f1b4015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.554+0000 7f1b4844b700 1 --2- 172.21.15.79:0/2468595012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b4015d040 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1b40069d80 tx=0x7f1b30009250 comp rx=0 tx=0).stop 2023-10-14T18:49:41.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 -- 172.21.15.79:0/2468595012 shutdown_connections 2023-10-14T18:49:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 --2- 172.21.15.79:0/2468595012 >> v2:172.21.15.144:3300/0 conn(0x7f1b40157870 0x7f1b4015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 --2- 172.21.15.79:0/2468595012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b4015d040 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 -- 172.21.15.79:0/2468595012 >> 172.21.15.79:0/2468595012 conn(0x7f1b40068ce0 msgr2=0x7f1b400690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 -- 172.21.15.79:0/2468595012 shutdown_connections 2023-10-14T18:49:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.555+0000 7f1b4844b700 1 -- 172.21.15.79:0/2468595012 wait complete. 2023-10-14T18:49:41.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 Processor -- start 2023-10-14T18:49:41.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 -- start start 2023-10-14T18:49:41.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b40157870 0x7f1b4014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4015d580 0x7f1b4015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b1470 con 0x7f1b4015a620 2023-10-14T18:49:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4014d0c0 con 0x7f1b4015d580 2023-10-14T18:49:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b4844b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b0860 con 0x7f1b40157870 2023-10-14T18:49:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.556+0000 7f1b459e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34406/0 (socket says 172.21.15.79:34406) 2023-10-14T18:49:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 -- 172.21.15.79:0/1932952771 learned_addr learned my addr 172.21.15.79:0/1932952771 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b469e8700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4015d580 0x7f1b4015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b461e7700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b40157870 0x7f1b4014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 -- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b40157870 msgr2=0x7f1b4014a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b40157870 0x7f1b4014a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 -- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4015d580 msgr2=0x7f1b4015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4015d580 0x7f1b4015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300094f0 con 0x7f1b4015a620 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b459e6700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1b300094c0 tx=0x7f1b30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000bbe0 con 0x7f1b4015a620 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30011420 con 0x7f1b4015a620 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b400b0b40 con 0x7f1b4015a620 2023-10-14T18:49:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300117c0 con 0x7f1b4015a620 2023-10-14T18:49:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.557+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b400b1100 con 0x7f1b4015a620 2023-10-14T18:49:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.558+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b400b15e0 con 0x7f1b4015a620 2023-10-14T18:49:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.558+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b30011bf0 con 0x7f1b4015a620 2023-10-14T18:49:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.559+0000 7f1b367fc700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.559+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b30085d20 con 0x7f1b4015a620 2023-10-14T18:49:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.559+0000 7f1b461e7700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.559+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f1b2406ea50 con 0x7f1b4015a620 2023-10-14T18:49:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.559+0000 7f1b461e7700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 0x7f1b240693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0076a0 tx=0x7f1b3c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.563+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b30052f90 con 0x7f1b4015a620 2023-10-14T18:49:41.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.848+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b4004c3c0 con 0x7f1b4015a620 2023-10-14T18:49:41.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.848+0000 7f1b367fc700 1 -- 172.21.15.79:0/1932952771 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f1b30015030 con 0x7f1b4015a620 2023-10-14T18:49:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:41.850 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 msgr2=0x7f1b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 0x7f1b240693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0076a0 tx=0x7f1b3c00b040 comp rx=0 tx=0).stop 2023-10-14T18:49:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 msgr2=0x7f1b400b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1b300094c0 tx=0x7f1b30017000 comp rx=0 tx=0).stop 2023-10-14T18:49:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 shutdown_connections 2023-10-14T18:49:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b4015d580 0x7f1b4015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1b40157870 0x7f1b4014a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.850+0000 7f1b4844b700 1 --2- 172.21.15.79:0/1932952771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b4015a620 0x7f1b400b1ac0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.851+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 >> 172.21.15.79:0/1932952771 conn(0x7f1b40068ce0 msgr2=0x7f1b400cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:41.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.851+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 shutdown_connections 2023-10-14T18:49:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.851+0000 7f1b4844b700 1 -- 172.21.15.79:0/1932952771 wait complete. 2023-10-14T18:49:41.854 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:41.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:41.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.977+0000 7f893a2c8700 1 Processor -- start 2023-10-14T18:49:41.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.977+0000 7f893a2c8700 1 -- start start 2023-10-14T18:49:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f893a2c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934159db0 0x7f89340d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f893a2c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89340b1f00 0x7f89340aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f893a2c8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89340b4bf0 con 0x7f8934068240 2023-10-14T18:49:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f893a2c8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340b5790 con 0x7f89340b1f00 2023-10-14T18:49:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f893a2c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340ae9b0 con 0x7f8934159db0 2023-10-14T18:49:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89340b1f00 0x7f89340aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89340b1f00 0x7f89340aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34408/0 (socket says 172.21.15.79:34408) 2023-10-14T18:49:41.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 -- 172.21.15.79:0/2068271818 learned_addr learned my addr 172.21.15.79:0/2068271818 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f89392c6700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934159db0 0x7f89340d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 -- 172.21.15.79:0/2068271818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934159db0 msgr2=0x7f89340d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934159db0 0x7f89340d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 -- 172.21.15.79:0/2068271818 >> v1:172.21.15.144:6789/0 conn(0x7f8934068240 legacy=0x7f89340b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 -- 172.21.15.79:0/2068271818 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340b59e0 con 0x7f89340b1f00 2023-10-14T18:49:41.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f8939ac7700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f89340aee40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f892c009f20 tx=0x7f892c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15d2f3df41f250b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f892bfff700 1 -- 172.21.15.79:0/2068271818 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00e070 con 0x7f89340b1f00 2023-10-14T18:49:41.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f892bfff700 1 -- 172.21.15.79:0/2068271818 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00ba60 con 0x7f89340b1f00 2023-10-14T18:49:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.978+0000 7f892bfff700 1 -- 172.21.15.79:0/2068271818 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0092e0 con 0x7f89340b1f00 2023-10-14T18:49:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 -- 172.21.15.79:0/2068271818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 msgr2=0x7f89340aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f89340aee40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f892c009f20 tx=0x7f892c009840 comp rx=0 tx=0).stop 2023-10-14T18:49:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 -- 172.21.15.79:0/2068271818 shutdown_connections 2023-10-14T18:49:41.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f89340aee40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 --2- 172.21.15.79:0/2068271818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934159db0 0x7f89340d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 -- 172.21.15.79:0/2068271818 >> 172.21.15.79:0/2068271818 conn(0x7f8934067e40 msgr2=0x7f89340d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:41.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 -- 172.21.15.79:0/2068271818 shutdown_connections 2023-10-14T18:49:41.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.979+0000 7f893a2c8700 1 -- 172.21.15.79:0/2068271818 wait complete. 2023-10-14T18:49:41.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.980+0000 7f893a2c8700 1 Processor -- start 2023-10-14T18:49:41.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.980+0000 7f893a2c8700 1 -- start start 2023-10-14T18:49:41.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934068240 0x7f8934154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 0x7f893415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893409ad20 con 0x7f89340b1f00 2023-10-14T18:49:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893409c490 con 0x7f8934159db0 2023-10-14T18:49:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f893a2c8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893415b520 con 0x7f8934068240 2023-10-14T18:49:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34416/0 (socket says 172.21.15.79:34416) 2023-10-14T18:49:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 -- 172.21.15.79:0/204017688 learned_addr learned my addr 172.21.15.79:0/204017688 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f89392c6700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934068240 0x7f8934154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8939ac7700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 0x7f893415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 -- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934068240 msgr2=0x7f8934154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934068240 0x7f8934154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 -- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 msgr2=0x7f893415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 0x7f893415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8938ac5700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009ae0 con 0x7f89340b1f00 2023-10-14T18:49:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.981+0000 7f8939ac7700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 0x7f893415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:41.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f8938ac5700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f892400c790 tx=0x7f8924007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924011590 con 0x7f89340b1f00 2023-10-14T18:49:41.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89240116f0 con 0x7f89340b1f00 2023-10-14T18:49:41.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893415b800 con 0x7f89340b1f00 2023-10-14T18:49:41.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924011ab0 con 0x7f89340b1f00 2023-10-14T18:49:41.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.982+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8934154db0 con 0x7f89340b1f00 2023-10-14T18:49:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.983+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893409c2d0 con 0x7f89340b1f00 2023-10-14T18:49:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.983+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f892401b3b0 con 0x7f89340b1f00 2023-10-14T18:49:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.983+0000 7f89297fa700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 0x7f89180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.983+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8924083910 con 0x7f89340b1f00 2023-10-14T18:49:41.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.984+0000 7f89392c6700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 0x7f89180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:41.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.984+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f891806ea50 con 0x7f89340b1f00 2023-10-14T18:49:41.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.984+0000 7f89392c6700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 0x7f89180693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8930009d10 tx=0x7f89300091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:41.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:41.988+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8924017070 con 0x7f89340b1f00 2023-10-14T18:49:42.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.175+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89340b5cc0 con 0x7f89340b1f00 2023-10-14T18:49:42.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.176+0000 7f89297fa700 1 -- 172.21.15.79:0/204017688 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15396 (secure 0 0 0) 0x7f893409c2d0 con 0x7f89340b1f00 2023-10-14T18:49:42.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:42.177 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":89,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:18.513884+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 msgr2=0x7f89180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 0x7f89180693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8930009d10 tx=0x7f89300091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 msgr2=0x7f893415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f892400c790 tx=0x7f8924007f40 comp rx=0 tx=0).stop 2023-10-14T18:49:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 shutdown_connections 2023-10-14T18:49:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8918066f30 0x7f89180693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934159db0 0x7f893415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8934068240 0x7f8934154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 --2- 172.21.15.79:0/204017688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89340b1f00 0x7f893415c870 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 >> 172.21.15.79:0/204017688 conn(0x7f8934067e40 msgr2=0x7f89340d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 shutdown_connections 2023-10-14T18:49:42.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.178+0000 7f893a2c8700 1 -- 172.21.15.79:0/204017688 wait complete. 2023-10-14T18:49:42.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:48:57.860905+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:48:58.995999+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:49:42.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.308+0000 7fe974ecb700 1 Processor -- start 2023-10-14T18:49:42.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.308+0000 7fe974ecb700 1 -- start start 2023-10-14T18:49:42.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe974ecb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe970159ec0 0x7fe9700af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe974ecb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe9700afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe974ecb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9700b0790 con 0x7fe97015a290 2023-10-14T18:49:42.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe974ecb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700ce1f0 con 0x7fe970159ec0 2023-10-14T18:49:42.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe974ecb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700b0b20 con 0x7fe97006acb0 2023-10-14T18:49:42.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe970159ec0 0x7fe9700af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe970159ec0 0x7fe9700af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34424/0 (socket says 172.21.15.79:34424) 2023-10-14T18:49:42.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe965d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe97015a290 0x7fe97006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47804/0 (socket says 172.21.15.79:47804) 2023-10-14T18:49:42.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 -- 172.21.15.79:0/1754631709 learned_addr learned my addr 172.21.15.79:0/1754631709 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:42.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96ed9d700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe9700afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 -- 172.21.15.79:0/1754631709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 msgr2=0x7fe9700afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:42.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe9700afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 -- 172.21.15.79:0/1754631709 >> v1:172.21.15.79:6789/0 conn(0x7fe97015a290 legacy=0x7fe97006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 -- 172.21.15.79:0/1754631709 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700b04b0 con 0x7fe970159ec0 2023-10-14T18:49:42.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96dd9b700 1 -- 172.21.15.79:0/1754631709 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011732750 0 0) 0x7fe9700b0790 con 0x7fe97015a290 2023-10-14T18:49:42.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.309+0000 7fe96e59c700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe970159ec0 0x7fe9700af940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe9600099b0 tx=0x7fe960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5fcc0ba51d895d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe96dd9b700 1 -- 172.21.15.79:0/1754631709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96000b860 con 0x7fe970159ec0 2023-10-14T18:49:42.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe96dd9b700 1 -- 172.21.15.79:0/1754631709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96000b9c0 con 0x7fe970159ec0 2023-10-14T18:49:42.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe96dd9b700 1 -- 172.21.15.79:0/1754631709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96000bd60 con 0x7fe970159ec0 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 -- 172.21.15.79:0/1754631709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe970159ec0 msgr2=0x7fe9700af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe970159ec0 0x7fe9700af940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe9600099b0 tx=0x7fe960009250 comp rx=0 tx=0).stop 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 -- 172.21.15.79:0/1754631709 shutdown_connections 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe9700afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 --2- 172.21.15.79:0/1754631709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe970159ec0 0x7fe9700af940 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 -- 172.21.15.79:0/1754631709 >> 172.21.15.79:0/1754631709 conn(0x7fe9700d1880 msgr2=0x7fe9700cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 -- 172.21.15.79:0/1754631709 shutdown_connections 2023-10-14T18:49:42.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.310+0000 7fe974ecb700 1 -- 172.21.15.79:0/1754631709 wait complete. 2023-10-14T18:49:42.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.311+0000 7fe974ecb700 1 Processor -- start 2023-10-14T18:49:42.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.311+0000 7fe974ecb700 1 -- start start 2023-10-14T18:49:42.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe97015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe970159ec0 0x7fe970155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015d8c0 con 0x7fe97015a290 2023-10-14T18:49:42.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015d340 con 0x7fe970159ec0 2023-10-14T18:49:42.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe974ecb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015d5e0 con 0x7fe97006acb0 2023-10-14T18:49:42.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34440/0 (socket says 172.21.15.79:34440) 2023-10-14T18:49:42.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 -- 172.21.15.79:0/2698342330 learned_addr learned my addr 172.21.15.79:0/2698342330 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:42.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96e59c700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe97015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe965d9b700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe970159ec0 0x7fe970155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 -- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 msgr2=0x7fe97015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe97015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 -- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe970159ec0 msgr2=0x7fe970155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.312+0000 7fe96ed9d700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe970159ec0 0x7fe970155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe96ed9d700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9600094f0 con 0x7fe97015a290 2023-10-14T18:49:42.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe96ed9d700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe968007ed0 tx=0x7fe968009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800eca0 con 0x7fe97015a290 2023-10-14T18:49:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800ee20 con 0x7fe97015a290 2023-10-14T18:49:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe970169fc0 con 0x7fe97015a290 2023-10-14T18:49:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968014670 con 0x7fe97015a290 2023-10-14T18:49:42.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.313+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97016a580 con 0x7fe97015a290 2023-10-14T18:49:42.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.314+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97004c3c0 con 0x7fe97015a290 2023-10-14T18:49:42.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.314+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe968014aa0 con 0x7fe97015a290 2023-10-14T18:49:42.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.314+0000 7fe966ffd700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 0x7fe9500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.315+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe968084d30 con 0x7fe97015a290 2023-10-14T18:49:42.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.315+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fe95006ea50 con 0x7fe97015a290 2023-10-14T18:49:42.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.315+0000 7fe96e59c700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 0x7fe9500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.315+0000 7fe96e59c700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 0x7fe9500693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9600099b0 tx=0x7fe960017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.319+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe968051f00 con 0x7fe97015a290 2023-10-14T18:49:42.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.498+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9700ceab0 con 0x7fe97015a290 2023-10-14T18:49:42.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.498+0000 7fe966ffd700 1 -- 172.21.15.79:0/2698342330 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe968055520 con 0x7fe97015a290 2023-10-14T18:49:42.500 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:49:42.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 msgr2=0x7fe9500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 0x7fe9500693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9600099b0 tx=0x7fe960017000 comp rx=0 tx=0).stop 2023-10-14T18:49:42.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 msgr2=0x7fe97015ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe968007ed0 tx=0x7fe968009880 comp rx=0 tx=0).stop 2023-10-14T18:49:42.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 shutdown_connections 2023-10-14T18:49:42.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe950066f30 0x7fe9500693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe97015a290 0x7fe97015ce00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe97006acb0 0x7fe97015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 --2- 172.21.15.79:0/2698342330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe970159ec0 0x7fe970155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 >> 172.21.15.79:0/2698342330 conn(0x7fe9700d1880 msgr2=0x7fe9700c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 shutdown_connections 2023-10-14T18:49:42.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.500+0000 7fe974ecb700 1 -- 172.21.15.79:0/2698342330 wait complete. 2023-10-14T18:49:42.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:49:42.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.630+0000 7f2c2e3c1700 1 Processor -- start 2023-10-14T18:49:42.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.630+0000 7f2c2e3c1700 1 -- start start 2023-10-14T18:49:42.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2e3c1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2c28159ec0 0x7f2c280af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2e3c1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280b0790 con 0x7f2c2806acb0 2023-10-14T18:49:42.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2e3c1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280ce1f0 con 0x7f2c2815a290 2023-10-14T18:49:42.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2e3c1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280b0b20 con 0x7f2c28159ec0 2023-10-14T18:49:42.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2c95e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2c2806acb0 0x7f2c280cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47814/0 (socket says 172.21.15.79:47814) 2023-10-14T18:49:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c2c95e700 1 -- 172.21.15.79:0/1103265186 learned_addr learned my addr 172.21.15.79:0/1103265186 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1103265186 >> v2:172.21.15.144:3300/0 conn(0x7f2c28159ec0 0x7f2c280af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027840786 0 0) 0x7f2c280b0790 con 0x7f2c2806acb0 2023-10-14T18:49:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c10003570 con 0x7f2c2806acb0 2023-10-14T18:49:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916369725 0 0) 0x7f2c10003570 con 0x7f2c2806acb0 2023-10-14T18:49:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 >> v2:172.21.15.144:3300/0 conn(0x7f2c28159ec0 msgr2=0x7f2c280af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 --2- 172.21.15.79:0/1103265186 >> v2:172.21.15.144:3300/0 conn(0x7f2c28159ec0 0x7f2c280af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 >> v1:172.21.15.144:6789/0 conn(0x7f2c2815a290 legacy=0x7f2c2806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280b04b0 con 0x7f2c2806acb0 2023-10-14T18:49:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f2c200017f0 con 0x7f2c2806acb0 2023-10-14T18:49:42.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 >> v1:172.21.15.79:6789/0 conn(0x7f2c2806acb0 legacy=0x7f2c280cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c10003a60 0x7f2c10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.631+0000 7f2c26ffd700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c10004810 0x7f2c10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280b0b20 con 0x7f2c100051c0 2023-10-14T18:49:42.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000c160 con 0x7f2c10004810 2023-10-14T18:49:42.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1000c320 con 0x7f2c10003a60 2023-10-14T18:49:42.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c10003a60 0x7f2c10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c277fe700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c10004810 0x7f2c10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 -- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c10003a60 msgr2=0x7f2c10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:42.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c10003a60 0x7f2c10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 -- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c10004810 msgr2=0x7f2c10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:42.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c10004810 0x7f2c10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 -- 172.21.15.79:0/1103265186 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10003570 con 0x7f2c100051c0 2023-10-14T18:49:42.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c10003a60 0x7f2c10003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:42.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c277fe700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c10004810 0x7f2c10004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:42.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 -- 172.21.15.79:0/1103265186 reap_dead start 2023-10-14T18:49:42.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c2c95e700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c1000ba60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b3770 tx=0x7f2c200021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a25238f3004ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200070d0 con 0x7f2c100051c0 2023-10-14T18:49:42.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20007230 con 0x7f2c100051c0 2023-10-14T18:49:42.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.632+0000 7f2c26ffd700 1 -- 172.21.15.79:0/1103265186 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c200075d0 con 0x7f2c100051c0 2023-10-14T18:49:42.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 msgr2=0x7f2c1000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c1000ba60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b3770 tx=0x7f2c200021d0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1103265186 shutdown_connections 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1103265186 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c1000ba60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1103265186 >> 172.21.15.79:0/1103265186 conn(0x7f2c280d1880 msgr2=0x7f2c280cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1103265186 shutdown_connections 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.633+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1103265186 wait complete. 2023-10-14T18:49:42.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.634+0000 7f2c2e3c1700 1 Processor -- start 2023-10-14T18:49:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.634+0000 7f2c2e3c1700 1 -- start start 2023-10-14T18:49:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c2816b1d0 0x7f2c2815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28154750 0x7f2c2815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815b410 con 0x7f2c100051c0 2023-10-14T18:49:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815a800 con 0x7f2c28154750 2023-10-14T18:49:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815aae0 con 0x7f2c2816b1d0 2023-10-14T18:49:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34460/0 (socket says 172.21.15.79:34460) 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 -- 172.21.15.79:0/1097845343 learned_addr learned my addr 172.21.15.79:0/1097845343 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c277fe700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c2816b1d0 0x7f2c2815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2c95e700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28154750 0x7f2c2815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 -- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c2816b1d0 msgr2=0x7f2c2815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c2816b1d0 0x7f2c2815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 -- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28154750 msgr2=0x7f2c2815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28154750 0x7f2c2815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2815adc0 con 0x7f2c100051c0 2023-10-14T18:49:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c27fff700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009fd0 tx=0x7f2c18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18015740 con 0x7f2c100051c0 2023-10-14T18:49:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180158a0 con 0x7f2c100051c0 2023-10-14T18:49:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2815b0a0 con 0x7f2c100051c0 2023-10-14T18:49:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18015c40 con 0x7f2c100051c0 2023-10-14T18:49:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.635+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2816d7e0 con 0x7f2c100051c0 2023-10-14T18:49:42.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.636+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2804c3c0 con 0x7f2c100051c0 2023-10-14T18:49:42.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.637+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c18013410 con 0x7f2c100051c0 2023-10-14T18:49:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.637+0000 7f2c0ffff700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 0x7f2c140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.637+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c18084ca0 con 0x7f2c100051c0 2023-10-14T18:49:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.637+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f2c1406ea50 con 0x7f2c100051c0 2023-10-14T18:49:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.637+0000 7f2c277fe700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 0x7f2c140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.638+0000 7f2c277fe700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 0x7f2c140693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b2f70 tx=0x7f2c1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.641+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c18051f10 con 0x7f2c100051c0 2023-10-14T18:49:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.824+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c2815b6f0 con 0x7f2c100051c0 2023-10-14T18:49:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.825+0000 7f2c0ffff700 1 -- 172.21.15.79:0/1097845343 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c18055530 con 0x7f2c100051c0 2023-10-14T18:49:42.826 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:49:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 msgr2=0x7f2c140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 0x7f2c140693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c280b2f70 tx=0x7f2c1c009040 comp rx=0 tx=0).stop 2023-10-14T18:49:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 msgr2=0x7f2c2816ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009fd0 tx=0x7f2c18008040 comp rx=0 tx=0).stop 2023-10-14T18:49:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 shutdown_connections 2023-10-14T18:49:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c14066f30 0x7f2c140693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28154750 0x7f2c2815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c100051c0 0x7f2c2816ac90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 --2- 172.21.15.79:0/1097845343 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c2816b1d0 0x7f2c2815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 >> 172.21.15.79:0/1097845343 conn(0x7f2c280d1880 msgr2=0x7f2c280b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 shutdown_connections 2023-10-14T18:49:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.827+0000 7f2c2e3c1700 1 -- 172.21.15.79:0/1097845343 wait complete. 2023-10-14T18:49:42.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:49:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.955+0000 7efc6aa53700 1 Processor -- start 2023-10-14T18:49:42.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.955+0000 7efc6aa53700 1 -- start start 2023-10-14T18:49:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc6aa53700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc6415a290 0x7efc6406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc6aa53700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc640b0790 con 0x7efc64159ec0 2023-10-14T18:49:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc6aa53700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6406af20 con 0x7efc6406aae0 2023-10-14T18:49:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc6aa53700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc640ce1f0 con 0x7efc6415a290 2023-10-14T18:49:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc637fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc6415a290 0x7efc6406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc63fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efc64159ec0 0x7efc640af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47822/0 (socket says 172.21.15.79:47822) 2023-10-14T18:49:42.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc63fff700 1 -- 172.21.15.79:0/839013061 learned_addr learned my addr 172.21.15.79:0/839013061 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc637fe700 1 -- 172.21.15.79:0/839013061 >> v1:172.21.15.144:6789/0 conn(0x7efc6406aae0 legacy=0x7efc640cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc637fe700 1 -- 172.21.15.79:0/839013061 >> v1:172.21.15.79:6789/0 conn(0x7efc64159ec0 legacy=0x7efc640af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc637fe700 1 -- 172.21.15.79:0/839013061 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc640b0b20 con 0x7efc6415a290 2023-10-14T18:49:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.956+0000 7efc62ffd700 1 -- 172.21.15.79:0/839013061 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462837612 0 0) 0x7efc640b0790 con 0x7efc64159ec0 2023-10-14T18:49:42.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc637fe700 1 --2- 172.21.15.79:0/839013061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6415a290 0x7efc6406a5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efc580098e0 tx=0x7efc580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e7bdce771f37ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc62ffd700 1 -- 172.21.15.79:0/839013061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58009e80 con 0x7efc6415a290 2023-10-14T18:49:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc62ffd700 1 -- 172.21.15.79:0/839013061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800b820 con 0x7efc6415a290 2023-10-14T18:49:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc62ffd700 1 -- 172.21.15.79:0/839013061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800bba0 con 0x7efc6415a290 2023-10-14T18:49:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 -- 172.21.15.79:0/839013061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6415a290 msgr2=0x7efc6406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 --2- 172.21.15.79:0/839013061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6415a290 0x7efc6406a5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efc580098e0 tx=0x7efc580091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 -- 172.21.15.79:0/839013061 shutdown_connections 2023-10-14T18:49:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 --2- 172.21.15.79:0/839013061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6415a290 0x7efc6406a5a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 -- 172.21.15.79:0/839013061 >> 172.21.15.79:0/839013061 conn(0x7efc640d1880 msgr2=0x7efc640cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 -- 172.21.15.79:0/839013061 shutdown_connections 2023-10-14T18:49:42.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.957+0000 7efc6aa53700 1 -- 172.21.15.79:0/839013061 wait complete. 2023-10-14T18:49:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.958+0000 7efc6aa53700 1 Processor -- start 2023-10-14T18:49:42.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 -- start start 2023-10-14T18:49:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc6406aae0 0x7efc6416b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 0x7efc640b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc640cab80 con 0x7efc64159ec0 2023-10-14T18:49:42.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6416b2a0 con 0x7efc6415a290 2023-10-14T18:49:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc6aa53700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6416b9c0 con 0x7efc6406aae0 2023-10-14T18:49:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc637fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc637fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34470/0 (socket says 172.21.15.79:34470) 2023-10-14T18:49:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.959+0000 7efc637fe700 1 -- 172.21.15.79:0/1608710367 learned_addr learned my addr 172.21.15.79:0/1608710367 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:42.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 -- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc6406aae0 msgr2=0x7efc6416b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc68ff0700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 0x7efc640b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc6406aae0 0x7efc6416b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 -- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 msgr2=0x7efc640b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 0x7efc640b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:42.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009420 con 0x7efc64159ec0 2023-10-14T18:49:42.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc68ff0700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 0x7efc640b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:42.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc637fe700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc580030c0 tx=0x7efc58016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5801c480 con 0x7efc64159ec0 2023-10-14T18:49:42.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5801c5e0 con 0x7efc64159ec0 2023-10-14T18:49:42.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5801c960 con 0x7efc64159ec0 2023-10-14T18:49:42.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6416bbb0 con 0x7efc64159ec0 2023-10-14T18:49:42.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.960+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc640b3c80 con 0x7efc64159ec0 2023-10-14T18:49:42.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.961+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6404c3c0 con 0x7efc64159ec0 2023-10-14T18:49:42.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.961+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc5801cd50 con 0x7efc64159ec0 2023-10-14T18:49:42.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.962+0000 7efc4bfff700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 0x7efc500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:42.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.962+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc58086710 con 0x7efc64159ec0 2023-10-14T18:49:42.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.962+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7efc5006ea50 con 0x7efc64159ec0 2023-10-14T18:49:42.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.962+0000 7efc63fff700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 0x7efc500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:42.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.962+0000 7efc63fff700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 0x7efc500693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc540011e0 tx=0x7efc540079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:42.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:42.966+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc58053980 con 0x7efc64159ec0 2023-10-14T18:49:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.147+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc640b04b0 con 0x7efc64159ec0 2023-10-14T18:49:43.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.147+0000 7efc4bfff700 1 -- 172.21.15.79:0/1608710367 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc5802a020 con 0x7efc64159ec0 2023-10-14T18:49:43.149 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:49:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 msgr2=0x7efc500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 0x7efc500693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc540011e0 tx=0x7efc540079d0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 msgr2=0x7efc64155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efc580030c0 tx=0x7efc58016000 comp rx=0 tx=0).stop 2023-10-14T18:49:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 shutdown_connections 2023-10-14T18:49:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc50066f30 0x7efc500693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6415a290 0x7efc640b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efc6406aae0 0x7efc6416b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 --2- 172.21.15.79:0/1608710367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc64159ec0 0x7efc64155040 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 >> 172.21.15.79:0/1608710367 conn(0x7efc640d1880 msgr2=0x7efc641574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 shutdown_connections 2023-10-14T18:49:43.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.149+0000 7efc6aa53700 1 -- 172.21.15.79:0/1608710367 wait complete. 2023-10-14T18:49:43.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.276+0000 7fe866599700 1 Processor -- start 2023-10-14T18:49:43.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.276+0000 7fe866599700 1 -- start start 2023-10-14T18:49:43.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe866599700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8600cdab0 0x7fe86015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe866599700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe86015dda0 0x7fe86015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe866599700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600cb7c0 con 0x7fe8600cd6e0 2023-10-14T18:49:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe866599700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86015e850 con 0x7fe86015dda0 2023-10-14T18:49:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe866599700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600cc360 con 0x7fe8600cdab0 2023-10-14T18:49:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865d98700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe86015dda0 0x7fe86015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865597700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe8600cd6e0 0x7fe8600cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47824/0 (socket says 172.21.15.79:47824) 2023-10-14T18:49:43.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865597700 1 -- 172.21.15.79:0/4098269052 learned_addr learned my addr 172.21.15.79:0/4098269052 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:43.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe864d96700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8600cdab0 0x7fe86015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865d98700 1 -- 172.21.15.79:0/4098269052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8600cdab0 msgr2=0x7fe86015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865d98700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8600cdab0 0x7fe86015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865d98700 1 -- 172.21.15.79:0/4098269052 >> v1:172.21.15.79:6789/0 conn(0x7fe8600cd6e0 legacy=0x7fe8600cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe865d98700 1 -- 172.21.15.79:0/4098269052 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86015e290 con 0x7fe86015dda0 2023-10-14T18:49:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.277+0000 7fe857fff700 1 -- 172.21.15.79:0/4098269052 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446932936 0 0) 0x7fe8600cb7c0 con 0x7fe8600cd6e0 2023-10-14T18:49:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe865d98700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe86015dda0 0x7fe86015cbd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e60 tx=0x7fe858009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fca8ca056853758 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe857fff700 1 -- 172.21.15.79:0/4098269052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800e070 con 0x7fe86015dda0 2023-10-14T18:49:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe857fff700 1 -- 172.21.15.79:0/4098269052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85800bc30 con 0x7fe86015dda0 2023-10-14T18:49:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe857fff700 1 -- 172.21.15.79:0/4098269052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858012430 con 0x7fe86015dda0 2023-10-14T18:49:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 -- 172.21.15.79:0/4098269052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe86015dda0 msgr2=0x7fe86015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe86015dda0 0x7fe86015cbd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e60 tx=0x7fe858009780 comp rx=0 tx=0).stop 2023-10-14T18:49:43.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 -- 172.21.15.79:0/4098269052 shutdown_connections 2023-10-14T18:49:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe86015dda0 0x7fe86015cbd0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 --2- 172.21.15.79:0/4098269052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe8600cdab0 0x7fe86015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 -- 172.21.15.79:0/4098269052 >> 172.21.15.79:0/4098269052 conn(0x7fe860067660 msgr2=0x7fe860067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 -- 172.21.15.79:0/4098269052 shutdown_connections 2023-10-14T18:49:43.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.278+0000 7fe866599700 1 -- 172.21.15.79:0/4098269052 wait complete. 2023-10-14T18:49:43.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.279+0000 7fe866599700 1 Processor -- start 2023-10-14T18:49:43.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.279+0000 7fe866599700 1 -- start start 2023-10-14T18:49:43.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8600cdab0 0x7fe86016a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe86015dda0 0x7fe8600b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600b3de0 con 0x7fe8600cd6e0 2023-10-14T18:49:43.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600b3ab0 con 0x7fe8600cdab0 2023-10-14T18:49:43.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe866599700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86016ac80 con 0x7fe86015dda0 2023-10-14T18:49:43.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe865597700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe865597700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34494/0 (socket says 172.21.15.79:34494) 2023-10-14T18:49:43.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.280+0000 7fe865597700 1 -- 172.21.15.79:0/3181612755 learned_addr learned my addr 172.21.15.79:0/3181612755 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:43.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 -- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe86015dda0 msgr2=0x7fe8600b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe86015dda0 0x7fe8600b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 -- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8600cdab0 msgr2=0x7fe86016a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8600cdab0 0x7fe86016a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009a20 con 0x7fe8600cd6e0 2023-10-14T18:49:43.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe865597700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c7e0 tx=0x7fe85c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c005b30 con 0x7fe8600cd6e0 2023-10-14T18:49:43.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c005c90 con 0x7fe8600cd6e0 2023-10-14T18:49:43.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86016af60 con 0x7fe8600cd6e0 2023-10-14T18:49:43.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c007300 con 0x7fe8600cd6e0 2023-10-14T18:49:43.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.281+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86014cd00 con 0x7fe8600cd6e0 2023-10-14T18:49:43.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.282+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8600b40c0 con 0x7fe8600cd6e0 2023-10-14T18:49:43.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.282+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe85c01b400 con 0x7fe8600cd6e0 2023-10-14T18:49:43.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.282+0000 7fe8557fa700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.283+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe85c084040 con 0x7fe8600cd6e0 2023-10-14T18:49:43.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.283+0000 7fe864d96700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.283+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fe84406ea50 con 0x7fe8600cd6e0 2023-10-14T18:49:43.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.283+0000 7fe864d96700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 0x7fe8440693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe86015c1d0 tx=0x7fe850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.287+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe85c051330 con 0x7fe8600cd6e0 2023-10-14T18:49:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.509+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe86004bb80 con 0x7fe8600cd6e0 2023-10-14T18:49:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.510+0000 7fe8557fa700 1 -- 172.21.15.79:0/3181612755 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe85c054950 con 0x7fe8600cd6e0 2023-10-14T18:49:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:43.511 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 msgr2=0x7fe8440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 0x7fe8440693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe86015c1d0 tx=0x7fe850008040 comp rx=0 tx=0).stop 2023-10-14T18:49:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 msgr2=0x7fe86014c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c7e0 tx=0x7fe85c007df0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 shutdown_connections 2023-10-14T18:49:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe844066f30 0x7fe8440693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe86015dda0 0x7fe8600b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8600cd6e0 0x7fe86014c7c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 --2- 172.21.15.79:0/3181612755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8600cdab0 0x7fe86016a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 >> 172.21.15.79:0/3181612755 conn(0x7fe860067660 msgr2=0x7fe8600c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 shutdown_connections 2023-10-14T18:49:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.512+0000 7fe866599700 1 -- 172.21.15.79:0/3181612755 wait complete. 2023-10-14T18:49:43.515 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:43.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.638+0000 7f144e580700 1 Processor -- start 2023-10-14T18:49:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.638+0000 7f144e580700 1 -- start start 2023-10-14T18:49:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144e580700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f144815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144e580700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f144815a620 0x7f144815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144e580700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144815cbb0 con 0x7f144815d580 2023-10-14T18:49:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144e580700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144815bfa0 con 0x7f144815a620 2023-10-14T18:49:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144e580700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144815c280 con 0x7f1448157870 2023-10-14T18:49:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144cb1d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f144815d580 0x7f1448158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47826/0 (socket says 172.21.15.79:47826) 2023-10-14T18:49:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f144cb1d700 1 -- 172.21.15.79:0/2270784985 learned_addr learned my addr 172.21.15.79:0/2270784985 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.639+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> v2:172.21.15.144:3300/0 conn(0x7f144815a620 0x7f144815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1447fff700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f144815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383323272 0 0) 0x7f144815cbb0 con 0x7f144815d580 2023-10-14T18:49:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1430003570 con 0x7f144815d580 2023-10-14T18:49:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152415975 0 0) 0x7f1430003570 con 0x7f144815d580 2023-10-14T18:49:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 msgr2=0x7f144815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f144815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 >> v2:172.21.15.144:3300/0 conn(0x7f144815a620 msgr2=0x7f144815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 --2- 172.21.15.79:0/2270784985 >> v2:172.21.15.144:3300/0 conn(0x7f144815a620 0x7f144815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144815c560 con 0x7f144815d580 2023-10-14T18:49:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f14400017f0 con 0x7f144815d580 2023-10-14T18:49:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> v2:172.21.15.144:3300/0 conn(0x7f144815a620 0x7f144815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:49:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 >> v1:172.21.15.79:6789/0 conn(0x7f144815d580 legacy=0x7f1448158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f1430003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1430003fe0 0x7f1430004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430004d50 0x7f14300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144815bfa0 con 0x7f1430003fe0 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144815c280 con 0x7f1430004d50 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143000ba90 con 0x7f1448157870 2023-10-14T18:49:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1430003fe0 0x7f1430004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f1447fff700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f1430003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f144cb1d700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430004d50 0x7f14300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 -- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 msgr2=0x7f1430003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1448157870 0x7f1430003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 -- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430004d50 msgr2=0x7f14300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430004d50 0x7f14300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.640+0000 7f14477fe700 1 -- 172.21.15.79:0/2270784985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430003570 con 0x7f1430003fe0 2023-10-14T18:49:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f14477fe700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1430003fe0 0x7f1430004810 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f143c009df0 tx=0x7f143c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451ab74425821323 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00e8c0 con 0x7f1430003fe0 2023-10-14T18:49:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c00ea20 con 0x7f1430003fe0 2023-10-14T18:49:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f1446ffd700 1 -- 172.21.15.79:0/2270784985 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00edc0 con 0x7f1430003fe0 2023-10-14T18:49:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 -- 172.21.15.79:0/2270784985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1430003fe0 msgr2=0x7f1430004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 --2- 172.21.15.79:0/2270784985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1430003fe0 0x7f1430004810 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f143c009df0 tx=0x7f143c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144cb1d700 1 -- 172.21.15.79:0/2270784985 reap_dead start 2023-10-14T18:49:43.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 -- 172.21.15.79:0/2270784985 shutdown_connections 2023-10-14T18:49:43.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 -- 172.21.15.79:0/2270784985 >> 172.21.15.79:0/2270784985 conn(0x7f1448068ce0 msgr2=0x7f14480690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 -- 172.21.15.79:0/2270784985 shutdown_connections 2023-10-14T18:49:43.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.641+0000 7f144e580700 1 -- 172.21.15.79:0/2270784985 wait complete. 2023-10-14T18:49:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.642+0000 7f144e580700 1 Processor -- start 2023-10-14T18:49:43.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.642+0000 7f144e580700 1 -- start start 2023-10-14T18:49:43.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 0x7f144816a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144814e220 0x7f144814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480b06a0 con 0x7f14480b2110 2023-10-14T18:49:43.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144814bea0 con 0x7f1430003fe0 2023-10-14T18:49:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144e580700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144816ab70 con 0x7f144814e220 2023-10-14T18:49:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144cb1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144cb1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34506/0 (socket says 172.21.15.79:34506) 2023-10-14T18:49:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.643+0000 7f144cb1d700 1 -- 172.21.15.79:0/3635554013 learned_addr learned my addr 172.21.15.79:0/3635554013 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:43.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f1447fff700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 0x7f144816a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f14477fe700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144814e220 0x7f144814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 -- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144814e220 msgr2=0x7f144814b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144814e220 0x7f144814b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 -- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 msgr2=0x7f144816a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 0x7f144816a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144816ae50 con 0x7f14480b2110 2023-10-14T18:49:43.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f1447fff700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 0x7f144816a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:43.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144cb1d700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f144815b630 tx=0x7f1440002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000ae50 con 0x7f14480b2110 2023-10-14T18:49:43.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14400133f0 con 0x7f14480b2110 2023-10-14T18:49:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400137b0 con 0x7f14480b2110 2023-10-14T18:49:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144816b130 con 0x7f14480b2110 2023-10-14T18:49:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.644+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480b2580 con 0x7f14480b2110 2023-10-14T18:49:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.645+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144804c3c0 con 0x7f14480b2110 2023-10-14T18:49:43.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.645+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1440013b60 con 0x7f14480b2110 2023-10-14T18:49:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.646+0000 7f142ffff700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.646+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1440084fa0 con 0x7f14480b2110 2023-10-14T18:49:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.646+0000 7f1447fff700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.646+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f143406ea50 con 0x7f14480b2110 2023-10-14T18:49:43.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.646+0000 7f1447fff700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 0x7f14340693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1438006dc0 tx=0x7f1438008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.650+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1440052210 con 0x7f14480b2110 2023-10-14T18:49:43.790 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:49:43.789+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-10-14T18:49:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.791+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(90..90 src has 1..90) v4 ==== 304+0+0 (secure 0 0 0) 0x7f14400565d0 con 0x7f14480b2110 2023-10-14T18:49:43.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.791+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f143406f230 con 0x7f14480b2110 2023-10-14T18:49:43.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.834+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144815c840 con 0x7f14480b2110 2023-10-14T18:49:43.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.835+0000 7f142ffff700 1 -- 172.21.15.79:0/3635554013 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15375 (secure 0 0 0) 0x7f1440055a10 con 0x7f14480b2110 2023-10-14T18:49:43.836 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:43.836 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:43.790482+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 msgr2=0x7f14340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 0x7f14340693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1438006dc0 tx=0x7f1438008040 comp rx=0 tx=0).stop 2023-10-14T18:49:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 msgr2=0x7f14480d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f144815b630 tx=0x7f1440002210 comp rx=0 tx=0).stop 2023-10-14T18:49:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 shutdown_connections 2023-10-14T18:49:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1434066f30 0x7f14340693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14480b2110 0x7f14480d0860 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1430003fe0 0x7f144816a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 --2- 172.21.15.79:0/3635554013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f144814e220 0x7f144814b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 >> 172.21.15.79:0/3635554013 conn(0x7f1448068ce0 msgr2=0x7f14480b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 shutdown_connections 2023-10-14T18:49:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.837+0000 7f144e580700 1 -- 172.21.15.79:0/3635554013 wait complete. 2023-10-14T18:49:43.850 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:49:43.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.965+0000 7f0843fff700 1 Processor -- start 2023-10-14T18:49:43.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.965+0000 7f0843fff700 1 -- start start 2023-10-14T18:49:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0843fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08440cd6e0 0x7f08440cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0843fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08440cdab0 0x7f084415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0843fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440cb7c0 con 0x7f084415dda0 2023-10-14T18:49:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0843fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084415e850 con 0x7f08440cdab0 2023-10-14T18:49:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0843fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440cd030 con 0x7f08440cd6e0 2023-10-14T18:49:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08440cdab0 0x7f084415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08440cdab0 0x7f084415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34516/0 (socket says 172.21.15.79:34516) 2023-10-14T18:49:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 -- 172.21.15.79:0/4224496069 learned_addr learned my addr 172.21.15.79:0/4224496069 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f0842ffd700 1 --2- 172.21.15.79:0/4224496069 >> v2:172.21.15.144:3300/0 conn(0x7f08440cd6e0 0x7f08440cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 -- 172.21.15.79:0/4224496069 >> v2:172.21.15.144:3300/0 conn(0x7f08440cd6e0 msgr2=0x7f08440cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 --2- 172.21.15.79:0/4224496069 >> v2:172.21.15.144:3300/0 conn(0x7f08440cd6e0 0x7f08440cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 -- 172.21.15.79:0/4224496069 >> v1:172.21.15.144:6789/0 conn(0x7f084415dda0 legacy=0x7f084415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.966+0000 7f08427fc700 1 -- 172.21.15.79:0/4224496069 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084415e290 con 0x7f08440cdab0 2023-10-14T18:49:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f08427fc700 1 --2- 172.21.15.79:0/4224496069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08440cdab0 0x7f084415d860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f084406b730 tx=0x7f0838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27976efdef92bb55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0841ffb700 1 -- 172.21.15.79:0/4224496069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800b860 con 0x7f08440cdab0 2023-10-14T18:49:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0841ffb700 1 -- 172.21.15.79:0/4224496069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800b9c0 con 0x7f08440cdab0 2023-10-14T18:49:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0841ffb700 1 -- 172.21.15.79:0/4224496069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800bd60 con 0x7f08440cdab0 2023-10-14T18:49:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 -- 172.21.15.79:0/4224496069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08440cdab0 msgr2=0x7f084415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 --2- 172.21.15.79:0/4224496069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08440cdab0 0x7f084415d860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f084406b730 tx=0x7f0838009250 comp rx=0 tx=0).stop 2023-10-14T18:49:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 -- 172.21.15.79:0/4224496069 shutdown_connections 2023-10-14T18:49:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 --2- 172.21.15.79:0/4224496069 >> v2:172.21.15.144:3300/0 conn(0x7f08440cd6e0 0x7f08440cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 --2- 172.21.15.79:0/4224496069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08440cdab0 0x7f084415d860 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 -- 172.21.15.79:0/4224496069 >> 172.21.15.79:0/4224496069 conn(0x7f0844067660 msgr2=0x7f0844067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 -- 172.21.15.79:0/4224496069 shutdown_connections 2023-10-14T18:49:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.967+0000 7f0843fff700 1 -- 172.21.15.79:0/4224496069 wait complete. 2023-10-14T18:49:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 Processor -- start 2023-10-14T18:49:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 -- start start 2023-10-14T18:49:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 0x7f084414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08440cdab0 0x7f08440c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084414e840 con 0x7f084415dda0 2023-10-14T18:49:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844151220 con 0x7f08440cdab0 2023-10-14T18:49:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f0843fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084414eac0 con 0x7f08440cd6e0 2023-10-14T18:49:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f08437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f08437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34528/0 (socket says 172.21.15.79:34528) 2023-10-14T18:49:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.969+0000 7f08437fe700 1 -- 172.21.15.79:0/2660111984 learned_addr learned my addr 172.21.15.79:0/2660111984 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08427fc700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08440cdab0 0x7f08440c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f0842ffd700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 0x7f084414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 -- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 msgr2=0x7f084414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 0x7f084414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 -- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08440cdab0 msgr2=0x7f08440c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08440cdab0 0x7f08440c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08380094f0 con 0x7f084415dda0 2023-10-14T18:49:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f0842ffd700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 0x7f084414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f08437fe700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c490 tx=0x7f083c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c011590 con 0x7f084415dda0 2023-10-14T18:49:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c011710 con 0x7f084415dda0 2023-10-14T18:49:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08440c8ec0 con 0x7f084415dda0 2023-10-14T18:49:43.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c011ad0 con 0x7f084415dda0 2023-10-14T18:49:43.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.970+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440c8980 con 0x7f084415dda0 2023-10-14T18:49:43.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.971+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084414ec30 con 0x7f084415dda0 2023-10-14T18:49:43.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.972+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f083c01b3b0 con 0x7f084415dda0 2023-10-14T18:49:43.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.972+0000 7f082affd700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 0x7f0830069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:43.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.972+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f083c083910 con 0x7f084415dda0 2023-10-14T18:49:43.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.972+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f083006ead0 con 0x7f084415dda0 2023-10-14T18:49:43.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.972+0000 7f0842ffd700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 0x7f0830069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:43.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.973+0000 7f0842ffd700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 0x7f0830069460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f08340075e0 tx=0x7f08340097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:43.976+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f083c017020 con 0x7f084415dda0 2023-10-14T18:49:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.202+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0844089320 con 0x7f084415dda0 2023-10-14T18:49:44.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.203+0000 7f082affd700 1 -- 172.21.15.79:0/2660111984 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0844089320 con 0x7f084415dda0 2023-10-14T18:49:44.204 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:44.204 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 msgr2=0x7f0830069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 0x7f0830069460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f08340075e0 tx=0x7f08340097e0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 msgr2=0x7f08441573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c490 tx=0x7f083c007f20 comp rx=0 tx=0).stop 2023-10-14T18:49:44.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 shutdown_connections 2023-10-14T18:49:44.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0830066fb0 0x7f0830069460 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f084415dda0 0x7f08441573e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08440cd6e0 0x7f084414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 --2- 172.21.15.79:0/2660111984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08440cdab0 0x7f08440c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 >> 172.21.15.79:0/2660111984 conn(0x7f0844067660 msgr2=0x7f08440b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:44.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 shutdown_connections 2023-10-14T18:49:44.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.205+0000 7f0843fff700 1 -- 172.21.15.79:0/2660111984 wait complete. 2023-10-14T18:49:44.209 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:44.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:44.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.332+0000 7fbe0aea3700 1 Processor -- start 2023-10-14T18:49:44.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.332+0000 7fbe0aea3700 1 -- start start 2023-10-14T18:49:44.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe0aea3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbe0415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe0aea3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe0415a620 0x7fbe0415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe0aea3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0415cbb0 con 0x7fbe0415d580 2023-10-14T18:49:44.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe0aea3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0415bfa0 con 0x7fbe0415a620 2023-10-14T18:49:44.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe0aea3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0415c280 con 0x7fbe04157870 2023-10-14T18:49:44.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe09440700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbe0415d580 0x7fbe04158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47836/0 (socket says 172.21.15.79:47836) 2023-10-14T18:49:44.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.333+0000 7fbe09440700 1 -- 172.21.15.79:0/1513683619 learned_addr learned my addr 172.21.15.79:0/1513683619 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:44.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbe08c3f700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbe0415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/1513683619 >> v2:172.21.15.144:3300/0 conn(0x7fbe0415a620 0x7fbe0415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845939169 0 0) 0x7fbe0415cbb0 con 0x7fbe0415d580 2023-10-14T18:49:44.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec003570 con 0x7fbe0415d580 2023-10-14T18:49:44.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 661538506 0 0) 0x7fbdec003570 con 0x7fbe0415d580 2023-10-14T18:49:44.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 msgr2=0x7fbe0415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:44.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbe0415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 >> v2:172.21.15.144:3300/0 conn(0x7fbe0415a620 msgr2=0x7fbe0415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:44.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 --2- 172.21.15.79:0/1513683619 >> v2:172.21.15.144:3300/0 conn(0x7fbe0415a620 0x7fbe0415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0415c560 con 0x7fbe0415d580 2023-10-14T18:49:44.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fbdfc001470 con 0x7fbe0415d580 2023-10-14T18:49:44.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 >> v1:172.21.15.79:6789/0 conn(0x7fbe0415d580 legacy=0x7fbe04158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdec003a60 0x7fbdec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdec004810 0x7fbdec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbdec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0415bfa0 con 0x7fbdec004810 2023-10-14T18:49:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0415c280 con 0x7fbdec003a60 2023-10-14T18:49:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec00ba60 con 0x7fbe04157870 2023-10-14T18:49:44.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdec004810 0x7fbdec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbe08c3f700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdec003a60 0x7fbdec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbe09440700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbdec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 -- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 msgr2=0x7fbdec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:44.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe04157870 0x7fbdec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 -- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdec003a60 msgr2=0x7fbdec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:44.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdec003a60 0x7fbdec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.334+0000 7fbdfbfff700 1 -- 172.21.15.79:0/1513683619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec003570 con 0x7fbdec004810 2023-10-14T18:49:44.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdec004810 0x7fbdec004c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009c30 tx=0x7fbdf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407b7e71d567ea0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400e710 con 0x7fbdec004810 2023-10-14T18:49:44.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400e870 con 0x7fbdec004810 2023-10-14T18:49:44.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbdfb7fe700 1 -- 172.21.15.79:0/1513683619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400ec30 con 0x7fbdec004810 2023-10-14T18:49:44.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 -- 172.21.15.79:0/1513683619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdec004810 msgr2=0x7fbdec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/1513683619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbdec004810 0x7fbdec004c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009c30 tx=0x7fbdf40091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe09440700 1 -- 172.21.15.79:0/1513683619 reap_dead start 2023-10-14T18:49:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 -- 172.21.15.79:0/1513683619 shutdown_connections 2023-10-14T18:49:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 -- 172.21.15.79:0/1513683619 >> 172.21.15.79:0/1513683619 conn(0x7fbe04068ce0 msgr2=0x7fbe040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 -- 172.21.15.79:0/1513683619 shutdown_connections 2023-10-14T18:49:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.335+0000 7fbe0aea3700 1 -- 172.21.15.79:0/1513683619 wait complete. 2023-10-14T18:49:44.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.336+0000 7fbe0aea3700 1 Processor -- start 2023-10-14T18:49:44.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 -- start start 2023-10-14T18:49:44.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdec004810 0x7fbe04143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 0x7fbe04154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04159ec0 con 0x7fbe04159520 2023-10-14T18:49:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe041552a0 con 0x7fbe04158e90 2023-10-14T18:49:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe0aea3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04155580 con 0x7fbdec004810 2023-10-14T18:49:44.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe09440700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe09440700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34540/0 (socket says 172.21.15.79:34540) 2023-10-14T18:49:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.337+0000 7fbe09440700 1 -- 172.21.15.79:0/696172067 learned_addr learned my addr 172.21.15.79:0/696172067 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 0x7fbe04154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe08c3f700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdec004810 0x7fbe04143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 -- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdec004810 msgr2=0x7fbe04143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdec004810 0x7fbe04143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 -- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 msgr2=0x7fbe04154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 0x7fbe04154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04155860 con 0x7fbe04159520 2023-10-14T18:49:44.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbdfbfff700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 0x7fbe04154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:44.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe09440700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbe0415b630 tx=0x7fbdfc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc018030 con 0x7fbe04159520 2023-10-14T18:49:44.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00f970 con 0x7fbe04159520 2023-10-14T18:49:44.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe04155b40 con 0x7fbe04159520 2023-10-14T18:49:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00fcf0 con 0x7fbe04159520 2023-10-14T18:49:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.338+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04143b80 con 0x7fbe04159520 2023-10-14T18:49:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.339+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0404c3c0 con 0x7fbe04159520 2023-10-14T18:49:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.339+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdfc01b070 con 0x7fbe04159520 2023-10-14T18:49:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.340+0000 7fbdf8ff9700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.340+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdfc019070 con 0x7fbe04159520 2023-10-14T18:49:44.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.340+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fbdf006ea50 con 0x7fbe04159520 2023-10-14T18:49:44.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.340+0000 7fbe08c3f700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.340+0000 7fbe08c3f700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 0x7fbdf00693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe000099f0 tx=0x7fbe0000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.344+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdfc051610 con 0x7fbe04159520 2023-10-14T18:49:44.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.567+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe0415c840 con 0x7fbe04159520 2023-10-14T18:49:44.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.567+0000 7fbdf8ff9700 1 -- 172.21.15.79:0/696172067 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbdfc054c30 con 0x7fbe04159520 2023-10-14T18:49:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:44.569 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:00.029287+0000","modified":"2023-10-14T18:49:03.686926+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/4032643414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4032643414},{"type":"v1","addr":"172.21.15.79:6835","nonce":4032643414}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-14T18:49:44.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.569+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 msgr2=0x7fbdf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.569+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 0x7fbdf00693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbe000099f0 tx=0x7fbe0000b040 comp rx=0 tx=0).stop 2023-10-14T18:49:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.569+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 msgr2=0x7fbe04159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.569+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbe0415b630 tx=0x7fbdfc001e90 comp rx=0 tx=0).stop 2023-10-14T18:49:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.569+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 shutdown_connections 2023-10-14T18:49:44.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbdf0066f30 0x7fbdf00693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe04159520 0x7fbe04159980 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbdec004810 0x7fbe04143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 --2- 172.21.15.79:0/696172067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe04158e90 0x7fbe04154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 >> 172.21.15.79:0/696172067 conn(0x7fbe04068ce0 msgr2=0x7fbe040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 shutdown_connections 2023-10-14T18:49:44.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.570+0000 7fbe0aea3700 1 -- 172.21.15.79:0/696172067 wait complete. 2023-10-14T18:49:44.573 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 40 2023-10-14T18:49:44.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.697+0000 7fa536272700 1 Processor -- start 2023-10-14T18:49:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.697+0000 7fa536272700 1 -- start start 2023-10-14T18:49:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa536272700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa53015a2b0 0x7fa5300b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa536272700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5300cfe20 0x7fa5300ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa536272700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5300c5d80 con 0x7fa5300d1c30 2023-10-14T18:49:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa536272700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa530068470 con 0x7fa5300cfe20 2023-10-14T18:49:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa536272700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300c6060 con 0x7fa53015a2b0 2023-10-14T18:49:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5300cfe20 0x7fa5300ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa5300cfe20 0x7fa5300ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34546/0 (socket says 172.21.15.79:34546) 2023-10-14T18:49:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 -- 172.21.15.79:0/2449856359 learned_addr learned my addr 172.21.15.79:0/2449856359 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa52ffff700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa53015a2b0 0x7fa5300b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 -- 172.21.15.79:0/2449856359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa53015a2b0 msgr2=0x7fa5300b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:44.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa53015a2b0 0x7fa5300b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 -- 172.21.15.79:0/2449856359 >> v1:172.21.15.144:6789/0 conn(0x7fa5300d1c30 legacy=0x7fa5300cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 -- 172.21.15.79:0/2449856359 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5300c6340 con 0x7fa5300cfe20 2023-10-14T18:49:44.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa53480f700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa5300ccdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa528009f20 tx=0x7fa528009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962938117f9d8f21 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa52effd700 1 -- 172.21.15.79:0/2449856359 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52800e070 con 0x7fa5300cfe20 2023-10-14T18:49:44.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa52effd700 1 -- 172.21.15.79:0/2449856359 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52800ba80 con 0x7fa5300cfe20 2023-10-14T18:49:44.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.698+0000 7fa52effd700 1 -- 172.21.15.79:0/2449856359 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280092e0 con 0x7fa5300cfe20 2023-10-14T18:49:44.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 -- 172.21.15.79:0/2449856359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 msgr2=0x7fa5300ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa5300ccdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa528009f20 tx=0x7fa528009840 comp rx=0 tx=0).stop 2023-10-14T18:49:44.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 -- 172.21.15.79:0/2449856359 shutdown_connections 2023-10-14T18:49:44.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa5300ccdd0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 --2- 172.21.15.79:0/2449856359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa53015a2b0 0x7fa5300b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 -- 172.21.15.79:0/2449856359 >> 172.21.15.79:0/2449856359 conn(0x7fa530067e40 msgr2=0x7fa5300d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:44.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 -- 172.21.15.79:0/2449856359 shutdown_connections 2023-10-14T18:49:44.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.699+0000 7fa536272700 1 -- 172.21.15.79:0/2449856359 wait complete. 2023-10-14T18:49:44.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.700+0000 7fa536272700 1 Processor -- start 2023-10-14T18:49:44.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.700+0000 7fa536272700 1 -- start start 2023-10-14T18:49:44.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 0x7fa53015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 0x7fa530068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5301560f0 con 0x7fa5300cfe20 2023-10-14T18:49:44.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53016b3b0 con 0x7fa53015a2b0 2023-10-14T18:49:44.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa536272700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53016a7a0 con 0x7fa5300d1c30 2023-10-14T18:49:44.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34560/0 (socket says 172.21.15.79:34560) 2023-10-14T18:49:44.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 -- 172.21.15.79:0/524978253 learned_addr learned my addr 172.21.15.79:0/524978253 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:44.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa53480f700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 0x7fa530068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52f7fe700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 0x7fa53015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 -- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 msgr2=0x7fa53015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 0x7fa53015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 -- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 msgr2=0x7fa530068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 0x7fa530068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009ae0 con 0x7fa5300cfe20 2023-10-14T18:49:44.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52f7fe700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 0x7fa53015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:44.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa53480f700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 0x7fa530068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:44.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa52ffff700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa52000d840 tx=0x7fa520008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520014620 con 0x7fa5300cfe20 2023-10-14T18:49:44.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.701+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa520014780 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.702+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53016aa80 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.702+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa520014b40 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.702+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53016b040 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.702+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53004c3c0 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.703+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa52001d400 con 0x7fa5300cfe20 2023-10-14T18:49:44.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.703+0000 7fa517fff700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:44.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.703+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa520084da0 con 0x7fa5300cfe20 2023-10-14T18:49:44.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.703+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fa51c06ea50 con 0x7fa5300cfe20 2023-10-14T18:49:44.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.704+0000 7fa52f7fe700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:44.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.704+0000 7fa52f7fe700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 0x7fa51c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa524007fd0 tx=0x7fa524009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.707+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa520052010 con 0x7fa5300cfe20 2023-10-14T18:49:44.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.894+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa530064a00 con 0x7fa5300cfe20 2023-10-14T18:49:44.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.894+0000 7fa517fff700 1 -- 172.21.15.79:0/524978253 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15375 (secure 0 0 0) 0x7fa520055630 con 0x7fa5300cfe20 2023-10-14T18:49:44.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:44.896 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:43.790482+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:48:57.860905+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-14T18:48:58.995999+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 msgr2=0x7fa51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 0x7fa51c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa524007fd0 tx=0x7fa524009040 comp rx=0 tx=0).stop 2023-10-14T18:49:44.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 msgr2=0x7fa530155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:44.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa52000d840 tx=0x7fa520008040 comp rx=0 tx=0).stop 2023-10-14T18:49:44.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 shutdown_connections 2023-10-14T18:49:44.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa51c066f30 0x7fa51c0693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa53015a2b0 0x7fa530068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5300cfe20 0x7fa530155bb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 --2- 172.21.15.79:0/524978253 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5300d1c30 0x7fa53015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.896+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 >> 172.21.15.79:0/524978253 conn(0x7fa530067e40 msgr2=0x7fa5300cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:44.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.897+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 shutdown_connections 2023-10-14T18:49:44.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:44.897+0000 7fa536272700 1 -- 172.21.15.79:0/524978253 wait complete. 2023-10-14T18:49:44.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:49:45.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.024+0000 7f5370ece700 1 Processor -- start 2023-10-14T18:49:45.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.024+0000 7f5370ece700 1 -- start start 2023-10-14T18:49:45.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5370ece700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5370ece700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c15cbb0 con 0x7f536c15d580 2023-10-14T18:49:45.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5370ece700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536c15bfa0 con 0x7f536c157870 2023-10-14T18:49:45.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5370ece700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c15bdb0 con 0x7f536c15a620 2023-10-14T18:49:45.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f536ad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f536c15d580 0x7f536c158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47846/0 (socket says 172.21.15.79:47846) 2023-10-14T18:49:45.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f536ad9d700 1 -- 172.21.15.79:0/990404281 learned_addr learned my addr 172.21.15.79:0/990404281 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:45.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5361d9b700 1 --2- 172.21.15.79:0/990404281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277714876 0 0) 0x7f536c15cbb0 con 0x7f536c15d580 2023-10-14T18:49:45.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5358003570 con 0x7f536c15d580 2023-10-14T18:49:45.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223483476 0 0) 0x7f536c15bfa0 con 0x7f536c157870 2023-10-14T18:49:45.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.025+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c15cbb0 con 0x7f536c157870 2023-10-14T18:49:45.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5361d9b700 1 -- 172.21.15.79:0/990404281 >> v1:172.21.15.144:6789/0 conn(0x7f536c157870 legacy=0x7f536c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5361d9b700 1 -- 172.21.15.79:0/990404281 >> v1:172.21.15.79:6789/0 conn(0x7f536c15d580 legacy=0x7f536c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5361d9b700 1 -- 172.21.15.79:0/990404281 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c15c280 con 0x7f536c15a620 2023-10-14T18:49:45.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5361d9b700 1 --2- 172.21.15.79:0/990404281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c15d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5354009910 tx=0x7f53540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2670d024d74ce69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011630 con 0x7f536c15a620 2023-10-14T18:49:45.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354011790 con 0x7f536c15a620 2023-10-14T18:49:45.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5369d9b700 1 -- 172.21.15.79:0/990404281 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011b10 con 0x7f536c15a620 2023-10-14T18:49:45.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 -- 172.21.15.79:0/990404281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 msgr2=0x7f536c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 --2- 172.21.15.79:0/990404281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c15d040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5354009910 tx=0x7f53540091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 -- 172.21.15.79:0/990404281 shutdown_connections 2023-10-14T18:49:45.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 --2- 172.21.15.79:0/990404281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c15d040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 -- 172.21.15.79:0/990404281 >> 172.21.15.79:0/990404281 conn(0x7f536c068ce0 msgr2=0x7f536c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:45.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 -- 172.21.15.79:0/990404281 shutdown_connections 2023-10-14T18:49:45.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.026+0000 7f5370ece700 1 -- 172.21.15.79:0/990404281 wait complete. 2023-10-14T18:49:45.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 Processor -- start 2023-10-14T18:49:45.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 -- start start 2023-10-14T18:49:45.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 0x7f536c14bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c16a9c0 con 0x7f536c157870 2023-10-14T18:49:45.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c16b970 con 0x7f536c15d580 2023-10-14T18:49:45.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.028+0000 7f5370ece700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c153b00 con 0x7f536c15a620 2023-10-14T18:49:45.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34572/0 (socket says 172.21.15.79:34572) 2023-10-14T18:49:45.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 -- 172.21.15.79:0/2775175952 learned_addr learned my addr 172.21.15.79:0/2775175952 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:45.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5361d9b700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536ad9d700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 0x7f536c14bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 -- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 msgr2=0x7f536c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 -- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 msgr2=0x7f536c14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 0x7f536c14bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009420 con 0x7f536c157870 2023-10-14T18:49:45.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536ad9d700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 0x7f536c14bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:45.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f536a59c700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c7c0 tx=0x7f535c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c010510 con 0x7f536c157870 2023-10-14T18:49:45.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c010670 con 0x7f536c157870 2023-10-14T18:49:45.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c16b4e0 con 0x7f536c157870 2023-10-14T18:49:45.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c010a10 con 0x7f536c157870 2023-10-14T18:49:45.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.029+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c16abb0 con 0x7f536c157870 2023-10-14T18:49:45.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.030+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c16b7c0 con 0x7f536c157870 2023-10-14T18:49:45.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.030+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f535c01b3b0 con 0x7f536c157870 2023-10-14T18:49:45.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.031+0000 7f5362ffd700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 0x7f534c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.031+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f535c084810 con 0x7f536c157870 2023-10-14T18:49:45.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.031+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f534c06ea50 con 0x7f536c157870 2023-10-14T18:49:45.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.031+0000 7f5361d9b700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 0x7f534c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.031+0000 7f5361d9b700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 0x7f534c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f536c15aa20 tx=0x7f5354017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.035+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f535c017070 con 0x7f536c157870 2023-10-14T18:49:45.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.258+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f536c04c3c0 con 0x7f536c157870 2023-10-14T18:49:45.260 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:49:45.259+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:49:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.263+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(91..91 src has 1..91) v4 ==== 366+0+0 (secure 0 0 0) 0x7f535c0553e0 con 0x7f536c157870 2023-10-14T18:49:45.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.263+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f534c06f3a0 con 0x7f536c157870 2023-10-14T18:49:45.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.266+0000 7f5362ffd700 1 -- 172.21.15.79:0/2775175952 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f535c051020 con 0x7f536c157870 2023-10-14T18:49:45.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 msgr2=0x7f534c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 0x7f534c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f536c15aa20 tx=0x7f5354017000 comp rx=0 tx=0).stop 2023-10-14T18:49:45.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 msgr2=0x7f536c153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c7c0 tx=0x7f535c007e10 comp rx=0 tx=0).stop 2023-10-14T18:49:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 shutdown_connections 2023-10-14T18:49:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f534c066f30 0x7f534c0693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f536c15d580 0x7f536c14bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f536c157870 0x7f536c153320 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 --2- 172.21.15.79:0/2775175952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f536c15a620 0x7f536c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 >> 172.21.15.79:0/2775175952 conn(0x7f536c068ce0 msgr2=0x7f536c1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 shutdown_connections 2023-10-14T18:49:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.269+0000 7f5370ece700 1 -- 172.21.15.79:0/2775175952 wait complete. 2023-10-14T18:49:45.273 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:49:45.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:49:45.304 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:49:45.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.402+0000 7f0cf95f3700 1 Processor -- start 2023-10-14T18:49:45.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.402+0000 7f0cf95f3700 1 -- start start 2023-10-14T18:49:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf95f3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0cf415b9a0 0x7f0cf40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf95f3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf415c8d0 con 0x7f0cf4152300 2023-10-14T18:49:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf95f3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40c9370 con 0x7f0cf406d370 2023-10-14T18:49:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf95f3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40b1400 con 0x7f0cf415b9a0 2023-10-14T18:49:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0cf4152300 0x7f0cf4158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47862/0 (socket says 172.21.15.79:47862) 2023-10-14T18:49:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf2ffd700 1 -- 172.21.15.79:0/626951617 learned_addr learned my addr 172.21.15.79:0/626951617 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.403+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737844973 0 0) 0x7f0cf415c8d0 con 0x7f0cf4152300 2023-10-14T18:49:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce0003570 con 0x7f0cf4152300 2023-10-14T18:49:45.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/626951617 >> v2:172.21.15.144:3300/0 conn(0x7f0cf415b9a0 0x7f0cf40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659330055 0 0) 0x7f0ce0003570 con 0x7f0cf4152300 2023-10-14T18:49:45.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 >> v2:172.21.15.144:3300/0 conn(0x7f0cf415b9a0 msgr2=0x7f0cf40caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:45.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 --2- 172.21.15.79:0/626951617 >> v2:172.21.15.144:3300/0 conn(0x7f0cf415b9a0 0x7f0cf40caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 >> v1:172.21.15.144:6789/0 conn(0x7f0cf406d370 legacy=0x7f0cf406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf415c030 con 0x7f0cf4152300 2023-10-14T18:49:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0ce4001470 con 0x7f0cf4152300 2023-10-14T18:49:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 >> v1:172.21.15.79:6789/0 conn(0x7f0cf4152300 legacy=0x7f0cf4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ce0003a60 0x7f0ce0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0ce000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000c0a0 con 0x7f0ce00051c0 2023-10-14T18:49:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000c210 con 0x7f0ce0004810 2023-10-14T18:49:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000c3d0 con 0x7f0ce0003a60 2023-10-14T18:49:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0ce000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf2ffd700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ce0003a60 0x7f0ce0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 -- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ce0003a60 msgr2=0x7f0ce0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:45.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ce0003a60 0x7f0ce0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 -- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ce0004810 msgr2=0x7f0ce0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:45.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 -- 172.21.15.79:0/626951617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0003570 con 0x7f0ce00051c0 2023-10-14T18:49:45.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf2ffd700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ce0003a60 0x7f0ce0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:45.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ce0004810 0x7f0ce0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:45.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 -- 172.21.15.79:0/626951617 reap_dead start 2023-10-14T18:49:45.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.404+0000 7f0cf37fe700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0ce000ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0cec001fc0 tx=0x7f0cec001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43389239612ebb06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec001950 con 0x7f0ce00051c0 2023-10-14T18:49:45.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00c8b0 con 0x7f0ce00051c0 2023-10-14T18:49:45.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf27fc700 1 -- 172.21.15.79:0/626951617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00cc90 con 0x7f0ce00051c0 2023-10-14T18:49:45.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 -- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 msgr2=0x7f0ce000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0ce000ba60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0cec001fc0 tx=0x7f0cec001640 comp rx=0 tx=0).stop 2023-10-14T18:49:45.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 -- 172.21.15.79:0/626951617 shutdown_connections 2023-10-14T18:49:45.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/626951617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0ce000ba60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 -- 172.21.15.79:0/626951617 >> 172.21.15.79:0/626951617 conn(0x7f0cf4069870 msgr2=0x7f0cf4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 -- 172.21.15.79:0/626951617 shutdown_connections 2023-10-14T18:49:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.405+0000 7f0cf95f3700 1 -- 172.21.15.79:0/626951617 wait complete. 2023-10-14T18:49:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.406+0000 7f0cf95f3700 1 Processor -- start 2023-10-14T18:49:45.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.406+0000 7f0cf95f3700 1 -- start start 2023-10-14T18:49:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf40c76e0 0x7f0cf40c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf41684d0 0x7f0cf4168940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4143c20 con 0x7f0ce00051c0 2023-10-14T18:49:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4169530 con 0x7f0cf41684d0 2023-10-14T18:49:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf95f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4152ec0 con 0x7f0cf40c76e0 2023-10-14T18:49:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34604/0 (socket says 172.21.15.79:34604) 2023-10-14T18:49:45.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 -- 172.21.15.79:0/1687826513 learned_addr learned my addr 172.21.15.79:0/1687826513 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf40c76e0 0x7f0cf40c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf37fe700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf41684d0 0x7f0cf4168940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 -- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf40c76e0 msgr2=0x7f0cf40c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf40c76e0 0x7f0cf40c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 -- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf41684d0 msgr2=0x7f0cf4168940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf41684d0 0x7f0cf4168940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.407+0000 7f0cf2ffd700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40c8090 con 0x7f0ce00051c0 2023-10-14T18:49:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0cf2ffd700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400e880 tx=0x7f0ce4000d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400a520 con 0x7f0ce00051c0 2023-10-14T18:49:45.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4010040 con 0x7f0ce00051c0 2023-10-14T18:49:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400a8b0 con 0x7f0ce00051c0 2023-10-14T18:49:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf41696f0 con 0x7f0ce00051c0 2023-10-14T18:49:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.408+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf4152870 con 0x7f0ce00051c0 2023-10-14T18:49:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.409+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf41526d0 con 0x7f0ce00051c0 2023-10-14T18:49:45.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.409+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ce400ac20 con 0x7f0ce00051c0 2023-10-14T18:49:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.409+0000 7f0ceb7fe700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.410+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0ce40838d0 con 0x7f0ce00051c0 2023-10-14T18:49:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.410+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7f0cd406eaf0 con 0x7f0ce00051c0 2023-10-14T18:49:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.410+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:45.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.410+0000 7f0cea7fc700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006c80 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:45.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.414+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ce404d5a0 con 0x7f0ce00051c0 2023-10-14T18:49:45.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:45.638+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0cf404c3c0 con 0x7f0ce00051c0 2023-10-14T18:49:46.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.263+0000 7f0ceb7fe700 1 -- 172.21.15.79:0/1687826513 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ce4019070 con 0x7f0ce00051c0 2023-10-14T18:49:46.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 msgr2=0x7f0cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:46.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006c80 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2023-10-14T18:49:46.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 msgr2=0x7f0cf41436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:46.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400e880 tx=0x7f0ce4000d70 comp rx=0 tx=0).stop 2023-10-14T18:49:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 shutdown_connections 2023-10-14T18:49:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cf41684d0 0x7f0cf4168940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ce00051c0 0x7f0cf41436e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 --2- 172.21.15.79:0/1687826513 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cf40c76e0 0x7f0cf40c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 >> 172.21.15.79:0/1687826513 conn(0x7f0cf4069870 msgr2=0x7f0cf40c39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:46.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 shutdown_connections 2023-10-14T18:49:46.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.266+0000 7f0cf95f3700 1 -- 172.21.15.79:0/1687826513 wait complete. 2023-10-14T18:49:46.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:49:46.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.440+0000 7ff62fddd700 1 Processor -- start 2023-10-14T18:49:46.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.440+0000 7ff62fddd700 1 -- start start 2023-10-14T18:49:46.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff628070950 0x7ff62806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff628067e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6281431f0 0x7ff628143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280c8640 con 0x7ff6281431f0 2023-10-14T18:49:46.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280c8e80 con 0x7ff628070950 2023-10-14T18:49:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62fddd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff628068350 con 0x7ff628070d20 2023-10-14T18:49:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62e37a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6281431f0 0x7ff628143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62e37a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6281431f0 0x7ff628143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34614/0 (socket says 172.21.15.79:34614) 2023-10-14T18:49:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.441+0000 7ff62e37a700 1 -- 172.21.15.79:0/2598735688 learned_addr learned my addr 172.21.15.79:0/2598735688 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:46.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62db79700 1 --2- 172.21.15.79:0/2598735688 >> v2:172.21.15.144:3300/0 conn(0x7ff628070950 0x7ff62806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62d378700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff628067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 -- 172.21.15.79:0/2598735688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 msgr2=0x7ff628067e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff628067e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 -- 172.21.15.79:0/2598735688 >> v2:172.21.15.144:3300/0 conn(0x7ff628070950 msgr2=0x7ff62806ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:46.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 --2- 172.21.15.79:0/2598735688 >> v2:172.21.15.144:3300/0 conn(0x7ff628070950 0x7ff62806ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 -- 172.21.15.79:0/2598735688 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62806f630 con 0x7ff6281431f0 2023-10-14T18:49:46.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62e37a700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6281431f0 0x7ff628143620 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff62806de10 tx=0x7ff620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fed212c32a82c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:46.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62cb77700 1 -- 172.21.15.79:0/2598735688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62000b860 con 0x7ff6281431f0 2023-10-14T18:49:46.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62cb77700 1 -- 172.21.15.79:0/2598735688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62000b9c0 con 0x7ff6281431f0 2023-10-14T18:49:46.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62cb77700 1 -- 172.21.15.79:0/2598735688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62000bd60 con 0x7ff6281431f0 2023-10-14T18:49:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 -- 172.21.15.79:0/2598735688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6281431f0 msgr2=0x7ff628143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6281431f0 0x7ff628143620 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff62806de10 tx=0x7ff620009250 comp rx=0 tx=0).stop 2023-10-14T18:49:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 -- 172.21.15.79:0/2598735688 shutdown_connections 2023-10-14T18:49:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6281431f0 0x7ff628143620 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 --2- 172.21.15.79:0/2598735688 >> v2:172.21.15.144:3300/0 conn(0x7ff628070950 0x7ff62806ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 --2- 172.21.15.79:0/2598735688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff628067e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.442+0000 7ff62fddd700 1 -- 172.21.15.79:0/2598735688 >> 172.21.15.79:0/2598735688 conn(0x7ff6280ce570 msgr2=0x7ff6280ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.443+0000 7ff62fddd700 1 -- 172.21.15.79:0/2598735688 shutdown_connections 2023-10-14T18:49:46.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.443+0000 7ff62fddd700 1 -- 172.21.15.79:0/2598735688 wait complete. 2023-10-14T18:49:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 Processor -- start 2023-10-14T18:49:46.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 -- start start 2023-10-14T18:49:46.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff62815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6281431f0 0x7ff628169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62815b1d0 con 0x7ff628070950 2023-10-14T18:49:46.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62815a5c0 con 0x7ff6281431f0 2023-10-14T18:49:46.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62fddd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62815a8a0 con 0x7ff628070d20 2023-10-14T18:49:46.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62db79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62db79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34622/0 (socket says 172.21.15.79:34622) 2023-10-14T18:49:46.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.444+0000 7ff62db79700 1 -- 172.21.15.79:0/3835682333 learned_addr learned my addr 172.21.15.79:0/3835682333 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:46.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62e37a700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6281431f0 0x7ff628169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62d378700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff62815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 -- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 msgr2=0x7ff62815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:46.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff62815cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 -- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6281431f0 msgr2=0x7ff628169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:46.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6281431f0 0x7ff628169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200094f0 con 0x7ff628070950 2023-10-14T18:49:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62d378700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff62815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62db79700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff624009fa0 tx=0x7ff624009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400ec70 con 0x7ff628070950 2023-10-14T18:49:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62400edd0 con 0x7ff628070950 2023-10-14T18:49:46.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62815ab80 con 0x7ff628070950 2023-10-14T18:49:46.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624014670 con 0x7ff628070950 2023-10-14T18:49:46.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.445+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62815d2b0 con 0x7ff628070950 2023-10-14T18:49:46.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.446+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62815b4b0 con 0x7ff628070950 2023-10-14T18:49:46.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.447+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6240149e0 con 0x7ff628070950 2023-10-14T18:49:46.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.447+0000 7ff61dffb700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 0x7ff60c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:46.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.447+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff624084c20 con 0x7ff628070950 2023-10-14T18:49:46.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.447+0000 7ff62d378700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 0x7ff60c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:46.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.447+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7ff60c06eaf0 con 0x7ff628070950 2023-10-14T18:49:46.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.448+0000 7ff62d378700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 0x7ff60c0693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff62813e480 tx=0x7ff618008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:46.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.451+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff624051e40 con 0x7ff628070950 2023-10-14T18:49:46.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:46.633+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff62804c3c0 con 0x7ff628070950 2023-10-14T18:49:47.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.266+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(92..92 src has 1..92) v4 ==== 288+0+0 (secure 0 0 0) 0x7ff62408b080 con 0x7ff628070950 2023-10-14T18:49:47.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.267+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7ff60c06cf20 con 0x7ff628070950 2023-10-14T18:49:47.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.269+0000 7ff61dffb700 1 -- 172.21.15.79:0/3835682333 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff624055460 con 0x7ff628070950 2023-10-14T18:49:47.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 msgr2=0x7ff60c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 0x7ff60c0693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff62813e480 tx=0x7ff618008040 comp rx=0 tx=0).stop 2023-10-14T18:49:47.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 msgr2=0x7ff62813e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff624009fa0 tx=0x7ff624009880 comp rx=0 tx=0).stop 2023-10-14T18:49:47.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 shutdown_connections 2023-10-14T18:49:47.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff60c066f30 0x7ff60c0693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6281431f0 0x7ff628169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff628070950 0x7ff62813e4d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 --2- 172.21.15.79:0/3835682333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff628070d20 0x7ff62815cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 >> 172.21.15.79:0/3835682333 conn(0x7ff6280ce570 msgr2=0x7ff6280c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:47.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 shutdown_connections 2023-10-14T18:49:47.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.274+0000 7ff62fddd700 1 -- 172.21.15.79:0/3835682333 wait complete. 2023-10-14T18:49:47.277 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:49:47.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:49:47.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.405+0000 7f5f86ac4700 1 Processor -- start 2023-10-14T18:49:47.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.405+0000 7f5f86ac4700 1 -- start start 2023-10-14T18:49:47.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f86ac4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f80159ef0 0x7f5f8015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f86ac4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f800b46f0 0x7f5f800b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f86ac4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f800b5090 con 0x7f5f800b6a10 2023-10-14T18:49:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f86ac4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800b17b0 con 0x7f5f800b46f0 2023-10-14T18:49:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f86ac4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800b1a60 con 0x7f5f80159ef0 2023-10-14T18:49:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f800b46f0 0x7f5f800b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f77fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5f800b6a10 0x7f5f800b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47872/0 (socket says 172.21.15.79:47872) 2023-10-14T18:49:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f77fff700 1 -- 172.21.15.79:0/2676316172 learned_addr learned my addr 172.21.15.79:0/2676316172 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 -- 172.21.15.79:0/2676316172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f80159ef0 msgr2=0x7f5f8015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 --2- 172.21.15.79:0/2676316172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f80159ef0 0x7f5f8015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 -- 172.21.15.79:0/2676316172 >> v1:172.21.15.79:6789/0 conn(0x7f5f800b6a10 legacy=0x7f5f800b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f777fe700 1 -- 172.21.15.79:0/2676316172 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469242212 0 0) 0x7f5f70001110 con 0x7f5f800b6a10 2023-10-14T18:49:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 -- 172.21.15.79:0/2676316172 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800b1d40 con 0x7f5f800b46f0 2023-10-14T18:49:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.406+0000 7f5f85061700 1 --2- 172.21.15.79:0/2676316172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f800b4b50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5f780098e0 tx=0x7f5f780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7329efb3c1632a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f777fe700 1 -- 172.21.15.79:0/2676316172 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78009e80 con 0x7f5f800b46f0 2023-10-14T18:49:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f777fe700 1 -- 172.21.15.79:0/2676316172 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7800b860 con 0x7f5f800b46f0 2023-10-14T18:49:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f777fe700 1 -- 172.21.15.79:0/2676316172 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7800bbe0 con 0x7f5f800b46f0 2023-10-14T18:49:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2676316172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 msgr2=0x7f5f800b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2676316172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f800b4b50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5f780098e0 tx=0x7f5f780091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2676316172 shutdown_connections 2023-10-14T18:49:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2676316172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f800b4b50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2676316172 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f80159ef0 0x7f5f8015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2676316172 >> 172.21.15.79:0/2676316172 conn(0x7f5f8009a0a0 msgr2=0x7f5f80067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2676316172 shutdown_connections 2023-10-14T18:49:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.407+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2676316172 wait complete. 2023-10-14T18:49:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.408+0000 7f5f86ac4700 1 Processor -- start 2023-10-14T18:49:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.408+0000 7f5f86ac4700 1 -- start start 2023-10-14T18:49:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 0x7f5f800afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f80159ef0 0x7f5f800ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8009bce0 con 0x7f5f800b46f0 2023-10-14T18:49:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8009c6b0 con 0x7f5f80159ef0 2023-10-14T18:49:47.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f86ac4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800b0060 con 0x7f5f800b6a10 2023-10-14T18:49:47.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f84860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:47.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f84860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34646/0 (socket says 172.21.15.79:34646) 2023-10-14T18:49:47.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f84860700 1 -- 172.21.15.79:0/2422746862 learned_addr learned my addr 172.21.15.79:0/2422746862 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:47.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f77fff700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 0x7f5f800afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:47.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.409+0000 7f5f85061700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f80159ef0 0x7f5f800ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:47.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 -- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 msgr2=0x7f5f800afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 0x7f5f800afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 -- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f80159ef0 msgr2=0x7f5f800ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f80159ef0 0x7f5f800ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78009420 con 0x7f5f800b46f0 2023-10-14T18:49:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f77fff700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 0x7f5f800afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f84860700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00bc30 tx=0x7f5f7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0092e0 con 0x7f5f800b46f0 2023-10-14T18:49:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00c6f0 con 0x7f5f800b46f0 2023-10-14T18:49:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8009b0d0 con 0x7f5f800b46f0 2023-10-14T18:49:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00cad0 con 0x7f5f800b46f0 2023-10-14T18:49:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.410+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8009b690 con 0x7f5f800b46f0 2023-10-14T18:49:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.411+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8009bfc0 con 0x7f5f800b46f0 2023-10-14T18:49:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.411+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7c012070 con 0x7f5f800b46f0 2023-10-14T18:49:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.412+0000 7f5f74ff9700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.412+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5f7c083f60 con 0x7f5f800b46f0 2023-10-14T18:49:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.412+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f5f6c06dcf0 con 0x7f5f800b46f0 2023-10-14T18:49:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.412+0000 7f5f77fff700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.412+0000 7f5f77fff700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5f8006a500 tx=0x7f5f70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.416+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f7c051330 con 0x7f5f800b46f0 2023-10-14T18:49:47.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:47.600+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f8008ae30 con 0x7f5f800b46f0 2023-10-14T18:49:48.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.519+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(93..93 src has 1..93) v4 ==== 666+0+0 (secure 0 0 0) 0x7f5f7c0556f0 con 0x7f5f800b46f0 2023-10-14T18:49:48.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.520+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f5f6c06ca80 con 0x7f5f800b46f0 2023-10-14T18:49:48.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.522+0000 7f5f74ff9700 1 -- 172.21.15.79:0/2422746862 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5f7c054950 con 0x7f5f800b46f0 2023-10-14T18:49:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.529+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 msgr2=0x7f5f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.529+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 0x7f5f6c0693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5f8006a500 tx=0x7f5f70009040 comp rx=0 tx=0).stop 2023-10-14T18:49:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.529+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 msgr2=0x7f5f8009c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.529+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00bc30 tx=0x7f5f7c009840 comp rx=0 tx=0).stop 2023-10-14T18:49:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 shutdown_connections 2023-10-14T18:49:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f6c066f30 0x7f5f6c0693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f80159ef0 0x7f5f800ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f800b46f0 0x7f5f8009c170 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 --2- 172.21.15.79:0/2422746862 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f800b6a10 0x7f5f800afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 >> 172.21.15.79:0/2422746862 conn(0x7f5f8009a0a0 msgr2=0x7f5f80157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 shutdown_connections 2023-10-14T18:49:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.530+0000 7f5f86ac4700 1 -- 172.21.15.79:0/2422746862 wait complete. 2023-10-14T18:49:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:49:48.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:49:48.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.663+0000 7fcee96d8700 1 Processor -- start 2023-10-14T18:49:48.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.663+0000 7fcee96d8700 1 -- start start 2023-10-14T18:49:48.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee96d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee40678b0 0x7fcee415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee96d8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcee40c9390 0x7fcee415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee96d8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40cae70 con 0x7fcee40cbf10 2023-10-14T18:49:48.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee96d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40cb150 con 0x7fcee40678b0 2023-10-14T18:49:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee96d8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40cb430 con 0x7fcee40c9390 2023-10-14T18:49:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee40678b0 0x7fcee415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcee40678b0 0x7fcee415db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43906/0 (socket says 172.21.15.79:43906) 2023-10-14T18:49:48.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee2ffd700 1 -- 172.21.15.79:0/122984723 learned_addr learned my addr 172.21.15.79:0/122984723 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.664+0000 7fcee37fe700 1 --2- 172.21.15.79:0/122984723 >> v2:172.21.15.144:3300/0 conn(0x7fcee40c9390 0x7fcee415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee2ffd700 1 -- 172.21.15.79:0/122984723 >> v2:172.21.15.144:3300/0 conn(0x7fcee40c9390 msgr2=0x7fcee415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee2ffd700 1 --2- 172.21.15.79:0/122984723 >> v2:172.21.15.144:3300/0 conn(0x7fcee40c9390 0x7fcee415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee2ffd700 1 -- 172.21.15.79:0/122984723 >> v1:172.21.15.144:6789/0 conn(0x7fcee40cbf10 legacy=0x7fcee415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee2ffd700 1 -- 172.21.15.79:0/122984723 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40cb710 con 0x7fcee40678b0 2023-10-14T18:49:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee2ffd700 1 --2- 172.21.15.79:0/122984723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee415db80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c9ab0 tx=0x7fced4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e344b17ddc1ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee27fc700 1 -- 172.21.15.79:0/122984723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400b860 con 0x7fcee40678b0 2023-10-14T18:49:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee27fc700 1 -- 172.21.15.79:0/122984723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400b9c0 con 0x7fcee40678b0 2023-10-14T18:49:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee27fc700 1 -- 172.21.15.79:0/122984723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400bd60 con 0x7fcee40678b0 2023-10-14T18:49:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 -- 172.21.15.79:0/122984723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 msgr2=0x7fcee415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 --2- 172.21.15.79:0/122984723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee415db80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcee40c9ab0 tx=0x7fced4009250 comp rx=0 tx=0).stop 2023-10-14T18:49:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 -- 172.21.15.79:0/122984723 shutdown_connections 2023-10-14T18:49:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 --2- 172.21.15.79:0/122984723 >> v2:172.21.15.144:3300/0 conn(0x7fcee40c9390 0x7fcee415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 --2- 172.21.15.79:0/122984723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee415db80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 -- 172.21.15.79:0/122984723 >> 172.21.15.79:0/122984723 conn(0x7fcee4069870 msgr2=0x7fcee4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 -- 172.21.15.79:0/122984723 shutdown_connections 2023-10-14T18:49:48.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.665+0000 7fcee96d8700 1 -- 172.21.15.79:0/122984723 wait complete. 2023-10-14T18:49:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 Processor -- start 2023-10-14T18:49:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 -- start start 2023-10-14T18:49:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 0x7fcee40adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcee40cbf10 0x7fcee40ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee416a500 con 0x7fcee40678b0 2023-10-14T18:49:48.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40c7fb0 con 0x7fcee40c9390 2023-10-14T18:49:48.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.667+0000 7fcee96d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40aeb00 con 0x7fcee40cbf10 2023-10-14T18:49:48.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43922/0 (socket says 172.21.15.79:43922) 2023-10-14T18:49:48.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 -- 172.21.15.79:0/1056296945 learned_addr learned my addr 172.21.15.79:0/1056296945 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:48.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fceda7fc700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 0x7fcee40adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee37fe700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcee40cbf10 0x7fcee40ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 -- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcee40cbf10 msgr2=0x7fcee40ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcee40cbf10 0x7fcee40ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 -- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 msgr2=0x7fcee40adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 0x7fcee40adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 -- 172.21.15.79:0/1056296945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40094f0 con 0x7fcee40678b0 2023-10-14T18:49:48.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fceda7fc700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 0x7fcee40adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee2ffd700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcee406a380 tx=0x7fced4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4011e60 con 0x7fcee40678b0 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced401a630 con 0x7fcee40678b0 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced401a9f0 con 0x7fcee40678b0 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee40aede0 con 0x7fcee40678b0 2023-10-14T18:49:48.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.668+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee40af3a0 con 0x7fcee40678b0 2023-10-14T18:49:48.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.669+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee404c3c0 con 0x7fcee40678b0 2023-10-14T18:49:48.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.670+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fced402d440 con 0x7fcee40678b0 2023-10-14T18:49:48.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.670+0000 7fcedb7fe700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.670+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fced4085d10 con 0x7fcee40678b0 2023-10-14T18:49:48.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.670+0000 7fceda7fc700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.671+0000 7fceda7fc700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcecc007fd0 tx=0x7fcecc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:48.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.674+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fced4053280 con 0x7fcee40678b0 2023-10-14T18:49:48.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.857+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcee4068da0 con 0x7fcee40678b0 2023-10-14T18:49:48.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.860+0000 7fcedb7fe700 1 -- 172.21.15.79:0/1056296945 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fced40568a0 con 0x7fcee40678b0 2023-10-14T18:49:48.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 msgr2=0x7fcec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 0x7fcec40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcecc007fd0 tx=0x7fcecc009040 comp rx=0 tx=0).stop 2023-10-14T18:49:48.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 msgr2=0x7fcee4150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcee406a380 tx=0x7fced4017000 comp rx=0 tx=0).stop 2023-10-14T18:49:48.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 shutdown_connections 2023-10-14T18:49:48.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcec4066f30 0x7fcec40693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcee40cbf10 0x7fcee40ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcee40678b0 0x7fcee4150850 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.862+0000 7fcee96d8700 1 --2- 172.21.15.79:0/1056296945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcee40c9390 0x7fcee40adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.863+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 >> 172.21.15.79:0/1056296945 conn(0x7fcee4069870 msgr2=0x7fcee40b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:48.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.863+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 shutdown_connections 2023-10-14T18:49:48.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.863+0000 7fcee96d8700 1 -- 172.21.15.79:0/1056296945 wait complete. 2023-10-14T18:49:48.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-14T18:49:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.989+0000 7f1f02a9d700 1 Processor -- start 2023-10-14T18:49:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.989+0000 7f1f02a9d700 1 -- start start 2023-10-14T18:49:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f02a9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1efc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f02a9d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0c5d80 con 0x7f1efc15a2b0 2023-10-14T18:49:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f02a9d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0c6060 con 0x7f1efc15a680 2023-10-14T18:49:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f02a9d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc068470 con 0x7f1efc0d1c30 2023-10-14T18:49:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f00839700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1efc15a2b0 0x7f1efc0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48928/0 (socket says 172.21.15.79:48928) 2023-10-14T18:49:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1f00839700 1 -- 172.21.15.79:0/2088090003 learned_addr learned my addr 172.21.15.79:0/2088090003 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180175005 0 0) 0x7f1efc0c5d80 con 0x7f1efc15a2b0 2023-10-14T18:49:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee4003570 con 0x7f1efc15a2b0 2023-10-14T18:49:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.990+0000 7f1efbfff700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1efc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163160419 0 0) 0x7f1ee4003570 con 0x7f1efc15a2b0 2023-10-14T18:49:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 msgr2=0x7f1efc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1efc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 >> v1:172.21.15.144:6789/0 conn(0x7f1efc15a680 legacy=0x7f1efc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0c6340 con 0x7f1efc15a2b0 2023-10-14T18:49:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1eec0015f0 con 0x7f1efc15a2b0 2023-10-14T18:49:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 >> v1:172.21.15.79:6789/0 conn(0x7f1efc15a2b0 legacy=0x7f1efc0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ee4003a90 0x7f1ee4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1ee4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ee4004d50 0x7f1ee40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc068470 con 0x7f1ee4003a90 2023-10-14T18:49:48.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee400bb70 con 0x7f1ee4004d50 2023-10-14T18:49:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee400bd30 con 0x7f1efc0d1c30 2023-10-14T18:49:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ee4003a90 0x7f1ee4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f0103a700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ee4004d50 0x7f1ee40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efbfff700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1ee4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 -- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 msgr2=0x7f1ee4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1efc0d1c30 0x7f1ee4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 -- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ee4004d50 msgr2=0x7f1ee40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ee4004d50 0x7f1ee40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 -- 172.21.15.79:0/2088090003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4003570 con 0x7f1ee4003a90 2023-10-14T18:49:48.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1f00839700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ee4003a90 0x7f1ee4003ea0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c3c0 tx=0x7f1eec007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba5b14d27a308a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00cc90 con 0x7f1ee4003a90 2023-10-14T18:49:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00ce10 con 0x7f1ee4003a90 2023-10-14T18:49:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.991+0000 7f1efb7fe700 1 -- 172.21.15.79:0/2088090003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec007320 con 0x7f1ee4003a90 2023-10-14T18:49:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 -- 172.21.15.79:0/2088090003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ee4003a90 msgr2=0x7f1ee4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/2088090003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ee4003a90 0x7f1ee4003ea0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00c3c0 tx=0x7f1eec007920 comp rx=0 tx=0).stop 2023-10-14T18:49:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f0103a700 1 -- 172.21.15.79:0/2088090003 reap_dead start 2023-10-14T18:49:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 -- 172.21.15.79:0/2088090003 shutdown_connections 2023-10-14T18:49:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 -- 172.21.15.79:0/2088090003 >> 172.21.15.79:0/2088090003 conn(0x7f1efc067e40 msgr2=0x7f1efc0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 -- 172.21.15.79:0/2088090003 shutdown_connections 2023-10-14T18:49:49.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.992+0000 7f1f02a9d700 1 -- 172.21.15.79:0/2088090003 wait complete. 2023-10-14T18:49:49.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.993+0000 7f1f02a9d700 1 Processor -- start 2023-10-14T18:49:49.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.993+0000 7f1f02a9d700 1 -- start start 2023-10-14T18:49:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ee4003a90 0x7f1efc143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1efc068f90 0x7f1efc069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc069940 con 0x7f1efc15d270 2023-10-14T18:49:49.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc15dc50 con 0x7f1efc068f90 2023-10-14T18:49:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f02a9d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0c8230 con 0x7f1ee4003a90 2023-10-14T18:49:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43934/0 (socket says 172.21.15.79:43934) 2023-10-14T18:49:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 -- 172.21.15.79:0/4102914380 learned_addr learned my addr 172.21.15.79:0/4102914380 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:49.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f00839700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ee4003a90 0x7f1efc143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1efbfff700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1efc068f90 0x7f1efc069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 -- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ee4003a90 msgr2=0x7f1efc143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ee4003a90 0x7f1efc143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 -- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1efc068f90 msgr2=0x7f1efc069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1efc068f90 0x7f1efc069400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 -- 172.21.15.79:0/4102914380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0c8510 con 0x7f1efc15d270 2023-10-14T18:49:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.994+0000 7f1f0103a700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1efc15aa50 tx=0x7f1ef4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40032e0 con 0x7f1efc15d270 2023-10-14T18:49:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4003440 con 0x7f1efc15d270 2023-10-14T18:49:49.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40017d0 con 0x7f1efc15d270 2023-10-14T18:49:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc0c87f0 con 0x7f1efc15d270 2023-10-14T18:49:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc0c8db0 con 0x7f1efc15d270 2023-10-14T18:49:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.995+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc0c8fd0 con 0x7f1efc15d270 2023-10-14T18:49:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.996+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ef4001c00 con 0x7f1efc15d270 2023-10-14T18:49:49.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.996+0000 7f1ef8ff9700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 0x7f1ee8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.996+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ef4083bf0 con 0x7f1efc15d270 2023-10-14T18:49:49.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.996+0000 7f1f00839700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 0x7f1ee8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:48.997+0000 7f1f00839700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 0x7f1ee8069460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000ef0 tx=0x7f1eec015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.000+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ef40510c0 con 0x7f1efc15d270 2023-10-14T18:49:49.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.253+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f1efc04c3c0 con 0x7f1efc15d270 2023-10-14T18:49:49.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.815+0000 7f1ef8ff9700 1 -- 172.21.15.79:0/4102914380 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v242) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1ef40190c0 con 0x7f1efc15d270 2023-10-14T18:49:49.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 msgr2=0x7f1ee8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 0x7f1ee8069460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000ef0 tx=0x7f1eec015000 comp rx=0 tx=0).stop 2023-10-14T18:49:49.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 msgr2=0x7f1efc15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1efc15aa50 tx=0x7f1ef4009040 comp rx=0 tx=0).stop 2023-10-14T18:49:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 shutdown_connections 2023-10-14T18:49:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ee8066fb0 0x7f1ee8069460 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1efc15d270 0x7f1efc15d710 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ee4003a90 0x7f1efc143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 --2- 172.21.15.79:0/4102914380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1efc068f90 0x7f1efc069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 >> 172.21.15.79:0/4102914380 conn(0x7f1efc067e40 msgr2=0x7f1efc1595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 shutdown_connections 2023-10-14T18:49:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.817+0000 7f1f02a9d700 1 -- 172.21.15.79:0/4102914380 wait complete. 2023-10-14T18:49:49.831 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-14T18:49:49.831 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-14T18:49:49.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-14T18:49:49.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 Processor -- start 2023-10-14T18:49:49.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 -- start start 2023-10-14T18:49:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95b4157870 0x7f95b415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b415cbb0 con 0x7f95b415a620 2023-10-14T18:49:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b415bfa0 con 0x7f95b4157c40 2023-10-14T18:49:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.948+0000 7f95b8c29700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b415c280 con 0x7f95b4157870 2023-10-14T18:49:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95a9d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95b415a620 0x7f95b415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48930/0 (socket says 172.21.15.79:48930) 2023-10-14T18:49:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95a9d9b700 1 -- 172.21.15.79:0/2110065687 learned_addr learned my addr 172.21.15.79:0/2110065687 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995057629 0 0) 0x7f95b415cbb0 con 0x7f95b415a620 2023-10-14T18:49:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 --2- 172.21.15.79:0/2110065687 >> v2:172.21.15.144:3300/0 conn(0x7f95b4157870 0x7f95b415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a0003570 con 0x7f95b415a620 2023-10-14T18:49:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768645740 0 0) 0x7f95a0003570 con 0x7f95b415a620 2023-10-14T18:49:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 >> v2:172.21.15.144:3300/0 conn(0x7f95b4157870 msgr2=0x7f95b415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 --2- 172.21.15.79:0/2110065687 >> v2:172.21.15.144:3300/0 conn(0x7f95b4157870 0x7f95b415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 >> v1:172.21.15.144:6789/0 conn(0x7f95b4157c40 legacy=0x7f95b4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b415c560 con 0x7f95b415a620 2023-10-14T18:49:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f959c001470 con 0x7f95b415a620 2023-10-14T18:49:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 >> v1:172.21.15.79:6789/0 conn(0x7f95b415a620 legacy=0x7f95b415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a0004810 0x7f95a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a00051c0 0x7f95a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b415c280 con 0x7f95a0003a60 2023-10-14T18:49:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a000c160 con 0x7f95a00051c0 2023-10-14T18:49:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a000c320 con 0x7f95a0004810 2023-10-14T18:49:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95a9d9b700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a0004810 0x7f95a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b2d9d700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a00051c0 0x7f95a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 -- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a0004810 msgr2=0x7f95a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:49.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95a0004810 0x7f95a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 -- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a00051c0 msgr2=0x7f95a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:49.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a00051c0 0x7f95a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b259c700 1 -- 172.21.15.79:0/2110065687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0003570 con 0x7f95a0003a60 2023-10-14T18:49:49.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b2d9d700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95a00051c0 0x7f95a000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:49.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.949+0000 7f95b2d9d700 1 -- 172.21.15.79:0/2110065687 reap_dead start 2023-10-14T18:49:49.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b259c700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95a0003e70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009c00 tx=0x7f95a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b00ad06a6bcf660 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a400e710 con 0x7f95a0003a60 2023-10-14T18:49:49.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a400e870 con 0x7f95a0003a60 2023-10-14T18:49:49.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b1d9b700 1 -- 172.21.15.79:0/2110065687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a400ec30 con 0x7f95a0003a60 2023-10-14T18:49:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 -- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 msgr2=0x7f95a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95a0003e70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009c00 tx=0x7f95a40091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 -- 172.21.15.79:0/2110065687 shutdown_connections 2023-10-14T18:49:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 --2- 172.21.15.79:0/2110065687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95a0003e70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 -- 172.21.15.79:0/2110065687 >> 172.21.15.79:0/2110065687 conn(0x7f95b4068ce0 msgr2=0x7f95b40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 -- 172.21.15.79:0/2110065687 shutdown_connections 2023-10-14T18:49:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.950+0000 7f95b8c29700 1 -- 172.21.15.79:0/2110065687 wait complete. 2023-10-14T18:49:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.951+0000 7f95b8c29700 1 Processor -- start 2023-10-14T18:49:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 -- start start 2023-10-14T18:49:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 0x7f95b41541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95b416bb40 0x7f95b416bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b414cf10 con 0x7f95a0003a60 2023-10-14T18:49:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b416c4f0 con 0x7f95b416bb40 2023-10-14T18:49:49.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b8c29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b4151ce0 con 0x7f95b4153d70 2023-10-14T18:49:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43962/0 (socket says 172.21.15.79:43962) 2023-10-14T18:49:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b259c700 1 -- 172.21.15.79:0/1599203600 learned_addr learned my addr 172.21.15.79:0/1599203600 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.952+0000 7f95b2d9d700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95b416bb40 0x7f95b416bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95a9d9b700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 0x7f95b41541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 -- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 msgr2=0x7f95b41541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 0x7f95b41541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 -- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95b416bb40 msgr2=0x7f95b416bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:49.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95b416bb40 0x7f95b416bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:49.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 -- 172.21.15.79:0/1599203600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b416b910 con 0x7f95a0003a60 2023-10-14T18:49:49.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95a9d9b700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 0x7f95b41541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:49.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b259c700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e4b0 tx=0x7f95a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4022070 con 0x7f95a0003a60 2023-10-14T18:49:49.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a400e9e0 con 0x7f95a0003a60 2023-10-14T18:49:49.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4027470 con 0x7f95a0003a60 2023-10-14T18:49:49.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b41538e0 con 0x7f95a0003a60 2023-10-14T18:49:49.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.953+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b4153290 con 0x7f95a0003a60 2023-10-14T18:49:49.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.954+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4153bc0 con 0x7f95a0003a60 2023-10-14T18:49:49.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.954+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95a401c450 con 0x7f95a0003a60 2023-10-14T18:49:49.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.955+0000 7f95aaffd700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 0x7f95940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:49.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.955+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f95a4085ce0 con 0x7f95a0003a60 2023-10-14T18:49:49.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.955+0000 7f95a9d9b700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 0x7f95940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:49.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.955+0000 7f95a9d9b700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 0x7f95940693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95b415aa20 tx=0x7f959c001000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:49.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:49.959+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95a4053250 con 0x7f95a0003a60 2023-10-14T18:49:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.215+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f95b404c3c0 con 0x7f95a0003a60 2023-10-14T18:49:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.819+0000 7f95aaffd700 1 -- 172.21.15.79:0/1599203600 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v243) v1 ==== 140+0+0 (secure 0 0 0) 0x7f95a40170d0 con 0x7f95a0003a60 2023-10-14T18:49:50.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 msgr2=0x7f95940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 0x7f95940693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95b415aa20 tx=0x7f959c001000 comp rx=0 tx=0).stop 2023-10-14T18:49:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 msgr2=0x7f95b413d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e4b0 tx=0x7f95a401a000 comp rx=0 tx=0).stop 2023-10-14T18:49:50.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 shutdown_connections 2023-10-14T18:49:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9594066f30 0x7f95940693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95b416bb40 0x7f95b416bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95a0003a60 0x7f95b413d300 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:50.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 --2- 172.21.15.79:0/1599203600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95b4153d70 0x7f95b41541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 >> 172.21.15.79:0/1599203600 conn(0x7f95b4068ce0 msgr2=0x7f95b40b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 shutdown_connections 2023-10-14T18:49:50.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:50.821+0000 7f95b8c29700 1 -- 172.21.15.79:0/1599203600 wait complete. 2023-10-14T18:49:50.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-14T18:49:50.962 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_objectstore":"memstore"} 2023-10-14T18:49:50.963 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-14T18:49:50.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:49:51.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.080+0000 7fe936470700 1 Processor -- start 2023-10-14T18:49:51.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.080+0000 7fe936470700 1 -- start start 2023-10-14T18:49:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe936470700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe930159ec0 0x7fe9300af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe936470700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300b0790 con 0x7fe93006acb0 2023-10-14T18:49:51.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe936470700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300ce1f0 con 0x7fe93015a290 2023-10-14T18:49:51.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe936470700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300b0b20 con 0x7fe930159ec0 2023-10-14T18:49:51.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe934a0d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe93006acb0 0x7fe9300cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48932/0 (socket says 172.21.15.79:48932) 2023-10-14T18:49:51.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe934a0d700 1 -- 172.21.15.79:0/2165811200 learned_addr learned my addr 172.21.15.79:0/2165811200 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256689574 0 0) 0x7fe9300b0790 con 0x7fe93006acb0 2023-10-14T18:49:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe918003570 con 0x7fe93006acb0 2023-10-14T18:49:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.081+0000 7fe92ffff700 1 --2- 172.21.15.79:0/2165811200 >> v2:172.21.15.144:3300/0 conn(0x7fe930159ec0 0x7fe9300af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143088944 0 0) 0x7fe918003570 con 0x7fe93006acb0 2023-10-14T18:49:51.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 >> v2:172.21.15.144:3300/0 conn(0x7fe930159ec0 msgr2=0x7fe9300af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 --2- 172.21.15.79:0/2165811200 >> v2:172.21.15.144:3300/0 conn(0x7fe930159ec0 0x7fe9300af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 >> v1:172.21.15.144:6789/0 conn(0x7fe93015a290 legacy=0x7fe93006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300b04b0 con 0x7fe93006acb0 2023-10-14T18:49:51.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe9280017f0 con 0x7fe93006acb0 2023-10-14T18:49:51.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 >> v1:172.21.15.79:6789/0 conn(0x7fe93006acb0 legacy=0x7fe9300cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe918003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe918004810 0x7fe918004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9180052e0 0x7fe91800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300b0b20 con 0x7fe918003a60 2023-10-14T18:49:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91800c230 con 0x7fe918004810 2023-10-14T18:49:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91800c3f0 con 0x7fe9180052e0 2023-10-14T18:49:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe918003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe918004810 0x7fe918004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe934a0d700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9180052e0 0x7fe91800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 -- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9180052e0 msgr2=0x7fe91800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9180052e0 0x7fe91800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 -- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe918004810 msgr2=0x7fe918004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe918004810 0x7fe918004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 -- 172.21.15.79:0/2165811200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918003570 con 0x7fe918003a60 2023-10-14T18:49:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe918004810 0x7fe918004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe934a0d700 1 -- 172.21.15.79:0/2165811200 reap_dead start 2023-10-14T18:49:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92ffff700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe918003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe92000bb90 tx=0x7fe920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba886ab9ba0ed44b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000d5d0 con 0x7fe918003a60 2023-10-14T18:49:51.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92000d730 con 0x7fe918003a60 2023-10-14T18:49:51.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.082+0000 7fe92effd700 1 -- 172.21.15.79:0/2165811200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92000daf0 con 0x7fe918003a60 2023-10-14T18:49:51.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 -- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 msgr2=0x7fe918003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe918003e70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe92000bb90 tx=0x7fe920008040 comp rx=0 tx=0).stop 2023-10-14T18:49:51.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 -- 172.21.15.79:0/2165811200 shutdown_connections 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 --2- 172.21.15.79:0/2165811200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe918003e70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 -- 172.21.15.79:0/2165811200 >> 172.21.15.79:0/2165811200 conn(0x7fe9300d1880 msgr2=0x7fe9300cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 -- 172.21.15.79:0/2165811200 shutdown_connections 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.083+0000 7fe936470700 1 -- 172.21.15.79:0/2165811200 wait complete. 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.084+0000 7fe936470700 1 Processor -- start 2023-10-14T18:49:51.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.084+0000 7fe936470700 1 -- start start 2023-10-14T18:49:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 0x7fe9300b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93015db20 0x7fe9300b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300c9560 con 0x7fe918003a60 2023-10-14T18:49:51.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300b69f0 con 0x7fe93015db20 2023-10-14T18:49:51.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe936470700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300c9de0 con 0x7fe93014e9d0 2023-10-14T18:49:51.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43992/0 (socket says 172.21.15.79:43992) 2023-10-14T18:49:51.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 -- 172.21.15.79:0/120215320 learned_addr learned my addr 172.21.15.79:0/120215320 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:51.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 0x7fe9300b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe934a0d700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93015db20 0x7fe9300b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 -- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 msgr2=0x7fe9300b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 0x7fe9300b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 -- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93015db20 msgr2=0x7fe9300b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93015db20 0x7fe9300b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 -- 172.21.15.79:0/120215320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300b6490 con 0x7fe918003a60 2023-10-14T18:49:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 0x7fe9300b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.085+0000 7fe92ffff700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c200 tx=0x7fe92001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920014790 con 0x7fe918003a60 2023-10-14T18:49:51.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9200148f0 con 0x7fe918003a60 2023-10-14T18:49:51.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93014ee40 con 0x7fe918003a60 2023-10-14T18:49:51.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920014cb0 con 0x7fe918003a60 2023-10-14T18:49:51.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300c9790 con 0x7fe918003a60 2023-10-14T18:49:51.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.086+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93004c3c0 con 0x7fe918003a60 2023-10-14T18:49:51.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.087+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe92001d610 con 0x7fe918003a60 2023-10-14T18:49:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.087+0000 7fe917fff700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.087+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe920085ad0 con 0x7fe918003a60 2023-10-14T18:49:51.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.088+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.088+0000 7fe92f7fe700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe924007a80 tx=0x7fe924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.092+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe920053040 con 0x7fe918003a60 2023-10-14T18:49:51.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.271+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe9300ceab0 con 0x7fe918003a60 2023-10-14T18:49:51.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.274+0000 7fe917fff700 1 -- 172.21.15.79:0/120215320 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe92002c0c0 con 0x7fe918003a60 2023-10-14T18:49:51.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 msgr2=0x7fe91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 0x7fe91c0693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe924007a80 tx=0x7fe924009040 comp rx=0 tx=0).stop 2023-10-14T18:49:51.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 msgr2=0x7fe9300b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c200 tx=0x7fe92001b000 comp rx=0 tx=0).stop 2023-10-14T18:49:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 shutdown_connections 2023-10-14T18:49:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe91c066f30 0x7fe91c0693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93015db20 0x7fe9300b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe918003a60 0x7fe9300b3bc0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 --2- 172.21.15.79:0/120215320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe93014e9d0 0x7fe9300b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 >> 172.21.15.79:0/120215320 conn(0x7fe9300d1880 msgr2=0x7fe9300cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 shutdown_connections 2023-10-14T18:49:51.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.277+0000 7fe936470700 1 -- 172.21.15.79:0/120215320 wait complete. 2023-10-14T18:49:51.289 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:49:51.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:49:51.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:49:51.376 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:49:51.377 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:49:51.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:49:51.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.490+0000 7f6278b0a700 1 Processor -- start 2023-10-14T18:49:51.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.490+0000 7f6278b0a700 1 -- start start 2023-10-14T18:49:51.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6278b0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f627415a620 0x7f627415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6278b0a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627415cbb0 con 0x7f627415d580 2023-10-14T18:49:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6278b0a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627415bfa0 con 0x7f6274157870 2023-10-14T18:49:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6278b0a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627415bdb0 con 0x7f627415a620 2023-10-14T18:49:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6271d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f627415a620 0x7f627415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6272d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f627415d580 0x7f6274158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48940/0 (socket says 172.21.15.79:48940) 2023-10-14T18:49:51.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.491+0000 7f6272d9d700 1 -- 172.21.15.79:0/2400361226 learned_addr learned my addr 172.21.15.79:0/2400361226 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:51.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6271d9b700 1 -- 172.21.15.79:0/2400361226 >> v1:172.21.15.144:6789/0 conn(0x7f6274157870 legacy=0x7f627415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6271d9b700 1 -- 172.21.15.79:0/2400361226 >> v1:172.21.15.79:6789/0 conn(0x7f627415d580 legacy=0x7f6274158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6271d9b700 1 -- 172.21.15.79:0/2400361226 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627415c280 con 0x7f627415a620 2023-10-14T18:49:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f627159a700 1 -- 172.21.15.79:0/2400361226 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932763110 0 0) 0x7f627415cbb0 con 0x7f627415d580 2023-10-14T18:49:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6271d9b700 1 --2- 172.21.15.79:0/2400361226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627415a620 0x7f627415d040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f625c0098e0 tx=0x7f625c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e72b2f7fed1888 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f627159a700 1 -- 172.21.15.79:0/2400361226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c009e80 con 0x7f627415a620 2023-10-14T18:49:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f627159a700 1 -- 172.21.15.79:0/2400361226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c00b860 con 0x7f627415a620 2023-10-14T18:49:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f627159a700 1 -- 172.21.15.79:0/2400361226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00bbe0 con 0x7f627415a620 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 -- 172.21.15.79:0/2400361226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627415a620 msgr2=0x7f627415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2400361226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627415a620 0x7f627415d040 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f625c0098e0 tx=0x7f625c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 -- 172.21.15.79:0/2400361226 shutdown_connections 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2400361226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f627415a620 0x7f627415d040 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 -- 172.21.15.79:0/2400361226 >> 172.21.15.79:0/2400361226 conn(0x7f6274068ce0 msgr2=0x7f62740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 -- 172.21.15.79:0/2400361226 shutdown_connections 2023-10-14T18:49:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.492+0000 7f6278b0a700 1 -- 172.21.15.79:0/2400361226 wait complete. 2023-10-14T18:49:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.493+0000 7f6278b0a700 1 Processor -- start 2023-10-14T18:49:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 -- start start 2023-10-14T18:49:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f627415a620 0x7f627413d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627415d580 0x7f62741529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627416b6e0 con 0x7f6274157870 2023-10-14T18:49:51.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627413dd10 con 0x7f627415d580 2023-10-14T18:49:51.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f6278b0a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6274152f30 con 0x7f627415a620 2023-10-14T18:49:51.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f627259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f627259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44012/0 (socket says 172.21.15.79:44012) 2023-10-14T18:49:51.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.494+0000 7f627259c700 1 -- 172.21.15.79:0/2624472274 learned_addr learned my addr 172.21.15.79:0/2624472274 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:51.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f6272d9d700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627415d580 0x7f62741529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 -- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f627415a620 msgr2=0x7f627413d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f627415a620 0x7f627413d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 -- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627415d580 msgr2=0x7f62741529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627415d580 0x7f62741529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 -- 172.21.15.79:0/2624472274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009420 con 0x7f6274157870 2023-10-14T18:49:51.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f627259c700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f626c00cb40 tx=0x7f626c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00a7a0 con 0x7f6274157870 2023-10-14T18:49:51.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00a920 con 0x7f6274157870 2023-10-14T18:49:51.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62741531d0 con 0x7f6274157870 2023-10-14T18:49:51.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ace0 con 0x7f6274157870 2023-10-14T18:49:51.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.495+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274153a70 con 0x7f6274157870 2023-10-14T18:49:51.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.496+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627404c3c0 con 0x7f6274157870 2023-10-14T18:49:51.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.496+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f626c003030 con 0x7f6274157870 2023-10-14T18:49:51.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.497+0000 7f626a7fc700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.497+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f626c084330 con 0x7f6274157870 2023-10-14T18:49:51.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.497+0000 7f6271d9b700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.497+0000 7f6271d9b700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f627415aa20 tx=0x7f625c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.501+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f626c0518a0 con 0x7f6274157870 2023-10-14T18:49:51.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.727+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f627415c560 con 0x7f6274157870 2023-10-14T18:49:51.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.728+0000 7f626a7fc700 1 -- 172.21.15.79:0/2624472274 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f626c054ec0 con 0x7f6274157870 2023-10-14T18:49:51.729 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:51.729 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1594044188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1594044188},{"type":"v1","addr":"172.21.15.144:6836","nonce":1594044188}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/213380802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":213380802},{"type":"v1","addr":"172.21.15.144:6837","nonce":213380802}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6030,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3162443435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3162443435},{"type":"v1","addr":"172.21.15.79:6834","nonce":3162443435}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4215459092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":4215459092},{"type":"v1","addr":"172.21.15.79:6835","nonce":4215459092}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-14T18:49:51.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 msgr2=0x7f62540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 0x7f62540693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f627415aa20 tx=0x7f625c017000 comp rx=0 tx=0).stop 2023-10-14T18:49:51.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 msgr2=0x7f627416b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f626c00cb40 tx=0x7f626c0017b0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 shutdown_connections 2023-10-14T18:49:51.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6254066f30 0x7f62540693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627415d580 0x7f62741529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6274157870 0x7f627416b1a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 --2- 172.21.15.79:0/2624472274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f627415a620 0x7f627413d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 >> 172.21.15.79:0/2624472274 conn(0x7f6274068ce0 msgr2=0x7f62740b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 shutdown_connections 2023-10-14T18:49:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.730+0000 7f6278b0a700 1 -- 172.21.15.79:0/2624472274 wait complete. 2023-10-14T18:49:51.733 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 42 2023-10-14T18:49:51.743 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:49:51.743 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:49:51.743 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:49:51.743 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:49:51.744 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:49:51.744 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:49:51.744 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:49:51.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:49:51.745 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:49:51.745 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:49:51.745 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:49:51.746 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:49:51.746 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:49:51.746 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:49:51.747 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:49:51.747 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:49:51.752 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:49:51.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:49:51.754 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:49:51.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:49:51.757 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:49:51.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:49:51.758 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:49:51.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:49:51.795 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:49:51.795 DEBUG:teuthology.parallel:result is None 2023-10-14T18:49:51.796 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:49:51.796 DEBUG:teuthology.parallel:result is None 2023-10-14T18:49:51.800 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:49:51.800 DEBUG:teuthology.parallel:result is None 2023-10-14T18:49:51.801 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:49:51.801 DEBUG:teuthology.parallel:result is None 2023-10-14T18:49:51.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:49:51.868 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:49:51.869 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:49:51.880 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:49:51.881 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:49:51.881 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-14T18:49:51.881+0000 7fcc85dd0700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T18:49:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.922+0000 7f73d4470700 1 Processor -- start 2023-10-14T18:49:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.922+0000 7f73d4470700 1 -- start start 2023-10-14T18:49:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d4470700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73cc159e10 0x7f73cc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d4470700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc15a1e0 0x7f73cc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d4470700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc15db80 con 0x7f73cc0b1610 2023-10-14T18:49:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d4470700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc15e800 con 0x7f73cc159e10 2023-10-14T18:49:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d4470700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc15de60 con 0x7f73cc15a1e0 2023-10-14T18:49:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d2a0d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f73cc0b1610 0x7f73cc0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48950/0 (socket says 172.21.15.79:48950) 2023-10-14T18:49:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.923+0000 7f73d2a0d700 1 -- 172.21.15.79:0/1897852234 learned_addr learned my addr 172.21.15.79:0/1897852234 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d1a0b700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc15a1e0 0x7f73cc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 --2- 172.21.15.79:0/1897852234 >> v2:172.21.15.144:3300/0 conn(0x7f73cc159e10 0x7f73cc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434779095 0 0) 0x7f73cc15db80 con 0x7f73cc0b1610 2023-10-14T18:49:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b8003570 con 0x7f73cc0b1610 2023-10-14T18:49:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906856229 0 0) 0x7f73b8003570 con 0x7f73cc0b1610 2023-10-14T18:49:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 -- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc15a1e0 msgr2=0x7f73cc0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc15a1e0 0x7f73cc0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 -- 172.21.15.79:0/1897852234 >> v1:172.21.15.79:6789/0 conn(0x7f73cc0b1610 legacy=0x7f73cc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 -- 172.21.15.79:0/1897852234 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc15e140 con 0x7f73cc159e10 2023-10-14T18:49:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d220c700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc159e10 0x7f73cc0b2d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f73c80098e0 tx=0x7f73c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef018116dbbb0c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40017f0 con 0x7f73cc159e10 2023-10-14T18:49:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8011420 con 0x7f73cc159e10 2023-10-14T18:49:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.924+0000 7f73d120a700 1 -- 172.21.15.79:0/1897852234 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c80117c0 con 0x7f73cc159e10 2023-10-14T18:49:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 -- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc159e10 msgr2=0x7f73cc0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc159e10 0x7f73cc0b2d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f73c80098e0 tx=0x7f73c80091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 -- 172.21.15.79:0/1897852234 shutdown_connections 2023-10-14T18:49:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc159e10 0x7f73cc0b2d20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 --2- 172.21.15.79:0/1897852234 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc15a1e0 0x7f73cc0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 -- 172.21.15.79:0/1897852234 >> 172.21.15.79:0/1897852234 conn(0x7f73cc067660 msgr2=0x7f73cc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 -- 172.21.15.79:0/1897852234 shutdown_connections 2023-10-14T18:49:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.925+0000 7f73d4470700 1 -- 172.21.15.79:0/1897852234 wait complete. 2023-10-14T18:49:51.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.926+0000 7f73d4470700 1 Processor -- start 2023-10-14T18:49:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.926+0000 7f73d4470700 1 -- start start 2023-10-14T18:49:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc159e10 0x7f73cc0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc15a1e0 0x7f73cc1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0c6460 con 0x7f73cc0b1610 2023-10-14T18:49:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0c9ec0 con 0x7f73cc15a1e0 2023-10-14T18:49:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc1577f0 con 0x7f73cc159e10 2023-10-14T18:49:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44042/0 (socket says 172.21.15.79:44042) 2023-10-14T18:49:51.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 -- 172.21.15.79:0/4138768802 learned_addr learned my addr 172.21.15.79:0/4138768802 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d1a0b700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc159e10 0x7f73cc0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d2a0d700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc15a1e0 0x7f73cc1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 -- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc159e10 msgr2=0x7f73cc0c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc159e10 0x7f73cc0c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 -- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc15a1e0 msgr2=0x7f73cc1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc15a1e0 0x7f73cc1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 -- 172.21.15.79:0/4138768802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c8009420 con 0x7f73cc0b1610 2023-10-14T18:49:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d220c700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0b6690 tx=0x7f73c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c801caf0 con 0x7f73cc0b1610 2023-10-14T18:49:51.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c801cc50 con 0x7f73cc0b1610 2023-10-14T18:49:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc0c57e0 con 0x7f73cc0b1610 2023-10-14T18:49:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.927+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8025680 con 0x7f73cc0b1610 2023-10-14T18:49:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.928+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc0c5da0 con 0x7f73cc0b1610 2023-10-14T18:49:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.928+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc04c3c0 con 0x7f73cc0b1610 2023-10-14T18:49:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.929+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73c80193f0 con 0x7f73cc0b1610 2023-10-14T18:49:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.929+0000 7f73c27fc700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 0x7f73b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.929+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f73c80853b0 con 0x7f73cc0b1610 2023-10-14T18:49:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.929+0000 7f73d1a0b700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 0x7f73b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.930+0000 7f73d1a0b700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 0x7f73b00693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f73cc15f950 tx=0x7f73bc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:51.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:51.933+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73c80529a0 con 0x7f73cc0b1610 2023-10-14T18:49:52.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:52.129+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f73cc15e420 con 0x7f73cc0b1610 2023-10-14T18:49:53.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.544+0000 7f73c27fc700 1 -- 172.21.15.79:0/4138768802 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f73c8055fc0 con 0x7f73cc0b1610 2023-10-14T18:49:53.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 msgr2=0x7f73b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 0x7f73b00693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f73cc15f950 tx=0x7f73bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 msgr2=0x7f73cc0c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0b6690 tx=0x7f73c8016000 comp rx=0 tx=0).stop 2023-10-14T18:49:53.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 shutdown_connections 2023-10-14T18:49:53.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f73b0066f30 0x7f73b00693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73cc15a1e0 0x7f73cc1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73cc0b1610 0x7f73cc0c5140 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 --2- 172.21.15.79:0/4138768802 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73cc159e10 0x7f73cc0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 >> 172.21.15.79:0/4138768802 conn(0x7f73cc067660 msgr2=0x7f73cc15a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:53.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 shutdown_connections 2023-10-14T18:49:53.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.547+0000 7f73d4470700 1 -- 172.21.15.79:0/4138768802 wait complete. 2023-10-14T18:49:53.552 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:49:53.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:49:53.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.681+0000 7ff72db36700 1 Processor -- start 2023-10-14T18:49:53.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.681+0000 7ff72db36700 1 -- start start 2023-10-14T18:49:53.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff72db36700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7280b0e50 0x7ff7280c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff72db36700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72815de60 con 0x7ff7280b1220 2023-10-14T18:49:53.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff72db36700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72815e140 con 0x7ff7280cb4f0 2023-10-14T18:49:53.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff72db36700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72815e420 con 0x7ff7280b0e50 2023-10-14T18:49:53.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff726ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff7280b1220 0x7ff72806d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48958/0 (socket says 172.21.15.79:48958) 2023-10-14T18:49:53.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.682+0000 7ff726ffd700 1 -- 172.21.15.79:0/3925150034 learned_addr learned my addr 172.21.15.79:0/3925150034 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:53.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7277fe700 1 --2- 172.21.15.79:0/3925150034 >> v2:172.21.15.144:3300/0 conn(0x7ff7280b0e50 0x7ff7280c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881216968 0 0) 0x7ff72815de60 con 0x7ff7280b1220 2023-10-14T18:49:53.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff710003570 con 0x7ff7280b1220 2023-10-14T18:49:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585611891 0 0) 0x7ff710003570 con 0x7ff7280b1220 2023-10-14T18:49:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 >> v2:172.21.15.144:3300/0 conn(0x7ff7280b0e50 msgr2=0x7ff7280c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 --2- 172.21.15.79:0/3925150034 >> v2:172.21.15.144:3300/0 conn(0x7ff7280b0e50 0x7ff7280c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 >> v1:172.21.15.144:6789/0 conn(0x7ff7280cb4f0 legacy=0x7ff7280679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72815e700 con 0x7ff7280b1220 2023-10-14T18:49:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff71c001470 con 0x7ff7280b1220 2023-10-14T18:49:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 >> v1:172.21.15.79:6789/0 conn(0x7ff7280b1220 legacy=0x7ff72806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff710003a60 0x7ff710003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff710004810 0x7ff710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 0x7ff71000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72815e420 con 0x7ff7100052e0 2023-10-14T18:49:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71000c2a0 con 0x7ff710004810 2023-10-14T18:49:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71000c460 con 0x7ff710003a60 2023-10-14T18:49:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 0x7ff71000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7277fe700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff710003a60 0x7ff710003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff726ffd700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff710004810 0x7ff710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 -- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff710003a60 msgr2=0x7ff710003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff710003a60 0x7ff710003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 -- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff710004810 msgr2=0x7ff710004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff710004810 0x7ff710004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 -- 172.21.15.79:0/3925150034 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710003570 con 0x7ff7100052e0 2023-10-14T18:49:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff7277fe700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff710003a60 0x7ff710003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff726ffd700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff710004810 0x7ff710004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 -- 172.21.15.79:0/3925150034 reap_dead start 2023-10-14T18:49:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.683+0000 7ff727fff700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 0x7ff71000ba60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff7200018b0 tx=0x7ff720007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e2c6417f049160 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720012420 con 0x7ff7100052e0 2023-10-14T18:49:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720012580 con 0x7ff7100052e0 2023-10-14T18:49:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff7267fc700 1 -- 172.21.15.79:0/3925150034 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720012920 con 0x7ff7100052e0 2023-10-14T18:49:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 -- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 msgr2=0x7ff71000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 0x7ff71000ba60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff7200018b0 tx=0x7ff720007d30 comp rx=0 tx=0).stop 2023-10-14T18:49:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 -- 172.21.15.79:0/3925150034 shutdown_connections 2023-10-14T18:49:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 --2- 172.21.15.79:0/3925150034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7100052e0 0x7ff71000ba60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 -- 172.21.15.79:0/3925150034 >> 172.21.15.79:0/3925150034 conn(0x7ff728069870 msgr2=0x7ff728069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 -- 172.21.15.79:0/3925150034 shutdown_connections 2023-10-14T18:49:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.684+0000 7ff72db36700 1 -- 172.21.15.79:0/3925150034 wait complete. 2023-10-14T18:49:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.685+0000 7ff72db36700 1 Processor -- start 2023-10-14T18:49:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.685+0000 7ff72db36700 1 -- start start 2023-10-14T18:49:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7100052e0 0x7ff7280c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff72816ad90 0x7ff72816b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7281541b0 con 0x7ff7280b4690 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72816e1c0 con 0x7ff72816ad90 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff72db36700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72816a630 con 0x7ff7100052e0 2023-10-14T18:49:53.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44068/0 (socket says 172.21.15.79:44068) 2023-10-14T18:49:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 -- 172.21.15.79:0/2323565153 learned_addr learned my addr 172.21.15.79:0/2323565153 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff7277fe700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7100052e0 0x7ff7280c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff727fff700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff72816ad90 0x7ff72816b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 -- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7100052e0 msgr2=0x7ff7280c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7100052e0 0x7ff7280c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 -- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff72816ad90 msgr2=0x7ff72816b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff72816ad90 0x7ff72816b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.686+0000 7ff726ffd700 1 -- 172.21.15.79:0/2323565153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72816e3f0 con 0x7ff7280b4690 2023-10-14T18:49:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff726ffd700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e7b0 tx=0x7ff71c000cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c012500 con 0x7ff7280b4690 2023-10-14T18:49:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c010040 con 0x7ff7280b4690 2023-10-14T18:49:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72816e6d0 con 0x7ff7280b4690 2023-10-14T18:49:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c012870 con 0x7ff7280b4690 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.687+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72816a870 con 0x7ff7280b4690 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.688+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72816ebd0 con 0x7ff7280b4690 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.688+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff71c012c60 con 0x7ff7280b4690 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.688+0000 7ff70f7fe700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 0x7ff7140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.688+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff71c083420 con 0x7ff7280b4690 2023-10-14T18:49:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.689+0000 7ff7277fe700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 0x7ff7140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.689+0000 7ff7277fe700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 0x7ff7140693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff718009fd0 tx=0x7ff71800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.693+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff71c04d5a0 con 0x7ff7280b4690 2023-10-14T18:49:53.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.951+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff7280c4840 con 0x7ff7280b4690 2023-10-14T18:49:53.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.952+0000 7ff70f7fe700 1 -- 172.21.15.79:0/2323565153 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff71c019020 con 0x7ff7280b4690 2023-10-14T18:49:53.954 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:53.954 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:49:53.954 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:49:53.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.955 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:49:53.955 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:49:53.955 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.955 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.955 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:49:53.956 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:49:53.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:49:53.957 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:49:53.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.958 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:49:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:49:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:49:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:49:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:49:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.962 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.964 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:49:53.964 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:49:53.964 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.966 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:49:53.966 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:49:53.966 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.966 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:49:53.967 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.969 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.970 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.970 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:49:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:49:53.972 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.973 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.973 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.973 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:49:53.974 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:49:53.975 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.975 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:49:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:49:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:49:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:49:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:49:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:49:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:49:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:49:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:49:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:49:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:49:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:49:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:49:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:49:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:49:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:49:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:49:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:49:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:49:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:49:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:49:53.988 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:49:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.953+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 msgr2=0x7ff7140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.953+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 0x7ff7140693e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff718009fd0 tx=0x7ff71800b040 comp rx=0 tx=0).stop 2023-10-14T18:49:53.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.953+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 msgr2=0x7ff72816dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.953+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e7b0 tx=0x7ff71c000cc0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 shutdown_connections 2023-10-14T18:49:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff714066f30 0x7ff7140693e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff72816ad90 0x7ff72816b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7100052e0 0x7ff7280c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 --2- 172.21.15.79:0/2323565153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7280b4690 0x7ff72816dc80 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 >> 172.21.15.79:0/2323565153 conn(0x7ff728069870 msgr2=0x7ff728069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 shutdown_connections 2023-10-14T18:49:53.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:53.954+0000 7ff72db36700 1 -- 172.21.15.79:0/2323565153 wait complete. 2023-10-14T18:49:53.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:54.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.106+0000 7f96826cf700 1 Processor -- start 2023-10-14T18:49:54.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.106+0000 7f96826cf700 1 -- start start 2023-10-14T18:49:54.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f967c0cdab0 0x7f967c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 0x7f967c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c15e850 con 0x7f967c0cdab0 2023-10-14T18:49:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c0cd030 con 0x7f967c15dda0 2023-10-14T18:49:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96826cf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0cb7c0 con 0x7f967c0cd6e0 2023-10-14T18:49:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f967c0cdab0 0x7f967c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f967c0cdab0 0x7f967c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44076/0 (socket says 172.21.15.79:44076) 2023-10-14T18:49:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 -- 172.21.15.79:0/1322877289 learned_addr learned my addr 172.21.15.79:0/1322877289 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 -- 172.21.15.79:0/1322877289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 msgr2=0x7f967c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f96816cd700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9681ece700 1 --2- 172.21.15.79:0/1322877289 >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 0x7f967c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 -- 172.21.15.79:0/1322877289 >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 msgr2=0x7f967c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 --2- 172.21.15.79:0/1322877289 >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 0x7f967c15cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 -- 172.21.15.79:0/1322877289 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c15e290 con 0x7f967c0cdab0 2023-10-14T18:49:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9681ece700 1 --2- 172.21.15.79:0/1322877289 >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 0x7f967c15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.107+0000 7f9680ecc700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c0cdab0 0x7f967c15d860 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f967c089ac0 tx=0x7f9670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5eae5452946119 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f967bfff700 1 -- 172.21.15.79:0/1322877289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000b860 con 0x7f967c0cdab0 2023-10-14T18:49:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f967bfff700 1 -- 172.21.15.79:0/1322877289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967000b9c0 con 0x7f967c0cdab0 2023-10-14T18:49:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f967bfff700 1 -- 172.21.15.79:0/1322877289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000bd60 con 0x7f967c0cdab0 2023-10-14T18:49:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 -- 172.21.15.79:0/1322877289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c0cdab0 msgr2=0x7f967c15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c0cdab0 0x7f967c15d860 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f967c089ac0 tx=0x7f9670009250 comp rx=0 tx=0).stop 2023-10-14T18:49:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 -- 172.21.15.79:0/1322877289 shutdown_connections 2023-10-14T18:49:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 --2- 172.21.15.79:0/1322877289 >> v2:172.21.15.144:3300/0 conn(0x7f967c15dda0 0x7f967c15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 --2- 172.21.15.79:0/1322877289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c0cdab0 0x7f967c15d860 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 -- 172.21.15.79:0/1322877289 >> 172.21.15.79:0/1322877289 conn(0x7f967c067660 msgr2=0x7f967c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 -- 172.21.15.79:0/1322877289 shutdown_connections 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.108+0000 7f96826cf700 1 -- 172.21.15.79:0/1322877289 wait complete. 2023-10-14T18:49:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.109+0000 7f96826cf700 1 Processor -- start 2023-10-14T18:49:54.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.109+0000 7f96826cf700 1 -- start start 2023-10-14T18:49:54.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0cdab0 0x7f967c16e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0c94f0 con 0x7f967c15dda0 2023-10-14T18:49:54.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c159670 con 0x7f967c0cdab0 2023-10-14T18:49:54.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96826cf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c159c00 con 0x7f967c0cd6e0 2023-10-14T18:49:54.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44086/0 (socket says 172.21.15.79:44086) 2023-10-14T18:49:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 -- 172.21.15.79:0/1338491905 learned_addr learned my addr 172.21.15.79:0/1338491905 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f96816cd700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9680ecc700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0cdab0 0x7f967c16e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 -- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 msgr2=0x7f967c0b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 -- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0cdab0 msgr2=0x7f967c16e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0cdab0 0x7f967c16e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.110+0000 7f9681ece700 1 -- 172.21.15.79:0/1338491905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96700094f0 con 0x7f967c15dda0 2023-10-14T18:49:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f9681ece700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c880 tx=0x7f966c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011600 con 0x7f967c15dda0 2023-10-14T18:49:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966c011760 con 0x7f967c15dda0 2023-10-14T18:49:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c011b20 con 0x7f967c15dda0 2023-10-14T18:49:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c159920 con 0x7f967c15dda0 2023-10-14T18:49:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.111+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c0c9180 con 0x7f967c15dda0 2023-10-14T18:49:54.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.112+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c0c9660 con 0x7f967c15dda0 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.112+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f966c0193b0 con 0x7f967c15dda0 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.112+0000 7f96797fa700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 0x7f96680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.112+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f966c084200 con 0x7f967c15dda0 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.113+0000 7f96816cd700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 0x7f96680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.113+0000 7f96816cd700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 0x7f96680693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9674007f60 tx=0x7f9674007470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.116+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f966c055250 con 0x7f967c15dda0 2023-10-14T18:49:54.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.298+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f967c15e570 con 0x7f967c15dda0 2023-10-14T18:49:54.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.299+0000 7f96797fa700 1 -- 172.21.15.79:0/1338491905 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f966c054de0 con 0x7f967c15dda0 2023-10-14T18:49:54.301 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:54.301 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":98,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:53.542205+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 msgr2=0x7f96680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 0x7f96680693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9674007f60 tx=0x7f9674007470 comp rx=0 tx=0).stop 2023-10-14T18:49:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 msgr2=0x7f967c159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f966c00c880 tx=0x7f966c008040 comp rx=0 tx=0).stop 2023-10-14T18:49:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 shutdown_connections 2023-10-14T18:49:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9668066f30 0x7f96680693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f967c15dda0 0x7f967c159130 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f967c0cd6e0 0x7f967c0b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 --2- 172.21.15.79:0/1338491905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0cdab0 0x7f967c16e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.301+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 >> 172.21.15.79:0/1338491905 conn(0x7f967c067660 msgr2=0x7f967c0c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.302+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 shutdown_connections 2023-10-14T18:49:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.302+0000 7f96826cf700 1 -- 172.21.15.79:0/1338491905 wait complete. 2023-10-14T18:49:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:49:54.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:49:54.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.432+0000 7f7101a9d700 1 Processor -- start 2023-10-14T18:49:54.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.432+0000 7f7101a9d700 1 -- start start 2023-10-14T18:49:54.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f7101a9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 0x7f70fc06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f7101a9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70fc06a830 0x7f70fc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f7101a9d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc06ac90 con 0x7f70fc0cce30 2023-10-14T18:49:54.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f7101a9d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0b4d70 con 0x7f70fc06a830 2023-10-14T18:49:54.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f7101a9d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc15b3b0 con 0x7f70fc0b6580 2023-10-14T18:49:54.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70fc06a830 0x7f70fc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70fc06a830 0x7f70fc0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44090/0 (socket says 172.21.15.79:44090) 2023-10-14T18:49:54.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 -- 172.21.15.79:0/978297762 learned_addr learned my addr 172.21.15.79:0/978297762 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:54.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f70fbfff700 1 --2- 172.21.15.79:0/978297762 >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 0x7f70fc06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 -- 172.21.15.79:0/978297762 >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 msgr2=0x7f70fc06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:54.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 --2- 172.21.15.79:0/978297762 >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 0x7f70fc06a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 -- 172.21.15.79:0/978297762 >> v1:172.21.15.144:6789/0 conn(0x7f70fc0cce30 legacy=0x7f70fc15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 -- 172.21.15.79:0/978297762 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0cd8d0 con 0x7f70fc06a830 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f70fbfff700 1 --2- 172.21.15.79:0/978297762 >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 0x7f70fc06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.433+0000 7f710129c700 1 --2- 172.21.15.79:0/978297762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc06a830 0x7f70fc0b5200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f70fc089bc0 tx=0x7f70f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eb8e613df67bae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f70fb7fe700 1 -- 172.21.15.79:0/978297762 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f400e070 con 0x7f70fc06a830 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f70fb7fe700 1 -- 172.21.15.79:0/978297762 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400ba50 con 0x7f70fc06a830 2023-10-14T18:49:54.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f70fb7fe700 1 -- 172.21.15.79:0/978297762 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40092e0 con 0x7f70fc06a830 2023-10-14T18:49:54.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 -- 172.21.15.79:0/978297762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc06a830 msgr2=0x7f70fc0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 --2- 172.21.15.79:0/978297762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc06a830 0x7f70fc0b5200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f70fc089bc0 tx=0x7f70f4009840 comp rx=0 tx=0).stop 2023-10-14T18:49:54.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 -- 172.21.15.79:0/978297762 shutdown_connections 2023-10-14T18:49:54.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 --2- 172.21.15.79:0/978297762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc06a830 0x7f70fc0b5200 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 --2- 172.21.15.79:0/978297762 >> v2:172.21.15.144:3300/0 conn(0x7f70fc0b6580 0x7f70fc06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 -- 172.21.15.79:0/978297762 >> 172.21.15.79:0/978297762 conn(0x7f70fc068cb0 msgr2=0x7f70fc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 -- 172.21.15.79:0/978297762 shutdown_connections 2023-10-14T18:49:54.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.434+0000 7f7101a9d700 1 -- 172.21.15.79:0/978297762 wait complete. 2023-10-14T18:49:54.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.435+0000 7f7101a9d700 1 Processor -- start 2023-10-14T18:49:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.435+0000 7f7101a9d700 1 -- start start 2023-10-14T18:49:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70fc06a830 0x7f70fc1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 0x7f70fc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc156d50 con 0x7f70fc0cce30 2023-10-14T18:49:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b2f70 con 0x7f70fc06a830 2023-10-14T18:49:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7101a9d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc152f50 con 0x7f70fc0b6580 2023-10-14T18:49:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f710129c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f710129c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44106/0 (socket says 172.21.15.79:44106) 2023-10-14T18:49:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f710129c700 1 -- 172.21.15.79:0/172261319 learned_addr learned my addr 172.21.15.79:0/172261319 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f70fbfff700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 0x7f70fc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.436+0000 7f7100a9b700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70fc06a830 0x7f70fc1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 -- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 msgr2=0x7f70fc1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 0x7f70fc1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 -- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70fc06a830 msgr2=0x7f70fc1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70fc06a830 0x7f70fc1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 -- 172.21.15.79:0/172261319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009ae0 con 0x7f70fc0cce30 2023-10-14T18:49:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f70fbfff700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 0x7f70fc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:54.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f710129c700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009880 tx=0x7f70f4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40094e0 con 0x7f70fc0cce30 2023-10-14T18:49:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc153230 con 0x7f70fc0cce30 2023-10-14T18:49:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400be60 con 0x7f70fc0cce30 2023-10-14T18:49:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4026460 con 0x7f70fc0cce30 2023-10-14T18:49:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.437+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc1537f0 con 0x7f70fc0cce30 2023-10-14T18:49:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.438+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc089550 con 0x7f70fc0cce30 2023-10-14T18:49:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.438+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70f4003040 con 0x7f70fc0cce30 2023-10-14T18:49:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.439+0000 7f70f8ff9700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 0x7f70e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.439+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f70f4086120 con 0x7f70fc0cce30 2023-10-14T18:49:54.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.439+0000 7f7100a9b700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 0x7f70e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.439+0000 7f7100a9b700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 0x7f70e00693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f70f00039e0 tx=0x7f70f0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.443+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70f40536e0 con 0x7f70fc0cce30 2023-10-14T18:49:54.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.623+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70fc0b4440 con 0x7f70fc0cce30 2023-10-14T18:49:54.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.624+0000 7f70f8ff9700 1 -- 172.21.15.79:0/172261319 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70f4056d00 con 0x7f70fc0cce30 2023-10-14T18:49:54.626 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:49:54.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 msgr2=0x7f70e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 0x7f70e00693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f70f00039e0 tx=0x7f70f0007ec0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 msgr2=0x7f70fc150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009880 tx=0x7f70f4018000 comp rx=0 tx=0).stop 2023-10-14T18:49:54.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 shutdown_connections 2023-10-14T18:49:54.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f70e0066f30 0x7f70e00693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70fc0cce30 0x7f70fc150360 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70fc06a830 0x7f70fc1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 --2- 172.21.15.79:0/172261319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70fc0b6580 0x7f70fc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.625+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 >> 172.21.15.79:0/172261319 conn(0x7f70fc068cb0 msgr2=0x7f70fc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.626+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 shutdown_connections 2023-10-14T18:49:54.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.626+0000 7f7101a9d700 1 -- 172.21.15.79:0/172261319 wait complete. 2023-10-14T18:49:54.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:49:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.751+0000 7fd72830b700 1 Processor -- start 2023-10-14T18:49:54.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.751+0000 7fd72830b700 1 -- start start 2023-10-14T18:49:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd72830b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd72015a620 0x7fd72015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd72830b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72015cbb0 con 0x7fd720157870 2023-10-14T18:49:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd72830b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72015bfa0 con 0x7fd72015d580 2023-10-14T18:49:54.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd72830b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72015bdb0 con 0x7fd72015a620 2023-10-14T18:49:54.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7260a7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd720157870 0x7fd72015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48970/0 (socket says 172.21.15.79:48970) 2023-10-14T18:49:54.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7258a6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd72015a620 0x7fd72015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7260a7700 1 -- 172.21.15.79:0/2093228222 learned_addr learned my addr 172.21.15.79:0/2093228222 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:54.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7258a6700 1 -- 172.21.15.79:0/2093228222 >> v1:172.21.15.144:6789/0 conn(0x7fd72015d580 legacy=0x7fd720158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:54.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7258a6700 1 -- 172.21.15.79:0/2093228222 >> v1:172.21.15.79:6789/0 conn(0x7fd720157870 legacy=0x7fd72015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd7258a6700 1 -- 172.21.15.79:0/2093228222 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72015c280 con 0x7fd72015a620 2023-10-14T18:49:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.752+0000 7fd7250a5700 1 -- 172.21.15.79:0/2093228222 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510160282 0 0) 0x7fd72015cbb0 con 0x7fd720157870 2023-10-14T18:49:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd7258a6700 1 --2- 172.21.15.79:0/2093228222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015a620 0x7fd72015d040 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd7100098e0 tx=0x7fd7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f243c0763315cebf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd7250a5700 1 -- 172.21.15.79:0/2093228222 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710009e80 con 0x7fd72015a620 2023-10-14T18:49:54.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd7250a5700 1 -- 172.21.15.79:0/2093228222 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000b820 con 0x7fd72015a620 2023-10-14T18:49:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd7250a5700 1 -- 172.21.15.79:0/2093228222 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000bba0 con 0x7fd72015a620 2023-10-14T18:49:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 -- 172.21.15.79:0/2093228222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015a620 msgr2=0x7fd72015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 --2- 172.21.15.79:0/2093228222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015a620 0x7fd72015d040 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd7100098e0 tx=0x7fd7100091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 -- 172.21.15.79:0/2093228222 shutdown_connections 2023-10-14T18:49:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 --2- 172.21.15.79:0/2093228222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015a620 0x7fd72015d040 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 -- 172.21.15.79:0/2093228222 >> 172.21.15.79:0/2093228222 conn(0x7fd720068ce0 msgr2=0x7fd7200690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 -- 172.21.15.79:0/2093228222 shutdown_connections 2023-10-14T18:49:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.753+0000 7fd72830b700 1 -- 172.21.15.79:0/2093228222 wait complete. 2023-10-14T18:49:54.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.754+0000 7fd72830b700 1 Processor -- start 2023-10-14T18:49:54.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.754+0000 7fd72830b700 1 -- start start 2023-10-14T18:49:54.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd720157870 0x7fd72014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd72015a620 0x7fd7200b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72016b8e0 con 0x7fd72015d580 2023-10-14T18:49:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72014a9b0 con 0x7fd720157870 2023-10-14T18:49:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd72830b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72016ad60 con 0x7fd72015a620 2023-10-14T18:49:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd7268a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd7268a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44122/0 (socket says 172.21.15.79:44122) 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd7268a8700 1 -- 172.21.15.79:0/2960856400 learned_addr learned my addr 172.21.15.79:0/2960856400 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd7260a7700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd720157870 0x7fd72014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.755+0000 7fd7258a6700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd72015a620 0x7fd7200b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 -- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd72015a620 msgr2=0x7fd7200b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd72015a620 0x7fd7200b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 -- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd720157870 msgr2=0x7fd72014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd720157870 0x7fd72014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 -- 172.21.15.79:0/2960856400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710009420 con 0x7fd72015d580 2023-10-14T18:49:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7268a8700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd71800bbb0 tx=0x7fd718009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800c970 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800cad0 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72016b040 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800ce90 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.756+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72016b600 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.757+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72016e010 con 0x7fd72015d580 2023-10-14T18:49:54.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.757+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd718014620 con 0x7fd72015d580 2023-10-14T18:49:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.757+0000 7fd7167fc700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.758+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd718084280 con 0x7fd72015d580 2023-10-14T18:49:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.758+0000 7fd7260a7700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:54.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.758+0000 7fd7260a7700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 0x7fd7040693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0011e0 tx=0x7fd71c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:54.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.762+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd72016e010 con 0x7fd72015d580 2023-10-14T18:49:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.949+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd72016e010 con 0x7fd72015d580 2023-10-14T18:49:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.949+0000 7fd7167fc700 1 -- 172.21.15.79:0/2960856400 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd72016e010 con 0x7fd72015d580 2023-10-14T18:49:54.951 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:54.951 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:49:54.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:49:54.952 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:49:54.952 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:49:54.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:49:54.952 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:49:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 msgr2=0x7fd7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 0x7fd7040693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0011e0 tx=0x7fd71c009040 comp rx=0 tx=0).stop 2023-10-14T18:49:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 msgr2=0x7fd72015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd71800bbb0 tx=0x7fd718009810 comp rx=0 tx=0).stop 2023-10-14T18:49:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 shutdown_connections 2023-10-14T18:49:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd72015d580 0x7fd72015eb90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd720157870 0x7fd72014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 --2- 172.21.15.79:0/2960856400 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd72015a620 0x7fd7200b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:54.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 >> 172.21.15.79:0/2960856400 conn(0x7fd720068ce0 msgr2=0x7fd720156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:54.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 shutdown_connections 2023-10-14T18:49:54.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:54.951+0000 7fd72830b700 1 -- 172.21.15.79:0/2960856400 wait complete. 2023-10-14T18:49:54.964 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:49:54.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:49:55.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.082+0000 7f927c67e700 1 Processor -- start 2023-10-14T18:49:55.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.082+0000 7f927c67e700 1 -- start start 2023-10-14T18:49:55.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927c67e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927c67e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927c67e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740b1a60 con 0x7f92740b15e0 2023-10-14T18:49:55.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927c67e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92740b1d40 con 0x7f9274159ef0 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927c67e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740b2020 con 0x7f92740b6a10 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f9279c19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927a41a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f9279c19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:58708/0 (socket says 172.21.15.79:58708) 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927a41a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:35842/0 (socket says 172.21.15.79:35842) 2023-10-14T18:49:55.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f9279c19700 1 -- 172.21.15.79:0/965609570 learned_addr learned my addr 172.21.15.79:0/965609570 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:55.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.083+0000 7f927ac1b700 1 --1- 172.21.15.79:0/965609570 >> v1:172.21.15.144:6789/0 conn(0x7f92740b15e0 0x7f92740b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:60584/0 (socket says 172.21.15.79:60584) 2023-10-14T18:49:55.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279418700 1 -- 172.21.15.79:0/965609570 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562410644 0 0) 0x7f92740b1a60 con 0x7f92740b15e0 2023-10-14T18:49:55.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279418700 1 -- 172.21.15.79:0/965609570 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9260003570 con 0x7f92740b15e0 2023-10-14T18:49:55.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279c19700 1 -- 172.21.15.79:0/965609570 >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 msgr2=0x7f927415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:55.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279c19700 1 --2- 172.21.15.79:0/965609570 >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279c19700 1 -- 172.21.15.79:0/965609570 >> v1:172.21.15.144:6789/0 conn(0x7f92740b15e0 legacy=0x7f92740b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279c19700 1 -- 172.21.15.79:0/965609570 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740b2300 con 0x7f92740b6a10 2023-10-14T18:49:55.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f927a41a700 1 --2- 172.21.15.79:0/965609570 >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:49:55.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279c19700 1 --2- 172.21.15.79:0/965609570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f92640099b0 tx=0x7f9264009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6514920dbeb0d054 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:55.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279418700 1 -- 172.21.15.79:0/965609570 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400b680 con 0x7f92740b6a10 2023-10-14T18:49:55.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279418700 1 -- 172.21.15.79:0/965609570 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400b7e0 con 0x7f92740b6a10 2023-10-14T18:49:55.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.084+0000 7f9279418700 1 -- 172.21.15.79:0/965609570 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400bb80 con 0x7f92740b6a10 2023-10-14T18:49:55.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 -- 172.21.15.79:0/965609570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 msgr2=0x7f92740b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 --2- 172.21.15.79:0/965609570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f92640099b0 tx=0x7f9264009250 comp rx=0 tx=0).stop 2023-10-14T18:49:55.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 -- 172.21.15.79:0/965609570 shutdown_connections 2023-10-14T18:49:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 --2- 172.21.15.79:0/965609570 >> v2:172.21.15.144:3300/0 conn(0x7f9274159ef0 0x7f927415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 --2- 172.21.15.79:0/965609570 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92740b6a10 0x7f92740b10a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 -- 172.21.15.79:0/965609570 >> 172.21.15.79:0/965609570 conn(0x7f927409a0a0 msgr2=0x7f9274067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 -- 172.21.15.79:0/965609570 shutdown_connections 2023-10-14T18:49:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.085+0000 7f927c67e700 1 -- 172.21.15.79:0/965609570 wait complete. 2023-10-14T18:49:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.086+0000 7f927c67e700 1 Processor -- start 2023-10-14T18:49:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.086+0000 7f927c67e700 1 -- start start 2023-10-14T18:49:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740b6a10 0x7f927416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92741542a0 0x7f9274153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274150950 con 0x7f9274159ef0 2023-10-14T18:49:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927416b140 con 0x7f92740b6a10 2023-10-14T18:49:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927c67e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9274155340 con 0x7f92741542a0 2023-10-14T18:49:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44136/0 (socket says 172.21.15.79:44136) 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 -- 172.21.15.79:0/3743594102 learned_addr learned my addr 172.21.15.79:0/3743594102 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927a41a700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740b6a10 0x7f927416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f927ac1b700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92741542a0 0x7f9274153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 -- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92741542a0 msgr2=0x7f9274153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92741542a0 0x7f9274153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 -- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740b6a10 msgr2=0x7f927416ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740b6a10 0x7f927416ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 -- 172.21.15.79:0/3743594102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270009a20 con 0x7f9274159ef0 2023-10-14T18:49:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.087+0000 7f9279c19700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9264009290 tx=0x7f9264017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400b950 con 0x7f9274159ef0 2023-10-14T18:49:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640094f0 con 0x7f9274159ef0 2023-10-14T18:49:55.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400bab0 con 0x7f9274159ef0 2023-10-14T18:49:55.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926401a680 con 0x7f9274159ef0 2023-10-14T18:49:55.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274154a10 con 0x7f9274159ef0 2023-10-14T18:49:55.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.088+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927404c3c0 con 0x7f9274159ef0 2023-10-14T18:49:55.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.089+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f926401aa30 con 0x7f9274159ef0 2023-10-14T18:49:55.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.089+0000 7f926a7fc700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.089+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9264085f80 con 0x7f9274159ef0 2023-10-14T18:49:55.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.090+0000 7f927a41a700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.090+0000 7f927a41a700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9270009fd0 tx=0x7f927000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:55.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.093+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92640b75a0 con 0x7f9274159ef0 2023-10-14T18:49:55.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.275+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f927408b370 con 0x7f9274159ef0 2023-10-14T18:49:55.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.839+0000 7f926a7fc700 1 -- 172.21.15.79:0/3743594102 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9264053540 con 0x7f9274159ef0 2023-10-14T18:49:55.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 msgr2=0x7f92580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 0x7f92580693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9270009fd0 tx=0x7f927000b040 comp rx=0 tx=0).stop 2023-10-14T18:49:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 msgr2=0x7f92740b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9264009290 tx=0x7f9264017000 comp rx=0 tx=0).stop 2023-10-14T18:49:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 shutdown_connections 2023-10-14T18:49:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9258066f30 0x7f92580693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f92741542a0 0x7f9274153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92740b6a10 0x7f927416ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 --2- 172.21.15.79:0/3743594102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9274159ef0 0x7f92740b0830 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 >> 172.21.15.79:0/3743594102 conn(0x7f927409a0a0 msgr2=0x7f92740b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 shutdown_connections 2023-10-14T18:49:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.843+0000 7f927c67e700 1 -- 172.21.15.79:0/3743594102 wait complete. 2023-10-14T18:49:55.850 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:49:55.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:49:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.980+0000 7f22e320e700 1 Processor -- start 2023-10-14T18:49:55.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.980+0000 7f22e320e700 1 -- start start 2023-10-14T18:49:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e320e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f22dc141490 0x7f22dc0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e320e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22dc06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e320e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc068480 con 0x7f22dc141860 2023-10-14T18:49:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e320e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc067660 con 0x7f22dc141490 2023-10-14T18:49:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e320e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc067870 con 0x7f22dc070e10 2023-10-14T18:49:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22d3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f22dc141860 0x7f22dc070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48984/0 (socket says 172.21.15.79:48984) 2023-10-14T18:49:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22d3fff700 1 -- 172.21.15.79:0/3500457907 learned_addr learned my addr 172.21.15.79:0/3500457907 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774690556 0 0) 0x7f22dc068480 con 0x7f22dc141860 2023-10-14T18:49:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c4003570 con 0x7f22dc141860 2023-10-14T18:49:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22dc06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.981+0000 7f22e0faa700 1 --2- 172.21.15.79:0/3500457907 >> v2:172.21.15.144:3300/0 conn(0x7f22dc141490 0x7f22dc0689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148716174 0 0) 0x7f22c4003570 con 0x7f22dc141860 2023-10-14T18:49:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 msgr2=0x7f22dc06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22dc06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 >> v2:172.21.15.144:3300/0 conn(0x7f22dc141490 msgr2=0x7f22dc0689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 --2- 172.21.15.79:0/3500457907 >> v2:172.21.15.144:3300/0 conn(0x7f22dc141490 0x7f22dc0689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc067b50 con 0x7f22dc141860 2023-10-14T18:49:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f22cc001470 con 0x7f22dc141860 2023-10-14T18:49:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 >> v1:172.21.15.79:6789/0 conn(0x7f22dc141860 legacy=0x7f22dc070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c4004090 0x7f22c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c4004d50 0x7f22c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc067660 con 0x7f22c4004d50 2023-10-14T18:49:55.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc067870 con 0x7f22c4004090 2023-10-14T18:49:55.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c400bbf0 con 0x7f22dc070e10 2023-10-14T18:49:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c4004d50 0x7f22c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e0faa700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d3fff700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c4004090 0x7f22c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 -- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 msgr2=0x7f22c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:55.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc070e10 0x7f22c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 -- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c4004090 msgr2=0x7f22c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22c4004090 0x7f22c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 -- 172.21.15.79:0/3500457907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4003570 con 0x7f22c4004d50 2023-10-14T18:49:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c4004d50 0x7f22c40051c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f22d400bb60 tx=0x7f22d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc47c57f2705af1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:55.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.982+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400d5d0 con 0x7f22c4004d50 2023-10-14T18:49:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400d730 con 0x7f22c4004d50 2023-10-14T18:49:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22d37fe700 1 -- 172.21.15.79:0/3500457907 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400daf0 con 0x7f22c4004d50 2023-10-14T18:49:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 -- 172.21.15.79:0/3500457907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c4004d50 msgr2=0x7f22c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 --2- 172.21.15.79:0/3500457907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22c4004d50 0x7f22c40051c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f22d400bb60 tx=0x7f22d4008040 comp rx=0 tx=0).stop 2023-10-14T18:49:55.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e17ab700 1 -- 172.21.15.79:0/3500457907 reap_dead start 2023-10-14T18:49:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 -- 172.21.15.79:0/3500457907 shutdown_connections 2023-10-14T18:49:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 -- 172.21.15.79:0/3500457907 >> 172.21.15.79:0/3500457907 conn(0x7f22dc0ce570 msgr2=0x7f22dc0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 -- 172.21.15.79:0/3500457907 shutdown_connections 2023-10-14T18:49:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.983+0000 7f22e320e700 1 -- 172.21.15.79:0/3500457907 wait complete. 2023-10-14T18:49:55.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.984+0000 7f22e320e700 1 Processor -- start 2023-10-14T18:49:55.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.984+0000 7f22e320e700 1 -- start start 2023-10-14T18:49:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc0c58b0 0x7f22dc159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22dc15c990 0x7f22dc1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:55.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c6420 con 0x7f22dc15c5c0 2023-10-14T18:49:55.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc159f30 con 0x7f22dc15c990 2023-10-14T18:49:55.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e320e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc15a4b0 con 0x7f22dc0c58b0 2023-10-14T18:49:55.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44152/0 (socket says 172.21.15.79:44152) 2023-10-14T18:49:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 -- 172.21.15.79:0/3281002976 learned_addr learned my addr 172.21.15.79:0/3281002976 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22d3fff700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc0c58b0 0x7f22dc159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e17ab700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22dc15c990 0x7f22dc1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:55.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 -- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc0c58b0 msgr2=0x7f22dc159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc0c58b0 0x7f22dc159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 -- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22dc15c990 msgr2=0x7f22dc1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22dc15c990 0x7f22dc1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.985+0000 7f22e0faa700 1 -- 172.21.15.79:0/3281002976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc15a1d0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22e0faa700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f22d80070b0 tx=0x7f22d8009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8015420 con 0x7f22dc15c5c0 2023-10-14T18:49:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8015580 con 0x7f22dc15c5c0 2023-10-14T18:49:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc0c60b0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8015920 con 0x7f22dc15c5c0 2023-10-14T18:49:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.986+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc0b0db0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.987+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc0c6700 con 0x7f22dc15c5c0 2023-10-14T18:49:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.987+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22d8003040 con 0x7f22dc15c5c0 2023-10-14T18:49:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.988+0000 7f22d0ff9700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 0x7f22c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.988+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f22d8084da0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.988+0000 7f22d3fff700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 0x7f22c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:56.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.988+0000 7f22d3fff700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 0x7f22c80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22cc000fd0 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:56.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:55.992+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22d80521f0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.177+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22dc04c3c0 con 0x7f22dc15c5c0 2023-10-14T18:49:56.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.846+0000 7f22d0ff9700 1 -- 172.21.15.79:0/3281002976 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7f22d8055810 con 0x7f22dc15c5c0 2023-10-14T18:49:56.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.852+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 msgr2=0x7f22c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.852+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 0x7f22c80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f22cc000fd0 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2023-10-14T18:49:56.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.852+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 msgr2=0x7f22dc15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.852+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f22d80070b0 tx=0x7f22d8009710 comp rx=0 tx=0).stop 2023-10-14T18:49:56.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 shutdown_connections 2023-10-14T18:49:56.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22c8066f30 0x7f22c80693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22dc15c990 0x7f22dc1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22dc15c5c0 0x7f22dc15a7d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 --2- 172.21.15.79:0/3281002976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22dc0c58b0 0x7f22dc159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.853+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 >> 172.21.15.79:0/3281002976 conn(0x7f22dc0ce570 msgr2=0x7f22dc0c9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:56.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.855+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 shutdown_connections 2023-10-14T18:49:56.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.855+0000 7f22e320e700 1 -- 172.21.15.79:0/3281002976 wait complete. 2023-10-14T18:49:56.858 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:49:56.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:49:56.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.988+0000 7f6d37fff700 1 Processor -- start 2023-10-14T18:49:56.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.988+0000 7f6d37fff700 1 -- start start 2023-10-14T18:49:56.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d37fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6d3806aa00 0x7f6d38164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:56.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d37fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380b4d70 con 0x7f6d380cce30 2023-10-14T18:49:56.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d37fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3815b3b0 con 0x7f6d380b6580 2023-10-14T18:49:56.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d37fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380cd8d0 con 0x7f6d3806aa00 2023-10-14T18:49:56.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d36ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6d380cce30 0x7f6d3815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48992/0 (socket says 172.21.15.79:48992) 2023-10-14T18:49:56.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d36ffd700 1 -- 172.21.15.79:0/3041067739 learned_addr learned my addr 172.21.15.79:0/3041067739 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:56.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d377fe700 1 --2- 172.21.15.79:0/3041067739 >> v2:172.21.15.79:3300/0 conn(0x7f6d3806aa00 0x7f6d38164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d35ffb700 1 -- 172.21.15.79:0/3041067739 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547722554 0 0) 0x7f6d380b4d70 con 0x7f6d380cce30 2023-10-14T18:49:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d35ffb700 1 -- 172.21.15.79:0/3041067739 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d20003570 con 0x7f6d380cce30 2023-10-14T18:49:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d377fe700 1 -- 172.21.15.79:0/3041067739 >> v1:172.21.15.144:6789/0 conn(0x7f6d380b6580 legacy=0x7f6d3806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d377fe700 1 -- 172.21.15.79:0/3041067739 >> v1:172.21.15.79:6789/0 conn(0x7f6d380cce30 legacy=0x7f6d3815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.989+0000 7f6d377fe700 1 -- 172.21.15.79:0/3041067739 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380b4440 con 0x7f6d3806aa00 2023-10-14T18:49:56.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d377fe700 1 --2- 172.21.15.79:0/3041067739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3806aa00 0x7f6d38164c20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6d300098e0 tx=0x7f6d300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb38f08981b7152 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:56.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d35ffb700 1 -- 172.21.15.79:0/3041067739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30011630 con 0x7f6d3806aa00 2023-10-14T18:49:56.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d35ffb700 1 -- 172.21.15.79:0/3041067739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d30011790 con 0x7f6d3806aa00 2023-10-14T18:49:56.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d35ffb700 1 -- 172.21.15.79:0/3041067739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30011b30 con 0x7f6d3806aa00 2023-10-14T18:49:56.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 -- 172.21.15.79:0/3041067739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3806aa00 msgr2=0x7f6d38164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 --2- 172.21.15.79:0/3041067739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3806aa00 0x7f6d38164c20 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6d300098e0 tx=0x7f6d300091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 -- 172.21.15.79:0/3041067739 shutdown_connections 2023-10-14T18:49:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 --2- 172.21.15.79:0/3041067739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3806aa00 0x7f6d38164c20 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 -- 172.21.15.79:0/3041067739 >> 172.21.15.79:0/3041067739 conn(0x7f6d38068cb0 msgr2=0x7f6d380690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 -- 172.21.15.79:0/3041067739 shutdown_connections 2023-10-14T18:49:56.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.990+0000 7f6d37fff700 1 -- 172.21.15.79:0/3041067739 wait complete. 2023-10-14T18:49:57.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 Processor -- start 2023-10-14T18:49:57.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 -- start start 2023-10-14T18:49:57.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 0x7f6d3813bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d380cce30 0x7f6d3815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38152b40 con 0x7f6d380b6580 2023-10-14T18:49:57.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3813c880 con 0x7f6d3806aa00 2023-10-14T18:49:57.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d37fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38151f30 con 0x7f6d380cce30 2023-10-14T18:49:57.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44176/0 (socket says 172.21.15.79:44176) 2023-10-14T18:49:57.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.992+0000 7f6d367fc700 1 -- 172.21.15.79:0/976630389 learned_addr learned my addr 172.21.15.79:0/976630389 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:57.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d377fe700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d380cce30 0x7f6d3815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d36ffd700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 0x7f6d3813bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 -- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d380cce30 msgr2=0x7f6d3815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d380cce30 0x7f6d3815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 -- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 msgr2=0x7f6d3813bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 0x7f6d3813bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 -- 172.21.15.79:0/976630389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30009420 con 0x7f6d380b6580 2023-10-14T18:49:57.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d36ffd700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 0x7f6d3813bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:57.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d367fc700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c5d0 tx=0x7f6d2c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011590 con 0x7f6d380b6580 2023-10-14T18:49:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011710 con 0x7f6d380b6580 2023-10-14T18:49:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38152210 con 0x7f6d380b6580 2023-10-14T18:49:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c011ad0 con 0x7f6d380b6580 2023-10-14T18:49:57.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.993+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d381527d0 con 0x7f6d380b6580 2023-10-14T18:49:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.994+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d38152cb0 con 0x7f6d380b6580 2023-10-14T18:49:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.994+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d2c01c460 con 0x7f6d380b6580 2023-10-14T18:49:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.995+0000 7f6d1effd700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.995+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6d2c0842d0 con 0x7f6d380b6580 2023-10-14T18:49:57.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.995+0000 7f6d36ffd700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.996+0000 7f6d36ffd700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005c50 tx=0x7f6d28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:57.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:56.999+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d2c0515a0 con 0x7f6d380b6580 2023-10-14T18:49:57.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.223+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d380b4720 con 0x7f6d380b6580 2023-10-14T18:49:57.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.846+0000 7f6d1effd700 1 -- 172.21.15.79:0/976630389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6d2c054bc0 con 0x7f6d380b6580 2023-10-14T18:49:57.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.850+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 msgr2=0x7f6d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.850+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005c50 tx=0x7f6d28009040 comp rx=0 tx=0).stop 2023-10-14T18:49:57.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.850+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 msgr2=0x7f6d380b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.850+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c00c5d0 tx=0x7f6d2c007f60 comp rx=0 tx=0).stop 2023-10-14T18:49:57.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 shutdown_connections 2023-10-14T18:49:57.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d380cce30 0x7f6d3815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3806aa00 0x7f6d3813bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 --2- 172.21.15.79:0/976630389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d380b6580 0x7f6d380b1e60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 >> 172.21.15.79:0/976630389 conn(0x7f6d38068cb0 msgr2=0x7f6d38150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:57.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 shutdown_connections 2023-10-14T18:49:57.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.851+0000 7f6d37fff700 1 -- 172.21.15.79:0/976630389 wait complete. 2023-10-14T18:49:57.856 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 12 and data pool 13 2023-10-14T18:49:57.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:57.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.979+0000 7fea0397c700 1 Processor -- start 2023-10-14T18:49:57.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.979+0000 7fea0397c700 1 -- start start 2023-10-14T18:49:57.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea0397c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 0x7fe9fc0af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea0397c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9fc0c90f0 0x7fe9fc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea0397c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc06efc0 con 0x7fe9fc06f450 2023-10-14T18:49:57.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea0397c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc158470 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea0397c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0af6c0 con 0x7fe9fc0aedb0 2023-10-14T18:49:57.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea01f19700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe9fc0c90f0 0x7fe9fc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea00f17700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe9fc06f450 0x7fe9fc0b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48996/0 (socket says 172.21.15.79:48996) 2023-10-14T18:49:57.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.980+0000 7fea00f17700 1 -- 172.21.15.79:0/2855267084 learned_addr learned my addr 172.21.15.79:0/2855267084 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:57.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01718700 1 --2- 172.21.15.79:0/2855267084 >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 0x7fe9fc0af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01f19700 1 -- 172.21.15.79:0/2855267084 >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 msgr2=0x7fe9fc0af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:57.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01f19700 1 --2- 172.21.15.79:0/2855267084 >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 0x7fe9fc0af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01f19700 1 -- 172.21.15.79:0/2855267084 >> v1:172.21.15.79:6789/0 conn(0x7fe9fc06f450 legacy=0x7fe9fc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fe9f3fff700 1 -- 172.21.15.79:0/2855267084 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897738583 0 0) 0x7fe9fc06efc0 con 0x7fe9fc06f450 2023-10-14T18:49:57.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01f19700 1 -- 172.21.15.79:0/2855267084 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0b2100 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01718700 1 --2- 172.21.15.79:0/2855267084 >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 0x7fe9fc0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fea01f19700 1 --2- 172.21.15.79:0/2855267084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc0c9530 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0711c0 tx=0x7fe9f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22b68fe5749ab14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fe9f3fff700 1 -- 172.21.15.79:0/2855267084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400e070 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fe9f3fff700 1 -- 172.21.15.79:0/2855267084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400bc30 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.981+0000 7fe9f3fff700 1 -- 172.21.15.79:0/2855267084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4012430 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 -- 172.21.15.79:0/2855267084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc0c90f0 msgr2=0x7fe9fc0c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 --2- 172.21.15.79:0/2855267084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc0c9530 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0711c0 tx=0x7fe9f4009780 comp rx=0 tx=0).stop 2023-10-14T18:49:57.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 -- 172.21.15.79:0/2855267084 shutdown_connections 2023-10-14T18:49:57.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 --2- 172.21.15.79:0/2855267084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc0c9530 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 --2- 172.21.15.79:0/2855267084 >> v2:172.21.15.144:3300/0 conn(0x7fe9fc0aedb0 0x7fe9fc0af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 -- 172.21.15.79:0/2855267084 >> 172.21.15.79:0/2855267084 conn(0x7fe9fc0cd1e0 msgr2=0x7fe9fc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:57.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 -- 172.21.15.79:0/2855267084 shutdown_connections 2023-10-14T18:49:57.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.982+0000 7fea0397c700 1 -- 172.21.15.79:0/2855267084 wait complete. 2023-10-14T18:49:57.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.984+0000 7fea0397c700 1 Processor -- start 2023-10-14T18:49:57.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.984+0000 7fea0397c700 1 -- start start 2023-10-14T18:49:57.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.984+0000 7fea0397c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.984+0000 7fea0397c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9fc0aedb0 0x7fe9fc0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.984+0000 7fea0397c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea0397c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cb620 con 0x7fe9fc06f450 2023-10-14T18:49:57.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea0397c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc15ac10 con 0x7fe9fc0c90f0 2023-10-14T18:49:57.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea0397c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc15b0a0 con 0x7fe9fc0aedb0 2023-10-14T18:49:57.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44190/0 (socket says 172.21.15.79:44190) 2023-10-14T18:49:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 -- 172.21.15.79:0/3633278282 learned_addr learned my addr 172.21.15.79:0/3633278282 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01f19700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea00f17700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9fc0aedb0 0x7fe9fc0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 -- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9fc0aedb0 msgr2=0x7fe9fc0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9fc0aedb0 0x7fe9fc0cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 -- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc0c90f0 msgr2=0x7fe9fc14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc14da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 -- 172.21.15.79:0/3633278282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4009a20 con 0x7fe9fc06f450 2023-10-14T18:49:57.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea01718700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c830 tx=0x7fe9f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:57.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011600 con 0x7fe9fc06f450 2023-10-14T18:49:57.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8011760 con 0x7fe9fc06f450 2023-10-14T18:49:57.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc15a000 con 0x7fe9fc06f450 2023-10-14T18:49:57.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011b20 con 0x7fe9fc06f450 2023-10-14T18:49:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.985+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc15a5c0 con 0x7fe9fc06f450 2023-10-14T18:49:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.986+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc04c3c0 con 0x7fe9fc06f450 2023-10-14T18:49:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.987+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9f800a3e0 con 0x7fe9fc06f450 2023-10-14T18:49:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.987+0000 7fe9f17fa700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 0x7fe9e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:57.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.987+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9f8084620 con 0x7fe9fc06f450 2023-10-14T18:49:57.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.987+0000 7fea00f17700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 0x7fe9e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:57.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.988+0000 7fea00f17700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 0x7fe9e00693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc09ab00 tx=0x7fe9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:57.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:57.992+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9f8051890 con 0x7fe9fc06f450 2023-10-14T18:49:58.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.173+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9fc0b23e0 con 0x7fe9fc06f450 2023-10-14T18:49:58.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.174+0000 7fe9f17fa700 1 -- 172.21.15.79:0/3633278282 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fe9f8054eb0 con 0x7fe9fc06f450 2023-10-14T18:49:58.176 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:58.176 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":101,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:57.226110+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 msgr2=0x7fe9e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 0x7fe9e00693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc09ab00 tx=0x7fe9ec009040 comp rx=0 tx=0).stop 2023-10-14T18:49:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 msgr2=0x7fe9fc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c830 tx=0x7fe9f8008040 comp rx=0 tx=0).stop 2023-10-14T18:49:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 shutdown_connections 2023-10-14T18:49:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe9e0066f30 0x7fe9e00693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc0c90f0 0x7fe9fc14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9fc06f450 0x7fe9fc159900 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 --2- 172.21.15.79:0/3633278282 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe9fc0aedb0 0x7fe9fc0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 >> 172.21.15.79:0/3633278282 conn(0x7fe9fc0cd1e0 msgr2=0x7fe9fc063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 shutdown_connections 2023-10-14T18:49:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.176+0000 7fea0397c700 1 -- 172.21.15.79:0/3633278282 wait complete. 2023-10-14T18:49:58.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:49:58.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.303+0000 7f138b344700 1 Processor -- start 2023-10-14T18:49:58.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.303+0000 7f138b344700 1 -- start start 2023-10-14T18:49:58.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.303+0000 7f138b344700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f138415a620 0x7f138415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f138b344700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138415cbb0 con 0x7f138415d580 2023-10-14T18:49:58.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f138b344700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138415bfa0 con 0x7f1384157870 2023-10-14T18:49:58.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f138b344700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138415bdb0 con 0x7f138415a620 2023-10-14T18:49:58.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13888df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f138415a620 0x7f138415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13898e1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f138415d580 0x7f1384158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:48998/0 (socket says 172.21.15.79:48998) 2023-10-14T18:49:58.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13898e1700 1 -- 172.21.15.79:0/2991294106 learned_addr learned my addr 172.21.15.79:0/2991294106 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:58.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13888df700 1 -- 172.21.15.79:0/2991294106 >> v1:172.21.15.144:6789/0 conn(0x7f1384157870 legacy=0x7f138415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:58.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13888df700 1 -- 172.21.15.79:0/2991294106 >> v1:172.21.15.79:6789/0 conn(0x7f138415d580 legacy=0x7f1384158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f137bfff700 1 -- 172.21.15.79:0/2991294106 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022531366 0 0) 0x7f138415cbb0 con 0x7f138415d580 2023-10-14T18:49:58.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13888df700 1 -- 172.21.15.79:0/2991294106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138415c280 con 0x7f138415a620 2023-10-14T18:49:58.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f13888df700 1 --2- 172.21.15.79:0/2991294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f138415a620 0x7f138415d040 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f13740098e0 tx=0x7f13740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552d725be0a98090 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f137bfff700 1 -- 172.21.15.79:0/2991294106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374009e80 con 0x7f138415a620 2023-10-14T18:49:58.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f137bfff700 1 -- 172.21.15.79:0/2991294106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400b820 con 0x7f138415a620 2023-10-14T18:49:58.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.304+0000 7f137bfff700 1 -- 172.21.15.79:0/2991294106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400bba0 con 0x7f138415a620 2023-10-14T18:49:58.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 -- 172.21.15.79:0/2991294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f138415a620 msgr2=0x7f138415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 --2- 172.21.15.79:0/2991294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f138415a620 0x7f138415d040 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f13740098e0 tx=0x7f13740091a0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 -- 172.21.15.79:0/2991294106 shutdown_connections 2023-10-14T18:49:58.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 --2- 172.21.15.79:0/2991294106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f138415a620 0x7f138415d040 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 -- 172.21.15.79:0/2991294106 >> 172.21.15.79:0/2991294106 conn(0x7f1384068ce0 msgr2=0x7f13840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:58.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 -- 172.21.15.79:0/2991294106 shutdown_connections 2023-10-14T18:49:58.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.305+0000 7f138b344700 1 -- 172.21.15.79:0/2991294106 wait complete. 2023-10-14T18:49:58.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.306+0000 7f138b344700 1 Processor -- start 2023-10-14T18:49:58.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.306+0000 7f138b344700 1 -- start start 2023-10-14T18:49:58.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f138415a620 0x7f138416eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f138415d580 0x7f138414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138416efe0 con 0x7f1384157870 2023-10-14T18:49:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840b1b90 con 0x7f138415d580 2023-10-14T18:49:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138414b990 con 0x7f138415a620 2023-10-14T18:49:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44204/0 (socket says 172.21.15.79:44204) 2023-10-14T18:49:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 -- 172.21.15.79:0/3172730805 learned_addr learned my addr 172.21.15.79:0/3172730805 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13898e1700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f138415d580 0x7f138414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13888df700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f138415a620 0x7f138416eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 -- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f138415a620 msgr2=0x7f138416eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f138415a620 0x7f138416eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 -- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f138415d580 msgr2=0x7f138414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f138415d580 0x7f138414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 -- 172.21.15.79:0/3172730805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009420 con 0x7f1384157870 2023-10-14T18:49:58.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13890e0700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f138000bbb0 tx=0x7f1380009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13800092e0 con 0x7f1384157870 2023-10-14T18:49:58.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138000c7a0 con 0x7f1384157870 2023-10-14T18:49:58.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840d0ab0 con 0x7f1384157870 2023-10-14T18:49:58.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000cb40 con 0x7f1384157870 2023-10-14T18:49:58.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.308+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840d1070 con 0x7f1384157870 2023-10-14T18:49:58.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.309+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138404c3c0 con 0x7f1384157870 2023-10-14T18:49:58.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.309+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1380012070 con 0x7f1384157870 2023-10-14T18:49:58.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.309+0000 7f13797fa700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 0x7f13680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.309+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13800842a0 con 0x7f1384157870 2023-10-14T18:49:58.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.309+0000 7f13888df700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 0x7f13680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.310+0000 7f13888df700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 0x7f13680693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f138415aa20 tx=0x7f1374016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.313+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1380051510 con 0x7f1384157870 2023-10-14T18:49:58.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.496+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f138415c560 con 0x7f1384157870 2023-10-14T18:49:58.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.497+0000 7f13797fa700 1 -- 172.21.15.79:0/3172730805 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f1380054b30 con 0x7f1384157870 2023-10-14T18:49:58.498 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:49:58.499 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":101,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:57.226110+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:49:58.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 msgr2=0x7f13680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 0x7f13680693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f138415aa20 tx=0x7f1374016000 comp rx=0 tx=0).stop 2023-10-14T18:49:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 msgr2=0x7f13840d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f138000bbb0 tx=0x7f1380009840 comp rx=0 tx=0).stop 2023-10-14T18:49:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 shutdown_connections 2023-10-14T18:49:58.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1368066f30 0x7f13680693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f138415d580 0x7f138414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1384157870 0x7f13840d04d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 --2- 172.21.15.79:0/3172730805 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f138415a620 0x7f138416eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 >> 172.21.15.79:0/3172730805 conn(0x7f1384068ce0 msgr2=0x7f138414c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 shutdown_connections 2023-10-14T18:49:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.499+0000 7f138b344700 1 -- 172.21.15.79:0/3172730805 wait complete. 2023-10-14T18:49:58.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:49:58.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 Processor -- start 2023-10-14T18:49:58.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 -- start start 2023-10-14T18:49:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f91600c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600cb3a0 con 0x7f916006f560 2023-10-14T18:49:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600c8350 con 0x7f916015e250 2023-10-14T18:49:58.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f9165a04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600cad50 con 0x7f916015e620 2023-10-14T18:49:58.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f915f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f916006f560 0x7f91600c7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45262/0 (socket says 172.21.15.79:45262) 2023-10-14T18:49:58.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.629+0000 7f915f7fe700 1 -- 172.21.15.79:0/3200629266 learned_addr learned my addr 172.21.15.79:0/3200629266 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:49:58.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f91567fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f91600c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397053805 0 0) 0x7f91600cb3a0 con 0x7f916006f560 2023-10-14T18:49:58.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f914c003570 con 0x7f916006f560 2023-10-14T18:49:58.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722944485 0 0) 0x7f914c003570 con 0x7f916006f560 2023-10-14T18:49:58.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 msgr2=0x7f91600c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:58.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f91600c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 >> v1:172.21.15.144:6789/0 conn(0x7f916015e250 legacy=0x7f916006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600cb030 con 0x7f916006f560 2023-10-14T18:49:58.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f91580017f0 con 0x7f916006f560 2023-10-14T18:49:58.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 >> v1:172.21.15.79:6789/0 conn(0x7f916006f560 legacy=0x7f91600c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f914c003a90 0x7f914c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f914c004810 0x7f914c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f914c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600cad50 con 0x7f914c003a90 2023-10-14T18:49:58.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c00bb60 con 0x7f914c004810 2023-10-14T18:49:58.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c00bd20 con 0x7f916015e620 2023-10-14T18:49:58.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f914c003a90 0x7f914c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f91567fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f914c004810 0x7f914c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915f7fe700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f914c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 -- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 msgr2=0x7f914c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:58.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f914c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 -- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f914c004810 msgr2=0x7f914c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:49:58.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f914c004810 0x7f914c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915effd700 1 -- 172.21.15.79:0/3200629266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c003570 con 0x7f914c003a90 2023-10-14T18:49:58.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f91567fc700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f914c004810 0x7f914c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:58.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.630+0000 7f915f7fe700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f916015e620 0x7f914c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:49:58.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f915effd700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f914c003a90 0x7f914c003ea0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f91500018b0 tx=0x7f9150007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b819002782510bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150012420 con 0x7f914c003a90 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150012580 con 0x7f914c003a90 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f915e7fc700 1 -- 172.21.15.79:0/3200629266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150012920 con 0x7f914c003a90 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 -- 172.21.15.79:0/3200629266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f914c003a90 msgr2=0x7f914c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 --2- 172.21.15.79:0/3200629266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f914c003a90 0x7f914c003ea0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f91500018b0 tx=0x7f9150007d30 comp rx=0 tx=0).stop 2023-10-14T18:49:58.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f915f7fe700 1 -- 172.21.15.79:0/3200629266 reap_dead start 2023-10-14T18:49:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 -- 172.21.15.79:0/3200629266 shutdown_connections 2023-10-14T18:49:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 -- 172.21.15.79:0/3200629266 >> 172.21.15.79:0/3200629266 conn(0x7f9160067660 msgr2=0x7f9160067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 -- 172.21.15.79:0/3200629266 shutdown_connections 2023-10-14T18:49:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.631+0000 7f9165a04700 1 -- 172.21.15.79:0/3200629266 wait complete. 2023-10-14T18:49:58.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.632+0000 7f9165a04700 1 Processor -- start 2023-10-14T18:49:58.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 -- start start 2023-10-14T18:49:58.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 0x7f9160158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 0x7f91600b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600b2cd0 con 0x7f916016d1f0 2023-10-14T18:49:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916016dba0 con 0x7f91600b08f0 2023-10-14T18:49:58.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f9165a04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600b2840 con 0x7f914c003a90 2023-10-14T18:49:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f915f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f915f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45624/0 (socket says 172.21.15.79:45624) 2023-10-14T18:49:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.633+0000 7f915f7fe700 1 -- 172.21.15.79:0/1445465994 learned_addr learned my addr 172.21.15.79:0/1445465994 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:49:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915effd700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 0x7f9160158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f91567fc700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 0x7f91600b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 -- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 msgr2=0x7f9160158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 0x7f9160158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 -- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 msgr2=0x7f91600b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 0x7f91600b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:58.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 -- 172.21.15.79:0/1445465994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600b1c30 con 0x7f916016d1f0 2023-10-14T18:49:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915effd700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 0x7f9160158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f91567fc700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 0x7f91600b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:49:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f915f7fe700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f916015d830 tx=0x7f9158001f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158017070 con 0x7f916016d1f0 2023-10-14T18:49:58.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915800ebc0 con 0x7f916016d1f0 2023-10-14T18:49:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91600b1f10 con 0x7f916016d1f0 2023-10-14T18:49:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158013420 con 0x7f916016d1f0 2023-10-14T18:49:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.634+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91600b24d0 con 0x7f916016d1f0 2023-10-14T18:49:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.635+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91600b29d0 con 0x7f916016d1f0 2023-10-14T18:49:58.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.635+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91580137d0 con 0x7f916016d1f0 2023-10-14T18:49:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.636+0000 7f91577fe700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 0x7f9140069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:49:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.636+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91580843f0 con 0x7f916016d1f0 2023-10-14T18:49:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.636+0000 7f915effd700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 0x7f9140069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:49:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.636+0000 7f915effd700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 0x7f9140069410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91500018b0 tx=0x7f9150015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:49:58.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.641+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9158051660 con 0x7f916016d1f0 2023-10-14T18:49:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:58.869+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91600cc840 con 0x7f916016d1f0 2023-10-14T18:49:59.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.866+0000 7f91577fe700 1 -- 172.21.15.79:0/1445465994 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91580017b0 con 0x7f916016d1f0 2023-10-14T18:49:59.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 msgr2=0x7f9140069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:59.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 0x7f9140069410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f91500018b0 tx=0x7f9150015000 comp rx=0 tx=0).stop 2023-10-14T18:49:59.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 msgr2=0x7f916016d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:49:59.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f916015d830 tx=0x7f9158001f40 comp rx=0 tx=0).stop 2023-10-14T18:49:59.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 shutdown_connections 2023-10-14T18:49:59.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9140066f60 0x7f9140069410 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:59.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f916016d1f0 0x7f916016d660 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:59.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f914c003a90 0x7f9160158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:59.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 --2- 172.21.15.79:0/1445465994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91600b08f0 0x7f91600b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:49:59.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 >> 172.21.15.79:0/1445465994 conn(0x7f9160067660 msgr2=0x7f91600cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:49:59.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 shutdown_connections 2023-10-14T18:49:59.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:49:59.868+0000 7f9165a04700 1 -- 172.21.15.79:0/1445465994 wait complete. 2023-10-14T18:49:59.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:50:00.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.004+0000 7f03e9d42700 1 Processor -- start 2023-10-14T18:50:00.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.004+0000 7f03e9d42700 1 -- start start 2023-10-14T18:50:00.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e9d42700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03e415a290 0x7f03e406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e9d42700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e40b0790 con 0x7f03e4159ec0 2023-10-14T18:50:00.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e9d42700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e406af20 con 0x7f03e406aae0 2023-10-14T18:50:00.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e9d42700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e40ce1f0 con 0x7f03e415a290 2023-10-14T18:50:00.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f03e4159ec0 0x7f03e40af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45270/0 (socket says 172.21.15.79:45270) 2023-10-14T18:50:00.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e37fe700 1 -- 172.21.15.79:0/3406364761 learned_addr learned my addr 172.21.15.79:0/3406364761 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:00.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935167754 0 0) 0x7f03e40b0790 con 0x7f03e4159ec0 2023-10-14T18:50:00.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc003570 con 0x7f03e4159ec0 2023-10-14T18:50:00.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/3406364761 >> v2:172.21.15.144:3300/0 conn(0x7f03e415a290 0x7f03e406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597693739 0 0) 0x7f03cc003570 con 0x7f03e4159ec0 2023-10-14T18:50:00.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 >> v2:172.21.15.144:3300/0 conn(0x7f03e415a290 msgr2=0x7f03e406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:00.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 --2- 172.21.15.79:0/3406364761 >> v2:172.21.15.144:3300/0 conn(0x7f03e415a290 0x7f03e406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 >> v1:172.21.15.144:6789/0 conn(0x7f03e406aae0 legacy=0x7f03e40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40b0b20 con 0x7f03e4159ec0 2023-10-14T18:50:00.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f03d40017f0 con 0x7f03e4159ec0 2023-10-14T18:50:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 >> v1:172.21.15.79:6789/0 conn(0x7f03e4159ec0 legacy=0x7f03e40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.005+0000 7f03e27fc700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc003a60 0x7f03cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 0x7f03cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03cc0051c0 0x7f03cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40ce1f0 con 0x7f03cc004810 2023-10-14T18:50:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc00c160 con 0x7f03cc0051c0 2023-10-14T18:50:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc00c320 con 0x7f03cc003a60 2023-10-14T18:50:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 0x7f03cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e37fe700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc003a60 0x7f03cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e3fff700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03cc0051c0 0x7f03cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 -- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc003a60 msgr2=0x7f03cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:00.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc003a60 0x7f03cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 -- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03cc0051c0 msgr2=0x7f03cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:00.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03cc0051c0 0x7f03cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e3fff700 1 -- 172.21.15.79:0/3406364761 reap_dead start 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 -- 172.21.15.79:0/3406364761 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc003570 con 0x7f03cc004810 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e37fe700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc003a60 0x7f03cc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 0x7f03cc004c80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009c00 tx=0x7f03d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c5b568b8fd9ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800e710 con 0x7f03cc004810 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800e870 con 0x7f03cc004810 2023-10-14T18:50:00.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.006+0000 7f03e27fc700 1 -- 172.21.15.79:0/3406364761 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800ec30 con 0x7f03cc004810 2023-10-14T18:50:00.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 -- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 msgr2=0x7f03cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 0x7f03cc004c80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009c00 tx=0x7f03d80091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 -- 172.21.15.79:0/3406364761 shutdown_connections 2023-10-14T18:50:00.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 --2- 172.21.15.79:0/3406364761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc004810 0x7f03cc004c80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 -- 172.21.15.79:0/3406364761 >> 172.21.15.79:0/3406364761 conn(0x7f03e40d1880 msgr2=0x7f03e40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:00.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 -- 172.21.15.79:0/3406364761 shutdown_connections 2023-10-14T18:50:00.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.007+0000 7f03e9d42700 1 -- 172.21.15.79:0/3406364761 wait complete. 2023-10-14T18:50:00.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.008+0000 7f03e9d42700 1 Processor -- start 2023-10-14T18:50:00.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.008+0000 7f03e9d42700 1 -- start start 2023-10-14T18:50:00.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc004810 0x7f03e415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03e40b6400 0x7f03e4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41585d0 con 0x7f03e415d250 2023-10-14T18:50:00.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e40b6900 con 0x7f03e40b6400 2023-10-14T18:50:00.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4157f80 con 0x7f03cc004810 2023-10-14T18:50:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45648/0 (socket says 172.21.15.79:45648) 2023-10-14T18:50:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 -- 172.21.15.79:0/2887561297 learned_addr learned my addr 172.21.15.79:0/2887561297 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e2ffd700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03e40b6400 0x7f03e4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e37fe700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc004810 0x7f03e415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 -- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc004810 msgr2=0x7f03e415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc004810 0x7f03e415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 -- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03e40b6400 msgr2=0x7f03e4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03e40b6400 0x7f03e4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 -- 172.21.15.79:0/2887561297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4158260 con 0x7f03e415d250 2023-10-14T18:50:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e3fff700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f03e406b5b0 tx=0x7f03dc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc00ee60 con 0x7f03e415d250 2023-10-14T18:50:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc012590 con 0x7f03e415d250 2023-10-14T18:50:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e41551f0 con 0x7f03e415d250 2023-10-14T18:50:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc012930 con 0x7f03e415d250 2023-10-14T18:50:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.009+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e415d6c0 con 0x7f03e415d250 2023-10-14T18:50:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.010+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e4157da0 con 0x7f03e415d250 2023-10-14T18:50:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.011+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03dc012d20 con 0x7f03e415d250 2023-10-14T18:50:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.011+0000 7f03cb7fe700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 0x7f03d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.011+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03dc0842e0 con 0x7f03e415d250 2023-10-14T18:50:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.011+0000 7f03e37fe700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 0x7f03d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.012+0000 7f03e37fe700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 0x7f03d00693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03d4001190 tx=0x7f03d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.015+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03dc051550 con 0x7f03e415d250 2023-10-14T18:50:00.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.242+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f03e415d8b0 con 0x7f03e415d250 2023-10-14T18:50:00.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.871+0000 7f03cb7fe700 1 -- 172.21.15.79:0/2887561297 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f03dc054b70 con 0x7f03e415d250 2023-10-14T18:50:00.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 msgr2=0x7f03d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 0x7f03d00693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03d4001190 tx=0x7f03d4009040 comp rx=0 tx=0).stop 2023-10-14T18:50:00.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 msgr2=0x7f03e40b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:00.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f03e406b5b0 tx=0x7f03dc009040 comp rx=0 tx=0).stop 2023-10-14T18:50:00.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 shutdown_connections 2023-10-14T18:50:00.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f03d0066f30 0x7f03d00693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03e415d250 0x7f03e40b2b10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f03cc004810 0x7f03e415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 --2- 172.21.15.79:0/2887561297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03e40b6400 0x7f03e4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:00.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 >> 172.21.15.79:0/2887561297 conn(0x7f03e40d1880 msgr2=0x7f03e4155b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:00.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 shutdown_connections 2023-10-14T18:50:00.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:00.873+0000 7f03e9d42700 1 -- 172.21.15.79:0/2887561297 wait complete. 2023-10-14T18:50:00.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:01.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.002+0000 7f4b3590c700 1 Processor -- start 2023-10-14T18:50:01.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.002+0000 7f4b3590c700 1 -- start start 2023-10-14T18:50:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b3590c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4b3015cbd0 0x7f4b3015d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b3590c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300cb7c0 con 0x7f4b300cdab0 2023-10-14T18:50:01.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b3590c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3015e290 con 0x7f4b300cd6e0 2023-10-14T18:50:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b3590c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3015e850 con 0x7f4b3015cbd0 2023-10-14T18:50:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b2ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4b300cdab0 0x7f4b3015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45276/0 (socket says 172.21.15.79:45276) 2023-10-14T18:50:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b2ffff700 1 -- 172.21.15.79:0/1439007169 learned_addr learned my addr 172.21.15.79:0/1439007169 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b3510b700 1 --2- 172.21.15.79:0/1439007169 >> v2:172.21.15.144:3300/0 conn(0x7f4b3015cbd0 0x7f4b3015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703594352 0 0) 0x7f4b300cb7c0 con 0x7f4b300cdab0 2023-10-14T18:50:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.003+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c003570 con 0x7f4b300cdab0 2023-10-14T18:50:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664966171 0 0) 0x7f4b1c003570 con 0x7f4b300cdab0 2023-10-14T18:50:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 >> v2:172.21.15.144:3300/0 conn(0x7f4b3015cbd0 msgr2=0x7f4b3015d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 --2- 172.21.15.79:0/1439007169 >> v2:172.21.15.144:3300/0 conn(0x7f4b3015cbd0 0x7f4b3015d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 >> v1:172.21.15.144:6789/0 conn(0x7f4b300cd6e0 legacy=0x7f4b300cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3015e570 con 0x7f4b300cdab0 2023-10-14T18:50:01.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4b20001470 con 0x7f4b300cdab0 2023-10-14T18:50:01.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 >> v1:172.21.15.79:6789/0 conn(0x7f4b300cdab0 legacy=0x7f4b3015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 0x7f4b1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c0051c0 0x7f4b1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3015e850 con 0x7f4b1c003a60 2023-10-14T18:50:01.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00c0d0 con 0x7f4b1c0051c0 2023-10-14T18:50:01.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00c290 con 0x7f4b1c004810 2023-10-14T18:50:01.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 0x7f4b1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2ffff700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3510b700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c0051c0 0x7f4b1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 -- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c004810 msgr2=0x7f4b1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 -- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c0051c0 msgr2=0x7f4b1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b1c0051c0 0x7f4b1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 -- 172.21.15.79:0/1439007169 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c003570 con 0x7f4b1c003a60 2023-10-14T18:50:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3510b700 1 -- 172.21.15.79:0/1439007169 reap_dead start 2023-10-14T18:50:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2ffff700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:01.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b3490a700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 0x7f4b1c003e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001fc0 tx=0x7f4b28001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e33b64d915f081 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28001950 con 0x7f4b1c003a60 2023-10-14T18:50:01.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2800c8b0 con 0x7f4b1c003a60 2023-10-14T18:50:01.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.004+0000 7f4b2f7fe700 1 -- 172.21.15.79:0/1439007169 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2800cc50 con 0x7f4b1c003a60 2023-10-14T18:50:01.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 -- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 msgr2=0x7f4b1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 0x7f4b1c003e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001fc0 tx=0x7f4b28001640 comp rx=0 tx=0).stop 2023-10-14T18:50:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 -- 172.21.15.79:0/1439007169 shutdown_connections 2023-10-14T18:50:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 --2- 172.21.15.79:0/1439007169 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b1c003a60 0x7f4b1c003e70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 -- 172.21.15.79:0/1439007169 >> 172.21.15.79:0/1439007169 conn(0x7f4b30067660 msgr2=0x7f4b30067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 -- 172.21.15.79:0/1439007169 shutdown_connections 2023-10-14T18:50:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.005+0000 7f4b3590c700 1 -- 172.21.15.79:0/1439007169 wait complete. 2023-10-14T18:50:01.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.006+0000 7f4b3590c700 1 Processor -- start 2023-10-14T18:50:01.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.006+0000 7f4b3590c700 1 -- start start 2023-10-14T18:50:01.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c003a60 0x7f4b300b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300b4550 0x7f4b300b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300cc360 con 0x7f4b3015c380 2023-10-14T18:50:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300b40c0 con 0x7f4b300b4550 2023-10-14T18:50:01.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3590c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300b3ab0 con 0x7f4b1c003a60 2023-10-14T18:50:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45674/0 (socket says 172.21.15.79:45674) 2023-10-14T18:50:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 -- 172.21.15.79:0/561672390 learned_addr learned my addr 172.21.15.79:0/561672390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3490a700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c003a60 0x7f4b300b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b3510b700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300b4550 0x7f4b300b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 -- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c003a60 msgr2=0x7f4b300b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c003a60 0x7f4b300b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 -- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300b4550 msgr2=0x7f4b300b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300b4550 0x7f4b300b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.007+0000 7f4b2ffff700 1 -- 172.21.15.79:0/561672390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300b5b10 con 0x7f4b3015c380 2023-10-14T18:50:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b2ffff700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4b20001c00 tx=0x7f4b20001430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000ee70 con 0x7f4b3015c380 2023-10-14T18:50:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20005e30 con 0x7f4b3015c380 2023-10-14T18:50:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b300b3d50 con 0x7f4b3015c380 2023-10-14T18:50:01.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000ca50 con 0x7f4b3015c380 2023-10-14T18:50:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.008+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b300b5df0 con 0x7f4b3015c380 2023-10-14T18:50:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.009+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b30089280 con 0x7f4b3015c380 2023-10-14T18:50:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.009+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b2001d460 con 0x7f4b3015c380 2023-10-14T18:50:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.010+0000 7f4b2cff9700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 0x7f4b100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.010+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b20084320 con 0x7f4b3015c380 2023-10-14T18:50:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.010+0000 7f4b3490a700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 0x7f4b100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.010+0000 7f4b3490a700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 0x7f4b100693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001da0 tx=0x7f4b28015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.014+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b20051590 con 0x7f4b3015c380 2023-10-14T18:50:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.236+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b300c63c0 con 0x7f4b3015c380 2023-10-14T18:50:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.237+0000 7f4b2cff9700 1 -- 172.21.15.79:0/561672390 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4b20054bb0 con 0x7f4b3015c380 2023-10-14T18:50:01.238 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:01.238 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 msgr2=0x7f4b100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 0x7f4b100693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001da0 tx=0x7f4b28015000 comp rx=0 tx=0).stop 2023-10-14T18:50:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 msgr2=0x7f4b3014d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4b20001c00 tx=0x7f4b20001430 comp rx=0 tx=0).stop 2023-10-14T18:50:01.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 shutdown_connections 2023-10-14T18:50:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b10066f30 0x7f4b100693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b300b4550 0x7f4b300b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b1c003a60 0x7f4b300b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 --2- 172.21.15.79:0/561672390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b3015c380 0x7f4b3014d6f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 >> 172.21.15.79:0/561672390 conn(0x7f4b30067660 msgr2=0x7f4b3006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 shutdown_connections 2023-10-14T18:50:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.239+0000 7f4b3590c700 1 -- 172.21.15.79:0/561672390 wait complete. 2023-10-14T18:50:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:01.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:01.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.367+0000 7f11b658d700 1 Processor -- start 2023-10-14T18:50:01.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.367+0000 7f11b658d700 1 -- start start 2023-10-14T18:50:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.368+0000 7f11b658d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 0x7f11b0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.368+0000 7f11b658d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11b006fe80 0x7f11b015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.368+0000 7f11b658d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b015bd50 con 0x7f11b0069870 2023-10-14T18:50:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.368+0000 7f11b658d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b006a710 con 0x7f11b006fe80 2023-10-14T18:50:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.368+0000 7f11b658d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01581c0 con 0x7f11b01578b0 2023-10-14T18:50:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b4d8a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11b006fe80 0x7f11b015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b5d8c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f11b0069870 0x7f11b00ca810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:42662/0 (socket says 172.21.15.79:42662) 2023-10-14T18:50:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 0x7f11b0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b5d8c700 1 -- 172.21.15.79:0/1939075303 learned_addr learned my addr 172.21.15.79:0/1939075303 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 -- 172.21.15.79:0/1939075303 >> v2:172.21.15.144:3300/0 conn(0x7f11b006fe80 msgr2=0x7f11b015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 --2- 172.21.15.79:0/1939075303 >> v2:172.21.15.144:3300/0 conn(0x7f11b006fe80 0x7f11b015c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11a7fff700 1 -- 172.21.15.79:0/1939075303 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266124243 0 0) 0x7f11b015bd50 con 0x7f11b0069870 2023-10-14T18:50:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 -- 172.21.15.79:0/1939075303 >> v1:172.21.15.144:6789/0 conn(0x7f11b0069870 legacy=0x7f11b00ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 -- 172.21.15.79:0/1939075303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b015c720 con 0x7f11b01578b0 2023-10-14T18:50:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11b558b700 1 --2- 172.21.15.79:0/1939075303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 0x7f11b0157c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098e0 tx=0x7f11ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d73c479e104bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11a7fff700 1 -- 172.21.15.79:0/1939075303 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00b640 con 0x7f11b01578b0 2023-10-14T18:50:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11a7fff700 1 -- 172.21.15.79:0/1939075303 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00b7a0 con 0x7f11b01578b0 2023-10-14T18:50:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.369+0000 7f11a7fff700 1 -- 172.21.15.79:0/1939075303 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00bb40 con 0x7f11b01578b0 2023-10-14T18:50:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 -- 172.21.15.79:0/1939075303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 msgr2=0x7f11b0157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 --2- 172.21.15.79:0/1939075303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 0x7f11b0157c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098e0 tx=0x7f11ac0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 -- 172.21.15.79:0/1939075303 shutdown_connections 2023-10-14T18:50:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 --2- 172.21.15.79:0/1939075303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b01578b0 0x7f11b0157c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 --2- 172.21.15.79:0/1939075303 >> v2:172.21.15.144:3300/0 conn(0x7f11b006fe80 0x7f11b015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 -- 172.21.15.79:0/1939075303 >> 172.21.15.79:0/1939075303 conn(0x7f11b006bc70 msgr2=0x7f11b006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 -- 172.21.15.79:0/1939075303 shutdown_connections 2023-10-14T18:50:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.370+0000 7f11b658d700 1 -- 172.21.15.79:0/1939075303 wait complete. 2023-10-14T18:50:01.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.371+0000 7f11b658d700 1 Processor -- start 2023-10-14T18:50:01.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.371+0000 7f11b658d700 1 -- start start 2023-10-14T18:50:01.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b0069870 0x7f11b00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 0x7f11b0152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c4a00 con 0x7f11b006fe80 2023-10-14T18:50:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b014f530 con 0x7f11b01578b0 2023-10-14T18:50:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b658d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c40d0 con 0x7f11b0069870 2023-10-14T18:50:01.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45682/0 (socket says 172.21.15.79:45682) 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 -- 172.21.15.79:0/691417597 learned_addr learned my addr 172.21.15.79:0/691417597 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b558b700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b0069870 0x7f11b00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b5d8c700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 0x7f11b0152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 -- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b0069870 msgr2=0x7f11b00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b0069870 0x7f11b00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 -- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 msgr2=0x7f11b0152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 0x7f11b0152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b4d8a700 1 -- 172.21.15.79:0/691417597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac009420 con 0x7f11b006fe80 2023-10-14T18:50:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.372+0000 7f11b5d8c700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 0x7f11b0152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11b4d8a700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f11a000ec80 tx=0x7f11a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a000c9d0 con 0x7f11b006fe80 2023-10-14T18:50:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a000cb30 con 0x7f11b006fe80 2023-10-14T18:50:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0013470 con 0x7f11b006fe80 2023-10-14T18:50:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b00c43b0 con 0x7f11b006fe80 2023-10-14T18:50:01.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.373+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00c3d80 con 0x7f11b006fe80 2023-10-14T18:50:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.374+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b00c4bb0 con 0x7f11b006fe80 2023-10-14T18:50:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.374+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11a0013820 con 0x7f11b006fe80 2023-10-14T18:50:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.375+0000 7f11a57fa700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 0x7f1194069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.375+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11a0084940 con 0x7f11b006fe80 2023-10-14T18:50:01.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.375+0000 7f11b558b700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 0x7f1194069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.375+0000 7f11b558b700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 0x7f1194069460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0091e0 tx=0x7f11ac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.379+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11b00c4bb0 con 0x7f11b006fe80 2023-10-14T18:50:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.564+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11b00c4b40 con 0x7f11b006fe80 2023-10-14T18:50:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.565+0000 7f11a57fa700 1 -- 172.21.15.79:0/691417597 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f11a0051b10 con 0x7f11b006fe80 2023-10-14T18:50:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:01.566 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":102,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:49:58.521166+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 msgr2=0x7f1194069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 0x7f1194069460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0091e0 tx=0x7f11ac017000 comp rx=0 tx=0).stop 2023-10-14T18:50:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 msgr2=0x7f11b00c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f11a000ec80 tx=0x7f11a00091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 shutdown_connections 2023-10-14T18:50:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1194066fb0 0x7f1194069460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11b01578b0 0x7f11b0152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11b0069870 0x7f11b00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 --2- 172.21.15.79:0/691417597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11b006fe80 0x7f11b00c4e90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 >> 172.21.15.79:0/691417597 conn(0x7f11b006bc70 msgr2=0x7f11b00cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 shutdown_connections 2023-10-14T18:50:01.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.567+0000 7f11b658d700 1 -- 172.21.15.79:0/691417597 wait complete. 2023-10-14T18:50:01.579 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:50:01.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:01.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.694+0000 7fc8dccd2700 1 Processor -- start 2023-10-14T18:50:01.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.694+0000 7fc8dccd2700 1 -- start start 2023-10-14T18:50:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8dccd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d8157870 0x7fc8d815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8dccd2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8d8157c40 0x7fc8d8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8dccd2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d815cbb0 con 0x7fc8d815a620 2023-10-14T18:50:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8dccd2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815bfa0 con 0x7fc8d8157c40 2023-10-14T18:50:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8dccd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d815c280 con 0x7fc8d8157870 2023-10-14T18:50:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8d8157c40 0x7fc8d8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d5d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc8d815a620 0x7fc8d815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45288/0 (socket says 172.21.15.79:45288) 2023-10-14T18:50:01.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d5d9b700 1 -- 172.21.15.79:0/2039885479 learned_addr learned my addr 172.21.15.79:0/2039885479 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:01.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d659c700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d8157870 0x7fc8d815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 -- 172.21.15.79:0/2039885479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d8157870 msgr2=0x7fc8d815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:01.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d8157870 0x7fc8d815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 -- 172.21.15.79:0/2039885479 >> v1:172.21.15.79:6789/0 conn(0x7fc8d815a620 legacy=0x7fc8d815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d559a700 1 -- 172.21.15.79:0/2039885479 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668596980 0 0) 0x7fc8d815cbb0 con 0x7fc8d815a620 2023-10-14T18:50:01.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 -- 172.21.15.79:0/2039885479 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d815c560 con 0x7fc8d8157c40 2023-10-14T18:50:01.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d6d9d700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157c40 0x7fc8d8158110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0192b00284b2601 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d559a700 1 -- 172.21.15.79:0/2039885479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8009e80 con 0x7fc8d8157c40 2023-10-14T18:50:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d559a700 1 -- 172.21.15.79:0/2039885479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800b860 con 0x7fc8d8157c40 2023-10-14T18:50:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.695+0000 7fc8d559a700 1 -- 172.21.15.79:0/2039885479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800bbe0 con 0x7fc8d8157c40 2023-10-14T18:50:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2039885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157c40 msgr2=0x7fc8d8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157c40 0x7fc8d8158110 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2039885479 shutdown_connections 2023-10-14T18:50:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157c40 0x7fc8d8158110 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2039885479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d8157870 0x7fc8d815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2039885479 >> 172.21.15.79:0/2039885479 conn(0x7fc8d8068ce0 msgr2=0x7fc8d80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2039885479 shutdown_connections 2023-10-14T18:50:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.696+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2039885479 wait complete. 2023-10-14T18:50:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.697+0000 7fc8dccd2700 1 Processor -- start 2023-10-14T18:50:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.697+0000 7fc8dccd2700 1 -- start start 2023-10-14T18:50:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 0x7fc8d80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d815a620 0x7fc8d814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b2040 con 0x7fc8d8157870 2023-10-14T18:50:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b2890 con 0x7fc8d8157c40 2023-10-14T18:50:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80b3260 con 0x7fc8d815a620 2023-10-14T18:50:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45712/0 (socket says 172.21.15.79:45712) 2023-10-14T18:50:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 -- 172.21.15.79:0/2335229787 learned_addr learned my addr 172.21.15.79:0/2335229787 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d5d9b700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 0x7fc8d80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d6d9d700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d815a620 0x7fc8d814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 -- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d815a620 msgr2=0x7fc8d814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d815a620 0x7fc8d814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 -- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 msgr2=0x7fc8d80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 0x7fc8d80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 -- 172.21.15.79:0/2335229787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c8009420 con 0x7fc8d8157870 2023-10-14T18:50:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d5d9b700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 0x7fc8d80b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8d659c700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000d890 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000b600 con 0x7fc8d8157870 2023-10-14T18:50:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000b760 con 0x7fc8d8157870 2023-10-14T18:50:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d8150970 con 0x7fc8d8157870 2023-10-14T18:50:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.698+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000bae0 con 0x7fc8d8157870 2023-10-14T18:50:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.699+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d80b2520 con 0x7fc8d8157870 2023-10-14T18:50:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.699+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d81512e0 con 0x7fc8d8157870 2023-10-14T18:50:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.700+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8d001e460 con 0x7fc8d8157870 2023-10-14T18:50:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.700+0000 7fc8c67fc700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.700+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8d0084bf0 con 0x7fc8d8157870 2023-10-14T18:50:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.701+0000 7fc8d5d9b700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.701+0000 7fc8d5d9b700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 0x7fc8b80693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8d814fe60 tx=0x7fc8cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.705+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8d0051e60 con 0x7fc8d8157870 2023-10-14T18:50:01.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.884+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8d80b29d0 con 0x7fc8b8066f30 2023-10-14T18:50:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.893+0000 7fc8c67fc700 1 -- 172.21.15.79:0/2335229787 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285807 (secure 0 0 0) 0x7fc8cc00eb40 con 0x7fc8b8066f30 2023-10-14T18:50:01.898 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 msgr2=0x7fc8b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 0x7fc8b80693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc8d814fe60 tx=0x7fc8cc009040 comp rx=0 tx=0).stop 2023-10-14T18:50:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 msgr2=0x7fc8d8150da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000d890 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2023-10-14T18:50:01.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 shutdown_connections 2023-10-14T18:50:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8d815a620 0x7fc8d814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d8157870 0x7fc8d8150da0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 --2- 172.21.15.79:0/2335229787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8d8157c40 0x7fc8d80b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 >> 172.21.15.79:0/2335229787 conn(0x7fc8d8068ce0 msgr2=0x7fc8d80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 shutdown_connections 2023-10-14T18:50:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:01.896+0000 7fc8dccd2700 1 -- 172.21.15.79:0/2335229787 wait complete. 2023-10-14T18:50:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:01.908 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2023-10-14T18:50:00.404292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557068,"statfs":{"total":1600000000,"available":1594438399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.563187"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535632+0000","last_change":"2023-10-14T18:49:57.535389+0000","last_active":"2023-10-14T18:49:57.535632+0000","last_peered":"2023-10-14T18:49:57.535632+0000","last_clean":"2023-10-14T18:49:57.535632+0000","last_became_active":"2023-10-14T18:49:57.534358+0000","last_became_peered":"2023-10-14T18:49:57.534358+0000","last_unstale":"2023-10-14T18:49:57.535632+0000","last_undegraded":"2023-10-14T18:49:57.535632+0000","last_fullsized":"2023-10-14T18:49:57.535632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535633+0000","last_change":"2023-10-14T18:49:57.535582+0000","last_active":"2023-10-14T18:49:57.535633+0000","last_peered":"2023-10-14T18:49:57.535633+0000","last_clean":"2023-10-14T18:49:57.535633+0000","last_became_active":"2023-10-14T18:49:57.535279+0000","last_became_peered":"2023-10-14T18:49:57.535279+0000","last_unstale":"2023-10-14T18:49:57.535633+0000","last_undegraded":"2023-10-14T18:49:57.535633+0000","last_fullsized":"2023-10-14T18:49:57.535633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:09.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.537273+0000","last_change":"2023-10-14T18:49:57.536788+0000","last_active":"2023-10-14T18:49:57.537273+0000","last_peered":"2023-10-14T18:49:57.537273+0000","last_clean":"2023-10-14T18:49:57.537273+0000","last_became_active":"2023-10-14T18:49:57.536557+0000","last_became_peered":"2023-10-14T18:49:57.536557+0000","last_unstale":"2023-10-14T18:49:57.537273+0000","last_undegraded":"2023-10-14T18:49:57.537273+0000","last_fullsized":"2023-10-14T18:49:57.537273+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:13.432265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534997+0000","last_change":"2023-10-14T18:49:57.534707+0000","last_active":"2023-10-14T18:49:57.534997+0000","last_peered":"2023-10-14T18:49:57.534997+0000","last_clean":"2023-10-14T18:49:57.534997+0000","last_became_active":"2023-10-14T18:49:57.534192+0000","last_became_peered":"2023-10-14T18:49:57.534192+0000","last_unstale":"2023-10-14T18:49:57.534997+0000","last_undegraded":"2023-10-14T18:49:57.534997+0000","last_fullsized":"2023-10-14T18:49:57.534997+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:58.447165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532432+0000","last_change":"2023-10-14T18:49:57.532350+0000","last_active":"2023-10-14T18:49:57.532432+0000","last_peered":"2023-10-14T18:49:57.532432+0000","last_clean":"2023-10-14T18:49:57.532432+0000","last_became_active":"2023-10-14T18:49:57.532092+0000","last_became_peered":"2023-10-14T18:49:57.532092+0000","last_unstale":"2023-10-14T18:49:57.532432+0000","last_undegraded":"2023-10-14T18:49:57.532432+0000","last_fullsized":"2023-10-14T18:49:57.532432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531823+0000","last_change":"2023-10-14T18:49:57.531761+0000","last_active":"2023-10-14T18:49:57.531823+0000","last_peered":"2023-10-14T18:49:57.531823+0000","last_clean":"2023-10-14T18:49:57.531823+0000","last_became_active":"2023-10-14T18:49:57.529672+0000","last_became_peered":"2023-10-14T18:49:57.529672+0000","last_unstale":"2023-10-14T18:49:57.531823+0000","last_undegraded":"2023-10-14T18:49:57.531823+0000","last_fullsized":"2023-10-14T18:49:57.531823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533306+0000","last_change":"2023-10-14T18:49:57.533229+0000","last_active":"2023-10-14T18:49:57.533306+0000","last_peered":"2023-10-14T18:49:57.533306+0000","last_clean":"2023-10-14T18:49:57.533306+0000","last_became_active":"2023-10-14T18:49:57.533004+0000","last_became_peered":"2023-10-14T18:49:57.533004+0000","last_unstale":"2023-10-14T18:49:57.533306+0000","last_undegraded":"2023-10-14T18:49:57.533306+0000","last_fullsized":"2023-10-14T18:49:57.533306+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:23:50.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533540+0000","last_change":"2023-10-14T18:49:57.533491+0000","last_active":"2023-10-14T18:49:57.533540+0000","last_peered":"2023-10-14T18:49:57.533540+0000","last_clean":"2023-10-14T18:49:57.533540+0000","last_became_active":"2023-10-14T18:49:57.533201+0000","last_became_peered":"2023-10-14T18:49:57.533201+0000","last_unstale":"2023-10-14T18:49:57.533540+0000","last_undegraded":"2023-10-14T18:49:57.533540+0000","last_fullsized":"2023-10-14T18:49:57.533540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:33.601045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533377+0000","last_change":"2023-10-14T18:49:57.533311+0000","last_active":"2023-10-14T18:49:57.533377+0000","last_peered":"2023-10-14T18:49:57.533377+0000","last_clean":"2023-10-14T18:49:57.533377+0000","last_became_active":"2023-10-14T18:49:57.533074+0000","last_became_peered":"2023-10-14T18:49:57.533074+0000","last_unstale":"2023-10-14T18:49:57.533377+0000","last_undegraded":"2023-10-14T18:49:57.533377+0000","last_fullsized":"2023-10-14T18:49:57.533377+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536468+0000","last_change":"2023-10-14T18:49:57.536402+0000","last_active":"2023-10-14T18:49:57.536468+0000","last_peered":"2023-10-14T18:49:57.536468+0000","last_clean":"2023-10-14T18:49:57.536468+0000","last_became_active":"2023-10-14T18:49:57.535700+0000","last_became_peered":"2023-10-14T18:49:57.535700+0000","last_unstale":"2023-10-14T18:49:57.536468+0000","last_undegraded":"2023-10-14T18:49:57.536468+0000","last_fullsized":"2023-10-14T18:49:57.536468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532828+0000","last_change":"2023-10-14T18:49:57.528817+0000","last_active":"2023-10-14T18:49:57.532828+0000","last_peered":"2023-10-14T18:49:57.532828+0000","last_clean":"2023-10-14T18:49:57.532828+0000","last_became_active":"2023-10-14T18:49:57.528069+0000","last_became_peered":"2023-10-14T18:49:57.528069+0000","last_unstale":"2023-10-14T18:49:57.532828+0000","last_undegraded":"2023-10-14T18:49:57.532828+0000","last_fullsized":"2023-10-14T18:49:57.532828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:34.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535067+0000","last_change":"2023-10-14T18:49:57.535000+0000","last_active":"2023-10-14T18:49:57.535067+0000","last_peered":"2023-10-14T18:49:57.535067+0000","last_clean":"2023-10-14T18:49:57.535067+0000","last_became_active":"2023-10-14T18:49:57.534517+0000","last_became_peered":"2023-10-14T18:49:57.534517+0000","last_unstale":"2023-10-14T18:49:57.535067+0000","last_undegraded":"2023-10-14T18:49:57.535067+0000","last_fullsized":"2023-10-14T18:49:57.535067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528735+0000","last_change":"2023-10-14T18:49:57.527606+0000","last_active":"2023-10-14T18:49:57.528735+0000","last_peered":"2023-10-14T18:49:57.528735+0000","last_clean":"2023-10-14T18:49:57.528735+0000","last_became_active":"2023-10-14T18:49:57.527360+0000","last_became_peered":"2023-10-14T18:49:57.527360+0000","last_unstale":"2023-10-14T18:49:57.528735+0000","last_undegraded":"2023-10-14T18:49:57.528735+0000","last_fullsized":"2023-10-14T18:49:57.528735+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:28.010689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534989+0000","last_change":"2023-10-14T18:49:57.534542+0000","last_active":"2023-10-14T18:49:57.534989+0000","last_peered":"2023-10-14T18:49:57.534989+0000","last_clean":"2023-10-14T18:49:57.534989+0000","last_became_active":"2023-10-14T18:49:57.533922+0000","last_became_peered":"2023-10-14T18:49:57.533922+0000","last_unstale":"2023-10-14T18:49:57.534989+0000","last_undegraded":"2023-10-14T18:49:57.534989+0000","last_fullsized":"2023-10-14T18:49:57.534989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:19.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527439+0000","last_change":"2023-10-14T18:49:57.525100+0000","last_active":"2023-10-14T18:49:57.527439+0000","last_peered":"2023-10-14T18:49:57.527439+0000","last_clean":"2023-10-14T18:49:57.527439+0000","last_became_active":"2023-10-14T18:49:57.524882+0000","last_became_peered":"2023-10-14T18:49:57.524882+0000","last_unstale":"2023-10-14T18:49:57.527439+0000","last_undegraded":"2023-10-14T18:49:57.527439+0000","last_fullsized":"2023-10-14T18:49:57.527439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534946+0000","last_change":"2023-10-14T18:49:57.534880+0000","last_active":"2023-10-14T18:49:57.534946+0000","last_peered":"2023-10-14T18:49:57.534946+0000","last_clean":"2023-10-14T18:49:57.534946+0000","last_became_active":"2023-10-14T18:49:57.534643+0000","last_became_peered":"2023-10-14T18:49:57.534643+0000","last_unstale":"2023-10-14T18:49:57.534946+0000","last_undegraded":"2023-10-14T18:49:57.534946+0000","last_fullsized":"2023-10-14T18:49:57.534946+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536237+0000","last_change":"2023-10-14T18:49:57.536142+0000","last_active":"2023-10-14T18:49:57.536237+0000","last_peered":"2023-10-14T18:49:57.536237+0000","last_clean":"2023-10-14T18:49:57.536237+0000","last_became_active":"2023-10-14T18:49:57.535794+0000","last_became_peered":"2023-10-14T18:49:57.535794+0000","last_unstale":"2023-10-14T18:49:57.536237+0000","last_undegraded":"2023-10-14T18:49:57.536237+0000","last_fullsized":"2023-10-14T18:49:57.536237+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538091+0000","last_change":"2023-10-14T18:49:57.538032+0000","last_active":"2023-10-14T18:49:57.538091+0000","last_peered":"2023-10-14T18:49:57.538091+0000","last_clean":"2023-10-14T18:49:57.538091+0000","last_became_active":"2023-10-14T18:49:57.537740+0000","last_became_peered":"2023-10-14T18:49:57.537740+0000","last_unstale":"2023-10-14T18:49:57.538091+0000","last_undegraded":"2023-10-14T18:49:57.538091+0000","last_fullsized":"2023-10-14T18:49:57.538091+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:45.236144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532222+0000","last_change":"2023-10-14T18:49:57.532085+0000","last_active":"2023-10-14T18:49:57.532222+0000","last_peered":"2023-10-14T18:49:57.532222+0000","last_clean":"2023-10-14T18:49:57.532222+0000","last_became_active":"2023-10-14T18:49:57.531772+0000","last_became_peered":"2023-10-14T18:49:57.531772+0000","last_unstale":"2023-10-14T18:49:57.532222+0000","last_undegraded":"2023-10-14T18:49:57.532222+0000","last_fullsized":"2023-10-14T18:49:57.532222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:13.432265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530246+0000","last_change":"2023-10-14T18:49:57.530194+0000","last_active":"2023-10-14T18:49:57.530246+0000","last_peered":"2023-10-14T18:49:57.530246+0000","last_clean":"2023-10-14T18:49:57.530246+0000","last_became_active":"2023-10-14T18:49:57.529980+0000","last_became_peered":"2023-10-14T18:49:57.529980+0000","last_unstale":"2023-10-14T18:49:57.530246+0000","last_undegraded":"2023-10-14T18:49:57.530246+0000","last_fullsized":"2023-10-14T18:49:57.530246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:23.536274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530037+0000","last_change":"2023-10-14T18:49:57.529832+0000","last_active":"2023-10-14T18:49:57.530037+0000","last_peered":"2023-10-14T18:49:57.530037+0000","last_clean":"2023-10-14T18:49:57.530037+0000","last_became_active":"2023-10-14T18:49:57.529619+0000","last_became_peered":"2023-10-14T18:49:57.529619+0000","last_unstale":"2023-10-14T18:49:57.530037+0000","last_undegraded":"2023-10-14T18:49:57.530037+0000","last_fullsized":"2023-10-14T18:49:57.530037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:27.752923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528878+0000","last_change":"2023-10-14T18:49:57.527919+0000","last_active":"2023-10-14T18:49:57.528878+0000","last_peered":"2023-10-14T18:49:57.528878+0000","last_clean":"2023-10-14T18:49:57.528878+0000","last_became_active":"2023-10-14T18:49:57.527681+0000","last_became_peered":"2023-10-14T18:49:57.527681+0000","last_unstale":"2023-10-14T18:49:57.528878+0000","last_undegraded":"2023-10-14T18:49:57.528878+0000","last_fullsized":"2023-10-14T18:49:57.528878+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:29.643782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.537773+0000","last_change":"2023-10-14T18:49:57.537704+0000","last_active":"2023-10-14T18:49:57.537773+0000","last_peered":"2023-10-14T18:49:57.537773+0000","last_clean":"2023-10-14T18:49:57.537773+0000","last_became_active":"2023-10-14T18:49:57.537022+0000","last_became_peered":"2023-10-14T18:49:57.537022+0000","last_unstale":"2023-10-14T18:49:57.537773+0000","last_undegraded":"2023-10-14T18:49:57.537773+0000","last_fullsized":"2023-10-14T18:49:57.537773+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529713+0000","last_change":"2023-10-14T18:49:57.529625+0000","last_active":"2023-10-14T18:49:57.529713+0000","last_peered":"2023-10-14T18:49:57.529713+0000","last_clean":"2023-10-14T18:49:57.529713+0000","last_became_active":"2023-10-14T18:49:57.529412+0000","last_became_peered":"2023-10-14T18:49:57.529412+0000","last_unstale":"2023-10-14T18:49:57.529713+0000","last_undegraded":"2023-10-14T18:49:57.529713+0000","last_fullsized":"2023-10-14T18:49:57.529713+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:21.370516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532886+0000","last_change":"2023-10-14T18:49:57.530706+0000","last_active":"2023-10-14T18:49:57.532886+0000","last_peered":"2023-10-14T18:49:57.532886+0000","last_clean":"2023-10-14T18:49:57.532886+0000","last_became_active":"2023-10-14T18:49:57.530396+0000","last_became_peered":"2023-10-14T18:49:57.530396+0000","last_unstale":"2023-10-14T18:49:57.532886+0000","last_undegraded":"2023-10-14T18:49:57.532886+0000","last_fullsized":"2023-10-14T18:49:57.532886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:11.579519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525015+0000","last_change":"2023-10-14T18:49:57.524946+0000","last_active":"2023-10-14T18:49:57.525015+0000","last_peered":"2023-10-14T18:49:57.525015+0000","last_clean":"2023-10-14T18:49:57.525015+0000","last_became_active":"2023-10-14T18:49:57.524726+0000","last_became_peered":"2023-10-14T18:49:57.524726+0000","last_unstale":"2023-10-14T18:49:57.525015+0000","last_undegraded":"2023-10-14T18:49:57.525015+0000","last_fullsized":"2023-10-14T18:49:57.525015+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:31:09.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534414+0000","last_change":"2023-10-14T18:49:57.534315+0000","last_active":"2023-10-14T18:49:57.534414+0000","last_peered":"2023-10-14T18:49:57.534414+0000","last_clean":"2023-10-14T18:49:57.534414+0000","last_became_active":"2023-10-14T18:49:57.534082+0000","last_became_peered":"2023-10-14T18:49:57.534082+0000","last_unstale":"2023-10-14T18:49:57.534414+0000","last_undegraded":"2023-10-14T18:49:57.534414+0000","last_fullsized":"2023-10-14T18:49:57.534414+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538418+0000","last_change":"2023-10-14T18:49:57.538331+0000","last_active":"2023-10-14T18:49:57.538418+0000","last_peered":"2023-10-14T18:49:57.538418+0000","last_clean":"2023-10-14T18:49:57.538418+0000","last_became_active":"2023-10-14T18:49:57.537877+0000","last_became_peered":"2023-10-14T18:49:57.537877+0000","last_unstale":"2023-10-14T18:49:57.538418+0000","last_undegraded":"2023-10-14T18:49:57.538418+0000","last_fullsized":"2023-10-14T18:49:57.538418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525163+0000","last_change":"2023-10-14T18:49:57.525103+0000","last_active":"2023-10-14T18:49:57.525163+0000","last_peered":"2023-10-14T18:49:57.525163+0000","last_clean":"2023-10-14T18:49:57.525163+0000","last_became_active":"2023-10-14T18:49:57.524890+0000","last_became_peered":"2023-10-14T18:49:57.524890+0000","last_unstale":"2023-10-14T18:49:57.525163+0000","last_undegraded":"2023-10-14T18:49:57.525163+0000","last_fullsized":"2023-10-14T18:49:57.525163+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:08:57.546298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532869+0000","last_change":"2023-10-14T18:49:57.530583+0000","last_active":"2023-10-14T18:49:57.532869+0000","last_peered":"2023-10-14T18:49:57.532869+0000","last_clean":"2023-10-14T18:49:57.532869+0000","last_became_active":"2023-10-14T18:49:57.530160+0000","last_became_peered":"2023-10-14T18:49:57.530160+0000","last_unstale":"2023-10-14T18:49:57.532869+0000","last_undegraded":"2023-10-14T18:49:57.532869+0000","last_fullsized":"2023-10-14T18:49:57.532869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:15.485363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530623+0000","last_change":"2023-10-14T18:49:57.530558+0000","last_active":"2023-10-14T18:49:57.530623+0000","last_peered":"2023-10-14T18:49:57.530623+0000","last_clean":"2023-10-14T18:49:57.530623+0000","last_became_active":"2023-10-14T18:49:57.530190+0000","last_became_peered":"2023-10-14T18:49:57.530190+0000","last_unstale":"2023-10-14T18:49:57.530623+0000","last_undegraded":"2023-10-14T18:49:57.530623+0000","last_fullsized":"2023-10-14T18:49:57.530623+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:10.275623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535650+0000","last_change":"2023-10-14T18:49:57.535472+0000","last_active":"2023-10-14T18:49:57.535650+0000","last_peered":"2023-10-14T18:49:57.535650+0000","last_clean":"2023-10-14T18:49:57.535650+0000","last_became_active":"2023-10-14T18:49:57.535238+0000","last_became_peered":"2023-10-14T18:49:57.535238+0000","last_unstale":"2023-10-14T18:49:57.535650+0000","last_undegraded":"2023-10-14T18:49:57.535650+0000","last_fullsized":"2023-10-14T18:49:57.535650+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:31:09.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536205+0000","last_change":"2023-10-14T18:49:57.535273+0000","last_active":"2023-10-14T18:49:57.536205+0000","last_peered":"2023-10-14T18:49:57.536205+0000","last_clean":"2023-10-14T18:49:57.536205+0000","last_became_active":"2023-10-14T18:49:57.535062+0000","last_became_peered":"2023-10-14T18:49:57.535062+0000","last_unstale":"2023-10-14T18:49:57.536205+0000","last_undegraded":"2023-10-14T18:49:57.536205+0000","last_fullsized":"2023-10-14T18:49:57.536205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"101'4","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854382+0000","last_change":"2023-10-14T18:49:56.859415+0000","last_active":"2023-10-14T18:49:57.854382+0000","last_peered":"2023-10-14T18:49:57.854382+0000","last_clean":"2023-10-14T18:49:57.854382+0000","last_became_active":"2023-10-14T18:49:56.858899+0000","last_became_peered":"2023-10-14T18:49:56.858899+0000","last_unstale":"2023-10-14T18:49:57.854382+0000","last_undegraded":"2023-10-14T18:49:57.854382+0000","last_fullsized":"2023-10-14T18:49:57.854382+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:01.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538136+0000","last_change":"2023-10-14T18:49:57.538074+0000","last_active":"2023-10-14T18:49:57.538136+0000","last_peered":"2023-10-14T18:49:57.538136+0000","last_clean":"2023-10-14T18:49:57.538136+0000","last_became_active":"2023-10-14T18:49:57.537511+0000","last_became_peered":"2023-10-14T18:49:57.537511+0000","last_unstale":"2023-10-14T18:49:57.538136+0000","last_undegraded":"2023-10-14T18:49:57.538136+0000","last_fullsized":"2023-10-14T18:49:57.538136+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852435+0000","last_change":"2023-10-14T18:49:56.860531+0000","last_active":"2023-10-14T18:49:57.852435+0000","last_peered":"2023-10-14T18:49:57.852435+0000","last_clean":"2023-10-14T18:49:57.852435+0000","last_became_active":"2023-10-14T18:49:56.859022+0000","last_became_peered":"2023-10-14T18:49:56.859022+0000","last_unstale":"2023-10-14T18:49:57.852435+0000","last_undegraded":"2023-10-14T18:49:57.852435+0000","last_fullsized":"2023-10-14T18:49:57.852435+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:00.030377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535666+0000","last_change":"2023-10-14T18:49:57.535517+0000","last_active":"2023-10-14T18:49:57.535666+0000","last_peered":"2023-10-14T18:49:57.535666+0000","last_clean":"2023-10-14T18:49:57.535666+0000","last_became_active":"2023-10-14T18:49:57.535169+0000","last_became_peered":"2023-10-14T18:49:57.535169+0000","last_unstale":"2023-10-14T18:49:57.535666+0000","last_undegraded":"2023-10-14T18:49:57.535666+0000","last_fullsized":"2023-10-14T18:49:57.535666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:23.816147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852121+0000","last_change":"2023-10-14T18:49:56.850927+0000","last_active":"2023-10-14T18:49:57.852121+0000","last_peered":"2023-10-14T18:49:57.852121+0000","last_clean":"2023-10-14T18:49:57.852121+0000","last_became_active":"2023-10-14T18:49:56.850365+0000","last_became_peered":"2023-10-14T18:49:56.850365+0000","last_unstale":"2023-10-14T18:49:57.852121+0000","last_undegraded":"2023-10-14T18:49:57.852121+0000","last_fullsized":"2023-10-14T18:49:57.852121+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:32.596255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534085+0000","last_change":"2023-10-14T18:49:57.531731+0000","last_active":"2023-10-14T18:49:57.534085+0000","last_peered":"2023-10-14T18:49:57.534085+0000","last_clean":"2023-10-14T18:49:57.534085+0000","last_became_active":"2023-10-14T18:49:57.530190+0000","last_became_peered":"2023-10-14T18:49:57.530190+0000","last_unstale":"2023-10-14T18:49:57.534085+0000","last_undegraded":"2023-10-14T18:49:57.534085+0000","last_fullsized":"2023-10-14T18:49:57.534085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853258+0000","last_change":"2023-10-14T18:49:56.850084+0000","last_active":"2023-10-14T18:49:57.853258+0000","last_peered":"2023-10-14T18:49:57.853258+0000","last_clean":"2023-10-14T18:49:57.853258+0000","last_became_active":"2023-10-14T18:49:56.849879+0000","last_became_peered":"2023-10-14T18:49:56.849879+0000","last_unstale":"2023-10-14T18:49:57.853258+0000","last_undegraded":"2023-10-14T18:49:57.853258+0000","last_fullsized":"2023-10-14T18:49:57.853258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:25.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532947+0000","last_change":"2023-10-14T18:49:57.531532+0000","last_active":"2023-10-14T18:49:57.532947+0000","last_peered":"2023-10-14T18:49:57.532947+0000","last_clean":"2023-10-14T18:49:57.532947+0000","last_became_active":"2023-10-14T18:49:57.531209+0000","last_became_peered":"2023-10-14T18:49:57.531209+0000","last_unstale":"2023-10-14T18:49:57.532947+0000","last_undegraded":"2023-10-14T18:49:57.532947+0000","last_fullsized":"2023-10-14T18:49:57.532947+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:35.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851482+0000","last_change":"2023-10-14T18:49:56.859300+0000","last_active":"2023-10-14T18:49:57.851482+0000","last_peered":"2023-10-14T18:49:57.851482+0000","last_clean":"2023-10-14T18:49:57.851482+0000","last_became_active":"2023-10-14T18:49:56.858453+0000","last_became_peered":"2023-10-14T18:49:56.858453+0000","last_unstale":"2023-10-14T18:49:57.851482+0000","last_undegraded":"2023-10-14T18:49:57.851482+0000","last_fullsized":"2023-10-14T18:49:57.851482+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:48:01.276427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536221+0000","last_change":"2023-10-14T18:49:57.536004+0000","last_active":"2023-10-14T18:49:57.536221+0000","last_peered":"2023-10-14T18:49:57.536221+0000","last_clean":"2023-10-14T18:49:57.536221+0000","last_became_active":"2023-10-14T18:49:57.535487+0000","last_became_peered":"2023-10-14T18:49:57.535487+0000","last_unstale":"2023-10-14T18:49:57.536221+0000","last_undegraded":"2023-10-14T18:49:57.536221+0000","last_fullsized":"2023-10-14T18:49:57.536221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.850963+0000","last_change":"2023-10-14T18:49:56.858556+0000","last_active":"2023-10-14T18:49:57.850963+0000","last_peered":"2023-10-14T18:49:57.850963+0000","last_clean":"2023-10-14T18:49:57.850963+0000","last_became_active":"2023-10-14T18:49:56.858321+0000","last_became_peered":"2023-10-14T18:49:56.858321+0000","last_unstale":"2023-10-14T18:49:57.850963+0000","last_undegraded":"2023-10-14T18:49:57.850963+0000","last_fullsized":"2023-10-14T18:49:57.850963+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:46.449021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534104+0000","last_change":"2023-10-14T18:49:57.531884+0000","last_active":"2023-10-14T18:49:57.534104+0000","last_peered":"2023-10-14T18:49:57.534104+0000","last_clean":"2023-10-14T18:49:57.534104+0000","last_became_active":"2023-10-14T18:49:57.530518+0000","last_became_peered":"2023-10-14T18:49:57.530518+0000","last_unstale":"2023-10-14T18:49:57.534104+0000","last_undegraded":"2023-10-14T18:49:57.534104+0000","last_fullsized":"2023-10-14T18:49:57.534104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526017+0000","last_change":"2023-10-14T18:49:56.856655+0000","last_active":"2023-10-14T18:49:57.526017+0000","last_peered":"2023-10-14T18:49:57.526017+0000","last_clean":"2023-10-14T18:49:57.526017+0000","last_became_active":"2023-10-14T18:49:56.856512+0000","last_became_peered":"2023-10-14T18:49:56.856512+0000","last_unstale":"2023-10-14T18:49:57.526017+0000","last_undegraded":"2023-10-14T18:49:57.526017+0000","last_fullsized":"2023-10-14T18:49:57.526017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:10.967315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530715+0000","last_change":"2023-10-14T18:49:57.529857+0000","last_active":"2023-10-14T18:49:57.530715+0000","last_peered":"2023-10-14T18:49:57.530715+0000","last_clean":"2023-10-14T18:49:57.530715+0000","last_became_active":"2023-10-14T18:49:57.527728+0000","last_became_peered":"2023-10-14T18:49:57.527728+0000","last_unstale":"2023-10-14T18:49:57.530715+0000","last_undegraded":"2023-10-14T18:49:57.530715+0000","last_fullsized":"2023-10-14T18:49:57.530715+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523532+0000","last_change":"2023-10-14T18:49:56.860059+0000","last_active":"2023-10-14T18:49:57.523532+0000","last_peered":"2023-10-14T18:49:57.523532+0000","last_clean":"2023-10-14T18:49:57.523532+0000","last_became_active":"2023-10-14T18:49:56.859838+0000","last_became_peered":"2023-10-14T18:49:56.859838+0000","last_unstale":"2023-10-14T18:49:57.523532+0000","last_undegraded":"2023-10-14T18:49:57.523532+0000","last_fullsized":"2023-10-14T18:49:57.523532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:10.495139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528967+0000","last_change":"2023-10-14T18:49:57.528913+0000","last_active":"2023-10-14T18:49:57.528967+0000","last_peered":"2023-10-14T18:49:57.528967+0000","last_clean":"2023-10-14T18:49:57.528967+0000","last_became_active":"2023-10-14T18:49:57.528699+0000","last_became_peered":"2023-10-14T18:49:57.528699+0000","last_unstale":"2023-10-14T18:49:57.528967+0000","last_undegraded":"2023-10-14T18:49:57.528967+0000","last_fullsized":"2023-10-14T18:49:57.528967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528093+0000","last_change":"2023-10-14T18:49:56.855487+0000","last_active":"2023-10-14T18:49:57.528093+0000","last_peered":"2023-10-14T18:49:57.528093+0000","last_clean":"2023-10-14T18:49:57.528093+0000","last_became_active":"2023-10-14T18:49:56.855240+0000","last_became_peered":"2023-10-14T18:49:56.855240+0000","last_unstale":"2023-10-14T18:49:57.528093+0000","last_undegraded":"2023-10-14T18:49:57.528093+0000","last_fullsized":"2023-10-14T18:49:57.528093+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.182550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530752+0000","last_change":"2023-10-14T18:49:57.529911+0000","last_active":"2023-10-14T18:49:57.530752+0000","last_peered":"2023-10-14T18:49:57.530752+0000","last_clean":"2023-10-14T18:49:57.530752+0000","last_became_active":"2023-10-14T18:49:57.529377+0000","last_became_peered":"2023-10-14T18:49:57.529377+0000","last_unstale":"2023-10-14T18:49:57.530752+0000","last_undegraded":"2023-10-14T18:49:57.530752+0000","last_fullsized":"2023-10-14T18:49:57.530752+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528627+0000","last_change":"2023-10-14T18:49:56.859551+0000","last_active":"2023-10-14T18:49:57.528627+0000","last_peered":"2023-10-14T18:49:57.528627+0000","last_clean":"2023-10-14T18:49:57.528627+0000","last_became_active":"2023-10-14T18:49:56.859294+0000","last_became_peered":"2023-10-14T18:49:56.859294+0000","last_unstale":"2023-10-14T18:49:57.528627+0000","last_undegraded":"2023-10-14T18:49:57.528627+0000","last_fullsized":"2023-10-14T18:49:57.528627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:48:01.276427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534697+0000","last_change":"2023-10-14T18:49:57.534640+0000","last_active":"2023-10-14T18:49:57.534697+0000","last_peered":"2023-10-14T18:49:57.534697+0000","last_clean":"2023-10-14T18:49:57.534697+0000","last_became_active":"2023-10-14T18:49:57.534423+0000","last_became_peered":"2023-10-14T18:49:57.534423+0000","last_unstale":"2023-10-14T18:49:57.534697+0000","last_undegraded":"2023-10-14T18:49:57.534697+0000","last_fullsized":"2023-10-14T18:49:57.534697+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"101'3","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854548+0000","last_change":"2023-10-14T18:49:56.859949+0000","last_active":"2023-10-14T18:49:57.854548+0000","last_peered":"2023-10-14T18:49:57.854548+0000","last_clean":"2023-10-14T18:49:57.854548+0000","last_became_active":"2023-10-14T18:49:56.859731+0000","last_became_peered":"2023-10-14T18:49:56.859731+0000","last_unstale":"2023-10-14T18:49:57.854548+0000","last_undegraded":"2023-10-14T18:49:57.854548+0000","last_fullsized":"2023-10-14T18:49:57.854548+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:54.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530004+0000","last_change":"2023-10-14T18:49:57.529791+0000","last_active":"2023-10-14T18:49:57.530004+0000","last_peered":"2023-10-14T18:49:57.530004+0000","last_clean":"2023-10-14T18:49:57.530004+0000","last_became_active":"2023-10-14T18:49:57.529240+0000","last_became_peered":"2023-10-14T18:49:57.529240+0000","last_unstale":"2023-10-14T18:49:57.530004+0000","last_undegraded":"2023-10-14T18:49:57.530004+0000","last_fullsized":"2023-10-14T18:49:57.530004+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:33.601045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"101'6","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854454+0000","last_change":"2023-10-14T18:49:56.856472+0000","last_active":"2023-10-14T18:49:57.854454+0000","last_peered":"2023-10-14T18:49:57.854454+0000","last_clean":"2023-10-14T18:49:57.854454+0000","last_became_active":"2023-10-14T18:49:56.856176+0000","last_became_peered":"2023-10-14T18:49:56.856176+0000","last_unstale":"2023-10-14T18:49:57.854454+0000","last_undegraded":"2023-10-14T18:49:57.854454+0000","last_fullsized":"2023-10-14T18:49:57.854454+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:14.480572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530271+0000","last_change":"2023-10-14T18:49:57.530174+0000","last_active":"2023-10-14T18:49:57.530271+0000","last_peered":"2023-10-14T18:49:57.530271+0000","last_clean":"2023-10-14T18:49:57.530271+0000","last_became_active":"2023-10-14T18:49:57.529715+0000","last_became_peered":"2023-10-14T18:49:57.529715+0000","last_unstale":"2023-10-14T18:49:57.530271+0000","last_undegraded":"2023-10-14T18:49:57.530271+0000","last_fullsized":"2023-10-14T18:49:57.530271+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:45.344622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852249+0000","last_change":"2023-10-14T18:49:56.857798+0000","last_active":"2023-10-14T18:49:57.852249+0000","last_peered":"2023-10-14T18:49:57.852249+0000","last_clean":"2023-10-14T18:49:57.852249+0000","last_became_active":"2023-10-14T18:49:56.857171+0000","last_became_peered":"2023-10-14T18:49:56.857171+0000","last_unstale":"2023-10-14T18:49:57.852249+0000","last_undegraded":"2023-10-14T18:49:57.852249+0000","last_fullsized":"2023-10-14T18:49:57.852249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:46.663236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530786+0000","last_change":"2023-10-14T18:49:57.530722+0000","last_active":"2023-10-14T18:49:57.530786+0000","last_peered":"2023-10-14T18:49:57.530786+0000","last_clean":"2023-10-14T18:49:57.530786+0000","last_became_active":"2023-10-14T18:49:57.529902+0000","last_became_peered":"2023-10-14T18:49:57.529902+0000","last_unstale":"2023-10-14T18:49:57.530786+0000","last_undegraded":"2023-10-14T18:49:57.530786+0000","last_fullsized":"2023-10-14T18:49:57.530786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.524219+0000","last_change":"2023-10-14T18:49:56.850511+0000","last_active":"2023-10-14T18:49:57.524219+0000","last_peered":"2023-10-14T18:49:57.524219+0000","last_clean":"2023-10-14T18:49:57.524219+0000","last_became_active":"2023-10-14T18:49:56.850299+0000","last_became_peered":"2023-10-14T18:49:56.850299+0000","last_unstale":"2023-10-14T18:49:57.524219+0000","last_undegraded":"2023-10-14T18:49:57.524219+0000","last_fullsized":"2023-10-14T18:49:57.524219+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:09.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532932+0000","last_change":"2023-10-14T18:49:57.531406+0000","last_active":"2023-10-14T18:49:57.532932+0000","last_peered":"2023-10-14T18:49:57.532932+0000","last_clean":"2023-10-14T18:49:57.532932+0000","last_became_active":"2023-10-14T18:49:57.530938+0000","last_became_peered":"2023-10-14T18:49:57.530938+0000","last_unstale":"2023-10-14T18:49:57.532932+0000","last_undegraded":"2023-10-14T18:49:57.532932+0000","last_fullsized":"2023-10-14T18:49:57.532932+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:18.039300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529908+0000","last_change":"2023-10-14T18:49:56.859253+0000","last_active":"2023-10-14T18:49:57.529908+0000","last_peered":"2023-10-14T18:49:57.529908+0000","last_clean":"2023-10-14T18:49:57.529908+0000","last_became_active":"2023-10-14T18:49:56.859014+0000","last_became_peered":"2023-10-14T18:49:56.859014+0000","last_unstale":"2023-10-14T18:49:57.529908+0000","last_undegraded":"2023-10-14T18:49:57.529908+0000","last_fullsized":"2023-10-14T18:49:57.529908+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:28.638992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535501+0000","last_change":"2023-10-14T18:49:57.535444+0000","last_active":"2023-10-14T18:49:57.535501+0000","last_peered":"2023-10-14T18:49:57.535501+0000","last_clean":"2023-10-14T18:49:57.535501+0000","last_became_active":"2023-10-14T18:49:57.535063+0000","last_became_peered":"2023-10-14T18:49:57.535063+0000","last_unstale":"2023-10-14T18:49:57.535501+0000","last_undegraded":"2023-10-14T18:49:57.535501+0000","last_fullsized":"2023-10-14T18:49:57.535501+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:02.948134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"101'8","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854266+0000","last_change":"2023-10-14T18:49:56.851724+0000","last_active":"2023-10-14T18:49:57.854266+0000","last_peered":"2023-10-14T18:49:57.854266+0000","last_clean":"2023-10-14T18:49:57.854266+0000","last_became_active":"2023-10-14T18:49:56.851497+0000","last_became_peered":"2023-10-14T18:49:56.851497+0000","last_unstale":"2023-10-14T18:49:57.854266+0000","last_undegraded":"2023-10-14T18:49:57.854266+0000","last_fullsized":"2023-10-14T18:49:57.854266+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:00.098213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528752+0000","last_change":"2023-10-14T18:49:57.527980+0000","last_active":"2023-10-14T18:49:57.528752+0000","last_peered":"2023-10-14T18:49:57.528752+0000","last_clean":"2023-10-14T18:49:57.528752+0000","last_became_active":"2023-10-14T18:49:57.527690+0000","last_became_peered":"2023-10-14T18:49:57.527690+0000","last_unstale":"2023-10-14T18:49:57.528752+0000","last_undegraded":"2023-10-14T18:49:57.528752+0000","last_fullsized":"2023-10-14T18:49:57.528752+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851437+0000","last_change":"2023-10-14T18:49:56.856308+0000","last_active":"2023-10-14T18:49:57.851437+0000","last_peered":"2023-10-14T18:49:57.851437+0000","last_clean":"2023-10-14T18:49:57.851437+0000","last_became_active":"2023-10-14T18:49:56.856077+0000","last_became_peered":"2023-10-14T18:49:56.856077+0000","last_unstale":"2023-10-14T18:49:57.851437+0000","last_undegraded":"2023-10-14T18:49:57.851437+0000","last_fullsized":"2023-10-14T18:49:57.851437+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:10.574728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538671+0000","last_change":"2023-10-14T18:49:57.538618+0000","last_active":"2023-10-14T18:49:57.538671+0000","last_peered":"2023-10-14T18:49:57.538671+0000","last_clean":"2023-10-14T18:49:57.538671+0000","last_became_active":"2023-10-14T18:49:57.538431+0000","last_became_peered":"2023-10-14T18:49:57.538431+0000","last_unstale":"2023-10-14T18:49:57.538671+0000","last_undegraded":"2023-10-14T18:49:57.538671+0000","last_fullsized":"2023-10-14T18:49:57.538671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853290+0000","last_change":"2023-10-14T18:49:56.858152+0000","last_active":"2023-10-14T18:49:57.853290+0000","last_peered":"2023-10-14T18:49:57.853290+0000","last_clean":"2023-10-14T18:49:57.853290+0000","last_became_active":"2023-10-14T18:49:56.857965+0000","last_became_peered":"2023-10-14T18:49:56.857965+0000","last_unstale":"2023-10-14T18:49:57.853290+0000","last_undegraded":"2023-10-14T18:49:57.853290+0000","last_fullsized":"2023-10-14T18:49:57.853290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:30.206790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532453+0000","last_change":"2023-10-14T18:49:57.532350+0000","last_active":"2023-10-14T18:49:57.532453+0000","last_peered":"2023-10-14T18:49:57.532453+0000","last_clean":"2023-10-14T18:49:57.532453+0000","last_became_active":"2023-10-14T18:49:57.532108+0000","last_became_peered":"2023-10-14T18:49:57.532108+0000","last_unstale":"2023-10-14T18:49:57.532453+0000","last_undegraded":"2023-10-14T18:49:57.532453+0000","last_fullsized":"2023-10-14T18:49:57.532453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526093+0000","last_change":"2023-10-14T18:49:56.855488+0000","last_active":"2023-10-14T18:49:57.526093+0000","last_peered":"2023-10-14T18:49:57.526093+0000","last_clean":"2023-10-14T18:49:57.526093+0000","last_became_active":"2023-10-14T18:49:56.855268+0000","last_became_peered":"2023-10-14T18:49:56.855268+0000","last_unstale":"2023-10-14T18:49:57.526093+0000","last_undegraded":"2023-10-14T18:49:57.526093+0000","last_fullsized":"2023-10-14T18:49:57.526093+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:40.002228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534978+0000","last_change":"2023-10-14T18:49:57.534411+0000","last_active":"2023-10-14T18:49:57.534978+0000","last_peered":"2023-10-14T18:49:57.534978+0000","last_clean":"2023-10-14T18:49:57.534978+0000","last_became_active":"2023-10-14T18:49:57.533642+0000","last_became_peered":"2023-10-14T18:49:57.533642+0000","last_unstale":"2023-10-14T18:49:57.534978+0000","last_undegraded":"2023-10-14T18:49:57.534978+0000","last_fullsized":"2023-10-14T18:49:57.534978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:06.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853064+0000","last_change":"2023-10-14T18:49:56.851227+0000","last_active":"2023-10-14T18:49:57.853064+0000","last_peered":"2023-10-14T18:49:57.853064+0000","last_clean":"2023-10-14T18:49:57.853064+0000","last_became_active":"2023-10-14T18:49:56.851010+0000","last_became_peered":"2023-10-14T18:49:56.851010+0000","last_unstale":"2023-10-14T18:49:57.853064+0000","last_undegraded":"2023-10-14T18:49:57.853064+0000","last_fullsized":"2023-10-14T18:49:57.853064+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:30.315199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531523+0000","last_change":"2023-10-14T18:49:57.531364+0000","last_active":"2023-10-14T18:49:57.531523+0000","last_peered":"2023-10-14T18:49:57.531523+0000","last_clean":"2023-10-14T18:49:57.531523+0000","last_became_active":"2023-10-14T18:49:57.530952+0000","last_became_peered":"2023-10-14T18:49:57.530952+0000","last_unstale":"2023-10-14T18:49:57.531523+0000","last_undegraded":"2023-10-14T18:49:57.531523+0000","last_fullsized":"2023-10-14T18:49:57.531523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:26.347735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529158+0000","last_change":"2023-10-14T18:49:56.849961+0000","last_active":"2023-10-14T18:49:57.529158+0000","last_peered":"2023-10-14T18:49:57.529158+0000","last_clean":"2023-10-14T18:49:57.529158+0000","last_became_active":"2023-10-14T18:49:56.849725+0000","last_became_peered":"2023-10-14T18:49:56.849725+0000","last_unstale":"2023-10-14T18:49:57.529158+0000","last_undegraded":"2023-10-14T18:49:57.529158+0000","last_fullsized":"2023-10-14T18:49:57.529158+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:18.641918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529477+0000","last_change":"2023-10-14T18:49:57.529403+0000","last_active":"2023-10-14T18:49:57.529477+0000","last_peered":"2023-10-14T18:49:57.529477+0000","last_clean":"2023-10-14T18:49:57.529477+0000","last_became_active":"2023-10-14T18:49:57.528883+0000","last_became_peered":"2023-10-14T18:49:57.528883+0000","last_unstale":"2023-10-14T18:49:57.529477+0000","last_undegraded":"2023-10-14T18:49:57.529477+0000","last_fullsized":"2023-10-14T18:49:57.529477+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:04.105506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528230+0000","last_change":"2023-10-14T18:49:56.856670+0000","last_active":"2023-10-14T18:49:57.528230+0000","last_peered":"2023-10-14T18:49:57.528230+0000","last_clean":"2023-10-14T18:49:57.528230+0000","last_became_active":"2023-10-14T18:49:56.856440+0000","last_became_peered":"2023-10-14T18:49:56.856440+0000","last_unstale":"2023-10-14T18:49:57.528230+0000","last_undegraded":"2023-10-14T18:49:57.528230+0000","last_fullsized":"2023-10-14T18:49:57.528230+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:57:27.252830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533512+0000","last_change":"2023-10-14T18:49:57.533454+0000","last_active":"2023-10-14T18:49:57.533512+0000","last_peered":"2023-10-14T18:49:57.533512+0000","last_clean":"2023-10-14T18:49:57.533512+0000","last_became_active":"2023-10-14T18:49:57.533243+0000","last_became_peered":"2023-10-14T18:49:57.533243+0000","last_unstale":"2023-10-14T18:49:57.533512+0000","last_undegraded":"2023-10-14T18:49:57.533512+0000","last_fullsized":"2023-10-14T18:49:57.533512+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:10.275623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.524305+0000","last_change":"2023-10-14T18:49:56.850062+0000","last_active":"2023-10-14T18:49:57.524305+0000","last_peered":"2023-10-14T18:49:57.524305+0000","last_clean":"2023-10-14T18:49:57.524305+0000","last_became_active":"2023-10-14T18:49:56.849836+0000","last_became_peered":"2023-10-14T18:49:56.849836+0000","last_unstale":"2023-10-14T18:49:57.524305+0000","last_undegraded":"2023-10-14T18:49:57.524305+0000","last_fullsized":"2023-10-14T18:49:57.524305+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:49.628326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530022+0000","last_change":"2023-10-14T18:49:57.529928+0000","last_active":"2023-10-14T18:49:57.530022+0000","last_peered":"2023-10-14T18:49:57.530022+0000","last_clean":"2023-10-14T18:49:57.530022+0000","last_became_active":"2023-10-14T18:49:57.529566+0000","last_became_peered":"2023-10-14T18:49:57.529566+0000","last_unstale":"2023-10-14T18:49:57.530022+0000","last_undegraded":"2023-10-14T18:49:57.530022+0000","last_fullsized":"2023-10-14T18:49:57.530022+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:26.347735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851002+0000","last_change":"2023-10-14T18:49:56.856876+0000","last_active":"2023-10-14T18:49:57.851002+0000","last_peered":"2023-10-14T18:49:57.851002+0000","last_clean":"2023-10-14T18:49:57.851002+0000","last_became_active":"2023-10-14T18:49:56.855807+0000","last_became_peered":"2023-10-14T18:49:56.855807+0000","last_unstale":"2023-10-14T18:49:57.851002+0000","last_undegraded":"2023-10-14T18:49:57.851002+0000","last_fullsized":"2023-10-14T18:49:57.851002+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:08.932606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530579+0000","last_change":"2023-10-14T18:49:57.529862+0000","last_active":"2023-10-14T18:49:57.530579+0000","last_peered":"2023-10-14T18:49:57.530579+0000","last_clean":"2023-10-14T18:49:57.530579+0000","last_became_active":"2023-10-14T18:49:57.529577+0000","last_became_peered":"2023-10-14T18:49:57.529577+0000","last_unstale":"2023-10-14T18:49:57.530579+0000","last_undegraded":"2023-10-14T18:49:57.530579+0000","last_fullsized":"2023-10-14T18:49:57.530579+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:23.816147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523136+0000","last_change":"2023-10-14T18:49:56.854294+0000","last_active":"2023-10-14T18:49:57.523136+0000","last_peered":"2023-10-14T18:49:57.523136+0000","last_clean":"2023-10-14T18:49:57.523136+0000","last_became_active":"2023-10-14T18:49:56.854074+0000","last_became_peered":"2023-10-14T18:49:56.854074+0000","last_unstale":"2023-10-14T18:49:57.523136+0000","last_undegraded":"2023-10-14T18:49:57.523136+0000","last_fullsized":"2023-10-14T18:49:57.523136+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:31.550474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531663+0000","last_change":"2023-10-14T18:49:57.531600+0000","last_active":"2023-10-14T18:49:57.531663+0000","last_peered":"2023-10-14T18:49:57.531663+0000","last_clean":"2023-10-14T18:49:57.531663+0000","last_became_active":"2023-10-14T18:49:57.531163+0000","last_became_peered":"2023-10-14T18:49:57.531163+0000","last_unstale":"2023-10-14T18:49:57.531663+0000","last_undegraded":"2023-10-14T18:49:57.531663+0000","last_fullsized":"2023-10-14T18:49:57.531663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531503+0000","last_change":"2023-10-14T18:49:56.857506+0000","last_active":"2023-10-14T18:49:57.531503+0000","last_peered":"2023-10-14T18:49:57.531503+0000","last_clean":"2023-10-14T18:49:57.531503+0000","last_became_active":"2023-10-14T18:49:56.856813+0000","last_became_peered":"2023-10-14T18:49:56.856813+0000","last_unstale":"2023-10-14T18:49:57.531503+0000","last_undegraded":"2023-10-14T18:49:57.531503+0000","last_fullsized":"2023-10-14T18:49:57.531503+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:43.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531847+0000","last_change":"2023-10-14T18:49:57.531785+0000","last_active":"2023-10-14T18:49:57.531847+0000","last_peered":"2023-10-14T18:49:57.531847+0000","last_clean":"2023-10-14T18:49:57.531847+0000","last_became_active":"2023-10-14T18:49:57.531565+0000","last_became_peered":"2023-10-14T18:49:57.531565+0000","last_unstale":"2023-10-14T18:49:57.531847+0000","last_undegraded":"2023-10-14T18:49:57.531847+0000","last_fullsized":"2023-10-14T18:49:57.531847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527062+0000","last_change":"2023-10-14T18:49:56.855589+0000","last_active":"2023-10-14T18:49:57.527062+0000","last_peered":"2023-10-14T18:49:57.527062+0000","last_clean":"2023-10-14T18:49:57.527062+0000","last_became_active":"2023-10-14T18:49:56.855360+0000","last_became_peered":"2023-10-14T18:49:56.855360+0000","last_unstale":"2023-10-14T18:49:57.527062+0000","last_undegraded":"2023-10-14T18:49:57.527062+0000","last_fullsized":"2023-10-14T18:49:57.527062+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:08:56.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532326+0000","last_change":"2023-10-14T18:49:57.532267+0000","last_active":"2023-10-14T18:49:57.532326+0000","last_peered":"2023-10-14T18:49:57.532326+0000","last_clean":"2023-10-14T18:49:57.532326+0000","last_became_active":"2023-10-14T18:49:57.532041+0000","last_became_peered":"2023-10-14T18:49:57.532041+0000","last_unstale":"2023-10-14T18:49:57.532326+0000","last_undegraded":"2023-10-14T18:49:57.532326+0000","last_fullsized":"2023-10-14T18:49:57.532326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527048+0000","last_change":"2023-10-14T18:49:56.852967+0000","last_active":"2023-10-14T18:49:57.527048+0000","last_peered":"2023-10-14T18:49:57.527048+0000","last_clean":"2023-10-14T18:49:57.527048+0000","last_became_active":"2023-10-14T18:49:56.852051+0000","last_became_peered":"2023-10-14T18:49:56.852051+0000","last_unstale":"2023-10-14T18:49:57.527048+0000","last_undegraded":"2023-10-14T18:49:57.527048+0000","last_fullsized":"2023-10-14T18:49:57.527048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:45.693025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530253+0000","last_change":"2023-10-14T18:49:57.529956+0000","last_active":"2023-10-14T18:49:57.530253+0000","last_peered":"2023-10-14T18:49:57.530253+0000","last_clean":"2023-10-14T18:49:57.530253+0000","last_became_active":"2023-10-14T18:49:57.529420+0000","last_became_peered":"2023-10-14T18:49:57.529420+0000","last_unstale":"2023-10-14T18:49:57.530253+0000","last_undegraded":"2023-10-14T18:49:57.530253+0000","last_fullsized":"2023-10-14T18:49:57.530253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:28.010689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530658+0000","last_change":"2023-10-14T18:49:56.859113+0000","last_active":"2023-10-14T18:49:57.530658+0000","last_peered":"2023-10-14T18:49:57.530658+0000","last_clean":"2023-10-14T18:49:57.530658+0000","last_became_active":"2023-10-14T18:49:56.858027+0000","last_became_peered":"2023-10-14T18:49:56.858027+0000","last_unstale":"2023-10-14T18:49:57.530658+0000","last_undegraded":"2023-10-14T18:49:57.530658+0000","last_fullsized":"2023-10-14T18:49:57.530658+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:54.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525032+0000","last_change":"2023-10-14T18:49:57.524955+0000","last_active":"2023-10-14T18:49:57.525032+0000","last_peered":"2023-10-14T18:49:57.525032+0000","last_clean":"2023-10-14T18:49:57.525032+0000","last_became_active":"2023-10-14T18:49:57.524660+0000","last_became_peered":"2023-10-14T18:49:57.524660+0000","last_unstale":"2023-10-14T18:49:57.525032+0000","last_undegraded":"2023-10-14T18:49:57.525032+0000","last_fullsized":"2023-10-14T18:49:57.525032+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535123+0000","last_change":"2023-10-14T18:49:56.857334+0000","last_active":"2023-10-14T18:49:57.535123+0000","last_peered":"2023-10-14T18:49:57.535123+0000","last_clean":"2023-10-14T18:49:57.535123+0000","last_became_active":"2023-10-14T18:49:56.856486+0000","last_became_peered":"2023-10-14T18:49:56.856486+0000","last_unstale":"2023-10-14T18:49:57.535123+0000","last_undegraded":"2023-10-14T18:49:57.535123+0000","last_fullsized":"2023-10-14T18:49:57.535123+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:00.030377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536390+0000","last_change":"2023-10-14T18:49:57.536325+0000","last_active":"2023-10-14T18:49:57.536390+0000","last_peered":"2023-10-14T18:49:57.536390+0000","last_clean":"2023-10-14T18:49:57.536390+0000","last_became_active":"2023-10-14T18:49:57.535937+0000","last_became_peered":"2023-10-14T18:49:57.535937+0000","last_unstale":"2023-10-14T18:49:57.536390+0000","last_undegraded":"2023-10-14T18:49:57.536390+0000","last_fullsized":"2023-10-14T18:49:57.536390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526217+0000","last_change":"2023-10-14T18:49:56.858754+0000","last_active":"2023-10-14T18:49:57.526217+0000","last_peered":"2023-10-14T18:49:57.526217+0000","last_clean":"2023-10-14T18:49:57.526217+0000","last_became_active":"2023-10-14T18:49:56.858408+0000","last_became_peered":"2023-10-14T18:49:56.858408+0000","last_unstale":"2023-10-14T18:49:57.526217+0000","last_undegraded":"2023-10-14T18:49:57.526217+0000","last_fullsized":"2023-10-14T18:49:57.526217+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.182550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532914+0000","last_change":"2023-10-14T18:49:57.531251+0000","last_active":"2023-10-14T18:49:57.532914+0000","last_peered":"2023-10-14T18:49:57.532914+0000","last_clean":"2023-10-14T18:49:57.532914+0000","last_became_active":"2023-10-14T18:49:57.530624+0000","last_became_peered":"2023-10-14T18:49:57.530624+0000","last_unstale":"2023-10-14T18:49:57.532914+0000","last_undegraded":"2023-10-14T18:49:57.532914+0000","last_fullsized":"2023-10-14T18:49:57.532914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:44.573085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851047+0000","last_change":"2023-10-14T18:49:56.855511+0000","last_active":"2023-10-14T18:49:57.851047+0000","last_peered":"2023-10-14T18:49:57.851047+0000","last_clean":"2023-10-14T18:49:57.851047+0000","last_became_active":"2023-10-14T18:49:56.855205+0000","last_became_peered":"2023-10-14T18:49:56.855205+0000","last_unstale":"2023-10-14T18:49:57.851047+0000","last_undegraded":"2023-10-14T18:49:57.851047+0000","last_fullsized":"2023-10-14T18:49:57.851047+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:32.966766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523006+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:49:57.523006+0000","last_peered":"2023-10-14T18:49:57.523006+0000","last_clean":"2023-10-14T18:49:57.523006+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:49:57.523006+0000","last_undegraded":"2023-10-14T18:49:57.523006+0000","last_fullsized":"2023-10-14T18:49:57.523006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194204,"statfs":{"total":200000000,"available":198865548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.439,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64900000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59099999999999997,"15min":0.64900000000000002},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68700000000000006,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.64300000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.45600000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69699999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.70699999999999996,"15min":0.85199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67500000000000004,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.68200000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":0.625},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76700000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":538,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194774,"statfs":{"total":200000000,"available":199449032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.245,"15min":0.245},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.66500000000000004},"min":{"1min":0.432,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.71899999999999997,"15min":0.90100000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77900000000000003,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68300000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.29099999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.624,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":537,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194774,"statfs":{"total":200000000,"available":199449504,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55100000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.316},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.59399999999999997,"15min":0.78800000000000003},"min":{"1min":0.29899999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53300000000000003,"5min":10.574,"15min":10.574},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65700000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79600000000000004,"5min":1.125,"15min":1.125},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83499999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1112,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198860307,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.28499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58299999999999996},"min":{"1min":0.45300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.42999999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89400000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59099999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":531,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194780,"statfs":{"total":200000000,"available":199455432,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.22700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.52900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.61099999999999999,"5min":1.006,"15min":1.006},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.28799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81299999999999994,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86499999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":538,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194773,"statfs":{"total":200000000,"available":199448162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.443,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33600000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53300000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44400000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84399999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":531,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194781,"statfs":{"total":200000000,"available":199455986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.30399999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.435},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.52400000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.497}]},{"osd":3,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73899999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.872,"15min":0.872},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":532,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.748},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60999999999999999,"5min":0.872,"15min":0.872},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.746,"15min":0.746},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70499999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48899999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:01.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.063+0000 7fc2ca147700 1 Processor -- start 2023-10-14T18:50:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.063+0000 7fc2ca147700 1 -- start start 2023-10-14T18:50:02.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2ca147700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c415a620 0x7fc2c415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2ca147700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2c415d580 0x7fc2c4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2ca147700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c415cbb0 con 0x7fc2c4157870 2023-10-14T18:50:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2ca147700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c415bdb0 con 0x7fc2c415d580 2023-10-14T18:50:02.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2ca147700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415bfa0 con 0x7fc2c415a620 2023-10-14T18:50:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2c37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc2c4157870 0x7fc2c415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45292/0 (socket says 172.21.15.79:45292) 2023-10-14T18:50:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.064+0000 7fc2c37fe700 1 -- 172.21.15.79:0/709882767 learned_addr learned my addr 172.21.15.79:0/709882767 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931474887 0 0) 0x7fc2c415cbb0 con 0x7fc2c4157870 2023-10-14T18:50:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 --2- 172.21.15.79:0/709882767 >> v2:172.21.15.144:3300/0 conn(0x7fc2c415d580 0x7fc2c4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ac003570 con 0x7fc2c4157870 2023-10-14T18:50:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c2ffd700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c415a620 0x7fc2c415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423505300 0 0) 0x7fc2ac003570 con 0x7fc2c4157870 2023-10-14T18:50:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c415a620 msgr2=0x7fc2c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c415a620 0x7fc2c415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 >> v2:172.21.15.144:3300/0 conn(0x7fc2c415d580 msgr2=0x7fc2c4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 --2- 172.21.15.79:0/709882767 >> v2:172.21.15.144:3300/0 conn(0x7fc2c415d580 0x7fc2c4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c415c280 con 0x7fc2c4157870 2023-10-14T18:50:02.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc2b40017f0 con 0x7fc2c4157870 2023-10-14T18:50:02.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 >> v1:172.21.15.79:6789/0 conn(0x7fc2c4157870 legacy=0x7fc2c415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2ac003a60 0x7fc2ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2ac004810 0x7fc2ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2ac0051c0 0x7fc2ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415bfa0 con 0x7fc2ac0051c0 2023-10-14T18:50:02.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac00bfa0 con 0x7fc2ac004810 2023-10-14T18:50:02.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac00c0e0 con 0x7fc2ac003a60 2023-10-14T18:50:02.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c2ffd700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c415a620 0x7fc2c415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:02.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2ac0051c0 0x7fc2ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c37fe700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2ac003a60 0x7fc2ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c2ffd700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2ac004810 0x7fc2ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 -- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2ac003a60 msgr2=0x7fc2ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2ac003a60 0x7fc2ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 -- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2ac004810 msgr2=0x7fc2ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2ac004810 0x7fc2ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.065+0000 7fc2c3fff700 1 -- 172.21.15.79:0/709882767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac003570 con 0x7fc2ac0051c0 2023-10-14T18:50:02.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2c3fff700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2ac0051c0 0x7fc2ac00ba60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009c00 tx=0x7fc2bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d352731a4852a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00e710 con 0x7fc2ac0051c0 2023-10-14T18:50:02.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00e870 con 0x7fc2ac0051c0 2023-10-14T18:50:02.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2c27fc700 1 -- 172.21.15.79:0/709882767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00ec30 con 0x7fc2ac0051c0 2023-10-14T18:50:02.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 -- 172.21.15.79:0/709882767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2ac0051c0 msgr2=0x7fc2ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 --2- 172.21.15.79:0/709882767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2ac0051c0 0x7fc2ac00ba60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009c00 tx=0x7fc2bc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2c3fff700 1 -- 172.21.15.79:0/709882767 reap_dead start 2023-10-14T18:50:02.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 -- 172.21.15.79:0/709882767 shutdown_connections 2023-10-14T18:50:02.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 -- 172.21.15.79:0/709882767 >> 172.21.15.79:0/709882767 conn(0x7fc2c4068ce0 msgr2=0x7fc2c40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:02.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 -- 172.21.15.79:0/709882767 shutdown_connections 2023-10-14T18:50:02.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.066+0000 7fc2ca147700 1 -- 172.21.15.79:0/709882767 wait complete. 2023-10-14T18:50:02.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.067+0000 7fc2ca147700 1 Processor -- start 2023-10-14T18:50:02.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 -- start start 2023-10-14T18:50:02.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c4153150 0x7fc2c40b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c40b27c0 0x7fc2c40c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b0f90 con 0x7fc2c4152d80 2023-10-14T18:50:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b1df0 con 0x7fc2c40b27c0 2023-10-14T18:50:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2ca147700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c416b250 con 0x7fc2c4153150 2023-10-14T18:50:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2c37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45734/0 (socket says 172.21.15.79:45734) 2023-10-14T18:50:02.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2c37fe700 1 -- 172.21.15.79:0/275585225 learned_addr learned my addr 172.21.15.79:0/275585225 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:02.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2c37fe700 1 -- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c4153150 msgr2=0x7fc2c40b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.068+0000 7fc2c37fe700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c4153150 0x7fc2c40b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2c37fe700 1 -- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c40b27c0 msgr2=0x7fc2c40c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2c37fe700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c40b27c0 0x7fc2c40c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2c37fe700 1 -- 172.21.15.79:0/275585225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40b11e0 con 0x7fc2c4152d80 2023-10-14T18:50:02.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2c37fe700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400e430 tx=0x7fc2b40010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400eec0 con 0x7fc2c4152d80 2023-10-14T18:50:02.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4010040 con 0x7fc2c4152d80 2023-10-14T18:50:02.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4012730 con 0x7fc2c4152d80 2023-10-14T18:50:02.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c40b14c0 con 0x7fc2c4152d80 2023-10-14T18:50:02.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.069+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c40b1a80 con 0x7fc2c4152d80 2023-10-14T18:50:02.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.070+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c404c3c0 con 0x7fc2c4152d80 2023-10-14T18:50:02.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.070+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2b4012aa0 con 0x7fc2c4152d80 2023-10-14T18:50:02.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.071+0000 7fc2ab7fe700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 0x7fc2b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.071+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2b4084bc0 con 0x7fc2c4152d80 2023-10-14T18:50:02.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.071+0000 7fc2c2ffd700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 0x7fc2b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.071+0000 7fc2c2ffd700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 0x7fc2b00693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4153540 tx=0x7fc2b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.075+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2b4051e30 con 0x7fc2c4152d80 2023-10-14T18:50:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.255+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2c40b1f30 con 0x7fc2b0066f30 2023-10-14T18:50:02.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.263+0000 7fc2ab7fe700 1 -- 172.21.15.79:0/275585225 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285807 (secure 0 0 0) 0x7fc2b8015470 con 0x7fc2b0066f30 2023-10-14T18:50:02.267 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 msgr2=0x7fc2b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 0x7fc2b00693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4153540 tx=0x7fc2b8008040 comp rx=0 tx=0).stop 2023-10-14T18:50:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 msgr2=0x7fc2c416ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400e430 tx=0x7fc2b40010f0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 shutdown_connections 2023-10-14T18:50:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc2b0066f30 0x7fc2b00693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c40b27c0 0x7fc2c40c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2c4152d80 0x7fc2c416ad10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 --2- 172.21.15.79:0/275585225 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc2c4153150 0x7fc2c40b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 >> 172.21.15.79:0/275585225 conn(0x7fc2c4068ce0 msgr2=0x7fc2c4155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 shutdown_connections 2023-10-14T18:50:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.266+0000 7fc2ca147700 1 -- 172.21.15.79:0/275585225 wait complete. 2023-10-14T18:50:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:02.279 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2023-10-14T18:50:00.404292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5431,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557068,"statfs":{"total":1600000000,"available":1594438399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.563187"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535632+0000","last_change":"2023-10-14T18:49:57.535389+0000","last_active":"2023-10-14T18:49:57.535632+0000","last_peered":"2023-10-14T18:49:57.535632+0000","last_clean":"2023-10-14T18:49:57.535632+0000","last_became_active":"2023-10-14T18:49:57.534358+0000","last_became_peered":"2023-10-14T18:49:57.534358+0000","last_unstale":"2023-10-14T18:49:57.535632+0000","last_undegraded":"2023-10-14T18:49:57.535632+0000","last_fullsized":"2023-10-14T18:49:57.535632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535633+0000","last_change":"2023-10-14T18:49:57.535582+0000","last_active":"2023-10-14T18:49:57.535633+0000","last_peered":"2023-10-14T18:49:57.535633+0000","last_clean":"2023-10-14T18:49:57.535633+0000","last_became_active":"2023-10-14T18:49:57.535279+0000","last_became_peered":"2023-10-14T18:49:57.535279+0000","last_unstale":"2023-10-14T18:49:57.535633+0000","last_undegraded":"2023-10-14T18:49:57.535633+0000","last_fullsized":"2023-10-14T18:49:57.535633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:09.441667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.537273+0000","last_change":"2023-10-14T18:49:57.536788+0000","last_active":"2023-10-14T18:49:57.537273+0000","last_peered":"2023-10-14T18:49:57.537273+0000","last_clean":"2023-10-14T18:49:57.537273+0000","last_became_active":"2023-10-14T18:49:57.536557+0000","last_became_peered":"2023-10-14T18:49:57.536557+0000","last_unstale":"2023-10-14T18:49:57.537273+0000","last_undegraded":"2023-10-14T18:49:57.537273+0000","last_fullsized":"2023-10-14T18:49:57.537273+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:13.432265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534997+0000","last_change":"2023-10-14T18:49:57.534707+0000","last_active":"2023-10-14T18:49:57.534997+0000","last_peered":"2023-10-14T18:49:57.534997+0000","last_clean":"2023-10-14T18:49:57.534997+0000","last_became_active":"2023-10-14T18:49:57.534192+0000","last_became_peered":"2023-10-14T18:49:57.534192+0000","last_unstale":"2023-10-14T18:49:57.534997+0000","last_undegraded":"2023-10-14T18:49:57.534997+0000","last_fullsized":"2023-10-14T18:49:57.534997+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:58.447165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532432+0000","last_change":"2023-10-14T18:49:57.532350+0000","last_active":"2023-10-14T18:49:57.532432+0000","last_peered":"2023-10-14T18:49:57.532432+0000","last_clean":"2023-10-14T18:49:57.532432+0000","last_became_active":"2023-10-14T18:49:57.532092+0000","last_became_peered":"2023-10-14T18:49:57.532092+0000","last_unstale":"2023-10-14T18:49:57.532432+0000","last_undegraded":"2023-10-14T18:49:57.532432+0000","last_fullsized":"2023-10-14T18:49:57.532432+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531823+0000","last_change":"2023-10-14T18:49:57.531761+0000","last_active":"2023-10-14T18:49:57.531823+0000","last_peered":"2023-10-14T18:49:57.531823+0000","last_clean":"2023-10-14T18:49:57.531823+0000","last_became_active":"2023-10-14T18:49:57.529672+0000","last_became_peered":"2023-10-14T18:49:57.529672+0000","last_unstale":"2023-10-14T18:49:57.531823+0000","last_undegraded":"2023-10-14T18:49:57.531823+0000","last_fullsized":"2023-10-14T18:49:57.531823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533306+0000","last_change":"2023-10-14T18:49:57.533229+0000","last_active":"2023-10-14T18:49:57.533306+0000","last_peered":"2023-10-14T18:49:57.533306+0000","last_clean":"2023-10-14T18:49:57.533306+0000","last_became_active":"2023-10-14T18:49:57.533004+0000","last_became_peered":"2023-10-14T18:49:57.533004+0000","last_unstale":"2023-10-14T18:49:57.533306+0000","last_undegraded":"2023-10-14T18:49:57.533306+0000","last_fullsized":"2023-10-14T18:49:57.533306+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:23:50.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533540+0000","last_change":"2023-10-14T18:49:57.533491+0000","last_active":"2023-10-14T18:49:57.533540+0000","last_peered":"2023-10-14T18:49:57.533540+0000","last_clean":"2023-10-14T18:49:57.533540+0000","last_became_active":"2023-10-14T18:49:57.533201+0000","last_became_peered":"2023-10-14T18:49:57.533201+0000","last_unstale":"2023-10-14T18:49:57.533540+0000","last_undegraded":"2023-10-14T18:49:57.533540+0000","last_fullsized":"2023-10-14T18:49:57.533540+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:33.601045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533377+0000","last_change":"2023-10-14T18:49:57.533311+0000","last_active":"2023-10-14T18:49:57.533377+0000","last_peered":"2023-10-14T18:49:57.533377+0000","last_clean":"2023-10-14T18:49:57.533377+0000","last_became_active":"2023-10-14T18:49:57.533074+0000","last_became_peered":"2023-10-14T18:49:57.533074+0000","last_unstale":"2023-10-14T18:49:57.533377+0000","last_undegraded":"2023-10-14T18:49:57.533377+0000","last_fullsized":"2023-10-14T18:49:57.533377+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536468+0000","last_change":"2023-10-14T18:49:57.536402+0000","last_active":"2023-10-14T18:49:57.536468+0000","last_peered":"2023-10-14T18:49:57.536468+0000","last_clean":"2023-10-14T18:49:57.536468+0000","last_became_active":"2023-10-14T18:49:57.535700+0000","last_became_peered":"2023-10-14T18:49:57.535700+0000","last_unstale":"2023-10-14T18:49:57.536468+0000","last_undegraded":"2023-10-14T18:49:57.536468+0000","last_fullsized":"2023-10-14T18:49:57.536468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532828+0000","last_change":"2023-10-14T18:49:57.528817+0000","last_active":"2023-10-14T18:49:57.532828+0000","last_peered":"2023-10-14T18:49:57.532828+0000","last_clean":"2023-10-14T18:49:57.532828+0000","last_became_active":"2023-10-14T18:49:57.528069+0000","last_became_peered":"2023-10-14T18:49:57.528069+0000","last_unstale":"2023-10-14T18:49:57.532828+0000","last_undegraded":"2023-10-14T18:49:57.532828+0000","last_fullsized":"2023-10-14T18:49:57.532828+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:58:34.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535067+0000","last_change":"2023-10-14T18:49:57.535000+0000","last_active":"2023-10-14T18:49:57.535067+0000","last_peered":"2023-10-14T18:49:57.535067+0000","last_clean":"2023-10-14T18:49:57.535067+0000","last_became_active":"2023-10-14T18:49:57.534517+0000","last_became_peered":"2023-10-14T18:49:57.534517+0000","last_unstale":"2023-10-14T18:49:57.535067+0000","last_undegraded":"2023-10-14T18:49:57.535067+0000","last_fullsized":"2023-10-14T18:49:57.535067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528735+0000","last_change":"2023-10-14T18:49:57.527606+0000","last_active":"2023-10-14T18:49:57.528735+0000","last_peered":"2023-10-14T18:49:57.528735+0000","last_clean":"2023-10-14T18:49:57.528735+0000","last_became_active":"2023-10-14T18:49:57.527360+0000","last_became_peered":"2023-10-14T18:49:57.527360+0000","last_unstale":"2023-10-14T18:49:57.528735+0000","last_undegraded":"2023-10-14T18:49:57.528735+0000","last_fullsized":"2023-10-14T18:49:57.528735+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:28.010689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534989+0000","last_change":"2023-10-14T18:49:57.534542+0000","last_active":"2023-10-14T18:49:57.534989+0000","last_peered":"2023-10-14T18:49:57.534989+0000","last_clean":"2023-10-14T18:49:57.534989+0000","last_became_active":"2023-10-14T18:49:57.533922+0000","last_became_peered":"2023-10-14T18:49:57.533922+0000","last_unstale":"2023-10-14T18:49:57.534989+0000","last_undegraded":"2023-10-14T18:49:57.534989+0000","last_fullsized":"2023-10-14T18:49:57.534989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:19.645510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527439+0000","last_change":"2023-10-14T18:49:57.525100+0000","last_active":"2023-10-14T18:49:57.527439+0000","last_peered":"2023-10-14T18:49:57.527439+0000","last_clean":"2023-10-14T18:49:57.527439+0000","last_became_active":"2023-10-14T18:49:57.524882+0000","last_became_peered":"2023-10-14T18:49:57.524882+0000","last_unstale":"2023-10-14T18:49:57.527439+0000","last_undegraded":"2023-10-14T18:49:57.527439+0000","last_fullsized":"2023-10-14T18:49:57.527439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534946+0000","last_change":"2023-10-14T18:49:57.534880+0000","last_active":"2023-10-14T18:49:57.534946+0000","last_peered":"2023-10-14T18:49:57.534946+0000","last_clean":"2023-10-14T18:49:57.534946+0000","last_became_active":"2023-10-14T18:49:57.534643+0000","last_became_peered":"2023-10-14T18:49:57.534643+0000","last_unstale":"2023-10-14T18:49:57.534946+0000","last_undegraded":"2023-10-14T18:49:57.534946+0000","last_fullsized":"2023-10-14T18:49:57.534946+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:41.007019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536237+0000","last_change":"2023-10-14T18:49:57.536142+0000","last_active":"2023-10-14T18:49:57.536237+0000","last_peered":"2023-10-14T18:49:57.536237+0000","last_clean":"2023-10-14T18:49:57.536237+0000","last_became_active":"2023-10-14T18:49:57.535794+0000","last_became_peered":"2023-10-14T18:49:57.535794+0000","last_unstale":"2023-10-14T18:49:57.536237+0000","last_undegraded":"2023-10-14T18:49:57.536237+0000","last_fullsized":"2023-10-14T18:49:57.536237+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538091+0000","last_change":"2023-10-14T18:49:57.538032+0000","last_active":"2023-10-14T18:49:57.538091+0000","last_peered":"2023-10-14T18:49:57.538091+0000","last_clean":"2023-10-14T18:49:57.538091+0000","last_became_active":"2023-10-14T18:49:57.537740+0000","last_became_peered":"2023-10-14T18:49:57.537740+0000","last_unstale":"2023-10-14T18:49:57.538091+0000","last_undegraded":"2023-10-14T18:49:57.538091+0000","last_fullsized":"2023-10-14T18:49:57.538091+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:39:45.236144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532222+0000","last_change":"2023-10-14T18:49:57.532085+0000","last_active":"2023-10-14T18:49:57.532222+0000","last_peered":"2023-10-14T18:49:57.532222+0000","last_clean":"2023-10-14T18:49:57.532222+0000","last_became_active":"2023-10-14T18:49:57.531772+0000","last_became_peered":"2023-10-14T18:49:57.531772+0000","last_unstale":"2023-10-14T18:49:57.532222+0000","last_undegraded":"2023-10-14T18:49:57.532222+0000","last_fullsized":"2023-10-14T18:49:57.532222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:04:13.432265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530246+0000","last_change":"2023-10-14T18:49:57.530194+0000","last_active":"2023-10-14T18:49:57.530246+0000","last_peered":"2023-10-14T18:49:57.530246+0000","last_clean":"2023-10-14T18:49:57.530246+0000","last_became_active":"2023-10-14T18:49:57.529980+0000","last_became_peered":"2023-10-14T18:49:57.529980+0000","last_unstale":"2023-10-14T18:49:57.530246+0000","last_undegraded":"2023-10-14T18:49:57.530246+0000","last_fullsized":"2023-10-14T18:49:57.530246+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:23.536274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530037+0000","last_change":"2023-10-14T18:49:57.529832+0000","last_active":"2023-10-14T18:49:57.530037+0000","last_peered":"2023-10-14T18:49:57.530037+0000","last_clean":"2023-10-14T18:49:57.530037+0000","last_became_active":"2023-10-14T18:49:57.529619+0000","last_became_peered":"2023-10-14T18:49:57.529619+0000","last_unstale":"2023-10-14T18:49:57.530037+0000","last_undegraded":"2023-10-14T18:49:57.530037+0000","last_fullsized":"2023-10-14T18:49:57.530037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:45:27.752923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528878+0000","last_change":"2023-10-14T18:49:57.527919+0000","last_active":"2023-10-14T18:49:57.528878+0000","last_peered":"2023-10-14T18:49:57.528878+0000","last_clean":"2023-10-14T18:49:57.528878+0000","last_became_active":"2023-10-14T18:49:57.527681+0000","last_became_peered":"2023-10-14T18:49:57.527681+0000","last_unstale":"2023-10-14T18:49:57.528878+0000","last_undegraded":"2023-10-14T18:49:57.528878+0000","last_fullsized":"2023-10-14T18:49:57.528878+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:29.643782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.537773+0000","last_change":"2023-10-14T18:49:57.537704+0000","last_active":"2023-10-14T18:49:57.537773+0000","last_peered":"2023-10-14T18:49:57.537773+0000","last_clean":"2023-10-14T18:49:57.537773+0000","last_became_active":"2023-10-14T18:49:57.537022+0000","last_became_peered":"2023-10-14T18:49:57.537022+0000","last_unstale":"2023-10-14T18:49:57.537773+0000","last_undegraded":"2023-10-14T18:49:57.537773+0000","last_fullsized":"2023-10-14T18:49:57.537773+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529713+0000","last_change":"2023-10-14T18:49:57.529625+0000","last_active":"2023-10-14T18:49:57.529713+0000","last_peered":"2023-10-14T18:49:57.529713+0000","last_clean":"2023-10-14T18:49:57.529713+0000","last_became_active":"2023-10-14T18:49:57.529412+0000","last_became_peered":"2023-10-14T18:49:57.529412+0000","last_unstale":"2023-10-14T18:49:57.529713+0000","last_undegraded":"2023-10-14T18:49:57.529713+0000","last_fullsized":"2023-10-14T18:49:57.529713+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:21.370516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532886+0000","last_change":"2023-10-14T18:49:57.530706+0000","last_active":"2023-10-14T18:49:57.532886+0000","last_peered":"2023-10-14T18:49:57.532886+0000","last_clean":"2023-10-14T18:49:57.532886+0000","last_became_active":"2023-10-14T18:49:57.530396+0000","last_became_peered":"2023-10-14T18:49:57.530396+0000","last_unstale":"2023-10-14T18:49:57.532886+0000","last_undegraded":"2023-10-14T18:49:57.532886+0000","last_fullsized":"2023-10-14T18:49:57.532886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:11.579519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525015+0000","last_change":"2023-10-14T18:49:57.524946+0000","last_active":"2023-10-14T18:49:57.525015+0000","last_peered":"2023-10-14T18:49:57.525015+0000","last_clean":"2023-10-14T18:49:57.525015+0000","last_became_active":"2023-10-14T18:49:57.524726+0000","last_became_peered":"2023-10-14T18:49:57.524726+0000","last_unstale":"2023-10-14T18:49:57.525015+0000","last_undegraded":"2023-10-14T18:49:57.525015+0000","last_fullsized":"2023-10-14T18:49:57.525015+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:31:09.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534414+0000","last_change":"2023-10-14T18:49:57.534315+0000","last_active":"2023-10-14T18:49:57.534414+0000","last_peered":"2023-10-14T18:49:57.534414+0000","last_clean":"2023-10-14T18:49:57.534414+0000","last_became_active":"2023-10-14T18:49:57.534082+0000","last_became_peered":"2023-10-14T18:49:57.534082+0000","last_unstale":"2023-10-14T18:49:57.534414+0000","last_undegraded":"2023-10-14T18:49:57.534414+0000","last_fullsized":"2023-10-14T18:49:57.534414+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538418+0000","last_change":"2023-10-14T18:49:57.538331+0000","last_active":"2023-10-14T18:49:57.538418+0000","last_peered":"2023-10-14T18:49:57.538418+0000","last_clean":"2023-10-14T18:49:57.538418+0000","last_became_active":"2023-10-14T18:49:57.537877+0000","last_became_peered":"2023-10-14T18:49:57.537877+0000","last_unstale":"2023-10-14T18:49:57.538418+0000","last_undegraded":"2023-10-14T18:49:57.538418+0000","last_fullsized":"2023-10-14T18:49:57.538418+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525163+0000","last_change":"2023-10-14T18:49:57.525103+0000","last_active":"2023-10-14T18:49:57.525163+0000","last_peered":"2023-10-14T18:49:57.525163+0000","last_clean":"2023-10-14T18:49:57.525163+0000","last_became_active":"2023-10-14T18:49:57.524890+0000","last_became_peered":"2023-10-14T18:49:57.524890+0000","last_unstale":"2023-10-14T18:49:57.525163+0000","last_undegraded":"2023-10-14T18:49:57.525163+0000","last_fullsized":"2023-10-14T18:49:57.525163+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:08:57.546298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532869+0000","last_change":"2023-10-14T18:49:57.530583+0000","last_active":"2023-10-14T18:49:57.532869+0000","last_peered":"2023-10-14T18:49:57.532869+0000","last_clean":"2023-10-14T18:49:57.532869+0000","last_became_active":"2023-10-14T18:49:57.530160+0000","last_became_peered":"2023-10-14T18:49:57.530160+0000","last_unstale":"2023-10-14T18:49:57.532869+0000","last_undegraded":"2023-10-14T18:49:57.532869+0000","last_fullsized":"2023-10-14T18:49:57.532869+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:15.485363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530623+0000","last_change":"2023-10-14T18:49:57.530558+0000","last_active":"2023-10-14T18:49:57.530623+0000","last_peered":"2023-10-14T18:49:57.530623+0000","last_clean":"2023-10-14T18:49:57.530623+0000","last_became_active":"2023-10-14T18:49:57.530190+0000","last_became_peered":"2023-10-14T18:49:57.530190+0000","last_unstale":"2023-10-14T18:49:57.530623+0000","last_undegraded":"2023-10-14T18:49:57.530623+0000","last_fullsized":"2023-10-14T18:49:57.530623+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:10.275623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535650+0000","last_change":"2023-10-14T18:49:57.535472+0000","last_active":"2023-10-14T18:49:57.535650+0000","last_peered":"2023-10-14T18:49:57.535650+0000","last_clean":"2023-10-14T18:49:57.535650+0000","last_became_active":"2023-10-14T18:49:57.535238+0000","last_became_peered":"2023-10-14T18:49:57.535238+0000","last_unstale":"2023-10-14T18:49:57.535650+0000","last_undegraded":"2023-10-14T18:49:57.535650+0000","last_fullsized":"2023-10-14T18:49:57.535650+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:31:09.085571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536205+0000","last_change":"2023-10-14T18:49:57.535273+0000","last_active":"2023-10-14T18:49:57.536205+0000","last_peered":"2023-10-14T18:49:57.536205+0000","last_clean":"2023-10-14T18:49:57.536205+0000","last_became_active":"2023-10-14T18:49:57.535062+0000","last_became_peered":"2023-10-14T18:49:57.535062+0000","last_unstale":"2023-10-14T18:49:57.536205+0000","last_undegraded":"2023-10-14T18:49:57.536205+0000","last_fullsized":"2023-10-14T18:49:57.536205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"101'4","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854382+0000","last_change":"2023-10-14T18:49:56.859415+0000","last_active":"2023-10-14T18:49:57.854382+0000","last_peered":"2023-10-14T18:49:57.854382+0000","last_clean":"2023-10-14T18:49:57.854382+0000","last_became_active":"2023-10-14T18:49:56.858899+0000","last_became_peered":"2023-10-14T18:49:56.858899+0000","last_unstale":"2023-10-14T18:49:57.854382+0000","last_undegraded":"2023-10-14T18:49:57.854382+0000","last_fullsized":"2023-10-14T18:49:57.854382+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:01.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538136+0000","last_change":"2023-10-14T18:49:57.538074+0000","last_active":"2023-10-14T18:49:57.538136+0000","last_peered":"2023-10-14T18:49:57.538136+0000","last_clean":"2023-10-14T18:49:57.538136+0000","last_became_active":"2023-10-14T18:49:57.537511+0000","last_became_peered":"2023-10-14T18:49:57.537511+0000","last_unstale":"2023-10-14T18:49:57.538136+0000","last_undegraded":"2023-10-14T18:49:57.538136+0000","last_fullsized":"2023-10-14T18:49:57.538136+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852435+0000","last_change":"2023-10-14T18:49:56.860531+0000","last_active":"2023-10-14T18:49:57.852435+0000","last_peered":"2023-10-14T18:49:57.852435+0000","last_clean":"2023-10-14T18:49:57.852435+0000","last_became_active":"2023-10-14T18:49:56.859022+0000","last_became_peered":"2023-10-14T18:49:56.859022+0000","last_unstale":"2023-10-14T18:49:57.852435+0000","last_undegraded":"2023-10-14T18:49:57.852435+0000","last_fullsized":"2023-10-14T18:49:57.852435+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:00.030377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535666+0000","last_change":"2023-10-14T18:49:57.535517+0000","last_active":"2023-10-14T18:49:57.535666+0000","last_peered":"2023-10-14T18:49:57.535666+0000","last_clean":"2023-10-14T18:49:57.535666+0000","last_became_active":"2023-10-14T18:49:57.535169+0000","last_became_peered":"2023-10-14T18:49:57.535169+0000","last_unstale":"2023-10-14T18:49:57.535666+0000","last_undegraded":"2023-10-14T18:49:57.535666+0000","last_fullsized":"2023-10-14T18:49:57.535666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:23.816147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852121+0000","last_change":"2023-10-14T18:49:56.850927+0000","last_active":"2023-10-14T18:49:57.852121+0000","last_peered":"2023-10-14T18:49:57.852121+0000","last_clean":"2023-10-14T18:49:57.852121+0000","last_became_active":"2023-10-14T18:49:56.850365+0000","last_became_peered":"2023-10-14T18:49:56.850365+0000","last_unstale":"2023-10-14T18:49:57.852121+0000","last_undegraded":"2023-10-14T18:49:57.852121+0000","last_fullsized":"2023-10-14T18:49:57.852121+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:32.596255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534085+0000","last_change":"2023-10-14T18:49:57.531731+0000","last_active":"2023-10-14T18:49:57.534085+0000","last_peered":"2023-10-14T18:49:57.534085+0000","last_clean":"2023-10-14T18:49:57.534085+0000","last_became_active":"2023-10-14T18:49:57.530190+0000","last_became_peered":"2023-10-14T18:49:57.530190+0000","last_unstale":"2023-10-14T18:49:57.534085+0000","last_undegraded":"2023-10-14T18:49:57.534085+0000","last_fullsized":"2023-10-14T18:49:57.534085+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:45.796322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853258+0000","last_change":"2023-10-14T18:49:56.850084+0000","last_active":"2023-10-14T18:49:57.853258+0000","last_peered":"2023-10-14T18:49:57.853258+0000","last_clean":"2023-10-14T18:49:57.853258+0000","last_became_active":"2023-10-14T18:49:56.849879+0000","last_became_peered":"2023-10-14T18:49:56.849879+0000","last_unstale":"2023-10-14T18:49:57.853258+0000","last_undegraded":"2023-10-14T18:49:57.853258+0000","last_fullsized":"2023-10-14T18:49:57.853258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:25.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532947+0000","last_change":"2023-10-14T18:49:57.531532+0000","last_active":"2023-10-14T18:49:57.532947+0000","last_peered":"2023-10-14T18:49:57.532947+0000","last_clean":"2023-10-14T18:49:57.532947+0000","last_became_active":"2023-10-14T18:49:57.531209+0000","last_became_peered":"2023-10-14T18:49:57.531209+0000","last_unstale":"2023-10-14T18:49:57.532947+0000","last_undegraded":"2023-10-14T18:49:57.532947+0000","last_fullsized":"2023-10-14T18:49:57.532947+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:09:35.990921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851482+0000","last_change":"2023-10-14T18:49:56.859300+0000","last_active":"2023-10-14T18:49:57.851482+0000","last_peered":"2023-10-14T18:49:57.851482+0000","last_clean":"2023-10-14T18:49:57.851482+0000","last_became_active":"2023-10-14T18:49:56.858453+0000","last_became_peered":"2023-10-14T18:49:56.858453+0000","last_unstale":"2023-10-14T18:49:57.851482+0000","last_undegraded":"2023-10-14T18:49:57.851482+0000","last_fullsized":"2023-10-14T18:49:57.851482+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:48:01.276427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536221+0000","last_change":"2023-10-14T18:49:57.536004+0000","last_active":"2023-10-14T18:49:57.536221+0000","last_peered":"2023-10-14T18:49:57.536221+0000","last_clean":"2023-10-14T18:49:57.536221+0000","last_became_active":"2023-10-14T18:49:57.535487+0000","last_became_peered":"2023-10-14T18:49:57.535487+0000","last_unstale":"2023-10-14T18:49:57.536221+0000","last_undegraded":"2023-10-14T18:49:57.536221+0000","last_fullsized":"2023-10-14T18:49:57.536221+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.850963+0000","last_change":"2023-10-14T18:49:56.858556+0000","last_active":"2023-10-14T18:49:57.850963+0000","last_peered":"2023-10-14T18:49:57.850963+0000","last_clean":"2023-10-14T18:49:57.850963+0000","last_became_active":"2023-10-14T18:49:56.858321+0000","last_became_peered":"2023-10-14T18:49:56.858321+0000","last_unstale":"2023-10-14T18:49:57.850963+0000","last_undegraded":"2023-10-14T18:49:57.850963+0000","last_fullsized":"2023-10-14T18:49:57.850963+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:04:46.449021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534104+0000","last_change":"2023-10-14T18:49:57.531884+0000","last_active":"2023-10-14T18:49:57.534104+0000","last_peered":"2023-10-14T18:49:57.534104+0000","last_clean":"2023-10-14T18:49:57.534104+0000","last_became_active":"2023-10-14T18:49:57.530518+0000","last_became_peered":"2023-10-14T18:49:57.530518+0000","last_unstale":"2023-10-14T18:49:57.534104+0000","last_undegraded":"2023-10-14T18:49:57.534104+0000","last_fullsized":"2023-10-14T18:49:57.534104+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526017+0000","last_change":"2023-10-14T18:49:56.856655+0000","last_active":"2023-10-14T18:49:57.526017+0000","last_peered":"2023-10-14T18:49:57.526017+0000","last_clean":"2023-10-14T18:49:57.526017+0000","last_became_active":"2023-10-14T18:49:56.856512+0000","last_became_peered":"2023-10-14T18:49:56.856512+0000","last_unstale":"2023-10-14T18:49:57.526017+0000","last_undegraded":"2023-10-14T18:49:57.526017+0000","last_fullsized":"2023-10-14T18:49:57.526017+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:10.967315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530715+0000","last_change":"2023-10-14T18:49:57.529857+0000","last_active":"2023-10-14T18:49:57.530715+0000","last_peered":"2023-10-14T18:49:57.530715+0000","last_clean":"2023-10-14T18:49:57.530715+0000","last_became_active":"2023-10-14T18:49:57.527728+0000","last_became_peered":"2023-10-14T18:49:57.527728+0000","last_unstale":"2023-10-14T18:49:57.530715+0000","last_undegraded":"2023-10-14T18:49:57.530715+0000","last_fullsized":"2023-10-14T18:49:57.530715+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523532+0000","last_change":"2023-10-14T18:49:56.860059+0000","last_active":"2023-10-14T18:49:57.523532+0000","last_peered":"2023-10-14T18:49:57.523532+0000","last_clean":"2023-10-14T18:49:57.523532+0000","last_became_active":"2023-10-14T18:49:56.859838+0000","last_became_peered":"2023-10-14T18:49:56.859838+0000","last_unstale":"2023-10-14T18:49:57.523532+0000","last_undegraded":"2023-10-14T18:49:57.523532+0000","last_fullsized":"2023-10-14T18:49:57.523532+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:22:10.495139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528967+0000","last_change":"2023-10-14T18:49:57.528913+0000","last_active":"2023-10-14T18:49:57.528967+0000","last_peered":"2023-10-14T18:49:57.528967+0000","last_clean":"2023-10-14T18:49:57.528967+0000","last_became_active":"2023-10-14T18:49:57.528699+0000","last_became_peered":"2023-10-14T18:49:57.528699+0000","last_unstale":"2023-10-14T18:49:57.528967+0000","last_undegraded":"2023-10-14T18:49:57.528967+0000","last_fullsized":"2023-10-14T18:49:57.528967+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528093+0000","last_change":"2023-10-14T18:49:56.855487+0000","last_active":"2023-10-14T18:49:57.528093+0000","last_peered":"2023-10-14T18:49:57.528093+0000","last_clean":"2023-10-14T18:49:57.528093+0000","last_became_active":"2023-10-14T18:49:56.855240+0000","last_became_peered":"2023-10-14T18:49:56.855240+0000","last_unstale":"2023-10-14T18:49:57.528093+0000","last_undegraded":"2023-10-14T18:49:57.528093+0000","last_fullsized":"2023-10-14T18:49:57.528093+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.182550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530752+0000","last_change":"2023-10-14T18:49:57.529911+0000","last_active":"2023-10-14T18:49:57.530752+0000","last_peered":"2023-10-14T18:49:57.530752+0000","last_clean":"2023-10-14T18:49:57.530752+0000","last_became_active":"2023-10-14T18:49:57.529377+0000","last_became_peered":"2023-10-14T18:49:57.529377+0000","last_unstale":"2023-10-14T18:49:57.530752+0000","last_undegraded":"2023-10-14T18:49:57.530752+0000","last_fullsized":"2023-10-14T18:49:57.530752+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:01.103004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528627+0000","last_change":"2023-10-14T18:49:56.859551+0000","last_active":"2023-10-14T18:49:57.528627+0000","last_peered":"2023-10-14T18:49:57.528627+0000","last_clean":"2023-10-14T18:49:57.528627+0000","last_became_active":"2023-10-14T18:49:56.859294+0000","last_became_peered":"2023-10-14T18:49:56.859294+0000","last_unstale":"2023-10-14T18:49:57.528627+0000","last_undegraded":"2023-10-14T18:49:57.528627+0000","last_fullsized":"2023-10-14T18:49:57.528627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:48:01.276427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534697+0000","last_change":"2023-10-14T18:49:57.534640+0000","last_active":"2023-10-14T18:49:57.534697+0000","last_peered":"2023-10-14T18:49:57.534697+0000","last_clean":"2023-10-14T18:49:57.534697+0000","last_became_active":"2023-10-14T18:49:57.534423+0000","last_became_peered":"2023-10-14T18:49:57.534423+0000","last_unstale":"2023-10-14T18:49:57.534697+0000","last_undegraded":"2023-10-14T18:49:57.534697+0000","last_fullsized":"2023-10-14T18:49:57.534697+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"101'3","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854548+0000","last_change":"2023-10-14T18:49:56.859949+0000","last_active":"2023-10-14T18:49:57.854548+0000","last_peered":"2023-10-14T18:49:57.854548+0000","last_clean":"2023-10-14T18:49:57.854548+0000","last_became_active":"2023-10-14T18:49:56.859731+0000","last_became_peered":"2023-10-14T18:49:56.859731+0000","last_unstale":"2023-10-14T18:49:57.854548+0000","last_undegraded":"2023-10-14T18:49:57.854548+0000","last_fullsized":"2023-10-14T18:49:57.854548+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:54.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530004+0000","last_change":"2023-10-14T18:49:57.529791+0000","last_active":"2023-10-14T18:49:57.530004+0000","last_peered":"2023-10-14T18:49:57.530004+0000","last_clean":"2023-10-14T18:49:57.530004+0000","last_became_active":"2023-10-14T18:49:57.529240+0000","last_became_peered":"2023-10-14T18:49:57.529240+0000","last_unstale":"2023-10-14T18:49:57.530004+0000","last_undegraded":"2023-10-14T18:49:57.530004+0000","last_fullsized":"2023-10-14T18:49:57.530004+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:58:33.601045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"101'6","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854454+0000","last_change":"2023-10-14T18:49:56.856472+0000","last_active":"2023-10-14T18:49:57.854454+0000","last_peered":"2023-10-14T18:49:57.854454+0000","last_clean":"2023-10-14T18:49:57.854454+0000","last_became_active":"2023-10-14T18:49:56.856176+0000","last_became_peered":"2023-10-14T18:49:56.856176+0000","last_unstale":"2023-10-14T18:49:57.854454+0000","last_undegraded":"2023-10-14T18:49:57.854454+0000","last_fullsized":"2023-10-14T18:49:57.854454+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:14.480572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530271+0000","last_change":"2023-10-14T18:49:57.530174+0000","last_active":"2023-10-14T18:49:57.530271+0000","last_peered":"2023-10-14T18:49:57.530271+0000","last_clean":"2023-10-14T18:49:57.530271+0000","last_became_active":"2023-10-14T18:49:57.529715+0000","last_became_peered":"2023-10-14T18:49:57.529715+0000","last_unstale":"2023-10-14T18:49:57.530271+0000","last_undegraded":"2023-10-14T18:49:57.530271+0000","last_fullsized":"2023-10-14T18:49:57.530271+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:45.344622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.852249+0000","last_change":"2023-10-14T18:49:56.857798+0000","last_active":"2023-10-14T18:49:57.852249+0000","last_peered":"2023-10-14T18:49:57.852249+0000","last_clean":"2023-10-14T18:49:57.852249+0000","last_became_active":"2023-10-14T18:49:56.857171+0000","last_became_peered":"2023-10-14T18:49:56.857171+0000","last_unstale":"2023-10-14T18:49:57.852249+0000","last_undegraded":"2023-10-14T18:49:57.852249+0000","last_fullsized":"2023-10-14T18:49:57.852249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:46.663236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530786+0000","last_change":"2023-10-14T18:49:57.530722+0000","last_active":"2023-10-14T18:49:57.530786+0000","last_peered":"2023-10-14T18:49:57.530786+0000","last_clean":"2023-10-14T18:49:57.530786+0000","last_became_active":"2023-10-14T18:49:57.529902+0000","last_became_peered":"2023-10-14T18:49:57.529902+0000","last_unstale":"2023-10-14T18:49:57.530786+0000","last_undegraded":"2023-10-14T18:49:57.530786+0000","last_fullsized":"2023-10-14T18:49:57.530786+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.524219+0000","last_change":"2023-10-14T18:49:56.850511+0000","last_active":"2023-10-14T18:49:57.524219+0000","last_peered":"2023-10-14T18:49:57.524219+0000","last_clean":"2023-10-14T18:49:57.524219+0000","last_became_active":"2023-10-14T18:49:56.850299+0000","last_became_peered":"2023-10-14T18:49:56.850299+0000","last_unstale":"2023-10-14T18:49:57.524219+0000","last_undegraded":"2023-10-14T18:49:57.524219+0000","last_fullsized":"2023-10-14T18:49:57.524219+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:09.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532932+0000","last_change":"2023-10-14T18:49:57.531406+0000","last_active":"2023-10-14T18:49:57.532932+0000","last_peered":"2023-10-14T18:49:57.532932+0000","last_clean":"2023-10-14T18:49:57.532932+0000","last_became_active":"2023-10-14T18:49:57.530938+0000","last_became_peered":"2023-10-14T18:49:57.530938+0000","last_unstale":"2023-10-14T18:49:57.532932+0000","last_undegraded":"2023-10-14T18:49:57.532932+0000","last_fullsized":"2023-10-14T18:49:57.532932+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:18.039300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529908+0000","last_change":"2023-10-14T18:49:56.859253+0000","last_active":"2023-10-14T18:49:57.529908+0000","last_peered":"2023-10-14T18:49:57.529908+0000","last_clean":"2023-10-14T18:49:57.529908+0000","last_became_active":"2023-10-14T18:49:56.859014+0000","last_became_peered":"2023-10-14T18:49:56.859014+0000","last_unstale":"2023-10-14T18:49:57.529908+0000","last_undegraded":"2023-10-14T18:49:57.529908+0000","last_fullsized":"2023-10-14T18:49:57.529908+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:28.638992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535501+0000","last_change":"2023-10-14T18:49:57.535444+0000","last_active":"2023-10-14T18:49:57.535501+0000","last_peered":"2023-10-14T18:49:57.535501+0000","last_clean":"2023-10-14T18:49:57.535501+0000","last_became_active":"2023-10-14T18:49:57.535063+0000","last_became_peered":"2023-10-14T18:49:57.535063+0000","last_unstale":"2023-10-14T18:49:57.535501+0000","last_undegraded":"2023-10-14T18:49:57.535501+0000","last_fullsized":"2023-10-14T18:49:57.535501+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:02.948134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"101'8","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.854266+0000","last_change":"2023-10-14T18:49:56.851724+0000","last_active":"2023-10-14T18:49:57.854266+0000","last_peered":"2023-10-14T18:49:57.854266+0000","last_clean":"2023-10-14T18:49:57.854266+0000","last_became_active":"2023-10-14T18:49:56.851497+0000","last_became_peered":"2023-10-14T18:49:56.851497+0000","last_unstale":"2023-10-14T18:49:57.854266+0000","last_undegraded":"2023-10-14T18:49:57.854266+0000","last_fullsized":"2023-10-14T18:49:57.854266+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:56:00.098213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528752+0000","last_change":"2023-10-14T18:49:57.527980+0000","last_active":"2023-10-14T18:49:57.528752+0000","last_peered":"2023-10-14T18:49:57.528752+0000","last_clean":"2023-10-14T18:49:57.528752+0000","last_became_active":"2023-10-14T18:49:57.527690+0000","last_became_peered":"2023-10-14T18:49:57.527690+0000","last_unstale":"2023-10-14T18:49:57.528752+0000","last_undegraded":"2023-10-14T18:49:57.528752+0000","last_fullsized":"2023-10-14T18:49:57.528752+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:34:46.501994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851437+0000","last_change":"2023-10-14T18:49:56.856308+0000","last_active":"2023-10-14T18:49:57.851437+0000","last_peered":"2023-10-14T18:49:57.851437+0000","last_clean":"2023-10-14T18:49:57.851437+0000","last_became_active":"2023-10-14T18:49:56.856077+0000","last_became_peered":"2023-10-14T18:49:56.856077+0000","last_unstale":"2023-10-14T18:49:57.851437+0000","last_undegraded":"2023-10-14T18:49:57.851437+0000","last_fullsized":"2023-10-14T18:49:57.851437+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:10.574728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.538671+0000","last_change":"2023-10-14T18:49:57.538618+0000","last_active":"2023-10-14T18:49:57.538671+0000","last_peered":"2023-10-14T18:49:57.538671+0000","last_clean":"2023-10-14T18:49:57.538671+0000","last_became_active":"2023-10-14T18:49:57.538431+0000","last_became_peered":"2023-10-14T18:49:57.538431+0000","last_unstale":"2023-10-14T18:49:57.538671+0000","last_undegraded":"2023-10-14T18:49:57.538671+0000","last_fullsized":"2023-10-14T18:49:57.538671+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853290+0000","last_change":"2023-10-14T18:49:56.858152+0000","last_active":"2023-10-14T18:49:57.853290+0000","last_peered":"2023-10-14T18:49:57.853290+0000","last_clean":"2023-10-14T18:49:57.853290+0000","last_became_active":"2023-10-14T18:49:56.857965+0000","last_became_peered":"2023-10-14T18:49:56.857965+0000","last_unstale":"2023-10-14T18:49:57.853290+0000","last_undegraded":"2023-10-14T18:49:57.853290+0000","last_fullsized":"2023-10-14T18:49:57.853290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:30.206790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532453+0000","last_change":"2023-10-14T18:49:57.532350+0000","last_active":"2023-10-14T18:49:57.532453+0000","last_peered":"2023-10-14T18:49:57.532453+0000","last_clean":"2023-10-14T18:49:57.532453+0000","last_became_active":"2023-10-14T18:49:57.532108+0000","last_became_peered":"2023-10-14T18:49:57.532108+0000","last_unstale":"2023-10-14T18:49:57.532453+0000","last_undegraded":"2023-10-14T18:49:57.532453+0000","last_fullsized":"2023-10-14T18:49:57.532453+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526093+0000","last_change":"2023-10-14T18:49:56.855488+0000","last_active":"2023-10-14T18:49:57.526093+0000","last_peered":"2023-10-14T18:49:57.526093+0000","last_clean":"2023-10-14T18:49:57.526093+0000","last_became_active":"2023-10-14T18:49:56.855268+0000","last_became_peered":"2023-10-14T18:49:56.855268+0000","last_unstale":"2023-10-14T18:49:57.526093+0000","last_undegraded":"2023-10-14T18:49:57.526093+0000","last_fullsized":"2023-10-14T18:49:57.526093+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:54:40.002228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.534978+0000","last_change":"2023-10-14T18:49:57.534411+0000","last_active":"2023-10-14T18:49:57.534978+0000","last_peered":"2023-10-14T18:49:57.534978+0000","last_clean":"2023-10-14T18:49:57.534978+0000","last_became_active":"2023-10-14T18:49:57.533642+0000","last_became_peered":"2023-10-14T18:49:57.533642+0000","last_unstale":"2023-10-14T18:49:57.534978+0000","last_undegraded":"2023-10-14T18:49:57.534978+0000","last_fullsized":"2023-10-14T18:49:57.534978+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:06.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.853064+0000","last_change":"2023-10-14T18:49:56.851227+0000","last_active":"2023-10-14T18:49:57.853064+0000","last_peered":"2023-10-14T18:49:57.853064+0000","last_clean":"2023-10-14T18:49:57.853064+0000","last_became_active":"2023-10-14T18:49:56.851010+0000","last_became_peered":"2023-10-14T18:49:56.851010+0000","last_unstale":"2023-10-14T18:49:57.853064+0000","last_undegraded":"2023-10-14T18:49:57.853064+0000","last_fullsized":"2023-10-14T18:49:57.853064+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:03:30.315199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531523+0000","last_change":"2023-10-14T18:49:57.531364+0000","last_active":"2023-10-14T18:49:57.531523+0000","last_peered":"2023-10-14T18:49:57.531523+0000","last_clean":"2023-10-14T18:49:57.531523+0000","last_became_active":"2023-10-14T18:49:57.530952+0000","last_became_peered":"2023-10-14T18:49:57.530952+0000","last_unstale":"2023-10-14T18:49:57.531523+0000","last_undegraded":"2023-10-14T18:49:57.531523+0000","last_fullsized":"2023-10-14T18:49:57.531523+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:26.347735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529158+0000","last_change":"2023-10-14T18:49:56.849961+0000","last_active":"2023-10-14T18:49:57.529158+0000","last_peered":"2023-10-14T18:49:57.529158+0000","last_clean":"2023-10-14T18:49:57.529158+0000","last_became_active":"2023-10-14T18:49:56.849725+0000","last_became_peered":"2023-10-14T18:49:56.849725+0000","last_unstale":"2023-10-14T18:49:57.529158+0000","last_undegraded":"2023-10-14T18:49:57.529158+0000","last_fullsized":"2023-10-14T18:49:57.529158+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:39:18.641918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.529477+0000","last_change":"2023-10-14T18:49:57.529403+0000","last_active":"2023-10-14T18:49:57.529477+0000","last_peered":"2023-10-14T18:49:57.529477+0000","last_clean":"2023-10-14T18:49:57.529477+0000","last_became_active":"2023-10-14T18:49:57.528883+0000","last_became_peered":"2023-10-14T18:49:57.528883+0000","last_unstale":"2023-10-14T18:49:57.529477+0000","last_undegraded":"2023-10-14T18:49:57.529477+0000","last_fullsized":"2023-10-14T18:49:57.529477+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:04.105506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.528230+0000","last_change":"2023-10-14T18:49:56.856670+0000","last_active":"2023-10-14T18:49:57.528230+0000","last_peered":"2023-10-14T18:49:57.528230+0000","last_clean":"2023-10-14T18:49:57.528230+0000","last_became_active":"2023-10-14T18:49:56.856440+0000","last_became_peered":"2023-10-14T18:49:56.856440+0000","last_unstale":"2023-10-14T18:49:57.528230+0000","last_undegraded":"2023-10-14T18:49:57.528230+0000","last_fullsized":"2023-10-14T18:49:57.528230+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:57:27.252830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.533512+0000","last_change":"2023-10-14T18:49:57.533454+0000","last_active":"2023-10-14T18:49:57.533512+0000","last_peered":"2023-10-14T18:49:57.533512+0000","last_clean":"2023-10-14T18:49:57.533512+0000","last_became_active":"2023-10-14T18:49:57.533243+0000","last_became_peered":"2023-10-14T18:49:57.533243+0000","last_unstale":"2023-10-14T18:49:57.533512+0000","last_undegraded":"2023-10-14T18:49:57.533512+0000","last_fullsized":"2023-10-14T18:49:57.533512+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:15:10.275623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.524305+0000","last_change":"2023-10-14T18:49:56.850062+0000","last_active":"2023-10-14T18:49:57.524305+0000","last_peered":"2023-10-14T18:49:57.524305+0000","last_clean":"2023-10-14T18:49:57.524305+0000","last_became_active":"2023-10-14T18:49:56.849836+0000","last_became_peered":"2023-10-14T18:49:56.849836+0000","last_unstale":"2023-10-14T18:49:57.524305+0000","last_undegraded":"2023-10-14T18:49:57.524305+0000","last_fullsized":"2023-10-14T18:49:57.524305+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:18:49.628326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530022+0000","last_change":"2023-10-14T18:49:57.529928+0000","last_active":"2023-10-14T18:49:57.530022+0000","last_peered":"2023-10-14T18:49:57.530022+0000","last_clean":"2023-10-14T18:49:57.530022+0000","last_became_active":"2023-10-14T18:49:57.529566+0000","last_became_peered":"2023-10-14T18:49:57.529566+0000","last_unstale":"2023-10-14T18:49:57.530022+0000","last_undegraded":"2023-10-14T18:49:57.530022+0000","last_fullsized":"2023-10-14T18:49:57.530022+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:22:26.347735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"101'2","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851002+0000","last_change":"2023-10-14T18:49:56.856876+0000","last_active":"2023-10-14T18:49:57.851002+0000","last_peered":"2023-10-14T18:49:57.851002+0000","last_clean":"2023-10-14T18:49:57.851002+0000","last_became_active":"2023-10-14T18:49:56.855807+0000","last_became_peered":"2023-10-14T18:49:56.855807+0000","last_unstale":"2023-10-14T18:49:57.851002+0000","last_undegraded":"2023-10-14T18:49:57.851002+0000","last_fullsized":"2023-10-14T18:49:57.851002+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:09:08.932606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530579+0000","last_change":"2023-10-14T18:49:57.529862+0000","last_active":"2023-10-14T18:49:57.530579+0000","last_peered":"2023-10-14T18:49:57.530579+0000","last_clean":"2023-10-14T18:49:57.530579+0000","last_became_active":"2023-10-14T18:49:57.529577+0000","last_became_peered":"2023-10-14T18:49:57.529577+0000","last_unstale":"2023-10-14T18:49:57.530579+0000","last_undegraded":"2023-10-14T18:49:57.530579+0000","last_fullsized":"2023-10-14T18:49:57.530579+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:31:23.816147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523136+0000","last_change":"2023-10-14T18:49:56.854294+0000","last_active":"2023-10-14T18:49:57.523136+0000","last_peered":"2023-10-14T18:49:57.523136+0000","last_clean":"2023-10-14T18:49:57.523136+0000","last_became_active":"2023-10-14T18:49:56.854074+0000","last_became_peered":"2023-10-14T18:49:56.854074+0000","last_unstale":"2023-10-14T18:49:57.523136+0000","last_undegraded":"2023-10-14T18:49:57.523136+0000","last_fullsized":"2023-10-14T18:49:57.523136+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:31.550474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531663+0000","last_change":"2023-10-14T18:49:57.531600+0000","last_active":"2023-10-14T18:49:57.531663+0000","last_peered":"2023-10-14T18:49:57.531663+0000","last_clean":"2023-10-14T18:49:57.531663+0000","last_became_active":"2023-10-14T18:49:57.531163+0000","last_became_peered":"2023-10-14T18:49:57.531163+0000","last_unstale":"2023-10-14T18:49:57.531663+0000","last_undegraded":"2023-10-14T18:49:57.531663+0000","last_fullsized":"2023-10-14T18:49:57.531663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:45.824307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531503+0000","last_change":"2023-10-14T18:49:56.857506+0000","last_active":"2023-10-14T18:49:57.531503+0000","last_peered":"2023-10-14T18:49:57.531503+0000","last_clean":"2023-10-14T18:49:57.531503+0000","last_became_active":"2023-10-14T18:49:56.856813+0000","last_became_peered":"2023-10-14T18:49:56.856813+0000","last_unstale":"2023-10-14T18:49:57.531503+0000","last_undegraded":"2023-10-14T18:49:57.531503+0000","last_fullsized":"2023-10-14T18:49:57.531503+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:43.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.531847+0000","last_change":"2023-10-14T18:49:57.531785+0000","last_active":"2023-10-14T18:49:57.531847+0000","last_peered":"2023-10-14T18:49:57.531847+0000","last_clean":"2023-10-14T18:49:57.531847+0000","last_became_active":"2023-10-14T18:49:57.531565+0000","last_became_peered":"2023-10-14T18:49:57.531565+0000","last_unstale":"2023-10-14T18:49:57.531847+0000","last_undegraded":"2023-10-14T18:49:57.531847+0000","last_fullsized":"2023-10-14T18:49:57.531847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:11.972106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527062+0000","last_change":"2023-10-14T18:49:56.855589+0000","last_active":"2023-10-14T18:49:57.527062+0000","last_peered":"2023-10-14T18:49:57.527062+0000","last_clean":"2023-10-14T18:49:57.527062+0000","last_became_active":"2023-10-14T18:49:56.855360+0000","last_became_peered":"2023-10-14T18:49:56.855360+0000","last_unstale":"2023-10-14T18:49:57.527062+0000","last_undegraded":"2023-10-14T18:49:57.527062+0000","last_fullsized":"2023-10-14T18:49:57.527062+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:08:56.541508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532326+0000","last_change":"2023-10-14T18:49:57.532267+0000","last_active":"2023-10-14T18:49:57.532326+0000","last_peered":"2023-10-14T18:49:57.532326+0000","last_clean":"2023-10-14T18:49:57.532326+0000","last_became_active":"2023-10-14T18:49:57.532041+0000","last_became_peered":"2023-10-14T18:49:57.532041+0000","last_unstale":"2023-10-14T18:49:57.532326+0000","last_undegraded":"2023-10-14T18:49:57.532326+0000","last_fullsized":"2023-10-14T18:49:57.532326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:46.697815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.527048+0000","last_change":"2023-10-14T18:49:56.852967+0000","last_active":"2023-10-14T18:49:57.527048+0000","last_peered":"2023-10-14T18:49:57.527048+0000","last_clean":"2023-10-14T18:49:57.527048+0000","last_became_active":"2023-10-14T18:49:56.852051+0000","last_became_peered":"2023-10-14T18:49:56.852051+0000","last_unstale":"2023-10-14T18:49:57.527048+0000","last_undegraded":"2023-10-14T18:49:57.527048+0000","last_fullsized":"2023-10-14T18:49:57.527048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:17:45.693025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530253+0000","last_change":"2023-10-14T18:49:57.529956+0000","last_active":"2023-10-14T18:49:57.530253+0000","last_peered":"2023-10-14T18:49:57.530253+0000","last_clean":"2023-10-14T18:49:57.530253+0000","last_became_active":"2023-10-14T18:49:57.529420+0000","last_became_peered":"2023-10-14T18:49:57.529420+0000","last_unstale":"2023-10-14T18:49:57.530253+0000","last_undegraded":"2023-10-14T18:49:57.530253+0000","last_fullsized":"2023-10-14T18:49:57.530253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:44:28.010689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.530658+0000","last_change":"2023-10-14T18:49:56.859113+0000","last_active":"2023-10-14T18:49:57.530658+0000","last_peered":"2023-10-14T18:49:57.530658+0000","last_clean":"2023-10-14T18:49:57.530658+0000","last_became_active":"2023-10-14T18:49:56.858027+0000","last_became_peered":"2023-10-14T18:49:56.858027+0000","last_unstale":"2023-10-14T18:49:57.530658+0000","last_undegraded":"2023-10-14T18:49:57.530658+0000","last_fullsized":"2023-10-14T18:49:57.530658+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:54.678484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.525032+0000","last_change":"2023-10-14T18:49:57.524955+0000","last_active":"2023-10-14T18:49:57.525032+0000","last_peered":"2023-10-14T18:49:57.525032+0000","last_clean":"2023-10-14T18:49:57.525032+0000","last_became_active":"2023-10-14T18:49:57.524660+0000","last_became_peered":"2023-10-14T18:49:57.524660+0000","last_unstale":"2023-10-14T18:49:57.525032+0000","last_undegraded":"2023-10-14T18:49:57.525032+0000","last_fullsized":"2023-10-14T18:49:57.525032+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:31.211580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.535123+0000","last_change":"2023-10-14T18:49:56.857334+0000","last_active":"2023-10-14T18:49:57.535123+0000","last_peered":"2023-10-14T18:49:57.535123+0000","last_clean":"2023-10-14T18:49:57.535123+0000","last_became_active":"2023-10-14T18:49:56.856486+0000","last_became_peered":"2023-10-14T18:49:56.856486+0000","last_unstale":"2023-10-14T18:49:57.535123+0000","last_undegraded":"2023-10-14T18:49:57.535123+0000","last_fullsized":"2023-10-14T18:49:57.535123+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:00.030377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.536390+0000","last_change":"2023-10-14T18:49:57.536325+0000","last_active":"2023-10-14T18:49:57.536390+0000","last_peered":"2023-10-14T18:49:57.536390+0000","last_clean":"2023-10-14T18:49:57.536390+0000","last_became_active":"2023-10-14T18:49:57.535937+0000","last_became_peered":"2023-10-14T18:49:57.535937+0000","last_unstale":"2023-10-14T18:49:57.536390+0000","last_undegraded":"2023-10-14T18:49:57.536390+0000","last_fullsized":"2023-10-14T18:49:57.536390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:16:18.472385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.526217+0000","last_change":"2023-10-14T18:49:56.858754+0000","last_active":"2023-10-14T18:49:57.526217+0000","last_peered":"2023-10-14T18:49:57.526217+0000","last_clean":"2023-10-14T18:49:57.526217+0000","last_became_active":"2023-10-14T18:49:56.858408+0000","last_became_peered":"2023-10-14T18:49:56.858408+0000","last_unstale":"2023-10-14T18:49:57.526217+0000","last_undegraded":"2023-10-14T18:49:57.526217+0000","last_fullsized":"2023-10-14T18:49:57.526217+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:00.182550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.532914+0000","last_change":"2023-10-14T18:49:57.531251+0000","last_active":"2023-10-14T18:49:57.532914+0000","last_peered":"2023-10-14T18:49:57.532914+0000","last_clean":"2023-10-14T18:49:57.532914+0000","last_became_active":"2023-10-14T18:49:57.530624+0000","last_became_peered":"2023-10-14T18:49:57.530624+0000","last_unstale":"2023-10-14T18:49:57.532914+0000","last_undegraded":"2023-10-14T18:49:57.532914+0000","last_fullsized":"2023-10-14T18:49:57.532914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:56.840626+0000","last_clean_scrub_stamp":"2023-10-14T18:49:56.840626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:40:44.573085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"101'1","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.851047+0000","last_change":"2023-10-14T18:49:56.855511+0000","last_active":"2023-10-14T18:49:57.851047+0000","last_peered":"2023-10-14T18:49:57.851047+0000","last_clean":"2023-10-14T18:49:57.851047+0000","last_became_active":"2023-10-14T18:49:56.855205+0000","last_became_peered":"2023-10-14T18:49:56.855205+0000","last_unstale":"2023-10-14T18:49:57.851047+0000","last_undegraded":"2023-10-14T18:49:57.851047+0000","last_fullsized":"2023-10-14T18:49:57.851047+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:49:55.835836+0000","last_clean_scrub_stamp":"2023-10-14T18:49:55.835836+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:17:32.966766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":245,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-14T18:49:57.523006+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:49:57.523006+0000","last_peered":"2023-10-14T18:49:57.523006+0000","last_clean":"2023-10-14T18:49:57.523006+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:49:57.523006+0000","last_undegraded":"2023-10-14T18:49:57.523006+0000","last_fullsized":"2023-10-14T18:49:57.523006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1107,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194204,"statfs":{"total":200000000,"available":198865548,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.439,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64900000000000002,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59099999999999997,"15min":0.64900000000000002},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68700000000000006,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.64300000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.45600000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69699999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.70699999999999996,"15min":0.85199999999999998},"min":{"1min":0.41699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67500000000000004,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.68200000000000005,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.315,"5min":0.311,"15min":0.311},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":0.625},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73599999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.82599999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.39900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.65900000000000003,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.69999999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:49:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70599999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76700000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":538,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194774,"statfs":{"total":200000000,"available":199449032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.245,"15min":0.245},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.376,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.73899999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.35799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.75,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.66500000000000004},"min":{"1min":0.432,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75800000000000001,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.49399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.71899999999999997,"15min":0.90100000000000002},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77900000000000003,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.372},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68300000000000005,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.44400000000000001,"15min":0.441},"min":{"1min":0.29099999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.58799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70299999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51800000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47199999999999998,"15min":0.47799999999999998},"min":{"1min":0.31900000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.624,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.52600000000000002},"min":{"1min":0.34399999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72199999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:49:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71199999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56100000000000005,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.76000000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":537,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194774,"statfs":{"total":200000000,"available":199449504,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32900000000000001},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.55100000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.45700000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.316},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.35299999999999998},"min":{"1min":0.28199999999999997,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.58499999999999996,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.59399999999999997,"15min":0.78800000000000003},"min":{"1min":0.29899999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53300000000000003,"5min":10.574,"15min":10.574},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65700000000000003,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.38200000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.39800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79600000000000004,"5min":1.125,"15min":1.125},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.57299999999999995},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.439,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78000000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83499999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.46200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.79600000000000004,"5min":0.878,"15min":0.878},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1112,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194199,"statfs":{"total":200000000,"available":198860307,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.219,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34499999999999997,"15min":0.33500000000000002},"min":{"1min":0.25600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.35399999999999998,"15min":0.35099999999999998},"min":{"1min":0.27700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.53500000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.28499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.57299999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.26300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.45100000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58299999999999996},"min":{"1min":0.45300000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68000000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39900000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56100000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.42999999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89400000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.56399999999999995},"min":{"1min":0.47999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59099999999999997,"15min":0.57399999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":531,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194780,"statfs":{"total":200000000,"available":199455432,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32200000000000001},"min":{"1min":0.249,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.22700000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.23499999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.52900000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38800000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.36899999999999999},"min":{"1min":0.30099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.61099999999999999,"5min":1.006,"15min":1.006},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.28799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.627,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.752,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61699999999999999,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81299999999999994,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.77700000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.432,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.83199999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.62},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82999999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.86499999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":538,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194773,"statfs":{"total":200000000,"available":199448162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32900000000000001,"15min":0.33200000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.443,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23000000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.33600000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33700000000000002,"15min":0.33800000000000002},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":0.49299999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.376,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53300000000000003,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44400000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40899999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.47899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.746,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84399999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:49:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91600000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":531,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194781,"statfs":{"total":200000000,"available":199455986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.30399999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.435},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.53200000000000003},"min":{"1min":0.34200000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52800000000000002,"15min":0.51500000000000001},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51200000000000001,"15min":0.502},"min":{"1min":0.36499999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70199999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56100000000000005,"15min":0.57699999999999996},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.52400000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.749,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.497}]},{"osd":3,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73899999999999999,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.34699999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:49:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.56399999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.872,"15min":0.872},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":532,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454428,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54400000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.36899999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71499999999999997,"5min":0.748,"15min":0.748},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.33000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60999999999999999,"5min":0.872,"15min":0.872},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52800000000000002,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64200000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.60199999999999998,"5min":0.746,"15min":0.746},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38200000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70499999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50700000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:49:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.66000000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48899999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:02.284 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:50:02.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:50:02.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.440+0000 7f3ece6e4700 1 Processor -- start 2023-10-14T18:50:02.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.440+0000 7f3ece6e4700 1 -- start start 2023-10-14T18:50:02.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ece6e4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 0x7f3ec80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ece6e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ece6e4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80b0790 con 0x7f3ec815a290 2023-10-14T18:50:02.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ece6e4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80ce1f0 con 0x7f3ec8159ec0 2023-10-14T18:50:02.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ece6e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b0b20 con 0x7f3ec806acb0 2023-10-14T18:50:02.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ec7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 0x7f3ec80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:59524/0 (socket says 172.21.15.79:59524) 2023-10-14T18:50:02.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 -- 172.21.15.79:0/3022555960 learned_addr learned my addr 172.21.15.79:0/3022555960 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:02.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ec77fe700 1 --1- 172.21.15.79:0/3022555960 >> v1:172.21.15.144:6789/0 conn(0x7f3ec815a290 0x7f3ec806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:42678/0 (socket says 172.21.15.79:42678) 2023-10-14T18:50:02.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 -- 172.21.15.79:0/3022555960 >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 msgr2=0x7f3ec80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 --2- 172.21.15.79:0/3022555960 >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 0x7f3ec80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 -- 172.21.15.79:0/3022555960 >> v1:172.21.15.144:6789/0 conn(0x7f3ec815a290 legacy=0x7f3ec806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3eccc81700 1 -- 172.21.15.79:0/3022555960 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80b04b0 con 0x7f3ec806acb0 2023-10-14T18:50:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.441+0000 7f3ec7fff700 1 --2- 172.21.15.79:0/3022555960 >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 0x7f3ec80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3eccc81700 1 --2- 172.21.15.79:0/3022555960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009f20 tx=0x7f3ec0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bdb58650bc6183 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ec6ffd700 1 -- 172.21.15.79:0/3022555960 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000e070 con 0x7f3ec806acb0 2023-10-14T18:50:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ec6ffd700 1 -- 172.21.15.79:0/3022555960 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000b9d0 con 0x7f3ec806acb0 2023-10-14T18:50:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ec6ffd700 1 -- 172.21.15.79:0/3022555960 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00092e0 con 0x7f3ec806acb0 2023-10-14T18:50:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 -- 172.21.15.79:0/3022555960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 msgr2=0x7f3ec80afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/3022555960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009f20 tx=0x7f3ec0009840 comp rx=0 tx=0).stop 2023-10-14T18:50:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 -- 172.21.15.79:0/3022555960 shutdown_connections 2023-10-14T18:50:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/3022555960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec806acb0 0x7f3ec80afe80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/3022555960 >> v2:172.21.15.144:3300/0 conn(0x7f3ec8159ec0 0x7f3ec80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 -- 172.21.15.79:0/3022555960 >> 172.21.15.79:0/3022555960 conn(0x7f3ec80d1880 msgr2=0x7f3ec80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:02.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 -- 172.21.15.79:0/3022555960 shutdown_connections 2023-10-14T18:50:02.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.442+0000 7f3ece6e4700 1 -- 172.21.15.79:0/3022555960 wait complete. 2023-10-14T18:50:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.443+0000 7f3ece6e4700 1 Processor -- start 2023-10-14T18:50:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 -- start start 2023-10-14T18:50:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec806acb0 0x7f3ec80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec8159ec0 0x7f3ec814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec814df00 con 0x7f3ec815a290 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b68f0 con 0x7f3ec806acb0 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3ece6e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b4e70 con 0x7f3ec8159ec0 2023-10-14T18:50:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.444+0000 7f3eccc81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45736/0 (socket says 172.21.15.79:45736) 2023-10-14T18:50:02.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 -- 172.21.15.79:0/1447915370 learned_addr learned my addr 172.21.15.79:0/1447915370 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:02.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3ec7fff700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec806acb0 0x7f3ec80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3ec77fe700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec8159ec0 0x7f3ec814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 -- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec8159ec0 msgr2=0x7f3ec814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec8159ec0 0x7f3ec814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 -- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec806acb0 msgr2=0x7f3ec80b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec806acb0 0x7f3ec80b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 -- 172.21.15.79:0/1447915370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc009420 con 0x7f3ec815a290 2023-10-14T18:50:02.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eccc81700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000b610 tx=0x7f3ec0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0008ad0 con 0x7f3ec815a290 2023-10-14T18:50:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0008c30 con 0x7f3ec815a290 2023-10-14T18:50:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0026460 con 0x7f3ec815a290 2023-10-14T18:50:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec0009ae0 con 0x7f3ec815a290 2023-10-14T18:50:02.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.445+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec80b4540 con 0x7f3ec815a290 2023-10-14T18:50:02.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.446+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec804c3c0 con 0x7f3ec815a290 2023-10-14T18:50:02.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.447+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ec0003040 con 0x7f3ec815a290 2023-10-14T18:50:02.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.447+0000 7f3eaffff700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.447+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ec0086340 con 0x7f3ec815a290 2023-10-14T18:50:02.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.447+0000 7f3ec7fff700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.448+0000 7f3ec7fff700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009f40 tx=0x7f3ebc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.451+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ec00535b0 con 0x7f3ec815a290 2023-10-14T18:50:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.708+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3ec80cbea0 con 0x7f3ec815a290 2023-10-14T18:50:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.712+0000 7f3eaffff700 1 -- 172.21.15.79:0/1447915370 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3ec0056bd0 con 0x7f3ec815a290 2023-10-14T18:50:02.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 msgr2=0x7f3eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009f40 tx=0x7f3ebc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 msgr2=0x7f3ec80b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000b610 tx=0x7f3ec0018000 comp rx=0 tx=0).stop 2023-10-14T18:50:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 shutdown_connections 2023-10-14T18:50:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ec815a290 0x7f3ec80b63b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ec806acb0 0x7f3ec80b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 --2- 172.21.15.79:0/1447915370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ec8159ec0 0x7f3ec814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 >> 172.21.15.79:0/1447915370 conn(0x7f3ec80d1880 msgr2=0x7f3ec8153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 shutdown_connections 2023-10-14T18:50:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.714+0000 7f3ece6e4700 1 -- 172.21.15.79:0/1447915370 wait complete. 2023-10-14T18:50:02.718 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:50:02.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:02.834 INFO:tasks.ceph.mds.a.smithi079.stderr:2023-10-14T18:50:02.833+0000 7f3f061d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:50:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 Processor -- start 2023-10-14T18:50:02.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 -- start start 2023-10-14T18:50:02.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc0c152010 0x7fcc0c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c06c010 con 0x7fcc0c158e50 2023-10-14T18:50:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c06bd10 con 0x7fcc0c152010 2023-10-14T18:50:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.841+0000 7fcc125df700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c15c060 con 0x7fcc0c1523e0 2023-10-14T18:50:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc0c152010 0x7fcc0c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcc0c152010 0x7fcc0c15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45742/0 (socket says 172.21.15.79:45742) 2023-10-14T18:50:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 -- 172.21.15.79:0/1322701081 learned_addr learned my addr 172.21.15.79:0/1322701081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 -- 172.21.15.79:0/1322701081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c1523e0 msgr2=0x7fcc0c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 --2- 172.21.15.79:0/1322701081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 -- 172.21.15.79:0/1322701081 >> v1:172.21.15.144:6789/0 conn(0x7fcc0c158e50 legacy=0x7fcc0c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 -- 172.21.15.79:0/1322701081 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c15c340 con 0x7fcc0c152010 2023-10-14T18:50:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0bfff700 1 --2- 172.21.15.79:0/1322701081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c15b810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0099b0 tx=0x7fcbfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7c1be534294e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0affd700 1 -- 172.21.15.79:0/1322701081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00b820 con 0x7fcc0c152010 2023-10-14T18:50:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0affd700 1 -- 172.21.15.79:0/1322701081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc00b980 con 0x7fcc0c152010 2023-10-14T18:50:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.842+0000 7fcc0affd700 1 -- 172.21.15.79:0/1322701081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00bd20 con 0x7fcc0c152010 2023-10-14T18:50:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 -- 172.21.15.79:0/1322701081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 msgr2=0x7fcc0c15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 --2- 172.21.15.79:0/1322701081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c15b810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0099b0 tx=0x7fcbfc009250 comp rx=0 tx=0).stop 2023-10-14T18:50:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 -- 172.21.15.79:0/1322701081 shutdown_connections 2023-10-14T18:50:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 --2- 172.21.15.79:0/1322701081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c15b810 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 --2- 172.21.15.79:0/1322701081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 -- 172.21.15.79:0/1322701081 >> 172.21.15.79:0/1322701081 conn(0x7fcc0c069870 msgr2=0x7fcc0c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 -- 172.21.15.79:0/1322701081 shutdown_connections 2023-10-14T18:50:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.843+0000 7fcc125df700 1 -- 172.21.15.79:0/1322701081 wait complete. 2023-10-14T18:50:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.844+0000 7fcc125df700 1 Processor -- start 2023-10-14T18:50:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.844+0000 7fcc125df700 1 -- start start 2023-10-14T18:50:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c158e50 0x7fcc0c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b4900 con 0x7fcc0c152010 2023-10-14T18:50:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0c72d0 con 0x7fcc0c1523e0 2023-10-14T18:50:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b4620 con 0x7fcc0c158e50 2023-10-14T18:50:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45750/0 (socket says 172.21.15.79:45750) 2023-10-14T18:50:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 -- 172.21.15.79:0/2073423596 learned_addr learned my addr 172.21.15.79:0/2073423596 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0b7fe700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc10b7c700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c158e50 0x7fcc0c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 -- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c158e50 msgr2=0x7fcc0c06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c158e50 0x7fcc0c06c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 -- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 msgr2=0x7fcc0c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 -- 172.21.15.79:0/2073423596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0094f0 con 0x7fcc0c152010 2023-10-14T18:50:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0b7fe700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc0bfff700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0094c0 tx=0x7fcbfc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc01a460 con 0x7fcc0c152010 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc01a5c0 con 0x7fcc0c152010 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c0c6c80 con 0x7fcc0c152010 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc01a980 con 0x7fcc0c152010 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.845+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c13e640 con 0x7fcc0c152010 2023-10-14T18:50:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.846+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c0c6ae0 con 0x7fcc0c152010 2023-10-14T18:50:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.847+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbfc01ad30 con 0x7fcc0c152010 2023-10-14T18:50:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.847+0000 7fcbf3fff700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.847+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbfc085f50 con 0x7fcc0c152010 2023-10-14T18:50:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.847+0000 7fcc0b7fe700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.848+0000 7fcc0b7fe700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 0x7fcbf80693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15ae20 tx=0x7fcc00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:02.851+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc0c0c6ae0 con 0x7fcc0c152010 2023-10-14T18:50:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.075+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc0c0c6ae0 con 0x7fcc0c152010 2023-10-14T18:50:03.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.076+0000 7fcbf3fff700 1 -- 172.21.15.79:0/2073423596 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fcc0c0c6ae0 con 0x7fcc0c152010 2023-10-14T18:50:03.077 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:03.077 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:03.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 msgr2=0x7fcbf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 0x7fcbf80693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c15ae20 tx=0x7fcc00008040 comp rx=0 tx=0).stop 2023-10-14T18:50:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 msgr2=0x7fcc0c13e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0094c0 tx=0x7fcbfc016000 comp rx=0 tx=0).stop 2023-10-14T18:50:03.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 shutdown_connections 2023-10-14T18:50:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcbf8066f30 0x7fcbf80693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc0c158e50 0x7fcc0c06c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc0c152010 0x7fcc0c13e100 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 --2- 172.21.15.79:0/2073423596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc0c1523e0 0x7fcc0c06c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 >> 172.21.15.79:0/2073423596 conn(0x7fcc0c069870 msgr2=0x7fcc0c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 shutdown_connections 2023-10-14T18:50:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.078+0000 7fcc125df700 1 -- 172.21.15.79:0/2073423596 wait complete. 2023-10-14T18:50:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:03.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:49:57.226431+0000', 'modified': '2023-10-14T18:50:00.866172+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6348': {'gid': 6348, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1750729224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 1750729224}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1750729224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:50:03.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:50:03.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T18:50:03.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.610+0000 7fb7963fe700 1 Processor -- start 2023-10-14T18:50:03.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.610+0000 7fb7963fe700 1 -- start start 2023-10-14T18:50:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb7963fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb790152010 0x7fb79015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb7963fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 0x7fb79006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb7963fe700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79006c010 con 0x7fb790158e50 2023-10-14T18:50:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb7963fe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79006bd10 con 0x7fb790152010 2023-10-14T18:50:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb7963fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79015c060 con 0x7fb7901523e0 2023-10-14T18:50:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb79499b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb790158e50 0x7fb7900cdf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45296/0 (socket says 172.21.15.79:45296) 2023-10-14T18:50:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.611+0000 7fb79499b700 1 -- 172.21.15.79:0/1943624946 learned_addr learned my addr 172.21.15.79:0/1943624946 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 0x7fb79006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78ffff700 1 --2- 172.21.15.79:0/1943624946 >> v2:172.21.15.144:3300/0 conn(0x7fb790152010 0x7fb79015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317956793 0 0) 0x7fb79006c010 con 0x7fb790158e50 2023-10-14T18:50:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb778003570 con 0x7fb790158e50 2023-10-14T18:50:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1226140144 0 0) 0x7fb778003570 con 0x7fb790158e50 2023-10-14T18:50:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 msgr2=0x7fb79006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 0x7fb79006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 >> v2:172.21.15.144:3300/0 conn(0x7fb790152010 msgr2=0x7fb79015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 --2- 172.21.15.79:0/1943624946 >> v2:172.21.15.144:3300/0 conn(0x7fb790152010 0x7fb79015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79015c340 con 0x7fb790158e50 2023-10-14T18:50:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb7880017f0 con 0x7fb790158e50 2023-10-14T18:50:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 >> v1:172.21.15.79:6789/0 conn(0x7fb790158e50 legacy=0x7fb7900cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb778003a60 0x7fb778003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb778004810 0x7fb778004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 0x7fb7780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79006bd10 con 0x7fb778004810 2023-10-14T18:50:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79015c060 con 0x7fb778003a60 2023-10-14T18:50:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77800ba60 con 0x7fb7901523e0 2023-10-14T18:50:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb778004810 0x7fb778004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78ffff700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb778003a60 0x7fb778003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 -- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 msgr2=0x7fb7780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7901523e0 0x7fb7780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 -- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb778003a60 msgr2=0x7fb778003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb778003a60 0x7fb778003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.612+0000 7fb78f7fe700 1 -- 172.21.15.79:0/1943624946 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778003570 con 0x7fb778004810 2023-10-14T18:50:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb778004810 0x7fb778004c80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb784009c00 tx=0x7fb7840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1002e0c21b0d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400e710 con 0x7fb778004810 2023-10-14T18:50:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78400e870 con 0x7fb778004810 2023-10-14T18:50:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb78effd700 1 -- 172.21.15.79:0/1943624946 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400ec30 con 0x7fb778004810 2023-10-14T18:50:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 -- 172.21.15.79:0/1943624946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb778004810 msgr2=0x7fb778004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 --2- 172.21.15.79:0/1943624946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb778004810 0x7fb778004c80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb784009c00 tx=0x7fb7840091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb79499b700 1 -- 172.21.15.79:0/1943624946 reap_dead start 2023-10-14T18:50:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 -- 172.21.15.79:0/1943624946 shutdown_connections 2023-10-14T18:50:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 -- 172.21.15.79:0/1943624946 >> 172.21.15.79:0/1943624946 conn(0x7fb790069870 msgr2=0x7fb790069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 -- 172.21.15.79:0/1943624946 shutdown_connections 2023-10-14T18:50:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.613+0000 7fb7963fe700 1 -- 172.21.15.79:0/1943624946 wait complete. 2023-10-14T18:50:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.614+0000 7fb7963fe700 1 Processor -- start 2023-10-14T18:50:03.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 -- start start 2023-10-14T18:50:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb778004810 0x7fb7900c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb790167d30 0x7fb7900b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b3f10 con 0x7fb790157250 2023-10-14T18:50:03.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b47d0 con 0x7fb790167d30 2023-10-14T18:50:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb7963fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900c7600 con 0x7fb778004810 2023-10-14T18:50:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb79499b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb79499b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45756/0 (socket says 172.21.15.79:45756) 2023-10-14T18:50:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.615+0000 7fb79499b700 1 -- 172.21.15.79:0/32216827 learned_addr learned my addr 172.21.15.79:0/32216827 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 -- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb778004810 msgr2=0x7fb7900c6410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:50:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb778004810 0x7fb7900c6410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 -- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb790167d30 msgr2=0x7fb7900b4290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:50:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb790167d30 0x7fb7900b4290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 -- 172.21.15.79:0/32216827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900c69f0 con 0x7fb790157250 2023-10-14T18:50:03.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb79499b700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb790159220 tx=0x7fb788007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb777fff700 1 -- 172.21.15.79:0/32216827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788004dc0 con 0x7fb790157250 2023-10-14T18:50:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb777fff700 1 -- 172.21.15.79:0/32216827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788007190 con 0x7fb790157250 2023-10-14T18:50:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900c6cd0 con 0x7fb790157250 2023-10-14T18:50:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb777fff700 1 -- 172.21.15.79:0/32216827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788007550 con 0x7fb790157250 2023-10-14T18:50:03.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.616+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900c7290 con 0x7fb790157250 2023-10-14T18:50:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.617+0000 7fb777fff700 1 -- 172.21.15.79:0/32216827 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb78800a5f0 con 0x7fb790157250 2023-10-14T18:50:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.618+0000 7fb777fff700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 0x7fb77c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.618+0000 7fb777fff700 1 -- 172.21.15.79:0/32216827 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7880843b0 con 0x7fb790157250 2023-10-14T18:50:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.618+0000 7fb78ffff700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 0x7fb77c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.619+0000 7fb78ffff700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 0x7fb77c0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb780006f00 tx=0x7fb7800091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.620+0000 7fb79f6f7b80 1 Processor -- start 2023-10-14T18:50:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.620+0000 7fb79f6f7b80 1 -- start start 2023-10-14T18:50:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.620+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb4de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.620+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb49cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67faa4a70 con 0x55c67fb97d00 2023-10-14T18:50:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67faa2270 con 0x55c67fb4da50 2023-10-14T18:50:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c67fa9e060 con 0x55c67fb76f60 2023-10-14T18:50:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45772/0 (socket says 172.21.15.79:45772) 2023-10-14T18:50:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3504587859 learned_addr learned my addr 172.21.15.79:0/3504587859 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb4de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb79499b700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb49cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 msgr2=0x55c67fb49cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb49cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 msgr2=0x55c67fb4de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb4de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3504587859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67f938270 con 0x55c67fb97d00 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb4de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e4b0 tx=0x7fb78401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a497c3e3bd1ec048 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb7757fa700 1 -- 172.21.15.79:0/3504587859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784022070 con 0x55c67fb97d00 2023-10-14T18:50:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb7757fa700 1 -- 172.21.15.79:0/3504587859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7840095b0 con 0x55c67fb97d00 2023-10-14T18:50:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.621+0000 7fb7757fa700 1 -- 172.21.15.79:0/3504587859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784006e50 con 0x55c67fb97d00 2023-10-14T18:50:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3504587859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 msgr2=0x55c67fb76a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e4b0 tx=0x7fb78401a000 comp rx=0 tx=0).stop 2023-10-14T18:50:03.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3504587859 shutdown_connections 2023-10-14T18:50:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb49cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb4de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3504587859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb76a20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3504587859 >> 172.21.15.79:0/3504587859 conn(0x55c67fb4f370 msgr2=0x55c67fb4f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3504587859 shutdown_connections 2023-10-14T18:50:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.622+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3504587859 wait complete. 2023-10-14T18:50:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 -- start start 2023-10-14T18:50:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 Processor -- start 2023-10-14T18:50:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb94ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fa49890 con 0x55c67fb97d00 2023-10-14T18:50:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fa64ea0 con 0x55c67fb4da50 2023-10-14T18:50:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c67f920e30 con 0x55c67fb76f60 2023-10-14T18:50:03.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.623+0000 7fb79f6f7b80 10 client.0 _ll_register_callbacks cb 0x55c67fb11110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:50:03.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45786/0 (socket says 172.21.15.79:45786) 2023-10-14T18:50:03.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 -- 172.21.15.79:0/2300512094 learned_addr learned my addr 172.21.15.79:0/2300512094 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb78ffff700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb94ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 -- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 msgr2=0x55c67fb94ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb94ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 -- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 msgr2=0x55c67fb732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 -- 172.21.15.79:0/2300512094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778003570 con 0x55c67fb97d00 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb78ffff700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79499b700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb7880828c0 tx=0x7fb788016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5baa6df0b5b210f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788007a50 con 0x55c67fb97d00 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb788055520 con 0x55c67fb97d00 2023-10-14T18:50:03.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c67fb42b70 con 0x55c67fb97d00 2023-10-14T18:50:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7880547b0 con 0x55c67fb97d00 2023-10-14T18:50:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 10 client.6483 fetch_fsmap learned FSMap version 48 2023-10-14T18:50:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55c67f8dafe0 con 0x55c67fb97d00 2023-10-14T18:50:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c67fb42b70 con 0x55c67fb97d00 2023-10-14T18:50:03.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb78805bdd0 con 0x55c67fb97d00 2023-10-14T18:50:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 10 client.6483 fetch_fsmap finished waiting for FSMap version 48 2023-10-14T18:50:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 10 client.6483 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:50:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 20 client.6483 populate_metadata read hostname 'smithi079' 2023-10-14T18:50:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fba77a0 0x55c67fba7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 4 client.6483 mds_command: new command op to 6348 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:50:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.624+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 --> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c67fb1faa0 con 0x55c67fba77a0 2023-10-14T18:50:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb78ffff700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fba77a0 0x55c67fba7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb76e7fc700 10 client.6483 ms_handle_connect on v2:172.21.15.79:6833/1750729224 2023-10-14T18:50:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb78ffff700 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fba77a0 0x55c67fba7b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f82ec29fab420e4 server_cookie=44ba7774490830a0 in_seq=0 out_seq=0 2023-10-14T18:50:03.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb76e7fc700 1 -- 172.21.15.79:0/2300512094 <== mds.0 v2:172.21.15.79:6833/1750729224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c67fb1faa0 con 0x55c67fba77a0 2023-10-14T18:50:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb76e7fc700 10 client.6483 handle_command_reply: tid=0 2023-10-14T18:50:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.625+0000 7fb79f6f7b80 1 client.6483 shutdown 2023-10-14T18:50:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 msgr2=0x55c67fb8de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb7880828c0 tx=0x7fb788016040 comp rx=0 tx=0).stop 2023-10-14T18:50:03.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 shutdown_connections 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fba77a0 0x55c67fba7b70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb97d00 0x55c67fb8de70 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb76e7fc700 0 client.6483 ms_handle_reset on v2:172.21.15.79:6833/1750729224 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb4da50 0x55c67fb732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/2300512094 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb76f60 0x55c67fb94ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 >> 172.21.15.79:0/2300512094 conn(0x55c67fb4f370 msgr2=0x55c67fb93550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 shutdown_connections 2023-10-14T18:50:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/2300512094 wait complete. 2023-10-14T18:50:03.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.626+0000 7fb79f6f7b80 20 client.6483 trim_cache size 0 max 16384 2023-10-14T18:50:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.642+0000 7fb79f6f7b80 1 Processor -- start 2023-10-14T18:50:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.642+0000 7fb79f6f7b80 1 -- start start 2023-10-14T18:50:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb76f60 0x55c67fb4a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb97d00 0x55c67fb8a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fb4c210 con 0x55c67fb4da50 2023-10-14T18:50:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fb4e7e0 con 0x55c67fb76f60 2023-10-14T18:50:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c67fb26410 con 0x55c67fb97d00 2023-10-14T18:50:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45792/0 (socket says 172.21.15.79:45792) 2023-10-14T18:50:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.643+0000 7fb78ffff700 1 -- 172.21.15.79:0/3198096914 learned_addr learned my addr 172.21.15.79:0/3198096914 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 -- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb97d00 msgr2=0x55c67fb8a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb97d00 0x55c67fb8a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 -- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb76f60 msgr2=0x55c67fb4a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb76f60 0x55c67fb4a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 -- 172.21.15.79:0/3198096914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67fa6c780 con 0x55c67fb4da50 2023-10-14T18:50:03.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55c67fb8ea70 tx=0x7fb780029250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de495a0dca66ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb775ffb700 1 -- 172.21.15.79:0/3198096914 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780028070 con 0x55c67fb4da50 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb775ffb700 1 -- 172.21.15.79:0/3198096914 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780014a50 con 0x55c67fb4da50 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb775ffb700 1 -- 172.21.15.79:0/3198096914 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780014df0 con 0x55c67fb4da50 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3198096914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 msgr2=0x55c67fb94c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.644+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x55c67fb8ea70 tx=0x7fb780029250 comp rx=0 tx=0).stop 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3198096914 shutdown_connections 2023-10-14T18:50:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb97d00 0x55c67fb8a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb4da50 0x55c67fb94c60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3198096914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb76f60 0x55c67fb4a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3198096914 >> 172.21.15.79:0/3198096914 conn(0x55c67fb4f370 msgr2=0x55c67fb8dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3198096914 shutdown_connections 2023-10-14T18:50:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3198096914 wait complete. 2023-10-14T18:50:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 -- start start 2023-10-14T18:50:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.645+0000 7fb79f6f7b80 1 Processor -- start 2023-10-14T18:50:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb4da50 0x55c67fb4ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb97d00 0x55c67fbb6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fbb3840 con 0x55c67fb76f60 2023-10-14T18:50:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67fb72810 con 0x55c67fb97d00 2023-10-14T18:50:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c67fbb1df0 con 0x55c67fb4da50 2023-10-14T18:50:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79f6f7b80 10 client.0 _ll_register_callbacks cb 0x55c67fb11110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:50:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45798/0 (socket says 172.21.15.79:45798) 2023-10-14T18:50:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3870308701 learned_addr learned my addr 172.21.15.79:0/3870308701 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb4da50 0x55c67fb4ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb79499b700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb97d00 0x55c67fbb6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb4da50 msgr2=0x55c67fb4ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb4da50 0x55c67fb4ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb97d00 msgr2=0x55c67fbb6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb97d00 0x55c67fbb6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 -- 172.21.15.79:0/3870308701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb780011e10 con 0x55c67fb76f60 2023-10-14T18:50:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb78f7fe700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb778004700 tx=0x7fb78401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0db3320aa8a21ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.646+0000 7fb76e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:50:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784022040 con 0x55c67fb76f60 2023-10-14T18:50:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb784035020 con 0x55c67fb76f60 2023-10-14T18:50:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c67fb49e70 con 0x55c67fb76f60 2023-10-14T18:50:03.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb78400e710 con 0x55c67fb76f60 2023-10-14T18:50:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 10 client.6489 fetch_fsmap learned FSMap version 48 2023-10-14T18:50:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55c67fa53470 con 0x55c67fb76f60 2023-10-14T18:50:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c67fb49e70 con 0x55c67fb76f60 2023-10-14T18:50:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb784011070 con 0x55c67fb76f60 2023-10-14T18:50:03.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 10 client.6489 fetch_fsmap finished waiting for FSMap version 48 2023-10-14T18:50:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 10 client.6489 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:50:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 20 client.6489 populate_metadata read hostname 'smithi079' 2023-10-14T18:50:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fb980d0 0x55c67fb984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 4 client.6489 mds_command: new command op to 6348 tid=0[{"prefix": "status"}] 2023-10-14T18:50:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 --> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fb7840095b0 con 0x55c67fb980d0 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fb980d0 0x55c67fb984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb78ffff700 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fb980d0 0x55c67fb984a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24d489a16819531 server_cookie=4c49c54acd497be2 in_seq=0 out_seq=0 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.647+0000 7fb76e7fc700 10 client.6489 ms_handle_connect on v2:172.21.15.79:6833/1750729224 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb76e7fc700 1 -- 172.21.15.79:0/3870308701 <== mds.0 v2:172.21.15.79:6833/1750729224 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fb7840095b0 con 0x55c67fb980d0 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb76e7fc700 10 client.6489 handle_command_reply: tid=0 2023-10-14T18:50:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 client.6489 shutdown 2023-10-14T18:50:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 msgr2=0x55c67fb8b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb778004700 tx=0x7fb78401f070 comp rx=0 tx=0).stop 2023-10-14T18:50:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 shutdown_connections 2023-10-14T18:50:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:6833/1750729224,v1:172.21.15.79:6835/1750729224] conn(0x55c67fb980d0 0x55c67fb984a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c67fb97d00 0x55c67fbb6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb76e7fc700 0 client.6489 ms_handle_reset on v2:172.21.15.79:6833/1750729224 2023-10-14T18:50:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55c67fb4da50 0x55c67fb4ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 --2- 172.21.15.79:0/3870308701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c67fb76f60 0x55c67fb8b050 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 >> 172.21.15.79:0/3870308701 conn(0x55c67fb4f370 msgr2=0x55c67fbadba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 shutdown_connections 2023-10-14T18:50:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 1 -- 172.21.15.79:0/3870308701 wait complete. 2023-10-14T18:50:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb79f6f7b80 20 client.6489 trim_cache size 0 max 16384 2023-10-14T18:50:03.676 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:03.676 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:03.677 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:50:03.677 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6348, 2023-10-14T18:50:03.677 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:50:03.677 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:50:03.677 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:50:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.8023894030000003, 2023-10-14T18:50:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 48, 2023-10-14T18:50:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 102, 2023-10-14T18:50:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 102, 2023-10-14T18:50:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 11.778087346 2023-10-14T18:50:03.679 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 msgr2=0x7fb77c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 0x7fb77c0693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb780006f00 tx=0x7fb7800091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 msgr2=0x7fb7900cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb790159220 tx=0x7fb788007be0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 shutdown_connections 2023-10-14T18:50:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb77c066f30 0x7fb77c0693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb790157250 0x7fb7900cb7a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb778004810 0x7fb7900c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 --2- 172.21.15.79:0/32216827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb790167d30 0x7fb7900b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.648+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 >> 172.21.15.79:0/32216827 conn(0x7fb790069870 msgr2=0x7fb790158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.649+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 shutdown_connections 2023-10-14T18:50:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.649+0000 7fb7963fe700 1 -- 172.21.15.79:0/32216827 wait complete. 2023-10-14T18:50:03.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:50:03.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.798+0000 7f721591a700 1 Processor -- start 2023-10-14T18:50:03.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.798+0000 7f721591a700 1 -- start start 2023-10-14T18:50:03.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f721591a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f721015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f721591a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f721015a620 0x7f721015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f721591a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721015cbb0 con 0x7f721015d580 2023-10-14T18:50:03.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f721591a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721015bfa0 con 0x7f721015a620 2023-10-14T18:50:03.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f721591a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721015c280 con 0x7f7210157870 2023-10-14T18:50:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f721015d580 0x7f7210158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45306/0 (socket says 172.21.15.79:45306) 2023-10-14T18:50:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720f7fe700 1 -- 172.21.15.79:0/2914055753 learned_addr learned my addr 172.21.15.79:0/2914055753 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f7207fff700 1 --2- 172.21.15.79:0/2914055753 >> v2:172.21.15.144:3300/0 conn(0x7f721015a620 0x7f721015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720effd700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f721015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976146737 0 0) 0x7f721015cbb0 con 0x7f721015d580 2023-10-14T18:50:03.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc003570 con 0x7f721015d580 2023-10-14T18:50:03.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851326566 0 0) 0x7f71fc003570 con 0x7f721015d580 2023-10-14T18:50:03.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 msgr2=0x7f721015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f721015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 >> v2:172.21.15.144:3300/0 conn(0x7f721015a620 msgr2=0x7f721015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 --2- 172.21.15.79:0/2914055753 >> v2:172.21.15.144:3300/0 conn(0x7f721015a620 0x7f721015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.799+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721015c560 con 0x7f721015d580 2023-10-14T18:50:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f72080017f0 con 0x7f721015d580 2023-10-14T18:50:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 >> v1:172.21.15.79:6789/0 conn(0x7f721015d580 legacy=0x7f7210158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71fc003a60 0x7f71fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc004400 0x7f71fc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f71fc004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721015bfa0 con 0x7f71fc004400 2023-10-14T18:50:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721015c280 con 0x7f71fc003a60 2023-10-14T18:50:03.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc00ba60 con 0x7f7210157870 2023-10-14T18:50:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc004400 0x7f71fc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720effd700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71fc003a60 0x7f71fc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 -- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 msgr2=0x7f71fc004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720f7fe700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f71fc004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f71fc004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 -- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71fc003a60 msgr2=0x7f71fc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71fc003a60 0x7f71fc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 -- 172.21.15.79:0/2914055753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc003570 con 0x7f71fc004400 2023-10-14T18:50:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720f7fe700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210157870 0x7f71fc004f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f720effd700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71fc003a60 0x7f71fc003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.800+0000 7f7207fff700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc004400 0x7f71fc0048b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009c00 tx=0x7f71f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde1d91d35664f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800e710 con 0x7f71fc004400 2023-10-14T18:50:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f800e870 con 0x7f71fc004400 2023-10-14T18:50:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f720e7fc700 1 -- 172.21.15.79:0/2914055753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800ec30 con 0x7f71fc004400 2023-10-14T18:50:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 -- 172.21.15.79:0/2914055753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc004400 msgr2=0x7f71fc0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 --2- 172.21.15.79:0/2914055753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc004400 0x7f71fc0048b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009c00 tx=0x7f71f80091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f720f7fe700 1 -- 172.21.15.79:0/2914055753 reap_dead start 2023-10-14T18:50:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 -- 172.21.15.79:0/2914055753 shutdown_connections 2023-10-14T18:50:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 -- 172.21.15.79:0/2914055753 >> 172.21.15.79:0/2914055753 conn(0x7f7210068ce0 msgr2=0x7f72100690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 -- 172.21.15.79:0/2914055753 shutdown_connections 2023-10-14T18:50:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.801+0000 7f721591a700 1 -- 172.21.15.79:0/2914055753 wait complete. 2023-10-14T18:50:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.802+0000 7f721591a700 1 Processor -- start 2023-10-14T18:50:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.802+0000 7f721591a700 1 -- start start 2023-10-14T18:50:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72100b19c0 0x7f7210155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210155580 0x7f7210153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100b2dd0 con 0x7f7210149940 2023-10-14T18:50:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72101559f0 con 0x7f72100b19c0 2023-10-14T18:50:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f721591a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100b21c0 con 0x7f7210155580 2023-10-14T18:50:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45826/0 (socket says 172.21.15.79:45826) 2023-10-14T18:50:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 -- 172.21.15.79:0/1205555786 learned_addr learned my addr 172.21.15.79:0/1205555786 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 -- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210155580 msgr2=0x7f7210153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210155580 0x7f7210153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 -- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72100b19c0 msgr2=0x7f7210155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72100b19c0 0x7f7210155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:03.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.803+0000 7f720effd700 1 -- 172.21.15.79:0/1205555786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100b24a0 con 0x7f7210149940 2023-10-14T18:50:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f720effd700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7200011910 tx=0x7f7200008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200011eb0 con 0x7f7210149940 2023-10-14T18:50:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720000f8e0 con 0x7f7210149940 2023-10-14T18:50:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000fc80 con 0x7f7210149940 2023-10-14T18:50:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72100b2780 con 0x7f7210149940 2023-10-14T18:50:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.804+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72100b1e30 con 0x7f7210149940 2023-10-14T18:50:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.805+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72100cf3e0 con 0x7f7210149940 2023-10-14T18:50:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.805+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7200015460 con 0x7f7210149940 2023-10-14T18:50:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.805+0000 7f7206ffd700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 0x7f71f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.805+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7200084ca0 con 0x7f7210149940 2023-10-14T18:50:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.805+0000 7f7207fff700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 0x7f71f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.806+0000 7f7207fff700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 0x7f71f00693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f721016dd60 tx=0x7f71f801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:03.810+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7200051f10 con 0x7f7210149940 2023-10-14T18:50:04.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.035+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f721004c3c0 con 0x7f7210149940 2023-10-14T18:50:04.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.035+0000 7f7206ffd700 1 -- 172.21.15.79:0/1205555786 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7200055530 con 0x7f7210149940 2023-10-14T18:50:04.036 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:50:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 msgr2=0x7f71f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 0x7f71f00693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f721016dd60 tx=0x7f71f801a000 comp rx=0 tx=0).stop 2023-10-14T18:50:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 msgr2=0x7f72100d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7200011910 tx=0x7f7200008040 comp rx=0 tx=0).stop 2023-10-14T18:50:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 shutdown_connections 2023-10-14T18:50:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f71f0066f30 0x7f71f00693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7210155580 0x7f7210153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7210149940 0x7f72100d1190 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 --2- 172.21.15.79:0/1205555786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72100b19c0 0x7f7210155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 >> 172.21.15.79:0/1205555786 conn(0x7f7210068ce0 msgr2=0x7f721014c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 shutdown_connections 2023-10-14T18:50:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.037+0000 7f721591a700 1 -- 172.21.15.79:0/1205555786 wait complete. 2023-10-14T18:50:04.050 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:50:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:50:04.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:50:04.051 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:50:04.052 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:04.052 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:50:04.052 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:50:04.053 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:50:04.053 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:04.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.054 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:50:04.070 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:50:04.070 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:50:04.070 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:50:04.070 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.071 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:50:04.071 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.071 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:04.071 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:04.071 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:50:04.072 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:04.072 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:04.072 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:50:04.072 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:04.072 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:04.073 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:50:04.073 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:04.073 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:50:04.073 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42230sec preferred_lft 42230sec 2023-10-14T18:50:04.073 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:50:04.074 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.074 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:50:04.074 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:04.074 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:50:04.074 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.075 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:50:04.075 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.075 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:04.075 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:50:04.075 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:50:04.076 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.076 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:04.076 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:50:04.076 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:50:04.076 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:04.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.077 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:50:04.133 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:50:04.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.135 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:50:04.190 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:50:04.191 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:50:04.191 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:50:04.191 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:50:04.191 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:50:04.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.192 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:50:04.193 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:50:04.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:50:04.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:50:04.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:50:04.194 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:50:04.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.290 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:50:04.305 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:50:04.305 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:50:04.306 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:04.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:50:04.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:04.370 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:04.425 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:04.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:04.426 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:04.479 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:50:04.480 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:50:04.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:04.558 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:04.559 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:04.559 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:04.567 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:04.567 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:04.568 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:04.568 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:04.568 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:04.589 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:04.590 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:04.590 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:04.590 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:04.590 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:04.591 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:50:04.591 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:50:04.591 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:50:04.592 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:50:04.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:04.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:04.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:50:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.810+0000 7fccde300700 1 Processor -- start 2023-10-14T18:50:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.810+0000 7fccde300700 1 -- start start 2023-10-14T18:50:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccde300700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccd8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccde300700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd815cbb0 con 0x7fccd8157870 2023-10-14T18:50:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccde300700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd815bfa0 con 0x7fccd815a620 2023-10-14T18:50:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccde300700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd815bdb0 con 0x7fccd8157c40 2023-10-14T18:50:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccd7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fccd8157870 0x7fccd815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:45316/0 (socket says 172.21.15.79:45316) 2023-10-14T18:50:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccd7fff700 1 -- 172.21.15.79:0/2690654860 learned_addr learned my addr 172.21.15.79:0/2690654860 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738933641 0 0) 0x7fccd815cbb0 con 0x7fccd8157870 2023-10-14T18:50:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc0003570 con 0x7fccd8157870 2023-10-14T18:50:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.811+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccd8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2625161382 0 0) 0x7fccc0003570 con 0x7fccd8157870 2023-10-14T18:50:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 msgr2=0x7fccd8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccd8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 >> v1:172.21.15.144:6789/0 conn(0x7fccd815a620 legacy=0x7fccd815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd815c280 con 0x7fccd8157870 2023-10-14T18:50:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fccc8001470 con 0x7fccd8157870 2023-10-14T18:50:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccd8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 >> v1:172.21.15.79:6789/0 conn(0x7fccd8157870 legacy=0x7fccd815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccc0003a90 0x7fccc0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc000bc40 con 0x7fccc0004d50 2023-10-14T18:50:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc000bd80 con 0x7fccc0003a90 2023-10-14T18:50:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc000bf40 con 0x7fccd8157c40 2023-10-14T18:50:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd7fff700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccc0003a90 0x7fccc0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd77fe700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 -- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 msgr2=0x7fccc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd8157c40 0x7fccc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 -- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccc0003a90 msgr2=0x7fccc0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccc0003a90 0x7fccc0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 -- 172.21.15.79:0/2690654860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0003570 con 0x7fccc0004d50 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccdc89d700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccc00051c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccd0007550 tx=0x7fccd00097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f00e991ae0f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0009ae0 con 0x7fccc0004d50 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0007da0 con 0x7fccc0004d50 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.812+0000 7fccd6ffd700 1 -- 172.21.15.79:0/2690654860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0014630 con 0x7fccc0004d50 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 -- 172.21.15.79:0/2690654860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 msgr2=0x7fccc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 --2- 172.21.15.79:0/2690654860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccc00051c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fccd0007550 tx=0x7fccd00097d0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccdc89d700 1 -- 172.21.15.79:0/2690654860 reap_dead start 2023-10-14T18:50:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 -- 172.21.15.79:0/2690654860 shutdown_connections 2023-10-14T18:50:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 -- 172.21.15.79:0/2690654860 >> 172.21.15.79:0/2690654860 conn(0x7fccd8068ce0 msgr2=0x7fccd80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 -- 172.21.15.79:0/2690654860 shutdown_connections 2023-10-14T18:50:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.813+0000 7fccde300700 1 -- 172.21.15.79:0/2690654860 wait complete. 2023-10-14T18:50:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.814+0000 7fccde300700 1 Processor -- start 2023-10-14T18:50:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.814+0000 7fccde300700 1 -- start start 2023-10-14T18:50:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 0x7fccd8148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd80c7220 0x7fccd80c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c7c00 con 0x7fccc0004d50 2023-10-14T18:50:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd815e410 con 0x7fccd815dcb0 2023-10-14T18:50:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccde300700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd815e6f0 con 0x7fccd80c7220 2023-10-14T18:50:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45848/0 (socket says 172.21.15.79:45848) 2023-10-14T18:50:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 -- 172.21.15.79:0/848736039 learned_addr learned my addr 172.21.15.79:0/848736039 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccdc89d700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd80c7220 0x7fccd80c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd77fe700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 0x7fccd8148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 -- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd80c7220 msgr2=0x7fccd80c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd80c7220 0x7fccd80c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 -- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 msgr2=0x7fccd8148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 0x7fccd8148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 -- 172.21.15.79:0/848736039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd815e9d0 con 0x7fccc0004d50 2023-10-14T18:50:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd77fe700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 0x7fccd8148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.815+0000 7fccd7fff700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fccc80073c0 tx=0x7fccc8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.816+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8018030 con 0x7fccc0004d50 2023-10-14T18:50:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.816+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc800f8d0 con 0x7fccc0004d50 2023-10-14T18:50:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.816+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd815ecb0 con 0x7fccc0004d50 2023-10-14T18:50:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.816+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc800fc90 con 0x7fccc0004d50 2023-10-14T18:50:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.816+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd815e120 con 0x7fccc0004d50 2023-10-14T18:50:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.817+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd804c3c0 con 0x7fccc0004d50 2023-10-14T18:50:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.817+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccc801b070 con 0x7fccc0004d50 2023-10-14T18:50:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.817+0000 7fccbffff700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 0x7fccc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.817+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fccc8019070 con 0x7fccc0004d50 2023-10-14T18:50:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.818+0000 7fccd77fe700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 0x7fccc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.818+0000 7fccd77fe700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 0x7fccc40693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c7130 tx=0x7fcccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:04.821+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccc80516c0 con 0x7fccc0004d50 2023-10-14T18:50:05.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.048+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fccd815c560 con 0x7fccc0004d50 2023-10-14T18:50:05.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.048+0000 7fccbffff700 1 -- 172.21.15.79:0/848736039 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fccc8054ce0 con 0x7fccc0004d50 2023-10-14T18:50:05.049 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:50:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 msgr2=0x7fccc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 0x7fccc40693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c7130 tx=0x7fcccc009040 comp rx=0 tx=0).stop 2023-10-14T18:50:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 msgr2=0x7fccd81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fccc80073c0 tx=0x7fccc8001e50 comp rx=0 tx=0).stop 2023-10-14T18:50:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 shutdown_connections 2023-10-14T18:50:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fccc4066f30 0x7fccc40693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccd80c7220 0x7fccd80c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccc0004d50 0x7fccd81608f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 --2- 172.21.15.79:0/848736039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd815dcb0 0x7fccd8148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 >> 172.21.15.79:0/848736039 conn(0x7fccd8068ce0 msgr2=0x7fccd80d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 shutdown_connections 2023-10-14T18:50:05.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.050+0000 7fccde300700 1 -- 172.21.15.79:0/848736039 wait complete. 2023-10-14T18:50:05.062 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:50:05.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:50:05.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:50:05.064 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:50:05.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:05.064 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:50:05.065 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:50:05.065 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:50:05.065 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:05.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.066 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:50:05.085 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:50:05.086 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:50:05.086 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:50:05.086 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.086 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:50:05.087 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.087 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:05.087 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:05.087 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:50:05.087 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:05.088 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:05.088 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:50:05.088 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:05.088 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:05.088 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:50:05.089 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:05.089 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:50:05.089 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42221sec preferred_lft 42221sec 2023-10-14T18:50:05.089 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:50:05.089 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.090 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:50:05.090 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:05.090 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:50:05.090 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.090 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.091 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:05.092 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:50:05.092 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:50:05.092 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:05.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.093 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:50:05.155 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:50:05.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.157 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:50:05.216 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:50:05.217 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:50:05.217 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:50:05.217 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:50:05.217 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:50:05.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.218 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:50:05.219 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:50:05.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:50:05.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:50:05.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:50:05.220 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:50:05.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.323 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:50:05.338 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:50:05.339 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:50:05.339 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:05.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:50:05.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:05.404 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:05.458 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:05.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:05.459 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:05.513 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:50:05.513 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:50:05.513 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:05.593 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:05.593 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:05.593 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:05.601 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:05.601 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:05.602 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:05.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:05.602 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:05.623 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:05.623 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:05.624 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:05.624 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:05.624 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:05.624 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:50:05.624 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:50:05.625 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:50:05.626 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:50:05.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:05.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:05.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.804+0000 7f483c445700 1 Processor -- start 2023-10-14T18:50:05.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.804+0000 7f483c445700 1 -- start start 2023-10-14T18:50:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483c445700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48341577d0 0x7f48340cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483c445700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f483415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483c445700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483415c360 con 0x7f4834157ba0 2023-10-14T18:50:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483c445700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483415b790 con 0x7f48341577d0 2023-10-14T18:50:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483c445700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483415ba30 con 0x7f483406ac30 2023-10-14T18:50:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483a1e1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48341577d0 0x7f48340cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483a1e1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f48341577d0 0x7f48340cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45856/0 (socket says 172.21.15.79:45856) 2023-10-14T18:50:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483a1e1700 1 -- 172.21.15.79:0/1853692240 learned_addr learned my addr 172.21.15.79:0/1853692240 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.805+0000 7f483a9e2700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f483415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483a1e1700 1 -- 172.21.15.79:0/1853692240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 msgr2=0x7f483415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483a1e1700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f483415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483a1e1700 1 -- 172.21.15.79:0/1853692240 >> v1:172.21.15.144:6789/0 conn(0x7f4834157ba0 legacy=0x7f483406a520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T18:50:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483a1e1700 1 -- 172.21.15.79:0/1853692240 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483415bd10 con 0x7f48341577d0 2023-10-14T18:50:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483a1e1700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48341577d0 0x7f48340cd770 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4830009f20 tx=0x7f4830009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5dd4cbf5074c2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f48391df700 1 -- 172.21.15.79:0/1853692240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483000e070 con 0x7f48341577d0 2023-10-14T18:50:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f48391df700 1 -- 172.21.15.79:0/1853692240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483000b990 con 0x7f48341577d0 2023-10-14T18:50:05.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f48391df700 1 -- 172.21.15.79:0/1853692240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300092e0 con 0x7f48341577d0 2023-10-14T18:50:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483c445700 1 -- 172.21.15.79:0/1853692240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48341577d0 msgr2=0x7f48340cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.806+0000 7f483c445700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48341577d0 0x7f48340cd770 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4830009f20 tx=0x7f4830009840 comp rx=0 tx=0).stop 2023-10-14T18:50:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 -- 172.21.15.79:0/1853692240 shutdown_connections 2023-10-14T18:50:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f483415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 --2- 172.21.15.79:0/1853692240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48341577d0 0x7f48340cd770 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 -- 172.21.15.79:0/1853692240 >> 172.21.15.79:0/1853692240 conn(0x7f4834068ce0 msgr2=0x7f48340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 -- 172.21.15.79:0/1853692240 shutdown_connections 2023-10-14T18:50:05.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.807+0000 7f483c445700 1 -- 172.21.15.79:0/1853692240 wait complete. 2023-10-14T18:50:05.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 Processor -- start 2023-10-14T18:50:05.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 -- start start 2023-10-14T18:50:05.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f48341505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48341577d0 0x7f483414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834150e00 con 0x7f4834157ba0 2023-10-14T18:50:05.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48341524f0 con 0x7f48341577d0 2023-10-14T18:50:05.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483c445700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4834151c00 con 0x7f483406ac30 2023-10-14T18:50:05.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.808+0000 7f483a9e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45870/0 (socket says 172.21.15.79:45870) 2023-10-14T18:50:05.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 -- 172.21.15.79:0/4222802420 learned_addr learned my addr 172.21.15.79:0/4222802420 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:05.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a1e1700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f48341505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f48399e0700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48341577d0 0x7f483414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 -- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 msgr2=0x7f48341505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:05.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f48341505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 -- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48341577d0 msgr2=0x7f483414db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:05.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48341577d0 0x7f483414db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:05.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 -- 172.21.15.79:0/4222802420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830009ae0 con 0x7f4834157ba0 2023-10-14T18:50:05.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483a9e2700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f482c00ea50 tx=0x7f482c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:05.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00ee90 con 0x7f4834157ba0 2023-10-14T18:50:05.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00c880 con 0x7f4834157ba0 2023-10-14T18:50:05.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483416a0f0 con 0x7f4834157ba0 2023-10-14T18:50:05.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00cc40 con 0x7f4834157ba0 2023-10-14T18:50:05.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.809+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4834152180 con 0x7f4834157ba0 2023-10-14T18:50:05.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.810+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483404c3c0 con 0x7f4834157ba0 2023-10-14T18:50:05.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.810+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f482c013470 con 0x7f4834157ba0 2023-10-14T18:50:05.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.811+0000 7f482a7fc700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 0x7f48180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:05.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.811+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f482c0847a0 con 0x7f4834157ba0 2023-10-14T18:50:05.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.811+0000 7f483a1e1700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 0x7f48180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:05.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.811+0000 7f483a1e1700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 0x7f48180693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4830009880 tx=0x7f4830017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:05.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:05.815+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f482c051a10 con 0x7f4834157ba0 2023-10-14T18:50:06.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.039+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f483415bff0 con 0x7f4834157ba0 2023-10-14T18:50:06.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.040+0000 7f482a7fc700 1 -- 172.21.15.79:0/4222802420 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f482c055030 con 0x7f4834157ba0 2023-10-14T18:50:06.041 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:06.041 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 msgr2=0x7f48180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 0x7f48180693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4830009880 tx=0x7f4830017000 comp rx=0 tx=0).stop 2023-10-14T18:50:06.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 msgr2=0x7f48340d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f482c00ea50 tx=0x7f482c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 shutdown_connections 2023-10-14T18:50:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4818066f30 0x7f48180693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4834157ba0 0x7f48340d0510 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:06.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f483406ac30 0x7f48341505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 --2- 172.21.15.79:0/4222802420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48341577d0 0x7f483414db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 >> 172.21.15.79:0/4222802420 conn(0x7f4834068ce0 msgr2=0x7f4834156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 shutdown_connections 2023-10-14T18:50:06.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:06.042+0000 7f483c445700 1 -- 172.21.15.79:0/4222802420 wait complete. 2023-10-14T18:50:06.046 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:06.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:50:06.188 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":6348,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3320215970000007,"mdsmap_epoch":48,"osdmap_epoch":102,"osdmap_epoch_barrier":102,"uptime":14.307720290000001} 2023-10-14T18:50:06.188 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 6348, "mdsmap_epoch": 48, "osdmap_epoch": 102, "osdmap_epoch_barrier": 102, "rank_uptime": 8.332021597, "state": "up:active", "uptime": 14.30772029, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:50:06.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:50:06.318 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:50:06.318 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:50:06.319 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-14T18:50:06.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:06.319 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-14T18:50:07.671 INFO:teuthology.orchestra.run.smithi079.stderr:265+0 records in 2023-10-14T18:50:07.671 INFO:teuthology.orchestra.run.smithi079.stderr:265+0 records out 2023-10-14T18:50:07.671 INFO:teuthology.orchestra.run.smithi079.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.33337 s, 208 MB/s 2023-10-14T18:50:07.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:07.672 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-14T18:50:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:292+0 records in 2023-10-14T18:50:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:292+0 records out 2023-10-14T18:50:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.48906 s, 206 MB/s 2023-10-14T18:50:09.179 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-14T18:50:09.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:09.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.293+0000 7f230a455700 1 Processor -- start 2023-10-14T18:50:09.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.293+0000 7f230a455700 1 -- start start 2023-10-14T18:50:09.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f230a455700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f23040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f230a455700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23040cdab0 0x7f230415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f230a455700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23040cb7c0 con 0x7f230415dda0 2023-10-14T18:50:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f230a455700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230415e850 con 0x7f23040cdab0 2023-10-14T18:50:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f230a455700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040cd030 con 0x7f23040cd6e0 2023-10-14T18:50:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f2309c54700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f230415dda0 0x7f230415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41148/0 (socket says 172.21.15.79:41148) 2023-10-14T18:50:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f2309c54700 1 -- 172.21.15.79:0/984150942 learned_addr learned my addr 172.21.15.79:0/984150942 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f2309453700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f23040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f2308c52700 1 --2- 172.21.15.79:0/984150942 >> v2:172.21.15.144:3300/0 conn(0x7f23040cdab0 0x7f230415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455065935 0 0) 0x7f23040cb7c0 con 0x7f230415dda0 2023-10-14T18:50:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.294+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f0003570 con 0x7f230415dda0 2023-10-14T18:50:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2308c52700 1 -- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 msgr2=0x7f23040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:09.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2308c52700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f23040cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2308c52700 1 -- 172.21.15.79:0/984150942 >> v1:172.21.15.79:6789/0 conn(0x7f230415dda0 legacy=0x7f230415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 300510659 0 0) 0x7f22f0003570 con 0x7f230415dda0 2023-10-14T18:50:09.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2308c52700 1 -- 172.21.15.79:0/984150942 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230415e290 con 0x7f23040cdab0 2023-10-14T18:50:09.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2309453700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f23040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:09.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f2308c52700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f230415d860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f22f40098e0 tx=0x7f22f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d19f33810f85277 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:09.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300001470 con 0x7f23040cdab0 2023-10-14T18:50:09.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f4011420 con 0x7f23040cdab0 2023-10-14T18:50:09.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f22fbfff700 1 -- 172.21.15.79:0/984150942 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f40117c0 con 0x7f23040cdab0 2023-10-14T18:50:09.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 -- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 msgr2=0x7f230415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f230415d860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f22f40098e0 tx=0x7f22f40091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 -- 172.21.15.79:0/984150942 shutdown_connections 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f23040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 --2- 172.21.15.79:0/984150942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f230415d860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.295+0000 7f230a455700 1 -- 172.21.15.79:0/984150942 >> 172.21.15.79:0/984150942 conn(0x7f2304067660 msgr2=0x7f2304067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:09.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.296+0000 7f230a455700 1 -- 172.21.15.79:0/984150942 shutdown_connections 2023-10-14T18:50:09.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.296+0000 7f230a455700 1 -- 172.21.15.79:0/984150942 wait complete. 2023-10-14T18:50:09.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 Processor -- start 2023-10-14T18:50:09.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 -- start start 2023-10-14T18:50:09.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f230416a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f23040c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040b3a10 con 0x7f230415dda0 2023-10-14T18:50:09.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230416a900 con 0x7f23040cdab0 2023-10-14T18:50:09.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.297+0000 7f230a455700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230416abe0 con 0x7f23040cd6e0 2023-10-14T18:50:09.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36138/0 (socket says 172.21.15.79:36138) 2023-10-14T18:50:09.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 -- 172.21.15.79:0/3943968230 learned_addr learned my addr 172.21.15.79:0/3943968230 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:09.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2308c52700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f23040c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309453700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f230416a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 -- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 msgr2=0x7f230416a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f230416a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 -- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 msgr2=0x7f23040c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f23040c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 -- 172.21.15.79:0/3943968230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc009a20 con 0x7f230415dda0 2023-10-14T18:50:09.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309453700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f230416a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:09.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f2309c54700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f230000cb90 tx=0x7f2300001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:09.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300001d30 con 0x7f230415dda0 2023-10-14T18:50:09.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300007360 con 0x7f230415dda0 2023-10-14T18:50:09.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300007700 con 0x7f230415dda0 2023-10-14T18:50:09.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f4009420 con 0x7f230415dda0 2023-10-14T18:50:09.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.298+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230416b1a0 con 0x7f230415dda0 2023-10-14T18:50:09.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.299+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040b3b80 con 0x7f230415dda0 2023-10-14T18:50:09.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.299+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2300004a40 con 0x7f230415dda0 2023-10-14T18:50:09.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.300+0000 7f22f97fa700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 0x7f22e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:09.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.300+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2300083dd0 con 0x7f230415dda0 2023-10-14T18:50:09.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.300+0000 7f2309453700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 0x7f22e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:09.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.300+0000 7f2309453700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 0x7f22e8069410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009fd0 tx=0x7f22fc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:09.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.304+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23000510c0 con 0x7f230415dda0 2023-10-14T18:50:09.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.488+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f230415e570 con 0x7f230415dda0 2023-10-14T18:50:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.489+0000 7f22f97fa700 1 -- 172.21.15.79:0/3943968230 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+32274 (secure 0 0 0) 0x7f2300018020 con 0x7f230415dda0 2023-10-14T18:50:09.490 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:09.490 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:09.490 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 102, 2023-10-14T18:50:09.490 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:09.490 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:09.491 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:49:58.521166+0000", 2023-10-14T18:50:09.491 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:09.491 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:09.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:09.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:09.492 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:09.492 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:09.492 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:09.492 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:09.492 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:09.493 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:09.493 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:09.493 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:09.493 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:09.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:09.495 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:09.495 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:09.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.495 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:09.495 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:09.496 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:09.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:09.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:09.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:09.496 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:09.497 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:09.497 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:09.497 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:09.497 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:09.497 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:09.498 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:09.498 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:09.498 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:09.498 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:09.498 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:09.499 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:09.500 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:09.500 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:09.500 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:09.500 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:09.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.501 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "93", 2023-10-14T18:50:09.501 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:09.501 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:09.501 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:09.501 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:09.502 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:09.502 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:09.502 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:09.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:09.502 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:09.503 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:09.504 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:09.505 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:09.505 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:09.505 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:09.505 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:09.505 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:09.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:09.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.506 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:09.506 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:09.506 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:09.507 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:09.507 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:09.507 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:09.507 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:09.507 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:09.508 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:09.508 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:09.508 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:09.508 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:09.508 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.510 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:09.510 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:09.510 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:09.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:09.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:09.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:09.511 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:09.511 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:09.511 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:09.512 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:09.512 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:09.512 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:09.512 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:09.512 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:09.513 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:09.513 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:09.513 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:09.513 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:09.513 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:09.514 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:09.514 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:09.514 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:09.514 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:09.514 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:09.515 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:09.515 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:09.515 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:09.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.515 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "101", 2023-10-14T18:50:09.516 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:09.516 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:09.516 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:09.516 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:09.516 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:09.517 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:09.517 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:09.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:09.517 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:09.517 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:09.518 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:09.519 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:09.519 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:09.519 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:09.519 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:09.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:09.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.521 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:09.521 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:09.521 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:09.521 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:09.522 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:09.522 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:09.522 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:09.522 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:09.522 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:09.523 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:09.523 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:09.523 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:09.523 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:09.523 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:09.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:09.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:09.526 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:09.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:09.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:09.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:09.526 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:09.527 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:09.527 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:09.527 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:09.527 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:09.527 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:09.528 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:09.528 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:09.528 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:09.528 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:09.528 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:09.529 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:09.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:09.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:09.530 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:09.530 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:09.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "102", 2023-10-14T18:50:09.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:09.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:09.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:09.531 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:09.532 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:09.532 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:09.532 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:09.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:09.532 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:09.533 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:09.534 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:09.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:09.534 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:09.534 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:09.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:09.535 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:09.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:09.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.536 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:09.536 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:09.536 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:09.537 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:09.537 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:09.537 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:09.537 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:09.537 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:09.538 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:09.538 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:09.538 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:09.538 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:09.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:09.539 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:09.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.539 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:09.539 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:09.539 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:09.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.541 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:09.541 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.541 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.541 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.541 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.542 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.542 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.542 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.542 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.542 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:09.544 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.546 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:09.547 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:09.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.548 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.548 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:09.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.551 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:09.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.554 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:09.554 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:09.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:09.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:09.554 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.555 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.555 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.555 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.556 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:09.556 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.556 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.556 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.556 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.557 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.557 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.557 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:09.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:09.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:09.562 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:09.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:09.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:09.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.569 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:09.569 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:09.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:09.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:09.569 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.570 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.571 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:09.571 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.571 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.571 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.571 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.572 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.573 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.573 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:09.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.575 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:09.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.578 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:09.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:09.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:09.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:09.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.583 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.584 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.585 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:09.585 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.586 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.586 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.586 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.586 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.587 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.587 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.587 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.587 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.587 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:09.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:09.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.593 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:09.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:09.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:09.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:09.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:09.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.598 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.599 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.600 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:09.600 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.601 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.602 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.602 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.602 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.602 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.602 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:09.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.605 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:09.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.608 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:09.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:09.610 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.610 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:09.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:09.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.613 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:09.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:09.614 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:09.614 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:09.614 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.614 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.614 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.615 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:09.615 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.616 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.616 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.616 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.617 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.617 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.617 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.617 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.617 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.618 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:09.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:09.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:09.622 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.623 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:09.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:09.627 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:09.628 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:09.629 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:09.629 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:09.629 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.629 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.629 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.630 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:09.630 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.631 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.631 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.631 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.631 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.632 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.633 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.633 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:09.633 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:09.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.635 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:09.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.639 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:09.639 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.640 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:09.640 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:09.641 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:09.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:09.645 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:09.646 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:09.647 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:09.647 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:09.647 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:09.647 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:09.647 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:09.649 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:09.650 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.652 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:09.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.653 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:09.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:09.654 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.654 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:09.655 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.655 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:09.656 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:09.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:09.656 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:09.656 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:09.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:09.657 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:09.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.658 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:09.658 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:09.659 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:09.659 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:09.659 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:09.659 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:09.659 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:09.661 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.661 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.661 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.661 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.661 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:09.662 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.663 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.663 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.663 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.663 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.663 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:09.664 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:09.664 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.665 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.665 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.665 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.665 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:09.666 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.666 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:09.666 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:09.667 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.668 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:09.668 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.668 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.670 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:09.670 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.670 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.670 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.671 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.671 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.671 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:09.671 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.672 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.673 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.673 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:09.673 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:09.674 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:09.674 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:09.674 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:09.674 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:09.674 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:09.675 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:09.675 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:09.675 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:09.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.675 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:09.676 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:09.676 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:09.676 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:09.676 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:09.676 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:09.677 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:09.677 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:09.677 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:09.677 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:09.677 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:09.678 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:09.679 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:09.679 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:09.679 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:09.679 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:09.679 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:09.680 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:09.680 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:09.680 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:09.680 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:09.680 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:09.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:09.681 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:09.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.490+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 msgr2=0x7f22e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.490+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 0x7f22e8069410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009fd0 tx=0x7f22fc00b040 comp rx=0 tx=0).stop 2023-10-14T18:50:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.490+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 msgr2=0x7f23040c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.490+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f230000cb90 tx=0x7f2300001aa0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 shutdown_connections 2023-10-14T18:50:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f22e8066f60 0x7f22e8069410 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f230415dda0 0x7f23040c8c60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23040cd6e0 0x7f230416a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 --2- 172.21.15.79:0/3943968230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23040cdab0 0x7f23040c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:09.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 >> 172.21.15.79:0/3943968230 conn(0x7f2304067660 msgr2=0x7f230415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:09.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 shutdown_connections 2023-10-14T18:50:09.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:09.491+0000 7f230a455700 1 -- 172.21.15.79:0/3943968230 wait complete. 2023-10-14T18:50:09.686 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:50:09.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:10.536 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:50:10.536+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-14T18:50:14.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.814+0000 7f957df8c700 1 Processor -- start 2023-10-14T18:50:14.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.814+0000 7f957df8c700 1 -- start start 2023-10-14T18:50:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957df8c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 0x7f95780cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957df8c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95780cdab0 0x7f957815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957df8c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95780cb7c0 con 0x7f957815dda0 2023-10-14T18:50:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957df8c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957815e850 con 0x7f95780cdab0 2023-10-14T18:50:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957df8c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95780cd030 con 0x7f95780cd6e0 2023-10-14T18:50:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95780cdab0 0x7f957815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:14.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957d78b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f957815dda0 0x7f957815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41156/0 (socket says 172.21.15.79:41156) 2023-10-14T18:50:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957d78b700 1 -- 172.21.15.79:0/641347196 learned_addr learned my addr 172.21.15.79:0/641347196 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957cf8a700 1 --2- 172.21.15.79:0/641347196 >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 0x7f95780cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 -- 172.21.15.79:0/641347196 >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 msgr2=0x7f95780cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 --2- 172.21.15.79:0/641347196 >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 0x7f95780cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 -- 172.21.15.79:0/641347196 >> v1:172.21.15.79:6789/0 conn(0x7f957815dda0 legacy=0x7f957815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 -- 172.21.15.79:0/641347196 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957815e290 con 0x7f95780cdab0 2023-10-14T18:50:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f957cf8a700 1 --2- 172.21.15.79:0/641347196 >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 0x7f95780cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f95777fe700 1 -- 172.21.15.79:0/641347196 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462444211 0 0) 0x7f95780cb7c0 con 0x7f957815dda0 2023-10-14T18:50:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.815+0000 7f9577fff700 1 --2- 172.21.15.79:0/641347196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957815d860 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f957806b730 tx=0x7f95640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80df7fcf9f383d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:14.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f95777fe700 1 -- 172.21.15.79:0/641347196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400b6b0 con 0x7f95780cdab0 2023-10-14T18:50:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f95777fe700 1 -- 172.21.15.79:0/641347196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956400b810 con 0x7f95780cdab0 2023-10-14T18:50:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f95777fe700 1 -- 172.21.15.79:0/641347196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956400bbb0 con 0x7f95780cdab0 2023-10-14T18:50:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 -- 172.21.15.79:0/641347196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 msgr2=0x7f957815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 --2- 172.21.15.79:0/641347196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957815d860 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f957806b730 tx=0x7f95640091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 -- 172.21.15.79:0/641347196 shutdown_connections 2023-10-14T18:50:14.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 --2- 172.21.15.79:0/641347196 >> v2:172.21.15.144:3300/0 conn(0x7f95780cd6e0 0x7f95780cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 --2- 172.21.15.79:0/641347196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957815d860 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 -- 172.21.15.79:0/641347196 >> 172.21.15.79:0/641347196 conn(0x7f9578067660 msgr2=0x7f9578067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:14.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 -- 172.21.15.79:0/641347196 shutdown_connections 2023-10-14T18:50:14.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.816+0000 7f957df8c700 1 -- 172.21.15.79:0/641347196 wait complete. 2023-10-14T18:50:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.817+0000 7f957df8c700 1 Processor -- start 2023-10-14T18:50:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 -- start start 2023-10-14T18:50:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95780cd6e0 0x7f95780b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f957815dda0 0x7f957815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780b4c00 con 0x7f95780cdab0 2023-10-14T18:50:14.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957814e690 con 0x7f957815dda0 2023-10-14T18:50:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f957df8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780c7ec0 con 0x7f95780cd6e0 2023-10-14T18:50:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f9577fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f9577fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36160/0 (socket says 172.21.15.79:36160) 2023-10-14T18:50:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.818+0000 7f9577fff700 1 -- 172.21.15.79:0/346282778 learned_addr learned my addr 172.21.15.79:0/346282778 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f957cf8a700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95780cd6e0 0x7f95780b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 -- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95780cd6e0 msgr2=0x7f95780b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95780cd6e0 0x7f95780b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 -- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f957815dda0 msgr2=0x7f957815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f957815dda0 0x7f957815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:14.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564009420 con 0x7f95780cdab0 2023-10-14T18:50:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9577fff700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f95780c7b10 tx=0x7f9564017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011420 con 0x7f95780cdab0 2023-10-14T18:50:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9564011580 con 0x7f95780cdab0 2023-10-14T18:50:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780c81a0 con 0x7f95780cdab0 2023-10-14T18:50:14.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564011920 con 0x7f95780cdab0 2023-10-14T18:50:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.819+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780c8760 con 0x7f95780cdab0 2023-10-14T18:50:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.820+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95780c8950 con 0x7f95780cdab0 2023-10-14T18:50:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.820+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9564011d10 con 0x7f95780cdab0 2023-10-14T18:50:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.821+0000 7f9574ff9700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 0x7f955c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:14.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.821+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95640861a0 con 0x7f95780cdab0 2023-10-14T18:50:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.821+0000 7f957cf8a700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 0x7f955c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.821+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f955c06ea50 con 0x7f95780cdab0 2023-10-14T18:50:14.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.821+0000 7f957cf8a700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 0x7f955c0693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f956c0089b0 tx=0x7f956c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:14.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:14.825+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9564053490 con 0x7f95780cdab0 2023-10-14T18:50:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.007+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f957815e570 con 0x7f95780cdab0 2023-10-14T18:50:15.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.008+0000 7f9574ff9700 1 -- 172.21.15.79:0/346282778 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32442 (secure 0 0 0) 0x7f9564015070 con 0x7f95780cdab0 2023-10-14T18:50:15.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:15.010 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 106, 2023-10-14T18:50:15.010 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:15.010 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:15.011 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:14.600381+0000", 2023-10-14T18:50:15.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:15.011 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:15.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:15.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:15.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:15.012 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:15.012 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:15.012 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:15.012 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:15.013 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.013 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:15.013 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:15.013 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:15.013 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:15.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:15.015 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:15.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:15.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:15.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:15.016 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:15.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.017 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.017 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.017 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.017 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.017 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:15.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:15.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:15.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:15.019 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:15.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:15.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.115 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:15.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:15.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.118 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:15.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.120 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:15.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:15.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.123 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:15.123 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.124 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:15.125 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.126 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.126 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.126 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.126 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.126 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.130 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:15.131 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:15.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.136 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:15.137 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.141 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:15.141 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.141 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.141 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.141 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.142 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.142 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.142 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.142 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.142 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.143 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.143 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.143 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:15.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.146 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:15.147 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:15.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.148 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:15.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:15.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:15.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:15.153 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.154 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:15.154 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:15.154 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:15.154 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:15.155 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.155 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.155 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.156 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.157 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.157 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.157 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.157 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.157 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.158 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.158 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.158 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.159 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:15.159 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:15.160 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.161 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:15.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:15.163 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.163 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.164 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:15.165 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:50:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.208 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.010+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 msgr2=0x7f955c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 0x7f955c0693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f956c0089b0 tx=0x7f956c008040 comp rx=0 tx=0).stop 2023-10-14T18:50:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 msgr2=0x7f957814c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f95780c7b10 tx=0x7f9564017000 comp rx=0 tx=0).stop 2023-10-14T18:50:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 shutdown_connections 2023-10-14T18:50:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f955c066f30 0x7f955c0693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f957815dda0 0x7f957815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95780cd6e0 0x7f95780b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 --2- 172.21.15.79:0/346282778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95780cdab0 0x7f957814c8f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 >> 172.21.15.79:0/346282778 conn(0x7f9578067660 msgr2=0x7f957814d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 shutdown_connections 2023-10-14T18:50:15.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.011+0000 7f957df8c700 1 -- 172.21.15.79:0/346282778 wait complete. 2023-10-14T18:50:15.212 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-14T18:50:15.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:15.213 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-14T18:50:15.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:50:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-14T18:50:15.466 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:50:15.466 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:50:15.466 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.231101 s, 227 MB/s 2023-10-14T18:50:15.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:15.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.580+0000 7fda32fff700 1 Processor -- start 2023-10-14T18:50:15.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.580+0000 7fda32fff700 1 -- start start 2023-10-14T18:50:15.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda32fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda2c156880 0x7fda2c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:15.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda32fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c157220 con 0x7fda2c156c50 2023-10-14T18:50:15.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda32fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0afa80 con 0x7fda2c068d80 2023-10-14T18:50:15.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda32fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0afd60 con 0x7fda2c156880 2023-10-14T18:50:15.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda31ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda2c156880 0x7fda2c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:15.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda317fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda2c156c50 0x7fda2c068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41164/0 (socket says 172.21.15.79:41164) 2023-10-14T18:50:15.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda317fc700 1 -- 172.21.15.79:0/386994379 learned_addr learned my addr 172.21.15.79:0/386994379 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:15.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.581+0000 7fda31ffd700 1 -- 172.21.15.79:0/386994379 >> v1:172.21.15.144:6789/0 conn(0x7fda2c068d80 legacy=0x7fda2c1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:15.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda31ffd700 1 -- 172.21.15.79:0/386994379 >> v1:172.21.15.79:6789/0 conn(0x7fda2c156c50 legacy=0x7fda2c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda30ffb700 1 -- 172.21.15.79:0/386994379 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182198082 0 0) 0x7fda2c157220 con 0x7fda2c156c50 2023-10-14T18:50:15.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda31ffd700 1 -- 172.21.15.79:0/386994379 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0b0040 con 0x7fda2c156880 2023-10-14T18:50:15.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda31ffd700 1 --2- 172.21.15.79:0/386994379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c156880 0x7fda2c0b1930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009e60 tx=0x7fda1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26e0656410f9141 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:15.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda30ffb700 1 -- 172.21.15.79:0/386994379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00e070 con 0x7fda2c156880 2023-10-14T18:50:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda30ffb700 1 -- 172.21.15.79:0/386994379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00bbf0 con 0x7fda2c156880 2023-10-14T18:50:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda30ffb700 1 -- 172.21.15.79:0/386994379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c012430 con 0x7fda2c156880 2023-10-14T18:50:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 -- 172.21.15.79:0/386994379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c156880 msgr2=0x7fda2c0b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 --2- 172.21.15.79:0/386994379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c156880 0x7fda2c0b1930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009e60 tx=0x7fda1c009780 comp rx=0 tx=0).stop 2023-10-14T18:50:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 -- 172.21.15.79:0/386994379 shutdown_connections 2023-10-14T18:50:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 --2- 172.21.15.79:0/386994379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c156880 0x7fda2c0b1930 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 -- 172.21.15.79:0/386994379 >> 172.21.15.79:0/386994379 conn(0x7fda2c06ace0 msgr2=0x7fda2c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 -- 172.21.15.79:0/386994379 shutdown_connections 2023-10-14T18:50:15.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.582+0000 7fda32fff700 1 -- 172.21.15.79:0/386994379 wait complete. 2023-10-14T18:50:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.583+0000 7fda32fff700 1 Processor -- start 2023-10-14T18:50:15.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 -- start start 2023-10-14T18:50:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda2c156880 0x7fda2c1688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda2c156c50 0x7fda2c070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c146b30 con 0x7fda2c068d80 2023-10-14T18:50:15.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c168e20 con 0x7fda2c156880 2023-10-14T18:50:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda32fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0ad170 con 0x7fda2c156c50 2023-10-14T18:50:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda31ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda31ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36184/0 (socket says 172.21.15.79:36184) 2023-10-14T18:50:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.584+0000 7fda31ffd700 1 -- 172.21.15.79:0/4028483000 learned_addr learned my addr 172.21.15.79:0/4028483000 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 -- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda2c156c50 msgr2=0x7fda2c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda2c156c50 0x7fda2c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 -- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda2c156880 msgr2=0x7fda2c1688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda2c156880 0x7fda2c1688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c009a20 con 0x7fda2c068d80 2023-10-14T18:50:15.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda31ffd700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0ae940 tx=0x7fda1c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:15.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c012e80 con 0x7fda2c068d80 2023-10-14T18:50:15.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c01e640 con 0x7fda2c068d80 2023-10-14T18:50:15.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c0ad450 con 0x7fda2c068d80 2023-10-14T18:50:15.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c01e9e0 con 0x7fda2c068d80 2023-10-14T18:50:15.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.585+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c0ada10 con 0x7fda2c068d80 2023-10-14T18:50:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.586+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c04c3c0 con 0x7fda2c068d80 2023-10-14T18:50:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.586+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda1c024070 con 0x7fda2c068d80 2023-10-14T18:50:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.587+0000 7fda29ffb700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.587+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda1c086f50 con 0x7fda2c068d80 2023-10-14T18:50:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.587+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7fda1806ea50 con 0x7fda2c068d80 2023-10-14T18:50:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.587+0000 7fda317fc700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.587+0000 7fda317fc700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 0x7fda180693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0b1050 tx=0x7fda20007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.591+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda1c054270 con 0x7fda2c068d80 2023-10-14T18:50:15.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.773+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fda2c0b0320 con 0x7fda2c068d80 2023-10-14T18:50:15.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.774+0000 7fda29ffb700 1 -- 172.21.15.79:0/4028483000 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32442 (secure 0 0 0) 0x7fda1c02c030 con 0x7fda2c068d80 2023-10-14T18:50:15.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:15.775 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 106, 2023-10-14T18:50:15.776 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:15.776 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:15.776 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:14.600381+0000", 2023-10-14T18:50:15.776 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:15.776 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:15.777 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:15.778 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:15.778 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:15.778 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.778 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:15.778 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:15.779 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:15.779 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:15.779 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:15.779 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:15.779 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:15.780 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:15.780 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:15.780 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:15.780 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:15.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.781 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:15.781 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:15.781 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:15.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.782 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.782 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.782 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.782 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.783 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.783 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.783 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.783 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.784 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:15.784 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:15.784 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:15.784 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:15.784 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:15.785 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.785 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.785 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.785 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.786 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.786 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.786 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.786 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.787 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.788 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.788 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.788 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.788 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.789 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.789 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.789 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.789 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.790 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.790 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.790 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.790 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.790 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.791 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.791 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.791 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.792 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.792 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.792 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.792 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.792 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.793 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.793 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.793 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.793 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.793 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.794 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.794 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.794 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:15.794 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:15.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.795 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.795 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:15.795 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.796 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:15.796 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:15.796 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:15.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.797 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.797 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.797 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.797 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.798 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.798 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.798 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.798 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.798 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:15.799 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.800 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.800 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.800 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.800 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.800 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.801 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.801 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.803 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.803 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.803 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.803 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.805 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.806 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.806 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.807 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.807 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.807 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.807 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.808 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.808 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.808 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.808 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.808 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.809 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.809 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.809 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:15.809 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:15.809 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:15.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.810 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.810 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:15.810 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:15.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:15.811 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:15.812 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:15.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:15.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:15.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:15.813 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:15.813 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:15.813 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:15.813 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:15.813 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:15.814 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:15.814 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:15.814 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:15.814 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:15.814 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:15.815 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:15.815 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:15.815 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:15.815 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:15.815 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:15.816 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:15.816 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:15.816 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:15.816 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:15.816 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:15.817 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:15.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.817 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:15.817 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:15.817 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:15.818 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:15.818 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:15.818 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:15.818 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:15.818 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:15.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:15.820 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:15.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:15.822 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:15.822 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:15.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:15.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.823 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:15.823 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:15.823 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:15.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:15.823 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:15.825 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:15.825 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:15.825 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:15.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.825 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:15.826 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:15.826 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:15.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.827 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:15.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:15.827 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:15.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:15.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:15.938 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:15.938 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:15.938 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:15.939 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.939 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:15.939 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.940 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:15.940 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:15.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:15.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.944 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:15.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:15.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:15.946 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.947 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:15.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:15.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:15.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:15.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:15.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:15.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:15.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.949 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:15.950 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:15.950 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:15.950 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:15.950 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:15.950 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:50:15.951 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:15.951 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:15.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:15.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.951 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:15.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:15.952 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.952 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.953 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.953 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.953 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.953 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:15.953 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:15.954 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.954 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.955 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.955 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.955 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.955 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:15.955 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.956 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:15.958 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.958 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.958 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.959 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.959 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.959 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:15.959 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.960 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:15.960 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.960 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.960 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.962 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:15.962 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.962 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.962 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.962 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.963 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.963 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:15.963 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:15.973 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 msgr2=0x7fda180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 0x7fda180693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0b1050 tx=0x7fda20007bd0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 msgr2=0x7fda2c1465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0ae940 tx=0x7fda1c018000 comp rx=0 tx=0).stop 2023-10-14T18:50:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 shutdown_connections 2023-10-14T18:50:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda18066f30 0x7fda180693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda2c156c50 0x7fda2c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda2c068d80 0x7fda2c1465f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 --2- 172.21.15.79:0/4028483000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda2c156880 0x7fda2c1688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 >> 172.21.15.79:0/4028483000 conn(0x7fda2c06ace0 msgr2=0x7fda2c1541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 shutdown_connections 2023-10-14T18:50:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:15.776+0000 7fda32fff700 1 -- 172.21.15.79:0/4028483000 wait complete. 2023-10-14T18:50:15.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:16.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.091+0000 7fa8a0a45700 1 Processor -- start 2023-10-14T18:50:16.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.091+0000 7fa8a0a45700 1 -- start start 2023-10-14T18:50:16.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa8a0a45700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa89c0cd6e0 0x7fa89c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa8a0a45700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0cb7c0 con 0x7fa89c0cdab0 2023-10-14T18:50:16.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa8a0a45700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c15e290 con 0x7fa89c15cbd0 2023-10-14T18:50:16.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa8a0a45700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c15e850 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa89c0cd6e0 0x7fa89c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89a59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa89c0cdab0 0x7fa89c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41178/0 (socket says 172.21.15.79:41178) 2023-10-14T18:50:16.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89a59c700 1 -- 172.21.15.79:0/1259384961 learned_addr learned my addr 172.21.15.79:0/1259384961 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:16.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89ad9d700 1 -- 172.21.15.79:0/1259384961 >> v1:172.21.15.144:6789/0 conn(0x7fa89c15cbd0 legacy=0x7fa89c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:16.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa899d9b700 1 -- 172.21.15.79:0/1259384961 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46698648 0 0) 0x7fa89c0cb7c0 con 0x7fa89c0cdab0 2023-10-14T18:50:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89ad9d700 1 -- 172.21.15.79:0/1259384961 >> v1:172.21.15.79:6789/0 conn(0x7fa89c0cdab0 legacy=0x7fa89c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89ad9d700 1 -- 172.21.15.79:0/1259384961 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c15e570 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa89ad9d700 1 --2- 172.21.15.79:0/1259384961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0cbc50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa894009e60 tx=0x7fa894009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2eb474b7d9ce65 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa899d9b700 1 -- 172.21.15.79:0/1259384961 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400e070 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa899d9b700 1 -- 172.21.15.79:0/1259384961 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400bc30 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.092+0000 7fa899d9b700 1 -- 172.21.15.79:0/1259384961 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894012430 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 -- 172.21.15.79:0/1259384961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 msgr2=0x7fa89c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/1259384961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0cbc50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa894009e60 tx=0x7fa894009780 comp rx=0 tx=0).stop 2023-10-14T18:50:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 -- 172.21.15.79:0/1259384961 shutdown_connections 2023-10-14T18:50:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/1259384961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0cbc50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 -- 172.21.15.79:0/1259384961 >> 172.21.15.79:0/1259384961 conn(0x7fa89c067660 msgr2=0x7fa89c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:16.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 -- 172.21.15.79:0/1259384961 shutdown_connections 2023-10-14T18:50:16.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.093+0000 7fa8a0a45700 1 -- 172.21.15.79:0/1259384961 wait complete. 2023-10-14T18:50:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.094+0000 7fa8a0a45700 1 Processor -- start 2023-10-14T18:50:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.094+0000 7fa8a0a45700 1 -- start start 2023-10-14T18:50:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa89c0cdab0 0x7fa89c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa89c15cbd0 0x7fa89c16a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c16b4c0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c15a4e0 con 0x7fa89c15cbd0 2023-10-14T18:50:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa8a0a45700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c16af00 con 0x7fa89c0cdab0 2023-10-14T18:50:16.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36200/0 (socket says 172.21.15.79:36200) 2023-10-14T18:50:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 -- 172.21.15.79:0/3153319969 learned_addr learned my addr 172.21.15.79:0/3153319969 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89a59c700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa89c0cdab0 0x7fa89c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89b59e700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa89c15cbd0 0x7fa89c16a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 -- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa89c0cdab0 msgr2=0x7fa89c15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa89c0cdab0 0x7fa89c15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 -- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa89c15cbd0 msgr2=0x7fa89c16a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa89c15cbd0 0x7fa89c16a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009a20 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.095+0000 7fa89ad9d700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa8940099f0 tx=0x7fa894019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.096+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89401b420 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.096+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89401b580 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.096+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89401b940 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.096+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c16b1e0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.096+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c15a830 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.097+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c15aca0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.097+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa89401bcf0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.097+0000 7fa882ffd700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.097+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa894085fd0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.098+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7fa88806ea50 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.098+0000 7fa89a59c700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.098+0000 7fa89a59c700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 0x7fa8880693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0b5f10 tx=0x7fa890009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.102+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa89402a060 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.329+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89c0b02a0 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.329+0000 7fa882ffd700 1 -- 172.21.15.79:0/3153319969 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fa894053240 con 0x7fa89c0cd6e0 2023-10-14T18:50:16.330 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:16.331 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 msgr2=0x7fa8880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 0x7fa8880693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0b5f10 tx=0x7fa890009040 comp rx=0 tx=0).stop 2023-10-14T18:50:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 msgr2=0x7fa89c0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa8940099f0 tx=0x7fa894019000 comp rx=0 tx=0).stop 2023-10-14T18:50:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 shutdown_connections 2023-10-14T18:50:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa888066f30 0x7fa8880693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa89c15cbd0 0x7fa89c16a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa89c0cd6e0 0x7fa89c0afcd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 --2- 172.21.15.79:0/3153319969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa89c0cdab0 0x7fa89c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 >> 172.21.15.79:0/3153319969 conn(0x7fa89c067660 msgr2=0x7fa89c0c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 shutdown_connections 2023-10-14T18:50:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.331+0000 7fa8a0a45700 1 -- 172.21.15.79:0/3153319969 wait complete. 2023-10-14T18:50:16.335 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:16.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:50:16.476 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":6348,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.620296586999999,"mdsmap_epoch":48,"osdmap_epoch":106,"osdmap_epoch_barrier":106,"uptime":24.595997958000002} 2023-10-14T18:50:16.476 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 6348, "mdsmap_epoch": 48, "osdmap_epoch": 106, "osdmap_epoch_barrier": 106, "rank_uptime": 18.620296587, "state": "up:active", "uptime": 24.595997958, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:50:16.477 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:50:16.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:16.478 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-14T18:50:16.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:50:16.494 INFO:teuthology.orchestra.run.smithi079.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-14T18:50:16.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:16.495 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-14T18:50:16.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:16.550 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-14T18:50:16.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:16.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.781+0000 7f1132a27700 1 Processor -- start 2023-10-14T18:50:16.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.781+0000 7f1132a27700 1 -- start start 2023-10-14T18:50:16.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.781+0000 7f1132a27700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f112c0b3430 0x7f112c164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1132a27700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c15db80 con 0x7f112c15a1e0 2023-10-14T18:50:16.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1132a27700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112c15de60 con 0x7f112c159e10 2023-10-14T18:50:16.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1132a27700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112c15e800 con 0x7f112c0b3430 2023-10-14T18:50:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1130fc4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f112c0b3430 0x7f112c164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f112c15a1e0 0x7f112c0cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:41184/0 (socket says 172.21.15.79:41184) 2023-10-14T18:50:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112b7fe700 1 -- 172.21.15.79:0/279714481 learned_addr learned my addr 172.21.15.79:0/279714481 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1130fc4700 1 -- 172.21.15.79:0/279714481 >> v1:172.21.15.144:6789/0 conn(0x7f112c159e10 legacy=0x7f112c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:16.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1130fc4700 1 -- 172.21.15.79:0/279714481 >> v1:172.21.15.79:6789/0 conn(0x7f112c15a1e0 legacy=0x7f112c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1130fc4700 1 -- 172.21.15.79:0/279714481 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c15e140 con 0x7f112c0b3430 2023-10-14T18:50:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112affd700 1 -- 172.21.15.79:0/279714481 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170503376 0 0) 0x7f112c15db80 con 0x7f112c15a1e0 2023-10-14T18:50:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f1130fc4700 1 --2- 172.21.15.79:0/279714481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c164e20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1124009e60 tx=0x7f1124009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c85de9a9fb519e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112affd700 1 -- 172.21.15.79:0/279714481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400e070 con 0x7f112c0b3430 2023-10-14T18:50:16.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112affd700 1 -- 172.21.15.79:0/279714481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400bbf0 con 0x7f112c0b3430 2023-10-14T18:50:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.782+0000 7f112affd700 1 -- 172.21.15.79:0/279714481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124012430 con 0x7f112c0b3430 2023-10-14T18:50:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 -- 172.21.15.79:0/279714481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 msgr2=0x7f112c164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 --2- 172.21.15.79:0/279714481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c164e20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1124009e60 tx=0x7f1124009780 comp rx=0 tx=0).stop 2023-10-14T18:50:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 -- 172.21.15.79:0/279714481 shutdown_connections 2023-10-14T18:50:16.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 --2- 172.21.15.79:0/279714481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c164e20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 -- 172.21.15.79:0/279714481 >> 172.21.15.79:0/279714481 conn(0x7f112c067660 msgr2=0x7f112c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 -- 172.21.15.79:0/279714481 shutdown_connections 2023-10-14T18:50:16.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.783+0000 7f1132a27700 1 -- 172.21.15.79:0/279714481 wait complete. 2023-10-14T18:50:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.784+0000 7f1132a27700 1 Processor -- start 2023-10-14T18:50:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.784+0000 7f1132a27700 1 -- start start 2023-10-14T18:50:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f112c159e10 0x7f112c16a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f112c15a1e0 0x7f112c14d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c158780 con 0x7f112c0b3430 2023-10-14T18:50:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c16a820 con 0x7f112c159e10 2023-10-14T18:50:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1132a27700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c16ab00 con 0x7f112c15a1e0 2023-10-14T18:50:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:36224/0 (socket says 172.21.15.79:36224) 2023-10-14T18:50:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 -- 172.21.15.79:0/58864365 learned_addr learned my addr 172.21.15.79:0/58864365 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1130fc4700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f112c15a1e0 0x7f112c14d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112b7fe700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f112c159e10 0x7f112c16a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 -- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f112c15a1e0 msgr2=0x7f112c14d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f112c15a1e0 0x7f112c14d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 -- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f112c159e10 msgr2=0x7f112c16a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f112c159e10 0x7f112c16a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124009a20 con 0x7f112c0b3430 2023-10-14T18:50:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f112bfff700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c5d0 tx=0x7f111c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.785+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011590 con 0x7f112c0b3430 2023-10-14T18:50:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.786+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011710 con 0x7f112c0b3430 2023-10-14T18:50:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.786+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011ad0 con 0x7f112c0b3430 2023-10-14T18:50:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.786+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c16ade0 con 0x7f112c0b3430 2023-10-14T18:50:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.786+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112c14d650 con 0x7f112c0b3430 2023-10-14T18:50:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.786+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112c04c3c0 con 0x7f112c0b3430 2023-10-14T18:50:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.787+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f111c01c460 con 0x7f112c0b3430 2023-10-14T18:50:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.787+0000 7f1113fff700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 0x7f11180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.787+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f111c084390 con 0x7f112c0b3430 2023-10-14T18:50:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.787+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=107}) v3 -- 0x7f111806ea50 con 0x7f112c0b3430 2023-10-14T18:50:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.787+0000 7f112b7fe700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 0x7f11180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.788+0000 7f112b7fe700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 0x7f11180693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ccfc0 tx=0x7f1120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.791+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f111c051600 con 0x7f112c0b3430 2023-10-14T18:50:16.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.977+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f112c16b280 con 0x7f112c0b3430 2023-10-14T18:50:16.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.978+0000 7f1113fff700 1 -- 172.21.15.79:0/58864365 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+32442 (secure 0 0 0) 0x7f111c054c20 con 0x7f112c0b3430 2023-10-14T18:50:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:16.979 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 106, 2023-10-14T18:50:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:14.600381+0000", 2023-10-14T18:50:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:16.995 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:16.996 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:16.996 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:16.996 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:16.996 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:16.996 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:16.997 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:16.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:16.998 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:16.998 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:16.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:16.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:16.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:16.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:16.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:16.999 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:16.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:17.000 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:17.001 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:17.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:17.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:17.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:17.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:17.003 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:17.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:17.005 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:17.005 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:17.005 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:17.005 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:17.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:17.006 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:17.006 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:17.006 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:17.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:17.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:17.007 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:17.008 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:17.008 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:17.008 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:17.008 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:17.008 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:17.009 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:17.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:17.010 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:17.010 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:17.010 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:17.010 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:17.011 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:17.012 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:17.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.012 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:17.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:17.012 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:17.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.013 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:17.014 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:17.014 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:17.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:17.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:17.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:17.015 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:17.015 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:17.015 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:17.015 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:17.015 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:17.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:17.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:17.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:17.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:17.017 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:17.017 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:17.018 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:17.018 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:17.018 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:17.018 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:17.018 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:17.019 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:17.020 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:17.020 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:17.020 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:17.020 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:17.020 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:17.021 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:17.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:17.022 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:17.022 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:17.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:17.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:17.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:17.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:17.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:17.023 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:17.024 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:17.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:17.025 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:17.025 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:17.025 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:17.025 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:17.026 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:17.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.027 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:17.027 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:17.027 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:17.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.028 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:17.028 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:17.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.029 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.030 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.030 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.030 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.030 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:17.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:17.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:17.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.036 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:17.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:17.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:17.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.041 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:17.042 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:17.042 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:17.042 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:17.042 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.042 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.043 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:17.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.043 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.044 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.045 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:17.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.048 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:17.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.051 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:17.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.053 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:17.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:17.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.056 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:17.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:17.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.059 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.059 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.059 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:17.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:17.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.065 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:17.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:17.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:17.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.070 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:17.071 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:17.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:17.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:17.071 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.071 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.072 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:17.072 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.073 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.074 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.075 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.075 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.075 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.077 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:17.078 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:17.079 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:17.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:17.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.083 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:17.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:17.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.085 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.086 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.087 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:17.087 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.088 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:17.094 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:17.095 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:17.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.099 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.100 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:17.101 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.102 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.102 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.102 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.102 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:17.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.106 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:17.108 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:17.109 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.110 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:17.110 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:17.112 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.114 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:17.114 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:17.114 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:17.114 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:17.114 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.115 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.115 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.116 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.117 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.117 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.117 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.117 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.117 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.118 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.118 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:17.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.120 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:17.121 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:17.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.123 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.126 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:17.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:17.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:17.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.128 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.129 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.130 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:17.131 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:17.132 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:17.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:17.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.137 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:17.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:17.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:17.142 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:17.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.142 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:50:17.143 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:17.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.145 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:17.146 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.146 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.147 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.148 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.150 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:17.150 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.150 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.150 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.152 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.153 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:17.153 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.153 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.154 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.155 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.156 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.156 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.156 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.156 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:17.156 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:17.157 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.158 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:17.159 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:17.159 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:17.159 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:17.159 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:17.159 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:17.160 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:17.160 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:17.160 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:17.162 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:17.162 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:17.162 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:17.162 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:17.162 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:17.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:17.163 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:17.163 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:17.163 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:17.164 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:17.165 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:17.165 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:17.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:17.165 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 msgr2=0x7f11180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 0x7f11180693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f112c0ccfc0 tx=0x7f1120009040 comp rx=0 tx=0).stop 2023-10-14T18:50:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 msgr2=0x7f112c0ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c5d0 tx=0x7f111c007f60 comp rx=0 tx=0).stop 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 shutdown_connections 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1118066f30 0x7f11180693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f112c15a1e0 0x7f112c14d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f112c0b3430 0x7f112c0ca8a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 --2- 172.21.15.79:0/58864365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f112c159e10 0x7f112c16a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 >> 172.21.15.79:0/58864365 conn(0x7f112c067660 msgr2=0x7f112c0b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 shutdown_connections 2023-10-14T18:50:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:16.980+0000 7f1132a27700 1 -- 172.21.15.79:0/58864365 wait complete. 2023-10-14T18:50:17.169 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:50:17.522 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:50:17.522+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-14T18:50:22.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.298+0000 7ff488745700 1 Processor -- start 2023-10-14T18:50:22.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.298+0000 7ff488745700 1 -- start start 2023-10-14T18:50:22.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff488745700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 0x7ff48015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff488745700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff48015d580 0x7ff480158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff488745700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48015cbb0 con 0x7ff480157870 2023-10-14T18:50:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff488745700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48015bdb0 con 0x7ff48015d580 2023-10-14T18:50:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff488745700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48015bfa0 con 0x7ff48015a620 2023-10-14T18:50:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4864e1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff480157870 0x7ff48015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:32838/0 (socket says 172.21.15.79:32838) 2023-10-14T18:50:22.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4864e1700 1 -- 172.21.15.79:0/2356581226 learned_addr learned my addr 172.21.15.79:0/2356581226 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:22.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff485ce0700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 0x7ff48015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff486ce2700 1 --2- 172.21.15.79:0/2356581226 >> v2:172.21.15.144:3300/0 conn(0x7ff48015d580 0x7ff480158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211162675 0 0) 0x7ff48015cbb0 con 0x7ff480157870 2023-10-14T18:50:22.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff468003570 con 0x7ff480157870 2023-10-14T18:50:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284341833 0 0) 0x7ff468003570 con 0x7ff480157870 2023-10-14T18:50:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 msgr2=0x7ff48015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.299+0000 7ff4854df700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 0x7ff48015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 >> v2:172.21.15.144:3300/0 conn(0x7ff48015d580 msgr2=0x7ff480158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:22.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 --2- 172.21.15.79:0/2356581226 >> v2:172.21.15.144:3300/0 conn(0x7ff48015d580 0x7ff480158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48015c280 con 0x7ff480157870 2023-10-14T18:50:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff4700017f0 con 0x7ff480157870 2023-10-14T18:50:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 >> v1:172.21.15.79:6789/0 conn(0x7ff480157870 legacy=0x7ff48015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff468003a60 0x7ff468003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468004810 0x7ff468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 0x7ff4680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48015bfa0 con 0x7ff468003a60 2023-10-14T18:50:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46800ba60 con 0x7ff468004810 2023-10-14T18:50:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46800bba0 con 0x7ff48015a620 2023-10-14T18:50:22.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff468003a60 0x7ff468003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff485ce0700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468004810 0x7ff468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 -- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 msgr2=0x7ff4680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff48015a620 0x7ff4680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 -- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468004810 msgr2=0x7ff468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:22.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468004810 0x7ff468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 -- 172.21.15.79:0/2356581226 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468003570 con 0x7ff468003a60 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff468003a60 0x7ff468003e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff47000a9a0 tx=0x7ff470002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3736972fe525ffcf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470012440 con 0x7ff468003a60 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700125c0 con 0x7ff468003a60 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.300+0000 7ff4854df700 1 -- 172.21.15.79:0/2356581226 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470012980 con 0x7ff468003a60 2023-10-14T18:50:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 -- 172.21.15.79:0/2356581226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff468003a60 msgr2=0x7ff468003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 --2- 172.21.15.79:0/2356581226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff468003a60 0x7ff468003e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff47000a9a0 tx=0x7ff470002210 comp rx=0 tx=0).stop 2023-10-14T18:50:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff486ce2700 1 -- 172.21.15.79:0/2356581226 reap_dead start 2023-10-14T18:50:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 -- 172.21.15.79:0/2356581226 shutdown_connections 2023-10-14T18:50:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 -- 172.21.15.79:0/2356581226 >> 172.21.15.79:0/2356581226 conn(0x7ff480068ce0 msgr2=0x7ff4800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 -- 172.21.15.79:0/2356581226 shutdown_connections 2023-10-14T18:50:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.301+0000 7ff488745700 1 -- 172.21.15.79:0/2356581226 wait complete. 2023-10-14T18:50:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.302+0000 7ff488745700 1 Processor -- start 2023-10-14T18:50:22.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.302+0000 7ff488745700 1 -- start start 2023-10-14T18:50:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468003a60 0x7ff48016e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff480150eb0 0x7ff4800d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48016eb80 con 0x7ff4800b06c0 2023-10-14T18:50:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480151fa0 con 0x7ff468003a60 2023-10-14T18:50:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff488745700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff480151390 con 0x7ff480150eb0 2023-10-14T18:50:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54434/0 (socket says 172.21.15.79:54434) 2023-10-14T18:50:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 -- 172.21.15.79:0/2135550503 learned_addr learned my addr 172.21.15.79:0/2135550503 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468003a60 0x7ff48016e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff485ce0700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff480150eb0 0x7ff4800d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 -- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff480150eb0 msgr2=0x7ff4800d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff480150eb0 0x7ff4800d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 -- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468003a60 msgr2=0x7ff48016e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468003a60 0x7ff48016e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.303+0000 7ff486ce2700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480151670 con 0x7ff4800b06c0 2023-10-14T18:50:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff486ce2700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff4800b3830 tx=0x7ff4780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478019070 con 0x7ff4800b06c0 2023-10-14T18:50:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478013680 con 0x7ff4800b06c0 2023-10-14T18:50:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480151950 con 0x7ff4800b06c0 2023-10-14T18:50:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478013a40 con 0x7ff4800b06c0 2023-10-14T18:50:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.304+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4800b6050 con 0x7ff4800b06c0 2023-10-14T18:50:22.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.305+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48004c3c0 con 0x7ff4800b06c0 2023-10-14T18:50:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.305+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff47801e410 con 0x7ff4800b06c0 2023-10-14T18:50:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.305+0000 7ff47e7fc700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.306+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff478083e70 con 0x7ff4800b06c0 2023-10-14T18:50:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.306+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=108}) v3 -- 0x7ff46c06ea50 con 0x7ff4800b06c0 2023-10-14T18:50:22.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.306+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.306+0000 7ff4864e1700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 0x7ff46c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff47000a940 tx=0x7ff470015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:22.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.310+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff478051040 con 0x7ff4800b06c0 2023-10-14T18:50:22.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.494+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff4801520e0 con 0x7ff4800b06c0 2023-10-14T18:50:22.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.494+0000 7ff47e7fc700 1 -- 172.21.15.79:0/2135550503 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+32450 (secure 0 0 0) 0x7ff478054660 con 0x7ff4800b06c0 2023-10-14T18:50:22.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:22.496 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:22.496 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 107, 2023-10-14T18:50:22.496 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:20.613742+0000", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:22.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:22.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:22.498 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:22.498 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:22.498 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:22.499 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:22.499 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:22.499 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:22.499 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:22.499 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:22.500 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:22.500 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:22.500 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:22.500 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:22.500 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:22.501 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:22.501 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:22.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:22.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:22.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:22.502 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:22.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:22.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:22.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:22.503 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:22.503 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:22.503 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:22.503 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:22.504 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:22.504 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:22.504 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:22.504 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:22.504 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:22.505 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:22.506 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:22.506 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:22.506 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:22.506 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:22.506 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:22.507 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:22.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.507 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:22.507 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:22.507 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:22.508 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:22.508 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:22.508 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:22.508 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:22.508 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:22.509 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:22.509 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:22.509 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:22.509 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:22.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:22.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:22.510 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:22.510 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:22.510 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:22.510 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:22.511 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:22.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:22.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:22.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:22.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:22.512 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:22.512 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:22.512 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:22.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:22.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.513 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:22.513 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:22.513 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:22.513 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:22.514 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:22.514 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:22.514 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:22.514 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:22.514 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:22.515 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:22.515 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:22.515 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:22.515 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:22.515 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:22.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.516 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:22.516 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:22.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:22.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:22.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:22.518 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:22.518 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:22.519 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:22.519 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:22.519 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:22.519 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:22.519 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:22.520 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:22.521 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:22.521 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:22.521 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:22.521 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:22.521 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:22.522 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:22.522 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:22.522 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:22.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.523 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:22.523 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:22.523 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:22.523 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:22.524 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:22.524 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:22.524 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:22.524 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:22.524 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:22.525 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:22.526 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:22.526 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:22.526 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:22.526 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:22.527 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:22.528 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:22.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:22.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.529 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:22.529 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:22.529 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:22.529 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:22.530 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:22.530 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:22.530 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:22.530 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:22.531 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:22.531 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:22.531 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:22.531 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:22.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:22.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:22.532 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:22.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.532 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.534 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:22.534 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:22.534 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:22.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 3, 2023-10-14T18:50:22.535 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full", 2023-10-14T18:50:22.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:22.535 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:22.535 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:22.535 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:22.536 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:22.536 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:22.536 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:22.536 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:22.537 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:22.537 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:22.537 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:22.537 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:22.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:22.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:22.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:22.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:22.539 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:22.539 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:22.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:22.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:22.540 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:22.540 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:22.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.540 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "103", 2023-10-14T18:50:22.540 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:22.541 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:22.541 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:22.541 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:22.541 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:22.541 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:22.542 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:22.542 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:22.542 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:22.542 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:22.542 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:22.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:22.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:22.543 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:22.543 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:22.544 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:22.545 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:22.545 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:22.545 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:22.545 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:22.545 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:22.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:22.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.546 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:22.546 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:22.546 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:22.547 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:22.547 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:22.547 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:22.547 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:22.547 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:22.548 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:22.548 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:22.548 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:22.548 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:22.548 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:22.549 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:22.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.549 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:22.549 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:22.550 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:22.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.551 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:22.551 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:22.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.551 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:22.551 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.552 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.552 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.552 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.552 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.552 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.553 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.553 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.553 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.553 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.554 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:22.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:22.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.557 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:22.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:22.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:22.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:22.562 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:22.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:22.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:22.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.565 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.566 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:22.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:22.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:22.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:22.567 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.567 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.567 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:22.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.568 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:22.568 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.568 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.571 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:22.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:22.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.575 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:22.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:22.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.579 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:22.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:22.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:22.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:22.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:22.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.585 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:22.586 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:22.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:22.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:22.587 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.587 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.587 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:22.588 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.589 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:22.589 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.590 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.590 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.590 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.591 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.592 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.592 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.592 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.592 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.593 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:22.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:22.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.596 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:22.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:22.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:22.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:22.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:22.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.605 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:22.605 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:22.605 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:22.605 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:22.606 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.606 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.606 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:22.606 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.608 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:22.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:22.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.613 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:22.615 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:22.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:22.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:22.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.622 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:22.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:22.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:22.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.626 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:22.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:22.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:22.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:22.627 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.627 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.627 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.628 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:22.628 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.629 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.629 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.629 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.629 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.629 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.630 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.630 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.630 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.630 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.630 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.631 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:22.632 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.633 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.633 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:22.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:22.635 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.636 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:22.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.638 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:22.638 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.639 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.639 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.640 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:22.640 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.641 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:22.641 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:22.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.643 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:22.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:22.643 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:22.644 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:22.644 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.644 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:50:22.644 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.644 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.645 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:22.646 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.646 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.646 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.646 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.647 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.648 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.648 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.650 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:22.650 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:22.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.653 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.654 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.655 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:22.655 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.658 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.663 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:22.667 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.669 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.670 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.671 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:22.672 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:22.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:22.676 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.685 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:22.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:22.689 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "full", 2023-10-14T18:50:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:22.691 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:22.692 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:22.693 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:22.694 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:22.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:22.700 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.703 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:22.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:22.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:22.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:22.705 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:22.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:22.706 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:22.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.708 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:22.708 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:22.708 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:22.708 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:22.709 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:22.709 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull", 2023-10-14T18:50:22.709 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:22.709 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:22.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:22.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.710 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:22.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:22.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:22.711 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.711 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.711 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.711 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.711 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.712 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:22.712 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.712 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:22.713 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.713 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.713 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.714 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.714 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.715 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:22.715 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.716 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:22.717 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.717 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.717 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.718 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.718 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.718 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:22.719 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.720 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:22.720 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.720 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.721 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.721 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.721 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.721 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:22.721 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.722 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:22.723 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.723 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.723 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.724 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.724 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.724 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:22.724 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.725 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:22.725 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.726 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.726 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.726 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.726 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.726 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:22.727 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.728 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:22.728 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.728 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.728 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.729 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.729 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.729 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:22.729 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:22.730 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:22.730 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:22.730 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:22.731 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:22.731 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:22.731 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:22.731 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:22.732 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:22.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.732 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:22.732 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:22.733 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:22.733 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:22.733 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:22.733 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:22.734 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:22.734 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:22.734 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:22.734 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:22.735 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:22.735 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:22.735 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:22.735 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:22.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:22.736 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:22.737 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:22.737 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:22.737 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:22.737 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:22.737 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:22.738 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:22.738 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:22.738 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 msgr2=0x7ff46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 0x7ff46c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff47000a940 tx=0x7ff470015000 comp rx=0 tx=0).stop 2023-10-14T18:50:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 msgr2=0x7ff48014a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff4800b3830 tx=0x7ff4780091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 shutdown_connections 2023-10-14T18:50:22.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff46c066f30 0x7ff46c0693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff4800b06c0 0x7ff48014a570 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468003a60 0x7ff48016e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 --2- 172.21.15.79:0/2135550503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff480150eb0 0x7ff4800d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:22.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 >> 172.21.15.79:0/2135550503 conn(0x7ff480068ce0 msgr2=0x7ff48014c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 shutdown_connections 2023-10-14T18:50:22.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:22.497+0000 7ff488745700 1 -- 172.21.15.79:0/2135550503 wait complete. 2023-10-14T18:50:22.744 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:50:22.744 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:50:22.523+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-14T18:50:27.524 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:50:27.524+0000 7fb5de774700 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-10-14T18:50:27.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.866+0000 7f04c35ef700 1 Processor -- start 2023-10-14T18:50:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.866+0000 7f04c35ef700 1 -- start start 2023-10-14T18:50:27.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c35ef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c35ef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc06e2b0 0x7f04bc06e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c35ef700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0c42b0 con 0x7f04bc156ea0 2023-10-14T18:50:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c35ef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc06fac0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c35ef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc06ec70 con 0x7f04bc157270 2023-10-14T18:50:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c1b8c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc06e2b0 0x7f04bc06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c1b8c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04bc06e2b0 0x7f04bc06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54444/0 (socket says 172.21.15.79:54444) 2023-10-14T18:50:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.867+0000 7f04c1b8c700 1 -- 172.21.15.79:0/2389990688 learned_addr learned my addr 172.21.15.79:0/2389990688 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c0b8a700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c1b8c700 1 -- 172.21.15.79:0/2389990688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 msgr2=0x7f04bc0c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c1b8c700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0c30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c1b8c700 1 -- 172.21.15.79:0/2389990688 >> v1:172.21.15.144:6789/0 conn(0x7f04bc156ea0 legacy=0x7f04bc06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c1b8c700 1 -- 172.21.15.79:0/2389990688 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0c36a0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c1b8c700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc06e730 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009f20 tx=0x7f04b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63a2bb0f13002de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:27.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04b3fff700 1 -- 172.21.15.79:0/2389990688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800e070 con 0x7f04bc06e2b0 2023-10-14T18:50:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04b3fff700 1 -- 172.21.15.79:0/2389990688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800ba40 con 0x7f04bc06e2b0 2023-10-14T18:50:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04b3fff700 1 -- 172.21.15.79:0/2389990688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80092e0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c35ef700 1 -- 172.21.15.79:0/2389990688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 msgr2=0x7f04bc06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.868+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc06e730 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009f20 tx=0x7f04b8009840 comp rx=0 tx=0).stop 2023-10-14T18:50:27.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 -- 172.21.15.79:0/2389990688 shutdown_connections 2023-10-14T18:50:27.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc06e730 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:27.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2389990688 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:27.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 -- 172.21.15.79:0/2389990688 >> 172.21.15.79:0/2389990688 conn(0x7f04bc0ca4f0 msgr2=0x7f04bc0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:27.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 -- 172.21.15.79:0/2389990688 shutdown_connections 2023-10-14T18:50:27.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.869+0000 7f04c35ef700 1 -- 172.21.15.79:0/2389990688 wait complete. 2023-10-14T18:50:27.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.870+0000 7f04c35ef700 1 Processor -- start 2023-10-14T18:50:27.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.870+0000 7f04c35ef700 1 -- start start 2023-10-14T18:50:27.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 0x7f04bc1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0c61f0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc153ae0 con 0x7f04bc156ea0 2023-10-14T18:50:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0c5ba0 con 0x7f04bc157270 2023-10-14T18:50:27.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54452/0 (socket says 172.21.15.79:54452) 2023-10-14T18:50:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 -- 172.21.15.79:0/2873673482 learned_addr learned my addr 172.21.15.79:0/2873673482 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c1b8c700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c0b8a700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 0x7f04bc1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 -- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 msgr2=0x7f04bc0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:27.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:27.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 -- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 msgr2=0x7f04bc1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:27.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 0x7f04bc1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:27.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 -- 172.21.15.79:0/2873673482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009ae0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c0b8a700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 0x7f04bc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c138b700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f04b400b600 tx=0x7f04b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400f510 con 0x7f04bc06e2b0 2023-10-14T18:50:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400f690 con 0x7f04bc06e2b0 2023-10-14T18:50:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc0c5e80 con 0x7f04bc06e2b0 2023-10-14T18:50:27.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400fa50 con 0x7f04bc06e2b0 2023-10-14T18:50:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.871+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc153dc0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.872+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc04c3c0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.873+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04b401a400 con 0x7f04bc06e2b0 2023-10-14T18:50:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.873+0000 7f04b17fa700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:27.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.873+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04b40840d0 con 0x7f04bc06e2b0 2023-10-14T18:50:27.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.873+0000 7f04c0b8a700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:27.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.874+0000 7f04c0b8a700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:27.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:27.877+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04b4051320 con 0x7f04bc06e2b0 2023-10-14T18:50:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.060+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f04bc06b620 con 0x7f04bc06e2b0 2023-10-14T18:50:28.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.061+0000 7f04b17fa700 1 -- 172.21.15.79:0/2873673482 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+32275 (secure 0 0 0) 0x7f04b4054940 con 0x7f04bc06e2b0 2023-10-14T18:50:28.062 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:28.062 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:28.063 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 111, 2023-10-14T18:50:28.063 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:28.063 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:28.063 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:27.735904+0000", 2023-10-14T18:50:28.064 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:28.064 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:28.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:28.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:28.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:28.065 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:28.065 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:28.065 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:28.065 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:28.066 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.066 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:28.066 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:28.066 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:28.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:28.068 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:28.069 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:28.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.069 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.070 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.070 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.070 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.070 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.070 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.071 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.071 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.071 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.071 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:28.071 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:28.072 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:28.072 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:28.072 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:28.072 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.072 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.073 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.073 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.073 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.073 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.073 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.076 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.076 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.077 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.077 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.078 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.078 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.078 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.078 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.079 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.079 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.079 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.080 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.080 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.080 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.080 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.080 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.081 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.081 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.081 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.081 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.082 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.082 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.083 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.083 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.083 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.083 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.084 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.084 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.084 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.084 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.085 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.085 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:28.085 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:28.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.086 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.086 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:28.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.087 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:28.087 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:28.087 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:28.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.088 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.088 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.088 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.089 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.089 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.089 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.090 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.090 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.090 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.090 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:28.090 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:28.091 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:28.091 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:28.091 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:28.091 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.091 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.092 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.092 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.092 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.092 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.092 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.093 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.094 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.094 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.094 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.094 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.095 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.095 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.121 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.121 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.121 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.121 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.122 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.123 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.123 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.124 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.124 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.124 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.124 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.125 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.125 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.126 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.126 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.126 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.126 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.126 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.127 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.127 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:28.127 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:28.128 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:28.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.128 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.129 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:28.129 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:28.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:28.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.131 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.131 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.131 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.132 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.132 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.132 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.132 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.132 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.133 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.133 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:28.133 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:28.133 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:28.133 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:28.134 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:28.134 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.134 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.134 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.134 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.135 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.135 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.135 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.135 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.136 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.136 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.136 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.136 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.136 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.137 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.137 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.137 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.137 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.137 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.138 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.138 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.138 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.139 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.139 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.139 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.139 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.139 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.140 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.140 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.141 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.142 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.142 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.142 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.142 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.142 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.143 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.143 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.143 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.143 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.143 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:28.144 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:28.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.144 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.144 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:28.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.146 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:28.146 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.146 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.146 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.147 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.147 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.147 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.147 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.147 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.148 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.148 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.148 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.148 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:28.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.151 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:28.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:28.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:28.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:28.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:28.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.159 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:28.159 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:28.159 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:28.160 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:28.160 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.160 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.160 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.161 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.162 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.162 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.162 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.162 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.162 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.163 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.163 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.163 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.163 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.165 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:28.165 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.166 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:28.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.168 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:28.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.172 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:28.172 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:28.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.173 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.173 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.174 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:28.174 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:28.174 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:28.174 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.177 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.177 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.177 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.179 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:28.179 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.180 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.181 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:28.181 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.182 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:28.182 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.183 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.183 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.185 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:28.185 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.186 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.186 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.186 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.187 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:28.187 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.189 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.190 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.190 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.190 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.191 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.192 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.193 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.193 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.193 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:28.194 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:28.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:28.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:28.203 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.206 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.207 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.210 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.211 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:28.211 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.212 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:28.212 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.215 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:28.215 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.215 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.216 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.216 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.216 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:28.217 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.218 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:28.218 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.220 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:28.220 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.220 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.221 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.221 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.221 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:28.223 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:28.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:28.226 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:28.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.228 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:28.229 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.230 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:28.233 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.234 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:28.234 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:28.235 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:28.236 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:28.236 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.236 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.236 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.238 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.238 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.238 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:28.240 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:28.241 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.243 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:28.243 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.244 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:28.244 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:28.245 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.246 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:28.246 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.247 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.247 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.247 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.249 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.249 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:28.249 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.250 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:28.250 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:28.250 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:28.250 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.252 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:28.252 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.252 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.252 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.252 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.253 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.253 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.253 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.253 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.253 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.254 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.254 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.254 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.254 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.255 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:28.255 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.257 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.257 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.257 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:28.258 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.258 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.258 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.259 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.260 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:28.260 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.261 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.262 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.262 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.262 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.263 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:28.263 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.264 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:28.264 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.265 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.266 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.266 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.266 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:28.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.267 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:28.267 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.267 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.267 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.268 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.268 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.268 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:28.268 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.269 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.270 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.270 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:28.270 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.271 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:28.271 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.271 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.271 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.271 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.272 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:28.273 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.273 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.273 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.273 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.273 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.274 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:28.274 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.274 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.275 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:28.276 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.277 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.277 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.277 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.277 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.277 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:28.278 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.278 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:28.278 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.279 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.279 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.279 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.279 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.279 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.280 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.281 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.281 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.281 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.281 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:28.281 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:28.282 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:28.283 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:28.283 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:28.283 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:28.283 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:28.283 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:28.284 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:28.284 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:28.284 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:28.284 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:28.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:28.285 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:28.286 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:28.286 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:28.286 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:28.286 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:28.286 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:28.287 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:28.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.287 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 msgr2=0x7f04a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 0x7f04a00693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).stop 2023-10-14T18:50:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 msgr2=0x7f04bc153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f04b400b600 tx=0x7f04b40091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 shutdown_connections 2023-10-14T18:50:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04a0066f30 0x7f04a00693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04bc157270 0x7f04bc0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04bc06e2b0 0x7f04bc153240 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 --2- 172.21.15.79:0/2873673482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04bc156ea0 0x7f04bc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 >> 172.21.15.79:0/2873673482 conn(0x7f04bc0ca4f0 msgr2=0x7f04bc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 shutdown_connections 2023-10-14T18:50:28.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.063+0000 7f04c35ef700 1 -- 172.21.15.79:0/2873673482 wait complete. 2023-10-14T18:50:28.292 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-14T18:50:28.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:50:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.408+0000 7fac8d1f5700 1 Processor -- start 2023-10-14T18:50:28.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.408+0000 7fac8d1f5700 1 -- start start 2023-10-14T18:50:28.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac8d1f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac880cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac8d1f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac880d0870 con 0x7fac881438f0 2023-10-14T18:50:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac8d1f5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac880cdfb0 con 0x7fac8806ab50 2023-10-14T18:50:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac8d1f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac880cfc60 con 0x7fac88143520 2023-10-14T18:50:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac877fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fac881438f0 0x7fac8806a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51294/0 (socket says 172.21.15.79:51294) 2023-10-14T18:50:28.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac877fe700 1 -- 172.21.15.79:0/1687275148 learned_addr learned my addr 172.21.15.79:0/1687275148 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.409+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458750303 0 0) 0x7fac880d0870 con 0x7fac881438f0 2023-10-14T18:50:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac880cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac70003570 con 0x7fac881438f0 2023-10-14T18:50:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130170707 0 0) 0x7fac70003570 con 0x7fac881438f0 2023-10-14T18:50:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 msgr2=0x7fac880cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac880cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 >> v1:172.21.15.144:6789/0 conn(0x7fac8806ab50 legacy=0x7fac880b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880cff40 con 0x7fac881438f0 2023-10-14T18:50:28.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fac7c001470 con 0x7fac881438f0 2023-10-14T18:50:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 >> v1:172.21.15.79:6789/0 conn(0x7fac881438f0 legacy=0x7fac8806a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac70003a90 0x7fac70003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac70004810 0x7fac70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac700051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac880cfc60 con 0x7fac70003a90 2023-10-14T18:50:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7000bb60 con 0x7fac70004810 2023-10-14T18:50:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7000bd20 con 0x7fac88143520 2023-10-14T18:50:28.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac70003a90 0x7fac70003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac877fe700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac70004810 0x7fac70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac8c9f4700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac700051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 -- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 msgr2=0x7fac700051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac88143520 0x7fac700051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 -- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac70004810 msgr2=0x7fac70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac70004810 0x7fac70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 -- 172.21.15.79:0/1687275148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70003570 con 0x7fac70003a90 2023-10-14T18:50:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac877fe700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac70004810 0x7fac70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.410+0000 7fac87fff700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac70003a90 0x7fac70003ea0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fac78009c00 tx=0x7fac780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7303c4412c85bc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800e710 con 0x7fac70003a90 2023-10-14T18:50:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800e870 con 0x7fac70003a90 2023-10-14T18:50:28.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac86ffd700 1 -- 172.21.15.79:0/1687275148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800ec30 con 0x7fac70003a90 2023-10-14T18:50:28.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 -- 172.21.15.79:0/1687275148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac70003a90 msgr2=0x7fac70003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/1687275148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac70003a90 0x7fac70003ea0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fac78009c00 tx=0x7fac780091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8c9f4700 1 -- 172.21.15.79:0/1687275148 reap_dead start 2023-10-14T18:50:28.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 -- 172.21.15.79:0/1687275148 shutdown_connections 2023-10-14T18:50:28.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 -- 172.21.15.79:0/1687275148 >> 172.21.15.79:0/1687275148 conn(0x7fac88069750 msgr2=0x7fac880b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:28.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 -- 172.21.15.79:0/1687275148 shutdown_connections 2023-10-14T18:50:28.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.411+0000 7fac8d1f5700 1 -- 172.21.15.79:0/1687275148 wait complete. 2023-10-14T18:50:28.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.412+0000 7fac8d1f5700 1 Processor -- start 2023-10-14T18:50:28.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 -- start start 2023-10-14T18:50:28.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac70003a90 0x7fac8815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 0x7fac8815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8815ad50 con 0x7fac8813b1c0 2023-10-14T18:50:28.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8816a680 con 0x7fac8815b720 2023-10-14T18:50:28.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8d1f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8813cc20 con 0x7fac70003a90 2023-10-14T18:50:28.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.413+0000 7fac8c9f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38420/0 (socket says 172.21.15.79:38420) 2023-10-14T18:50:28.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 -- 172.21.15.79:0/76803624 learned_addr learned my addr 172.21.15.79:0/76803624 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:28.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac87fff700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac70003a90 0x7fac8815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac877fe700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 0x7fac8815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 -- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac70003a90 msgr2=0x7fac8815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac70003a90 0x7fac8815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 -- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 msgr2=0x7fac8815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 0x7fac8815bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 -- 172.21.15.79:0/76803624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8815a420 con 0x7fac8813b1c0 2023-10-14T18:50:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac877fe700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 0x7fac8815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8c9f4700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fac80007fd0 tx=0x7fac80009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac800032e0 con 0x7fac8813b1c0 2023-10-14T18:50:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80001580 con 0x7fac8813b1c0 2023-10-14T18:50:28.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8815a700 con 0x7fac8813b1c0 2023-10-14T18:50:28.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80001940 con 0x7fac8813b1c0 2023-10-14T18:50:28.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.414+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac880cc180 con 0x7fac8813b1c0 2023-10-14T18:50:28.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.415+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac88089030 con 0x7fac8813b1c0 2023-10-14T18:50:28.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.415+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac80001cb0 con 0x7fac8813b1c0 2023-10-14T18:50:28.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.416+0000 7fac6ffff700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 0x7fac740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.416+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac80084370 con 0x7fac8813b1c0 2023-10-14T18:50:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.416+0000 7fac87fff700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 0x7fac740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.416+0000 7fac87fff700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 0x7fac740693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fac780091e0 tx=0x7fac7801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.420+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac800515e0 con 0x7fac8813b1c0 2023-10-14T18:50:28.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.603+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fac880d0220 con 0x7fac8813b1c0 2023-10-14T18:50:28.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.604+0000 7fac6ffff700 1 -- 172.21.15.79:0/76803624 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) v1 ==== 81+0+32275 (secure 0 0 0) 0x7fac80054c00 con 0x7fac8813b1c0 2023-10-14T18:50:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:28.606 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 111, 2023-10-14T18:50:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:50:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:50:27.735904+0000", 2023-10-14T18:50:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:50:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:50:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:50:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:50:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:50:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:50:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:50:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:50:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:50:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:50:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 13, 2023-10-14T18:50:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:50:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:50:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:50:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:50:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:50:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:50:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:50:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:50:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:50:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:50:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:50:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:50:28.615 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:50:28.615 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.615 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.615 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.615 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.616 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.616 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:50:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:50:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.626 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:50:28.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.626 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 12, 2023-10-14T18:50:28.627 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:50:28.627 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:55.294128+0000", 2023-10-14T18:50:28.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.628 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.629 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.629 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.629 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.629 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:50:28.629 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:50:28.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:50:28.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:50:28.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:50:28.630 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.630 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.631 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.633 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.633 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.633 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.633 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.633 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.634 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.634 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.634 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.634 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.634 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.635 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.635 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.635 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.635 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.635 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.636 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.637 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.638 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.639 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.640 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:50:28.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:50:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:50:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:28.642 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:50:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 13, 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:49:56.196375+0000", 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:50:28.644 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:50:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:50:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:50:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:50:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:50:28.645 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:50:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:50:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:50:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:50:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:50:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:50:28.647 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:50:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:50:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:50:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:50:28.648 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:50:28.649 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:50:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:50:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:50:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:50:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:50:28.650 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:50:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:50:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:50:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:50:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:50:28.651 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:50:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:50:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:50:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:50:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:50:28.652 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:50:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:50:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:50:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:50:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:50:28.653 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:50:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:50:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:50:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:50:28.654 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:50:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:50:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:50:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:50:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:50:28.655 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:50:28.656 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:50:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:50:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:50:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:50:28.657 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:50:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.658 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:50:28.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:28.659 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.659 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.659 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.660 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:50:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:50:28.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.664 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.664 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.664 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:50:28.665 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:50:28.667 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.668 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:50:28.668 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:50:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.671 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:50:28.671 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:50:28.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.672 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:50:28.672 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:50:28.672 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:50:28.672 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:50:28.672 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.673 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.673 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.674 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.675 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.675 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.675 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.675 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.675 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.676 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:50:28.677 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:50:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:50:28.679 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.681 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.682 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:50:28.682 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:50:28.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:50:28.685 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.685 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:50:28.686 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:50:28.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.686 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:50:28.687 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:50:28.687 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:50:28.687 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:50:28.687 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.687 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:28.688 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.689 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.689 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.689 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.689 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.689 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.690 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:50:28.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:50:28.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.693 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.693 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:50:28.694 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.696 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:50:28.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:50:28.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:50:28.699 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:50:28.700 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:50:28.701 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:50:28.702 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:50:28.702 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.702 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.702 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.703 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:28.703 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.704 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.705 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.705 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.705 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:50:28.706 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:50:28.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.708 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.710 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:50:28.710 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:50:28.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.713 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:50:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:50:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.716 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:50:28.716 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:50:28.716 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:50:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:50:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.718 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.719 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.720 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.720 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.720 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.720 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.721 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:50:28.721 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.723 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.723 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.724 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:50:28.724 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.725 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:50:28.725 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:50:28.726 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.727 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:50:28.727 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:50:28.729 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:50:28.730 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:50:28.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:50:28.731 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.733 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.734 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:50:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.737 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.738 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.738 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:50:28.738 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:50:28.739 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:50:28.742 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:50:28.744 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:50:28.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.745 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:50:28.745 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:50:28.746 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:50:28.746 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:50:28.746 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.746 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.746 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.747 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:28.747 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.748 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.750 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.750 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:50:28.750 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.752 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.752 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.753 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:50:28.753 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.754 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:50:28.754 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.754 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.755 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.755 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.756 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:50:28.756 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.757 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.758 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.758 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:50:28.758 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.759 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:50:28.759 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:50:28.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.760 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.760 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:50:28.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:28.762 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:50:28.762 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:50:28.763 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:50:28.763 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:50:28.763 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:50:28.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:50:28.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:50:28.764 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.765 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:50:28.765 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.766 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:50:28.766 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.768 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:50:28.768 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:50:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:50:28.770 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.771 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:50:28.771 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.772 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:50:28.772 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:50:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:50:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:50:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.775 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:50:28.775 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:50:28.775 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:50:28.775 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:50:28.776 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:50:28.776 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:50:28.776 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:50:28.776 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:28.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.777 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:50:28.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:50:28.777 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:50:28.778 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:50:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.779 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:50:28.781 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.781 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.781 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.782 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.782 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.782 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:50:28.782 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:50:28.783 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.783 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.783 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:50:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.785 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.786 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:50:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.787 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:50:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.788 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:50:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.789 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:50:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:28.790 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:50:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:50:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:50:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:50:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:50:28.792 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:50:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:50:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:50:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:50:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:50:28.793 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:50:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:50:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:50:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:50:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:50:28.794 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:50:28.795 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:50:28.796 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:50:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:50:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:50:28.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:28.797 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 msgr2=0x7fac740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 0x7fac740693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fac780091e0 tx=0x7fac7801a000 comp rx=0 tx=0).stop 2023-10-14T18:50:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 msgr2=0x7fac8813b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fac80007fd0 tx=0x7fac80009040 comp rx=0 tx=0).stop 2023-10-14T18:50:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 shutdown_connections 2023-10-14T18:50:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fac74066f30 0x7fac740693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac8813b1c0 0x7fac8813b610 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac70003a90 0x7fac8815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 --2- 172.21.15.79:0/76803624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8815b720 0x7fac8815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 >> 172.21.15.79:0/76803624 conn(0x7fac88069750 msgr2=0x7fac880d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 shutdown_connections 2023-10-14T18:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.606+0000 7fac8d1f5700 1 -- 172.21.15.79:0/76803624 wait complete. 2023-10-14T18:50:28.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.918+0000 7f1ec33d8700 1 Processor -- start 2023-10-14T18:50:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.918+0000 7f1ec33d8700 1 -- start start 2023-10-14T18:50:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec33d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc1568d0 0x7f1ebc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec33d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec33d8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ebc067ba0 con 0x7f1ebc156ca0 2023-10-14T18:50:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec33d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ebc15aa90 con 0x7f1ebc0ad9b0 2023-10-14T18:50:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec33d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc067870 con 0x7f1ebc1568d0 2023-10-14T18:50:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec0973700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec0973700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38436/0 (socket says 172.21.15.79:38436) 2023-10-14T18:50:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.919+0000 7f1ec0973700 1 -- 172.21.15.79:0/1903148744 learned_addr learned my addr 172.21.15.79:0/1903148744 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec1174700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc1568d0 0x7f1ebc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec0973700 1 -- 172.21.15.79:0/1903148744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc1568d0 msgr2=0x7f1ebc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec0973700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc1568d0 0x7f1ebc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec0973700 1 -- 172.21.15.79:0/1903148744 >> v1:172.21.15.144:6789/0 conn(0x7f1ebc156ca0 legacy=0x7f1ebc0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec0973700 1 -- 172.21.15.79:0/1903148744 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0c8ca0 con 0x7f1ebc0ad9b0 2023-10-14T18:50:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1ec0973700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00bc50 tx=0x7f1eac00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58e4f034d9468ef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1eb3fff700 1 -- 172.21.15.79:0/1903148744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00dbf0 con 0x7f1ebc0ad9b0 2023-10-14T18:50:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1eb3fff700 1 -- 172.21.15.79:0/1903148744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac00dd50 con 0x7f1ebc0ad9b0 2023-10-14T18:50:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.920+0000 7f1eb3fff700 1 -- 172.21.15.79:0/1903148744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac0196b0 con 0x7f1ebc0ad9b0 2023-10-14T18:50:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 -- 172.21.15.79:0/1903148744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc0ad9b0 msgr2=0x7f1ebc06a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00bc50 tx=0x7f1eac00b4f0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 -- 172.21.15.79:0/1903148744 shutdown_connections 2023-10-14T18:50:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc1568d0 0x7f1ebc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/1903148744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc0ad9b0 0x7f1ebc06a360 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 -- 172.21.15.79:0/1903148744 >> 172.21.15.79:0/1903148744 conn(0x7f1ebc0cda50 msgr2=0x7f1ebc0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 -- 172.21.15.79:0/1903148744 shutdown_connections 2023-10-14T18:50:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.921+0000 7f1ec33d8700 1 -- 172.21.15.79:0/1903148744 wait complete. 2023-10-14T18:50:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.922+0000 7f1ec33d8700 1 Processor -- start 2023-10-14T18:50:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.922+0000 7f1ec33d8700 1 -- start start 2023-10-14T18:50:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ebc1568d0 0x7f1ebc155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc0b20a0 0x7f1ebc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0b1000 con 0x7f1ebc156ca0 2023-10-14T18:50:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0b12e0 con 0x7f1ebc1568d0 2023-10-14T18:50:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec33d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ebc0b15c0 con 0x7f1ebc0b20a0 2023-10-14T18:50:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38446/0 (socket says 172.21.15.79:38446) 2023-10-14T18:50:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 -- 172.21.15.79:0/2923929719 learned_addr learned my addr 172.21.15.79:0/2923929719 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec1174700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ebc1568d0 0x7f1ebc155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec1975700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc0b20a0 0x7f1ebc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 -- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc0b20a0 msgr2=0x7f1ebc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc0b20a0 0x7f1ebc0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 -- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ebc1568d0 msgr2=0x7f1ebc155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ebc1568d0 0x7f1ebc155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 -- 172.21.15.79:0/2923929719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac00b790 con 0x7f1ebc156ca0 2023-10-14T18:50:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1ec0973700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00bc50 tx=0x7f1eac01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.923+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00dec0 con 0x7f1ebc156ca0 2023-10-14T18:50:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.924+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac010680 con 0x7f1ebc156ca0 2023-10-14T18:50:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.924+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eac010a00 con 0x7f1ebc156ca0 2023-10-14T18:50:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.924+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc0b18a0 con 0x7f1ebc156ca0 2023-10-14T18:50:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.924+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ebc152d10 con 0x7f1ebc156ca0 2023-10-14T18:50:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.925+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ebc0b1dc0 con 0x7f1ebc156ca0 2023-10-14T18:50:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.925+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eac02c430 con 0x7f1ebc156ca0 2023-10-14T18:50:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.925+0000 7f1eb17fa700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.925+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1eac014070 con 0x7f1ebc156ca0 2023-10-14T18:50:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.925+0000 7f1ec1174700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.926+0000 7f1ec1174700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800f570 tx=0x7f1eb800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:28.929+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ebc0b1dc0 con 0x7f1ebc156ca0 2023-10-14T18:50:29.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.153+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ebc0b1dc0 con 0x7f1ebc156ca0 2023-10-14T18:50:29.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.153+0000 7f1eb17fa700 1 -- 172.21.15.79:0/2923929719 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f1ebc0b1dc0 con 0x7f1ebc156ca0 2023-10-14T18:50:29.155 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:29.155 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:29.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 msgr2=0x7f1ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 0x7f1ea00693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800f570 tx=0x7f1eb800b040 comp rx=0 tx=0).stop 2023-10-14T18:50:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 msgr2=0x7f1ebc0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00bc50 tx=0x7f1eac01b000 comp rx=0 tx=0).stop 2023-10-14T18:50:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 shutdown_connections 2023-10-14T18:50:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea0066f30 0x7f1ea00693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ebc0b20a0 0x7f1ebc0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ebc1568d0 0x7f1ebc155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.155+0000 7f1ec33d8700 1 --2- 172.21.15.79:0/2923929719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ebc156ca0 0x7f1ebc0b0900 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.156+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 >> 172.21.15.79:0/2923929719 conn(0x7f1ebc0cda50 msgr2=0x7f1ebc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.156+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 shutdown_connections 2023-10-14T18:50:29.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.156+0000 7f1ec33d8700 1 -- 172.21.15.79:0/2923929719 wait complete. 2023-10-14T18:50:29.159 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:29.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:50:29.301 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":6348,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.445046079000001,"mdsmap_epoch":48,"osdmap_epoch":111,"osdmap_epoch_barrier":106,"uptime":37.420747087999999} 2023-10-14T18:50:29.301 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 6348, "mdsmap_epoch": 48, "osdmap_epoch": 111, "osdmap_epoch_barrier": 106, "rank_uptime": 31.445046079, "state": "up:active", "uptime": 37.420747088, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:50:29.302 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:50:29.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:29.303 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-14T18:50:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:50:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:50:29.597 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.276633 s, 190 MB/s 2023-10-14T18:50:29.598 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:50:29.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:50:29.640 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:50:29.678 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:50:29.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:50:29.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:29.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:29.745 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:50:29.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:29.746 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:50:29.761 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:50:29.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:29.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:29.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:50:29.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:29.808 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:50:29.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:29.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.937+0000 7f3925984700 1 Processor -- start 2023-10-14T18:50:29.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.937+0000 7f3925984700 1 -- start start 2023-10-14T18:50:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f3925984700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39200c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f3925984700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39200b1220 0x7f392006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f3925984700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392015de60 con 0x7f392006dad0 2023-10-14T18:50:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f3925984700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392015e140 con 0x7f39200b1220 2023-10-14T18:50:29.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f3925984700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392015e420 con 0x7f39200b0e50 2023-10-14T18:50:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f391e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39200b1220 0x7f392006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f391e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39200b1220 0x7f392006d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38448/0 (socket says 172.21.15.79:38448) 2023-10-14T18:50:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f391e7fc700 1 -- 172.21.15.79:0/993900259 learned_addr learned my addr 172.21.15.79:0/993900259 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f391f7fe700 1 --1- 172.21.15.79:0/993900259 >> v1:172.21.15.79:6789/0 conn(0x7f392006dad0 0x7f39200cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51310/0 (socket says 172.21.15.79:51310) 2023-10-14T18:50:29.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.938+0000 7f391effd700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39200c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391e7fc700 1 -- 172.21.15.79:0/993900259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 msgr2=0x7f39200c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391e7fc700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39200c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391e7fc700 1 -- 172.21.15.79:0/993900259 >> v1:172.21.15.79:6789/0 conn(0x7f392006dad0 legacy=0x7f39200cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391e7fc700 1 -- 172.21.15.79:0/993900259 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392015e700 con 0x7f39200b1220 2023-10-14T18:50:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391dffb700 1 -- 172.21.15.79:0/993900259 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254068988 0 0) 0x7f392015de60 con 0x7f392006dad0 2023-10-14T18:50:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391effd700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39200c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391e7fc700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f392006d590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f39080099e0 tx=0x7f3908009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54fc82d9cad330 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391dffb700 1 -- 172.21.15.79:0/993900259 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800b820 con 0x7f39200b1220 2023-10-14T18:50:29.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391dffb700 1 -- 172.21.15.79:0/993900259 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390800b980 con 0x7f39200b1220 2023-10-14T18:50:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f391dffb700 1 -- 172.21.15.79:0/993900259 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800bd40 con 0x7f39200b1220 2023-10-14T18:50:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 -- 172.21.15.79:0/993900259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 msgr2=0x7f392006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f392006d590 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f39080099e0 tx=0x7f3908009250 comp rx=0 tx=0).stop 2023-10-14T18:50:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 -- 172.21.15.79:0/993900259 shutdown_connections 2023-10-14T18:50:29.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39200c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 --2- 172.21.15.79:0/993900259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f392006d590 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.939+0000 7f3925984700 1 -- 172.21.15.79:0/993900259 >> 172.21.15.79:0/993900259 conn(0x7f3920069870 msgr2=0x7f3920069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:29.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.940+0000 7f3925984700 1 -- 172.21.15.79:0/993900259 shutdown_connections 2023-10-14T18:50:29.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.940+0000 7f3925984700 1 -- 172.21.15.79:0/993900259 wait complete. 2023-10-14T18:50:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 Processor -- start 2023-10-14T18:50:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 -- start start 2023-10-14T18:50:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392006dad0 0x7f3920147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39201582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392016e740 con 0x7f39200b1220 2023-10-14T18:50:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392016db30 con 0x7f392006dad0 2023-10-14T18:50:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.941+0000 7f3925984700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392016de10 con 0x7f39200b0e50 2023-10-14T18:50:29.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38462/0 (socket says 172.21.15.79:38462) 2023-10-14T18:50:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 -- 172.21.15.79:0/2263589625 learned_addr learned my addr 172.21.15.79:0/2263589625 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391e7fc700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39201582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391effd700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392006dad0 0x7f3920147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 -- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 msgr2=0x7f39201582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39201582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 -- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392006dad0 msgr2=0x7f3920147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392006dad0 0x7f3920147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:29.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 -- 172.21.15.79:0/2263589625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080094f0 con 0x7f39200b1220 2023-10-14T18:50:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391e7fc700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39201582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f391f7fe700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f39180011e0 tx=0x7f3918007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918005a70 con 0x7f39200b1220 2023-10-14T18:50:29.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918005bd0 con 0x7f39200b1220 2023-10-14T18:50:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392016e0f0 con 0x7f39200b1220 2023-10-14T18:50:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180070d0 con 0x7f39200b1220 2023-10-14T18:50:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.942+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39201479a0 con 0x7f39200b1220 2023-10-14T18:50:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.943+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3920147b90 con 0x7f39200b1220 2023-10-14T18:50:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.943+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3918007440 con 0x7f39200b1220 2023-10-14T18:50:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.944+0000 7f3916ffd700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.944+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3918083b20 con 0x7f39200b1220 2023-10-14T18:50:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.944+0000 7f391effd700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:29.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.944+0000 7f391effd700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39100076a0 tx=0x7f39100098f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:29.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:29.948+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3918050d90 con 0x7f39200b1220 2023-10-14T18:50:30.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.172+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f392004c3c0 con 0x7f39200b1220 2023-10-14T18:50:30.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.172+0000 7f3916ffd700 1 -- 172.21.15.79:0/2263589625 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f3918017020 con 0x7f39200b1220 2023-10-14T18:50:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:30.174 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:30.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 msgr2=0x7f39000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 0x7f39000693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39100076a0 tx=0x7f39100098f0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 msgr2=0x7f39201587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f39180011e0 tx=0x7f3918007d30 comp rx=0 tx=0).stop 2023-10-14T18:50:30.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 shutdown_connections 2023-10-14T18:50:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3900066f30 0x7f39000693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39200b1220 0x7f39201587f0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f392006dad0 0x7f3920147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 --2- 172.21.15.79:0/2263589625 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f39200b0e50 0x7f39201582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 >> 172.21.15.79:0/2263589625 conn(0x7f3920069870 msgr2=0x7f39200c3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 shutdown_connections 2023-10-14T18:50:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.174+0000 7f3925984700 1 -- 172.21.15.79:0/2263589625 wait complete. 2023-10-14T18:50:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:30.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:30.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.300+0000 7fe56ead6700 1 Processor -- start 2023-10-14T18:50:30.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.301+0000 7fe56ead6700 1 -- start start 2023-10-14T18:50:30.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.301+0000 7fe56ead6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe568159f10 0x7fe5680c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.301+0000 7fe56ead6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe56815a2e0 0x7fe5680cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.301+0000 7fe56ead6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56ead6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56815a760 con 0x7fe568159f10 2023-10-14T18:50:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56ead6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680ae320 con 0x7fe56815a2e0 2023-10-14T18:50:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56ead6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680ad710 con 0x7fe5680cc240 2023-10-14T18:50:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe568159f10 0x7fe5680c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe568159f10 0x7fe5680c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38466/0 (socket says 172.21.15.79:38466) 2023-10-14T18:50:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 -- 172.21.15.79:0/3365152106 learned_addr learned my addr 172.21.15.79:0/3365152106 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56d2d3700 1 --2- 172.21.15.79:0/3365152106 >> v2:172.21.15.144:3300/0 conn(0x7fe56815a2e0 0x7fe5680cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56e2d5700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 -- 172.21.15.79:0/3365152106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 msgr2=0x7fe5680ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 -- 172.21.15.79:0/3365152106 >> v2:172.21.15.144:3300/0 conn(0x7fe56815a2e0 msgr2=0x7fe5680cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3365152106 >> v2:172.21.15.144:3300/0 conn(0x7fe56815a2e0 0x7fe5680cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 -- 172.21.15.79:0/3365152106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680ad9f0 con 0x7fe568159f10 2023-10-14T18:50:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568159f10 0x7fe5680c59e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c7a10 tx=0x7fe564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfb9a0a768e96f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56cad2700 1 -- 172.21.15.79:0/3365152106 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400b640 con 0x7fe568159f10 2023-10-14T18:50:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56cad2700 1 -- 172.21.15.79:0/3365152106 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400b7a0 con 0x7fe568159f10 2023-10-14T18:50:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.302+0000 7fe56cad2700 1 -- 172.21.15.79:0/3365152106 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400bb60 con 0x7fe568159f10 2023-10-14T18:50:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 -- 172.21.15.79:0/3365152106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568159f10 msgr2=0x7fe5680c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568159f10 0x7fe5680c59e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c7a10 tx=0x7fe564009250 comp rx=0 tx=0).stop 2023-10-14T18:50:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 -- 172.21.15.79:0/3365152106 shutdown_connections 2023-10-14T18:50:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3365152106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe568159f10 0x7fe5680c59e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3365152106 >> v2:172.21.15.144:3300/0 conn(0x7fe56815a2e0 0x7fe5680cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 -- 172.21.15.79:0/3365152106 >> 172.21.15.79:0/3365152106 conn(0x7fe568067e40 msgr2=0x7fe5680d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 -- 172.21.15.79:0/3365152106 shutdown_connections 2023-10-14T18:50:30.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.303+0000 7fe56ead6700 1 -- 172.21.15.79:0/3365152106 wait complete. 2023-10-14T18:50:30.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.304+0000 7fe56ead6700 1 Processor -- start 2023-10-14T18:50:30.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.304+0000 7fe56ead6700 1 -- start start 2023-10-14T18:50:30.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe568159f10 0x7fe5680b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c7e20 con 0x7fe56815a2e0 2023-10-14T18:50:30.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c8100 con 0x7fe568159f10 2023-10-14T18:50:30.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c83e0 con 0x7fe5680cc240 2023-10-14T18:50:30.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38478/0 (socket says 172.21.15.79:38478) 2023-10-14T18:50:30.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 -- 172.21.15.79:0/3674237363 learned_addr learned my addr 172.21.15.79:0/3674237363 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56d2d3700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe568159f10 0x7fe5680b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 -- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 msgr2=0x7fe5680ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 -- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe568159f10 msgr2=0x7fe5680b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe568159f10 0x7fe5680b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 -- 172.21.15.79:0/3674237363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640094f0 con 0x7fe56815a2e0 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56e2d5700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe560009e90 tx=0x7fe56000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000caa0 con 0x7fe56815a2e0 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000f040 con 0x7fe56815a2e0 2023-10-14T18:50:30.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5680c86c0 con 0x7fe56815a2e0 2023-10-14T18:50:30.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.305+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000ce50 con 0x7fe56815a2e0 2023-10-14T18:50:30.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.306+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5680b6800 con 0x7fe56815a2e0 2023-10-14T18:50:30.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.307+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5680c8be0 con 0x7fe56815a2e0 2023-10-14T18:50:30.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.307+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe560014690 con 0x7fe56815a2e0 2023-10-14T18:50:30.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.307+0000 7fe55dffb700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.308+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe560085150 con 0x7fe56815a2e0 2023-10-14T18:50:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.308+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.308+0000 7fe56dad4700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c7a10 tx=0x7fe564017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.312+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5680c8be0 con 0x7fe56815a2e0 2023-10-14T18:50:30.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.494+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5680c8be0 con 0x7fe56815a2e0 2023-10-14T18:50:30.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.495+0000 7fe55dffb700 1 -- 172.21.15.79:0/3674237363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fe5680c8be0 con 0x7fe56815a2e0 2023-10-14T18:50:30.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:30.496 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":111,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:27.735904+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:30.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 msgr2=0x7fe54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 0x7fe54c0693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c7a10 tx=0x7fe564017000 comp rx=0 tx=0).stop 2023-10-14T18:50:30.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 msgr2=0x7fe5681576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe560009e90 tx=0x7fe56000b040 comp rx=0 tx=0).stop 2023-10-14T18:50:30.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 shutdown_connections 2023-10-14T18:50:30.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe54c066f30 0x7fe54c0693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe56815a2e0 0x7fe5681576a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5680cc240 0x7fe5680ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 --2- 172.21.15.79:0/3674237363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe568159f10 0x7fe5680b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 >> 172.21.15.79:0/3674237363 conn(0x7fe568067e40 msgr2=0x7fe5680c6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 shutdown_connections 2023-10-14T18:50:30.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.497+0000 7fe56ead6700 1 -- 172.21.15.79:0/3674237363 wait complete. 2023-10-14T18:50:30.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:49:55.294128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:49:56.196375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:50:30.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:50:30.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.629+0000 7f83a11a1700 1 Processor -- start 2023-10-14T18:50:30.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.629+0000 7f83a11a1700 1 -- start start 2023-10-14T18:50:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a11a1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f839c06d7a0 0x7f839c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a11a1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f839c06f480 0x7f839c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a11a1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c0ca520 con 0x7f839c06f0b0 2023-10-14T18:50:30.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a11a1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c06dc30 con 0x7f839c06f480 2023-10-14T18:50:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a11a1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c06df10 con 0x7f839c06d7a0 2023-10-14T18:50:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f839bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f839c06f0b0 0x7f839c158c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51312/0 (socket says 172.21.15.79:51312) 2023-10-14T18:50:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f83a09a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f839c06f480 0x7f839c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.630+0000 7f839bfff700 1 -- 172.21.15.79:0/2212950464 learned_addr learned my addr 172.21.15.79:0/2212950464 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:30.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a09a0700 1 -- 172.21.15.79:0/2212950464 >> v2:172.21.15.144:3300/0 conn(0x7f839c06d7a0 msgr2=0x7f839c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f839b7fe700 1 --2- 172.21.15.79:0/2212950464 >> v2:172.21.15.144:3300/0 conn(0x7f839c06d7a0 0x7f839c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a09a0700 1 --2- 172.21.15.79:0/2212950464 >> v2:172.21.15.144:3300/0 conn(0x7f839c06d7a0 0x7f839c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f839affd700 1 -- 172.21.15.79:0/2212950464 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169021618 0 0) 0x7f839c0ca520 con 0x7f839c06f0b0 2023-10-14T18:50:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a09a0700 1 -- 172.21.15.79:0/2212950464 >> v1:172.21.15.79:6789/0 conn(0x7f839c06f0b0 legacy=0x7f839c158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a09a0700 1 -- 172.21.15.79:0/2212950464 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c06e1f0 con 0x7f839c06f480 2023-10-14T18:50:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a09a0700 1 --2- 172.21.15.79:0/2212950464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06f480 0x7f839c0cc170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8394009e60 tx=0x7f8394009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703ed5a0997f2dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f839affd700 1 -- 172.21.15.79:0/2212950464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400e070 con 0x7f839c06f480 2023-10-14T18:50:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f839affd700 1 -- 172.21.15.79:0/2212950464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839400bbf0 con 0x7f839c06f480 2023-10-14T18:50:30.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f839affd700 1 -- 172.21.15.79:0/2212950464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394012430 con 0x7f839c06f480 2023-10-14T18:50:30.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a11a1700 1 -- 172.21.15.79:0/2212950464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06f480 msgr2=0x7f839c0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.631+0000 7f83a11a1700 1 --2- 172.21.15.79:0/2212950464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06f480 0x7f839c0cc170 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8394009e60 tx=0x7f8394009780 comp rx=0 tx=0).stop 2023-10-14T18:50:30.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 -- 172.21.15.79:0/2212950464 shutdown_connections 2023-10-14T18:50:30.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 --2- 172.21.15.79:0/2212950464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06f480 0x7f839c0cc170 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 --2- 172.21.15.79:0/2212950464 >> v2:172.21.15.144:3300/0 conn(0x7f839c06d7a0 0x7f839c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 -- 172.21.15.79:0/2212950464 >> 172.21.15.79:0/2212950464 conn(0x7f839c0cdbc0 msgr2=0x7f839c0c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 -- 172.21.15.79:0/2212950464 shutdown_connections 2023-10-14T18:50:30.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.632+0000 7f83a11a1700 1 -- 172.21.15.79:0/2212950464 wait complete. 2023-10-14T18:50:30.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.633+0000 7f83a11a1700 1 Processor -- start 2023-10-14T18:50:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.633+0000 7f83a11a1700 1 -- start start 2023-10-14T18:50:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f839c06f0b0 0x7f839c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f839c06f480 0x7f839c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c83d0 con 0x7f839c06d7a0 2023-10-14T18:50:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c77c0 con 0x7f839c06f0b0 2023-10-14T18:50:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c7aa0 con 0x7f839c06f480 2023-10-14T18:50:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38492/0 (socket says 172.21.15.79:38492) 2023-10-14T18:50:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 -- 172.21.15.79:0/183722201 learned_addr learned my addr 172.21.15.79:0/183722201 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839b7fe700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f839c06f0b0 0x7f839c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a09a0700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f839c06f480 0x7f839c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 -- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f839c06f480 msgr2=0x7f839c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f839c06f480 0x7f839c156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 -- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f839c06f0b0 msgr2=0x7f839c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f839c06f0b0 0x7f839c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 -- 172.21.15.79:0/183722201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009a20 con 0x7f839c06d7a0 2023-10-14T18:50:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f839bfff700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c7e0 tx=0x7f838c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c005b30 con 0x7f839c06d7a0 2023-10-14T18:50:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c005c90 con 0x7f839c06d7a0 2023-10-14T18:50:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c0c7d80 con 0x7f839c06d7a0 2023-10-14T18:50:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c007300 con 0x7f839c06d7a0 2023-10-14T18:50:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.634+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c0c8860 con 0x7f839c06d7a0 2023-10-14T18:50:30.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.635+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c0c8220 con 0x7f839c06d7a0 2023-10-14T18:50:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.636+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f838c01b3b0 con 0x7f839c06d7a0 2023-10-14T18:50:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.636+0000 7f8383fff700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 0x7f83880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.636+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f838c083a50 con 0x7f839c06d7a0 2023-10-14T18:50:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.636+0000 7f839b7fe700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 0x7f83880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.637+0000 7f839b7fe700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 0x7f83880693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f839c0cc190 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.640+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f838c050cc0 con 0x7f839c06d7a0 2023-10-14T18:50:30.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.822+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f839c0c86b0 con 0x7f839c06d7a0 2023-10-14T18:50:30.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.822+0000 7f8383fff700 1 -- 172.21.15.79:0/183722201 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f838c017020 con 0x7f839c06d7a0 2023-10-14T18:50:30.823 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:50:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 msgr2=0x7f83880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 0x7f83880693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f839c0cc190 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-10-14T18:50:30.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 msgr2=0x7f839c0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f838c00c7e0 tx=0x7f838c007df0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 shutdown_connections 2023-10-14T18:50:30.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8388066f30 0x7f83880693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f839c06f480 0x7f839c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f839c06d7a0 0x7f839c0cade0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 --2- 172.21.15.79:0/183722201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f839c06f0b0 0x7f839c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 >> 172.21.15.79:0/183722201 conn(0x7f839c0cdbc0 msgr2=0x7f839c0b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 shutdown_connections 2023-10-14T18:50:30.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.824+0000 7f83a11a1700 1 -- 172.21.15.79:0/183722201 wait complete. 2023-10-14T18:50:30.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:50:30.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.953+0000 7f3304dba700 1 Processor -- start 2023-10-14T18:50:30.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.953+0000 7f3304dba700 1 -- start start 2023-10-14T18:50:30.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f3304dba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3300159ec0 0x7f33000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f3304dba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f330015a290 0x7f33000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f3304dba700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000b0790 con 0x7f330006a5a0 2023-10-14T18:50:30.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f3304dba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000ce1f0 con 0x7f330015a290 2023-10-14T18:50:30.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f3304dba700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000b0b20 con 0x7f3300159ec0 2023-10-14T18:50:30.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f330015a290 0x7f33000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f330015a290 0x7f33000afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38500/0 (socket says 172.21.15.79:38500) 2023-10-14T18:50:30.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 -- 172.21.15.79:0/2845742231 learned_addr learned my addr 172.21.15.79:0/2845742231 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:30.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fe59c700 1 --2- 172.21.15.79:0/2845742231 >> v2:172.21.15.144:3300/0 conn(0x7f3300159ec0 0x7f33000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 -- 172.21.15.79:0/2845742231 >> v2:172.21.15.144:3300/0 conn(0x7f3300159ec0 msgr2=0x7f33000af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:30.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 --2- 172.21.15.79:0/2845742231 >> v2:172.21.15.144:3300/0 conn(0x7f3300159ec0 0x7f33000af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 -- 172.21.15.79:0/2845742231 >> v1:172.21.15.144:6789/0 conn(0x7f330006a5a0 legacy=0x7f330015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:30.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.954+0000 7f32fdd9b700 1 -- 172.21.15.79:0/2845742231 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000b04b0 con 0x7f330015a290 2023-10-14T18:50:30.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f32fdd9b700 1 --2- 172.21.15.79:0/2845742231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330015a290 0x7f33000afe80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f33000898e0 tx=0x7f32e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14d758c638ea9c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f32fd59a700 1 -- 172.21.15.79:0/2845742231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800b860 con 0x7f330015a290 2023-10-14T18:50:30.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f32fd59a700 1 -- 172.21.15.79:0/2845742231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800b9c0 con 0x7f330015a290 2023-10-14T18:50:30.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f32fd59a700 1 -- 172.21.15.79:0/2845742231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800bd60 con 0x7f330015a290 2023-10-14T18:50:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 -- 172.21.15.79:0/2845742231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330015a290 msgr2=0x7f33000afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 --2- 172.21.15.79:0/2845742231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330015a290 0x7f33000afe80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f33000898e0 tx=0x7f32e8009250 comp rx=0 tx=0).stop 2023-10-14T18:50:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 -- 172.21.15.79:0/2845742231 shutdown_connections 2023-10-14T18:50:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 --2- 172.21.15.79:0/2845742231 >> v2:172.21.15.144:3300/0 conn(0x7f3300159ec0 0x7f33000af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 --2- 172.21.15.79:0/2845742231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330015a290 0x7f33000afe80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 -- 172.21.15.79:0/2845742231 >> 172.21.15.79:0/2845742231 conn(0x7f33000d1880 msgr2=0x7f33000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:30.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 -- 172.21.15.79:0/2845742231 shutdown_connections 2023-10-14T18:50:30.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.955+0000 7f3304dba700 1 -- 172.21.15.79:0/2845742231 wait complete. 2023-10-14T18:50:30.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.956+0000 7f3304dba700 1 Processor -- start 2023-10-14T18:50:30.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.956+0000 7f3304dba700 1 -- start start 2023-10-14T18:50:30.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3300159ec0 0x7f330015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f330015a290 0x7f33000b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000a77c0 con 0x7f330006a5a0 2023-10-14T18:50:30.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330015c7b0 con 0x7f3300159ec0 2023-10-14T18:50:30.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f3304dba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330016a800 con 0x7f330015a290 2023-10-14T18:50:30.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f32fe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38514/0 (socket says 172.21.15.79:38514) 2023-10-14T18:50:30.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.957+0000 7f32fe59c700 1 -- 172.21.15.79:0/2778682994 learned_addr learned my addr 172.21.15.79:0/2778682994 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 -- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f330015a290 msgr2=0x7f33000b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f330015a290 0x7f33000b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 -- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3300159ec0 msgr2=0x7f330015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3300159ec0 0x7f330015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 -- 172.21.15.79:0/2778682994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80094f0 con 0x7f330006a5a0 2023-10-14T18:50:30.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32fe59c700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32f000e190 tx=0x7f32f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000ee30 con 0x7f330006a5a0 2023-10-14T18:50:30.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f0014420 con 0x7f330006a5a0 2023-10-14T18:50:30.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f00147e0 con 0x7f330006a5a0 2023-10-14T18:50:30.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330016aae0 con 0x7f330006a5a0 2023-10-14T18:50:30.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.958+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330016b0a0 con 0x7f330006a5a0 2023-10-14T18:50:30.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.959+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330004c3c0 con 0x7f330006a5a0 2023-10-14T18:50:30.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.959+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32f0014b50 con 0x7f330006a5a0 2023-10-14T18:50:30.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.959+0000 7f32f67fc700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 0x7f32e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:30.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.960+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32f0084d40 con 0x7f330006a5a0 2023-10-14T18:50:30.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.960+0000 7f32fdd9b700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 0x7f32e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:30.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.960+0000 7f32fdd9b700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 0x7f32e00693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f33000898e0 tx=0x7f32e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:30.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:30.964+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32f0051fb0 con 0x7f330006a5a0 2023-10-14T18:50:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.144+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33000ceab0 con 0x7f330006a5a0 2023-10-14T18:50:31.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.145+0000 7f32f67fc700 1 -- 172.21.15.79:0/2778682994 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f32f0009a60 con 0x7f330006a5a0 2023-10-14T18:50:31.146 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:50:31.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 msgr2=0x7f32e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 0x7f32e00693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f33000898e0 tx=0x7f32e8017000 comp rx=0 tx=0).stop 2023-10-14T18:50:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 msgr2=0x7f33000ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f32f000e190 tx=0x7f32f0009920 comp rx=0 tx=0).stop 2023-10-14T18:50:31.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 shutdown_connections 2023-10-14T18:50:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f32e0066f30 0x7f32e00693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f330015a290 0x7f33000b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330006a5a0 0x7f33000ca650 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 --2- 172.21.15.79:0/2778682994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3300159ec0 0x7f330015c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 >> 172.21.15.79:0/2778682994 conn(0x7f33000d1880 msgr2=0x7f33000b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 shutdown_connections 2023-10-14T18:50:31.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.147+0000 7f3304dba700 1 -- 172.21.15.79:0/2778682994 wait complete. 2023-10-14T18:50:31.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:50:31.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.274+0000 7fd6b28a9700 1 Processor -- start 2023-10-14T18:50:31.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.274+0000 7fd6b28a9700 1 -- start start 2023-10-14T18:50:31.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6b28a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6ac06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6b28a9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac0b0790 con 0x7fd6ac159ec0 2023-10-14T18:50:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6b28a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac0ce1f0 con 0x7fd6ac06aae0 2023-10-14T18:50:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6b28a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac06af60 con 0x7fd6ac15a290 2023-10-14T18:50:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6abfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd6ac159ec0 0x7fd6ac0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51322/0 (socket says 172.21.15.79:51322) 2023-10-14T18:50:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.275+0000 7fd6abfff700 1 -- 172.21.15.79:0/629017272 learned_addr learned my addr 172.21.15.79:0/629017272 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6ac06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077359778 0 0) 0x7fd6ac0b0790 con 0x7fd6ac159ec0 2023-10-14T18:50:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd694003570 con 0x7fd6ac159ec0 2023-10-14T18:50:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402333771 0 0) 0x7fd694003570 con 0x7fd6ac159ec0 2023-10-14T18:50:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 msgr2=0x7fd6ac06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6ac06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 >> v1:172.21.15.144:6789/0 conn(0x7fd6ac06aae0 legacy=0x7fd6ac0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0b0b20 con 0x7fd6ac159ec0 2023-10-14T18:50:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd69c001470 con 0x7fd6ac159ec0 2023-10-14T18:50:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 >> v1:172.21.15.79:6789/0 conn(0x7fd6ac159ec0 legacy=0x7fd6ac0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd694003a90 0x7fd694003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd694004810 0x7fd694004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6940051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac06af60 con 0x7fd694004810 2023-10-14T18:50:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69400bb60 con 0x7fd694003a90 2023-10-14T18:50:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69400bd20 con 0x7fd6ac15a290 2023-10-14T18:50:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd694004810 0x7fd694004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6abfff700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd694003a90 0x7fd694003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6b0e46700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6940051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 -- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 msgr2=0x7fd6940051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6ac15a290 0x7fd6940051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 -- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd694003a90 msgr2=0x7fd694003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd694003a90 0x7fd694003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.276+0000 7fd6ab7fe700 1 -- 172.21.15.79:0/629017272 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694003570 con 0x7fd694004810 2023-10-14T18:50:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd694004810 0x7fd694004c80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009c00 tx=0x7fd6a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a90837d21109e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000e710 con 0x7fd694004810 2023-10-14T18:50:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a000e870 con 0x7fd694004810 2023-10-14T18:50:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6aaffd700 1 -- 172.21.15.79:0/629017272 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000ec30 con 0x7fd694004810 2023-10-14T18:50:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 -- 172.21.15.79:0/629017272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd694004810 msgr2=0x7fd694004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/629017272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd694004810 0x7fd694004c80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009c00 tx=0x7fd6a00091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b0e46700 1 -- 172.21.15.79:0/629017272 reap_dead start 2023-10-14T18:50:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 -- 172.21.15.79:0/629017272 shutdown_connections 2023-10-14T18:50:31.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 -- 172.21.15.79:0/629017272 >> 172.21.15.79:0/629017272 conn(0x7fd6ac0d1880 msgr2=0x7fd6ac0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 -- 172.21.15.79:0/629017272 shutdown_connections 2023-10-14T18:50:31.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.277+0000 7fd6b28a9700 1 -- 172.21.15.79:0/629017272 wait complete. 2023-10-14T18:50:31.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.278+0000 7fd6b28a9700 1 Processor -- start 2023-10-14T18:50:31.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 -- start start 2023-10-14T18:50:31.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd694004810 0x7fd6ac155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6ac156c90 0x7fd6ac0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac15c0f0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c8e30 con 0x7fd6ac156c90 2023-10-14T18:50:31.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b28a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1564d0 con 0x7fd694004810 2023-10-14T18:50:31.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b0e46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b0e46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38538/0 (socket says 172.21.15.79:38538) 2023-10-14T18:50:31.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.279+0000 7fd6b0e46700 1 -- 172.21.15.79:0/3597793073 learned_addr learned my addr 172.21.15.79:0/3597793073 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:31.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6ab7fe700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6ac156c90 0x7fd6ac0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6abfff700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd694004810 0x7fd6ac155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 -- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd694004810 msgr2=0x7fd6ac155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd694004810 0x7fd6ac155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 -- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6ac156c90 msgr2=0x7fd6ac0b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6ac156c90 0x7fd6ac0b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 -- 172.21.15.79:0/3597793073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0c8220 con 0x7fd6ac1566c0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b0e46700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac089010 tx=0x7fd6a4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4006db0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a400c5a0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac0c8500 con 0x7fd6ac1566c0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400c960 con 0x7fd6ac1566c0 2023-10-14T18:50:31.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.280+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac0c8ac0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.281+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac04c3c0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.281+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6a400ccd0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.282+0000 7fd693fff700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.282+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6a4083e60 con 0x7fd6ac1566c0 2023-10-14T18:50:31.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.282+0000 7fd6abfff700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.282+0000 7fd6abfff700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 0x7fd6980693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd69c001120 tx=0x7fd69c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.286+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6a404c5a0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.469+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6ac0b04b0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.469+0000 7fd693fff700 1 -- 172.21.15.79:0/3597793073 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6a40510d0 con 0x7fd6ac1566c0 2023-10-14T18:50:31.470 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:50:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 msgr2=0x7fd6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 0x7fd6980693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd69c001120 tx=0x7fd69c009040 comp rx=0 tx=0).stop 2023-10-14T18:50:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 msgr2=0x7fd6ac0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac089010 tx=0x7fd6a4001640 comp rx=0 tx=0).stop 2023-10-14T18:50:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 shutdown_connections 2023-10-14T18:50:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd698066f30 0x7fd6980693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6ac1566c0 0x7fd6ac0b5060 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd694004810 0x7fd6ac155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 --2- 172.21.15.79:0/3597793073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6ac156c90 0x7fd6ac0b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 >> 172.21.15.79:0/3597793073 conn(0x7fd6ac0d1880 msgr2=0x7fd6ac0b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 shutdown_connections 2023-10-14T18:50:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.471+0000 7fd6b28a9700 1 -- 172.21.15.79:0/3597793073 wait complete. 2023-10-14T18:50:31.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:31.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.597+0000 7fd2a2855700 1 Processor -- start 2023-10-14T18:50:31.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.597+0000 7fd2a2855700 1 -- start start 2023-10-14T18:50:31.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2855700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd29c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2855700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0cb7c0 con 0x7fd29c15dda0 2023-10-14T18:50:31.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2855700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15e290 con 0x7fd29c0cd6e0 2023-10-14T18:50:31.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2855700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c15e850 con 0x7fd29c0cdab0 2023-10-14T18:50:31.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2054700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd29c15dda0 0x7fd29c15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51324/0 (socket says 172.21.15.79:51324) 2023-10-14T18:50:31.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a2054700 1 -- 172.21.15.79:0/814419903 learned_addr learned my addr 172.21.15.79:0/814419903 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a1052700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd29c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564360870 0 0) 0x7fd29c0cb7c0 con 0x7fd29c15dda0 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.598+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd284003570 con 0x7fd29c15dda0 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3173350677 0 0) 0x7fd284003570 con 0x7fd29c15dda0 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 msgr2=0x7fd29c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd29c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 >> v1:172.21.15.144:6789/0 conn(0x7fd29c0cd6e0 legacy=0x7fd29c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c15e570 con 0x7fd29c15dda0 2023-10-14T18:50:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd294001470 con 0x7fd29c15dda0 2023-10-14T18:50:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 >> v1:172.21.15.79:6789/0 conn(0x7fd29c15dda0 legacy=0x7fd29c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd284003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd284004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284004d50 0x7fd2840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c15e850 con 0x7fd284003fd0 2023-10-14T18:50:31.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28400bb40 con 0x7fd284004d50 2023-10-14T18:50:31.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28400bd00 con 0x7fd29c0cdab0 2023-10-14T18:50:31.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd284004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1853700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd284003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a2054700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284004d50 0x7fd2840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 -- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 msgr2=0x7fd284003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0cdab0 0x7fd284003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 -- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284004d50 msgr2=0x7fd2840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284004d50 0x7fd2840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 -- 172.21.15.79:0/814419903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284003570 con 0x7fd284003fd0 2023-10-14T18:50:31.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a2054700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd284004d50 0x7fd2840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:31.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a1052700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd284004810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd290009c00 tx=0x7fd2900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7d0a65447a72db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000e710 con 0x7fd284003fd0 2023-10-14T18:50:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000e870 con 0x7fd284003fd0 2023-10-14T18:50:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.599+0000 7fd2a0851700 1 -- 172.21.15.79:0/814419903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000ec30 con 0x7fd284003fd0 2023-10-14T18:50:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 -- 172.21.15.79:0/814419903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 msgr2=0x7fd284004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 --2- 172.21.15.79:0/814419903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd284004810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd290009c00 tx=0x7fd2900091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2054700 1 -- 172.21.15.79:0/814419903 reap_dead start 2023-10-14T18:50:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 -- 172.21.15.79:0/814419903 shutdown_connections 2023-10-14T18:50:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 -- 172.21.15.79:0/814419903 >> 172.21.15.79:0/814419903 conn(0x7fd29c067660 msgr2=0x7fd29c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 -- 172.21.15.79:0/814419903 shutdown_connections 2023-10-14T18:50:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.600+0000 7fd2a2855700 1 -- 172.21.15.79:0/814419903 wait complete. 2023-10-14T18:50:31.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.601+0000 7fd2a2855700 1 Processor -- start 2023-10-14T18:50:31.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.601+0000 7fd2a2855700 1 -- start start 2023-10-14T18:50:31.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 0x7fd29c0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0c87a0 0x7fd29c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0cc360 con 0x7fd284003fd0 2023-10-14T18:50:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0c9180 con 0x7fd29c0c7d20 2023-10-14T18:50:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c14d0c0 con 0x7fd29c0c87a0 2023-10-14T18:50:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38544/0 (socket says 172.21.15.79:38544) 2023-10-14T18:50:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 -- 172.21.15.79:0/464919725 learned_addr learned my addr 172.21.15.79:0/464919725 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2054700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0c87a0 0x7fd29c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1052700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 0x7fd29c0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 -- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0c87a0 msgr2=0x7fd29c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0c87a0 0x7fd29c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 -- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 msgr2=0x7fd29c0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 0x7fd29c0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 -- 172.21.15.79:0/464919725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0b2680 con 0x7fd284003fd0 2023-10-14T18:50:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1052700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 0x7fd29c0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a1853700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00eb90 tx=0x7fd28c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c019070 con 0x7fd284003fd0 2023-10-14T18:50:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c001a00 con 0x7fd284003fd0 2023-10-14T18:50:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c0b2960 con 0x7fd284003fd0 2023-10-14T18:50:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.602+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c001dc0 con 0x7fd284003fd0 2023-10-14T18:50:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.603+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0b2f20 con 0x7fd284003fd0 2023-10-14T18:50:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.604+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c0b3110 con 0x7fd284003fd0 2023-10-14T18:50:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.604+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd28c00cb20 con 0x7fd284003fd0 2023-10-14T18:50:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.604+0000 7fd299ffb700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.604+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd28c084950 con 0x7fd284003fd0 2023-10-14T18:50:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.604+0000 7fd2a1052700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.605+0000 7fd2a1052700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 0x7fd2880693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd2900091e0 tx=0x7fd29001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.608+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd28c051c80 con 0x7fd284003fd0 2023-10-14T18:50:31.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.832+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd29c04bb80 con 0x7fd284003fd0 2023-10-14T18:50:31.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.832+0000 7fd299ffb700 1 -- 172.21.15.79:0/464919725 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd28c0552a0 con 0x7fd284003fd0 2023-10-14T18:50:31.833 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:31.833 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:31.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 msgr2=0x7fd2880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 0x7fd2880693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd2900091e0 tx=0x7fd29001a000 comp rx=0 tx=0).stop 2023-10-14T18:50:31.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 msgr2=0x7fd29c14cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd28c00eb90 tx=0x7fd28c0016d0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 shutdown_connections 2023-10-14T18:50:31.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd288066f30 0x7fd2880693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd29c0c87a0 0x7fd29c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd284003fd0 0x7fd29c14cb80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 --2- 172.21.15.79:0/464919725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd29c0c7d20 0x7fd29c0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 >> 172.21.15.79:0/464919725 conn(0x7fd29c067660 msgr2=0x7fd29c0cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 shutdown_connections 2023-10-14T18:50:31.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.834+0000 7fd2a2855700 1 -- 172.21.15.79:0/464919725 wait complete. 2023-10-14T18:50:31.838 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:31.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.960+0000 7f6982006700 1 Processor -- start 2023-10-14T18:50:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.960+0000 7f6982006700 1 -- start start 2023-10-14T18:50:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 0x7f697c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f697c15d580 0x7f697c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15cbb0 con 0x7f697c15d580 2023-10-14T18:50:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c15bfa0 con 0x7f697c15a620 2023-10-14T18:50:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6982006700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c15c280 con 0x7f697c157870 2023-10-14T18:50:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f697c15d580 0x7f697c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f697c15d580 0x7f697c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38548/0 (socket says 172.21.15.79:38548) 2023-10-14T18:50:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 -- 172.21.15.79:0/3236109375 learned_addr learned my addr 172.21.15.79:0/3236109375 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:31.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697b7fe700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6972ffd700 1 --2- 172.21.15.79:0/3236109375 >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 0x7f697c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 -- 172.21.15.79:0/3236109375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 msgr2=0x7f697c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 -- 172.21.15.79:0/3236109375 >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 msgr2=0x7f697c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 --2- 172.21.15.79:0/3236109375 >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 0x7f697c15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f697bfff700 1 -- 172.21.15.79:0/3236109375 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15c560 con 0x7f697c15d580 2023-10-14T18:50:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.961+0000 7f6972ffd700 1 --2- 172.21.15.79:0/3236109375 >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 0x7f697c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:31.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f697bfff700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c158110 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f697c0897d0 tx=0x7f6974009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e313e3ced1d886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f697affd700 1 -- 172.21.15.79:0/3236109375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400e070 con 0x7f697c15d580 2023-10-14T18:50:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f697affd700 1 -- 172.21.15.79:0/3236109375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400ba50 con 0x7f697c15d580 2023-10-14T18:50:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f697affd700 1 -- 172.21.15.79:0/3236109375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740092e0 con 0x7f697c15d580 2023-10-14T18:50:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 -- 172.21.15.79:0/3236109375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 msgr2=0x7f697c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c158110 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f697c0897d0 tx=0x7f6974009840 comp rx=0 tx=0).stop 2023-10-14T18:50:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 -- 172.21.15.79:0/3236109375 shutdown_connections 2023-10-14T18:50:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 --2- 172.21.15.79:0/3236109375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c158110 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 --2- 172.21.15.79:0/3236109375 >> v2:172.21.15.144:3300/0 conn(0x7f697c15a620 0x7f697c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 -- 172.21.15.79:0/3236109375 >> 172.21.15.79:0/3236109375 conn(0x7f697c068ce0 msgr2=0x7f697c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 -- 172.21.15.79:0/3236109375 shutdown_connections 2023-10-14T18:50:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.962+0000 7f6982006700 1 -- 172.21.15.79:0/3236109375 wait complete. 2023-10-14T18:50:31.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.963+0000 7f6982006700 1 Processor -- start 2023-10-14T18:50:31.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 -- start start 2023-10-14T18:50:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f697c15a620 0x7f697c0d0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0b19a0 con 0x7f697c15d580 2023-10-14T18:50:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c16eb20 con 0x7f697c15a620 2023-10-14T18:50:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f6982006700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0b2370 con 0x7f697c157870 2023-10-14T18:50:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f697bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f697bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38552/0 (socket says 172.21.15.79:38552) 2023-10-14T18:50:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.964+0000 7f697bfff700 1 -- 172.21.15.79:0/3529569908 learned_addr learned my addr 172.21.15.79:0/3529569908 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6972ffd700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f697c15a620 0x7f697c0d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697b7fe700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 -- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 msgr2=0x7f697c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 -- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f697c15a620 msgr2=0x7f697c0d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:31.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f697c15a620 0x7f697c0d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:31.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 -- 172.21.15.79:0/3529569908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974009ae0 con 0x7f697c15d580 2023-10-14T18:50:31.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f697bfff700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f697c06b530 tx=0x7f6974018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69740032f0 con 0x7f697c15d580 2023-10-14T18:50:31.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974008e80 con 0x7f697c15d580 2023-10-14T18:50:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697401c640 con 0x7f697c15d580 2023-10-14T18:50:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697c0b0ab0 con 0x7f697c15d580 2023-10-14T18:50:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.965+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c0b1070 con 0x7f697c15d580 2023-10-14T18:50:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.966+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c0b1b10 con 0x7f697c15d580 2023-10-14T18:50:31.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.966+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6974003040 con 0x7f697c15d580 2023-10-14T18:50:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.967+0000 7f6973fff700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.967+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6974085dd0 con 0x7f697c15d580 2023-10-14T18:50:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.967+0000 7f697b7fe700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.967+0000 7f697b7fe700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f696c006fd0 tx=0x7f696c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:31.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:31.971+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6974053040 con 0x7f697c15d580 2023-10-14T18:50:32.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.152+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697c04c3c0 con 0x7f697c15d580 2023-10-14T18:50:32.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.153+0000 7f6973fff700 1 -- 172.21.15.79:0/3529569908 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f6974009940 con 0x7f697c15d580 2023-10-14T18:50:32.154 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:32.154 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":111,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:27.735904+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:32.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 msgr2=0x7f695c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f696c006fd0 tx=0x7f696c008040 comp rx=0 tx=0).stop 2023-10-14T18:50:32.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 msgr2=0x7f697c14ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f697c06b530 tx=0x7f6974018000 comp rx=0 tx=0).stop 2023-10-14T18:50:32.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 shutdown_connections 2023-10-14T18:50:32.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f697c15d580 0x7f697c14ce90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f697c157870 0x7f697c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 --2- 172.21.15.79:0/3529569908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f697c15a620 0x7f697c0d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 >> 172.21.15.79:0/3529569908 conn(0x7f697c068ce0 msgr2=0x7f697c14c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:32.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 shutdown_connections 2023-10-14T18:50:32.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.155+0000 7f6982006700 1 -- 172.21.15.79:0/3529569908 wait complete. 2023-10-14T18:50:32.168 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:50:32.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:32.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.282+0000 7f0e518a0700 1 Processor -- start 2023-10-14T18:50:32.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.282+0000 7f0e518a0700 1 -- start start 2023-10-14T18:50:32.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e518a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e4c157c40 0x7f0e4c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e518a0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c15cbb0 con 0x7f0e4c15a620 2023-10-14T18:50:32.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e518a0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c15bfa0 con 0x7f0e4c157870 2023-10-14T18:50:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e518a0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c15bdb0 con 0x7f0e4c157c40 2023-10-14T18:50:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e4c157c40 0x7f0e4c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e427fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0e4c15a620 0x7f0e4c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51330/0 (socket says 172.21.15.79:51330) 2023-10-14T18:50:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e4c157c40 0x7f0e4c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38554/0 (socket says 172.21.15.79:38554) 2023-10-14T18:50:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e427fc700 1 -- 172.21.15.79:0/3049274369 learned_addr learned my addr 172.21.15.79:0/3049274369 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 -- 172.21.15.79:0/3049274369 >> v1:172.21.15.144:6789/0 conn(0x7f0e4c157870 legacy=0x7f0e4c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 -- 172.21.15.79:0/3049274369 >> v1:172.21.15.79:6789/0 conn(0x7f0e4c15a620 legacy=0x7f0e4c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4a7fc700 1 -- 172.21.15.79:0/3049274369 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142722560 0 0) 0x7f0e4c15cbb0 con 0x7f0e4c15a620 2023-10-14T18:50:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 -- 172.21.15.79:0/3049274369 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c15c280 con 0x7f0e4c157c40 2023-10-14T18:50:32.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.283+0000 7f0e4b7fe700 1 --2- 172.21.15.79:0/3049274369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157c40 0x7f0e4c158110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009e60 tx=0x7f0e44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0362be4a8215f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e4a7fc700 1 -- 172.21.15.79:0/3049274369 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400e070 con 0x7f0e4c157c40 2023-10-14T18:50:32.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e4a7fc700 1 -- 172.21.15.79:0/3049274369 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400bc30 con 0x7f0e4c157c40 2023-10-14T18:50:32.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e4a7fc700 1 -- 172.21.15.79:0/3049274369 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44012430 con 0x7f0e4c157c40 2023-10-14T18:50:32.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 -- 172.21.15.79:0/3049274369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157c40 msgr2=0x7f0e4c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 --2- 172.21.15.79:0/3049274369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157c40 0x7f0e4c158110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009e60 tx=0x7f0e44009780 comp rx=0 tx=0).stop 2023-10-14T18:50:32.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 -- 172.21.15.79:0/3049274369 shutdown_connections 2023-10-14T18:50:32.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 --2- 172.21.15.79:0/3049274369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157c40 0x7f0e4c158110 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 -- 172.21.15.79:0/3049274369 >> 172.21.15.79:0/3049274369 conn(0x7f0e4c068ce0 msgr2=0x7f0e4c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:32.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 -- 172.21.15.79:0/3049274369 shutdown_connections 2023-10-14T18:50:32.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.284+0000 7f0e518a0700 1 -- 172.21.15.79:0/3049274369 wait complete. 2023-10-14T18:50:32.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.285+0000 7f0e518a0700 1 Processor -- start 2023-10-14T18:50:32.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.285+0000 7f0e518a0700 1 -- start start 2023-10-14T18:50:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4c157c40 0x7f0e4c13f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e4c15a620 0x7f0e4c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c14e6e0 con 0x7f0e4c157870 2023-10-14T18:50:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c14ef80 con 0x7f0e4c157c40 2023-10-14T18:50:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e518a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b2eb0 con 0x7f0e4c15a620 2023-10-14T18:50:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38558/0 (socket says 172.21.15.79:38558) 2023-10-14T18:50:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 -- 172.21.15.79:0/1107392262 learned_addr learned my addr 172.21.15.79:0/1107392262 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4b7fe700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e4c15a620 0x7f0e4c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e427fc700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4c157c40 0x7f0e4c13f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 -- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e4c15a620 msgr2=0x7f0e4c0b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e4c15a620 0x7f0e4c0b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 -- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4c157c40 msgr2=0x7f0e4c13f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4c157c40 0x7f0e4c13f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.286+0000 7f0e4affd700 1 -- 172.21.15.79:0/1107392262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44009a20 con 0x7f0e4c157870 2023-10-14T18:50:32.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e4affd700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c5c0 tx=0x7f0e3c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c011590 con 0x7f0e4c157870 2023-10-14T18:50:32.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c011710 con 0x7f0e4c157870 2023-10-14T18:50:32.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c14e930 con 0x7f0e4c157870 2023-10-14T18:50:32.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c011ad0 con 0x7f0e4c157870 2023-10-14T18:50:32.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.287+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c13fd50 con 0x7f0e4c157870 2023-10-14T18:50:32.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.288+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c04c3c0 con 0x7f0e4c157870 2023-10-14T18:50:32.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.288+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e3c01b3b0 con 0x7f0e4c157870 2023-10-14T18:50:32.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.289+0000 7f0e437fe700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.289+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e3c083ad0 con 0x7f0e4c157870 2023-10-14T18:50:32.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.289+0000 7f0e427fc700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.289+0000 7f0e427fc700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 0x7f0e2c0693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c157090 tx=0x7f0e34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.293+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e3c050d40 con 0x7f0e4c157870 2023-10-14T18:50:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.516+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e4c14edd0 con 0x7f0e4c157870 2023-10-14T18:50:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.516+0000 7f0e437fe700 1 -- 172.21.15.79:0/1107392262 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f0e3c017020 con 0x7f0e4c157870 2023-10-14T18:50:32.518 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:32.518 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:32.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 msgr2=0x7f0e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 0x7f0e2c0693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c157090 tx=0x7f0e34009040 comp rx=0 tx=0).stop 2023-10-14T18:50:32.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 msgr2=0x7f0e4c16a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c5c0 tx=0x7f0e3c00c980 comp rx=0 tx=0).stop 2023-10-14T18:50:32.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 shutdown_connections 2023-10-14T18:50:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0e2c066f30 0x7f0e2c0693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0e4c15a620 0x7f0e4c0b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e4c157870 0x7f0e4c16a3d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 --2- 172.21.15.79:0/1107392262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4c157c40 0x7f0e4c13f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 >> 172.21.15.79:0/1107392262 conn(0x7f0e4c068ce0 msgr2=0x7f0e4c0d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:32.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 shutdown_connections 2023-10-14T18:50:32.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.518+0000 7f0e518a0700 1 -- 172.21.15.79:0/1107392262 wait complete. 2023-10-14T18:50:32.524 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:32.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.645+0000 7fb04a048700 1 Processor -- start 2023-10-14T18:50:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.645+0000 7fb04a048700 1 -- start start 2023-10-14T18:50:32.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb04a048700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb04415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb04a048700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04415cbb0 con 0x7fb044157870 2023-10-14T18:50:32.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb04a048700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04415bfa0 con 0x7fb04415d580 2023-10-14T18:50:32.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb04a048700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04415bdb0 con 0x7fb04415a620 2023-10-14T18:50:32.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0437fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb044157870 0x7fb04415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51340/0 (socket says 172.21.15.79:51340) 2023-10-14T18:50:32.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0437fe700 1 -- 172.21.15.79:0/2956673325 learned_addr learned my addr 172.21.15.79:0/2956673325 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:32.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008014505 0 0) 0x7fb04415cbb0 con 0x7fb044157870 2023-10-14T18:50:32.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb042ffd700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb04415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c003570 con 0x7fb044157870 2023-10-14T18:50:32.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111295563 0 0) 0x7fb02c003570 con 0x7fb044157870 2023-10-14T18:50:32.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 msgr2=0x7fb04415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:32.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb04415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.646+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 >> v1:172.21.15.144:6789/0 conn(0x7fb04415d580 legacy=0x7fb044158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04415c280 con 0x7fb044157870 2023-10-14T18:50:32.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb0340017f0 con 0x7fb044157870 2023-10-14T18:50:32.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 >> v1:172.21.15.79:6789/0 conn(0x7fb044157870 legacy=0x7fb04415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb02c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb02c004010 0x7fb02c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb02c004d50 0x7fb02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c00bbf0 con 0x7fb02c004d50 2023-10-14T18:50:32.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c00bd30 con 0x7fb02c004010 2023-10-14T18:50:32.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c00bef0 con 0x7fb04415a620 2023-10-14T18:50:32.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb02c004d50 0x7fb02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0437fe700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb02c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb042ffd700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb02c004010 0x7fb02c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 -- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 msgr2=0x7fb02c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:32.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb04415a620 0x7fb02c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 -- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb02c004010 msgr2=0x7fb02c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:32.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb02c004010 0x7fb02c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 -- 172.21.15.79:0/2956673325 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c003570 con 0x7fb02c004d50 2023-10-14T18:50:32.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb043fff700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb02c004d50 0x7fb02c0051c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb04415d9e0 tx=0x7fb03c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3f85a2ebc0d1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c012420 con 0x7fb02c004d50 2023-10-14T18:50:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c012580 con 0x7fb02c004d50 2023-10-14T18:50:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.647+0000 7fb0427fc700 1 -- 172.21.15.79:0/2956673325 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c012920 con 0x7fb02c004d50 2023-10-14T18:50:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 -- 172.21.15.79:0/2956673325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb02c004d50 msgr2=0x7fb02c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 --2- 172.21.15.79:0/2956673325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb02c004d50 0x7fb02c0051c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb04415d9e0 tx=0x7fb03c007d30 comp rx=0 tx=0).stop 2023-10-14T18:50:32.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb043fff700 1 -- 172.21.15.79:0/2956673325 reap_dead start 2023-10-14T18:50:32.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 -- 172.21.15.79:0/2956673325 shutdown_connections 2023-10-14T18:50:32.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 -- 172.21.15.79:0/2956673325 >> 172.21.15.79:0/2956673325 conn(0x7fb044068ce0 msgr2=0x7fb0440690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:32.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 -- 172.21.15.79:0/2956673325 shutdown_connections 2023-10-14T18:50:32.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.648+0000 7fb04a048700 1 -- 172.21.15.79:0/2956673325 wait complete. 2023-10-14T18:50:32.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.649+0000 7fb04a048700 1 Processor -- start 2023-10-14T18:50:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.649+0000 7fb04a048700 1 -- start start 2023-10-14T18:50:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0440c6d90 0x7fb04415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04416bb20 0x7fb04415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04416b450 con 0x7fb0440c69c0 2023-10-14T18:50:32.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440b26a0 con 0x7fb04416bb20 2023-10-14T18:50:32.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb04a048700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04416b170 con 0x7fb0440c6d90 2023-10-14T18:50:32.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38576/0 (socket says 172.21.15.79:38576) 2023-10-14T18:50:32.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 -- 172.21.15.79:0/3926573481 learned_addr learned my addr 172.21.15.79:0/3926573481 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:32.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb042ffd700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0440c6d90 0x7fb04415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb043fff700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04416bb20 0x7fb04415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 -- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0440c6d90 msgr2=0x7fb04415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0440c6d90 0x7fb04415e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 -- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04416bb20 msgr2=0x7fb04415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04416bb20 0x7fb04415ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.650+0000 7fb0437fe700 1 -- 172.21.15.79:0/3926573481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440b2050 con 0x7fb0440c69c0 2023-10-14T18:50:32.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb0437fe700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb03400a640 tx=0x7fb0340021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034013600 con 0x7fb0440c69c0 2023-10-14T18:50:32.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034013780 con 0x7fb0440c69c0 2023-10-14T18:50:32.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440b2330 con 0x7fb0440c69c0 2023-10-14T18:50:32.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034013b40 con 0x7fb0440c69c0 2023-10-14T18:50:32.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.651+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440b2d70 con 0x7fb0440c69c0 2023-10-14T18:50:32.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.652+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0440b1eb0 con 0x7fb0440c69c0 2023-10-14T18:50:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.652+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb03401c400 con 0x7fb0440c69c0 2023-10-14T18:50:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.652+0000 7fb02b7fe700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.653+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb034085720 con 0x7fb0440c69c0 2023-10-14T18:50:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.653+0000 7fb042ffd700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.653+0000 7fb042ffd700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 0x7fb0300693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb038006f00 tx=0x7fb038008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:32.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.657+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0440b1eb0 con 0x7fb0440c69c0 2023-10-14T18:50:32.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.882+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0440b1eb0 con 0x7fb0440c69c0 2023-10-14T18:50:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.882+0000 7fb02b7fe700 1 -- 172.21.15.79:0/3926573481 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fb0440b1eb0 con 0x7fb0440c69c0 2023-10-14T18:50:32.884 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:32.884 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:49:57.226431+0000","modified":"2023-10-14T18:50:00.866172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6348":{"gid":6348,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1750729224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1750729224},{"type":"v1","addr":"172.21.15.79:6835","nonce":1750729224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-14T18:50:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 msgr2=0x7fb0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 0x7fb0300693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb038006f00 tx=0x7fb038008040 comp rx=0 tx=0).stop 2023-10-14T18:50:32.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 msgr2=0x7fb04416b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb03400a640 tx=0x7fb0340021d0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 shutdown_connections 2023-10-14T18:50:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04416bb20 0x7fb04415ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0440c69c0 0x7fb04416b5e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 --2- 172.21.15.79:0/3926573481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb0440c6d90 0x7fb04415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 >> 172.21.15.79:0/3926573481 conn(0x7fb044068ce0 msgr2=0x7fb044159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.884+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 shutdown_connections 2023-10-14T18:50:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:32.885+0000 7fb04a048700 1 -- 172.21.15.79:0/3926573481 wait complete. 2023-10-14T18:50:32.888 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 48 2023-10-14T18:50:32.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:33.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.012+0000 7fea1b06e700 1 Processor -- start 2023-10-14T18:50:33.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.012+0000 7fea1b06e700 1 -- start start 2023-10-14T18:50:33.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea1b06e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea14157870 0x7fea1415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea1b06e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1415cbb0 con 0x7fea1415a620 2023-10-14T18:50:33.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea1b06e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1415bfa0 con 0x7fea14157c40 2023-10-14T18:50:33.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea1b06e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1415c280 con 0x7fea14157870 2023-10-14T18:50:33.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea18e0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fea14157870 0x7fea1415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea0bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fea1415a620 0x7fea1415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51342/0 (socket says 172.21.15.79:51342) 2023-10-14T18:50:33.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea0bfff700 1 -- 172.21.15.79:0/4115678208 learned_addr learned my addr 172.21.15.79:0/4115678208 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:33.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea18e0a700 1 -- 172.21.15.79:0/4115678208 >> v1:172.21.15.144:6789/0 conn(0x7fea14157c40 legacy=0x7fea14158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:33.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea18e0a700 1 -- 172.21.15.79:0/4115678208 >> v1:172.21.15.79:6789/0 conn(0x7fea1415a620 legacy=0x7fea1415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea18e0a700 1 -- 172.21.15.79:0/4115678208 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1415c560 con 0x7fea14157870 2023-10-14T18:50:33.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea0b7fe700 1 -- 172.21.15.79:0/4115678208 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187585913 0 0) 0x7fea1415cbb0 con 0x7fea1415a620 2023-10-14T18:50:33.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.013+0000 7fea18e0a700 1 --2- 172.21.15.79:0/4115678208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea14157870 0x7fea1415b6a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e60 tx=0x7fea10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae06eaf5db12bc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea0b7fe700 1 -- 172.21.15.79:0/4115678208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000e070 con 0x7fea14157870 2023-10-14T18:50:33.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea0b7fe700 1 -- 172.21.15.79:0/4115678208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000bbf0 con 0x7fea14157870 2023-10-14T18:50:33.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea0b7fe700 1 -- 172.21.15.79:0/4115678208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10012430 con 0x7fea14157870 2023-10-14T18:50:33.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 -- 172.21.15.79:0/4115678208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea14157870 msgr2=0x7fea1415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 --2- 172.21.15.79:0/4115678208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea14157870 0x7fea1415b6a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e60 tx=0x7fea10009780 comp rx=0 tx=0).stop 2023-10-14T18:50:33.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 -- 172.21.15.79:0/4115678208 shutdown_connections 2023-10-14T18:50:33.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 --2- 172.21.15.79:0/4115678208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea14157870 0x7fea1415b6a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 -- 172.21.15.79:0/4115678208 >> 172.21.15.79:0/4115678208 conn(0x7fea14068ce0 msgr2=0x7fea140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:33.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 -- 172.21.15.79:0/4115678208 shutdown_connections 2023-10-14T18:50:33.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.014+0000 7fea1b06e700 1 -- 172.21.15.79:0/4115678208 wait complete. 2023-10-14T18:50:33.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.015+0000 7fea1b06e700 1 Processor -- start 2023-10-14T18:50:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.015+0000 7fea1b06e700 1 -- start start 2023-10-14T18:50:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea14157870 0x7fea1415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 0x7fea140a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415e550 con 0x7fea1415a620 2023-10-14T18:50:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140a89b0 con 0x7fea14157c40 2023-10-14T18:50:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1b06e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415f350 con 0x7fea14157870 2023-10-14T18:50:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38602/0 (socket says 172.21.15.79:38602) 2023-10-14T18:50:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 -- 172.21.15.79:0/204565941 learned_addr learned my addr 172.21.15.79:0/204565941 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea18e0a700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea14157870 0x7fea1415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea0bfff700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 0x7fea140a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 -- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea14157870 msgr2=0x7fea1415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea14157870 0x7fea1415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 -- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 msgr2=0x7fea140a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 0x7fea140a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea1960b700 1 -- 172.21.15.79:0/204565941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009a20 con 0x7fea1415a620 2023-10-14T18:50:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.016+0000 7fea0bfff700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 0x7fea140a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea1960b700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00b5e0 tx=0x7fea0c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00f510 con 0x7fea1415a620 2023-10-14T18:50:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c00f690 con 0x7fea1415a620 2023-10-14T18:50:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea14145d20 con 0x7fea1415a620 2023-10-14T18:50:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fa50 con 0x7fea1415a620 2023-10-14T18:50:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.017+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1415ea20 con 0x7fea1415a620 2023-10-14T18:50:33.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.018+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1415f4e0 con 0x7fea1415a620 2023-10-14T18:50:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.018+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea0c01a400 con 0x7fea1415a620 2023-10-14T18:50:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.019+0000 7fea08ff9700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.019+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea0c083f70 con 0x7fea1415a620 2023-10-14T18:50:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.019+0000 7fea18e0a700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.019+0000 7fea18e0a700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fea100099f0 tx=0x7fea10018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.023+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea0c051260 con 0x7fea1415a620 2023-10-14T18:50:33.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.208+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea1404c3c0 con 0x7fea1415a620 2023-10-14T18:50:33.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.209+0000 7fea08ff9700 1 -- 172.21.15.79:0/204565941 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fea0c054880 con 0x7fea1415a620 2023-10-14T18:50:33.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:33.210 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":111,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:27.735904+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:49:55.294128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-14T18:49:56.196375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:33.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 msgr2=0x7fea000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 0x7fea000693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fea100099f0 tx=0x7fea10018000 comp rx=0 tx=0).stop 2023-10-14T18:50:33.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 msgr2=0x7fea141457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00b5e0 tx=0x7fea0c0090f0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 shutdown_connections 2023-10-14T18:50:33.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fea00066f30 0x7fea000693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea1415a620 0x7fea141457e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fea14157870 0x7fea1415e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 --2- 172.21.15.79:0/204565941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14157c40 0x7fea140a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 >> 172.21.15.79:0/204565941 conn(0x7fea14068ce0 msgr2=0x7fea140690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:33.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 shutdown_connections 2023-10-14T18:50:33.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.211+0000 7fea1b06e700 1 -- 172.21.15.79:0/204565941 wait complete. 2023-10-14T18:50:33.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:50:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.338+0000 7f16e6243700 1 Processor -- start 2023-10-14T18:50:33.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.338+0000 7f16e6243700 1 -- start start 2023-10-14T18:50:33.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16e6243700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f16e0157c40 0x7f16e0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16e6243700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e015cbb0 con 0x7f16e015a620 2023-10-14T18:50:33.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16e6243700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e015bfa0 con 0x7f16e0157870 2023-10-14T18:50:33.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16e6243700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e015bdb0 con 0x7f16e0157c40 2023-10-14T18:50:33.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16deffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f16e015a620 0x7f16e015d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51346/0 (socket says 172.21.15.79:51346) 2023-10-14T18:50:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.339+0000 7f16deffd700 1 -- 172.21.15.79:0/3864773853 learned_addr learned my addr 172.21.15.79:0/3864773853 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132262552 0 0) 0x7f16e015cbb0 con 0x7f16e015a620 2023-10-14T18:50:33.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16dffff700 1 --2- 172.21.15.79:0/3864773853 >> v2:172.21.15.144:3300/0 conn(0x7f16e0157c40 0x7f16e0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c8003570 con 0x7f16e015a620 2023-10-14T18:50:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2004659375 0 0) 0x7f16c8003570 con 0x7f16e015a620 2023-10-14T18:50:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 >> v2:172.21.15.144:3300/0 conn(0x7f16e0157c40 msgr2=0x7f16e0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 --2- 172.21.15.79:0/3864773853 >> v2:172.21.15.144:3300/0 conn(0x7f16e0157c40 0x7f16e0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 >> v1:172.21.15.144:6789/0 conn(0x7f16e0157870 legacy=0x7f16e015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e015c280 con 0x7f16e015a620 2023-10-14T18:50:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f16d4001470 con 0x7f16e015a620 2023-10-14T18:50:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 >> v1:172.21.15.79:6789/0 conn(0x7f16e015a620 legacy=0x7f16e015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16c8003a60 0x7f16c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 0x7f16c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c80051c0 0x7f16c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800c130 con 0x7f16c8004810 2023-10-14T18:50:33.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800c2a0 con 0x7f16c8003a60 2023-10-14T18:50:33.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800c460 con 0x7f16c80051c0 2023-10-14T18:50:33.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 0x7f16c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16df7fe700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16c8003a60 0x7f16c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16dffff700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c80051c0 0x7f16c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 -- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c80051c0 msgr2=0x7f16c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c80051c0 0x7f16c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 -- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16c8003a60 msgr2=0x7f16c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16c8003a60 0x7f16c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16dffff700 1 -- 172.21.15.79:0/3864773853 reap_dead start 2023-10-14T18:50:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.340+0000 7f16deffd700 1 -- 172.21.15.79:0/3864773853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8003570 con 0x7f16c8004810 2023-10-14T18:50:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16deffd700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 0x7f16c8004c80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c390 tx=0x7f16d4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49c65137cf19cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cbe0 con 0x7f16c8004810 2023-10-14T18:50:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400cd40 con 0x7f16c8004810 2023-10-14T18:50:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16de7fc700 1 -- 172.21.15.79:0/3864773853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4005b50 con 0x7f16c8004810 2023-10-14T18:50:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 -- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 msgr2=0x7f16c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 0x7f16c8004c80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f16d400c390 tx=0x7f16d4001e50 comp rx=0 tx=0).stop 2023-10-14T18:50:33.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 -- 172.21.15.79:0/3864773853 shutdown_connections 2023-10-14T18:50:33.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 --2- 172.21.15.79:0/3864773853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16c8004810 0x7f16c8004c80 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 -- 172.21.15.79:0/3864773853 >> 172.21.15.79:0/3864773853 conn(0x7f16e0068ce0 msgr2=0x7f16e00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:33.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 -- 172.21.15.79:0/3864773853 shutdown_connections 2023-10-14T18:50:33.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.341+0000 7f16e6243700 1 -- 172.21.15.79:0/3864773853 wait complete. 2023-10-14T18:50:33.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 Processor -- start 2023-10-14T18:50:33.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 -- start start 2023-10-14T18:50:33.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c8004810 0x7f16e013be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01530c0 0x7f16e0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e014c1d0 con 0x7f16e00b0f80 2023-10-14T18:50:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e0153a60 con 0x7f16e01530c0 2023-10-14T18:50:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16e6243700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00b1400 con 0x7f16c8004810 2023-10-14T18:50:33.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16deffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16deffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38630/0 (socket says 172.21.15.79:38630) 2023-10-14T18:50:33.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.343+0000 7f16deffd700 1 -- 172.21.15.79:0/2973370845 learned_addr learned my addr 172.21.15.79:0/2973370845 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:33.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16dffff700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01530c0 0x7f16e0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16df7fe700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c8004810 0x7f16e013be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 -- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c8004810 msgr2=0x7f16e013be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c8004810 0x7f16e013be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 -- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01530c0 msgr2=0x7f16e0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01530c0 0x7f16e0153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 -- 172.21.15.79:0/2973370845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00b16e0 con 0x7f16e00b0f80 2023-10-14T18:50:33.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16deffd700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c270 tx=0x7f16d4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cbe0 con 0x7f16e00b0f80 2023-10-14T18:50:33.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400ceb0 con 0x7f16e00b0f80 2023-10-14T18:50:33.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00b19c0 con 0x7f16e00b0f80 2023-10-14T18:50:33.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4007300 con 0x7f16e00b0f80 2023-10-14T18:50:33.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.344+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e013c3b0 con 0x7f16e00b0f80 2023-10-14T18:50:33.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.345+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e0151100 con 0x7f16e00b0f80 2023-10-14T18:50:33.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.345+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16d40076f0 con 0x7f16e00b0f80 2023-10-14T18:50:33.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.346+0000 7f16c77fe700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.346+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16d4085c30 con 0x7f16e00b0f80 2023-10-14T18:50:33.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.346+0000 7f16df7fe700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.346+0000 7f16df7fe700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 0x7f16cc0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000f80 tx=0x7f16d0001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.350+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16e0151100 con 0x7f16e00b0f80 2023-10-14T18:50:33.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.577+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f16e0151100 con 0x7f16e00b0f80 2023-10-14T18:50:33.578 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:50:33.578+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:50:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.583+0000 7f16c77fe700 1 -- 172.21.15.79:0/2973370845 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f16e0151100 con 0x7f16e00b0f80 2023-10-14T18:50:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 msgr2=0x7f16cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 0x7f16cc0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f16d0000f80 tx=0x7f16d0001640 comp rx=0 tx=0).stop 2023-10-14T18:50:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 msgr2=0x7f16e00b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c270 tx=0x7f16d4015000 comp rx=0 tx=0).stop 2023-10-14T18:50:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 shutdown_connections 2023-10-14T18:50:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16e01530c0 0x7f16e0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16c8004810 0x7f16e013be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 --2- 172.21.15.79:0/2973370845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e00b0f80 0x7f16e00b2ef0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 >> 172.21.15.79:0/2973370845 conn(0x7f16e0068ce0 msgr2=0x7f16e00b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:33.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 shutdown_connections 2023-10-14T18:50:33.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.585+0000 7f16e6243700 1 -- 172.21.15.79:0/2973370845 wait complete. 2023-10-14T18:50:33.589 INFO:tasks.ceph.mds.a.smithi079.stderr: -9085> 2023-10-14T18:50:02.833+0000 7f3f061d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:50:33.589 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:50:33.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:50:33.616 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:50:33.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.715+0000 7f2d41831700 1 Processor -- start 2023-10-14T18:50:33.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.715+0000 7f2d41831700 1 -- start start 2023-10-14T18:50:33.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d41831700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d3c15da90 0x7f2d3c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d41831700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d41831700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c068000 con 0x7f2d3c154440 2023-10-14T18:50:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d41831700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c15e1e0 con 0x7f2d3c067ba0 2023-10-14T18:50:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d41831700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c15e4c0 con 0x7f2d3c15da90 2023-10-14T18:50:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38646/0 (socket says 172.21.15.79:38646) 2023-10-14T18:50:33.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 -- 172.21.15.79:0/784379075 learned_addr learned my addr 172.21.15.79:0/784379075 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3a7fc700 1 --2- 172.21.15.79:0/784379075 >> v2:172.21.15.144:3300/0 conn(0x7f2d3c15da90 0x7f2d3c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 -- 172.21.15.79:0/784379075 >> v2:172.21.15.144:3300/0 conn(0x7f2d3c15da90 msgr2=0x7f2d3c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 --2- 172.21.15.79:0/784379075 >> v2:172.21.15.144:3300/0 conn(0x7f2d3c15da90 0x7f2d3c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 -- 172.21.15.79:0/784379075 >> v1:172.21.15.144:6789/0 conn(0x7f2d3c154440 legacy=0x7f2d3c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 -- 172.21.15.79:0/784379075 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c15e7a0 con 0x7f2d3c067ba0 2023-10-14T18:50:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d3b7fe700 1 --2- 172.21.15.79:0/784379075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0d1ee0 tx=0x7f2d34009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6d1f950eb70db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d39ffb700 1 -- 172.21.15.79:0/784379075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400e070 con 0x7f2d3c067ba0 2023-10-14T18:50:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d39ffb700 1 -- 172.21.15.79:0/784379075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400ba50 con 0x7f2d3c067ba0 2023-10-14T18:50:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.716+0000 7f2d39ffb700 1 -- 172.21.15.79:0/784379075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340092e0 con 0x7f2d3c067ba0 2023-10-14T18:50:33.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 -- 172.21.15.79:0/784379075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c067ba0 msgr2=0x7f2d3c0cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 --2- 172.21.15.79:0/784379075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0d1ee0 tx=0x7f2d34009840 comp rx=0 tx=0).stop 2023-10-14T18:50:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 -- 172.21.15.79:0/784379075 shutdown_connections 2023-10-14T18:50:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 --2- 172.21.15.79:0/784379075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c067ba0 0x7f2d3c0cfa20 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 --2- 172.21.15.79:0/784379075 >> v2:172.21.15.144:3300/0 conn(0x7f2d3c15da90 0x7f2d3c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 -- 172.21.15.79:0/784379075 >> 172.21.15.79:0/784379075 conn(0x7f2d3c0d0dd0 msgr2=0x7f2d3c0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:33.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 -- 172.21.15.79:0/784379075 shutdown_connections 2023-10-14T18:50:33.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.717+0000 7f2d41831700 1 -- 172.21.15.79:0/784379075 wait complete. 2023-10-14T18:50:33.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.718+0000 7f2d41831700 1 Processor -- start 2023-10-14T18:50:33.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.718+0000 7f2d41831700 1 -- start start 2023-10-14T18:50:33.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d3c067ba0 0x7f2d3c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d3c15da90 0x7f2d3c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b2330 con 0x7f2d3c154440 2023-10-14T18:50:33.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c151d20 con 0x7f2d3c15da90 2023-10-14T18:50:33.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d41831700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0b1720 con 0x7f2d3c067ba0 2023-10-14T18:50:33.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38662/0 (socket says 172.21.15.79:38662) 2023-10-14T18:50:33.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 -- 172.21.15.79:0/1858750062 learned_addr learned my addr 172.21.15.79:0/1858750062 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:33.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3affd700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d3c067ba0 0x7f2d3c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3b7fe700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d3c15da90 0x7f2d3c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 -- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d3c067ba0 msgr2=0x7f2d3c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d3c067ba0 0x7f2d3c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 -- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d3c15da90 msgr2=0x7f2d3c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:33.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d3c15da90 0x7f2d3c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:33.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 -- 172.21.15.79:0/1858750062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34009ae0 con 0x7f2d3c154440 2023-10-14T18:50:33.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.719+0000 7f2d3a7fc700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000d890 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.720+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d300125f0 con 0x7f2d3c154440 2023-10-14T18:50:33.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.720+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30012770 con 0x7f2d3c154440 2023-10-14T18:50:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.720+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30012b30 con 0x7f2d3c154440 2023-10-14T18:50:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.720+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c0b1a00 con 0x7f2d3c154440 2023-10-14T18:50:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.720+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c0b1fc0 con 0x7f2d3c154440 2023-10-14T18:50:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.721+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c15a4d0 con 0x7f2d3c154440 2023-10-14T18:50:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.721+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d3001e460 con 0x7f2d3c154440 2023-10-14T18:50:33.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.721+0000 7f2d22ffd700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 0x7f2d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:33.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.721+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2d30084cc0 con 0x7f2d3c154440 2023-10-14T18:50:33.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.721+0000 7f2d3affd700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 0x7f2d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:33.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.722+0000 7f2d3affd700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 0x7f2d280693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c003860 tx=0x7f2d2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:33.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.725+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d30051ee0 con 0x7f2d3c154440 2023-10-14T18:50:33.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:33.950+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2d3c04c3c0 con 0x7f2d3c154440 2023-10-14T18:50:34.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.582+0000 7f2d22ffd700 1 -- 172.21.15.79:0/1858750062 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2d30055500 con 0x7f2d3c154440 2023-10-14T18:50:34.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.584+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 msgr2=0x7f2d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.584+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 0x7f2d280693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c003860 tx=0x7f2d2c009040 comp rx=0 tx=0).stop 2023-10-14T18:50:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.584+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 msgr2=0x7f2d3c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000d890 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2023-10-14T18:50:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 shutdown_connections 2023-10-14T18:50:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d28066f30 0x7f2d280693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d3c15da90 0x7f2d3c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d3c067ba0 0x7f2d3c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 --2- 172.21.15.79:0/1858750062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d3c154440 0x7f2d3c154810 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 >> 172.21.15.79:0/1858750062 conn(0x7f2d3c0d0dd0 msgr2=0x7f2d3c153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 shutdown_connections 2023-10-14T18:50:34.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.585+0000 7f2d41831700 1 -- 172.21.15.79:0/1858750062 wait complete. 2023-10-14T18:50:34.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:50:34.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 Processor -- start 2023-10-14T18:50:34.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 -- start start 2023-10-14T18:50:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 0x7fae940d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae9415a580 0x7fae9415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940d08e0 con 0x7fae94157ac0 2023-10-14T18:50:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae94157e90 con 0x7fae9415a580 2023-10-14T18:50:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.755+0000 7fae98e82700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9415b2f0 con 0x7fae940d1450 2023-10-14T18:50:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae9415a580 0x7fae9415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae9415a580 0x7fae9415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:38488/0 (socket says 172.21.15.79:38488) 2023-10-14T18:50:34.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae89d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 0x7fae940d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 -- 172.21.15.79:0/418039427 learned_addr learned my addr 172.21.15.79:0/418039427 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae9259c700 1 --1- 172.21.15.79:0/418039427 >> v1:172.21.15.144:6789/0 conn(0x7fae94157ac0 0x7fae940d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:37752/0 (socket says 172.21.15.79:37752) 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 -- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 msgr2=0x7fae940d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 0x7fae940d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 -- 172.21.15.79:0/418039427 >> v1:172.21.15.144:6789/0 conn(0x7fae94157ac0 legacy=0x7fae940d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae92d9d700 1 -- 172.21.15.79:0/418039427 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940cf8e0 con 0x7fae9415a580 2023-10-14T18:50:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.756+0000 7fae89d9b700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 0x7fae940d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae92d9d700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9415a580 0x7fae9415a9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009f20 tx=0x7fae8c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0b70ca4007a013 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae91d9b700 1 -- 172.21.15.79:0/418039427 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00e070 con 0x7fae9415a580 2023-10-14T18:50:34.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae91d9b700 1 -- 172.21.15.79:0/418039427 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00b9d0 con 0x7fae9415a580 2023-10-14T18:50:34.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae91d9b700 1 -- 172.21.15.79:0/418039427 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0092e0 con 0x7fae9415a580 2023-10-14T18:50:34.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 -- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9415a580 msgr2=0x7fae9415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9415a580 0x7fae9415a9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009f20 tx=0x7fae8c009840 comp rx=0 tx=0).stop 2023-10-14T18:50:34.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 -- 172.21.15.79:0/418039427 shutdown_connections 2023-10-14T18:50:34.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9415a580 0x7fae9415a9c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 --2- 172.21.15.79:0/418039427 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae940d1450 0x7fae940d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 -- 172.21.15.79:0/418039427 >> 172.21.15.79:0/418039427 conn(0x7fae940680f0 msgr2=0x7fae940b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:34.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 -- 172.21.15.79:0/418039427 shutdown_connections 2023-10-14T18:50:34.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.757+0000 7fae98e82700 1 -- 172.21.15.79:0/418039427 wait complete. 2023-10-14T18:50:34.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 Processor -- start 2023-10-14T18:50:34.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 -- start start 2023-10-14T18:50:34.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae940d1450 0x7fae9415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae9415a580 0x7fae94151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9415c110 con 0x7fae94157ac0 2023-10-14T18:50:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94153fe0 con 0x7fae940d1450 2023-10-14T18:50:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae98e82700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940b1720 con 0x7fae9415a580 2023-10-14T18:50:34.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae89d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae89d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38674/0 (socket says 172.21.15.79:38674) 2023-10-14T18:50:34.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.759+0000 7fae89d9b700 1 -- 172.21.15.79:0/751807319 learned_addr learned my addr 172.21.15.79:0/751807319 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:34.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae9259c700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae940d1450 0x7fae9415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae92d9d700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae9415a580 0x7fae94151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 -- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae9415a580 msgr2=0x7fae94151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae9415a580 0x7fae94151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 -- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae940d1450 msgr2=0x7fae9415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:34.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae940d1450 0x7fae9415bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:34.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 -- 172.21.15.79:0/751807319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c009420 con 0x7fae94157ac0 2023-10-14T18:50:34.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae89d9b700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00ecb0 tx=0x7fae7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:34.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00ee60 con 0x7fae94157ac0 2023-10-14T18:50:34.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00cb80 con 0x7fae94157ac0 2023-10-14T18:50:34.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c013470 con 0x7fae94157ac0 2023-10-14T18:50:34.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c009ae0 con 0x7fae94157ac0 2023-10-14T18:50:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.760+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940b2250 con 0x7fae94157ac0 2023-10-14T18:50:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.761+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae940b23e0 con 0x7fae94157ac0 2023-10-14T18:50:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.761+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae7c013820 con 0x7fae94157ac0 2023-10-14T18:50:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.762+0000 7fae8affd700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:34.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.762+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fae7c0849f0 con 0x7fae94157ac0 2023-10-14T18:50:34.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.762+0000 7fae9259c700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:34.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.762+0000 7fae9259c700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 0x7fae740693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:34.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.766+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae7c051c10 con 0x7fae94157ac0 2023-10-14T18:50:34.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:34.950+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae9404c3c0 con 0x7fae94157ac0 2023-10-14T18:50:35.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.779+0000 7fae8affd700 1 -- 172.21.15.79:0/751807319 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7fae7c055230 con 0x7fae94157ac0 2023-10-14T18:50:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 msgr2=0x7fae740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 0x7fae740693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84009040 comp rx=0 tx=0).stop 2023-10-14T18:50:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 msgr2=0x7fae940cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00ecb0 tx=0x7fae7c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 shutdown_connections 2023-10-14T18:50:35.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae74066f30 0x7fae740693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae9415a580 0x7fae94151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae940d1450 0x7fae9415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 --2- 172.21.15.79:0/751807319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae94157ac0 0x7fae940cc8f0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 >> 172.21.15.79:0/751807319 conn(0x7fae940680f0 msgr2=0x7fae9415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:35.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 shutdown_connections 2023-10-14T18:50:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.782+0000 7fae98e82700 1 -- 172.21.15.79:0/751807319 wait complete. 2023-10-14T18:50:35.786 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:50:35.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:50:35.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.915+0000 7f6498db4700 1 Processor -- start 2023-10-14T18:50:35.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.915+0000 7f6498db4700 1 -- start start 2023-10-14T18:50:35.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6498db4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6494159ef0 0x7f649415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6498db4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64940b6a10 0x7f64940b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6498db4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64940b1a60 con 0x7f64940b15e0 2023-10-14T18:50:35.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6498db4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b1d40 con 0x7f6494159ef0 2023-10-14T18:50:35.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6498db4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b2020 con 0x7f64940b6a10 2023-10-14T18:50:35.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6494159ef0 0x7f649415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:35.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6492d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64940b15e0 0x7f64940b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51352/0 (socket says 172.21.15.79:51352) 2023-10-14T18:50:35.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f6492d9d700 1 -- 172.21.15.79:0/1733396463 learned_addr learned my addr 172.21.15.79:0/1733396463 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 -- 172.21.15.79:0/1733396463 >> v2:172.21.15.144:3300/0 conn(0x7f64940b6a10 msgr2=0x7f64940b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 --2- 172.21.15.79:0/1733396463 >> v2:172.21.15.144:3300/0 conn(0x7f64940b6a10 0x7f64940b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 -- 172.21.15.79:0/1733396463 >> v1:172.21.15.79:6789/0 conn(0x7f64940b15e0 legacy=0x7f64940b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 -- 172.21.15.79:0/1733396463 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940b2300 con 0x7f6494159ef0 2023-10-14T18:50:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649159a700 1 -- 172.21.15.79:0/1733396463 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89825792 0 0) 0x7f64940b1a60 con 0x7f64940b15e0 2023-10-14T18:50:35.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.916+0000 7f649259c700 1 --2- 172.21.15.79:0/1733396463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6494159ef0 0x7f649415a2c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6494089550 tx=0x7f6484009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cea51b543c4cc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:35.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f649159a700 1 -- 172.21.15.79:0/1733396463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484005c10 con 0x7f6494159ef0 2023-10-14T18:50:35.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f649159a700 1 -- 172.21.15.79:0/1733396463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6484005d70 con 0x7f6494159ef0 2023-10-14T18:50:35.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f649159a700 1 -- 172.21.15.79:0/1733396463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484006260 con 0x7f6494159ef0 2023-10-14T18:50:35.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 -- 172.21.15.79:0/1733396463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6494159ef0 msgr2=0x7f649415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 --2- 172.21.15.79:0/1733396463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6494159ef0 0x7f649415a2c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6494089550 tx=0x7f6484009120 comp rx=0 tx=0).stop 2023-10-14T18:50:35.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 -- 172.21.15.79:0/1733396463 shutdown_connections 2023-10-14T18:50:35.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 --2- 172.21.15.79:0/1733396463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6494159ef0 0x7f649415a2c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 --2- 172.21.15.79:0/1733396463 >> v2:172.21.15.144:3300/0 conn(0x7f64940b6a10 0x7f64940b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 -- 172.21.15.79:0/1733396463 >> 172.21.15.79:0/1733396463 conn(0x7f649409a0a0 msgr2=0x7f6494067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:35.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 -- 172.21.15.79:0/1733396463 shutdown_connections 2023-10-14T18:50:35.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.917+0000 7f6498db4700 1 -- 172.21.15.79:0/1733396463 wait complete. 2023-10-14T18:50:35.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.918+0000 7f6498db4700 1 Processor -- start 2023-10-14T18:50:35.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.918+0000 7f6498db4700 1 -- start start 2023-10-14T18:50:35.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494159ef0 0x7f64941575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6494157e20 0x7f649409db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6494158640 con 0x7f64940b6a10 2023-10-14T18:50:35.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c6bb0 con 0x7f6494159ef0 2023-10-14T18:50:35.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f6498db4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c6e90 con 0x7f6494157e20 2023-10-14T18:50:35.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:35.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38694/0 (socket says 172.21.15.79:38694) 2023-10-14T18:50:35.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 -- 172.21.15.79:0/1861870312 learned_addr learned my addr 172.21.15.79:0/1861870312 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:35.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 -- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6494157e20 msgr2=0x7f649409db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6494157e20 0x7f649409db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 -- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494159ef0 msgr2=0x7f64941575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:35.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494159ef0 0x7f64941575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:35.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 -- 172.21.15.79:0/1861870312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840093c0 con 0x7f64940b6a10 2023-10-14T18:50:35.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.919+0000 7f649259c700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6494071f80 tx=0x7f6484016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:35.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.920+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400bcf0 con 0x7f64940b6a10 2023-10-14T18:50:35.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.920+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400be50 con 0x7f64940b6a10 2023-10-14T18:50:35.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.920+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648401b6d0 con 0x7f64940b6a10 2023-10-14T18:50:35.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.920+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64940c7170 con 0x7f64940b6a10 2023-10-14T18:50:35.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.920+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940ae680 con 0x7f64940b6a10 2023-10-14T18:50:35.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.921+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649404c3c0 con 0x7f64940b6a10 2023-10-14T18:50:35.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.921+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f648401bac0 con 0x7f64940b6a10 2023-10-14T18:50:35.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.921+0000 7f64827fc700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:35.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.921+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f6484086960 con 0x7f64940b6a10 2023-10-14T18:50:35.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.922+0000 7f6491d9b700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:35.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.922+0000 7f6491d9b700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 0x7f64740693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488006db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:35.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:35.925+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6484053d30 con 0x7f64940b6a10 2023-10-14T18:50:36.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.114+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f649406a270 con 0x7f64940b6a10 2023-10-14T18:50:36.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.782+0000 7f64827fc700 1 -- 172.21.15.79:0/1861870312 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6484057350 con 0x7f64940b6a10 2023-10-14T18:50:36.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.786+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 msgr2=0x7f64740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.786+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 0x7f64740693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488006db0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 msgr2=0x7f64940c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6494071f80 tx=0x7f6484016000 comp rx=0 tx=0).stop 2023-10-14T18:50:36.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 shutdown_connections 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6474066f30 0x7f64740693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6494157e20 0x7f649409db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64940b6a10 0x7f64940c65d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 --2- 172.21.15.79:0/1861870312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6494159ef0 0x7f64941575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 >> 172.21.15.79:0/1861870312 conn(0x7f649409a0a0 msgr2=0x7f6494159270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:36.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 shutdown_connections 2023-10-14T18:50:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.787+0000 7f6498db4700 1 -- 172.21.15.79:0/1861870312 wait complete. 2023-10-14T18:50:36.790 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:50:36.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:50:36.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.917+0000 7f88547fb700 1 Processor -- start 2023-10-14T18:50:36.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.917+0000 7f88547fb700 1 -- start start 2023-10-14T18:50:36.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f88547fb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f884c159ec0 0x7f884c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f88547fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f88547fb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0b0790 con 0x7f884c06a5a0 2023-10-14T18:50:36.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f88547fb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0ce1f0 con 0x7f884c159ec0 2023-10-14T18:50:36.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f88547fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b0b20 con 0x7f884c15a290 2023-10-14T18:50:36.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f8852597700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f884c159ec0 0x7f884c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f8852597700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f884c159ec0 0x7f884c0af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38698/0 (socket says 172.21.15.79:38698) 2023-10-14T18:50:36.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.918+0000 7f8852597700 1 -- 172.21.15.79:0/4028077125 learned_addr learned my addr 172.21.15.79:0/4028077125 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:36.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8851d96700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8852597700 1 -- 172.21.15.79:0/4028077125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 msgr2=0x7f884c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:36.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8852597700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8852597700 1 -- 172.21.15.79:0/4028077125 >> v1:172.21.15.144:6789/0 conn(0x7f884c06a5a0 legacy=0x7f884c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:36.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8852597700 1 -- 172.21.15.79:0/4028077125 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0b04b0 con 0x7f884c159ec0 2023-10-14T18:50:36.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8851d96700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:36.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8852597700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c159ec0 0x7f884c0af940 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8848009f20 tx=0x7f8848009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07316dae5fa7515 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:36.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8851595700 1 -- 172.21.15.79:0/4028077125 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800e070 con 0x7f884c159ec0 2023-10-14T18:50:36.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8851595700 1 -- 172.21.15.79:0/4028077125 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800ba40 con 0x7f884c159ec0 2023-10-14T18:50:36.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f8851595700 1 -- 172.21.15.79:0/4028077125 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480092e0 con 0x7f884c159ec0 2023-10-14T18:50:36.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 -- 172.21.15.79:0/4028077125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c159ec0 msgr2=0x7f884c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:36.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c159ec0 0x7f884c0af940 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f8848009f20 tx=0x7f8848009840 comp rx=0 tx=0).stop 2023-10-14T18:50:36.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 -- 172.21.15.79:0/4028077125 shutdown_connections 2023-10-14T18:50:36.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c159ec0 0x7f884c0af940 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 --2- 172.21.15.79:0/4028077125 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 -- 172.21.15.79:0/4028077125 >> 172.21.15.79:0/4028077125 conn(0x7f884c0d1880 msgr2=0x7f884c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.919+0000 7f88547fb700 1 -- 172.21.15.79:0/4028077125 shutdown_connections 2023-10-14T18:50:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.920+0000 7f88547fb700 1 -- 172.21.15.79:0/4028077125 wait complete. 2023-10-14T18:50:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 Processor -- start 2023-10-14T18:50:36.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 -- start start 2023-10-14T18:50:36.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c159ec0 0x7f884c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15c420 con 0x7f884c06a5a0 2023-10-14T18:50:36.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c16a8e0 con 0x7f884c159ec0 2023-10-14T18:50:36.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f88547fb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15b810 con 0x7f884c15a290 2023-10-14T18:50:36.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f8852597700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f8852597700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38710/0 (socket says 172.21.15.79:38710) 2023-10-14T18:50:36.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f8852597700 1 -- 172.21.15.79:0/3806163465 learned_addr learned my addr 172.21.15.79:0/3806163465 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:36.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f8851d96700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c159ec0 0x7f884c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.921+0000 7f8852d98700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 -- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 msgr2=0x7f884c14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:36.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 -- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c159ec0 msgr2=0x7f884c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:36.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c159ec0 0x7f884c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:36.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 -- 172.21.15.79:0/3806163465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009ae0 con 0x7f884c06a5a0 2023-10-14T18:50:36.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f8852597700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f884c071eb0 tx=0x7f8848017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:36.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848012aa0 con 0x7f884c06a5a0 2023-10-14T18:50:36.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848012c20 con 0x7f884c06a5a0 2023-10-14T18:50:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c15baf0 con 0x7f884c06a5a0 2023-10-14T18:50:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884801d420 con 0x7f884c06a5a0 2023-10-14T18:50:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.922+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c15c0b0 con 0x7f884c06a5a0 2023-10-14T18:50:36.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.923+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c04c3c0 con 0x7f884c06a5a0 2023-10-14T18:50:36.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.923+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f884801d850 con 0x7f884c06a5a0 2023-10-14T18:50:36.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.923+0000 7f88427fc700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 0x7f88300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:36.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.924+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f88480858b0 con 0x7f884c06a5a0 2023-10-14T18:50:36.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.924+0000 7f8851d96700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 0x7f88300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.924+0000 7f8851d96700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 0x7f88300693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b15a0 tx=0x7f883c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:36.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:36.928+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8848052e20 con 0x7f884c06a5a0 2023-10-14T18:50:37.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.112+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f884c0ceab0 con 0x7f884c06a5a0 2023-10-14T18:50:37.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.116+0000 7f88427fc700 1 -- 172.21.15.79:0/3806163465 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8848056440 con 0x7f884c06a5a0 2023-10-14T18:50:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 msgr2=0x7f88300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 0x7f88300693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f884c0b15a0 tx=0x7f883c006f90 comp rx=0 tx=0).stop 2023-10-14T18:50:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 msgr2=0x7f884c16a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f884c071eb0 tx=0x7f8848017000 comp rx=0 tx=0).stop 2023-10-14T18:50:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 shutdown_connections 2023-10-14T18:50:37.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8830066f30 0x7f88300693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c15a290 0x7f884c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c06a5a0 0x7f884c16a3a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 --2- 172.21.15.79:0/3806163465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c159ec0 0x7f884c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 >> 172.21.15.79:0/3806163465 conn(0x7f884c0d1880 msgr2=0x7f884c15db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 shutdown_connections 2023-10-14T18:50:37.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.118+0000 7f88547fb700 1 -- 172.21.15.79:0/3806163465 wait complete. 2023-10-14T18:50:37.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-14T18:50:37.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.244+0000 7f797ea2a700 1 Processor -- start 2023-10-14T18:50:37.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 -- start start 2023-10-14T18:50:37.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f797815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f797815a620 0x7f797815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797815cbb0 con 0x7f797815d580 2023-10-14T18:50:37.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797815bfa0 con 0x7f797815a620 2023-10-14T18:50:37.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f797ea2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797815c280 con 0x7f7978157870 2023-10-14T18:50:37.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f79777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f797815a620 0x7f797815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f79777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f797815a620 0x7f797815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38716/0 (socket says 172.21.15.79:38716) 2023-10-14T18:50:37.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.245+0000 7f79777fe700 1 -- 172.21.15.79:0/1173804807 learned_addr learned my addr 172.21.15.79:0/1173804807 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:37.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f7977fff700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f797815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f79777fe700 1 -- 172.21.15.79:0/1173804807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 msgr2=0x7f797815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:37.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f79777fe700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f797815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f79777fe700 1 -- 172.21.15.79:0/1173804807 >> v1:172.21.15.144:6789/0 conn(0x7f797815d580 legacy=0x7f7978158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f79777fe700 1 -- 172.21.15.79:0/1173804807 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797815c560 con 0x7f797815a620 2023-10-14T18:50:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f7977fff700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f797815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f79777fe700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f797815d040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f796c0099b0 tx=0x7f796c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fae1d83a1702ad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f7976ffd700 1 -- 172.21.15.79:0/1173804807 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00b860 con 0x7f797815a620 2023-10-14T18:50:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f7976ffd700 1 -- 172.21.15.79:0/1173804807 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c00b9c0 con 0x7f797815a620 2023-10-14T18:50:37.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.246+0000 7f7976ffd700 1 -- 172.21.15.79:0/1173804807 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00bd60 con 0x7f797815a620 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 -- 172.21.15.79:0/1173804807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 msgr2=0x7f797815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f797815d040 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f796c0099b0 tx=0x7f796c009250 comp rx=0 tx=0).stop 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 -- 172.21.15.79:0/1173804807 shutdown_connections 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f797815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 --2- 172.21.15.79:0/1173804807 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f797815d040 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 -- 172.21.15.79:0/1173804807 >> 172.21.15.79:0/1173804807 conn(0x7f7978068ce0 msgr2=0x7f79780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:37.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 -- 172.21.15.79:0/1173804807 shutdown_connections 2023-10-14T18:50:37.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.247+0000 7f797ea2a700 1 -- 172.21.15.79:0/1173804807 wait complete. 2023-10-14T18:50:37.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.248+0000 7f797ea2a700 1 Processor -- start 2023-10-14T18:50:37.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.248+0000 7f797ea2a700 1 -- start start 2023-10-14T18:50:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f79780b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f797815d580 0x7f7978154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797815e340 con 0x7f797815a620 2023-10-14T18:50:37.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780cf8b0 con 0x7f797815d580 2023-10-14T18:50:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780cf580 con 0x7f7978157870 2023-10-14T18:50:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38730/0 (socket says 172.21.15.79:38730) 2023-10-14T18:50:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 -- 172.21.15.79:0/3884452796 learned_addr learned my addr 172.21.15.79:0/3884452796 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:37.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f7977fff700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f79780b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797cfc7700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f797815d580 0x7f7978154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 -- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 msgr2=0x7f79780b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f79780b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 -- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f797815d580 msgr2=0x7f7978154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f797815d580 0x7f7978154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 -- 172.21.15.79:0/3884452796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0094f0 con 0x7f797815a620 2023-10-14T18:50:37.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f79777fe700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f796c009290 tx=0x7f796c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c011e00 con 0x7f797815a620 2023-10-14T18:50:37.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c01f070 con 0x7f797815a620 2023-10-14T18:50:37.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797814adb0 con 0x7f797815a620 2023-10-14T18:50:37.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.249+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0266d0 con 0x7f797815a620 2023-10-14T18:50:37.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.250+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79781549e0 con 0x7f797815a620 2023-10-14T18:50:37.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.250+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797804c3c0 con 0x7f797815a620 2023-10-14T18:50:37.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.251+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f796c026a40 con 0x7f797815a620 2023-10-14T18:50:37.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.251+0000 7f795ffff700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.251+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f796c021070 con 0x7f797815a620 2023-10-14T18:50:37.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.251+0000 7f7977fff700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.252+0000 7f7977fff700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7968006f00 tx=0x7f7968008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.255+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f796c053560 con 0x7f797815a620 2023-10-14T18:50:37.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.516+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f79780cf9f0 con 0x7f797815a620 2023-10-14T18:50:37.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.781+0000 7f795ffff700 1 -- 172.21.15.79:0/3884452796 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v286) v1 ==== 137+0+0 (secure 0 0 0) 0x7f796c02b0d0 con 0x7f797815a620 2023-10-14T18:50:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 msgr2=0x7f79640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7968006f00 tx=0x7f7968008040 comp rx=0 tx=0).stop 2023-10-14T18:50:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 msgr2=0x7f7978153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f796c009290 tx=0x7f796c017000 comp rx=0 tx=0).stop 2023-10-14T18:50:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 shutdown_connections 2023-10-14T18:50:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7964066f30 0x7f79640693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f797815d580 0x7f7978154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7978157870 0x7f79780b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 --2- 172.21.15.79:0/3884452796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f797815a620 0x7f7978153b10 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 >> 172.21.15.79:0/3884452796 conn(0x7f7978068ce0 msgr2=0x7f797814fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 shutdown_connections 2023-10-14T18:50:37.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.783+0000 7f797ea2a700 1 -- 172.21.15.79:0/3884452796 wait complete. 2023-10-14T18:50:37.797 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-14T18:50:37.798 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-14T18:50:37.798 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-14T18:50:37.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-14T18:50:37.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.912+0000 7f1c8a6f6700 1 Processor -- start 2023-10-14T18:50:37.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.912+0000 7f1c8a6f6700 1 -- start start 2023-10-14T18:50:37.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c8a6f6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c840c9180 0x7f1c840b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c8a6f6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8415e860 con 0x7f1c840b0d30 2023-10-14T18:50:37.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c8a6f6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8415dc50 con 0x7f1c840cbce0 2023-10-14T18:50:37.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c8a6f6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8415da40 con 0x7f1c840c9180 2023-10-14T18:50:37.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c83fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1c840b0d30 0x7f1c840cb5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:51360/0 (socket says 172.21.15.79:51360) 2023-10-14T18:50:37.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c83fff700 1 -- 172.21.15.79:0/1616950956 learned_addr learned my addr 172.21.15.79:0/1616950956 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:37.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c837fe700 1 --2- 172.21.15.79:0/1616950956 >> v2:172.21.15.144:3300/0 conn(0x7f1c840c9180 0x7f1c840b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256624785 0 0) 0x7f1c8415e860 con 0x7f1c840b0d30 2023-10-14T18:50:37.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c6c003570 con 0x7f1c840b0d30 2023-10-14T18:50:37.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393047693 0 0) 0x7f1c8415dc50 con 0x7f1c840cbce0 2023-10-14T18:50:37.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8415e860 con 0x7f1c840cbce0 2023-10-14T18:50:37.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 403568668 0 0) 0x7f1c6c003570 con 0x7f1c840b0d30 2023-10-14T18:50:37.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 >> v2:172.21.15.144:3300/0 conn(0x7f1c840c9180 msgr2=0x7f1c840b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:37.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 --2- 172.21.15.79:0/1616950956 >> v2:172.21.15.144:3300/0 conn(0x7f1c840c9180 0x7f1c840b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 >> v1:172.21.15.144:6789/0 conn(0x7f1c840cbce0 legacy=0x7f1c840cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8415df30 con 0x7f1c840b0d30 2023-10-14T18:50:37.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1c74001470 con 0x7f1c840b0d30 2023-10-14T18:50:37.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 >> v1:172.21.15.79:6789/0 conn(0x7f1c840b0d30 legacy=0x7f1c840cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6c003bf0 0x7f1c6c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 0x7f1c6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c0051c0 0x7f1c6c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8415da40 con 0x7f1c6c004810 2023-10-14T18:50:37.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c00c0b0 con 0x7f1c6c003bf0 2023-10-14T18:50:37.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c00c270 con 0x7f1c6c0051c0 2023-10-14T18:50:37.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c837fe700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 0x7f1c6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c83fff700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6c003bf0 0x7f1c6c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.913+0000 7f1c88c93700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c0051c0 0x7f1c6c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 -- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c0051c0 msgr2=0x7f1c6c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:37.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c0051c0 0x7f1c6c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 -- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6c003bf0 msgr2=0x7f1c6c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:37.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6c003bf0 0x7f1c6c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 -- 172.21.15.79:0/1616950956 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c003570 con 0x7f1c6c004810 2023-10-14T18:50:37.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c88c93700 1 -- 172.21.15.79:0/1616950956 reap_dead start 2023-10-14T18:50:37.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c837fe700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 0x7f1c6c004c80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009c00 tx=0x7f1c780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcffeebcd9336ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800e710 con 0x7f1c6c004810 2023-10-14T18:50:37.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800e870 con 0x7f1c6c004810 2023-10-14T18:50:37.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c82ffd700 1 -- 172.21.15.79:0/1616950956 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800ec30 con 0x7f1c6c004810 2023-10-14T18:50:37.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 msgr2=0x7f1c6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 0x7f1c6c004c80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009c00 tx=0x7f1c780091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/1616950956 shutdown_connections 2023-10-14T18:50:37.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/1616950956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c6c004810 0x7f1c6c004c80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/1616950956 >> 172.21.15.79:0/1616950956 conn(0x7f1c84069870 msgr2=0x7f1c84069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:37.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.914+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/1616950956 shutdown_connections 2023-10-14T18:50:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.915+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/1616950956 wait complete. 2023-10-14T18:50:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 Processor -- start 2023-10-14T18:50:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 -- start start 2023-10-14T18:50:37.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 0x7f1c840c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 0x7f1c84157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840c8c30 con 0x7f1c840b18e0 2023-10-14T18:50:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840c8740 con 0x7f1c8414d5e0 2023-10-14T18:50:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.916+0000 7f1c8a6f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8415b850 con 0x7f1c6c004810 2023-10-14T18:50:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38734/0 (socket says 172.21.15.79:38734) 2023-10-14T18:50:37.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 -- 172.21.15.79:0/2751998366 learned_addr learned my addr 172.21.15.79:0/2751998366 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c83fff700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 0x7f1c840c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c88c93700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 0x7f1c84157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 -- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 msgr2=0x7f1c840c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 0x7f1c840c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 -- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 msgr2=0x7f1c84157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 0x7f1c84157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 -- 172.21.15.79:0/2751998366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840c8950 con 0x7f1c840b18e0 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c83fff700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 0x7f1c840c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c88c93700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 0x7f1c84157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c837fe700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800e4b0 tx=0x7f1c7801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78022070 con 0x7f1c840b18e0 2023-10-14T18:50:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800e9e0 con 0x7f1c840b18e0 2023-10-14T18:50:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8415b200 con 0x7f1c840b18e0 2023-10-14T18:50:37.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7801c450 con 0x7f1c840b18e0 2023-10-14T18:50:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.917+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c840c6d00 con 0x7f1c840b18e0 2023-10-14T18:50:37.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.918+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8415b6a0 con 0x7f1c840b18e0 2023-10-14T18:50:37.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.918+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c7801c8a0 con 0x7f1c840b18e0 2023-10-14T18:50:37.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.919+0000 7f1c6bfff700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 0x7f1c700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:37.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.919+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1c78085a60 con 0x7f1c840b18e0 2023-10-14T18:50:37.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.919+0000 7f1c83fff700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 0x7f1c700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:37.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.919+0000 7f1c83fff700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 0x7f1c700693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1c740011e0 tx=0x7f1c74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:37.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:37.923+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c78052fd0 con 0x7f1c840b18e0 2023-10-14T18:50:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.180+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f1c8415b060 con 0x7f1c840b18e0 2023-10-14T18:50:38.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.789+0000 7f1c6bfff700 1 -- 172.21.15.79:0/2751998366 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v287) v1 ==== 131+0+0 (secure 0 0 0) 0x7f1c8415b060 con 0x7f1c840b18e0 2023-10-14T18:50:38.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 msgr2=0x7f1c700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 0x7f1c700693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1c740011e0 tx=0x7f1c74009040 comp rx=0 tx=0).stop 2023-10-14T18:50:38.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 msgr2=0x7f1c840c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800e4b0 tx=0x7f1c7801a000 comp rx=0 tx=0).stop 2023-10-14T18:50:38.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 shutdown_connections 2023-10-14T18:50:38.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c70066f30 0x7f1c700693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8414d5e0 0x7f1c84157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6c004810 0x7f1c840c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 --2- 172.21.15.79:0/2751998366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c840b18e0 0x7f1c840c67c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 >> 172.21.15.79:0/2751998366 conn(0x7f1c84069870 msgr2=0x7f1c8414de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:38.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 shutdown_connections 2023-10-14T18:50:38.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.791+0000 7f1c8a6f6700 1 -- 172.21.15.79:0/2751998366 wait complete. 2023-10-14T18:50:38.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:50:38.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.920+0000 7fddcbfff700 1 Processor -- start 2023-10-14T18:50:38.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.920+0000 7fddcbfff700 1 -- start start 2023-10-14T18:50:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc0cce30 0x7fddcc15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcbfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aa00 0x7fddcc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcbfff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0b4d70 con 0x7fddcc0b6580 2023-10-14T18:50:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcbfff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0cd8d0 con 0x7fddcc0cce30 2023-10-14T18:50:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcbfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b4440 con 0x7fddcc06aa00 2023-10-14T18:50:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc0cce30 0x7fddcc15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc0cce30 0x7fddcc15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46328/0 (socket says 172.21.15.79:46328) 2023-10-14T18:50:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddca7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fddcc0b6580 0x7fddcc06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58114/0 (socket says 172.21.15.79:58114) 2023-10-14T18:50:38.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 -- 172.21.15.79:0/627896797 learned_addr learned my addr 172.21.15.79:0/627896797 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:38.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcb7fe700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aa00 0x7fddcc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 -- 172.21.15.79:0/627896797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aa00 msgr2=0x7fddcc0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:38.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aa00 0x7fddcc0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 -- 172.21.15.79:0/627896797 >> v1:172.21.15.79:6789/0 conn(0x7fddcc0b6580 legacy=0x7fddcc06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddcaffd700 1 -- 172.21.15.79:0/627896797 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0b4720 con 0x7fddcc0cce30 2023-10-14T18:50:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.921+0000 7fddc9ffb700 1 -- 172.21.15.79:0/627896797 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508274208 0 0) 0x7fddcc0b4d70 con 0x7fddcc0b6580 2023-10-14T18:50:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcaffd700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0cce30 0x7fddcc15aca0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0099b0 tx=0x7fddbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2badbf88093ca56a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddc9ffb700 1 -- 172.21.15.79:0/627896797 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00b860 con 0x7fddcc0cce30 2023-10-14T18:50:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddc9ffb700 1 -- 172.21.15.79:0/627896797 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00b9c0 con 0x7fddcc0cce30 2023-10-14T18:50:38.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddc9ffb700 1 -- 172.21.15.79:0/627896797 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00bd60 con 0x7fddcc0cce30 2023-10-14T18:50:38.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 -- 172.21.15.79:0/627896797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0cce30 msgr2=0x7fddcc15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0cce30 0x7fddcc15aca0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0099b0 tx=0x7fddbc009250 comp rx=0 tx=0).stop 2023-10-14T18:50:38.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 -- 172.21.15.79:0/627896797 shutdown_connections 2023-10-14T18:50:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aa00 0x7fddcc0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 --2- 172.21.15.79:0/627896797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0cce30 0x7fddcc15aca0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 -- 172.21.15.79:0/627896797 >> 172.21.15.79:0/627896797 conn(0x7fddcc068cb0 msgr2=0x7fddcc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 -- 172.21.15.79:0/627896797 shutdown_connections 2023-10-14T18:50:38.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.922+0000 7fddcbfff700 1 -- 172.21.15.79:0/627896797 wait complete. 2023-10-14T18:50:38.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 Processor -- start 2023-10-14T18:50:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 -- start start 2023-10-14T18:50:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 0x7fddcc14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 0x7fddcc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc1523d0 con 0x7fddcc0b6580 2023-10-14T18:50:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b1340 con 0x7fddcc06aa00 2023-10-14T18:50:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddcbfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc14ee40 con 0x7fddcc0cce30 2023-10-14T18:50:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddca7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddca7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46334/0 (socket says 172.21.15.79:46334) 2023-10-14T18:50:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.924+0000 7fddca7fc700 1 -- 172.21.15.79:0/2692522389 learned_addr learned my addr 172.21.15.79:0/2692522389 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:38.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcb7fe700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 0x7fddcc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcaffd700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 0x7fddcc14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 -- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 msgr2=0x7fddcc0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 0x7fddcc0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 -- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 msgr2=0x7fddcc14e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:38.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 0x7fddcc14e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:38.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 -- 172.21.15.79:0/2692522389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0094f0 con 0x7fddcc0b6580 2023-10-14T18:50:38.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcb7fe700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 0x7fddcc0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:38.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcaffd700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 0x7fddcc14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:38.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddca7fc700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c7e0 tx=0x7fddb4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:38.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4007300 con 0x7fddcc0b6580 2023-10-14T18:50:38.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4007460 con 0x7fddcc0b6580 2023-10-14T18:50:38.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc14e940 con 0x7fddcc0b6580 2023-10-14T18:50:38.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4004830 con 0x7fddcc0b6580 2023-10-14T18:50:38.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.925+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0b1060 con 0x7fddcc0b6580 2023-10-14T18:50:38.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.926+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc152540 con 0x7fddcc0b6580 2023-10-14T18:50:38.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.926+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddb4004be0 con 0x7fddcc0b6580 2023-10-14T18:50:38.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.927+0000 7fddc2ffd700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:38.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.927+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fddb4083770 con 0x7fddcc0b6580 2023-10-14T18:50:38.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.927+0000 7fddcaffd700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:38.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.927+0000 7fddcaffd700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0099b0 tx=0x7fddbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:38.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:38.931+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddb4050d60 con 0x7fddcc0b6580 2023-10-14T18:50:39.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.112+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fddcc0b4a00 con 0x7fddcc0b6580 2023-10-14T18:50:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.117+0000 7fddc2ffd700 1 -- 172.21.15.79:0/2692522389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fddb40180c0 con 0x7fddcc0b6580 2023-10-14T18:50:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 msgr2=0x7fddac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0099b0 tx=0x7fddbc017000 comp rx=0 tx=0).stop 2023-10-14T18:50:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 msgr2=0x7fddcc0b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c7e0 tx=0x7fddb4007e10 comp rx=0 tx=0).stop 2023-10-14T18:50:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 shutdown_connections 2023-10-14T18:50:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc0cce30 0x7fddcc0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc06aa00 0x7fddcc14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 --2- 172.21.15.79:0/2692522389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc0b6580 0x7fddcc0b0480 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 >> 172.21.15.79:0/2692522389 conn(0x7fddcc068cb0 msgr2=0x7fddcc0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 shutdown_connections 2023-10-14T18:50:39.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.119+0000 7fddcbfff700 1 -- 172.21.15.79:0/2692522389 wait complete. 2023-10-14T18:50:39.133 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:50:39.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:50:39.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:50:39.219 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:50:39.220 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:50:39.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:39.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.332+0000 7ff7c72d3700 1 Processor -- start 2023-10-14T18:50:39.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.332+0000 7ff7c72d3700 1 -- start start 2023-10-14T18:50:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c72d3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7c015e540 0x7ff7c0070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c72d3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c0071080 con 0x7ff7c00afff0 2023-10-14T18:50:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c72d3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c015e9b0 con 0x7ff7c0070c40 2023-10-14T18:50:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c72d3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c00b03c0 con 0x7ff7c015e540 2023-10-14T18:50:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c486e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff7c015e540 0x7ff7c0070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c506f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff7c00afff0 0x7ff7c0069e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58126/0 (socket says 172.21.15.79:58126) 2023-10-14T18:50:39.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.333+0000 7ff7c506f700 1 -- 172.21.15.79:0/2485024908 learned_addr learned my addr 172.21.15.79:0/2485024908 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c486e700 1 -- 172.21.15.79:0/2485024908 >> v1:172.21.15.144:6789/0 conn(0x7ff7c0070c40 legacy=0x7ff7c006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c486e700 1 -- 172.21.15.79:0/2485024908 >> v1:172.21.15.79:6789/0 conn(0x7ff7c00afff0 legacy=0x7ff7c0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7bffff700 1 -- 172.21.15.79:0/2485024908 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33558081 0 0) 0x7ff7c0071080 con 0x7ff7c00afff0 2023-10-14T18:50:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c486e700 1 -- 172.21.15.79:0/2485024908 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c006a870 con 0x7ff7c015e540 2023-10-14T18:50:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c486e700 1 --2- 172.21.15.79:0/2485024908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c015e540 0x7ff7c0070700 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098e0 tx=0x7ff7b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2f7acbdd935343 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7bffff700 1 -- 172.21.15.79:0/2485024908 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4009e80 con 0x7ff7c015e540 2023-10-14T18:50:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7bffff700 1 -- 172.21.15.79:0/2485024908 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400b820 con 0x7ff7c015e540 2023-10-14T18:50:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7bffff700 1 -- 172.21.15.79:0/2485024908 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400bba0 con 0x7ff7c015e540 2023-10-14T18:50:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c72d3700 1 -- 172.21.15.79:0/2485024908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c015e540 msgr2=0x7ff7c0070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.334+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/2485024908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c015e540 0x7ff7c0070700 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098e0 tx=0x7ff7b40091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.335+0000 7ff7c72d3700 1 -- 172.21.15.79:0/2485024908 shutdown_connections 2023-10-14T18:50:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.335+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/2485024908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c015e540 0x7ff7c0070700 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.335+0000 7ff7c72d3700 1 -- 172.21.15.79:0/2485024908 >> 172.21.15.79:0/2485024908 conn(0x7ff7c00cda50 msgr2=0x7ff7c00cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.335+0000 7ff7c72d3700 1 -- 172.21.15.79:0/2485024908 shutdown_connections 2023-10-14T18:50:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.335+0000 7ff7c72d3700 1 -- 172.21.15.79:0/2485024908 wait complete. 2023-10-14T18:50:39.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.336+0000 7ff7c72d3700 1 Processor -- start 2023-10-14T18:50:39.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.336+0000 7ff7c72d3700 1 -- start start 2023-10-14T18:50:39.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c00afff0 0x7ff7c015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015e540 0x7ff7c015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015b090 con 0x7ff7c0070c40 2023-10-14T18:50:39.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c016b6e0 con 0x7ff7c00afff0 2023-10-14T18:50:39.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b2650 con 0x7ff7c015e540 2023-10-14T18:50:39.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46348/0 (socket says 172.21.15.79:46348) 2023-10-14T18:50:39.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 -- 172.21.15.79:0/11181606 learned_addr learned my addr 172.21.15.79:0/11181606 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:39.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 -- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015e540 msgr2=0x7ff7c015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015e540 0x7ff7c015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 -- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c00afff0 msgr2=0x7ff7c015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c00afff0 0x7ff7c015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 -- 172.21.15.79:0/11181606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009420 con 0x7ff7c0070c40 2023-10-14T18:50:39.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c506f700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000cd80 tx=0x7ff7b0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000ab10 con 0x7ff7c0070c40 2023-10-14T18:50:39.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b000ac70 con 0x7ff7c0070c40 2023-10-14T18:50:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00070f0 con 0x7ff7c0070c40 2023-10-14T18:50:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c015aa40 con 0x7ff7c0070c40 2023-10-14T18:50:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.337+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c00c0c60 con 0x7ff7c0070c40 2023-10-14T18:50:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.338+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c015a8a0 con 0x7ff7c0070c40 2023-10-14T18:50:39.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.339+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7b00074e0 con 0x7ff7c0070c40 2023-10-14T18:50:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.339+0000 7ff7bd7fa700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 0x7ff7ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.339+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff7b00846e0 con 0x7ff7c0070c40 2023-10-14T18:50:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.340+0000 7ff7c486e700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 0x7ff7ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.340+0000 7ff7c486e700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 0x7ff7ac0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00b3a10 tx=0x7ff7b4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.343+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7c015a8a0 con 0x7ff7c0070c40 2023-10-14T18:50:39.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.567+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7c015a8a0 con 0x7ff7c0070c40 2023-10-14T18:50:39.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.567+0000 7ff7bd7fa700 1 -- 172.21.15.79:0/11181606 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff7c015a8a0 con 0x7ff7c0070c40 2023-10-14T18:50:39.569 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:39.569 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5465,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2801743437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2801743437},{"type":"v1","addr":"172.21.15.144:6837","nonce":2801743437}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2949597446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2949597446},{"type":"v1","addr":"172.21.15.144:6836","nonce":2949597446}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6345,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1464955401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1464955401},{"type":"v1","addr":"172.21.15.79:6834","nonce":1464955401}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6657,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1840778585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1840778585},{"type":"v1","addr":"172.21.15.79:6835","nonce":1840778585}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2023-10-14T18:50:39.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 msgr2=0x7ff7ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 0x7ff7ac0693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00b3a10 tx=0x7ff7b4016000 comp rx=0 tx=0).stop 2023-10-14T18:50:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 msgr2=0x7ff7c00c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000cd80 tx=0x7ff7b0001ae0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 shutdown_connections 2023-10-14T18:50:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff7ac066f30 0x7ff7ac0693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7c015e540 0x7ff7c015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7c0070c40 0x7ff7c00c0720 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 --2- 172.21.15.79:0/11181606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7c00afff0 0x7ff7c015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 >> 172.21.15.79:0/11181606 conn(0x7ff7c00cda50 msgr2=0x7ff7c00c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:39.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.569+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 shutdown_connections 2023-10-14T18:50:39.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.570+0000 7ff7c72d3700 1 -- 172.21.15.79:0/11181606 wait complete. 2023-10-14T18:50:39.574 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 50 2023-10-14T18:50:39.583 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:50:39.583 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:50:39.584 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:50:39.584 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:50:39.584 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:50:39.584 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:50:39.585 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:50:39.585 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:50:39.585 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:50:39.586 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:50:39.586 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:50:39.586 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:50:39.586 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:50:39.587 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:50:39.587 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:50:39.587 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:50:39.593 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:50:39.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:50:39.595 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:50:39.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:50:39.597 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:50:39.598 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:50:39.599 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:50:39.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:50:39.637 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:50:39.638 DEBUG:teuthology.parallel:result is None 2023-10-14T18:50:39.638 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:50:39.639 DEBUG:teuthology.parallel:result is None 2023-10-14T18:50:39.641 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:50:39.641 DEBUG:teuthology.parallel:result is None 2023-10-14T18:50:39.642 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:50:39.643 DEBUG:teuthology.parallel:result is None 2023-10-14T18:50:39.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:50:39.710 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:50:39.710 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:50:39.719 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:50:39.720 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:50:39.720 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-10-14T18:50:39.719+0000 7f999906b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-14T18:50:39.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.763+0000 7f8ef56b6700 1 Processor -- start 2023-10-14T18:50:39.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.763+0000 7f8ef56b6700 1 -- start start 2023-10-14T18:50:39.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8ef56b6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ef0157870 0x7f8ef015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8ef56b6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015cbb0 con 0x7f8ef0157c40 2023-10-14T18:50:39.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8ef56b6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015bfa0 con 0x7f8ef015a620 2023-10-14T18:50:39.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8ef56b6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef015c280 con 0x7f8ef0157870 2023-10-14T18:50:39.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eef7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8ef0157c40 0x7f8ef0158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58152/0 (socket says 172.21.15.79:58152) 2023-10-14T18:50:39.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eef7fe700 1 -- 172.21.15.79:0/1283516335 learned_addr learned my addr 172.21.15.79:0/1283516335 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:39.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140256258 0 0) 0x7f8ef015cbb0 con 0x7f8ef0157c40 2023-10-14T18:50:39.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eeeffd700 1 --2- 172.21.15.79:0/1283516335 >> v2:172.21.15.144:3300/0 conn(0x7f8ef0157870 0x7f8ef015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003570 con 0x7f8ef0157c40 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901722936 0 0) 0x7f8ed8003570 con 0x7f8ef0157c40 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 >> v2:172.21.15.144:3300/0 conn(0x7f8ef0157870 msgr2=0x7f8ef015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 --2- 172.21.15.79:0/1283516335 >> v2:172.21.15.144:3300/0 conn(0x7f8ef0157870 0x7f8ef015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 >> v1:172.21.15.144:6789/0 conn(0x7f8ef015a620 legacy=0x7f8ef015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef015c560 con 0x7f8ef0157c40 2023-10-14T18:50:39.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f8ee80017f0 con 0x7f8ef0157c40 2023-10-14T18:50:39.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 >> v1:172.21.15.79:6789/0 conn(0x7f8ef0157c40 legacy=0x7f8ef0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8003a60 0x7f8ed8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ed8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed80051c0 0x7f8ed800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef015c280 con 0x7f8ed8004810 2023-10-14T18:50:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800c0e0 con 0x7f8ed8003a60 2023-10-14T18:50:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed800c2a0 con 0x7f8ed80051c0 2023-10-14T18:50:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.764+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ed8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eeeffd700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8003a60 0x7f8ed8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eef7fe700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed80051c0 0x7f8ed800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 -- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed80051c0 msgr2=0x7f8ed800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:39.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ed80051c0 0x7f8ed800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 -- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8003a60 msgr2=0x7f8ed8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:39.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed8003a60 0x7f8ed8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eef7fe700 1 -- 172.21.15.79:0/1283516335 reap_dead start 2023-10-14T18:50:39.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 -- 172.21.15.79:0/1283516335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8003570 con 0x7f8ed8004810 2023-10-14T18:50:39.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ed8004c80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4001970 tx=0x7f8ee4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18a868a34e74bc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400c5d0 con 0x7f8ed8004810 2023-10-14T18:50:39.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400c750 con 0x7f8ed8004810 2023-10-14T18:50:39.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8eedffb700 1 -- 172.21.15.79:0/1283516335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400cb10 con 0x7f8ed8004810 2023-10-14T18:50:39.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8ef56b6700 1 -- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 msgr2=0x7f8ed8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.765+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ed8004c80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4001970 tx=0x7f8ee4007d10 comp rx=0 tx=0).stop 2023-10-14T18:50:39.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.766+0000 7f8ef56b6700 1 -- 172.21.15.79:0/1283516335 shutdown_connections 2023-10-14T18:50:39.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.766+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/1283516335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ed8004c80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.766+0000 7f8ef56b6700 1 -- 172.21.15.79:0/1283516335 >> 172.21.15.79:0/1283516335 conn(0x7f8ef0068ce0 msgr2=0x7f8ef00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.766+0000 7f8ef56b6700 1 -- 172.21.15.79:0/1283516335 shutdown_connections 2023-10-14T18:50:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.766+0000 7f8ef56b6700 1 -- 172.21.15.79:0/1283516335 wait complete. 2023-10-14T18:50:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.767+0000 7f8ef56b6700 1 Processor -- start 2023-10-14T18:50:39.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.767+0000 7f8ef56b6700 1 -- start start 2023-10-14T18:50:39.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.767+0000 7f8ef56b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015fb60 0x7f8ef015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef00a7680 0x7f8ef00a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0160510 con 0x7f8ed8004810 2023-10-14T18:50:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00a8fe0 con 0x7f8ef015fb60 2023-10-14T18:50:39.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00a83d0 con 0x7f8ef00a7680 2023-10-14T18:50:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46396/0 (socket says 172.21.15.79:46396) 2023-10-14T18:50:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 -- 172.21.15.79:0/2779294776 learned_addr learned my addr 172.21.15.79:0/2779294776 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015fb60 0x7f8ef015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eef7fe700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef00a7680 0x7f8ef00a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 -- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef00a7680 msgr2=0x7f8ef00a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef00a7680 0x7f8ef00a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 -- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015fb60 msgr2=0x7f8ef015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:39.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015fb60 0x7f8ef015ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 -- 172.21.15.79:0/2779294776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00a86b0 con 0x7f8ed8004810 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8eeeffd700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0011d40 tx=0x7f8ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000f9b0 con 0x7f8ed8004810 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000fb10 con 0x7f8ed8004810 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00a8990 con 0x7f8ed8004810 2023-10-14T18:50:39.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000fed0 con 0x7f8ed8004810 2023-10-14T18:50:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.768+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0148cc0 con 0x7f8ed8004810 2023-10-14T18:50:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.769+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004c3c0 con 0x7f8ed8004810 2023-10-14T18:50:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.769+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ee0014650 con 0x7f8ed8004810 2023-10-14T18:50:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.770+0000 7f8ed6ffd700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 0x7f8edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.770+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8ee0018030 con 0x7f8ed8004810 2023-10-14T18:50:39.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.770+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 0x7f8edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:39.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.770+0000 7f8eee7fc700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 0x7f8edc0693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8ef015ea60 tx=0x7f8ee4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:39.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.774+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ee0052180 con 0x7f8ed8004810 2023-10-14T18:50:39.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:39.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:39.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:39.982+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8ef015c840 con 0x7f8ed8004810 2023-10-14T18:50:40.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.811+0000 7f8ed6ffd700 1 -- 172.21.15.79:0/2779294776 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8ee0022080 con 0x7f8ed8004810 2023-10-14T18:50:40.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 msgr2=0x7f8edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 0x7f8edc0693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8ef015ea60 tx=0x7f8ee4015000 comp rx=0 tx=0).stop 2023-10-14T18:50:40.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 msgr2=0x7f8ef0148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0011d40 tx=0x7f8ee00091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 shutdown_connections 2023-10-14T18:50:40.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8edc066f30 0x7f8edc0693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ef00a7680 0x7f8ef00a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ed8004810 0x7f8ef0148780 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 --2- 172.21.15.79:0/2779294776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015fb60 0x7f8ef015ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 >> 172.21.15.79:0/2779294776 conn(0x7f8ef0068ce0 msgr2=0x7f8ef00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:40.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.813+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 shutdown_connections 2023-10-14T18:50:40.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.814+0000 7f8ef56b6700 1 -- 172.21.15.79:0/2779294776 wait complete. 2023-10-14T18:50:40.818 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:50:40.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:50:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.944+0000 7f6aae0a0700 1 Processor -- start 2023-10-14T18:50:40.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.944+0000 7f6aae0a0700 1 -- start start 2023-10-14T18:50:40.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aae0a0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6aa815a620 0x7f6aa815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aae0a0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 0x7f6aa8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aae0a0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa815cbb0 con 0x7f6aa8157870 2023-10-14T18:50:40.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aae0a0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa815bdb0 con 0x7f6aa815a620 2023-10-14T18:50:40.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aae0a0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa815bfa0 con 0x7f6aa815d580 2023-10-14T18:50:40.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aa6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6aa815a620 0x7f6aa815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:40.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aa77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6aa8157870 0x7f6aa815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58156/0 (socket says 172.21.15.79:58156) 2023-10-14T18:50:40.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.945+0000 7f6aa77fe700 1 -- 172.21.15.79:0/3310809922 learned_addr learned my addr 172.21.15.79:0/3310809922 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:40.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa7fff700 1 --2- 172.21.15.79:0/3310809922 >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 0x7f6aa8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:40.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/3310809922 >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 msgr2=0x7f6aa8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:40.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa6ffd700 1 --2- 172.21.15.79:0/3310809922 >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 0x7f6aa8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/3310809922 >> v1:172.21.15.79:6789/0 conn(0x7f6aa8157870 legacy=0x7f6aa815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa67fc700 1 -- 172.21.15.79:0/3310809922 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8564579 0 0) 0x7f6aa815cbb0 con 0x7f6aa8157870 2023-10-14T18:50:40.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/3310809922 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa815c280 con 0x7f6aa815a620 2023-10-14T18:50:40.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa7fff700 1 --2- 172.21.15.79:0/3310809922 >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 0x7f6aa8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:40.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa6ffd700 1 --2- 172.21.15.79:0/3310809922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa815d040 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6aa806b4e0 tx=0x7f6a9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968edeb9a147b419 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:40.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa67fc700 1 -- 172.21.15.79:0/3310809922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00b6b0 con 0x7f6aa815a620 2023-10-14T18:50:40.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa67fc700 1 -- 172.21.15.79:0/3310809922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00b810 con 0x7f6aa815a620 2023-10-14T18:50:40.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aa67fc700 1 -- 172.21.15.79:0/3310809922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00bbb0 con 0x7f6aa815a620 2023-10-14T18:50:40.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 -- 172.21.15.79:0/3310809922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 msgr2=0x7f6aa815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/3310809922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa815d040 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6aa806b4e0 tx=0x7f6a9c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 -- 172.21.15.79:0/3310809922 shutdown_connections 2023-10-14T18:50:40.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/3310809922 >> v2:172.21.15.144:3300/0 conn(0x7f6aa815d580 0x7f6aa8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/3310809922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa815d040 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 -- 172.21.15.79:0/3310809922 >> 172.21.15.79:0/3310809922 conn(0x7f6aa8068ce0 msgr2=0x7f6aa80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:40.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.946+0000 7f6aae0a0700 1 -- 172.21.15.79:0/3310809922 shutdown_connections 2023-10-14T18:50:40.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.947+0000 7f6aae0a0700 1 -- 172.21.15.79:0/3310809922 wait complete. 2023-10-14T18:50:40.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 Processor -- start 2023-10-14T18:50:40.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 -- start start 2023-10-14T18:50:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 0x7f6aa814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6aa815d580 0x7f6aa8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80b30e0 con 0x7f6aa815a620 2023-10-14T18:50:40.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80b0db0 con 0x7f6aa8157870 2023-10-14T18:50:40.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.948+0000 7f6aae0a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80d1270 con 0x7f6aa815d580 2023-10-14T18:50:40.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:40.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46414/0 (socket says 172.21.15.79:46414) 2023-10-14T18:50:40.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/1229449133 learned_addr learned my addr 172.21.15.79:0/1229449133 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa77fe700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 0x7f6aa814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6aa815d580 msgr2=0x7f6aa8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6aa815d580 0x7f6aa8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 msgr2=0x7f6aa814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:40.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 0x7f6aa814db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:40.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 -- 172.21.15.79:0/1229449133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c009420 con 0x7f6aa815a620 2023-10-14T18:50:40.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa77fe700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 0x7f6aa814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:40.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aa6ffd700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c013000 tx=0x7f6a9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c011420 con 0x7f6aa815a620 2023-10-14T18:50:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c011580 con 0x7f6aa815a620 2023-10-14T18:50:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c011920 con 0x7f6aa815a620 2023-10-14T18:50:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa80d1550 con 0x7f6aa815a620 2023-10-14T18:50:40.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.949+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa80b0a40 con 0x7f6aa815a620 2023-10-14T18:50:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.950+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa804c3c0 con 0x7f6aa815a620 2023-10-14T18:50:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.951+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a9c011d10 con 0x7f6aa815a620 2023-10-14T18:50:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.951+0000 7f6a8f7fe700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 0x7f6a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:40.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.951+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6a9c085870 con 0x7f6aa815a620 2023-10-14T18:50:40.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.951+0000 7f6aa77fe700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 0x7f6a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:40.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.952+0000 7f6aa77fe700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 0x7f6a940693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800d270 tx=0x7f6a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:40.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:40.955+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a9c052eb0 con 0x7f6aa815a620 2023-10-14T18:50:41.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.210+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6aa815c560 con 0x7f6aa815a620 2023-10-14T18:50:41.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.211+0000 7f6a8f7fe700 1 -- 172.21.15.79:0/1229449133 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6a9c0564d0 con 0x7f6aa815a620 2023-10-14T18:50:41.213 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:41.213 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:41.213 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:50:41.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.214 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:50:41.214 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:50:41.214 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.214 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.215 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:50:41.215 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:50:41.215 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.216 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:50:41.217 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:50:41.217 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.218 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:50:41.218 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:50:41.218 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.218 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.218 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.219 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:50:41.220 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:50:41.220 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.220 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.220 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:50:41.220 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:50:41.221 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.221 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:50:41.222 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:50:41.222 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.222 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.222 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.222 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:50:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:50:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:50:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:50:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:50:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:50:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:50:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:50:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:50:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.231 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.232 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.233 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.233 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.235 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:50:41.235 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:50:41.235 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.236 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.236 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:50:41.236 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:50:41.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.237 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:50:41.237 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:50:41.237 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.237 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.238 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:50:41.238 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:50:41.238 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:50:41.238 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.239 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:50:41.240 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:50:41.240 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:50:41.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.241 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:50:41.241 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:50:41.241 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.241 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:50:41.241 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:50:41.242 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:50:41.242 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:50:41.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:50:41.243 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:50:41.244 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.244 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:50:41.245 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:50:41.245 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.245 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:50:41.245 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:50:41.246 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:50:41.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:50:41.247 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:50:41.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:41.248 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:50:41.248 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 msgr2=0x7f6a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 0x7f6a940693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6a9800d270 tx=0x7f6a98009040 comp rx=0 tx=0).stop 2023-10-14T18:50:41.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 msgr2=0x7f6aa8158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c013000 tx=0x7f6a9c017000 comp rx=0 tx=0).stop 2023-10-14T18:50:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 shutdown_connections 2023-10-14T18:50:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6a94066f30 0x7f6a940693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6aa815d580 0x7f6aa8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6aa8157870 0x7f6aa814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 --2- 172.21.15.79:0/1229449133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aa815a620 0x7f6aa8158a70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 >> 172.21.15.79:0/1229449133 conn(0x7f6aa8068ce0 msgr2=0x7f6aa8152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 shutdown_connections 2023-10-14T18:50:41.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.213+0000 7f6aae0a0700 1 -- 172.21.15.79:0/1229449133 wait complete. 2023-10-14T18:50:41.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:41.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.366+0000 7ff047fff700 1 Processor -- start 2023-10-14T18:50:41.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.366+0000 7ff047fff700 1 -- start start 2023-10-14T18:50:41.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff047fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0480d10a0 0x7ff048164980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff047fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480b3940 con 0x7ff048159f40 2023-10-14T18:50:41.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff047fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480b44c0 con 0x7ff048159b70 2023-10-14T18:50:41.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff047fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480b3b90 con 0x7ff0480d10a0 2023-10-14T18:50:41.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff03ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff048159f40 0x7ff0480d0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58160/0 (socket says 172.21.15.79:58160) 2023-10-14T18:50:41.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff03ffff700 1 -- 172.21.15.79:0/2949346920 learned_addr learned my addr 172.21.15.79:0/2949346920 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:41.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff0477fe700 1 --2- 172.21.15.79:0/2949346920 >> v2:172.21.15.144:3300/0 conn(0x7ff0480d10a0 0x7ff048164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.367+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028238678 0 0) 0x7ff0480b3940 con 0x7ff048159f40 2023-10-14T18:50:41.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff034003570 con 0x7ff048159f40 2023-10-14T18:50:41.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072632521 0 0) 0x7ff034003570 con 0x7ff048159f40 2023-10-14T18:50:41.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 >> v2:172.21.15.144:3300/0 conn(0x7ff0480d10a0 msgr2=0x7ff048164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:41.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 --2- 172.21.15.79:0/2949346920 >> v2:172.21.15.144:3300/0 conn(0x7ff0480d10a0 0x7ff048164980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 >> v1:172.21.15.144:6789/0 conn(0x7ff048159b70 legacy=0x7ff0480cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480b3e70 con 0x7ff048159f40 2023-10-14T18:50:41.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff030001470 con 0x7ff048159f40 2023-10-14T18:50:41.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 >> v1:172.21.15.79:6789/0 conn(0x7ff048159f40 legacy=0x7ff0480d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff034003a60 0x7ff034003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff034004810 0x7ff034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff03400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480b3b90 con 0x7ff0340052e0 2023-10-14T18:50:41.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400c2a0 con 0x7ff034003a60 2023-10-14T18:50:41.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400c460 con 0x7ff034004810 2023-10-14T18:50:41.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff03400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff03ffff700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff034004810 0x7ff034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff046ffd700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff034003a60 0x7ff034003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 -- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff034004810 msgr2=0x7ff034004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:41.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff034004810 0x7ff034004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 -- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff034003a60 msgr2=0x7ff034003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:41.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff034003a60 0x7ff034003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 -- 172.21.15.79:0/2949346920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034003570 con 0x7ff0340052e0 2023-10-14T18:50:41.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff046ffd700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff034003a60 0x7ff034003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:41.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 -- 172.21.15.79:0/2949346920 reap_dead start 2023-10-14T18:50:41.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.368+0000 7ff0477fe700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff03400ba60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff0480d14a0 tx=0x7ff04000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d63dd86793b325c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000ea60 con 0x7ff0340052e0 2023-10-14T18:50:41.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000f040 con 0x7ff0340052e0 2023-10-14T18:50:41.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff0467fc700 1 -- 172.21.15.79:0/2949346920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000ee30 con 0x7ff0340052e0 2023-10-14T18:50:41.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 -- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 msgr2=0x7ff03400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff03400ba60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff0480d14a0 tx=0x7ff04000b040 comp rx=0 tx=0).stop 2023-10-14T18:50:41.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 -- 172.21.15.79:0/2949346920 shutdown_connections 2023-10-14T18:50:41.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 --2- 172.21.15.79:0/2949346920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff03400ba60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 -- 172.21.15.79:0/2949346920 >> 172.21.15.79:0/2949346920 conn(0x7ff0480680f0 msgr2=0x7ff048068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:41.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 -- 172.21.15.79:0/2949346920 shutdown_connections 2023-10-14T18:50:41.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.369+0000 7ff047fff700 1 -- 172.21.15.79:0/2949346920 wait complete. 2023-10-14T18:50:41.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.370+0000 7ff047fff700 1 Processor -- start 2023-10-14T18:50:41.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.370+0000 7ff047fff700 1 -- start start 2023-10-14T18:50:41.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff048154800 0x7ff048154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff04814e3a0 0x7ff04814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814ed50 con 0x7ff0340052e0 2023-10-14T18:50:41.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04814ff20 con 0x7ff048154800 2023-10-14T18:50:41.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff047fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff048150200 con 0x7ff04814e3a0 2023-10-14T18:50:41.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46434/0 (socket says 172.21.15.79:46434) 2023-10-14T18:50:41.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 -- 172.21.15.79:0/896465026 learned_addr learned my addr 172.21.15.79:0/896465026 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:41.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff03ffff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff048154800 0x7ff048154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff0477fe700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff04814e3a0 0x7ff04814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 -- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff04814e3a0 msgr2=0x7ff04814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff04814e3a0 0x7ff04814e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 -- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff048154800 msgr2=0x7ff048154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff048154800 0x7ff048154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 -- 172.21.15.79:0/896465026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0481504e0 con 0x7ff0340052e0 2023-10-14T18:50:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.371+0000 7ff046ffd700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e580 tx=0x7ff038009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011460 con 0x7ff0340052e0 2023-10-14T18:50:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038010040 con 0x7ff0340052e0 2023-10-14T18:50:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038011810 con 0x7ff0340052e0 2023-10-14T18:50:41.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0481507c0 con 0x7ff0340052e0 2023-10-14T18:50:41.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff048150d80 con 0x7ff0340052e0 2023-10-14T18:50:41.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.372+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0480891c0 con 0x7ff0340052e0 2023-10-14T18:50:41.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.373+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff038011c00 con 0x7ff0340052e0 2023-10-14T18:50:41.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.373+0000 7ff03effd700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.373+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff038083420 con 0x7ff0340052e0 2023-10-14T18:50:41.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.373+0000 7ff03ffff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.374+0000 7ff03ffff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 0x7ff0280693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff0300015a0 tx=0x7ff030009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.377+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff03804d5a0 con 0x7ff0340052e0 2023-10-14T18:50:41.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.559+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0480ce340 con 0x7ff0340052e0 2023-10-14T18:50:41.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.560+0000 7ff03effd700 1 -- 172.21.15.79:0/896465026 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+12145 (secure 0 0 0) 0x7ff038050a90 con 0x7ff0340052e0 2023-10-14T18:50:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:41.562 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":119,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:40.809959+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 msgr2=0x7ff0280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 0x7ff0280693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff0300015a0 tx=0x7ff030009040 comp rx=0 tx=0).stop 2023-10-14T18:50:41.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 msgr2=0x7ff04814c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff03800e580 tx=0x7ff038009040 comp rx=0 tx=0).stop 2023-10-14T18:50:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 shutdown_connections 2023-10-14T18:50:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff028066f30 0x7ff0280693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff04814e3a0 0x7ff04814e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0340052e0 0x7ff04814c800 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 --2- 172.21.15.79:0/896465026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff048154800 0x7ff048154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 >> 172.21.15.79:0/896465026 conn(0x7ff0480680f0 msgr2=0x7ff0480b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 shutdown_connections 2023-10-14T18:50:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.562+0000 7ff047fff700 1 -- 172.21.15.79:0/896465026 wait complete. 2023-10-14T18:50:41.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:50:41.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:50:41.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 Processor -- start 2023-10-14T18:50:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 -- start start 2023-10-14T18:50:41.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 0x7f6d3c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0b0790 con 0x7f6d3c06acb0 2023-10-14T18:50:41.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3c0ce1f0 con 0x7f6d3c15a290 2023-10-14T18:50:41.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.693+0000 7f6d41995700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c0b0b20 con 0x7f6d3c159ec0 2023-10-14T18:50:41.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6d3c06acb0 0x7f6d3c0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58168/0 (socket says 172.21.15.79:58168) 2023-10-14T18:50:41.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3b7fe700 1 -- 172.21.15.79:0/4173847587 learned_addr learned my addr 172.21.15.79:0/4173847587 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3affd700 1 --2- 172.21.15.79:0/4173847587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 0x7f6d3c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711854039 0 0) 0x7f6d3c0b0790 con 0x7f6d3c06acb0 2023-10-14T18:50:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d28003570 con 0x7f6d3c06acb0 2023-10-14T18:50:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286878458 0 0) 0x7f6d3c0ce1f0 con 0x7f6d3c15a290 2023-10-14T18:50:41.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d3c0b0790 con 0x7f6d3c15a290 2023-10-14T18:50:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220813181 0 0) 0x7f6d28003570 con 0x7f6d3c06acb0 2023-10-14T18:50:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3affd700 1 -- 172.21.15.79:0/4173847587 >> v1:172.21.15.144:6789/0 conn(0x7f6d3c15a290 legacy=0x7f6d3c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3affd700 1 -- 172.21.15.79:0/4173847587 >> v1:172.21.15.79:6789/0 conn(0x7f6d3c06acb0 legacy=0x7f6d3c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3affd700 1 -- 172.21.15.79:0/4173847587 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0b04b0 con 0x7f6d3c159ec0 2023-10-14T18:50:41.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3affd700 1 --2- 172.21.15.79:0/4173847587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 0x7f6d3c0af940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009910 tx=0x7f6d2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189567408f063503 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.694+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340017f0 con 0x7f6d3c159ec0 2023-10-14T18:50:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011420 con 0x7f6d3c159ec0 2023-10-14T18:50:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d3a7fc700 1 -- 172.21.15.79:0/4173847587 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0117c0 con 0x7f6d3c159ec0 2023-10-14T18:50:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 -- 172.21.15.79:0/4173847587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 msgr2=0x7f6d3c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 --2- 172.21.15.79:0/4173847587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 0x7f6d3c0af940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009910 tx=0x7f6d2c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 -- 172.21.15.79:0/4173847587 shutdown_connections 2023-10-14T18:50:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 --2- 172.21.15.79:0/4173847587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c159ec0 0x7f6d3c0af940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 -- 172.21.15.79:0/4173847587 >> 172.21.15.79:0/4173847587 conn(0x7f6d3c0d1880 msgr2=0x7f6d3c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 -- 172.21.15.79:0/4173847587 shutdown_connections 2023-10-14T18:50:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.695+0000 7f6d41995700 1 -- 172.21.15.79:0/4173847587 wait complete. 2023-10-14T18:50:41.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.696+0000 7f6d41995700 1 Processor -- start 2023-10-14T18:50:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.696+0000 7f6d41995700 1 -- start start 2023-10-14T18:50:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 0x7f6d3c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 0x7f6d3c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c14afe0 con 0x7f6d3c15a290 2023-10-14T18:50:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c14b880 con 0x7f6d3c159ec0 2023-10-14T18:50:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d41995700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3c14a890 con 0x7f6d3c06acb0 2023-10-14T18:50:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46438/0 (socket says 172.21.15.79:46438) 2023-10-14T18:50:41.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 -- 172.21.15.79:0/3748810005 learned_addr learned my addr 172.21.15.79:0/3748810005 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:41.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3affd700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 0x7f6d3c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 -- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 msgr2=0x7f6d3c1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d327fc700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 0x7f6d3c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 0x7f6d3c1471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 -- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 msgr2=0x7f6d3c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 0x7f6d3c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3b7fe700 1 -- 172.21.15.79:0/3748810005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c009420 con 0x7f6d3c15a290 2023-10-14T18:50:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d3affd700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 0x7f6d3c1471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.697+0000 7f6d327fc700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 0x7f6d3c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d3b7fe700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400cc40 tx=0x7f6d34007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34004dc0 con 0x7f6d3c15a290 2023-10-14T18:50:41.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3400a6b0 con 0x7f6d3c15a290 2023-10-14T18:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400aa70 con 0x7f6d3c15a290 2023-10-14T18:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c14b230 con 0x7f6d3c15a290 2023-10-14T18:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.698+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3c1476f0 con 0x7f6d3c15a290 2023-10-14T18:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.699+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3c04c3c0 con 0x7f6d3c15a290 2023-10-14T18:50:41.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.699+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d34007150 con 0x7f6d3c15a290 2023-10-14T18:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.699+0000 7f6d337fe700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.699+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6d34083860 con 0x7f6d3c15a290 2023-10-14T18:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.700+0000 7f6d3affd700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.700+0000 7f6d3affd700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0093a0 tx=0x7f6d2c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:41.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.703+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d34050ea0 con 0x7f6d3c15a290 2023-10-14T18:50:41.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.886+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d3c14b9c0 con 0x7f6d3c15a290 2023-10-14T18:50:41.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.886+0000 7f6d337fe700 1 -- 172.21.15.79:0/3748810005 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d34018020 con 0x7f6d3c15a290 2023-10-14T18:50:41.888 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:50:41.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 msgr2=0x7f6d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0093a0 tx=0x7f6d2c016000 comp rx=0 tx=0).stop 2023-10-14T18:50:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 msgr2=0x7f6d3c0ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400cc40 tx=0x7f6d34007c70 comp rx=0 tx=0).stop 2023-10-14T18:50:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 shutdown_connections 2023-10-14T18:50:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6d3c15a290 0x7f6d3c0ca4f0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d3c06acb0 0x7f6d3c1471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 --2- 172.21.15.79:0/3748810005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d3c159ec0 0x7f6d3c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:41.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 >> 172.21.15.79:0/3748810005 conn(0x7f6d3c0d1880 msgr2=0x7f6d3c0c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:41.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 shutdown_connections 2023-10-14T18:50:41.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:41.888+0000 7f6d41995700 1 -- 172.21.15.79:0/3748810005 wait complete. 2023-10-14T18:50:41.908 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:50:42.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.021+0000 7f26b41b8700 1 Processor -- start 2023-10-14T18:50:42.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.021+0000 7f26b41b8700 1 -- start start 2023-10-14T18:50:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b41b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26ac0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b41b8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac0cbb10 con 0x7f26ac152020 2023-10-14T18:50:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b41b8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac0cbfa0 con 0x7f26ac1523f0 2023-10-14T18:50:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b41b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0caca0 con 0x7f26ac15bf00 2023-10-14T18:50:42.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b1f54700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f26ac152020 0x7f26ac15b7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58178/0 (socket says 172.21.15.79:58178) 2023-10-14T18:50:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.022+0000 7f26b1f54700 1 -- 172.21.15.79:0/1050753677 learned_addr learned my addr 172.21.15.79:0/1050753677 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999381903 0 0) 0x7f26ac0cbb10 con 0x7f26ac152020 2023-10-14T18:50:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2698003570 con 0x7f26ac152020 2023-10-14T18:50:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26ac0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4290928914 0 0) 0x7f2698003570 con 0x7f26ac152020 2023-10-14T18:50:42.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 msgr2=0x7f26ac0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:42.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26ac0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 >> v1:172.21.15.144:6789/0 conn(0x7f26ac1523f0 legacy=0x7f26ac1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac0caf00 con 0x7f26ac152020 2023-10-14T18:50:42.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f26a80017f0 con 0x7f26ac152020 2023-10-14T18:50:42.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 >> v1:172.21.15.79:6789/0 conn(0x7f26ac152020 legacy=0x7f26ac15b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2698003a90 0x7f2698003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f2698004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0caca0 con 0x7f2698004810 2023-10-14T18:50:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269800bb60 con 0x7f2698003a90 2023-10-14T18:50:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269800bd20 con 0x7f26ac15bf00 2023-10-14T18:50:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f2698004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1f54700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2698003a90 0x7f2698003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b2755700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 -- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 msgr2=0x7f26980051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac15bf00 0x7f26980051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 -- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2698003a90 msgr2=0x7f2698003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2698003a90 0x7f2698003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.023+0000 7f26b1753700 1 -- 172.21.15.79:0/1050753677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698003570 con 0x7f2698004810 2023-10-14T18:50:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b1753700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f2698004c80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f269c009c00 tx=0x7f269c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e1ae00474a893 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00e710 con 0x7f2698004810 2023-10-14T18:50:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c00e870 con 0x7f2698004810 2023-10-14T18:50:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b0f52700 1 -- 172.21.15.79:0/1050753677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00ec30 con 0x7f2698004810 2023-10-14T18:50:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 -- 172.21.15.79:0/1050753677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 msgr2=0x7f2698004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 --2- 172.21.15.79:0/1050753677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f2698004c80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f269c009c00 tx=0x7f269c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b2755700 1 -- 172.21.15.79:0/1050753677 reap_dead start 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 -- 172.21.15.79:0/1050753677 shutdown_connections 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 -- 172.21.15.79:0/1050753677 >> 172.21.15.79:0/1050753677 conn(0x7f26ac069870 msgr2=0x7f26ac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 -- 172.21.15.79:0/1050753677 shutdown_connections 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.024+0000 7f26b41b8700 1 -- 172.21.15.79:0/1050753677 wait complete. 2023-10-14T18:50:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.025+0000 7f26b41b8700 1 Processor -- start 2023-10-14T18:50:42.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.025+0000 7f26b41b8700 1 -- start start 2023-10-14T18:50:42.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 0x7f26ac14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac0cc6f0 0x7f26ac0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac14f490 con 0x7f2698004810 2023-10-14T18:50:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac168560 con 0x7f26ac14eae0 2023-10-14T18:50:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b41b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0cd460 con 0x7f26ac0cc6f0 2023-10-14T18:50:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46456/0 (socket says 172.21.15.79:46456) 2023-10-14T18:50:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 -- 172.21.15.79:0/2841380811 learned_addr learned my addr 172.21.15.79:0/2841380811 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1753700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 0x7f26ac14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b2755700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac0cc6f0 0x7f26ac0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 -- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac0cc6f0 msgr2=0x7f26ac0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac0cc6f0 0x7f26ac0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 -- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 msgr2=0x7f26ac14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 0x7f26ac14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1f54700 1 -- 172.21.15.79:0/2841380811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac0cd740 con 0x7f2698004810 2023-10-14T18:50:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.026+0000 7f26b1753700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 0x7f26ac14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26b1f54700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f26a8007a70 tx=0x7f26ac0cba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a800ad70 con 0x7f2698004810 2023-10-14T18:50:42.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a80133f0 con 0x7f2698004810 2023-10-14T18:50:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac0cda20 con 0x7f2698004810 2023-10-14T18:50:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80137b0 con 0x7f2698004810 2023-10-14T18:50:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.027+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac14b1d0 con 0x7f2698004810 2023-10-14T18:50:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.028+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac04c3c0 con 0x7f2698004810 2023-10-14T18:50:42.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.028+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26a8013b20 con 0x7f2698004810 2023-10-14T18:50:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.029+0000 7f26a1ffb700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.029+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f26a8085040 con 0x7f2698004810 2023-10-14T18:50:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.029+0000 7f26b1753700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.029+0000 7f26b1753700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 0x7f26900693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0c8830 tx=0x7f269c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.033+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a8052600 con 0x7f2698004810 2023-10-14T18:50:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.215+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f26ac0cb1e0 con 0x7f2698004810 2023-10-14T18:50:42.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.216+0000 7f26a1ffb700 1 -- 172.21.15.79:0/2841380811 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+65 (secure 0 0 0) 0x7f26a8017090 con 0x7f2698004810 2023-10-14T18:50:42.218 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:42.218 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:50:42.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:50:42.219 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:50:42.219 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:50:42.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:50:42.219 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:50:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 msgr2=0x7f26900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 0x7f26900693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f26ac0c8830 tx=0x7f269c01a000 comp rx=0 tx=0).stop 2023-10-14T18:50:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 msgr2=0x7f26ac14ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f26a8007a70 tx=0x7f26ac0cba80 comp rx=0 tx=0).stop 2023-10-14T18:50:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 shutdown_connections 2023-10-14T18:50:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2690066f30 0x7f26900693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26ac0cc6f0 0x7f26ac0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2698004810 0x7f26ac14ac90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 --2- 172.21.15.79:0/2841380811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26ac14eae0 0x7f26ac14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 >> 172.21.15.79:0/2841380811 conn(0x7f26ac069870 msgr2=0x7f26ac14bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 shutdown_connections 2023-10-14T18:50:42.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.218+0000 7f26b41b8700 1 -- 172.21.15.79:0/2841380811 wait complete. 2023-10-14T18:50:42.231 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:50:42.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:50:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.348+0000 7fae9d575700 1 Processor -- start 2023-10-14T18:50:42.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.348+0000 7fae9d575700 1 -- start start 2023-10-14T18:50:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9d575700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 0x7fae980ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9d575700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 0x7fae980cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9d575700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae980cbb80 con 0x7fae9815d240 2023-10-14T18:50:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9d575700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae980cbe60 con 0x7fae980cc940 2023-10-14T18:50:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9d575700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae980cc140 con 0x7fae980ce810 2023-10-14T18:50:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae9cd74700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 0x7fae980cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae977fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 0x7fae980ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae97fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fae9815d240 0x7fae980b3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:37462/0 (socket says 172.21.15.79:37462) 2023-10-14T18:50:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.349+0000 7fae97fff700 1 -- 172.21.15.79:0/4218276115 learned_addr learned my addr 172.21.15.79:0/4218276115 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9cd74700 1 -- 172.21.15.79:0/4218276115 >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 msgr2=0x7fae980ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9cd74700 1 --2- 172.21.15.79:0/4218276115 >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 0x7fae980ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9cd74700 1 -- 172.21.15.79:0/4218276115 >> v1:172.21.15.144:6789/0 conn(0x7fae9815d240 legacy=0x7fae980b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9cd74700 1 -- 172.21.15.79:0/4218276115 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980cc420 con 0x7fae980ce810 2023-10-14T18:50:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae96ffd700 1 -- 172.21.15.79:0/4218276115 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087508951 0 0) 0x7fae980cbb80 con 0x7fae9815d240 2023-10-14T18:50:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae977fe700 1 --2- 172.21.15.79:0/4218276115 >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 0x7fae980ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9cd74700 1 --2- 172.21.15.79:0/4218276115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 0x7fae980cec90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae90009e60 tx=0x7fae90009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=777d6adeb7f2c446 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae96ffd700 1 -- 172.21.15.79:0/4218276115 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9000e070 con 0x7fae980ce810 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae96ffd700 1 -- 172.21.15.79:0/4218276115 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9000bb60 con 0x7fae980ce810 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae96ffd700 1 -- 172.21.15.79:0/4218276115 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90012430 con 0x7fae980ce810 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 -- 172.21.15.79:0/4218276115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 msgr2=0x7fae980cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 --2- 172.21.15.79:0/4218276115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 0x7fae980cec90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae90009e60 tx=0x7fae90009780 comp rx=0 tx=0).stop 2023-10-14T18:50:42.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 -- 172.21.15.79:0/4218276115 shutdown_connections 2023-10-14T18:50:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 --2- 172.21.15.79:0/4218276115 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980ce810 0x7fae980cec90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 --2- 172.21.15.79:0/4218276115 >> v2:172.21.15.144:3300/0 conn(0x7fae980cc940 0x7fae980ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.350+0000 7fae9d575700 1 -- 172.21.15.79:0/4218276115 >> 172.21.15.79:0/4218276115 conn(0x7fae98067e40 msgr2=0x7fae980d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.351+0000 7fae9d575700 1 -- 172.21.15.79:0/4218276115 shutdown_connections 2023-10-14T18:50:42.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.351+0000 7fae9d575700 1 -- 172.21.15.79:0/4218276115 wait complete. 2023-10-14T18:50:42.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 Processor -- start 2023-10-14T18:50:42.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 -- start start 2023-10-14T18:50:42.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 0x7fae9816d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 0x7fae98154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98156510 con 0x7fae980ce810 2023-10-14T18:50:42.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9816dc70 con 0x7fae9815d240 2023-10-14T18:50:42.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.352+0000 7fae9d575700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae981561c0 con 0x7fae980cc940 2023-10-14T18:50:42.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46466/0 (socket says 172.21.15.79:46466) 2023-10-14T18:50:42.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 -- 172.21.15.79:0/4064118988 learned_addr learned my addr 172.21.15.79:0/4064118988 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:42.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae9cd74700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 0x7fae98154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae97fff700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 0x7fae9816d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 -- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 msgr2=0x7fae9816d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 0x7fae9816d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 -- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 msgr2=0x7fae98154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:42.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 0x7fae98154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:42.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 -- 172.21.15.79:0/4064118988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c009420 con 0x7fae980ce810 2023-10-14T18:50:42.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae9cd74700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 0x7fae98154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:42.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae97fff700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 0x7fae9816d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:42.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae977fe700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00ec80 tx=0x7fae8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00c9d0 con 0x7fae980ce810 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00cb30 con 0x7fae980ce810 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90009a20 con 0x7fae980ce810 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00ceb0 con 0x7fae980ce810 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.353+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9816e1f0 con 0x7fae980ce810 2023-10-14T18:50:42.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.354+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae98156680 con 0x7fae980ce810 2023-10-14T18:50:42.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.355+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae8c013680 con 0x7fae980ce810 2023-10-14T18:50:42.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.355+0000 7fae7ffff700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 0x7fae84069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:42.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.355+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fae8c084530 con 0x7fae980ce810 2023-10-14T18:50:42.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.355+0000 7fae97fff700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 0x7fae84069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:42.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.356+0000 7fae97fff700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 0x7fae84069410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae88001800 tx=0x7fae88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:42.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.359+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae8c051af0 con 0x7fae980ce810 2023-10-14T18:50:42.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:42.544+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fae9806ac60 con 0x7fae980ce810 2023-10-14T18:50:43.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.530+0000 7fae7ffff700 1 -- 172.21.15.79:0/4064118988 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7fae8c055110 con 0x7fae980ce810 2023-10-14T18:50:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 msgr2=0x7fae84069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 0x7fae84069410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fae88001800 tx=0x7fae88009040 comp rx=0 tx=0).stop 2023-10-14T18:50:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 msgr2=0x7fae980cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00ec80 tx=0x7fae8c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 shutdown_connections 2023-10-14T18:50:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fae84066f60 0x7fae84069410 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae9815d240 0x7fae98154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae980cc940 0x7fae9816d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 --2- 172.21.15.79:0/4064118988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae980ce810 0x7fae980cd030 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 >> 172.21.15.79:0/4064118988 conn(0x7fae98067e40 msgr2=0x7fae980c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:43.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 shutdown_connections 2023-10-14T18:50:43.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.534+0000 7fae9d575700 1 -- 172.21.15.79:0/4064118988 wait complete. 2023-10-14T18:50:43.541 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:50:43.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:50:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.671+0000 7f0b62367700 1 Processor -- start 2023-10-14T18:50:43.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 -- start start 2023-10-14T18:50:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b5c06aa00 0x7f0b5c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c06b0a0 con 0x7f0b5c0cd630 2023-10-14T18:50:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c15b2e0 con 0x7f0b5c06aa00 2023-10-14T18:50:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.672+0000 7f0b62367700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c15ad20 con 0x7f0b5c1542a0 2023-10-14T18:50:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b5c06aa00 0x7f0b5c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61365700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b60b64700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0b5c0cd630 0x7f0b5c06a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:37476/0 (socket says 172.21.15.79:37476) 2023-10-14T18:50:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b60b64700 1 -- 172.21.15.79:0/3066118117 learned_addr learned my addr 172.21.15.79:0/3066118117 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 -- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 msgr2=0x7f0b5c0b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c0b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 -- 172.21.15.79:0/3066118117 >> v1:172.21.15.144:6789/0 conn(0x7f0b5c0cd630 legacy=0x7f0b5c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 -- 172.21.15.79:0/3066118117 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c15b000 con 0x7f0b5c06aa00 2023-10-14T18:50:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61365700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.673+0000 7f0b61b66700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c15c140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0b540098e0 tx=0x7f0b540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad60a4bd923f564f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b53fff700 1 -- 172.21.15.79:0/3066118117 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400b640 con 0x7f0b5c06aa00 2023-10-14T18:50:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b53fff700 1 -- 172.21.15.79:0/3066118117 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5400b7a0 con 0x7f0b5c06aa00 2023-10-14T18:50:43.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b53fff700 1 -- 172.21.15.79:0/3066118117 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400bb40 con 0x7f0b5c06aa00 2023-10-14T18:50:43.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 -- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 msgr2=0x7f0b5c15c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c15c140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0b540098e0 tx=0x7f0b540091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 -- 172.21.15.79:0/3066118117 shutdown_connections 2023-10-14T18:50:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c15c140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 --2- 172.21.15.79:0/3066118117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 -- 172.21.15.79:0/3066118117 >> 172.21.15.79:0/3066118117 conn(0x7f0b5c068cb0 msgr2=0x7f0b5c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 -- 172.21.15.79:0/3066118117 shutdown_connections 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.674+0000 7f0b62367700 1 -- 172.21.15.79:0/3066118117 wait complete. 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.675+0000 7f0b62367700 1 Processor -- start 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.675+0000 7f0b62367700 1 -- start start 2023-10-14T18:50:43.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1587d0 con 0x7f0b5c0cd630 2023-10-14T18:50:43.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c6760 con 0x7f0b5c06aa00 2023-10-14T18:50:43.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b62367700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c5b50 con 0x7f0b5c1542a0 2023-10-14T18:50:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b60b64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b60b64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46468/0 (socket says 172.21.15.79:46468) 2023-10-14T18:50:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.676+0000 7f0b60b64700 1 -- 172.21.15.79:0/799196878 learned_addr learned my addr 172.21.15.79:0/799196878 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b61365700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b61b66700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 -- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 msgr2=0x7f0b5c158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 -- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 msgr2=0x7f0b5c169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:43.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 -- 172.21.15.79:0/799196878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009a20 con 0x7f0b5c0cd630 2023-10-14T18:50:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b60b64700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00c7c0 tx=0x7f0b4c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c005b30 con 0x7f0b5c0cd630 2023-10-14T18:50:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c005c90 con 0x7f0b5c0cd630 2023-10-14T18:50:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004a80 con 0x7f0b5c0cd630 2023-10-14T18:50:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b54009420 con 0x7f0b5c0cd630 2023-10-14T18:50:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.677+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0c6110 con 0x7f0b5c0cd630 2023-10-14T18:50:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.678+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c0c68d0 con 0x7f0b5c0cd630 2023-10-14T18:50:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.679+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b4c0070d0 con 0x7f0b5c0cd630 2023-10-14T18:50:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.679+0000 7f0b517fa700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 0x7f0b400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:43.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.679+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f0b4c083640 con 0x7f0b5c0cd630 2023-10-14T18:50:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.679+0000 7f0b61365700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 0x7f0b400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.680+0000 7f0b61365700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 0x7f0b400693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800f750 tx=0x7f0b5800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:43.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.683+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b4c04b5a0 con 0x7f0b5c0cd630 2023-10-14T18:50:43.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:43.870+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b5c089600 con 0x7f0b5c0cd630 2023-10-14T18:50:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.537+0000 7f0b517fa700 1 -- 172.21.15.79:0/799196878 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b4c050a90 con 0x7f0b5c0cd630 2023-10-14T18:50:44.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.545+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 msgr2=0x7f0b400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.545+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 0x7f0b400693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800f750 tx=0x7f0b5800b040 comp rx=0 tx=0).stop 2023-10-14T18:50:44.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.545+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 msgr2=0x7f0b5c157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.545+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00c7c0 tx=0x7f0b4c007f70 comp rx=0 tx=0).stop 2023-10-14T18:50:44.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 shutdown_connections 2023-10-14T18:50:44.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b40066f30 0x7f0b400693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b5c1542a0 0x7f0b5c158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5c06aa00 0x7f0b5c169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 --2- 172.21.15.79:0/799196878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5c0cd630 0x7f0b5c157d50 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.546+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 >> 172.21.15.79:0/799196878 conn(0x7f0b5c068cb0 msgr2=0x7f0b5c0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:44.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.547+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 shutdown_connections 2023-10-14T18:50:44.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.547+0000 7f0b62367700 1 -- 172.21.15.79:0/799196878 wait complete. 2023-10-14T18:50:44.549 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:50:44.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:50:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.678+0000 7f90e6c57700 1 Processor -- start 2023-10-14T18:50:44.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.678+0000 7f90e6c57700 1 -- start start 2023-10-14T18:50:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e6c57700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90e015a290 0x7f90e006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e6c57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90e00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e6c57700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e00b0790 con 0x7f90e0159ec0 2023-10-14T18:50:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e6c57700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e006af60 con 0x7f90e015a290 2023-10-14T18:50:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e6c57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00ce1f0 con 0x7f90e006aae0 2023-10-14T18:50:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e49f3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f90e0159ec0 0x7f90e00af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58186/0 (socket says 172.21.15.79:58186) 2023-10-14T18:50:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e49f3700 1 -- 172.21.15.79:0/3841376923 learned_addr learned my addr 172.21.15.79:0/3841376923 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90d7fff700 1 --2- 172.21.15.79:0/3841376923 >> v2:172.21.15.144:3300/0 conn(0x7f90e015a290 0x7f90e006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90e51f4700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90e00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.679+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644807983 0 0) 0x7f90e00b0790 con 0x7f90e0159ec0 2023-10-14T18:50:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c8003570 con 0x7f90e0159ec0 2023-10-14T18:50:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706617766 0 0) 0x7f90c8003570 con 0x7f90e0159ec0 2023-10-14T18:50:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 msgr2=0x7f90e00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90e00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 >> v2:172.21.15.144:3300/0 conn(0x7f90e015a290 msgr2=0x7f90e006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 --2- 172.21.15.79:0/3841376923 >> v2:172.21.15.144:3300/0 conn(0x7f90e015a290 0x7f90e006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00b0b20 con 0x7f90e0159ec0 2023-10-14T18:50:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f90dc0017f0 con 0x7f90e0159ec0 2023-10-14T18:50:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 >> v1:172.21.15.79:6789/0 conn(0x7f90e0159ec0 legacy=0x7f90e00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c8004d50 0x7f90c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e006af60 con 0x7f90c8003a60 2023-10-14T18:50:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00ce1f0 con 0x7f90c8004d50 2023-10-14T18:50:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c800ba60 con 0x7f90e006aae0 2023-10-14T18:50:44.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e51f4700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c8004d50 0x7f90c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90d7fff700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 -- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 msgr2=0x7f90c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:44.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e006aae0 0x7f90c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 -- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c8004d50 msgr2=0x7f90c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90c8004d50 0x7f90c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 -- 172.21.15.79:0/3841376923 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8003570 con 0x7f90c8003a60 2023-10-14T18:50:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.680+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90c8003e70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a970 tx=0x7f90dc002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377bc71ce0ac2198 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:44.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0070d0 con 0x7f90c8003a60 2023-10-14T18:50:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc007230 con 0x7f90c8003a60 2023-10-14T18:50:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90d77fe700 1 -- 172.21.15.79:0/3841376923 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0075d0 con 0x7f90c8003a60 2023-10-14T18:50:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 -- 172.21.15.79:0/3841376923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 msgr2=0x7f90c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3841376923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90c8003e70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a970 tx=0x7f90dc002210 comp rx=0 tx=0).stop 2023-10-14T18:50:44.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e51f4700 1 -- 172.21.15.79:0/3841376923 reap_dead start 2023-10-14T18:50:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 -- 172.21.15.79:0/3841376923 shutdown_connections 2023-10-14T18:50:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 -- 172.21.15.79:0/3841376923 >> 172.21.15.79:0/3841376923 conn(0x7f90e00d1880 msgr2=0x7f90e00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 -- 172.21.15.79:0/3841376923 shutdown_connections 2023-10-14T18:50:44.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.681+0000 7f90e6c57700 1 -- 172.21.15.79:0/3841376923 wait complete. 2023-10-14T18:50:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.682+0000 7f90e6c57700 1 Processor -- start 2023-10-14T18:50:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.682+0000 7f90e6c57700 1 -- start start 2023-10-14T18:50:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e01582a0 0x7f90e00c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 0x7f90e00ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015bd20 con 0x7f90c8003a60 2023-10-14T18:50:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015c1b0 con 0x7f90e01582a0 2023-10-14T18:50:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e6c57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015b110 con 0x7f90e014dd30 2023-10-14T18:50:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46496/0 (socket says 172.21.15.79:46496) 2023-10-14T18:50:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 -- 172.21.15.79:0/3860953794 learned_addr learned my addr 172.21.15.79:0/3860953794 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e51f4700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 0x7f90e00ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90d7fff700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e01582a0 0x7f90e00c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 -- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 msgr2=0x7f90e00ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 0x7f90e00ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 -- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e01582a0 msgr2=0x7f90e00c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e01582a0 0x7f90e00c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e49f3700 1 -- 172.21.15.79:0/3860953794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e015b3f0 con 0x7f90c8003a60 2023-10-14T18:50:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.683+0000 7f90e51f4700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 0x7f90e00ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90e49f3700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004730 tx=0x7f90dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0075b0 con 0x7f90c8003a60 2023-10-14T18:50:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc012400 con 0x7f90c8003a60 2023-10-14T18:50:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e015b6d0 con 0x7f90c8003a60 2023-10-14T18:50:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0125b0 con 0x7f90c8003a60 2023-10-14T18:50:44.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.684+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e015d2a0 con 0x7f90c8003a60 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.685+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e015bb70 con 0x7f90c8003a60 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.685+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90dc024030 con 0x7f90c8003a60 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.686+0000 7f90d4ff9700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.686+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f90dc0864a0 con 0x7f90c8003a60 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.686+0000 7f90d7fff700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:44.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.686+0000 7f90d7fff700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 0x7f90cc0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f90d0006dc0 tx=0x7f90d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:44.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.690+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90dc0536d0 con 0x7f90c8003a60 2023-10-14T18:50:44.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:44.918+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f90e015d4c0 con 0x7f90c8003a60 2023-10-14T18:50:45.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.810+0000 7f90d4ff9700 1 -- 172.21.15.79:0/3860953794 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7f90e015d4c0 con 0x7f90c8003a60 2023-10-14T18:50:45.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 msgr2=0x7f90cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 0x7f90cc0693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f90d0006dc0 tx=0x7f90d0008040 comp rx=0 tx=0).stop 2023-10-14T18:50:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 msgr2=0x7f90e015cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004730 tx=0x7f90dc015000 comp rx=0 tx=0).stop 2023-10-14T18:50:45.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 shutdown_connections 2023-10-14T18:50:45.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f90cc066f30 0x7f90cc0693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f90e014dd30 0x7f90e00ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90c8003a60 0x7f90e015cd60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 --2- 172.21.15.79:0/3860953794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e01582a0 0x7f90e00c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 >> 172.21.15.79:0/3860953794 conn(0x7f90e00d1880 msgr2=0x7f90e0158e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:45.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 shutdown_connections 2023-10-14T18:50:45.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.829+0000 7f90e6c57700 1 -- 172.21.15.79:0/3860953794 wait complete. 2023-10-14T18:50:45.832 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 14 and data pool 15 2023-10-14T18:50:45.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:45.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.957+0000 7f2c215ad700 1 Processor -- start 2023-10-14T18:50:45.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.957+0000 7f2c215ad700 1 -- start start 2023-10-14T18:50:45.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c15a2b0 0x7f2c1c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2c1c0d1c30 0x7f2c1c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c1c15a680 0x7f2c1c0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c068470 con 0x7f2c1c15a680 2023-10-14T18:50:45.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0c5d80 con 0x7f2c1c0d1c30 2023-10-14T18:50:45.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c215ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0c6060 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c1c15a680 0x7f2c1c0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c1c15a680 0x7f2c1c0cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46510/0 (socket says 172.21.15.79:46510) 2023-10-14T18:50:45.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 -- 172.21.15.79:0/1359104640 learned_addr learned my addr 172.21.15.79:0/1359104640 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:45.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1affd700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c15a2b0 0x7f2c1c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1a7fc700 1 --2- 172.21.15.79:0/1359104640 >> v2:172.21.15.144:3300/0 conn(0x7f2c1c0d1c30 0x7f2c1c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 -- 172.21.15.79:0/1359104640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c15a2b0 msgr2=0x7f2c1c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c15a2b0 0x7f2c1c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 -- 172.21.15.79:0/1359104640 >> v2:172.21.15.144:3300/0 conn(0x7f2c1c0d1c30 msgr2=0x7f2c1c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:45.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 --2- 172.21.15.79:0/1359104640 >> v2:172.21.15.144:3300/0 conn(0x7f2c1c0d1c30 0x7f2c1c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.958+0000 7f2c1b7fe700 1 -- 172.21.15.79:0/1359104640 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0c6340 con 0x7f2c1c15a680 2023-10-14T18:50:45.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c1b7fe700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0cfc50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c089050 tx=0x7f2c14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40432d98f3eb4cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:45.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c19ffb700 1 -- 172.21.15.79:0/1359104640 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400b860 con 0x7f2c1c15a680 2023-10-14T18:50:45.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c19ffb700 1 -- 172.21.15.79:0/1359104640 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1400b9c0 con 0x7f2c1c15a680 2023-10-14T18:50:45.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c19ffb700 1 -- 172.21.15.79:0/1359104640 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400bd60 con 0x7f2c1c15a680 2023-10-14T18:50:45.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 -- 172.21.15.79:0/1359104640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a680 msgr2=0x7f2c1c0cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:45.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0cfc50 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c089050 tx=0x7f2c14009250 comp rx=0 tx=0).stop 2023-10-14T18:50:45.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 -- 172.21.15.79:0/1359104640 shutdown_connections 2023-10-14T18:50:45.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c15a2b0 0x7f2c1c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 --2- 172.21.15.79:0/1359104640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0cfc50 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 --2- 172.21.15.79:0/1359104640 >> v2:172.21.15.144:3300/0 conn(0x7f2c1c0d1c30 0x7f2c1c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 -- 172.21.15.79:0/1359104640 >> 172.21.15.79:0/1359104640 conn(0x7f2c1c067e40 msgr2=0x7f2c1c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:45.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 -- 172.21.15.79:0/1359104640 shutdown_connections 2023-10-14T18:50:45.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.959+0000 7f2c215ad700 1 -- 172.21.15.79:0/1359104640 wait complete. 2023-10-14T18:50:45.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.960+0000 7f2c215ad700 1 Processor -- start 2023-10-14T18:50:45.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 -- start start 2023-10-14T18:50:45.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 0x7f2c1c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c15e140 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c15e3e0 con 0x7f2c1c15a680 2023-10-14T18:50:45.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c215ad700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c15c0f0 con 0x7f2c1c0d1c30 2023-10-14T18:50:45.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c1a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c1a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46518/0 (socket says 172.21.15.79:46518) 2023-10-14T18:50:45.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.961+0000 7f2c1a7fc700 1 -- 172.21.15.79:0/3539824698 learned_addr learned my addr 172.21.15.79:0/3539824698 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:45.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1affd700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 0x7f2c1c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1b7fe700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 -- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 msgr2=0x7f2c1c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:45.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 0x7f2c1c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 -- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 msgr2=0x7f2c1c0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:45.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:45.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 -- 172.21.15.79:0/3539824698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140094f0 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1affd700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 0x7f2c1c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:45.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1b7fe700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:45.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c1a7fc700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000d860 tx=0x7f2c10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:45.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100125f0 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c10012770 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c15c3d0 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10012b30 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.962+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c15bd20 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.963+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c04c3c0 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.963+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c1001e460 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.964+0000 7f2c02ffd700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 0x7f2c080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.964+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c10084ab0 con 0x7f2c1c15a2b0 2023-10-14T18:50:45.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.964+0000 7f2c1affd700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 0x7f2c080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:45.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.965+0000 7f2c1affd700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 0x7f2c080693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007470 tx=0x7f2c0c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:45.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:45.968+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c10051d20 con 0x7f2c1c15a2b0 2023-10-14T18:50:46.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.151+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c1c15e520 con 0x7f2c1c15a2b0 2023-10-14T18:50:46.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.152+0000 7f2c02ffd700 1 -- 172.21.15.79:0/3539824698 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f2c10055340 con 0x7f2c1c15a2b0 2023-10-14T18:50:46.153 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:46.153 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":122,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:44.919305+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:46.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 msgr2=0x7f2c080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 0x7f2c080693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007470 tx=0x7f2c0c00b040 comp rx=0 tx=0).stop 2023-10-14T18:50:46.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 msgr2=0x7f2c1c0c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000d860 tx=0x7f2c10008040 comp rx=0 tx=0).stop 2023-10-14T18:50:46.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 shutdown_connections 2023-10-14T18:50:46.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2c08066f30 0x7f2c080693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c15a680 0x7f2c1c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c0d1c30 0x7f2c1c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 --2- 172.21.15.79:0/3539824698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c1c15a2b0 0x7f2c1c0c9910 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 >> 172.21.15.79:0/3539824698 conn(0x7f2c1c067e40 msgr2=0x7f2c1c0695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:46.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 shutdown_connections 2023-10-14T18:50:46.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.154+0000 7f2c215ad700 1 -- 172.21.15.79:0/3539824698 wait complete. 2023-10-14T18:50:46.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:46.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.280+0000 7fd3788f3700 1 Processor -- start 2023-10-14T18:50:46.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 -- start start 2023-10-14T18:50:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37415a1e0 0x7fd3740cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3740b3430 0x7fd3740cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37415db80 con 0x7fd374159e10 2023-10-14T18:50:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37415e800 con 0x7fd3740b3430 2023-10-14T18:50:46.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd3788f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37415de60 con 0x7fd37415a1e0 2023-10-14T18:50:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.281+0000 7fd372d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3740b3430 0x7fd3740cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd37259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd374159e10 0x7fd3740b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58192/0 (socket says 172.21.15.79:58192) 2023-10-14T18:50:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3740b3430 0x7fd3740cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46520/0 (socket says 172.21.15.79:46520) 2023-10-14T18:50:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd37259c700 1 -- 172.21.15.79:0/3870292093 learned_addr learned my addr 172.21.15.79:0/3870292093 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:46.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd369d9b700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37415a1e0 0x7fd3740cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 -- 172.21.15.79:0/3870292093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37415a1e0 msgr2=0x7fd3740cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37415a1e0 0x7fd3740cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 -- 172.21.15.79:0/3870292093 >> v1:172.21.15.79:6789/0 conn(0x7fd374159e10 legacy=0x7fd3740b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 -- 172.21.15.79:0/3870292093 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37415e140 con 0x7fd3740b3430 2023-10-14T18:50:46.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd371d9b700 1 -- 172.21.15.79:0/3870292093 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147347964 0 0) 0x7fd37415db80 con 0x7fd374159e10 2023-10-14T18:50:46.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd372d9d700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3740b3430 0x7fd3740cdc80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009e60 tx=0x7fd36c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3166ebe9727963f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd371d9b700 1 -- 172.21.15.79:0/3870292093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00e070 con 0x7fd3740b3430 2023-10-14T18:50:46.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd371d9b700 1 -- 172.21.15.79:0/3870292093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00bc30 con 0x7fd3740b3430 2023-10-14T18:50:46.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.282+0000 7fd371d9b700 1 -- 172.21.15.79:0/3870292093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c012430 con 0x7fd3740b3430 2023-10-14T18:50:46.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 -- 172.21.15.79:0/3870292093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3740b3430 msgr2=0x7fd3740cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3740b3430 0x7fd3740cdc80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009e60 tx=0x7fd36c009780 comp rx=0 tx=0).stop 2023-10-14T18:50:46.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 -- 172.21.15.79:0/3870292093 shutdown_connections 2023-10-14T18:50:46.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3740b3430 0x7fd3740cdc80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3870292093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37415a1e0 0x7fd3740cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 -- 172.21.15.79:0/3870292093 >> 172.21.15.79:0/3870292093 conn(0x7fd374067660 msgr2=0x7fd374067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:46.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 -- 172.21.15.79:0/3870292093 shutdown_connections 2023-10-14T18:50:46.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.283+0000 7fd3788f3700 1 -- 172.21.15.79:0/3870292093 wait complete. 2023-10-14T18:50:46.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.284+0000 7fd3788f3700 1 Processor -- start 2023-10-14T18:50:46.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.284+0000 7fd3788f3700 1 -- start start 2023-10-14T18:50:46.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3740b3430 0x7fd374159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 0x7fd374169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740c6ae0 con 0x7fd37415a1e0 2023-10-14T18:50:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740c6dc0 con 0x7fd3740b3430 2023-10-14T18:50:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741597a0 con 0x7fd374159e10 2023-10-14T18:50:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46534/0 (socket says 172.21.15.79:46534) 2023-10-14T18:50:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 -- 172.21.15.79:0/3502368130 learned_addr learned my addr 172.21.15.79:0/3502368130 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd369d9b700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 0x7fd374169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd37259c700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3740b3430 0x7fd374159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 -- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 msgr2=0x7fd374169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 0x7fd374169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 -- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3740b3430 msgr2=0x7fd374159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3740b3430 0x7fd374159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 -- 172.21.15.79:0/3502368130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009a20 con 0x7fd37415a1e0 2023-10-14T18:50:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd369d9b700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 0x7fd374169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:46.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd372d9d700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b6c0 tx=0x7fd36c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c012e30 con 0x7fd37415a1e0 2023-10-14T18:50:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c01d630 con 0x7fd37415a1e0 2023-10-14T18:50:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37416a610 con 0x7fd37415a1e0 2023-10-14T18:50:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.285+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c01d9f0 con 0x7fd37415a1e0 2023-10-14T18:50:46.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.286+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37416abd0 con 0x7fd37415a1e0 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.286+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3740b6110 con 0x7fd37415a1e0 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.287+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd36c024070 con 0x7fd37415a1e0 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.287+0000 7fd36affd700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.287+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd36c086d70 con 0x7fd37415a1e0 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.287+0000 7fd37259c700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.288+0000 7fd37259c700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 0x7fd3540693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd364007fd0 tx=0x7fd364007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.291+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd36c053fe0 con 0x7fd37415a1e0 2023-10-14T18:50:46.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.475+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd37404c3c0 con 0x7fd37415a1e0 2023-10-14T18:50:46.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.476+0000 7fd36affd700 1 -- 172.21.15.79:0/3502368130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fd36c057600 con 0x7fd37415a1e0 2023-10-14T18:50:46.477 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:46.477 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":122,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:44.919305+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:46.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 msgr2=0x7fd3540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 0x7fd3540693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd364007fd0 tx=0x7fd364007d30 comp rx=0 tx=0).stop 2023-10-14T18:50:46.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 msgr2=0x7fd3740c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b6c0 tx=0x7fd36c019000 comp rx=0 tx=0).stop 2023-10-14T18:50:46.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 shutdown_connections 2023-10-14T18:50:46.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd354066f30 0x7fd3540693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd37415a1e0 0x7fd3740c7250 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3740b3430 0x7fd374159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 --2- 172.21.15.79:0/3502368130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd374159e10 0x7fd374169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 >> 172.21.15.79:0/3502368130 conn(0x7fd374067660 msgr2=0x7fd3740b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:46.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 shutdown_connections 2023-10-14T18:50:46.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.478+0000 7fd3788f3700 1 -- 172.21.15.79:0/3502368130 wait complete. 2023-10-14T18:50:46.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:50:46.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.608+0000 7f174d9ae700 1 Processor -- start 2023-10-14T18:50:46.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.608+0000 7f174d9ae700 1 -- start start 2023-10-14T18:50:46.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d9ae700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1748141490 0x7f1748067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d9ae700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f174806ca90 0x7f17480c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d9ae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1748159130 con 0x7f1748141860 2023-10-14T18:50:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d9ae700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748158310 con 0x7f1748141490 2023-10-14T18:50:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d9ae700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1748158520 con 0x7f174806ca90 2023-10-14T18:50:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1748141490 0x7f1748067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f1747fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1748141860 0x7f174806c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58204/0 (socket says 172.21.15.79:58204) 2023-10-14T18:50:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1748141490 0x7f1748067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46536/0 (socket says 172.21.15.79:46536) 2023-10-14T18:50:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f1747fff700 1 -- 172.21.15.79:0/2700965882 learned_addr learned my addr 172.21.15.79:0/2700965882 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174d1ad700 1 --2- 172.21.15.79:0/2700965882 >> v2:172.21.15.144:3300/0 conn(0x7f174806ca90 0x7f17480c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 -- 172.21.15.79:0/2700965882 >> v2:172.21.15.144:3300/0 conn(0x7f174806ca90 msgr2=0x7f17480c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 --2- 172.21.15.79:0/2700965882 >> v2:172.21.15.144:3300/0 conn(0x7f174806ca90 0x7f17480c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 -- 172.21.15.79:0/2700965882 >> v1:172.21.15.79:6789/0 conn(0x7f1748141860 legacy=0x7f174806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f17477fe700 1 -- 172.21.15.79:0/2700965882 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279454776 0 0) 0x7f1748159130 con 0x7f1748141860 2023-10-14T18:50:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 -- 172.21.15.79:0/2700965882 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748158800 con 0x7f1748141490 2023-10-14T18:50:46.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.609+0000 7f174c9ac700 1 --2- 172.21.15.79:0/2700965882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f1748067660 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f174806e1a0 tx=0x7f173c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbef50ec09999a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f17477fe700 1 -- 172.21.15.79:0/2700965882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011630 con 0x7f1748141490 2023-10-14T18:50:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f17477fe700 1 -- 172.21.15.79:0/2700965882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c011790 con 0x7f1748141490 2023-10-14T18:50:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f17477fe700 1 -- 172.21.15.79:0/2700965882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c011b30 con 0x7f1748141490 2023-10-14T18:50:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 -- 172.21.15.79:0/2700965882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 msgr2=0x7f1748067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 --2- 172.21.15.79:0/2700965882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f1748067660 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f174806e1a0 tx=0x7f173c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 -- 172.21.15.79:0/2700965882 shutdown_connections 2023-10-14T18:50:46.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 --2- 172.21.15.79:0/2700965882 >> v2:172.21.15.144:3300/0 conn(0x7f174806ca90 0x7f17480c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 --2- 172.21.15.79:0/2700965882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f1748067660 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 -- 172.21.15.79:0/2700965882 >> 172.21.15.79:0/2700965882 conn(0x7f17480cb0a0 msgr2=0x7f174806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:46.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 -- 172.21.15.79:0/2700965882 shutdown_connections 2023-10-14T18:50:46.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.610+0000 7f174d9ae700 1 -- 172.21.15.79:0/2700965882 wait complete. 2023-10-14T18:50:46.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.611+0000 7f174d9ae700 1 Processor -- start 2023-10-14T18:50:46.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.611+0000 7f174d9ae700 1 -- start start 2023-10-14T18:50:46.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 0x7f174813c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 0x7f17480b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480afd10 con 0x7f1748141490 2023-10-14T18:50:46.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b1470 con 0x7f1748141860 2023-10-14T18:50:46.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d9ae700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b1750 con 0x7f174806ca90 2023-10-14T18:50:46.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f1747fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f1747fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46542/0 (socket says 172.21.15.79:46542) 2023-10-14T18:50:46.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f1747fff700 1 -- 172.21.15.79:0/657461743 learned_addr learned my addr 172.21.15.79:0/657461743 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:46.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174c9ac700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 0x7f174813c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f174d1ad700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 0x7f17480b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.612+0000 7f1747fff700 1 -- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 msgr2=0x7f174813c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1747fff700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 0x7f174813c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1747fff700 1 -- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 msgr2=0x7f17480b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:46.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1747fff700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 0x7f17480b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:46.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1747fff700 1 -- 172.21.15.79:0/657461743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009420 con 0x7f1748141490 2023-10-14T18:50:46.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f174c9ac700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 0x7f174813c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:46.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f174d1ad700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 0x7f17480b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:46.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1747fff700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f173400c5e0 tx=0x7f1734000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734005b30 con 0x7f1748141490 2023-10-14T18:50:46.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1734005c90 con 0x7f1748141490 2023-10-14T18:50:46.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480b1a30 con 0x7f1748141490 2023-10-14T18:50:46.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734007300 con 0x7f1748141490 2023-10-14T18:50:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.613+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480b2070 con 0x7f1748141490 2023-10-14T18:50:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.614+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480b2200 con 0x7f1748141490 2023-10-14T18:50:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.614+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17340076b0 con 0x7f1748141490 2023-10-14T18:50:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.614+0000 7f1744ff9700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 0x7f172c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.615+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1734083a70 con 0x7f1748141490 2023-10-14T18:50:46.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.615+0000 7f174c9ac700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 0x7f172c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:46.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.615+0000 7f174c9ac700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 0x7f172c0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f173c003080 tx=0x7f173c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:46.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.619+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1734050ce0 con 0x7f1748141490 2023-10-14T18:50:46.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:46.844+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1748158ae0 con 0x7f1748141490 2023-10-14T18:50:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.827+0000 7f1744ff9700 1 -- 172.21.15.79:0/657461743 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1734017020 con 0x7f1748141490 2023-10-14T18:50:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 msgr2=0x7f172c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 0x7f172c0693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f173c003080 tx=0x7f173c017000 comp rx=0 tx=0).stop 2023-10-14T18:50:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 msgr2=0x7f17480b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f173400c5e0 tx=0x7f1734000fe0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 shutdown_connections 2023-10-14T18:50:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f172c066f30 0x7f172c0693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1748141860 0x7f17480b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f174806ca90 0x7f174813c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 --2- 172.21.15.79:0/657461743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1748141490 0x7f17480b2510 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 >> 172.21.15.79:0/657461743 conn(0x7f17480cb0a0 msgr2=0x7f1748068800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 shutdown_connections 2023-10-14T18:50:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.830+0000 7f174d9ae700 1 -- 172.21.15.79:0/657461743 wait complete. 2023-10-14T18:50:47.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:50:47.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.965+0000 7f410f59e700 1 Processor -- start 2023-10-14T18:50:47.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.965+0000 7f410f59e700 1 -- start start 2023-10-14T18:50:47.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f411015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410f59e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100b4d70 con 0x7f41100b6580 2023-10-14T18:50:47.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410f59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41100cd8d0 con 0x7f411006aa00 2023-10-14T18:50:47.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b4440 con 0x7f41100cce30 2023-10-14T18:50:47.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f41100b6580 0x7f411006a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58216/0 (socket says 172.21.15.79:58216) 2023-10-14T18:50:47.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410dd9b700 1 -- 172.21.15.79:0/1678838065 learned_addr learned my addr 172.21.15.79:0/1678838065 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:47.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445700876 0 0) 0x7f41100b4d70 con 0x7f41100b6580 2023-10-14T18:50:47.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410e59c700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f411015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f8003570 con 0x7f41100b6580 2023-10-14T18:50:47.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 303480182 0 0) 0x7f40f8003570 con 0x7f41100b6580 2023-10-14T18:50:47.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 msgr2=0x7f411015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:47.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f411015aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 >> v1:172.21.15.144:6789/0 conn(0x7f411006aa00 legacy=0x7f41100b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100b4720 con 0x7f41100b6580 2023-10-14T18:50:47.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4104001470 con 0x7f41100b6580 2023-10-14T18:50:47.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 >> v1:172.21.15.79:6789/0 conn(0x7f41100b6580 legacy=0x7f411006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.966+0000 7f410d59a700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f40f8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f8004010 0x7f40f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f8004d50 0x7f40f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b4440 con 0x7f40f8004d50 2023-10-14T18:50:47.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800bbf0 con 0x7f40f8004010 2023-10-14T18:50:47.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800bdb0 con 0x7f41100cce30 2023-10-14T18:50:47.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f8004d50 0x7f40f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410e59c700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f40f8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410dd9b700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f8004010 0x7f40f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 -- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 msgr2=0x7f40f8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:47.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41100cce30 0x7f40f8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 -- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f8004010 msgr2=0x7f40f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:47.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40f8004010 0x7f40f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 -- 172.21.15.79:0/1678838065 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8003570 con 0x7f40f8004d50 2023-10-14T18:50:47.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410ed9d700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f8004d50 0x7f40f80051c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f411006ae00 tx=0x7f4108001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe59a382e49923e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:47.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108001950 con 0x7f40f8004d50 2023-10-14T18:50:47.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108004030 con 0x7f40f8004d50 2023-10-14T18:50:47.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.967+0000 7f410d59a700 1 -- 172.21.15.79:0/1678838065 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800cb00 con 0x7f40f8004d50 2023-10-14T18:50:47.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 -- 172.21.15.79:0/1678838065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f8004d50 msgr2=0x7f40f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 --2- 172.21.15.79:0/1678838065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40f8004d50 0x7f40f80051c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f411006ae00 tx=0x7f4108001640 comp rx=0 tx=0).stop 2023-10-14T18:50:47.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410ed9d700 1 -- 172.21.15.79:0/1678838065 reap_dead start 2023-10-14T18:50:47.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 -- 172.21.15.79:0/1678838065 shutdown_connections 2023-10-14T18:50:47.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 -- 172.21.15.79:0/1678838065 >> 172.21.15.79:0/1678838065 conn(0x7f4110068cb0 msgr2=0x7f41100690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:47.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 -- 172.21.15.79:0/1678838065 shutdown_connections 2023-10-14T18:50:47.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.968+0000 7f410f59e700 1 -- 172.21.15.79:0/1678838065 wait complete. 2023-10-14T18:50:47.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.969+0000 7f410f59e700 1 Processor -- start 2023-10-14T18:50:47.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.969+0000 7f410f59e700 1 -- start start 2023-10-14T18:50:47.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40f8004d50 0x7f41100b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 0x7f4110153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b26d0 con 0x7f4110151890 2023-10-14T18:50:47.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41101542c0 con 0x7f41100b2b60 2023-10-14T18:50:47.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41100b1ac0 con 0x7f40f8004d50 2023-10-14T18:50:47.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46566/0 (socket says 172.21.15.79:46566) 2023-10-14T18:50:47.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 -- 172.21.15.79:0/943038732 learned_addr learned my addr 172.21.15.79:0/943038732 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:47.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410e59c700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40f8004d50 0x7f41100b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410dd9b700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 0x7f4110153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 -- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40f8004d50 msgr2=0x7f41100b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40f8004d50 0x7f41100b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 -- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 msgr2=0x7f4110153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:47.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 0x7f4110153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:47.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 -- 172.21.15.79:0/943038732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100b1da0 con 0x7f4110151890 2023-10-14T18:50:47.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410dd9b700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 0x7f4110153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:47.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410ed9d700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4108004000 tx=0x7f4108015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:47.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108001950 con 0x7f4110151890 2023-10-14T18:50:47.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800c6d0 con 0x7f4110151890 2023-10-14T18:50:47.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41100b2080 con 0x7f4110151890 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108006df0 con 0x7f4110151890 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.970+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411014eb60 con 0x7f4110151890 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.971+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100b2840 con 0x7f4110151890 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.972+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f410801f620 con 0x7f4110151890 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.972+0000 7f40fe7fc700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:47.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.972+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4108085570 con 0x7f4110151890 2023-10-14T18:50:47.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.972+0000 7f410e59c700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:47.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.973+0000 7f410e59c700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 0x7f40f00693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4100006f00 tx=0x7f41000091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:47.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:47.976+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41080527e0 con 0x7f4110151890 2023-10-14T18:50:48.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.202+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41100b29d0 con 0x7f4110151890 2023-10-14T18:50:48.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.833+0000 7f40fe7fc700 1 -- 172.21.15.79:0/943038732 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4108055e00 con 0x7f4110151890 2023-10-14T18:50:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 msgr2=0x7f40f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 0x7f40f00693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4100006f00 tx=0x7f41000091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 msgr2=0x7f4110151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4108004000 tx=0x7f4108015000 comp rx=0 tx=0).stop 2023-10-14T18:50:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 shutdown_connections 2023-10-14T18:50:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40f0066f30 0x7f40f00693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4110151890 0x7f4110151d30 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40f8004d50 0x7f41100b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 --2- 172.21.15.79:0/943038732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41100b2b60 0x7f4110153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 >> 172.21.15.79:0/943038732 conn(0x7f4110068cb0 msgr2=0x7f41100d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 shutdown_connections 2023-10-14T18:50:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.835+0000 7f410f59e700 1 -- 172.21.15.79:0/943038732 wait complete. 2023-10-14T18:50:48.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:48.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.962+0000 7f5a24d3b700 1 Processor -- start 2023-10-14T18:50:48.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.962+0000 7f5a24d3b700 1 -- start start 2023-10-14T18:50:48.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a24d3b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a200cd6e0 0x7f5a200cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a24d3b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a2015cbd0 0x7f5a2015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a24d3b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a200cb7c0 con 0x7f5a200cdab0 2023-10-14T18:50:48.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a24d3b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2015e850 con 0x7f5a2015cbd0 2023-10-14T18:50:48.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a24d3b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200cd030 con 0x7f5a200cd6e0 2023-10-14T18:50:48.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a2015cbd0 0x7f5a2015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a200cdab0 0x7f5a2015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38146/0 (socket says 172.21.15.79:38146) 2023-10-14T18:50:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1effd700 1 -- 172.21.15.79:0/733610533 learned_addr learned my addr 172.21.15.79:0/733610533 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1f7fe700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a200cd6e0 0x7f5a200cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 -- 172.21.15.79:0/733610533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a200cd6e0 msgr2=0x7f5a200cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:48.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a200cd6e0 0x7f5a200cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 -- 172.21.15.79:0/733610533 >> v1:172.21.15.79:6789/0 conn(0x7f5a200cdab0 legacy=0x7f5a2015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 -- 172.21.15.79:0/733610533 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2015e290 con 0x7f5a2015cbd0 2023-10-14T18:50:48.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1e7fc700 1 -- 172.21.15.79:0/733610533 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479673956 0 0) 0x7f5a200cb7c0 con 0x7f5a200cdab0 2023-10-14T18:50:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.963+0000 7f5a1ffff700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a2015cbd0 0x7f5a2015d020 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5a180098e0 tx=0x7f5a180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84982b1c3245c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a1e7fc700 1 -- 172.21.15.79:0/733610533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800b640 con 0x7f5a2015cbd0 2023-10-14T18:50:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a1e7fc700 1 -- 172.21.15.79:0/733610533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1800b7a0 con 0x7f5a2015cbd0 2023-10-14T18:50:48.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a1e7fc700 1 -- 172.21.15.79:0/733610533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800bb40 con 0x7f5a2015cbd0 2023-10-14T18:50:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 -- 172.21.15.79:0/733610533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a2015cbd0 msgr2=0x7f5a2015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a2015cbd0 0x7f5a2015d020 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5a180098e0 tx=0x7f5a180091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 -- 172.21.15.79:0/733610533 shutdown_connections 2023-10-14T18:50:48.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a2015cbd0 0x7f5a2015d020 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/733610533 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a200cd6e0 0x7f5a200cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 -- 172.21.15.79:0/733610533 >> 172.21.15.79:0/733610533 conn(0x7f5a20067660 msgr2=0x7f5a20067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 -- 172.21.15.79:0/733610533 shutdown_connections 2023-10-14T18:50:48.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.964+0000 7f5a24d3b700 1 -- 172.21.15.79:0/733610533 wait complete. 2023-10-14T18:50:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.965+0000 7f5a24d3b700 1 Processor -- start 2023-10-14T18:50:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.965+0000 7f5a24d3b700 1 -- start start 2023-10-14T18:50:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a200cd6e0 0x7f5a20143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 0x7f5a2015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20144260 con 0x7f5a200cdab0 2023-10-14T18:50:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015bfd0 con 0x7f5a200cd6e0 2023-10-14T18:50:48.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a24d3b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015b3c0 con 0x7f5a2015cbd0 2023-10-14T18:50:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59402/0 (socket says 172.21.15.79:59402) 2023-10-14T18:50:48.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1effd700 1 -- 172.21.15.79:0/1807057051 learned_addr learned my addr 172.21.15.79:0/1807057051 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1f7fe700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a200cd6e0 0x7f5a20143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1ffff700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 0x7f5a2015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1effd700 1 -- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 msgr2=0x7f5a2015ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.966+0000 7f5a1effd700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 0x7f5a2015ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a1effd700 1 -- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a200cd6e0 msgr2=0x7f5a20143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a1effd700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a200cd6e0 0x7f5a20143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a1effd700 1 -- 172.21.15.79:0/1807057051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18009420 con 0x7f5a200cdab0 2023-10-14T18:50:48.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a1ffff700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 0x7f5a2015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:48.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a1effd700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c810 tx=0x7f5a14007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:48.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a14005b30 con 0x7f5a200cdab0 2023-10-14T18:50:48.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a14005c90 con 0x7f5a200cdab0 2023-10-14T18:50:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a140072e0 con 0x7f5a200cdab0 2023-10-14T18:50:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2015b6a0 con 0x7f5a200cdab0 2023-10-14T18:50:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.967+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2015bc60 con 0x7f5a200cdab0 2023-10-14T18:50:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.968+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20089280 con 0x7f5a200cdab0 2023-10-14T18:50:48.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.968+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a140076d0 con 0x7f5a200cdab0 2023-10-14T18:50:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.969+0000 7f5a077fe700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 0x7f5a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.969+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a14083960 con 0x7f5a200cdab0 2023-10-14T18:50:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.969+0000 7f5a1f7fe700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 0x7f5a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:48.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.969+0000 7f5a1f7fe700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 0x7f5a0c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009fd0 tx=0x7f5a1000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:48.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:48.973+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a1404b5a0 con 0x7f5a200cdab0 2023-10-14T18:50:49.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.194+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a2015c110 con 0x7f5a200cdab0 2023-10-14T18:50:49.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.195+0000 7f5a077fe700 1 -- 172.21.15.79:0/1807057051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5a14017090 con 0x7f5a200cdab0 2023-10-14T18:50:49.197 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:49.197 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:50:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 msgr2=0x7f5a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 0x7f5a0c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009fd0 tx=0x7f5a1000b040 comp rx=0 tx=0).stop 2023-10-14T18:50:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 msgr2=0x7f5a2015a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f5a1400c810 tx=0x7f5a14007df0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 shutdown_connections 2023-10-14T18:50:49.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a0c066f30 0x7f5a0c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a2015cbd0 0x7f5a2015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a200cd6e0 0x7f5a20143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 --2- 172.21.15.79:0/1807057051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a200cdab0 0x7f5a2015a820 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 >> 172.21.15.79:0/1807057051 conn(0x7f5a20067660 msgr2=0x7f5a20067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 shutdown_connections 2023-10-14T18:50:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.197+0000 7f5a24d3b700 1 -- 172.21.15.79:0/1807057051 wait complete. 2023-10-14T18:50:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:50:49.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:50:49.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.324+0000 7f68820ac700 1 Processor -- start 2023-10-14T18:50:49.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.324+0000 7f68820ac700 1 -- start start 2023-10-14T18:50:49.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f687c0cd6e0 0x7f687c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 0x7f687c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f687c15dda0 0x7f687c15cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c15e850 con 0x7f687c0cd6e0 2023-10-14T18:50:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c0cd030 con 0x7f687c15dda0 2023-10-14T18:50:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68820ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0cb7c0 con 0x7f687c0cdab0 2023-10-14T18:50:49.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68810aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f687c0cd6e0 0x7f687c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68810aa700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f687c0cd6e0 0x7f687c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59414/0 (socket says 172.21.15.79:59414) 2023-10-14T18:50:49.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68810aa700 1 -- 172.21.15.79:0/1181619954 learned_addr learned my addr 172.21.15.79:0/1181619954 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:49.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68818ab700 1 --2- 172.21.15.79:0/1181619954 >> v2:172.21.15.144:3300/0 conn(0x7f687c15dda0 0x7f687c15cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.325+0000 7f68808a9700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 0x7f687c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 -- 172.21.15.79:0/1181619954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 msgr2=0x7f687c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 0x7f687c15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 -- 172.21.15.79:0/1181619954 >> v2:172.21.15.144:3300/0 conn(0x7f687c15dda0 msgr2=0x7f687c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 --2- 172.21.15.79:0/1181619954 >> v2:172.21.15.144:3300/0 conn(0x7f687c15dda0 0x7f687c15cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 -- 172.21.15.79:0/1181619954 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c15e290 con 0x7f687c0cd6e0 2023-10-14T18:50:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68808a9700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 0x7f687c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68810aa700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c0cd6e0 0x7f687c0cbc50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f687c089ac0 tx=0x7f6878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb46584ba1873742 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f6873fff700 1 -- 172.21.15.79:0/1181619954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878009e70 con 0x7f687c0cd6e0 2023-10-14T18:50:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f6873fff700 1 -- 172.21.15.79:0/1181619954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800b860 con 0x7f687c0cd6e0 2023-10-14T18:50:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f6873fff700 1 -- 172.21.15.79:0/1181619954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800bc00 con 0x7f687c0cd6e0 2023-10-14T18:50:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 -- 172.21.15.79:0/1181619954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c0cd6e0 msgr2=0x7f687c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c0cd6e0 0x7f687c0cbc50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f687c089ac0 tx=0x7f6878009250 comp rx=0 tx=0).stop 2023-10-14T18:50:49.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 -- 172.21.15.79:0/1181619954 shutdown_connections 2023-10-14T18:50:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 --2- 172.21.15.79:0/1181619954 >> v2:172.21.15.144:3300/0 conn(0x7f687c15dda0 0x7f687c15cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c0cd6e0 0x7f687c0cbc50 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 --2- 172.21.15.79:0/1181619954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cdab0 0x7f687c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.326+0000 7f68820ac700 1 -- 172.21.15.79:0/1181619954 >> 172.21.15.79:0/1181619954 conn(0x7f687c067660 msgr2=0x7f687c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.327+0000 7f68820ac700 1 -- 172.21.15.79:0/1181619954 shutdown_connections 2023-10-14T18:50:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.327+0000 7f68820ac700 1 -- 172.21.15.79:0/1181619954 wait complete. 2023-10-14T18:50:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.328+0000 7f68820ac700 1 Processor -- start 2023-10-14T18:50:49.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.328+0000 7f68820ac700 1 -- start start 2023-10-14T18:50:49.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.328+0000 7f68820ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cd6e0 0x7f687c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.328+0000 7f68820ac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687c0cdab0 0x7f687c15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0b60b0 con 0x7f687c15dda0 2023-10-14T18:50:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0b54a0 con 0x7f687c0cdab0 2023-10-14T18:50:49.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0b5780 con 0x7f687c0cd6e0 2023-10-14T18:50:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59424/0 (socket says 172.21.15.79:59424) 2023-10-14T18:50:49.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 -- 172.21.15.79:0/2644370903 learned_addr learned my addr 172.21.15.79:0/2644370903 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68810aa700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cd6e0 0x7f687c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68808a9700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687c0cdab0 0x7f687c15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 -- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cd6e0 msgr2=0x7f687c0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cd6e0 0x7f687c0b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 -- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687c0cdab0 msgr2=0x7f687c15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687c0cdab0 0x7f687c15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 -- 172.21.15.79:0/2644370903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780094f0 con 0x7f687c15dda0 2023-10-14T18:50:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68818ab700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6874009e90 tx=0x7f687400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400cb70 con 0x7f687c15dda0 2023-10-14T18:50:49.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687400f040 con 0x7f687c15dda0 2023-10-14T18:50:49.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c0b5a60 con 0x7f687c15dda0 2023-10-14T18:50:49.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874014480 con 0x7f687c15dda0 2023-10-14T18:50:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.329+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c0caae0 con 0x7f687c15dda0 2023-10-14T18:50:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.330+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c089280 con 0x7f687c15dda0 2023-10-14T18:50:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.331+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6874014830 con 0x7f687c15dda0 2023-10-14T18:50:49.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.331+0000 7f68717fa700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.331+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6874084f60 con 0x7f687c15dda0 2023-10-14T18:50:49.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.331+0000 7f68810aa700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.332+0000 7f68810aa700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 0x7f68600693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f687c089ac0 tx=0x7f6878017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.335+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68740521d0 con 0x7f687c15dda0 2023-10-14T18:50:49.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.517+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687c15e570 con 0x7f687c15dda0 2023-10-14T18:50:49.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.518+0000 7f68717fa700 1 -- 172.21.15.79:0/2644370903 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f68740557f0 con 0x7f687c15dda0 2023-10-14T18:50:49.519 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:49.519 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":123,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:50:46.807482+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 msgr2=0x7f68600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 0x7f68600693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f687c089ac0 tx=0x7f6878017000 comp rx=0 tx=0).stop 2023-10-14T18:50:49.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 msgr2=0x7f687c15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6874009e90 tx=0x7f687400b040 comp rx=0 tx=0).stop 2023-10-14T18:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 shutdown_connections 2023-10-14T18:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6860066f30 0x7f68600693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c15dda0 0x7f687c15b3a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f687c0cd6e0 0x7f687c0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 --2- 172.21.15.79:0/2644370903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687c0cdab0 0x7f687c15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 >> 172.21.15.79:0/2644370903 conn(0x7f687c067660 msgr2=0x7f687c0d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 shutdown_connections 2023-10-14T18:50:49.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.520+0000 7f68820ac700 1 -- 172.21.15.79:0/2644370903 wait complete. 2023-10-14T18:50:49.533 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:50:49.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.649+0000 7f0bbb2ce700 1 Processor -- start 2023-10-14T18:50:49.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 -- start start 2023-10-14T18:50:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bb415a620 0x7f0bb415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415d580 0x7f0bb4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb415cbb0 con 0x7f0bb4157870 2023-10-14T18:50:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb415bdb0 con 0x7f0bb415a620 2023-10-14T18:50:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.650+0000 7f0bbb2ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb415bfa0 con 0x7f0bb415d580 2023-10-14T18:50:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bb415a620 0x7f0bb415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb986b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415d580 0x7f0bb4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb906a700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0bb4157870 0x7f0bb415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54704/0 (socket says 172.21.15.79:54704) 2023-10-14T18:50:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb906a700 1 -- 172.21.15.79:0/2336303108 learned_addr learned my addr 172.21.15.79:0/2336303108 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 -- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415d580 msgr2=0x7f0bb4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 --2- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415d580 0x7f0bb4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 -- 172.21.15.79:0/2336303108 >> v1:172.21.15.144:6789/0 conn(0x7f0bb4157870 legacy=0x7f0bb415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 -- 172.21.15.79:0/2336303108 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb415c280 con 0x7f0bb415a620 2023-10-14T18:50:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0babfff700 1 -- 172.21.15.79:0/2336303108 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832827479 0 0) 0x7f0bb415cbb0 con 0x7f0bb4157870 2023-10-14T18:50:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0bb8869700 1 --2- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb415a620 0x7f0bb415d040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098e0 tx=0x7f0ba40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411d88216f3385ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0babfff700 1 -- 172.21.15.79:0/2336303108 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400b640 con 0x7f0bb415a620 2023-10-14T18:50:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0babfff700 1 -- 172.21.15.79:0/2336303108 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400b7a0 con 0x7f0bb415a620 2023-10-14T18:50:49.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.651+0000 7f0babfff700 1 -- 172.21.15.79:0/2336303108 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400bb40 con 0x7f0bb415a620 2023-10-14T18:50:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb415a620 msgr2=0x7f0bb415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb415a620 0x7f0bb415d040 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40098e0 tx=0x7f0ba40091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2336303108 shutdown_connections 2023-10-14T18:50:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415d580 0x7f0bb4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2336303108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb415a620 0x7f0bb415d040 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2336303108 >> 172.21.15.79:0/2336303108 conn(0x7f0bb4068ce0 msgr2=0x7f0bb40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:49.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2336303108 shutdown_connections 2023-10-14T18:50:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.652+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2336303108 wait complete. 2023-10-14T18:50:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.653+0000 7f0bbb2ce700 1 Processor -- start 2023-10-14T18:50:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.653+0000 7f0bbb2ce700 1 -- start start 2023-10-14T18:50:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb4157870 0x7f0bb414b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415a620 0x7f0bb40d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41506f0 con 0x7f0bb415d580 2023-10-14T18:50:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b2cc0 con 0x7f0bb4157870 2023-10-14T18:50:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bbb2ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40b2fa0 con 0x7f0bb415a620 2023-10-14T18:50:49.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bb986b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bb986b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59438/0 (socket says 172.21.15.79:59438) 2023-10-14T18:50:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bb986b700 1 -- 172.21.15.79:0/2382728218 learned_addr learned my addr 172.21.15.79:0/2382728218 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bb8869700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415a620 0x7f0bb40d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.654+0000 7f0bb906a700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb4157870 0x7f0bb414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 -- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415a620 msgr2=0x7f0bb40d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415a620 0x7f0bb40d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 -- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb4157870 msgr2=0x7f0bb414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb4157870 0x7f0bb414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 -- 172.21.15.79:0/2382728218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009420 con 0x7f0bb415d580 2023-10-14T18:50:49.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bb986b700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00e900 tx=0x7f0bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac013680 con 0x7f0bb415d580 2023-10-14T18:50:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb40b3280 con 0x7f0bb415d580 2023-10-14T18:50:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb414bbc0 con 0x7f0bb415d580 2023-10-14T18:50:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac0139f0 con 0x7f0bb415d580 2023-10-14T18:50:49.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.655+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac013b60 con 0x7f0bb415d580 2023-10-14T18:50:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.656+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940052b0 con 0x7f0bb415d580 2023-10-14T18:50:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.656+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bac01c450 con 0x7f0bb415d580 2023-10-14T18:50:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.657+0000 7f0ba97fa700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 0x7f0b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.657+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bac0848e0 con 0x7f0bb415d580 2023-10-14T18:50:49.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.657+0000 7f0bb906a700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 0x7f0b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.657+0000 7f0bb906a700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 0x7f0b980693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0002230 tx=0x7f0bb0001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:49.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.661+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bac051b50 con 0x7f0bb415d580 2023-10-14T18:50:49.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.841+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b94000bc0 con 0x7f0b98066f30 2023-10-14T18:50:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.849+0000 7f0ba97fa700 1 -- 172.21.15.79:0/2382728218 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276474 (secure 0 0 0) 0x7f0b94000bc0 con 0x7f0b98066f30 2023-10-14T18:50:49.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 msgr2=0x7f0b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 0x7f0b980693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0002230 tx=0x7f0bb0001a20 comp rx=0 tx=0).stop 2023-10-14T18:50:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 msgr2=0x7f0bb40d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00e900 tx=0x7f0bac0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 shutdown_connections 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b98066f30 0x7f0b980693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bb415d580 0x7f0bb40d06e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bb4157870 0x7f0bb414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 --2- 172.21.15.79:0/2382728218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0bb415a620 0x7f0bb40d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 >> 172.21.15.79:0/2382728218 conn(0x7f0bb4068ce0 msgr2=0x7f0bb40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:49.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 shutdown_connections 2023-10-14T18:50:49.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:49.852+0000 7f0bbb2ce700 1 -- 172.21.15.79:0/2382728218 wait complete. 2023-10-14T18:50:49.857 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:49.864 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2023-10-14T18:50:48.415470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6268,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556231,"statfs":{"total":1600000000,"available":1593581235,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.880963"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534926+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:41.709376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535922+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534090+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:25:23.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534127+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:40.655850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534641+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:45.643573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534147+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:38.799032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536454+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534592+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:12.785301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534487+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:15.325915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535062+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535503+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536350+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535746+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:36.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535836+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:10.808268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536976+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534475+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:50.222701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535772+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536885+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:37.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533773+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:29:26.970279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533690+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:16.639029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536471+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:35.867437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536877+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:11.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533632+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535935+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:59.180976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533260+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533180+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535935+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533274+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536374+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535084+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536041+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:38.949950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535537+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-14T18:50:40.812606+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:50:40.812606+0000","last_peered":"2023-10-14T18:50:40.812606+0000","last_clean":"2023-10-14T18:50:40.812606+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:50:40.812606+0000","last_undegraded":"2023-10-14T18:50:40.812606+0000","last_fullsized":"2023-10-14T18:50:40.812606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1216,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194096,"statfs":{"total":200000000,"available":198754752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.63900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.82799999999999996},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70299999999999996,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.877,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.871},"min":{"1min":0.372,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53900000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.443},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73399999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64200000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.62},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64000000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55700000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.309},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.378}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.501,"15min":0.75700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":10.574,"15min":10.574},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64000000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.433}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88700000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194097,"statfs":{"total":200000000,"available":198755763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55700000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.316},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54700000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.372},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.27900000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88500000000000001,"5min":1.01,"15min":1.01},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90700000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.56499999999999995},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.35599999999999998,"15min":0.33300000000000002},"min":{"1min":0.217,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51500000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55900000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.006,"15min":1.006},"last":0.439},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.251,"15min":0.251},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.60699999999999998},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55100000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.621},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23300000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46000000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33400000000000002},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.307},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47799999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.307,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.755},{"interface":"front","average":{"1min":0.627,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84199999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.5},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.999,"15min":0.999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.872,"15min":0.872},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.434}]},{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.748,"15min":0.748},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.29399999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.34599999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51800000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:49.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.018+0000 7fc874ac3700 1 Processor -- start 2023-10-14T18:50:50.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.018+0000 7fc874ac3700 1 -- start start 2023-10-14T18:50:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc874ac3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc87015a620 0x7fc87015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc874ac3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc870158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc874ac3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87015cbb0 con 0x7fc870157870 2023-10-14T18:50:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc874ac3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87015bdb0 con 0x7fc87015a620 2023-10-14T18:50:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc874ac3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87015bfa0 con 0x7fc87015d580 2023-10-14T18:50:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc86e59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc870157870 0x7fc87015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38160/0 (socket says 172.21.15.79:38160) 2023-10-14T18:50:50.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc86e59c700 1 -- 172.21.15.79:0/1214343147 learned_addr learned my addr 172.21.15.79:0/1214343147 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215356537 0 0) 0x7fc87015cbb0 con 0x7fc870157870 2023-10-14T18:50:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c003570 con 0x7fc870157870 2023-10-14T18:50:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> v2:172.21.15.144:3300/0 conn(0x7fc87015a620 0x7fc87015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.019+0000 7fc86ed9d700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc870158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289958026 0 0) 0x7fc85c003570 con 0x7fc870157870 2023-10-14T18:50:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 msgr2=0x7fc870158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc870158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 >> v2:172.21.15.144:3300/0 conn(0x7fc87015a620 msgr2=0x7fc87015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 --2- 172.21.15.79:0/1214343147 >> v2:172.21.15.144:3300/0 conn(0x7fc87015a620 0x7fc87015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87015c280 con 0x7fc870157870 2023-10-14T18:50:50.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc860001470 con 0x7fc870157870 2023-10-14T18:50:50.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86ed9d700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc870158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:50.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 >> v1:172.21.15.79:6789/0 conn(0x7fc870157870 legacy=0x7fc87015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c003a60 0x7fc85c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85c004810 0x7fc85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc85c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87015bfa0 con 0x7fc85c004810 2023-10-14T18:50:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00bb10 con 0x7fc85c003a60 2023-10-14T18:50:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00bcd0 con 0x7fc87015d580 2023-10-14T18:50:50.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> v2:172.21.15.144:3300/0 conn(0x7fc87015a620 0x7fc87015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86e59c700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c003a60 0x7fc85c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85c004810 0x7fc85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86ed9d700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc85c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 -- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 msgr2=0x7fc85c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87015d580 0x7fc85c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 -- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c003a60 msgr2=0x7fc85c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c003a60 0x7fc85c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 -- 172.21.15.79:0/1214343147 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c003570 con 0x7fc85c004810 2023-10-14T18:50:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc865d9b700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85c004810 0x7fc85c004c80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc87015aa20 tx=0x7fc858008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2439e9051afb92e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800c070 con 0x7fc85c004810 2023-10-14T18:50:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800e5e0 con 0x7fc85c004810 2023-10-14T18:50:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.020+0000 7fc86dd9b700 1 -- 172.21.15.79:0/1214343147 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800e790 con 0x7fc85c004810 2023-10-14T18:50:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 -- 172.21.15.79:0/1214343147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85c004810 msgr2=0x7fc85c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 --2- 172.21.15.79:0/1214343147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc85c004810 0x7fc85c004c80 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc87015aa20 tx=0x7fc858008040 comp rx=0 tx=0).stop 2023-10-14T18:50:50.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc86ed9d700 1 -- 172.21.15.79:0/1214343147 reap_dead start 2023-10-14T18:50:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 -- 172.21.15.79:0/1214343147 shutdown_connections 2023-10-14T18:50:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 -- 172.21.15.79:0/1214343147 >> 172.21.15.79:0/1214343147 conn(0x7fc870068ce0 msgr2=0x7fc8700690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 -- 172.21.15.79:0/1214343147 shutdown_connections 2023-10-14T18:50:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.021+0000 7fc874ac3700 1 -- 172.21.15.79:0/1214343147 wait complete. 2023-10-14T18:50:50.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.022+0000 7fc874ac3700 1 Processor -- start 2023-10-14T18:50:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.022+0000 7fc874ac3700 1 -- start start 2023-10-14T18:50:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87016b5d0 0x7fc8700a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc870158600 0x7fc870158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc870159f40 con 0x7fc87016b200 2023-10-14T18:50:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc870159330 con 0x7fc870158600 2023-10-14T18:50:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc874ac3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc870159610 con 0x7fc87016b5d0 2023-10-14T18:50:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59456/0 (socket says 172.21.15.79:59456) 2023-10-14T18:50:50.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 -- 172.21.15.79:0/715230070 learned_addr learned my addr 172.21.15.79:0/715230070 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86ed9d700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc870158600 0x7fc870158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc865d9b700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87016b5d0 0x7fc8700a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 -- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87016b5d0 msgr2=0x7fc8700a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87016b5d0 0x7fc8700a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 -- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc870158600 msgr2=0x7fc870158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc870158600 0x7fc870158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 -- 172.21.15.79:0/715230070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8701598f0 con 0x7fc87016b200 2023-10-14T18:50:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.023+0000 7fc86e59c700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc860001620 tx=0x7fc860001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.024+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860018030 con 0x7fc87016b200 2023-10-14T18:50:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.024+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000f850 con 0x7fc87016b200 2023-10-14T18:50:50.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.024+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc870159bd0 con 0x7fc87016b200 2023-10-14T18:50:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.024+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000fc10 con 0x7fc87016b200 2023-10-14T18:50:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.024+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700b1820 con 0x7fc87016b200 2023-10-14T18:50:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.025+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87015a080 con 0x7fc87016b200 2023-10-14T18:50:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.025+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc86001b070 con 0x7fc87016b200 2023-10-14T18:50:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.025+0000 7fc866ffd700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.025+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc860019070 con 0x7fc87016b200 2023-10-14T18:50:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.025+0000 7fc865d9b700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.026+0000 7fc865d9b700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 0x7fc8500693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b36a0 tx=0x7fc85801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.030+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc860051780 con 0x7fc87016b200 2023-10-14T18:50:50.124 INFO:tasks.ceph.mds.c.smithi079.stderr:2023-10-14T18:50:50.123+0000 7f156de46700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:50:50.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.207+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8700b16b0 con 0x7fc850066f30 2023-10-14T18:50:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.215+0000 7fc866ffd700 1 -- 172.21.15.79:0/715230070 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276474 (secure 0 0 0) 0x7fc8700b16b0 con 0x7fc850066f30 2023-10-14T18:50:50.219 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:50.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 msgr2=0x7fc8500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 0x7fc8500693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc8700b36a0 tx=0x7fc85801a000 comp rx=0 tx=0).stop 2023-10-14T18:50:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 msgr2=0x7fc8700a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc860001620 tx=0x7fc860001e90 comp rx=0 tx=0).stop 2023-10-14T18:50:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 shutdown_connections 2023-10-14T18:50:50.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc850066f30 0x7fc8500693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc870158600 0x7fc870158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc87016b200 0x7fc8700a7e30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 --2- 172.21.15.79:0/715230070 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc87016b5d0 0x7fc8700a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 >> 172.21.15.79:0/715230070 conn(0x7fc870068ce0 msgr2=0x7fc870155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:50.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 shutdown_connections 2023-10-14T18:50:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.219+0000 7fc874ac3700 1 -- 172.21.15.79:0/715230070 wait complete. 2023-10-14T18:50:50.224 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:50.231 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2023-10-14T18:50:48.415470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6268,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556231,"statfs":{"total":1600000000,"available":1593581235,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.880963"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534926+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:41.709376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535922+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534090+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:25:23.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534127+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:40.655850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534641+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:45.643573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534147+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:38.799032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536454+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534592+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:12.785301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534487+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:15.325915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535062+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535503+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536350+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535746+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:30:36.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535836+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:10.808268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536976+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.534475+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:50.222701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535772+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536885+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:37.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533773+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:29:26.970279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533690+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:16.639029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536471+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:17:35.867437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536877+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:52:11.470539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533632+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535935+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:37:59.180976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533260+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533180+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535935+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.533274+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536374+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535084+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.536041+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:38.949950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:50:44.530929+0000","last_change":"2023-10-14T18:50:44.530929+0000","last_active":"2023-10-14T18:50:44.530929+0000","last_peered":"2023-10-14T18:50:44.530929+0000","last_clean":"2023-10-14T18:50:44.530929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:44.530929+0000","last_undegraded":"2023-10-14T18:50:44.530929+0000","last_fullsized":"2023-10-14T18:50:44.530929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:50:43.529078+0000","last_change":"2023-10-14T18:50:43.535537+0000","last_active":"2023-10-14T18:50:43.529078+0000","last_peered":"2023-10-14T18:50:43.529078+0000","last_clean":"2023-10-14T18:50:43.529078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:50:43.529078+0000","last_undegraded":"2023-10-14T18:50:43.529078+0000","last_fullsized":"2023-10-14T18:50:43.529078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-10-14T18:50:40.812606+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:50:40.812606+0000","last_peered":"2023-10-14T18:50:40.812606+0000","last_clean":"2023-10-14T18:50:40.812606+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:50:40.812606+0000","last_undegraded":"2023-10-14T18:50:40.812606+0000","last_fullsized":"2023-10-14T18:50:40.812606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1216,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194096,"statfs":{"total":200000000,"available":198754752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.63900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.82799999999999996},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70299999999999996,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63700000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.70999999999999996}]},{"osd":6,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.877,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.65400000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.871},"min":{"1min":0.372,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53900000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.443},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73399999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64200000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.62},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64000000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55700000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.309},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.378}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.501,"15min":0.75700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":10.574,"15min":10.574},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64000000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.433}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88700000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.46000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1215,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194097,"statfs":{"total":200000000,"available":198755763,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55700000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.316},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54700000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.372},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.27900000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53400000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88500000000000001,"5min":1.01,"15min":1.01},"last":0.52000000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90700000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.56499999999999995},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.35599999999999998,"15min":0.33300000000000002},"min":{"1min":0.217,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51500000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.374}]},{"osd":1,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55900000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.006,"15min":1.006},"last":0.439},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.251,"15min":0.251},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.60699999999999998},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.55100000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.621},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23300000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46000000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33400000000000002},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.307},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47799999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.307,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.755},{"interface":"front","average":{"1min":0.627,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84199999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.5},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.624}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.999,"15min":0.999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64200000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.872,"15min":0.872},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345120,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.434}]},{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.748,"15min":0.748},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.54800000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.29399999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.34599999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51800000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:50.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:50.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.384+0000 7f60b69d0700 1 Processor -- start 2023-10-14T18:50:50.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.384+0000 7f60b69d0700 1 -- start start 2023-10-14T18:50:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b69d0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b00cdab0 0x7f60b015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b69d0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60b015dda0 0x7f60b015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b69d0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00cb7c0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b69d0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b015e850 con 0x7f60b015dda0 2023-10-14T18:50:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b69d0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00cc360 con 0x7f60b00cdab0 2023-10-14T18:50:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b61cf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60b015dda0 0x7f60b015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b59ce700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f60b00cd6e0 0x7f60b00cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38170/0 (socket says 172.21.15.79:38170) 2023-10-14T18:50:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b59ce700 1 -- 172.21.15.79:0/4111093639 learned_addr learned my addr 172.21.15.79:0/4111093639 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b51cd700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b00cdab0 0x7f60b015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b61cf700 1 -- 172.21.15.79:0/4111093639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b00cdab0 msgr2=0x7f60b015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b61cf700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b00cdab0 0x7f60b015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b61cf700 1 -- 172.21.15.79:0/4111093639 >> v1:172.21.15.79:6789/0 conn(0x7f60b00cd6e0 legacy=0x7f60b00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b61cf700 1 -- 172.21.15.79:0/4111093639 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b015e290 con 0x7f60b015dda0 2023-10-14T18:50:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.385+0000 7f60b49cc700 1 -- 172.21.15.79:0/4111093639 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923221000 0 0) 0x7f60b00cb7c0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b61cf700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b015dda0 0x7f60b015cbd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f60a80098e0 tx=0x7f60a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9d65a61c85adb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b49cc700 1 -- 172.21.15.79:0/4111093639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8009e80 con 0x7f60b015dda0 2023-10-14T18:50:50.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b49cc700 1 -- 172.21.15.79:0/4111093639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a800b860 con 0x7f60b015dda0 2023-10-14T18:50:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b49cc700 1 -- 172.21.15.79:0/4111093639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800bbe0 con 0x7f60b015dda0 2023-10-14T18:50:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 -- 172.21.15.79:0/4111093639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b015dda0 msgr2=0x7f60b015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b015dda0 0x7f60b015cbd0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f60a80098e0 tx=0x7f60a80091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 -- 172.21.15.79:0/4111093639 shutdown_connections 2023-10-14T18:50:50.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b015dda0 0x7f60b015cbd0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 --2- 172.21.15.79:0/4111093639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b00cdab0 0x7f60b015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 -- 172.21.15.79:0/4111093639 >> 172.21.15.79:0/4111093639 conn(0x7f60b0067660 msgr2=0x7f60b0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 -- 172.21.15.79:0/4111093639 shutdown_connections 2023-10-14T18:50:50.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.386+0000 7f60b69d0700 1 -- 172.21.15.79:0/4111093639 wait complete. 2023-10-14T18:50:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 Processor -- start 2023-10-14T18:50:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 -- start start 2023-10-14T18:50:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 0x7f60b0153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 0x7f60b00b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00b28c0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b016e600 con 0x7f60b00cdab0 2023-10-14T18:50:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b69d0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00b2270 con 0x7f60b015dda0 2023-10-14T18:50:50.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b59ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b59ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59480/0 (socket says 172.21.15.79:59480) 2023-10-14T18:50:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.388+0000 7f60b59ce700 1 -- 172.21.15.79:0/3491172856 learned_addr learned my addr 172.21.15.79:0/3491172856 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b51cd700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 0x7f60b0153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b61cf700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 0x7f60b00b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 -- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 msgr2=0x7f60b00b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 0x7f60b00b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 -- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 msgr2=0x7f60b0153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 0x7f60b0153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 -- 172.21.15.79:0/3491172856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009420 con 0x7f60b00cd6e0 2023-10-14T18:50:50.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b51cd700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 0x7f60b0153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b61cf700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 0x7f60b00b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b59ce700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00cd80 tx=0x7f60ac001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00ab10 con 0x7f60b00cd6e0 2023-10-14T18:50:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00ac70 con 0x7f60b00cd6e0 2023-10-14T18:50:50.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b00b2550 con 0x7f60b00cd6e0 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0070f0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.389+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b0153fe0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.390+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b00b26e0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.390+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60ac0074e0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.391+0000 7f60a5ffb700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.391+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60ac084ac0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.391+0000 7f60b51cd700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.391+0000 7f60b51cd700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60b01591d0 tx=0x7f60a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.395+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60ac051db0 con 0x7f60b00cd6e0 2023-10-14T18:50:50.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.572+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60b00b2a00 con 0x7f6094066f30 2023-10-14T18:50:50.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.580+0000 7f60a5ffb700 1 -- 172.21.15.79:0/3491172856 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285740 (secure 0 0 0) 0x7f60a000f760 con 0x7f6094066f30 2023-10-14T18:50:50.584 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 msgr2=0x7f60940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60b01591d0 tx=0x7f60a0008040 comp rx=0 tx=0).stop 2023-10-14T18:50:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 msgr2=0x7f60b00b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00cd80 tx=0x7f60ac001ae0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 shutdown_connections 2023-10-14T18:50:50.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60b015dda0 0x7f60b00b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60b00cd6e0 0x7f60b00b2d50 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 --2- 172.21.15.79:0/3491172856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00cdab0 0x7f60b0153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 >> 172.21.15.79:0/3491172856 conn(0x7f60b0067660 msgr2=0x7f60b015d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:50.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 shutdown_connections 2023-10-14T18:50:50.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.584+0000 7f60b69d0700 1 -- 172.21.15.79:0/3491172856 wait complete. 2023-10-14T18:50:50.589 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:50.596 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2023-10-14T18:50:50.415860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556076,"statfs":{"total":1600000000,"available":1593422111,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001462"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819785+0000","last_change":"2023-10-14T18:50:45.819576+0000","last_active":"2023-10-14T18:50:45.819785+0000","last_peered":"2023-10-14T18:50:45.819785+0000","last_clean":"2023-10-14T18:50:45.819785+0000","last_became_active":"2023-10-14T18:50:45.818658+0000","last_became_peered":"2023-10-14T18:50:45.818658+0000","last_unstale":"2023-10-14T18:50:45.819785+0000","last_undegraded":"2023-10-14T18:50:45.819785+0000","last_fullsized":"2023-10-14T18:50:45.819785+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828544+0000","last_change":"2023-10-14T18:50:45.828504+0000","last_active":"2023-10-14T18:50:45.828544+0000","last_peered":"2023-10-14T18:50:45.828544+0000","last_clean":"2023-10-14T18:50:45.828544+0000","last_became_active":"2023-10-14T18:50:45.827821+0000","last_became_peered":"2023-10-14T18:50:45.827821+0000","last_unstale":"2023-10-14T18:50:45.828544+0000","last_undegraded":"2023-10-14T18:50:45.828544+0000","last_fullsized":"2023-10-14T18:50:45.828544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:31.668664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814795+0000","last_change":"2023-10-14T18:50:45.814742+0000","last_active":"2023-10-14T18:50:45.814795+0000","last_peered":"2023-10-14T18:50:45.814795+0000","last_clean":"2023-10-14T18:50:45.814795+0000","last_became_active":"2023-10-14T18:50:45.814499+0000","last_became_peered":"2023-10-14T18:50:45.814499+0000","last_unstale":"2023-10-14T18:50:45.814795+0000","last_undegraded":"2023-10-14T18:50:45.814795+0000","last_fullsized":"2023-10-14T18:50:45.814795+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:37.911232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820881+0000","last_change":"2023-10-14T18:50:45.820759+0000","last_active":"2023-10-14T18:50:45.820881+0000","last_peered":"2023-10-14T18:50:45.820881+0000","last_clean":"2023-10-14T18:50:45.820881+0000","last_became_active":"2023-10-14T18:50:45.820207+0000","last_became_peered":"2023-10-14T18:50:45.820207+0000","last_unstale":"2023-10-14T18:50:45.820881+0000","last_undegraded":"2023-10-14T18:50:45.820881+0000","last_fullsized":"2023-10-14T18:50:45.820881+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820197+0000","last_change":"2023-10-14T18:50:45.820039+0000","last_active":"2023-10-14T18:50:45.820197+0000","last_peered":"2023-10-14T18:50:45.820197+0000","last_clean":"2023-10-14T18:50:45.820197+0000","last_became_active":"2023-10-14T18:50:45.819820+0000","last_became_peered":"2023-10-14T18:50:45.819820+0000","last_unstale":"2023-10-14T18:50:45.820197+0000","last_undegraded":"2023-10-14T18:50:45.820197+0000","last_fullsized":"2023-10-14T18:50:45.820197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.816304+0000","last_change":"2023-10-14T18:50:45.815791+0000","last_active":"2023-10-14T18:50:45.816304+0000","last_peered":"2023-10-14T18:50:45.816304+0000","last_clean":"2023-10-14T18:50:45.816304+0000","last_became_active":"2023-10-14T18:50:45.815123+0000","last_became_peered":"2023-10-14T18:50:45.815123+0000","last_unstale":"2023-10-14T18:50:45.816304+0000","last_undegraded":"2023-10-14T18:50:45.816304+0000","last_fullsized":"2023-10-14T18:50:45.816304+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820409+0000","last_change":"2023-10-14T18:50:45.819869+0000","last_active":"2023-10-14T18:50:45.820409+0000","last_peered":"2023-10-14T18:50:45.820409+0000","last_clean":"2023-10-14T18:50:45.820409+0000","last_became_active":"2023-10-14T18:50:45.816982+0000","last_became_peered":"2023-10-14T18:50:45.816982+0000","last_unstale":"2023-10-14T18:50:45.820409+0000","last_undegraded":"2023-10-14T18:50:45.820409+0000","last_fullsized":"2023-10-14T18:50:45.820409+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820051+0000","last_change":"2023-10-14T18:50:45.819986+0000","last_active":"2023-10-14T18:50:45.820051+0000","last_peered":"2023-10-14T18:50:45.820051+0000","last_clean":"2023-10-14T18:50:45.820051+0000","last_became_active":"2023-10-14T18:50:45.818860+0000","last_became_peered":"2023-10-14T18:50:45.818860+0000","last_unstale":"2023-10-14T18:50:45.820051+0000","last_undegraded":"2023-10-14T18:50:45.820051+0000","last_fullsized":"2023-10-14T18:50:45.820051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:51.568633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824751+0000","last_change":"2023-10-14T18:50:45.824686+0000","last_active":"2023-10-14T18:50:45.824751+0000","last_peered":"2023-10-14T18:50:45.824751+0000","last_clean":"2023-10-14T18:50:45.824751+0000","last_became_active":"2023-10-14T18:50:45.824473+0000","last_became_peered":"2023-10-14T18:50:45.824473+0000","last_unstale":"2023-10-14T18:50:45.824751+0000","last_undegraded":"2023-10-14T18:50:45.824751+0000","last_fullsized":"2023-10-14T18:50:45.824751+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823467+0000","last_change":"2023-10-14T18:50:45.822903+0000","last_active":"2023-10-14T18:50:45.823467+0000","last_peered":"2023-10-14T18:50:45.823467+0000","last_clean":"2023-10-14T18:50:45.823467+0000","last_became_active":"2023-10-14T18:50:45.822620+0000","last_became_peered":"2023-10-14T18:50:45.822620+0000","last_unstale":"2023-10-14T18:50:45.823467+0000","last_undegraded":"2023-10-14T18:50:45.823467+0000","last_fullsized":"2023-10-14T18:50:45.823467+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819749+0000","last_change":"2023-10-14T18:50:45.817932+0000","last_active":"2023-10-14T18:50:45.819749+0000","last_peered":"2023-10-14T18:50:45.819749+0000","last_clean":"2023-10-14T18:50:45.819749+0000","last_became_active":"2023-10-14T18:50:45.817243+0000","last_became_peered":"2023-10-14T18:50:45.817243+0000","last_unstale":"2023-10-14T18:50:45.819749+0000","last_undegraded":"2023-10-14T18:50:45.819749+0000","last_fullsized":"2023-10-14T18:50:45.819749+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:18.916660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824260+0000","last_change":"2023-10-14T18:50:45.824116+0000","last_active":"2023-10-14T18:50:45.824260+0000","last_peered":"2023-10-14T18:50:45.824260+0000","last_clean":"2023-10-14T18:50:45.824260+0000","last_became_active":"2023-10-14T18:50:45.823884+0000","last_became_peered":"2023-10-14T18:50:45.823884+0000","last_unstale":"2023-10-14T18:50:45.824260+0000","last_undegraded":"2023-10-14T18:50:45.824260+0000","last_fullsized":"2023-10-14T18:50:45.824260+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822133+0000","last_change":"2023-10-14T18:50:45.822055+0000","last_active":"2023-10-14T18:50:45.822133+0000","last_peered":"2023-10-14T18:50:45.822133+0000","last_clean":"2023-10-14T18:50:45.822133+0000","last_became_active":"2023-10-14T18:50:45.821167+0000","last_became_peered":"2023-10-14T18:50:45.821167+0000","last_unstale":"2023-10-14T18:50:45.822133+0000","last_undegraded":"2023-10-14T18:50:45.822133+0000","last_fullsized":"2023-10-14T18:50:45.822133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817154+0000","last_change":"2023-10-14T18:50:45.816793+0000","last_active":"2023-10-14T18:50:45.817154+0000","last_peered":"2023-10-14T18:50:45.817154+0000","last_clean":"2023-10-14T18:50:45.817154+0000","last_became_active":"2023-10-14T18:50:45.816382+0000","last_became_peered":"2023-10-14T18:50:45.816382+0000","last_unstale":"2023-10-14T18:50:45.817154+0000","last_undegraded":"2023-10-14T18:50:45.817154+0000","last_fullsized":"2023-10-14T18:50:45.817154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:02:08.547770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826697+0000","last_change":"2023-10-14T18:50:45.826633+0000","last_active":"2023-10-14T18:50:45.826697+0000","last_peered":"2023-10-14T18:50:45.826697+0000","last_clean":"2023-10-14T18:50:45.826697+0000","last_became_active":"2023-10-14T18:50:45.826107+0000","last_became_peered":"2023-10-14T18:50:45.826107+0000","last_unstale":"2023-10-14T18:50:45.826697+0000","last_undegraded":"2023-10-14T18:50:45.826697+0000","last_fullsized":"2023-10-14T18:50:45.826697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819717+0000","last_change":"2023-10-14T18:50:45.817606+0000","last_active":"2023-10-14T18:50:45.819717+0000","last_peered":"2023-10-14T18:50:45.819717+0000","last_clean":"2023-10-14T18:50:45.819717+0000","last_became_active":"2023-10-14T18:50:45.816570+0000","last_became_peered":"2023-10-14T18:50:45.816570+0000","last_unstale":"2023-10-14T18:50:45.819717+0000","last_undegraded":"2023-10-14T18:50:45.819717+0000","last_fullsized":"2023-10-14T18:50:45.819717+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819333+0000","last_change":"2023-10-14T18:50:45.819234+0000","last_active":"2023-10-14T18:50:45.819333+0000","last_peered":"2023-10-14T18:50:45.819333+0000","last_clean":"2023-10-14T18:50:45.819333+0000","last_became_active":"2023-10-14T18:50:45.819008+0000","last_became_peered":"2023-10-14T18:50:45.819008+0000","last_unstale":"2023-10-14T18:50:45.819333+0000","last_undegraded":"2023-10-14T18:50:45.819333+0000","last_fullsized":"2023-10-14T18:50:45.819333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:10.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822360+0000","last_change":"2023-10-14T18:50:45.822312+0000","last_active":"2023-10-14T18:50:45.822360+0000","last_peered":"2023-10-14T18:50:45.822360+0000","last_clean":"2023-10-14T18:50:45.822360+0000","last_became_active":"2023-10-14T18:50:45.821835+0000","last_became_peered":"2023-10-14T18:50:45.821835+0000","last_unstale":"2023-10-14T18:50:45.822360+0000","last_undegraded":"2023-10-14T18:50:45.822360+0000","last_fullsized":"2023-10-14T18:50:45.822360+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:42.711227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822959+0000","last_change":"2023-10-14T18:50:45.820969+0000","last_active":"2023-10-14T18:50:45.822959+0000","last_peered":"2023-10-14T18:50:45.822959+0000","last_clean":"2023-10-14T18:50:45.822959+0000","last_became_active":"2023-10-14T18:50:45.820670+0000","last_became_peered":"2023-10-14T18:50:45.820670+0000","last_unstale":"2023-10-14T18:50:45.822959+0000","last_undegraded":"2023-10-14T18:50:45.822959+0000","last_fullsized":"2023-10-14T18:50:45.822959+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:56.359682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823528+0000","last_change":"2023-10-14T18:50:45.822620+0000","last_active":"2023-10-14T18:50:45.823528+0000","last_peered":"2023-10-14T18:50:45.823528+0000","last_clean":"2023-10-14T18:50:45.823528+0000","last_became_active":"2023-10-14T18:50:45.822254+0000","last_became_peered":"2023-10-14T18:50:45.822254+0000","last_unstale":"2023-10-14T18:50:45.823528+0000","last_undegraded":"2023-10-14T18:50:45.823528+0000","last_fullsized":"2023-10-14T18:50:45.823528+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818120+0000","last_change":"2023-10-14T18:50:45.818062+0000","last_active":"2023-10-14T18:50:45.818120+0000","last_peered":"2023-10-14T18:50:45.818120+0000","last_clean":"2023-10-14T18:50:45.818120+0000","last_became_active":"2023-10-14T18:50:45.817814+0000","last_became_peered":"2023-10-14T18:50:45.817814+0000","last_unstale":"2023-10-14T18:50:45.818120+0000","last_undegraded":"2023-10-14T18:50:45.818120+0000","last_fullsized":"2023-10-14T18:50:45.818120+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:52.081054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828637+0000","last_change":"2023-10-14T18:50:45.828590+0000","last_active":"2023-10-14T18:50:45.828637+0000","last_peered":"2023-10-14T18:50:45.828637+0000","last_clean":"2023-10-14T18:50:45.828637+0000","last_became_active":"2023-10-14T18:50:45.828082+0000","last_became_peered":"2023-10-14T18:50:45.828082+0000","last_unstale":"2023-10-14T18:50:45.828637+0000","last_undegraded":"2023-10-14T18:50:45.828637+0000","last_fullsized":"2023-10-14T18:50:45.828637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:14.870008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820702+0000","last_change":"2023-10-14T18:50:45.820637+0000","last_active":"2023-10-14T18:50:45.820702+0000","last_peered":"2023-10-14T18:50:45.820702+0000","last_clean":"2023-10-14T18:50:45.820702+0000","last_became_active":"2023-10-14T18:50:45.820205+0000","last_became_peered":"2023-10-14T18:50:45.820205+0000","last_unstale":"2023-10-14T18:50:45.820702+0000","last_undegraded":"2023-10-14T18:50:45.820702+0000","last_fullsized":"2023-10-14T18:50:45.820702+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:16.464393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.811977+0000","last_change":"2023-10-14T18:50:45.811813+0000","last_active":"2023-10-14T18:50:45.811977+0000","last_peered":"2023-10-14T18:50:45.811977+0000","last_clean":"2023-10-14T18:50:45.811977+0000","last_became_active":"2023-10-14T18:50:45.811573+0000","last_became_peered":"2023-10-14T18:50:45.811573+0000","last_unstale":"2023-10-14T18:50:45.811977+0000","last_undegraded":"2023-10-14T18:50:45.811977+0000","last_fullsized":"2023-10-14T18:50:45.811977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819121+0000","last_change":"2023-10-14T18:50:45.819032+0000","last_active":"2023-10-14T18:50:45.819121+0000","last_peered":"2023-10-14T18:50:45.819121+0000","last_clean":"2023-10-14T18:50:45.819121+0000","last_became_active":"2023-10-14T18:50:45.818759+0000","last_became_peered":"2023-10-14T18:50:45.818759+0000","last_unstale":"2023-10-14T18:50:45.819121+0000","last_undegraded":"2023-10-14T18:50:45.819121+0000","last_fullsized":"2023-10-14T18:50:45.819121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827589+0000","last_change":"2023-10-14T18:50:45.827528+0000","last_active":"2023-10-14T18:50:45.827589+0000","last_peered":"2023-10-14T18:50:45.827589+0000","last_clean":"2023-10-14T18:50:45.827589+0000","last_became_active":"2023-10-14T18:50:45.827086+0000","last_became_peered":"2023-10-14T18:50:45.827086+0000","last_unstale":"2023-10-14T18:50:45.827589+0000","last_undegraded":"2023-10-14T18:50:45.827589+0000","last_fullsized":"2023-10-14T18:50:45.827589+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:08.753906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819698+0000","last_change":"2023-10-14T18:50:45.817224+0000","last_active":"2023-10-14T18:50:45.819698+0000","last_peered":"2023-10-14T18:50:45.819698+0000","last_clean":"2023-10-14T18:50:45.819698+0000","last_became_active":"2023-10-14T18:50:45.816658+0000","last_became_peered":"2023-10-14T18:50:45.816658+0000","last_unstale":"2023-10-14T18:50:45.819698+0000","last_undegraded":"2023-10-14T18:50:45.819698+0000","last_fullsized":"2023-10-14T18:50:45.819698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823484+0000","last_change":"2023-10-14T18:50:45.823278+0000","last_active":"2023-10-14T18:50:45.823484+0000","last_peered":"2023-10-14T18:50:45.823484+0000","last_clean":"2023-10-14T18:50:45.823484+0000","last_became_active":"2023-10-14T18:50:45.822659+0000","last_became_peered":"2023-10-14T18:50:45.822659+0000","last_unstale":"2023-10-14T18:50:45.823484+0000","last_undegraded":"2023-10-14T18:50:45.823484+0000","last_fullsized":"2023-10-14T18:50:45.823484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826351+0000","last_change":"2023-10-14T18:50:45.826298+0000","last_active":"2023-10-14T18:50:45.826351+0000","last_peered":"2023-10-14T18:50:45.826351+0000","last_clean":"2023-10-14T18:50:45.826351+0000","last_became_active":"2023-10-14T18:50:45.826171+0000","last_became_peered":"2023-10-14T18:50:45.826171+0000","last_unstale":"2023-10-14T18:50:45.826351+0000","last_undegraded":"2023-10-14T18:50:45.826351+0000","last_fullsized":"2023-10-14T18:50:45.826351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:30.600160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826874+0000","last_change":"2023-10-14T18:50:45.826700+0000","last_active":"2023-10-14T18:50:45.826874+0000","last_peered":"2023-10-14T18:50:45.826874+0000","last_clean":"2023-10-14T18:50:45.826874+0000","last_became_active":"2023-10-14T18:50:45.826364+0000","last_became_peered":"2023-10-14T18:50:45.826364+0000","last_unstale":"2023-10-14T18:50:45.826874+0000","last_undegraded":"2023-10-14T18:50:45.826874+0000","last_fullsized":"2023-10-14T18:50:45.826874+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:18.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820850+0000","last_change":"2023-10-14T18:50:45.820309+0000","last_active":"2023-10-14T18:50:45.820850+0000","last_peered":"2023-10-14T18:50:45.820850+0000","last_clean":"2023-10-14T18:50:45.820850+0000","last_became_active":"2023-10-14T18:50:45.819980+0000","last_became_peered":"2023-10-14T18:50:45.819980+0000","last_unstale":"2023-10-14T18:50:45.820850+0000","last_undegraded":"2023-10-14T18:50:45.820850+0000","last_fullsized":"2023-10-14T18:50:45.820850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822406+0000","last_change":"2023-10-14T18:50:45.822017+0000","last_active":"2023-10-14T18:50:45.822406+0000","last_peered":"2023-10-14T18:50:45.822406+0000","last_clean":"2023-10-14T18:50:45.822406+0000","last_became_active":"2023-10-14T18:50:45.821809+0000","last_became_peered":"2023-10-14T18:50:45.821809+0000","last_unstale":"2023-10-14T18:50:45.822406+0000","last_undegraded":"2023-10-14T18:50:45.822406+0000","last_fullsized":"2023-10-14T18:50:45.822406+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:33.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817138+0000","last_change":"2023-10-14T18:50:45.816656+0000","last_active":"2023-10-14T18:50:45.817138+0000","last_peered":"2023-10-14T18:50:45.817138+0000","last_clean":"2023-10-14T18:50:45.817138+0000","last_became_active":"2023-10-14T18:50:45.816127+0000","last_became_peered":"2023-10-14T18:50:45.816127+0000","last_unstale":"2023-10-14T18:50:45.817138+0000","last_undegraded":"2023-10-14T18:50:45.817138+0000","last_fullsized":"2023-10-14T18:50:45.817138+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:40.585030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829493+0000","last_change":"2023-10-14T18:50:44.545811+0000","last_active":"2023-10-14T18:50:45.829493+0000","last_peered":"2023-10-14T18:50:45.829493+0000","last_clean":"2023-10-14T18:50:45.829493+0000","last_became_active":"2023-10-14T18:50:44.545344+0000","last_became_peered":"2023-10-14T18:50:44.545344+0000","last_unstale":"2023-10-14T18:50:45.829493+0000","last_undegraded":"2023-10-14T18:50:45.829493+0000","last_fullsized":"2023-10-14T18:50:45.829493+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:54.972036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822235+0000","last_change":"2023-10-14T18:50:45.822186+0000","last_active":"2023-10-14T18:50:45.822235+0000","last_peered":"2023-10-14T18:50:45.822235+0000","last_clean":"2023-10-14T18:50:45.822235+0000","last_became_active":"2023-10-14T18:50:45.821552+0000","last_became_peered":"2023-10-14T18:50:45.821552+0000","last_unstale":"2023-10-14T18:50:45.822235+0000","last_undegraded":"2023-10-14T18:50:45.822235+0000","last_fullsized":"2023-10-14T18:50:45.822235+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827447+0000","last_change":"2023-10-14T18:50:44.540309+0000","last_active":"2023-10-14T18:50:45.827447+0000","last_peered":"2023-10-14T18:50:45.827447+0000","last_clean":"2023-10-14T18:50:45.827447+0000","last_became_active":"2023-10-14T18:50:44.539792+0000","last_became_peered":"2023-10-14T18:50:44.539792+0000","last_unstale":"2023-10-14T18:50:45.827447+0000","last_undegraded":"2023-10-14T18:50:45.827447+0000","last_fullsized":"2023-10-14T18:50:45.827447+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:16.639029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820145+0000","last_change":"2023-10-14T18:50:45.819750+0000","last_active":"2023-10-14T18:50:45.820145+0000","last_peered":"2023-10-14T18:50:45.820145+0000","last_clean":"2023-10-14T18:50:45.820145+0000","last_became_active":"2023-10-14T18:50:45.819359+0000","last_became_peered":"2023-10-14T18:50:45.819359+0000","last_unstale":"2023-10-14T18:50:45.820145+0000","last_undegraded":"2023-10-14T18:50:45.820145+0000","last_fullsized":"2023-10-14T18:50:45.820145+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:05.181656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825610+0000","last_change":"2023-10-14T18:50:44.539788+0000","last_active":"2023-10-14T18:50:45.825610+0000","last_peered":"2023-10-14T18:50:45.825610+0000","last_clean":"2023-10-14T18:50:45.825610+0000","last_became_active":"2023-10-14T18:50:44.539503+0000","last_became_peered":"2023-10-14T18:50:44.539503+0000","last_unstale":"2023-10-14T18:50:45.825610+0000","last_undegraded":"2023-10-14T18:50:45.825610+0000","last_fullsized":"2023-10-14T18:50:45.825610+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:10.032267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822612+0000","last_change":"2023-10-14T18:50:45.822481+0000","last_active":"2023-10-14T18:50:45.822612+0000","last_peered":"2023-10-14T18:50:45.822612+0000","last_clean":"2023-10-14T18:50:45.822612+0000","last_became_active":"2023-10-14T18:50:45.821679+0000","last_became_peered":"2023-10-14T18:50:45.821679+0000","last_unstale":"2023-10-14T18:50:45.822612+0000","last_undegraded":"2023-10-14T18:50:45.822612+0000","last_fullsized":"2023-10-14T18:50:45.822612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827395+0000","last_change":"2023-10-14T18:50:44.547260+0000","last_active":"2023-10-14T18:50:45.827395+0000","last_peered":"2023-10-14T18:50:45.827395+0000","last_clean":"2023-10-14T18:50:45.827395+0000","last_became_active":"2023-10-14T18:50:44.547133+0000","last_became_peered":"2023-10-14T18:50:44.547133+0000","last_unstale":"2023-10-14T18:50:45.827395+0000","last_undegraded":"2023-10-14T18:50:45.827395+0000","last_fullsized":"2023-10-14T18:50:45.827395+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:00.360150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820141+0000","last_change":"2023-10-14T18:50:45.818964+0000","last_active":"2023-10-14T18:50:45.820141+0000","last_peered":"2023-10-14T18:50:45.820141+0000","last_clean":"2023-10-14T18:50:45.820141+0000","last_became_active":"2023-10-14T18:50:45.818739+0000","last_became_peered":"2023-10-14T18:50:45.818739+0000","last_unstale":"2023-10-14T18:50:45.820141+0000","last_undegraded":"2023-10-14T18:50:45.820141+0000","last_fullsized":"2023-10-14T18:50:45.820141+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827324+0000","last_change":"2023-10-14T18:50:44.544542+0000","last_active":"2023-10-14T18:50:45.827324+0000","last_peered":"2023-10-14T18:50:45.827324+0000","last_clean":"2023-10-14T18:50:45.827324+0000","last_became_active":"2023-10-14T18:50:44.543597+0000","last_became_peered":"2023-10-14T18:50:44.543597+0000","last_unstale":"2023-10-14T18:50:45.827324+0000","last_undegraded":"2023-10-14T18:50:45.827324+0000","last_fullsized":"2023-10-14T18:50:45.827324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:54.499443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820427+0000","last_change":"2023-10-14T18:50:45.820349+0000","last_active":"2023-10-14T18:50:45.820427+0000","last_peered":"2023-10-14T18:50:45.820427+0000","last_clean":"2023-10-14T18:50:45.820427+0000","last_became_active":"2023-10-14T18:50:45.820102+0000","last_became_peered":"2023-10-14T18:50:45.820102+0000","last_unstale":"2023-10-14T18:50:45.820427+0000","last_undegraded":"2023-10-14T18:50:45.820427+0000","last_fullsized":"2023-10-14T18:50:45.820427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829562+0000","last_change":"2023-10-14T18:50:44.546523+0000","last_active":"2023-10-14T18:50:45.829562+0000","last_peered":"2023-10-14T18:50:45.829562+0000","last_clean":"2023-10-14T18:50:45.829562+0000","last_became_active":"2023-10-14T18:50:44.546079+0000","last_became_peered":"2023-10-14T18:50:44.546079+0000","last_unstale":"2023-10-14T18:50:45.829562+0000","last_undegraded":"2023-10-14T18:50:45.829562+0000","last_fullsized":"2023-10-14T18:50:45.829562+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:40.776044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826828+0000","last_change":"2023-10-14T18:50:45.826768+0000","last_active":"2023-10-14T18:50:45.826828+0000","last_peered":"2023-10-14T18:50:45.826828+0000","last_clean":"2023-10-14T18:50:45.826828+0000","last_became_active":"2023-10-14T18:50:45.826421+0000","last_became_peered":"2023-10-14T18:50:45.826421+0000","last_unstale":"2023-10-14T18:50:45.826828+0000","last_undegraded":"2023-10-14T18:50:45.826828+0000","last_fullsized":"2023-10-14T18:50:45.826828+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812193+0000","last_change":"2023-10-14T18:50:44.542559+0000","last_active":"2023-10-14T18:50:45.812193+0000","last_peered":"2023-10-14T18:50:45.812193+0000","last_clean":"2023-10-14T18:50:45.812193+0000","last_became_active":"2023-10-14T18:50:44.542328+0000","last_became_peered":"2023-10-14T18:50:44.542328+0000","last_unstale":"2023-10-14T18:50:45.812193+0000","last_undegraded":"2023-10-14T18:50:45.812193+0000","last_fullsized":"2023-10-14T18:50:45.812193+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817111+0000","last_change":"2023-10-14T18:50:45.816987+0000","last_active":"2023-10-14T18:50:45.817111+0000","last_peered":"2023-10-14T18:50:45.817111+0000","last_clean":"2023-10-14T18:50:45.817111+0000","last_became_active":"2023-10-14T18:50:45.816739+0000","last_became_peered":"2023-10-14T18:50:45.816739+0000","last_unstale":"2023-10-14T18:50:45.817111+0000","last_undegraded":"2023-10-14T18:50:45.817111+0000","last_fullsized":"2023-10-14T18:50:45.817111+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809213+0000","last_change":"2023-10-14T18:50:44.542883+0000","last_active":"2023-10-14T18:50:45.809213+0000","last_peered":"2023-10-14T18:50:45.809213+0000","last_clean":"2023-10-14T18:50:45.809213+0000","last_became_active":"2023-10-14T18:50:44.542659+0000","last_became_peered":"2023-10-14T18:50:44.542659+0000","last_unstale":"2023-10-14T18:50:45.809213+0000","last_undegraded":"2023-10-14T18:50:45.809213+0000","last_fullsized":"2023-10-14T18:50:45.809213+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:55:43.270454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828772+0000","last_change":"2023-10-14T18:50:45.828700+0000","last_active":"2023-10-14T18:50:45.828772+0000","last_peered":"2023-10-14T18:50:45.828772+0000","last_clean":"2023-10-14T18:50:45.828772+0000","last_became_active":"2023-10-14T18:50:45.828351+0000","last_became_peered":"2023-10-14T18:50:45.828351+0000","last_unstale":"2023-10-14T18:50:45.828772+0000","last_undegraded":"2023-10-14T18:50:45.828772+0000","last_fullsized":"2023-10-14T18:50:45.828772+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:47:46.701116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809318+0000","last_change":"2023-10-14T18:50:44.544430+0000","last_active":"2023-10-14T18:50:45.809318+0000","last_peered":"2023-10-14T18:50:45.809318+0000","last_clean":"2023-10-14T18:50:45.809318+0000","last_became_active":"2023-10-14T18:50:44.543784+0000","last_became_peered":"2023-10-14T18:50:44.543784+0000","last_unstale":"2023-10-14T18:50:45.809318+0000","last_undegraded":"2023-10-14T18:50:45.809318+0000","last_fullsized":"2023-10-14T18:50:45.809318+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:47.975371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819225+0000","last_change":"2023-10-14T18:50:45.818536+0000","last_active":"2023-10-14T18:50:45.819225+0000","last_peered":"2023-10-14T18:50:45.819225+0000","last_clean":"2023-10-14T18:50:45.819225+0000","last_became_active":"2023-10-14T18:50:45.818041+0000","last_became_peered":"2023-10-14T18:50:45.818041+0000","last_unstale":"2023-10-14T18:50:45.819225+0000","last_undegraded":"2023-10-14T18:50:45.819225+0000","last_fullsized":"2023-10-14T18:50:45.819225+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813577+0000","last_change":"2023-10-14T18:50:44.536713+0000","last_active":"2023-10-14T18:50:45.813577+0000","last_peered":"2023-10-14T18:50:45.813577+0000","last_clean":"2023-10-14T18:50:45.813577+0000","last_became_active":"2023-10-14T18:50:44.536488+0000","last_became_peered":"2023-10-14T18:50:44.536488+0000","last_unstale":"2023-10-14T18:50:45.813577+0000","last_undegraded":"2023-10-14T18:50:45.813577+0000","last_fullsized":"2023-10-14T18:50:45.813577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822400+0000","last_change":"2023-10-14T18:50:45.821375+0000","last_active":"2023-10-14T18:50:45.822400+0000","last_peered":"2023-10-14T18:50:45.822400+0000","last_clean":"2023-10-14T18:50:45.822400+0000","last_became_active":"2023-10-14T18:50:45.819731+0000","last_became_peered":"2023-10-14T18:50:45.819731+0000","last_unstale":"2023-10-14T18:50:45.822400+0000","last_undegraded":"2023-10-14T18:50:45.822400+0000","last_fullsized":"2023-10-14T18:50:45.822400+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825807+0000","last_change":"2023-10-14T18:50:44.542109+0000","last_active":"2023-10-14T18:50:45.825807+0000","last_peered":"2023-10-14T18:50:45.825807+0000","last_clean":"2023-10-14T18:50:45.825807+0000","last_became_active":"2023-10-14T18:50:44.541891+0000","last_became_peered":"2023-10-14T18:50:44.541891+0000","last_unstale":"2023-10-14T18:50:45.825807+0000","last_undegraded":"2023-10-14T18:50:45.825807+0000","last_fullsized":"2023-10-14T18:50:45.825807+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817075+0000","last_change":"2023-10-14T18:50:45.817020+0000","last_active":"2023-10-14T18:50:45.817075+0000","last_peered":"2023-10-14T18:50:45.817075+0000","last_clean":"2023-10-14T18:50:45.817075+0000","last_became_active":"2023-10-14T18:50:45.816711+0000","last_became_peered":"2023-10-14T18:50:45.816711+0000","last_unstale":"2023-10-14T18:50:45.817075+0000","last_undegraded":"2023-10-14T18:50:45.817075+0000","last_fullsized":"2023-10-14T18:50:45.817075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828804+0000","last_change":"2023-10-14T18:50:44.544803+0000","last_active":"2023-10-14T18:50:45.828804+0000","last_peered":"2023-10-14T18:50:45.828804+0000","last_clean":"2023-10-14T18:50:45.828804+0000","last_became_active":"2023-10-14T18:50:44.544586+0000","last_became_peered":"2023-10-14T18:50:44.544586+0000","last_unstale":"2023-10-14T18:50:45.828804+0000","last_undegraded":"2023-10-14T18:50:45.828804+0000","last_fullsized":"2023-10-14T18:50:45.828804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820815+0000","last_change":"2023-10-14T18:50:45.820183+0000","last_active":"2023-10-14T18:50:45.820815+0000","last_peered":"2023-10-14T18:50:45.820815+0000","last_clean":"2023-10-14T18:50:45.820815+0000","last_became_active":"2023-10-14T18:50:45.819649+0000","last_became_peered":"2023-10-14T18:50:45.819649+0000","last_unstale":"2023-10-14T18:50:45.820815+0000","last_undegraded":"2023-10-14T18:50:45.820815+0000","last_fullsized":"2023-10-14T18:50:45.820815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:41.657701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823079+0000","last_change":"2023-10-14T18:50:44.545892+0000","last_active":"2023-10-14T18:50:45.823079+0000","last_peered":"2023-10-14T18:50:45.823079+0000","last_clean":"2023-10-14T18:50:45.823079+0000","last_became_active":"2023-10-14T18:50:44.545675+0000","last_became_peered":"2023-10-14T18:50:44.545675+0000","last_unstale":"2023-10-14T18:50:45.823079+0000","last_undegraded":"2023-10-14T18:50:45.823079+0000","last_fullsized":"2023-10-14T18:50:45.823079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:52.384948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825660+0000","last_change":"2023-10-14T18:50:45.825425+0000","last_active":"2023-10-14T18:50:45.825660+0000","last_peered":"2023-10-14T18:50:45.825660+0000","last_clean":"2023-10-14T18:50:45.825660+0000","last_became_active":"2023-10-14T18:50:45.825086+0000","last_became_peered":"2023-10-14T18:50:45.825086+0000","last_unstale":"2023-10-14T18:50:45.825660+0000","last_undegraded":"2023-10-14T18:50:45.825660+0000","last_fullsized":"2023-10-14T18:50:45.825660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:38.311624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812759+0000","last_change":"2023-10-14T18:50:44.543357+0000","last_active":"2023-10-14T18:50:45.812759+0000","last_peered":"2023-10-14T18:50:45.812759+0000","last_clean":"2023-10-14T18:50:45.812759+0000","last_became_active":"2023-10-14T18:50:44.543144+0000","last_became_peered":"2023-10-14T18:50:44.543144+0000","last_unstale":"2023-10-14T18:50:45.812759+0000","last_undegraded":"2023-10-14T18:50:45.812759+0000","last_fullsized":"2023-10-14T18:50:45.812759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:11.473597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.821166+0000","last_change":"2023-10-14T18:50:45.820718+0000","last_active":"2023-10-14T18:50:45.821166+0000","last_peered":"2023-10-14T18:50:45.821166+0000","last_clean":"2023-10-14T18:50:45.821166+0000","last_became_active":"2023-10-14T18:50:45.820428+0000","last_became_peered":"2023-10-14T18:50:45.820428+0000","last_unstale":"2023-10-14T18:50:45.821166+0000","last_undegraded":"2023-10-14T18:50:45.821166+0000","last_fullsized":"2023-10-14T18:50:45.821166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815283+0000","last_change":"2023-10-14T18:50:44.546145+0000","last_active":"2023-10-14T18:50:45.815283+0000","last_peered":"2023-10-14T18:50:45.815283+0000","last_clean":"2023-10-14T18:50:45.815283+0000","last_became_active":"2023-10-14T18:50:44.545927+0000","last_became_peered":"2023-10-14T18:50:44.545927+0000","last_unstale":"2023-10-14T18:50:45.815283+0000","last_undegraded":"2023-10-14T18:50:45.815283+0000","last_fullsized":"2023-10-14T18:50:45.815283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818441+0000","last_change":"2023-10-14T18:50:45.818379+0000","last_active":"2023-10-14T18:50:45.818441+0000","last_peered":"2023-10-14T18:50:45.818441+0000","last_clean":"2023-10-14T18:50:45.818441+0000","last_became_active":"2023-10-14T18:50:45.817568+0000","last_became_peered":"2023-10-14T18:50:45.817568+0000","last_unstale":"2023-10-14T18:50:45.818441+0000","last_undegraded":"2023-10-14T18:50:45.818441+0000","last_fullsized":"2023-10-14T18:50:45.818441+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:43:46.507961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827444+0000","last_change":"2023-10-14T18:50:44.544087+0000","last_active":"2023-10-14T18:50:45.827444+0000","last_peered":"2023-10-14T18:50:45.827444+0000","last_clean":"2023-10-14T18:50:45.827444+0000","last_became_active":"2023-10-14T18:50:44.543861+0000","last_became_peered":"2023-10-14T18:50:44.543861+0000","last_unstale":"2023-10-14T18:50:45.827444+0000","last_undegraded":"2023-10-14T18:50:45.827444+0000","last_fullsized":"2023-10-14T18:50:45.827444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:33.856982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817607+0000","last_change":"2023-10-14T18:50:45.817151+0000","last_active":"2023-10-14T18:50:45.817607+0000","last_peered":"2023-10-14T18:50:45.817607+0000","last_clean":"2023-10-14T18:50:45.817607+0000","last_became_active":"2023-10-14T18:50:45.816906+0000","last_became_peered":"2023-10-14T18:50:45.816906+0000","last_unstale":"2023-10-14T18:50:45.817607+0000","last_undegraded":"2023-10-14T18:50:45.817607+0000","last_fullsized":"2023-10-14T18:50:45.817607+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827241+0000","last_change":"2023-10-14T18:50:44.546883+0000","last_active":"2023-10-14T18:50:45.827241+0000","last_peered":"2023-10-14T18:50:45.827241+0000","last_clean":"2023-10-14T18:50:45.827241+0000","last_became_active":"2023-10-14T18:50:44.546539+0000","last_became_peered":"2023-10-14T18:50:44.546539+0000","last_unstale":"2023-10-14T18:50:45.827241+0000","last_undegraded":"2023-10-14T18:50:45.827241+0000","last_fullsized":"2023-10-14T18:50:45.827241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:37.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820166+0000","last_change":"2023-10-14T18:50:45.819430+0000","last_active":"2023-10-14T18:50:45.820166+0000","last_peered":"2023-10-14T18:50:45.820166+0000","last_clean":"2023-10-14T18:50:45.820166+0000","last_became_active":"2023-10-14T18:50:45.818305+0000","last_became_peered":"2023-10-14T18:50:45.818305+0000","last_unstale":"2023-10-14T18:50:45.820166+0000","last_undegraded":"2023-10-14T18:50:45.820166+0000","last_fullsized":"2023-10-14T18:50:45.820166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823730+0000","last_change":"2023-10-14T18:50:44.542020+0000","last_active":"2023-10-14T18:50:45.823730+0000","last_peered":"2023-10-14T18:50:45.823730+0000","last_clean":"2023-10-14T18:50:45.823730+0000","last_became_active":"2023-10-14T18:50:44.541797+0000","last_became_peered":"2023-10-14T18:50:44.541797+0000","last_unstale":"2023-10-14T18:50:45.823730+0000","last_undegraded":"2023-10-14T18:50:45.823730+0000","last_fullsized":"2023-10-14T18:50:45.823730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819733+0000","last_change":"2023-10-14T18:50:45.817742+0000","last_active":"2023-10-14T18:50:45.819733+0000","last_peered":"2023-10-14T18:50:45.819733+0000","last_clean":"2023-10-14T18:50:45.819733+0000","last_became_active":"2023-10-14T18:50:45.816928+0000","last_became_peered":"2023-10-14T18:50:45.816928+0000","last_unstale":"2023-10-14T18:50:45.819733+0000","last_undegraded":"2023-10-14T18:50:45.819733+0000","last_fullsized":"2023-10-14T18:50:45.819733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:57.920593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818242+0000","last_change":"2023-10-14T18:50:44.547856+0000","last_active":"2023-10-14T18:50:45.818242+0000","last_peered":"2023-10-14T18:50:45.818242+0000","last_clean":"2023-10-14T18:50:45.818242+0000","last_became_active":"2023-10-14T18:50:44.547592+0000","last_became_peered":"2023-10-14T18:50:44.547592+0000","last_unstale":"2023-10-14T18:50:45.818242+0000","last_undegraded":"2023-10-14T18:50:45.818242+0000","last_fullsized":"2023-10-14T18:50:45.818242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:01.487859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823012+0000","last_change":"2023-10-14T18:50:45.821544+0000","last_active":"2023-10-14T18:50:45.823012+0000","last_peered":"2023-10-14T18:50:45.823012+0000","last_clean":"2023-10-14T18:50:45.823012+0000","last_became_active":"2023-10-14T18:50:45.821241+0000","last_became_peered":"2023-10-14T18:50:45.821241+0000","last_unstale":"2023-10-14T18:50:45.823012+0000","last_undegraded":"2023-10-14T18:50:45.823012+0000","last_fullsized":"2023-10-14T18:50:45.823012+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:35.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829131+0000","last_change":"2023-10-14T18:50:44.545684+0000","last_active":"2023-10-14T18:50:45.829131+0000","last_peered":"2023-10-14T18:50:45.829131+0000","last_clean":"2023-10-14T18:50:45.829131+0000","last_became_active":"2023-10-14T18:50:44.545025+0000","last_became_peered":"2023-10-14T18:50:44.545025+0000","last_unstale":"2023-10-14T18:50:45.829131+0000","last_undegraded":"2023-10-14T18:50:45.829131+0000","last_fullsized":"2023-10-14T18:50:45.829131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:50.517495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822977+0000","last_change":"2023-10-14T18:50:45.820978+0000","last_active":"2023-10-14T18:50:45.822977+0000","last_peered":"2023-10-14T18:50:45.822977+0000","last_clean":"2023-10-14T18:50:45.822977+0000","last_became_active":"2023-10-14T18:50:45.820721+0000","last_became_peered":"2023-10-14T18:50:45.820721+0000","last_unstale":"2023-10-14T18:50:45.822977+0000","last_undegraded":"2023-10-14T18:50:45.822977+0000","last_fullsized":"2023-10-14T18:50:45.822977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:51.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812794+0000","last_change":"2023-10-14T18:50:44.544194+0000","last_active":"2023-10-14T18:50:45.812794+0000","last_peered":"2023-10-14T18:50:45.812794+0000","last_clean":"2023-10-14T18:50:45.812794+0000","last_became_active":"2023-10-14T18:50:44.543942+0000","last_became_peered":"2023-10-14T18:50:44.543942+0000","last_unstale":"2023-10-14T18:50:45.812794+0000","last_undegraded":"2023-10-14T18:50:45.812794+0000","last_fullsized":"2023-10-14T18:50:45.812794+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822994+0000","last_change":"2023-10-14T18:50:45.821162+0000","last_active":"2023-10-14T18:50:45.822994+0000","last_peered":"2023-10-14T18:50:45.822994+0000","last_clean":"2023-10-14T18:50:45.822994+0000","last_became_active":"2023-10-14T18:50:45.820913+0000","last_became_peered":"2023-10-14T18:50:45.820913+0000","last_unstale":"2023-10-14T18:50:45.822994+0000","last_undegraded":"2023-10-14T18:50:45.822994+0000","last_fullsized":"2023-10-14T18:50:45.822994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:02.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812909+0000","last_change":"2023-10-14T18:50:44.542926+0000","last_active":"2023-10-14T18:50:45.812909+0000","last_peered":"2023-10-14T18:50:45.812909+0000","last_clean":"2023-10-14T18:50:45.812909+0000","last_became_active":"2023-10-14T18:50:44.542667+0000","last_became_peered":"2023-10-14T18:50:44.542667+0000","last_unstale":"2023-10-14T18:50:45.812909+0000","last_undegraded":"2023-10-14T18:50:45.812909+0000","last_fullsized":"2023-10-14T18:50:45.812909+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827495+0000","last_change":"2023-10-14T18:50:45.827448+0000","last_active":"2023-10-14T18:50:45.827495+0000","last_peered":"2023-10-14T18:50:45.827495+0000","last_clean":"2023-10-14T18:50:45.827495+0000","last_became_active":"2023-10-14T18:50:45.827278+0000","last_became_peered":"2023-10-14T18:50:45.827278+0000","last_unstale":"2023-10-14T18:50:45.827495+0000","last_undegraded":"2023-10-14T18:50:45.827495+0000","last_fullsized":"2023-10-14T18:50:45.827495+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814987+0000","last_change":"2023-10-14T18:50:44.540631+0000","last_active":"2023-10-14T18:50:45.814987+0000","last_peered":"2023-10-14T18:50:45.814987+0000","last_clean":"2023-10-14T18:50:45.814987+0000","last_became_active":"2023-10-14T18:50:44.540385+0000","last_became_peered":"2023-10-14T18:50:44.540385+0000","last_unstale":"2023-10-14T18:50:45.814987+0000","last_undegraded":"2023-10-14T18:50:45.814987+0000","last_fullsized":"2023-10-14T18:50:45.814987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:48.403019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825436+0000","last_change":"2023-10-14T18:50:45.820760+0000","last_active":"2023-10-14T18:50:45.825436+0000","last_peered":"2023-10-14T18:50:45.825436+0000","last_clean":"2023-10-14T18:50:45.825436+0000","last_became_active":"2023-10-14T18:50:45.820460+0000","last_became_peered":"2023-10-14T18:50:45.820460+0000","last_unstale":"2023-10-14T18:50:45.825436+0000","last_undegraded":"2023-10-14T18:50:45.825436+0000","last_fullsized":"2023-10-14T18:50:45.825436+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:22.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826286+0000","last_change":"2023-10-14T18:50:44.545233+0000","last_active":"2023-10-14T18:50:45.826286+0000","last_peered":"2023-10-14T18:50:45.826286+0000","last_clean":"2023-10-14T18:50:45.826286+0000","last_became_active":"2023-10-14T18:50:44.544792+0000","last_became_peered":"2023-10-14T18:50:44.544792+0000","last_unstale":"2023-10-14T18:50:45.826286+0000","last_undegraded":"2023-10-14T18:50:45.826286+0000","last_fullsized":"2023-10-14T18:50:45.826286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815781+0000","last_change":"2023-10-14T18:50:45.815713+0000","last_active":"2023-10-14T18:50:45.815781+0000","last_peered":"2023-10-14T18:50:45.815781+0000","last_clean":"2023-10-14T18:50:45.815781+0000","last_became_active":"2023-10-14T18:50:45.815482+0000","last_became_peered":"2023-10-14T18:50:45.815482+0000","last_unstale":"2023-10-14T18:50:45.815781+0000","last_undegraded":"2023-10-14T18:50:45.815781+0000","last_fullsized":"2023-10-14T18:50:45.815781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:30.361127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813816+0000","last_change":"2023-10-14T18:50:44.545553+0000","last_active":"2023-10-14T18:50:45.813816+0000","last_peered":"2023-10-14T18:50:45.813816+0000","last_clean":"2023-10-14T18:50:45.813816+0000","last_became_active":"2023-10-14T18:50:44.544744+0000","last_became_peered":"2023-10-14T18:50:44.544744+0000","last_unstale":"2023-10-14T18:50:45.813816+0000","last_undegraded":"2023-10-14T18:50:45.813816+0000","last_fullsized":"2023-10-14T18:50:45.813816+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:50.784388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819761+0000","last_change":"2023-10-14T18:50:45.817923+0000","last_active":"2023-10-14T18:50:45.819761+0000","last_peered":"2023-10-14T18:50:45.819761+0000","last_clean":"2023-10-14T18:50:45.819761+0000","last_became_active":"2023-10-14T18:50:45.817729+0000","last_became_peered":"2023-10-14T18:50:45.817729+0000","last_unstale":"2023-10-14T18:50:45.819761+0000","last_undegraded":"2023-10-14T18:50:45.819761+0000","last_fullsized":"2023-10-14T18:50:45.819761+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812620+0000","last_change":"2023-10-14T18:50:44.548701+0000","last_active":"2023-10-14T18:50:45.812620+0000","last_peered":"2023-10-14T18:50:45.812620+0000","last_clean":"2023-10-14T18:50:45.812620+0000","last_became_active":"2023-10-14T18:50:44.548107+0000","last_became_peered":"2023-10-14T18:50:44.548107+0000","last_unstale":"2023-10-14T18:50:45.812620+0000","last_undegraded":"2023-10-14T18:50:45.812620+0000","last_fullsized":"2023-10-14T18:50:45.812620+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:50.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822419+0000","last_change":"2023-10-14T18:50:45.821848+0000","last_active":"2023-10-14T18:50:45.822419+0000","last_peered":"2023-10-14T18:50:45.822419+0000","last_clean":"2023-10-14T18:50:45.822419+0000","last_became_active":"2023-10-14T18:50:45.821632+0000","last_became_peered":"2023-10-14T18:50:45.821632+0000","last_unstale":"2023-10-14T18:50:45.822419+0000","last_undegraded":"2023-10-14T18:50:45.822419+0000","last_fullsized":"2023-10-14T18:50:45.822419+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810729+0000","last_change":"2023-10-14T18:50:44.541670+0000","last_active":"2023-10-14T18:50:45.810729+0000","last_peered":"2023-10-14T18:50:45.810729+0000","last_clean":"2023-10-14T18:50:45.810729+0000","last_became_active":"2023-10-14T18:50:44.541267+0000","last_became_peered":"2023-10-14T18:50:44.541267+0000","last_unstale":"2023-10-14T18:50:45.810729+0000","last_undegraded":"2023-10-14T18:50:45.810729+0000","last_fullsized":"2023-10-14T18:50:45.810729+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817860+0000","last_change":"2023-10-14T18:50:45.817785+0000","last_active":"2023-10-14T18:50:45.817860+0000","last_peered":"2023-10-14T18:50:45.817860+0000","last_clean":"2023-10-14T18:50:45.817860+0000","last_became_active":"2023-10-14T18:50:45.817268+0000","last_became_peered":"2023-10-14T18:50:45.817268+0000","last_unstale":"2023-10-14T18:50:45.817860+0000","last_undegraded":"2023-10-14T18:50:45.817860+0000","last_fullsized":"2023-10-14T18:50:45.817860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:22:22.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815073+0000","last_change":"2023-10-14T18:50:44.539950+0000","last_active":"2023-10-14T18:50:45.815073+0000","last_peered":"2023-10-14T18:50:45.815073+0000","last_clean":"2023-10-14T18:50:45.815073+0000","last_became_active":"2023-10-14T18:50:44.539282+0000","last_became_peered":"2023-10-14T18:50:44.539282+0000","last_unstale":"2023-10-14T18:50:45.815073+0000","last_undegraded":"2023-10-14T18:50:45.815073+0000","last_fullsized":"2023-10-14T18:50:45.815073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:18.987531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819244+0000","last_change":"2023-10-14T18:50:45.819015+0000","last_active":"2023-10-14T18:50:45.819244+0000","last_peered":"2023-10-14T18:50:45.819244+0000","last_clean":"2023-10-14T18:50:45.819244+0000","last_became_active":"2023-10-14T18:50:45.818786+0000","last_became_peered":"2023-10-14T18:50:45.818786+0000","last_unstale":"2023-10-14T18:50:45.819244+0000","last_undegraded":"2023-10-14T18:50:45.819244+0000","last_fullsized":"2023-10-14T18:50:45.819244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810928+0000","last_change":"2023-10-14T18:50:44.542847+0000","last_active":"2023-10-14T18:50:45.810928+0000","last_peered":"2023-10-14T18:50:45.810928+0000","last_clean":"2023-10-14T18:50:45.810928+0000","last_became_active":"2023-10-14T18:50:44.542585+0000","last_became_peered":"2023-10-14T18:50:44.542585+0000","last_unstale":"2023-10-14T18:50:45.810928+0000","last_undegraded":"2023-10-14T18:50:45.810928+0000","last_fullsized":"2023-10-14T18:50:45.810928+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817547+0000","last_change":"2023-10-14T18:50:45.817468+0000","last_active":"2023-10-14T18:50:45.817547+0000","last_peered":"2023-10-14T18:50:45.817547+0000","last_clean":"2023-10-14T18:50:45.817547+0000","last_became_active":"2023-10-14T18:50:45.817236+0000","last_became_peered":"2023-10-14T18:50:45.817236+0000","last_unstale":"2023-10-14T18:50:45.817547+0000","last_undegraded":"2023-10-14T18:50:45.817547+0000","last_fullsized":"2023-10-14T18:50:45.817547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:02.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815412+0000","last_change":"2023-10-14T18:50:44.540475+0000","last_active":"2023-10-14T18:50:45.815412+0000","last_peered":"2023-10-14T18:50:45.815412+0000","last_clean":"2023-10-14T18:50:45.815412+0000","last_became_active":"2023-10-14T18:50:44.540267+0000","last_became_peered":"2023-10-14T18:50:44.540267+0000","last_unstale":"2023-10-14T18:50:45.815412+0000","last_undegraded":"2023-10-14T18:50:45.815412+0000","last_fullsized":"2023-10-14T18:50:45.815412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823498+0000","last_change":"2023-10-14T18:50:45.823412+0000","last_active":"2023-10-14T18:50:45.823498+0000","last_peered":"2023-10-14T18:50:45.823498+0000","last_clean":"2023-10-14T18:50:45.823498+0000","last_became_active":"2023-10-14T18:50:45.822978+0000","last_became_peered":"2023-10-14T18:50:45.822978+0000","last_unstale":"2023-10-14T18:50:45.823498+0000","last_undegraded":"2023-10-14T18:50:45.823498+0000","last_fullsized":"2023-10-14T18:50:45.823498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813898+0000","last_change":"2023-10-14T18:50:44.547653+0000","last_active":"2023-10-14T18:50:45.813898+0000","last_peered":"2023-10-14T18:50:45.813898+0000","last_clean":"2023-10-14T18:50:45.813898+0000","last_became_active":"2023-10-14T18:50:44.547471+0000","last_became_peered":"2023-10-14T18:50:44.547471+0000","last_unstale":"2023-10-14T18:50:45.813898+0000","last_undegraded":"2023-10-14T18:50:45.813898+0000","last_fullsized":"2023-10-14T18:50:45.813898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:04.600759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823026+0000","last_change":"2023-10-14T18:50:45.822597+0000","last_active":"2023-10-14T18:50:45.823026+0000","last_peered":"2023-10-14T18:50:45.823026+0000","last_clean":"2023-10-14T18:50:45.823026+0000","last_became_active":"2023-10-14T18:50:45.822394+0000","last_became_peered":"2023-10-14T18:50:45.822394+0000","last_unstale":"2023-10-14T18:50:45.823026+0000","last_undegraded":"2023-10-14T18:50:45.823026+0000","last_fullsized":"2023-10-14T18:50:45.823026+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:31.776666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826201+0000","last_change":"2023-10-14T18:50:44.540458+0000","last_active":"2023-10-14T18:50:45.826201+0000","last_peered":"2023-10-14T18:50:45.826201+0000","last_clean":"2023-10-14T18:50:45.826201+0000","last_became_active":"2023-10-14T18:50:44.540085+0000","last_became_peered":"2023-10-14T18:50:44.540085+0000","last_unstale":"2023-10-14T18:50:45.826201+0000","last_undegraded":"2023-10-14T18:50:45.826201+0000","last_fullsized":"2023-10-14T18:50:45.826201+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:29:26.970279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":266,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809981+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:50:45.809981+0000","last_peered":"2023-10-14T18:50:45.809981+0000","last_clean":"2023-10-14T18:50:45.809981+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:50:45.809981+0000","last_undegraded":"2023-10-14T18:50:45.809981+0000","last_fullsized":"2023-10-14T18:50:45.809981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194077,"statfs":{"total":200000000,"available":198735326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.63900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.82799999999999996},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70299999999999996,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40799999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.877,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325182,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.871},"min":{"1min":0.372,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.443},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73399999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64200000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55700000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.22800000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.501,"15min":0.75700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":10.574,"15min":10.574},"last":0.311},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64000000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.29299999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88700000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1234,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194078,"statfs":{"total":200000000,"available":198735895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55700000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.248},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54700000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.372},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88500000000000001,"5min":1.01,"15min":1.01},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90700000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.56499999999999995},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.35599999999999998,"15min":0.33300000000000002},"min":{"1min":0.217,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51500000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55900000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.006,"15min":1.006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.251,"15min":0.251},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.60699999999999998},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.621},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23300000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46000000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33400000000000002},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.25900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47799999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.312},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.307,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84199999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.71599999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.999,"15min":0.999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.748},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.872,"15min":0.872},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325736,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.748,"15min":0.748},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52100000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:50.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T18:50:50.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.750+0000 7f2b10461700 1 Processor -- start 2023-10-14T18:50:50.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.750+0000 7f2b10461700 1 -- start start 2023-10-14T18:50:50.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b10461700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b0806a530 0x7f2b080c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b10461700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b080ad9b0 0x7f2b080c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b10461700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b08067ba0 con 0x7f2b081568d0 2023-10-14T18:50:50.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b10461700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0815aa90 con 0x7f2b0806a530 2023-10-14T18:50:50.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b10461700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08067870 con 0x7f2b080ad9b0 2023-10-14T18:50:50.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b0806a530 0x7f2b080c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2b0806a530 0x7f2b080c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59484/0 (socket says 172.21.15.79:59484) 2023-10-14T18:50:50.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 -- 172.21.15.79:0/2846760460 learned_addr learned my addr 172.21.15.79:0/2846760460 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:50.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0e9fe700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b080ad9b0 0x7f2b080c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 -- 172.21.15.79:0/2846760460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b080ad9b0 msgr2=0x7f2b080c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:50.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b080ad9b0 0x7f2b080c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 -- 172.21.15.79:0/2846760460 >> v1:172.21.15.144:6789/0 conn(0x7f2b081568d0 legacy=0x7f2b08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 -- 172.21.15.79:0/2846760460 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080c8ca0 con 0x7f2b0806a530 2023-10-14T18:50:50.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.751+0000 7f2b0d9fc700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c8090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bc50 tx=0x7f2af800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a600e68a723f000 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b0d1fb700 1 -- 172.21.15.79:0/2846760460 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800be60 con 0x7f2b0806a530 2023-10-14T18:50:50.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b0d1fb700 1 -- 172.21.15.79:0/2846760460 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800de00 con 0x7f2b0806a530 2023-10-14T18:50:50.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b0d1fb700 1 -- 172.21.15.79:0/2846760460 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80196b0 con 0x7f2b0806a530 2023-10-14T18:50:50.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 -- 172.21.15.79:0/2846760460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 msgr2=0x7f2b080c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c8090 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bc50 tx=0x7f2af800b4f0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 -- 172.21.15.79:0/2846760460 shutdown_connections 2023-10-14T18:50:50.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b080ad9b0 0x7f2b080c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 --2- 172.21.15.79:0/2846760460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c8090 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 -- 172.21.15.79:0/2846760460 >> 172.21.15.79:0/2846760460 conn(0x7f2b080cda50 msgr2=0x7f2b080cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:50.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 -- 172.21.15.79:0/2846760460 shutdown_connections 2023-10-14T18:50:50.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.752+0000 7f2b10461700 1 -- 172.21.15.79:0/2846760460 wait complete. 2023-10-14T18:50:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.753+0000 7f2b10461700 1 Processor -- start 2023-10-14T18:50:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.753+0000 7f2b10461700 1 -- start start 2023-10-14T18:50:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b080ad9b0 0x7f2b08155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b081568d0 0x7f2b080c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0816ed40 con 0x7f2b0806a530 2023-10-14T18:50:50.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081564b0 con 0x7f2b080ad9b0 2023-10-14T18:50:50.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b10461700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0816e1c0 con 0x7f2b081568d0 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59500/0 (socket says 172.21.15.79:59500) 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 -- 172.21.15.79:0/2317500692 learned_addr learned my addr 172.21.15.79:0/2317500692 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e9fe700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b081568d0 0x7f2b080c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0d9fc700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b080ad9b0 0x7f2b08155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 -- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b081568d0 msgr2=0x7f2b080c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b081568d0 0x7f2b080c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.754+0000 7f2b0e1fd700 1 -- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b080ad9b0 msgr2=0x7f2b08155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2b0e1fd700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b080ad9b0 0x7f2b08155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2b0e1fd700 1 -- 172.21.15.79:0/2317500692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af800b790 con 0x7f2b0806a530 2023-10-14T18:50:50.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2b0e1fd700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c590 tx=0x7f2b0400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04011590 con 0x7f2b0806a530 2023-10-14T18:50:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b04011710 con 0x7f2b0806a530 2023-10-14T18:50:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0816e4a0 con 0x7f2b0806a530 2023-10-14T18:50:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04011ad0 con 0x7f2b0806a530 2023-10-14T18:50:50.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.755+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0816ea60 con 0x7f2b0806a530 2023-10-14T18:50:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.756+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b080aa910 con 0x7f2b0806a530 2023-10-14T18:50:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.756+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b0401b3b0 con 0x7f2b0806a530 2023-10-14T18:50:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.756+0000 7f2afe7fc700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 0x7f2aec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.757+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b04083940 con 0x7f2b0806a530 2023-10-14T18:50:50.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.757+0000 7f2b0d9fc700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 0x7f2aec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:50.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.757+0000 7f2b0d9fc700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 0x7f2aec0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bc50 tx=0x7f2af801b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:50.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:50.761+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b080aa910 con 0x7f2b0806a530 2023-10-14T18:50:51.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.022+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2b0804c3c0 con 0x7f2b0806a530 2023-10-14T18:50:51.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.023+0000 7f2afe7fc700 1 -- 172.21.15.79:0/2317500692 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1428 (secure 0 0 0) 0x7f2b04017020 con 0x7f2b0806a530 2023-10-14T18:50:51.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:51.024 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":358,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":123,"num_osds":8,"num_up_osds":8,"osd_up_since":1697309098,"num_in_osds":8,"osd_in_since":1697309095,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":6577889,"bytes_avail":1593422111,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":56,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6729}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-14T18:50:34.412550+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-14T18:50:51.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 msgr2=0x7f2aec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 0x7f2aec0693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2af800bc50 tx=0x7f2af801b000 comp rx=0 tx=0).stop 2023-10-14T18:50:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 msgr2=0x7f2b080c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c590 tx=0x7f2b0400c8a0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 shutdown_connections 2023-10-14T18:50:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2aec066f30 0x7f2aec0693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b081568d0 0x7f2b080c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b0806a530 0x7f2b080c1f10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 --2- 172.21.15.79:0/2317500692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b080ad9b0 0x7f2b08155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 >> 172.21.15.79:0/2317500692 conn(0x7f2b080cda50 msgr2=0x7f2b080cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 shutdown_connections 2023-10-14T18:50:51.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.025+0000 7f2b10461700 1 -- 172.21.15.79:0/2317500692 wait complete. 2023-10-14T18:50:51.037 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T18:50:51.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.151+0000 7f5ab2eba700 1 Processor -- start 2023-10-14T18:50:51.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.151+0000 7f5ab2eba700 1 -- start start 2023-10-14T18:50:51.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab2eba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5aac1510f0 0x7f5aac06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab2eba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5aac070700 0x7f5aac070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab2eba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac071040 con 0x7f5aac0c9af0 2023-10-14T18:50:51.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab2eba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac0ca0b0 con 0x7f5aac1510f0 2023-10-14T18:50:51.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab2eba700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac068a10 con 0x7f5aac070700 2023-10-14T18:50:51.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5ab0c56700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5aac1510f0 0x7f5aac06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5aabfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5aac0c9af0 0x7f5aac15dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38178/0 (socket says 172.21.15.79:38178) 2023-10-14T18:50:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.152+0000 7f5aabfff700 1 -- 172.21.15.79:0/4293321501 learned_addr learned my addr 172.21.15.79:0/4293321501 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab0c56700 1 -- 172.21.15.79:0/4293321501 >> v2:172.21.15.144:3300/0 conn(0x7f5aac070700 msgr2=0x7f5aac070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/4293321501 >> v2:172.21.15.144:3300/0 conn(0x7f5aac070700 0x7f5aac070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab0c56700 1 -- 172.21.15.79:0/4293321501 >> v1:172.21.15.79:6789/0 conn(0x7f5aac0c9af0 legacy=0x7f5aac15dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab0c56700 1 -- 172.21.15.79:0/4293321501 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac068cf0 con 0x7f5aac1510f0 2023-10-14T18:50:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/4293321501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac06ecc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06df40 tx=0x7f5a9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330275f08110e0a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5aab7fe700 1 -- 172.21.15.79:0/4293321501 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00e070 con 0x7f5aac1510f0 2023-10-14T18:50:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5aab7fe700 1 -- 172.21.15.79:0/4293321501 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00bc30 con 0x7f5aac1510f0 2023-10-14T18:50:51.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5aab7fe700 1 -- 172.21.15.79:0/4293321501 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c012430 con 0x7f5aac1510f0 2023-10-14T18:50:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 -- 172.21.15.79:0/4293321501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 msgr2=0x7f5aac06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/4293321501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac06ecc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06df40 tx=0x7f5a9c009780 comp rx=0 tx=0).stop 2023-10-14T18:50:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 -- 172.21.15.79:0/4293321501 shutdown_connections 2023-10-14T18:50:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/4293321501 >> v2:172.21.15.144:3300/0 conn(0x7f5aac070700 0x7f5aac070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/4293321501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac06ecc0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 -- 172.21.15.79:0/4293321501 >> 172.21.15.79:0/4293321501 conn(0x7f5aac0ca4f0 msgr2=0x7f5aac0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:51.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 -- 172.21.15.79:0/4293321501 shutdown_connections 2023-10-14T18:50:51.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.153+0000 7f5ab2eba700 1 -- 172.21.15.79:0/4293321501 wait complete. 2023-10-14T18:50:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.154+0000 7f5ab2eba700 1 Processor -- start 2023-10-14T18:50:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 -- start start 2023-10-14T18:50:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 0x7f5aac0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5aac0c9af0 0x7f5aac16a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0c6430 con 0x7f5aac1510f0 2023-10-14T18:50:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0c7960 con 0x7f5aac0c9af0 2023-10-14T18:50:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab2eba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0c5820 con 0x7f5aac070700 2023-10-14T18:50:51.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.155+0000 7f5ab1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59508/0 (socket says 172.21.15.79:59508) 2023-10-14T18:50:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 -- 172.21.15.79:0/11008212 learned_addr learned my addr 172.21.15.79:0/11008212 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5aabfff700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5aac0c9af0 0x7f5aac16a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 0x7f5aac0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:51.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 -- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 msgr2=0x7f5aac0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 0x7f5aac0c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 -- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5aac0c9af0 msgr2=0x7f5aac16a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5aac0c9af0 0x7f5aac16a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 -- 172.21.15.79:0/11008212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c009a20 con 0x7f5aac1510f0 2023-10-14T18:50:51.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 0x7f5aac0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab1457700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400b810 tx=0x7f5aa40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400f510 con 0x7f5aac1510f0 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa400f690 con 0x7f5aac1510f0 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400fa50 con 0x7f5aac1510f0 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac0c5b00 con 0x7f5aac1510f0 2023-10-14T18:50:51.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.156+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac0c60c0 con 0x7f5aac1510f0 2023-10-14T18:50:51.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.157+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac0c8600 con 0x7f5aac1510f0 2023-10-14T18:50:51.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.157+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa401a400 con 0x7f5aac1510f0 2023-10-14T18:50:51.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.158+0000 7f5aa8ff9700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 0x7f5a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:51.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.158+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aa4084060 con 0x7f5aac1510f0 2023-10-14T18:50:51.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.158+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 0x7f5a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.159+0000 7f5ab0c56700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 0x7f5a980693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06df40 tx=0x7f5a9c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:51.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.162+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa4051350 con 0x7f5aac1510f0 2023-10-14T18:50:51.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.339+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5aac152b80 con 0x7f5a98066f30 2023-10-14T18:50:51.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.348+0000 7f5aa8ff9700 1 -- 172.21.15.79:0/11008212 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285740 (secure 0 0 0) 0x7f5aac152b80 con 0x7f5a98066f30 2023-10-14T18:50:51.352 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 msgr2=0x7f5a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 0x7f5a980693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5aac06df40 tx=0x7f5a9c019000 comp rx=0 tx=0).stop 2023-10-14T18:50:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 msgr2=0x7f5aac16ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400b810 tx=0x7f5aa40091d0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 shutdown_connections 2023-10-14T18:50:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a98066f30 0x7f5a980693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5aac1510f0 0x7f5aac16ad60 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5aac070700 0x7f5aac0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 --2- 172.21.15.79:0/11008212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5aac0c9af0 0x7f5aac16a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:51.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 >> 172.21.15.79:0/11008212 conn(0x7f5aac0ca4f0 msgr2=0x7f5aac0cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 shutdown_connections 2023-10-14T18:50:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:51.351+0000 7f5ab2eba700 1 -- 172.21.15.79:0/11008212 wait complete. 2023-10-14T18:50:51.357 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:51.364 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2023-10-14T18:50:50.415860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556076,"statfs":{"total":1600000000,"available":1593422111,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001462"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819785+0000","last_change":"2023-10-14T18:50:45.819576+0000","last_active":"2023-10-14T18:50:45.819785+0000","last_peered":"2023-10-14T18:50:45.819785+0000","last_clean":"2023-10-14T18:50:45.819785+0000","last_became_active":"2023-10-14T18:50:45.818658+0000","last_became_peered":"2023-10-14T18:50:45.818658+0000","last_unstale":"2023-10-14T18:50:45.819785+0000","last_undegraded":"2023-10-14T18:50:45.819785+0000","last_fullsized":"2023-10-14T18:50:45.819785+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828544+0000","last_change":"2023-10-14T18:50:45.828504+0000","last_active":"2023-10-14T18:50:45.828544+0000","last_peered":"2023-10-14T18:50:45.828544+0000","last_clean":"2023-10-14T18:50:45.828544+0000","last_became_active":"2023-10-14T18:50:45.827821+0000","last_became_peered":"2023-10-14T18:50:45.827821+0000","last_unstale":"2023-10-14T18:50:45.828544+0000","last_undegraded":"2023-10-14T18:50:45.828544+0000","last_fullsized":"2023-10-14T18:50:45.828544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:31.668664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814795+0000","last_change":"2023-10-14T18:50:45.814742+0000","last_active":"2023-10-14T18:50:45.814795+0000","last_peered":"2023-10-14T18:50:45.814795+0000","last_clean":"2023-10-14T18:50:45.814795+0000","last_became_active":"2023-10-14T18:50:45.814499+0000","last_became_peered":"2023-10-14T18:50:45.814499+0000","last_unstale":"2023-10-14T18:50:45.814795+0000","last_undegraded":"2023-10-14T18:50:45.814795+0000","last_fullsized":"2023-10-14T18:50:45.814795+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:37.911232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820881+0000","last_change":"2023-10-14T18:50:45.820759+0000","last_active":"2023-10-14T18:50:45.820881+0000","last_peered":"2023-10-14T18:50:45.820881+0000","last_clean":"2023-10-14T18:50:45.820881+0000","last_became_active":"2023-10-14T18:50:45.820207+0000","last_became_peered":"2023-10-14T18:50:45.820207+0000","last_unstale":"2023-10-14T18:50:45.820881+0000","last_undegraded":"2023-10-14T18:50:45.820881+0000","last_fullsized":"2023-10-14T18:50:45.820881+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820197+0000","last_change":"2023-10-14T18:50:45.820039+0000","last_active":"2023-10-14T18:50:45.820197+0000","last_peered":"2023-10-14T18:50:45.820197+0000","last_clean":"2023-10-14T18:50:45.820197+0000","last_became_active":"2023-10-14T18:50:45.819820+0000","last_became_peered":"2023-10-14T18:50:45.819820+0000","last_unstale":"2023-10-14T18:50:45.820197+0000","last_undegraded":"2023-10-14T18:50:45.820197+0000","last_fullsized":"2023-10-14T18:50:45.820197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.816304+0000","last_change":"2023-10-14T18:50:45.815791+0000","last_active":"2023-10-14T18:50:45.816304+0000","last_peered":"2023-10-14T18:50:45.816304+0000","last_clean":"2023-10-14T18:50:45.816304+0000","last_became_active":"2023-10-14T18:50:45.815123+0000","last_became_peered":"2023-10-14T18:50:45.815123+0000","last_unstale":"2023-10-14T18:50:45.816304+0000","last_undegraded":"2023-10-14T18:50:45.816304+0000","last_fullsized":"2023-10-14T18:50:45.816304+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820409+0000","last_change":"2023-10-14T18:50:45.819869+0000","last_active":"2023-10-14T18:50:45.820409+0000","last_peered":"2023-10-14T18:50:45.820409+0000","last_clean":"2023-10-14T18:50:45.820409+0000","last_became_active":"2023-10-14T18:50:45.816982+0000","last_became_peered":"2023-10-14T18:50:45.816982+0000","last_unstale":"2023-10-14T18:50:45.820409+0000","last_undegraded":"2023-10-14T18:50:45.820409+0000","last_fullsized":"2023-10-14T18:50:45.820409+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820051+0000","last_change":"2023-10-14T18:50:45.819986+0000","last_active":"2023-10-14T18:50:45.820051+0000","last_peered":"2023-10-14T18:50:45.820051+0000","last_clean":"2023-10-14T18:50:45.820051+0000","last_became_active":"2023-10-14T18:50:45.818860+0000","last_became_peered":"2023-10-14T18:50:45.818860+0000","last_unstale":"2023-10-14T18:50:45.820051+0000","last_undegraded":"2023-10-14T18:50:45.820051+0000","last_fullsized":"2023-10-14T18:50:45.820051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:51.568633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824751+0000","last_change":"2023-10-14T18:50:45.824686+0000","last_active":"2023-10-14T18:50:45.824751+0000","last_peered":"2023-10-14T18:50:45.824751+0000","last_clean":"2023-10-14T18:50:45.824751+0000","last_became_active":"2023-10-14T18:50:45.824473+0000","last_became_peered":"2023-10-14T18:50:45.824473+0000","last_unstale":"2023-10-14T18:50:45.824751+0000","last_undegraded":"2023-10-14T18:50:45.824751+0000","last_fullsized":"2023-10-14T18:50:45.824751+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823467+0000","last_change":"2023-10-14T18:50:45.822903+0000","last_active":"2023-10-14T18:50:45.823467+0000","last_peered":"2023-10-14T18:50:45.823467+0000","last_clean":"2023-10-14T18:50:45.823467+0000","last_became_active":"2023-10-14T18:50:45.822620+0000","last_became_peered":"2023-10-14T18:50:45.822620+0000","last_unstale":"2023-10-14T18:50:45.823467+0000","last_undegraded":"2023-10-14T18:50:45.823467+0000","last_fullsized":"2023-10-14T18:50:45.823467+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819749+0000","last_change":"2023-10-14T18:50:45.817932+0000","last_active":"2023-10-14T18:50:45.819749+0000","last_peered":"2023-10-14T18:50:45.819749+0000","last_clean":"2023-10-14T18:50:45.819749+0000","last_became_active":"2023-10-14T18:50:45.817243+0000","last_became_peered":"2023-10-14T18:50:45.817243+0000","last_unstale":"2023-10-14T18:50:45.819749+0000","last_undegraded":"2023-10-14T18:50:45.819749+0000","last_fullsized":"2023-10-14T18:50:45.819749+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:18.916660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824260+0000","last_change":"2023-10-14T18:50:45.824116+0000","last_active":"2023-10-14T18:50:45.824260+0000","last_peered":"2023-10-14T18:50:45.824260+0000","last_clean":"2023-10-14T18:50:45.824260+0000","last_became_active":"2023-10-14T18:50:45.823884+0000","last_became_peered":"2023-10-14T18:50:45.823884+0000","last_unstale":"2023-10-14T18:50:45.824260+0000","last_undegraded":"2023-10-14T18:50:45.824260+0000","last_fullsized":"2023-10-14T18:50:45.824260+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822133+0000","last_change":"2023-10-14T18:50:45.822055+0000","last_active":"2023-10-14T18:50:45.822133+0000","last_peered":"2023-10-14T18:50:45.822133+0000","last_clean":"2023-10-14T18:50:45.822133+0000","last_became_active":"2023-10-14T18:50:45.821167+0000","last_became_peered":"2023-10-14T18:50:45.821167+0000","last_unstale":"2023-10-14T18:50:45.822133+0000","last_undegraded":"2023-10-14T18:50:45.822133+0000","last_fullsized":"2023-10-14T18:50:45.822133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817154+0000","last_change":"2023-10-14T18:50:45.816793+0000","last_active":"2023-10-14T18:50:45.817154+0000","last_peered":"2023-10-14T18:50:45.817154+0000","last_clean":"2023-10-14T18:50:45.817154+0000","last_became_active":"2023-10-14T18:50:45.816382+0000","last_became_peered":"2023-10-14T18:50:45.816382+0000","last_unstale":"2023-10-14T18:50:45.817154+0000","last_undegraded":"2023-10-14T18:50:45.817154+0000","last_fullsized":"2023-10-14T18:50:45.817154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:02:08.547770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826697+0000","last_change":"2023-10-14T18:50:45.826633+0000","last_active":"2023-10-14T18:50:45.826697+0000","last_peered":"2023-10-14T18:50:45.826697+0000","last_clean":"2023-10-14T18:50:45.826697+0000","last_became_active":"2023-10-14T18:50:45.826107+0000","last_became_peered":"2023-10-14T18:50:45.826107+0000","last_unstale":"2023-10-14T18:50:45.826697+0000","last_undegraded":"2023-10-14T18:50:45.826697+0000","last_fullsized":"2023-10-14T18:50:45.826697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819717+0000","last_change":"2023-10-14T18:50:45.817606+0000","last_active":"2023-10-14T18:50:45.819717+0000","last_peered":"2023-10-14T18:50:45.819717+0000","last_clean":"2023-10-14T18:50:45.819717+0000","last_became_active":"2023-10-14T18:50:45.816570+0000","last_became_peered":"2023-10-14T18:50:45.816570+0000","last_unstale":"2023-10-14T18:50:45.819717+0000","last_undegraded":"2023-10-14T18:50:45.819717+0000","last_fullsized":"2023-10-14T18:50:45.819717+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819333+0000","last_change":"2023-10-14T18:50:45.819234+0000","last_active":"2023-10-14T18:50:45.819333+0000","last_peered":"2023-10-14T18:50:45.819333+0000","last_clean":"2023-10-14T18:50:45.819333+0000","last_became_active":"2023-10-14T18:50:45.819008+0000","last_became_peered":"2023-10-14T18:50:45.819008+0000","last_unstale":"2023-10-14T18:50:45.819333+0000","last_undegraded":"2023-10-14T18:50:45.819333+0000","last_fullsized":"2023-10-14T18:50:45.819333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:10.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822360+0000","last_change":"2023-10-14T18:50:45.822312+0000","last_active":"2023-10-14T18:50:45.822360+0000","last_peered":"2023-10-14T18:50:45.822360+0000","last_clean":"2023-10-14T18:50:45.822360+0000","last_became_active":"2023-10-14T18:50:45.821835+0000","last_became_peered":"2023-10-14T18:50:45.821835+0000","last_unstale":"2023-10-14T18:50:45.822360+0000","last_undegraded":"2023-10-14T18:50:45.822360+0000","last_fullsized":"2023-10-14T18:50:45.822360+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:42.711227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822959+0000","last_change":"2023-10-14T18:50:45.820969+0000","last_active":"2023-10-14T18:50:45.822959+0000","last_peered":"2023-10-14T18:50:45.822959+0000","last_clean":"2023-10-14T18:50:45.822959+0000","last_became_active":"2023-10-14T18:50:45.820670+0000","last_became_peered":"2023-10-14T18:50:45.820670+0000","last_unstale":"2023-10-14T18:50:45.822959+0000","last_undegraded":"2023-10-14T18:50:45.822959+0000","last_fullsized":"2023-10-14T18:50:45.822959+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:56.359682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823528+0000","last_change":"2023-10-14T18:50:45.822620+0000","last_active":"2023-10-14T18:50:45.823528+0000","last_peered":"2023-10-14T18:50:45.823528+0000","last_clean":"2023-10-14T18:50:45.823528+0000","last_became_active":"2023-10-14T18:50:45.822254+0000","last_became_peered":"2023-10-14T18:50:45.822254+0000","last_unstale":"2023-10-14T18:50:45.823528+0000","last_undegraded":"2023-10-14T18:50:45.823528+0000","last_fullsized":"2023-10-14T18:50:45.823528+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818120+0000","last_change":"2023-10-14T18:50:45.818062+0000","last_active":"2023-10-14T18:50:45.818120+0000","last_peered":"2023-10-14T18:50:45.818120+0000","last_clean":"2023-10-14T18:50:45.818120+0000","last_became_active":"2023-10-14T18:50:45.817814+0000","last_became_peered":"2023-10-14T18:50:45.817814+0000","last_unstale":"2023-10-14T18:50:45.818120+0000","last_undegraded":"2023-10-14T18:50:45.818120+0000","last_fullsized":"2023-10-14T18:50:45.818120+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:52.081054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828637+0000","last_change":"2023-10-14T18:50:45.828590+0000","last_active":"2023-10-14T18:50:45.828637+0000","last_peered":"2023-10-14T18:50:45.828637+0000","last_clean":"2023-10-14T18:50:45.828637+0000","last_became_active":"2023-10-14T18:50:45.828082+0000","last_became_peered":"2023-10-14T18:50:45.828082+0000","last_unstale":"2023-10-14T18:50:45.828637+0000","last_undegraded":"2023-10-14T18:50:45.828637+0000","last_fullsized":"2023-10-14T18:50:45.828637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:14.870008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820702+0000","last_change":"2023-10-14T18:50:45.820637+0000","last_active":"2023-10-14T18:50:45.820702+0000","last_peered":"2023-10-14T18:50:45.820702+0000","last_clean":"2023-10-14T18:50:45.820702+0000","last_became_active":"2023-10-14T18:50:45.820205+0000","last_became_peered":"2023-10-14T18:50:45.820205+0000","last_unstale":"2023-10-14T18:50:45.820702+0000","last_undegraded":"2023-10-14T18:50:45.820702+0000","last_fullsized":"2023-10-14T18:50:45.820702+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:16.464393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.811977+0000","last_change":"2023-10-14T18:50:45.811813+0000","last_active":"2023-10-14T18:50:45.811977+0000","last_peered":"2023-10-14T18:50:45.811977+0000","last_clean":"2023-10-14T18:50:45.811977+0000","last_became_active":"2023-10-14T18:50:45.811573+0000","last_became_peered":"2023-10-14T18:50:45.811573+0000","last_unstale":"2023-10-14T18:50:45.811977+0000","last_undegraded":"2023-10-14T18:50:45.811977+0000","last_fullsized":"2023-10-14T18:50:45.811977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819121+0000","last_change":"2023-10-14T18:50:45.819032+0000","last_active":"2023-10-14T18:50:45.819121+0000","last_peered":"2023-10-14T18:50:45.819121+0000","last_clean":"2023-10-14T18:50:45.819121+0000","last_became_active":"2023-10-14T18:50:45.818759+0000","last_became_peered":"2023-10-14T18:50:45.818759+0000","last_unstale":"2023-10-14T18:50:45.819121+0000","last_undegraded":"2023-10-14T18:50:45.819121+0000","last_fullsized":"2023-10-14T18:50:45.819121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827589+0000","last_change":"2023-10-14T18:50:45.827528+0000","last_active":"2023-10-14T18:50:45.827589+0000","last_peered":"2023-10-14T18:50:45.827589+0000","last_clean":"2023-10-14T18:50:45.827589+0000","last_became_active":"2023-10-14T18:50:45.827086+0000","last_became_peered":"2023-10-14T18:50:45.827086+0000","last_unstale":"2023-10-14T18:50:45.827589+0000","last_undegraded":"2023-10-14T18:50:45.827589+0000","last_fullsized":"2023-10-14T18:50:45.827589+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:08.753906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819698+0000","last_change":"2023-10-14T18:50:45.817224+0000","last_active":"2023-10-14T18:50:45.819698+0000","last_peered":"2023-10-14T18:50:45.819698+0000","last_clean":"2023-10-14T18:50:45.819698+0000","last_became_active":"2023-10-14T18:50:45.816658+0000","last_became_peered":"2023-10-14T18:50:45.816658+0000","last_unstale":"2023-10-14T18:50:45.819698+0000","last_undegraded":"2023-10-14T18:50:45.819698+0000","last_fullsized":"2023-10-14T18:50:45.819698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823484+0000","last_change":"2023-10-14T18:50:45.823278+0000","last_active":"2023-10-14T18:50:45.823484+0000","last_peered":"2023-10-14T18:50:45.823484+0000","last_clean":"2023-10-14T18:50:45.823484+0000","last_became_active":"2023-10-14T18:50:45.822659+0000","last_became_peered":"2023-10-14T18:50:45.822659+0000","last_unstale":"2023-10-14T18:50:45.823484+0000","last_undegraded":"2023-10-14T18:50:45.823484+0000","last_fullsized":"2023-10-14T18:50:45.823484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826351+0000","last_change":"2023-10-14T18:50:45.826298+0000","last_active":"2023-10-14T18:50:45.826351+0000","last_peered":"2023-10-14T18:50:45.826351+0000","last_clean":"2023-10-14T18:50:45.826351+0000","last_became_active":"2023-10-14T18:50:45.826171+0000","last_became_peered":"2023-10-14T18:50:45.826171+0000","last_unstale":"2023-10-14T18:50:45.826351+0000","last_undegraded":"2023-10-14T18:50:45.826351+0000","last_fullsized":"2023-10-14T18:50:45.826351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:30.600160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826874+0000","last_change":"2023-10-14T18:50:45.826700+0000","last_active":"2023-10-14T18:50:45.826874+0000","last_peered":"2023-10-14T18:50:45.826874+0000","last_clean":"2023-10-14T18:50:45.826874+0000","last_became_active":"2023-10-14T18:50:45.826364+0000","last_became_peered":"2023-10-14T18:50:45.826364+0000","last_unstale":"2023-10-14T18:50:45.826874+0000","last_undegraded":"2023-10-14T18:50:45.826874+0000","last_fullsized":"2023-10-14T18:50:45.826874+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:18.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820850+0000","last_change":"2023-10-14T18:50:45.820309+0000","last_active":"2023-10-14T18:50:45.820850+0000","last_peered":"2023-10-14T18:50:45.820850+0000","last_clean":"2023-10-14T18:50:45.820850+0000","last_became_active":"2023-10-14T18:50:45.819980+0000","last_became_peered":"2023-10-14T18:50:45.819980+0000","last_unstale":"2023-10-14T18:50:45.820850+0000","last_undegraded":"2023-10-14T18:50:45.820850+0000","last_fullsized":"2023-10-14T18:50:45.820850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822406+0000","last_change":"2023-10-14T18:50:45.822017+0000","last_active":"2023-10-14T18:50:45.822406+0000","last_peered":"2023-10-14T18:50:45.822406+0000","last_clean":"2023-10-14T18:50:45.822406+0000","last_became_active":"2023-10-14T18:50:45.821809+0000","last_became_peered":"2023-10-14T18:50:45.821809+0000","last_unstale":"2023-10-14T18:50:45.822406+0000","last_undegraded":"2023-10-14T18:50:45.822406+0000","last_fullsized":"2023-10-14T18:50:45.822406+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:33.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817138+0000","last_change":"2023-10-14T18:50:45.816656+0000","last_active":"2023-10-14T18:50:45.817138+0000","last_peered":"2023-10-14T18:50:45.817138+0000","last_clean":"2023-10-14T18:50:45.817138+0000","last_became_active":"2023-10-14T18:50:45.816127+0000","last_became_peered":"2023-10-14T18:50:45.816127+0000","last_unstale":"2023-10-14T18:50:45.817138+0000","last_undegraded":"2023-10-14T18:50:45.817138+0000","last_fullsized":"2023-10-14T18:50:45.817138+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:40.585030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829493+0000","last_change":"2023-10-14T18:50:44.545811+0000","last_active":"2023-10-14T18:50:45.829493+0000","last_peered":"2023-10-14T18:50:45.829493+0000","last_clean":"2023-10-14T18:50:45.829493+0000","last_became_active":"2023-10-14T18:50:44.545344+0000","last_became_peered":"2023-10-14T18:50:44.545344+0000","last_unstale":"2023-10-14T18:50:45.829493+0000","last_undegraded":"2023-10-14T18:50:45.829493+0000","last_fullsized":"2023-10-14T18:50:45.829493+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:54.972036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822235+0000","last_change":"2023-10-14T18:50:45.822186+0000","last_active":"2023-10-14T18:50:45.822235+0000","last_peered":"2023-10-14T18:50:45.822235+0000","last_clean":"2023-10-14T18:50:45.822235+0000","last_became_active":"2023-10-14T18:50:45.821552+0000","last_became_peered":"2023-10-14T18:50:45.821552+0000","last_unstale":"2023-10-14T18:50:45.822235+0000","last_undegraded":"2023-10-14T18:50:45.822235+0000","last_fullsized":"2023-10-14T18:50:45.822235+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827447+0000","last_change":"2023-10-14T18:50:44.540309+0000","last_active":"2023-10-14T18:50:45.827447+0000","last_peered":"2023-10-14T18:50:45.827447+0000","last_clean":"2023-10-14T18:50:45.827447+0000","last_became_active":"2023-10-14T18:50:44.539792+0000","last_became_peered":"2023-10-14T18:50:44.539792+0000","last_unstale":"2023-10-14T18:50:45.827447+0000","last_undegraded":"2023-10-14T18:50:45.827447+0000","last_fullsized":"2023-10-14T18:50:45.827447+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:16.639029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820145+0000","last_change":"2023-10-14T18:50:45.819750+0000","last_active":"2023-10-14T18:50:45.820145+0000","last_peered":"2023-10-14T18:50:45.820145+0000","last_clean":"2023-10-14T18:50:45.820145+0000","last_became_active":"2023-10-14T18:50:45.819359+0000","last_became_peered":"2023-10-14T18:50:45.819359+0000","last_unstale":"2023-10-14T18:50:45.820145+0000","last_undegraded":"2023-10-14T18:50:45.820145+0000","last_fullsized":"2023-10-14T18:50:45.820145+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:05.181656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825610+0000","last_change":"2023-10-14T18:50:44.539788+0000","last_active":"2023-10-14T18:50:45.825610+0000","last_peered":"2023-10-14T18:50:45.825610+0000","last_clean":"2023-10-14T18:50:45.825610+0000","last_became_active":"2023-10-14T18:50:44.539503+0000","last_became_peered":"2023-10-14T18:50:44.539503+0000","last_unstale":"2023-10-14T18:50:45.825610+0000","last_undegraded":"2023-10-14T18:50:45.825610+0000","last_fullsized":"2023-10-14T18:50:45.825610+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:10.032267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822612+0000","last_change":"2023-10-14T18:50:45.822481+0000","last_active":"2023-10-14T18:50:45.822612+0000","last_peered":"2023-10-14T18:50:45.822612+0000","last_clean":"2023-10-14T18:50:45.822612+0000","last_became_active":"2023-10-14T18:50:45.821679+0000","last_became_peered":"2023-10-14T18:50:45.821679+0000","last_unstale":"2023-10-14T18:50:45.822612+0000","last_undegraded":"2023-10-14T18:50:45.822612+0000","last_fullsized":"2023-10-14T18:50:45.822612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827395+0000","last_change":"2023-10-14T18:50:44.547260+0000","last_active":"2023-10-14T18:50:45.827395+0000","last_peered":"2023-10-14T18:50:45.827395+0000","last_clean":"2023-10-14T18:50:45.827395+0000","last_became_active":"2023-10-14T18:50:44.547133+0000","last_became_peered":"2023-10-14T18:50:44.547133+0000","last_unstale":"2023-10-14T18:50:45.827395+0000","last_undegraded":"2023-10-14T18:50:45.827395+0000","last_fullsized":"2023-10-14T18:50:45.827395+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:00.360150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820141+0000","last_change":"2023-10-14T18:50:45.818964+0000","last_active":"2023-10-14T18:50:45.820141+0000","last_peered":"2023-10-14T18:50:45.820141+0000","last_clean":"2023-10-14T18:50:45.820141+0000","last_became_active":"2023-10-14T18:50:45.818739+0000","last_became_peered":"2023-10-14T18:50:45.818739+0000","last_unstale":"2023-10-14T18:50:45.820141+0000","last_undegraded":"2023-10-14T18:50:45.820141+0000","last_fullsized":"2023-10-14T18:50:45.820141+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827324+0000","last_change":"2023-10-14T18:50:44.544542+0000","last_active":"2023-10-14T18:50:45.827324+0000","last_peered":"2023-10-14T18:50:45.827324+0000","last_clean":"2023-10-14T18:50:45.827324+0000","last_became_active":"2023-10-14T18:50:44.543597+0000","last_became_peered":"2023-10-14T18:50:44.543597+0000","last_unstale":"2023-10-14T18:50:45.827324+0000","last_undegraded":"2023-10-14T18:50:45.827324+0000","last_fullsized":"2023-10-14T18:50:45.827324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:54.499443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820427+0000","last_change":"2023-10-14T18:50:45.820349+0000","last_active":"2023-10-14T18:50:45.820427+0000","last_peered":"2023-10-14T18:50:45.820427+0000","last_clean":"2023-10-14T18:50:45.820427+0000","last_became_active":"2023-10-14T18:50:45.820102+0000","last_became_peered":"2023-10-14T18:50:45.820102+0000","last_unstale":"2023-10-14T18:50:45.820427+0000","last_undegraded":"2023-10-14T18:50:45.820427+0000","last_fullsized":"2023-10-14T18:50:45.820427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829562+0000","last_change":"2023-10-14T18:50:44.546523+0000","last_active":"2023-10-14T18:50:45.829562+0000","last_peered":"2023-10-14T18:50:45.829562+0000","last_clean":"2023-10-14T18:50:45.829562+0000","last_became_active":"2023-10-14T18:50:44.546079+0000","last_became_peered":"2023-10-14T18:50:44.546079+0000","last_unstale":"2023-10-14T18:50:45.829562+0000","last_undegraded":"2023-10-14T18:50:45.829562+0000","last_fullsized":"2023-10-14T18:50:45.829562+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:40.776044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826828+0000","last_change":"2023-10-14T18:50:45.826768+0000","last_active":"2023-10-14T18:50:45.826828+0000","last_peered":"2023-10-14T18:50:45.826828+0000","last_clean":"2023-10-14T18:50:45.826828+0000","last_became_active":"2023-10-14T18:50:45.826421+0000","last_became_peered":"2023-10-14T18:50:45.826421+0000","last_unstale":"2023-10-14T18:50:45.826828+0000","last_undegraded":"2023-10-14T18:50:45.826828+0000","last_fullsized":"2023-10-14T18:50:45.826828+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812193+0000","last_change":"2023-10-14T18:50:44.542559+0000","last_active":"2023-10-14T18:50:45.812193+0000","last_peered":"2023-10-14T18:50:45.812193+0000","last_clean":"2023-10-14T18:50:45.812193+0000","last_became_active":"2023-10-14T18:50:44.542328+0000","last_became_peered":"2023-10-14T18:50:44.542328+0000","last_unstale":"2023-10-14T18:50:45.812193+0000","last_undegraded":"2023-10-14T18:50:45.812193+0000","last_fullsized":"2023-10-14T18:50:45.812193+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817111+0000","last_change":"2023-10-14T18:50:45.816987+0000","last_active":"2023-10-14T18:50:45.817111+0000","last_peered":"2023-10-14T18:50:45.817111+0000","last_clean":"2023-10-14T18:50:45.817111+0000","last_became_active":"2023-10-14T18:50:45.816739+0000","last_became_peered":"2023-10-14T18:50:45.816739+0000","last_unstale":"2023-10-14T18:50:45.817111+0000","last_undegraded":"2023-10-14T18:50:45.817111+0000","last_fullsized":"2023-10-14T18:50:45.817111+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809213+0000","last_change":"2023-10-14T18:50:44.542883+0000","last_active":"2023-10-14T18:50:45.809213+0000","last_peered":"2023-10-14T18:50:45.809213+0000","last_clean":"2023-10-14T18:50:45.809213+0000","last_became_active":"2023-10-14T18:50:44.542659+0000","last_became_peered":"2023-10-14T18:50:44.542659+0000","last_unstale":"2023-10-14T18:50:45.809213+0000","last_undegraded":"2023-10-14T18:50:45.809213+0000","last_fullsized":"2023-10-14T18:50:45.809213+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:55:43.270454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828772+0000","last_change":"2023-10-14T18:50:45.828700+0000","last_active":"2023-10-14T18:50:45.828772+0000","last_peered":"2023-10-14T18:50:45.828772+0000","last_clean":"2023-10-14T18:50:45.828772+0000","last_became_active":"2023-10-14T18:50:45.828351+0000","last_became_peered":"2023-10-14T18:50:45.828351+0000","last_unstale":"2023-10-14T18:50:45.828772+0000","last_undegraded":"2023-10-14T18:50:45.828772+0000","last_fullsized":"2023-10-14T18:50:45.828772+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:47:46.701116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809318+0000","last_change":"2023-10-14T18:50:44.544430+0000","last_active":"2023-10-14T18:50:45.809318+0000","last_peered":"2023-10-14T18:50:45.809318+0000","last_clean":"2023-10-14T18:50:45.809318+0000","last_became_active":"2023-10-14T18:50:44.543784+0000","last_became_peered":"2023-10-14T18:50:44.543784+0000","last_unstale":"2023-10-14T18:50:45.809318+0000","last_undegraded":"2023-10-14T18:50:45.809318+0000","last_fullsized":"2023-10-14T18:50:45.809318+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:47.975371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819225+0000","last_change":"2023-10-14T18:50:45.818536+0000","last_active":"2023-10-14T18:50:45.819225+0000","last_peered":"2023-10-14T18:50:45.819225+0000","last_clean":"2023-10-14T18:50:45.819225+0000","last_became_active":"2023-10-14T18:50:45.818041+0000","last_became_peered":"2023-10-14T18:50:45.818041+0000","last_unstale":"2023-10-14T18:50:45.819225+0000","last_undegraded":"2023-10-14T18:50:45.819225+0000","last_fullsized":"2023-10-14T18:50:45.819225+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813577+0000","last_change":"2023-10-14T18:50:44.536713+0000","last_active":"2023-10-14T18:50:45.813577+0000","last_peered":"2023-10-14T18:50:45.813577+0000","last_clean":"2023-10-14T18:50:45.813577+0000","last_became_active":"2023-10-14T18:50:44.536488+0000","last_became_peered":"2023-10-14T18:50:44.536488+0000","last_unstale":"2023-10-14T18:50:45.813577+0000","last_undegraded":"2023-10-14T18:50:45.813577+0000","last_fullsized":"2023-10-14T18:50:45.813577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822400+0000","last_change":"2023-10-14T18:50:45.821375+0000","last_active":"2023-10-14T18:50:45.822400+0000","last_peered":"2023-10-14T18:50:45.822400+0000","last_clean":"2023-10-14T18:50:45.822400+0000","last_became_active":"2023-10-14T18:50:45.819731+0000","last_became_peered":"2023-10-14T18:50:45.819731+0000","last_unstale":"2023-10-14T18:50:45.822400+0000","last_undegraded":"2023-10-14T18:50:45.822400+0000","last_fullsized":"2023-10-14T18:50:45.822400+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825807+0000","last_change":"2023-10-14T18:50:44.542109+0000","last_active":"2023-10-14T18:50:45.825807+0000","last_peered":"2023-10-14T18:50:45.825807+0000","last_clean":"2023-10-14T18:50:45.825807+0000","last_became_active":"2023-10-14T18:50:44.541891+0000","last_became_peered":"2023-10-14T18:50:44.541891+0000","last_unstale":"2023-10-14T18:50:45.825807+0000","last_undegraded":"2023-10-14T18:50:45.825807+0000","last_fullsized":"2023-10-14T18:50:45.825807+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817075+0000","last_change":"2023-10-14T18:50:45.817020+0000","last_active":"2023-10-14T18:50:45.817075+0000","last_peered":"2023-10-14T18:50:45.817075+0000","last_clean":"2023-10-14T18:50:45.817075+0000","last_became_active":"2023-10-14T18:50:45.816711+0000","last_became_peered":"2023-10-14T18:50:45.816711+0000","last_unstale":"2023-10-14T18:50:45.817075+0000","last_undegraded":"2023-10-14T18:50:45.817075+0000","last_fullsized":"2023-10-14T18:50:45.817075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828804+0000","last_change":"2023-10-14T18:50:44.544803+0000","last_active":"2023-10-14T18:50:45.828804+0000","last_peered":"2023-10-14T18:50:45.828804+0000","last_clean":"2023-10-14T18:50:45.828804+0000","last_became_active":"2023-10-14T18:50:44.544586+0000","last_became_peered":"2023-10-14T18:50:44.544586+0000","last_unstale":"2023-10-14T18:50:45.828804+0000","last_undegraded":"2023-10-14T18:50:45.828804+0000","last_fullsized":"2023-10-14T18:50:45.828804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820815+0000","last_change":"2023-10-14T18:50:45.820183+0000","last_active":"2023-10-14T18:50:45.820815+0000","last_peered":"2023-10-14T18:50:45.820815+0000","last_clean":"2023-10-14T18:50:45.820815+0000","last_became_active":"2023-10-14T18:50:45.819649+0000","last_became_peered":"2023-10-14T18:50:45.819649+0000","last_unstale":"2023-10-14T18:50:45.820815+0000","last_undegraded":"2023-10-14T18:50:45.820815+0000","last_fullsized":"2023-10-14T18:50:45.820815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:41.657701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823079+0000","last_change":"2023-10-14T18:50:44.545892+0000","last_active":"2023-10-14T18:50:45.823079+0000","last_peered":"2023-10-14T18:50:45.823079+0000","last_clean":"2023-10-14T18:50:45.823079+0000","last_became_active":"2023-10-14T18:50:44.545675+0000","last_became_peered":"2023-10-14T18:50:44.545675+0000","last_unstale":"2023-10-14T18:50:45.823079+0000","last_undegraded":"2023-10-14T18:50:45.823079+0000","last_fullsized":"2023-10-14T18:50:45.823079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:52.384948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825660+0000","last_change":"2023-10-14T18:50:45.825425+0000","last_active":"2023-10-14T18:50:45.825660+0000","last_peered":"2023-10-14T18:50:45.825660+0000","last_clean":"2023-10-14T18:50:45.825660+0000","last_became_active":"2023-10-14T18:50:45.825086+0000","last_became_peered":"2023-10-14T18:50:45.825086+0000","last_unstale":"2023-10-14T18:50:45.825660+0000","last_undegraded":"2023-10-14T18:50:45.825660+0000","last_fullsized":"2023-10-14T18:50:45.825660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:38.311624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812759+0000","last_change":"2023-10-14T18:50:44.543357+0000","last_active":"2023-10-14T18:50:45.812759+0000","last_peered":"2023-10-14T18:50:45.812759+0000","last_clean":"2023-10-14T18:50:45.812759+0000","last_became_active":"2023-10-14T18:50:44.543144+0000","last_became_peered":"2023-10-14T18:50:44.543144+0000","last_unstale":"2023-10-14T18:50:45.812759+0000","last_undegraded":"2023-10-14T18:50:45.812759+0000","last_fullsized":"2023-10-14T18:50:45.812759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:11.473597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.821166+0000","last_change":"2023-10-14T18:50:45.820718+0000","last_active":"2023-10-14T18:50:45.821166+0000","last_peered":"2023-10-14T18:50:45.821166+0000","last_clean":"2023-10-14T18:50:45.821166+0000","last_became_active":"2023-10-14T18:50:45.820428+0000","last_became_peered":"2023-10-14T18:50:45.820428+0000","last_unstale":"2023-10-14T18:50:45.821166+0000","last_undegraded":"2023-10-14T18:50:45.821166+0000","last_fullsized":"2023-10-14T18:50:45.821166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815283+0000","last_change":"2023-10-14T18:50:44.546145+0000","last_active":"2023-10-14T18:50:45.815283+0000","last_peered":"2023-10-14T18:50:45.815283+0000","last_clean":"2023-10-14T18:50:45.815283+0000","last_became_active":"2023-10-14T18:50:44.545927+0000","last_became_peered":"2023-10-14T18:50:44.545927+0000","last_unstale":"2023-10-14T18:50:45.815283+0000","last_undegraded":"2023-10-14T18:50:45.815283+0000","last_fullsized":"2023-10-14T18:50:45.815283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818441+0000","last_change":"2023-10-14T18:50:45.818379+0000","last_active":"2023-10-14T18:50:45.818441+0000","last_peered":"2023-10-14T18:50:45.818441+0000","last_clean":"2023-10-14T18:50:45.818441+0000","last_became_active":"2023-10-14T18:50:45.817568+0000","last_became_peered":"2023-10-14T18:50:45.817568+0000","last_unstale":"2023-10-14T18:50:45.818441+0000","last_undegraded":"2023-10-14T18:50:45.818441+0000","last_fullsized":"2023-10-14T18:50:45.818441+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:43:46.507961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827444+0000","last_change":"2023-10-14T18:50:44.544087+0000","last_active":"2023-10-14T18:50:45.827444+0000","last_peered":"2023-10-14T18:50:45.827444+0000","last_clean":"2023-10-14T18:50:45.827444+0000","last_became_active":"2023-10-14T18:50:44.543861+0000","last_became_peered":"2023-10-14T18:50:44.543861+0000","last_unstale":"2023-10-14T18:50:45.827444+0000","last_undegraded":"2023-10-14T18:50:45.827444+0000","last_fullsized":"2023-10-14T18:50:45.827444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:33.856982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817607+0000","last_change":"2023-10-14T18:50:45.817151+0000","last_active":"2023-10-14T18:50:45.817607+0000","last_peered":"2023-10-14T18:50:45.817607+0000","last_clean":"2023-10-14T18:50:45.817607+0000","last_became_active":"2023-10-14T18:50:45.816906+0000","last_became_peered":"2023-10-14T18:50:45.816906+0000","last_unstale":"2023-10-14T18:50:45.817607+0000","last_undegraded":"2023-10-14T18:50:45.817607+0000","last_fullsized":"2023-10-14T18:50:45.817607+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827241+0000","last_change":"2023-10-14T18:50:44.546883+0000","last_active":"2023-10-14T18:50:45.827241+0000","last_peered":"2023-10-14T18:50:45.827241+0000","last_clean":"2023-10-14T18:50:45.827241+0000","last_became_active":"2023-10-14T18:50:44.546539+0000","last_became_peered":"2023-10-14T18:50:44.546539+0000","last_unstale":"2023-10-14T18:50:45.827241+0000","last_undegraded":"2023-10-14T18:50:45.827241+0000","last_fullsized":"2023-10-14T18:50:45.827241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:37.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820166+0000","last_change":"2023-10-14T18:50:45.819430+0000","last_active":"2023-10-14T18:50:45.820166+0000","last_peered":"2023-10-14T18:50:45.820166+0000","last_clean":"2023-10-14T18:50:45.820166+0000","last_became_active":"2023-10-14T18:50:45.818305+0000","last_became_peered":"2023-10-14T18:50:45.818305+0000","last_unstale":"2023-10-14T18:50:45.820166+0000","last_undegraded":"2023-10-14T18:50:45.820166+0000","last_fullsized":"2023-10-14T18:50:45.820166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823730+0000","last_change":"2023-10-14T18:50:44.542020+0000","last_active":"2023-10-14T18:50:45.823730+0000","last_peered":"2023-10-14T18:50:45.823730+0000","last_clean":"2023-10-14T18:50:45.823730+0000","last_became_active":"2023-10-14T18:50:44.541797+0000","last_became_peered":"2023-10-14T18:50:44.541797+0000","last_unstale":"2023-10-14T18:50:45.823730+0000","last_undegraded":"2023-10-14T18:50:45.823730+0000","last_fullsized":"2023-10-14T18:50:45.823730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819733+0000","last_change":"2023-10-14T18:50:45.817742+0000","last_active":"2023-10-14T18:50:45.819733+0000","last_peered":"2023-10-14T18:50:45.819733+0000","last_clean":"2023-10-14T18:50:45.819733+0000","last_became_active":"2023-10-14T18:50:45.816928+0000","last_became_peered":"2023-10-14T18:50:45.816928+0000","last_unstale":"2023-10-14T18:50:45.819733+0000","last_undegraded":"2023-10-14T18:50:45.819733+0000","last_fullsized":"2023-10-14T18:50:45.819733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:57.920593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818242+0000","last_change":"2023-10-14T18:50:44.547856+0000","last_active":"2023-10-14T18:50:45.818242+0000","last_peered":"2023-10-14T18:50:45.818242+0000","last_clean":"2023-10-14T18:50:45.818242+0000","last_became_active":"2023-10-14T18:50:44.547592+0000","last_became_peered":"2023-10-14T18:50:44.547592+0000","last_unstale":"2023-10-14T18:50:45.818242+0000","last_undegraded":"2023-10-14T18:50:45.818242+0000","last_fullsized":"2023-10-14T18:50:45.818242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:01.487859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823012+0000","last_change":"2023-10-14T18:50:45.821544+0000","last_active":"2023-10-14T18:50:45.823012+0000","last_peered":"2023-10-14T18:50:45.823012+0000","last_clean":"2023-10-14T18:50:45.823012+0000","last_became_active":"2023-10-14T18:50:45.821241+0000","last_became_peered":"2023-10-14T18:50:45.821241+0000","last_unstale":"2023-10-14T18:50:45.823012+0000","last_undegraded":"2023-10-14T18:50:45.823012+0000","last_fullsized":"2023-10-14T18:50:45.823012+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:35.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829131+0000","last_change":"2023-10-14T18:50:44.545684+0000","last_active":"2023-10-14T18:50:45.829131+0000","last_peered":"2023-10-14T18:50:45.829131+0000","last_clean":"2023-10-14T18:50:45.829131+0000","last_became_active":"2023-10-14T18:50:44.545025+0000","last_became_peered":"2023-10-14T18:50:44.545025+0000","last_unstale":"2023-10-14T18:50:45.829131+0000","last_undegraded":"2023-10-14T18:50:45.829131+0000","last_fullsized":"2023-10-14T18:50:45.829131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:50.517495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822977+0000","last_change":"2023-10-14T18:50:45.820978+0000","last_active":"2023-10-14T18:50:45.822977+0000","last_peered":"2023-10-14T18:50:45.822977+0000","last_clean":"2023-10-14T18:50:45.822977+0000","last_became_active":"2023-10-14T18:50:45.820721+0000","last_became_peered":"2023-10-14T18:50:45.820721+0000","last_unstale":"2023-10-14T18:50:45.822977+0000","last_undegraded":"2023-10-14T18:50:45.822977+0000","last_fullsized":"2023-10-14T18:50:45.822977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:51.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812794+0000","last_change":"2023-10-14T18:50:44.544194+0000","last_active":"2023-10-14T18:50:45.812794+0000","last_peered":"2023-10-14T18:50:45.812794+0000","last_clean":"2023-10-14T18:50:45.812794+0000","last_became_active":"2023-10-14T18:50:44.543942+0000","last_became_peered":"2023-10-14T18:50:44.543942+0000","last_unstale":"2023-10-14T18:50:45.812794+0000","last_undegraded":"2023-10-14T18:50:45.812794+0000","last_fullsized":"2023-10-14T18:50:45.812794+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822994+0000","last_change":"2023-10-14T18:50:45.821162+0000","last_active":"2023-10-14T18:50:45.822994+0000","last_peered":"2023-10-14T18:50:45.822994+0000","last_clean":"2023-10-14T18:50:45.822994+0000","last_became_active":"2023-10-14T18:50:45.820913+0000","last_became_peered":"2023-10-14T18:50:45.820913+0000","last_unstale":"2023-10-14T18:50:45.822994+0000","last_undegraded":"2023-10-14T18:50:45.822994+0000","last_fullsized":"2023-10-14T18:50:45.822994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:02.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812909+0000","last_change":"2023-10-14T18:50:44.542926+0000","last_active":"2023-10-14T18:50:45.812909+0000","last_peered":"2023-10-14T18:50:45.812909+0000","last_clean":"2023-10-14T18:50:45.812909+0000","last_became_active":"2023-10-14T18:50:44.542667+0000","last_became_peered":"2023-10-14T18:50:44.542667+0000","last_unstale":"2023-10-14T18:50:45.812909+0000","last_undegraded":"2023-10-14T18:50:45.812909+0000","last_fullsized":"2023-10-14T18:50:45.812909+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827495+0000","last_change":"2023-10-14T18:50:45.827448+0000","last_active":"2023-10-14T18:50:45.827495+0000","last_peered":"2023-10-14T18:50:45.827495+0000","last_clean":"2023-10-14T18:50:45.827495+0000","last_became_active":"2023-10-14T18:50:45.827278+0000","last_became_peered":"2023-10-14T18:50:45.827278+0000","last_unstale":"2023-10-14T18:50:45.827495+0000","last_undegraded":"2023-10-14T18:50:45.827495+0000","last_fullsized":"2023-10-14T18:50:45.827495+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814987+0000","last_change":"2023-10-14T18:50:44.540631+0000","last_active":"2023-10-14T18:50:45.814987+0000","last_peered":"2023-10-14T18:50:45.814987+0000","last_clean":"2023-10-14T18:50:45.814987+0000","last_became_active":"2023-10-14T18:50:44.540385+0000","last_became_peered":"2023-10-14T18:50:44.540385+0000","last_unstale":"2023-10-14T18:50:45.814987+0000","last_undegraded":"2023-10-14T18:50:45.814987+0000","last_fullsized":"2023-10-14T18:50:45.814987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:48.403019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825436+0000","last_change":"2023-10-14T18:50:45.820760+0000","last_active":"2023-10-14T18:50:45.825436+0000","last_peered":"2023-10-14T18:50:45.825436+0000","last_clean":"2023-10-14T18:50:45.825436+0000","last_became_active":"2023-10-14T18:50:45.820460+0000","last_became_peered":"2023-10-14T18:50:45.820460+0000","last_unstale":"2023-10-14T18:50:45.825436+0000","last_undegraded":"2023-10-14T18:50:45.825436+0000","last_fullsized":"2023-10-14T18:50:45.825436+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:22.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826286+0000","last_change":"2023-10-14T18:50:44.545233+0000","last_active":"2023-10-14T18:50:45.826286+0000","last_peered":"2023-10-14T18:50:45.826286+0000","last_clean":"2023-10-14T18:50:45.826286+0000","last_became_active":"2023-10-14T18:50:44.544792+0000","last_became_peered":"2023-10-14T18:50:44.544792+0000","last_unstale":"2023-10-14T18:50:45.826286+0000","last_undegraded":"2023-10-14T18:50:45.826286+0000","last_fullsized":"2023-10-14T18:50:45.826286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815781+0000","last_change":"2023-10-14T18:50:45.815713+0000","last_active":"2023-10-14T18:50:45.815781+0000","last_peered":"2023-10-14T18:50:45.815781+0000","last_clean":"2023-10-14T18:50:45.815781+0000","last_became_active":"2023-10-14T18:50:45.815482+0000","last_became_peered":"2023-10-14T18:50:45.815482+0000","last_unstale":"2023-10-14T18:50:45.815781+0000","last_undegraded":"2023-10-14T18:50:45.815781+0000","last_fullsized":"2023-10-14T18:50:45.815781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:30.361127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813816+0000","last_change":"2023-10-14T18:50:44.545553+0000","last_active":"2023-10-14T18:50:45.813816+0000","last_peered":"2023-10-14T18:50:45.813816+0000","last_clean":"2023-10-14T18:50:45.813816+0000","last_became_active":"2023-10-14T18:50:44.544744+0000","last_became_peered":"2023-10-14T18:50:44.544744+0000","last_unstale":"2023-10-14T18:50:45.813816+0000","last_undegraded":"2023-10-14T18:50:45.813816+0000","last_fullsized":"2023-10-14T18:50:45.813816+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:50.784388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819761+0000","last_change":"2023-10-14T18:50:45.817923+0000","last_active":"2023-10-14T18:50:45.819761+0000","last_peered":"2023-10-14T18:50:45.819761+0000","last_clean":"2023-10-14T18:50:45.819761+0000","last_became_active":"2023-10-14T18:50:45.817729+0000","last_became_peered":"2023-10-14T18:50:45.817729+0000","last_unstale":"2023-10-14T18:50:45.819761+0000","last_undegraded":"2023-10-14T18:50:45.819761+0000","last_fullsized":"2023-10-14T18:50:45.819761+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812620+0000","last_change":"2023-10-14T18:50:44.548701+0000","last_active":"2023-10-14T18:50:45.812620+0000","last_peered":"2023-10-14T18:50:45.812620+0000","last_clean":"2023-10-14T18:50:45.812620+0000","last_became_active":"2023-10-14T18:50:44.548107+0000","last_became_peered":"2023-10-14T18:50:44.548107+0000","last_unstale":"2023-10-14T18:50:45.812620+0000","last_undegraded":"2023-10-14T18:50:45.812620+0000","last_fullsized":"2023-10-14T18:50:45.812620+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:50.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822419+0000","last_change":"2023-10-14T18:50:45.821848+0000","last_active":"2023-10-14T18:50:45.822419+0000","last_peered":"2023-10-14T18:50:45.822419+0000","last_clean":"2023-10-14T18:50:45.822419+0000","last_became_active":"2023-10-14T18:50:45.821632+0000","last_became_peered":"2023-10-14T18:50:45.821632+0000","last_unstale":"2023-10-14T18:50:45.822419+0000","last_undegraded":"2023-10-14T18:50:45.822419+0000","last_fullsized":"2023-10-14T18:50:45.822419+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810729+0000","last_change":"2023-10-14T18:50:44.541670+0000","last_active":"2023-10-14T18:50:45.810729+0000","last_peered":"2023-10-14T18:50:45.810729+0000","last_clean":"2023-10-14T18:50:45.810729+0000","last_became_active":"2023-10-14T18:50:44.541267+0000","last_became_peered":"2023-10-14T18:50:44.541267+0000","last_unstale":"2023-10-14T18:50:45.810729+0000","last_undegraded":"2023-10-14T18:50:45.810729+0000","last_fullsized":"2023-10-14T18:50:45.810729+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817860+0000","last_change":"2023-10-14T18:50:45.817785+0000","last_active":"2023-10-14T18:50:45.817860+0000","last_peered":"2023-10-14T18:50:45.817860+0000","last_clean":"2023-10-14T18:50:45.817860+0000","last_became_active":"2023-10-14T18:50:45.817268+0000","last_became_peered":"2023-10-14T18:50:45.817268+0000","last_unstale":"2023-10-14T18:50:45.817860+0000","last_undegraded":"2023-10-14T18:50:45.817860+0000","last_fullsized":"2023-10-14T18:50:45.817860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:22:22.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815073+0000","last_change":"2023-10-14T18:50:44.539950+0000","last_active":"2023-10-14T18:50:45.815073+0000","last_peered":"2023-10-14T18:50:45.815073+0000","last_clean":"2023-10-14T18:50:45.815073+0000","last_became_active":"2023-10-14T18:50:44.539282+0000","last_became_peered":"2023-10-14T18:50:44.539282+0000","last_unstale":"2023-10-14T18:50:45.815073+0000","last_undegraded":"2023-10-14T18:50:45.815073+0000","last_fullsized":"2023-10-14T18:50:45.815073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:18.987531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819244+0000","last_change":"2023-10-14T18:50:45.819015+0000","last_active":"2023-10-14T18:50:45.819244+0000","last_peered":"2023-10-14T18:50:45.819244+0000","last_clean":"2023-10-14T18:50:45.819244+0000","last_became_active":"2023-10-14T18:50:45.818786+0000","last_became_peered":"2023-10-14T18:50:45.818786+0000","last_unstale":"2023-10-14T18:50:45.819244+0000","last_undegraded":"2023-10-14T18:50:45.819244+0000","last_fullsized":"2023-10-14T18:50:45.819244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810928+0000","last_change":"2023-10-14T18:50:44.542847+0000","last_active":"2023-10-14T18:50:45.810928+0000","last_peered":"2023-10-14T18:50:45.810928+0000","last_clean":"2023-10-14T18:50:45.810928+0000","last_became_active":"2023-10-14T18:50:44.542585+0000","last_became_peered":"2023-10-14T18:50:44.542585+0000","last_unstale":"2023-10-14T18:50:45.810928+0000","last_undegraded":"2023-10-14T18:50:45.810928+0000","last_fullsized":"2023-10-14T18:50:45.810928+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817547+0000","last_change":"2023-10-14T18:50:45.817468+0000","last_active":"2023-10-14T18:50:45.817547+0000","last_peered":"2023-10-14T18:50:45.817547+0000","last_clean":"2023-10-14T18:50:45.817547+0000","last_became_active":"2023-10-14T18:50:45.817236+0000","last_became_peered":"2023-10-14T18:50:45.817236+0000","last_unstale":"2023-10-14T18:50:45.817547+0000","last_undegraded":"2023-10-14T18:50:45.817547+0000","last_fullsized":"2023-10-14T18:50:45.817547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:02.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815412+0000","last_change":"2023-10-14T18:50:44.540475+0000","last_active":"2023-10-14T18:50:45.815412+0000","last_peered":"2023-10-14T18:50:45.815412+0000","last_clean":"2023-10-14T18:50:45.815412+0000","last_became_active":"2023-10-14T18:50:44.540267+0000","last_became_peered":"2023-10-14T18:50:44.540267+0000","last_unstale":"2023-10-14T18:50:45.815412+0000","last_undegraded":"2023-10-14T18:50:45.815412+0000","last_fullsized":"2023-10-14T18:50:45.815412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823498+0000","last_change":"2023-10-14T18:50:45.823412+0000","last_active":"2023-10-14T18:50:45.823498+0000","last_peered":"2023-10-14T18:50:45.823498+0000","last_clean":"2023-10-14T18:50:45.823498+0000","last_became_active":"2023-10-14T18:50:45.822978+0000","last_became_peered":"2023-10-14T18:50:45.822978+0000","last_unstale":"2023-10-14T18:50:45.823498+0000","last_undegraded":"2023-10-14T18:50:45.823498+0000","last_fullsized":"2023-10-14T18:50:45.823498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813898+0000","last_change":"2023-10-14T18:50:44.547653+0000","last_active":"2023-10-14T18:50:45.813898+0000","last_peered":"2023-10-14T18:50:45.813898+0000","last_clean":"2023-10-14T18:50:45.813898+0000","last_became_active":"2023-10-14T18:50:44.547471+0000","last_became_peered":"2023-10-14T18:50:44.547471+0000","last_unstale":"2023-10-14T18:50:45.813898+0000","last_undegraded":"2023-10-14T18:50:45.813898+0000","last_fullsized":"2023-10-14T18:50:45.813898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:04.600759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823026+0000","last_change":"2023-10-14T18:50:45.822597+0000","last_active":"2023-10-14T18:50:45.823026+0000","last_peered":"2023-10-14T18:50:45.823026+0000","last_clean":"2023-10-14T18:50:45.823026+0000","last_became_active":"2023-10-14T18:50:45.822394+0000","last_became_peered":"2023-10-14T18:50:45.822394+0000","last_unstale":"2023-10-14T18:50:45.823026+0000","last_undegraded":"2023-10-14T18:50:45.823026+0000","last_fullsized":"2023-10-14T18:50:45.823026+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:31.776666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826201+0000","last_change":"2023-10-14T18:50:44.540458+0000","last_active":"2023-10-14T18:50:45.826201+0000","last_peered":"2023-10-14T18:50:45.826201+0000","last_clean":"2023-10-14T18:50:45.826201+0000","last_became_active":"2023-10-14T18:50:44.540085+0000","last_became_peered":"2023-10-14T18:50:44.540085+0000","last_unstale":"2023-10-14T18:50:45.826201+0000","last_undegraded":"2023-10-14T18:50:45.826201+0000","last_fullsized":"2023-10-14T18:50:45.826201+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:29:26.970279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":266,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809981+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:50:45.809981+0000","last_peered":"2023-10-14T18:50:45.809981+0000","last_clean":"2023-10-14T18:50:45.809981+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:50:45.809981+0000","last_undegraded":"2023-10-14T18:50:45.809981+0000","last_fullsized":"2023-10-14T18:50:45.809981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194077,"statfs":{"total":200000000,"available":198735326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.63900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.78100000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.82799999999999996},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70299999999999996,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.65400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.63},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40799999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.877,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325182,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.871},"min":{"1min":0.372,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47099999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.443},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73399999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64200000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.627},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55700000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.22800000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.501,"15min":0.75700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":10.574,"15min":10.574},"last":0.311},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64000000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.29299999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88700000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1234,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194078,"statfs":{"total":200000000,"available":198735895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55700000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.248},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54700000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.372},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.35999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53900000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88500000000000001,"5min":1.01,"15min":1.01},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90700000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.56499999999999995},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.497}]}]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.35599999999999998,"15min":0.33300000000000002},"min":{"1min":0.217,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51500000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55900000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.006,"15min":1.006},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.251,"15min":0.251},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.53800000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.60699999999999998},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.77800000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.621},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23300000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46000000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33400000000000002},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.25900000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47799999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.312},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.307,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35399999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84199999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54000000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.71599999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.999,"15min":0.999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.75900000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.748},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.872,"15min":0.872},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325736,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.623}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.748,"15min":0.748},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.64300000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52100000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:54.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:50:54.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.495+0000 7f570939d700 1 Processor -- start 2023-10-14T18:50:54.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.495+0000 7f570939d700 1 -- start start 2023-10-14T18:50:54.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f570939d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57040cd6e0 0x7f57040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f570939d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57040cb7c0 con 0x7f570415cbd0 2023-10-14T18:50:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f570939d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570415e290 con 0x7f57040cdab0 2023-10-14T18:50:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f570939d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570415e850 con 0x7f57040cd6e0 2023-10-14T18:50:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5708b9c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f570415cbd0 0x7f570415d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38186/0 (socket says 172.21.15.79:38186) 2023-10-14T18:50:54.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5708b9c700 1 -- 172.21.15.79:0/2090564179 learned_addr learned my addr 172.21.15.79:0/2090564179 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086466663 0 0) 0x7f57040cb7c0 con 0x7f570415cbd0 2023-10-14T18:50:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56ec003570 con 0x7f570415cbd0 2023-10-14T18:50:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5703fff700 1 --2- 172.21.15.79:0/2090564179 >> v2:172.21.15.144:3300/0 conn(0x7f57040cd6e0 0x7f57040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056556632 0 0) 0x7f56ec003570 con 0x7f570415cbd0 2023-10-14T18:50:54.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 >> v2:172.21.15.144:3300/0 conn(0x7f57040cd6e0 msgr2=0x7f57040cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 --2- 172.21.15.79:0/2090564179 >> v2:172.21.15.144:3300/0 conn(0x7f57040cd6e0 0x7f57040cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 >> v1:172.21.15.144:6789/0 conn(0x7f57040cdab0 legacy=0x7f570415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570415e570 con 0x7f570415cbd0 2023-10-14T18:50:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f56fc0017f0 con 0x7f570415cbd0 2023-10-14T18:50:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 >> v1:172.21.15.79:6789/0 conn(0x7f570415cbd0 legacy=0x7f570415d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec003a60 0x7f56ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f56ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ec0052e0 0x7f56ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570415e850 con 0x7f56ec004810 2023-10-14T18:50:54.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec00c190 con 0x7f56ec003a60 2023-10-14T18:50:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec00c350 con 0x7f56ec0052e0 2023-10-14T18:50:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f5703fff700 1 --2- 172.21.15.79:0/2090564179 >> v2:172.21.15.144:3300/0 conn(0x7f57040cd6e0 0x7f57040cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.496+0000 7f57037fe700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f56ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5708b9c700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ec0052e0 0x7f56ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5703fff700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec003a60 0x7f56ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 -- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ec0052e0 msgr2=0x7f56ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56ec0052e0 0x7f56ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 -- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec003a60 msgr2=0x7f56ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56ec003a60 0x7f56ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5708b9c700 1 -- 172.21.15.79:0/2090564179 reap_dead start 2023-10-14T18:50:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 -- 172.21.15.79:0/2090564179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec003570 con 0x7f56ec004810 2023-10-14T18:50:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f57037fe700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f56ec004c80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f56f80018b0 tx=0x7f56f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a07e8c8326956d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8012420 con 0x7f56ec004810 2023-10-14T18:50:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80125a0 con 0x7f56ec004810 2023-10-14T18:50:54.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.497+0000 7f5702ffd700 1 -- 172.21.15.79:0/2090564179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8012960 con 0x7f56ec004810 2023-10-14T18:50:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 -- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 msgr2=0x7f56ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f56ec004c80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f56f80018b0 tx=0x7f56f8007d30 comp rx=0 tx=0).stop 2023-10-14T18:50:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 -- 172.21.15.79:0/2090564179 shutdown_connections 2023-10-14T18:50:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 --2- 172.21.15.79:0/2090564179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f56ec004c80 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 -- 172.21.15.79:0/2090564179 >> 172.21.15.79:0/2090564179 conn(0x7f5704067660 msgr2=0x7f5704067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 -- 172.21.15.79:0/2090564179 shutdown_connections 2023-10-14T18:50:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.498+0000 7f570939d700 1 -- 172.21.15.79:0/2090564179 wait complete. 2023-10-14T18:50:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.499+0000 7f570939d700 1 Processor -- start 2023-10-14T18:50:54.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.499+0000 7f570939d700 1 -- start start 2023-10-14T18:50:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041586b0 0x7f57040c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f570416a490 0x7f57040b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040c8130 con 0x7f56ec004810 2023-10-14T18:50:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570416b430 con 0x7f57041586b0 2023-10-14T18:50:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570416ae70 con 0x7f570416a490 2023-10-14T18:50:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59524/0 (socket says 172.21.15.79:59524) 2023-10-14T18:50:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 -- 172.21.15.79:0/3240677782 learned_addr learned my addr 172.21.15.79:0/3240677782 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:54.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f57037fe700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041586b0 0x7f57040c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5708b9c700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f570416a490 0x7f57040b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 -- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f570416a490 msgr2=0x7f57040b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f570416a490 0x7f57040b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 -- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041586b0 msgr2=0x7f57040c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041586b0 0x7f57040c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 -- 172.21.15.79:0/3240677782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570416b150 con 0x7f56ec004810 2023-10-14T18:50:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f5703fff700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f56f40108d0 tx=0x7f56f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4014620 con 0x7f56ec004810 2023-10-14T18:50:54.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f400c050 con 0x7f56ec004810 2023-10-14T18:50:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57040c7dc0 con 0x7f56ec004810 2023-10-14T18:50:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4014990 con 0x7f56ec004810 2023-10-14T18:50:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.500+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570416a910 con 0x7f56ec004810 2023-10-14T18:50:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.501+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5704089280 con 0x7f56ec004810 2023-10-14T18:50:54.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.502+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56f4014d40 con 0x7f56ec004810 2023-10-14T18:50:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.502+0000 7f56ebfff700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 0x7f56f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.502+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56f4084790 con 0x7f56ec004810 2023-10-14T18:50:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.502+0000 7f57037fe700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 0x7f56f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.503+0000 7f57037fe700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 0x7f56f00693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f57040d0e80 tx=0x7f56f8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.507+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56f4055490 con 0x7f56ec004810 2023-10-14T18:50:54.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.691+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57040c8270 con 0x7f56f0066f30 2023-10-14T18:50:54.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.699+0000 7f56ebfff700 1 -- 172.21.15.79:0/3240677782 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285616 (secure 0 0 0) 0x7f56f8024070 con 0x7f56f0066f30 2023-10-14T18:50:54.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:54.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 msgr2=0x7f56f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 0x7f56f00693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f57040d0e80 tx=0x7f56f8015000 comp rx=0 tx=0).stop 2023-10-14T18:50:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 msgr2=0x7f57040ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f56f40108d0 tx=0x7f56f4008040 comp rx=0 tx=0).stop 2023-10-14T18:50:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 shutdown_connections 2023-10-14T18:50:54.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f56f0066f30 0x7f56f00693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f570416a490 0x7f57040b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec004810 0x7f57040ca780 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 --2- 172.21.15.79:0/3240677782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041586b0 0x7f57040c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.702+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 >> 172.21.15.79:0/3240677782 conn(0x7f5704067660 msgr2=0x7f57040b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:54.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.703+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 shutdown_connections 2023-10-14T18:50:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.703+0000 7f570939d700 1 -- 172.21.15.79:0/3240677782 wait complete. 2023-10-14T18:50:54.708 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:50:54.715 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-10-14T18:50:54.417013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556076,"statfs":{"total":1600000000,"available":1593422111,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.608343"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819785+0000","last_change":"2023-10-14T18:50:45.819576+0000","last_active":"2023-10-14T18:50:45.819785+0000","last_peered":"2023-10-14T18:50:45.819785+0000","last_clean":"2023-10-14T18:50:45.819785+0000","last_became_active":"2023-10-14T18:50:45.818658+0000","last_became_peered":"2023-10-14T18:50:45.818658+0000","last_unstale":"2023-10-14T18:50:45.819785+0000","last_undegraded":"2023-10-14T18:50:45.819785+0000","last_fullsized":"2023-10-14T18:50:45.819785+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828544+0000","last_change":"2023-10-14T18:50:45.828504+0000","last_active":"2023-10-14T18:50:45.828544+0000","last_peered":"2023-10-14T18:50:45.828544+0000","last_clean":"2023-10-14T18:50:45.828544+0000","last_became_active":"2023-10-14T18:50:45.827821+0000","last_became_peered":"2023-10-14T18:50:45.827821+0000","last_unstale":"2023-10-14T18:50:45.828544+0000","last_undegraded":"2023-10-14T18:50:45.828544+0000","last_fullsized":"2023-10-14T18:50:45.828544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:57:31.668664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814795+0000","last_change":"2023-10-14T18:50:45.814742+0000","last_active":"2023-10-14T18:50:45.814795+0000","last_peered":"2023-10-14T18:50:45.814795+0000","last_clean":"2023-10-14T18:50:45.814795+0000","last_became_active":"2023-10-14T18:50:45.814499+0000","last_became_peered":"2023-10-14T18:50:45.814499+0000","last_unstale":"2023-10-14T18:50:45.814795+0000","last_undegraded":"2023-10-14T18:50:45.814795+0000","last_fullsized":"2023-10-14T18:50:45.814795+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:37.911232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820881+0000","last_change":"2023-10-14T18:50:45.820759+0000","last_active":"2023-10-14T18:50:45.820881+0000","last_peered":"2023-10-14T18:50:45.820881+0000","last_clean":"2023-10-14T18:50:45.820881+0000","last_became_active":"2023-10-14T18:50:45.820207+0000","last_became_peered":"2023-10-14T18:50:45.820207+0000","last_unstale":"2023-10-14T18:50:45.820881+0000","last_undegraded":"2023-10-14T18:50:45.820881+0000","last_fullsized":"2023-10-14T18:50:45.820881+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820197+0000","last_change":"2023-10-14T18:50:45.820039+0000","last_active":"2023-10-14T18:50:45.820197+0000","last_peered":"2023-10-14T18:50:45.820197+0000","last_clean":"2023-10-14T18:50:45.820197+0000","last_became_active":"2023-10-14T18:50:45.819820+0000","last_became_peered":"2023-10-14T18:50:45.819820+0000","last_unstale":"2023-10-14T18:50:45.820197+0000","last_undegraded":"2023-10-14T18:50:45.820197+0000","last_fullsized":"2023-10-14T18:50:45.820197+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.816304+0000","last_change":"2023-10-14T18:50:45.815791+0000","last_active":"2023-10-14T18:50:45.816304+0000","last_peered":"2023-10-14T18:50:45.816304+0000","last_clean":"2023-10-14T18:50:45.816304+0000","last_became_active":"2023-10-14T18:50:45.815123+0000","last_became_peered":"2023-10-14T18:50:45.815123+0000","last_unstale":"2023-10-14T18:50:45.816304+0000","last_undegraded":"2023-10-14T18:50:45.816304+0000","last_fullsized":"2023-10-14T18:50:45.816304+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:42.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820409+0000","last_change":"2023-10-14T18:50:45.819869+0000","last_active":"2023-10-14T18:50:45.820409+0000","last_peered":"2023-10-14T18:50:45.820409+0000","last_clean":"2023-10-14T18:50:45.820409+0000","last_became_active":"2023-10-14T18:50:45.816982+0000","last_became_peered":"2023-10-14T18:50:45.816982+0000","last_unstale":"2023-10-14T18:50:45.820409+0000","last_undegraded":"2023-10-14T18:50:45.820409+0000","last_fullsized":"2023-10-14T18:50:45.820409+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820051+0000","last_change":"2023-10-14T18:50:45.819986+0000","last_active":"2023-10-14T18:50:45.820051+0000","last_peered":"2023-10-14T18:50:45.820051+0000","last_clean":"2023-10-14T18:50:45.820051+0000","last_became_active":"2023-10-14T18:50:45.818860+0000","last_became_peered":"2023-10-14T18:50:45.818860+0000","last_unstale":"2023-10-14T18:50:45.820051+0000","last_undegraded":"2023-10-14T18:50:45.820051+0000","last_fullsized":"2023-10-14T18:50:45.820051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:51.568633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824751+0000","last_change":"2023-10-14T18:50:45.824686+0000","last_active":"2023-10-14T18:50:45.824751+0000","last_peered":"2023-10-14T18:50:45.824751+0000","last_clean":"2023-10-14T18:50:45.824751+0000","last_became_active":"2023-10-14T18:50:45.824473+0000","last_became_peered":"2023-10-14T18:50:45.824473+0000","last_unstale":"2023-10-14T18:50:45.824751+0000","last_undegraded":"2023-10-14T18:50:45.824751+0000","last_fullsized":"2023-10-14T18:50:45.824751+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823467+0000","last_change":"2023-10-14T18:50:45.822903+0000","last_active":"2023-10-14T18:50:45.823467+0000","last_peered":"2023-10-14T18:50:45.823467+0000","last_clean":"2023-10-14T18:50:45.823467+0000","last_became_active":"2023-10-14T18:50:45.822620+0000","last_became_peered":"2023-10-14T18:50:45.822620+0000","last_unstale":"2023-10-14T18:50:45.823467+0000","last_undegraded":"2023-10-14T18:50:45.823467+0000","last_fullsized":"2023-10-14T18:50:45.823467+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:55:26.578321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819749+0000","last_change":"2023-10-14T18:50:45.817932+0000","last_active":"2023-10-14T18:50:45.819749+0000","last_peered":"2023-10-14T18:50:45.819749+0000","last_clean":"2023-10-14T18:50:45.819749+0000","last_became_active":"2023-10-14T18:50:45.817243+0000","last_became_peered":"2023-10-14T18:50:45.817243+0000","last_unstale":"2023-10-14T18:50:45.819749+0000","last_undegraded":"2023-10-14T18:50:45.819749+0000","last_fullsized":"2023-10-14T18:50:45.819749+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:22:18.916660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.824260+0000","last_change":"2023-10-14T18:50:45.824116+0000","last_active":"2023-10-14T18:50:45.824260+0000","last_peered":"2023-10-14T18:50:45.824260+0000","last_clean":"2023-10-14T18:50:45.824260+0000","last_became_active":"2023-10-14T18:50:45.823884+0000","last_became_peered":"2023-10-14T18:50:45.823884+0000","last_unstale":"2023-10-14T18:50:45.824260+0000","last_undegraded":"2023-10-14T18:50:45.824260+0000","last_fullsized":"2023-10-14T18:50:45.824260+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822133+0000","last_change":"2023-10-14T18:50:45.822055+0000","last_active":"2023-10-14T18:50:45.822133+0000","last_peered":"2023-10-14T18:50:45.822133+0000","last_clean":"2023-10-14T18:50:45.822133+0000","last_became_active":"2023-10-14T18:50:45.821167+0000","last_became_peered":"2023-10-14T18:50:45.821167+0000","last_unstale":"2023-10-14T18:50:45.822133+0000","last_undegraded":"2023-10-14T18:50:45.822133+0000","last_fullsized":"2023-10-14T18:50:45.822133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817154+0000","last_change":"2023-10-14T18:50:45.816793+0000","last_active":"2023-10-14T18:50:45.817154+0000","last_peered":"2023-10-14T18:50:45.817154+0000","last_clean":"2023-10-14T18:50:45.817154+0000","last_became_active":"2023-10-14T18:50:45.816382+0000","last_became_peered":"2023-10-14T18:50:45.816382+0000","last_unstale":"2023-10-14T18:50:45.817154+0000","last_undegraded":"2023-10-14T18:50:45.817154+0000","last_fullsized":"2023-10-14T18:50:45.817154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:02:08.547770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826697+0000","last_change":"2023-10-14T18:50:45.826633+0000","last_active":"2023-10-14T18:50:45.826697+0000","last_peered":"2023-10-14T18:50:45.826697+0000","last_clean":"2023-10-14T18:50:45.826697+0000","last_became_active":"2023-10-14T18:50:45.826107+0000","last_became_peered":"2023-10-14T18:50:45.826107+0000","last_unstale":"2023-10-14T18:50:45.826697+0000","last_undegraded":"2023-10-14T18:50:45.826697+0000","last_fullsized":"2023-10-14T18:50:45.826697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819717+0000","last_change":"2023-10-14T18:50:45.817606+0000","last_active":"2023-10-14T18:50:45.819717+0000","last_peered":"2023-10-14T18:50:45.819717+0000","last_clean":"2023-10-14T18:50:45.819717+0000","last_became_active":"2023-10-14T18:50:45.816570+0000","last_became_peered":"2023-10-14T18:50:45.816570+0000","last_unstale":"2023-10-14T18:50:45.819717+0000","last_undegraded":"2023-10-14T18:50:45.819717+0000","last_fullsized":"2023-10-14T18:50:45.819717+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819333+0000","last_change":"2023-10-14T18:50:45.819234+0000","last_active":"2023-10-14T18:50:45.819333+0000","last_peered":"2023-10-14T18:50:45.819333+0000","last_clean":"2023-10-14T18:50:45.819333+0000","last_became_active":"2023-10-14T18:50:45.819008+0000","last_became_peered":"2023-10-14T18:50:45.819008+0000","last_unstale":"2023-10-14T18:50:45.819333+0000","last_undegraded":"2023-10-14T18:50:45.819333+0000","last_fullsized":"2023-10-14T18:50:45.819333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:10.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822360+0000","last_change":"2023-10-14T18:50:45.822312+0000","last_active":"2023-10-14T18:50:45.822360+0000","last_peered":"2023-10-14T18:50:45.822360+0000","last_clean":"2023-10-14T18:50:45.822360+0000","last_became_active":"2023-10-14T18:50:45.821835+0000","last_became_peered":"2023-10-14T18:50:45.821835+0000","last_unstale":"2023-10-14T18:50:45.822360+0000","last_undegraded":"2023-10-14T18:50:45.822360+0000","last_fullsized":"2023-10-14T18:50:45.822360+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:42.711227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822959+0000","last_change":"2023-10-14T18:50:45.820969+0000","last_active":"2023-10-14T18:50:45.822959+0000","last_peered":"2023-10-14T18:50:45.822959+0000","last_clean":"2023-10-14T18:50:45.822959+0000","last_became_active":"2023-10-14T18:50:45.820670+0000","last_became_peered":"2023-10-14T18:50:45.820670+0000","last_unstale":"2023-10-14T18:50:45.822959+0000","last_undegraded":"2023-10-14T18:50:45.822959+0000","last_fullsized":"2023-10-14T18:50:45.822959+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:56.359682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823528+0000","last_change":"2023-10-14T18:50:45.822620+0000","last_active":"2023-10-14T18:50:45.823528+0000","last_peered":"2023-10-14T18:50:45.823528+0000","last_clean":"2023-10-14T18:50:45.823528+0000","last_became_active":"2023-10-14T18:50:45.822254+0000","last_became_peered":"2023-10-14T18:50:45.822254+0000","last_unstale":"2023-10-14T18:50:45.823528+0000","last_undegraded":"2023-10-14T18:50:45.823528+0000","last_fullsized":"2023-10-14T18:50:45.823528+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:19.989382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818120+0000","last_change":"2023-10-14T18:50:45.818062+0000","last_active":"2023-10-14T18:50:45.818120+0000","last_peered":"2023-10-14T18:50:45.818120+0000","last_clean":"2023-10-14T18:50:45.818120+0000","last_became_active":"2023-10-14T18:50:45.817814+0000","last_became_peered":"2023-10-14T18:50:45.817814+0000","last_unstale":"2023-10-14T18:50:45.818120+0000","last_undegraded":"2023-10-14T18:50:45.818120+0000","last_fullsized":"2023-10-14T18:50:45.818120+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:25:52.081054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828637+0000","last_change":"2023-10-14T18:50:45.828590+0000","last_active":"2023-10-14T18:50:45.828637+0000","last_peered":"2023-10-14T18:50:45.828637+0000","last_clean":"2023-10-14T18:50:45.828637+0000","last_became_active":"2023-10-14T18:50:45.828082+0000","last_became_peered":"2023-10-14T18:50:45.828082+0000","last_unstale":"2023-10-14T18:50:45.828637+0000","last_undegraded":"2023-10-14T18:50:45.828637+0000","last_fullsized":"2023-10-14T18:50:45.828637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:14.870008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820702+0000","last_change":"2023-10-14T18:50:45.820637+0000","last_active":"2023-10-14T18:50:45.820702+0000","last_peered":"2023-10-14T18:50:45.820702+0000","last_clean":"2023-10-14T18:50:45.820702+0000","last_became_active":"2023-10-14T18:50:45.820205+0000","last_became_peered":"2023-10-14T18:50:45.820205+0000","last_unstale":"2023-10-14T18:50:45.820702+0000","last_undegraded":"2023-10-14T18:50:45.820702+0000","last_fullsized":"2023-10-14T18:50:45.820702+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:16.464393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.811977+0000","last_change":"2023-10-14T18:50:45.811813+0000","last_active":"2023-10-14T18:50:45.811977+0000","last_peered":"2023-10-14T18:50:45.811977+0000","last_clean":"2023-10-14T18:50:45.811977+0000","last_became_active":"2023-10-14T18:50:45.811573+0000","last_became_peered":"2023-10-14T18:50:45.811573+0000","last_unstale":"2023-10-14T18:50:45.811977+0000","last_undegraded":"2023-10-14T18:50:45.811977+0000","last_fullsized":"2023-10-14T18:50:45.811977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819121+0000","last_change":"2023-10-14T18:50:45.819032+0000","last_active":"2023-10-14T18:50:45.819121+0000","last_peered":"2023-10-14T18:50:45.819121+0000","last_clean":"2023-10-14T18:50:45.819121+0000","last_became_active":"2023-10-14T18:50:45.818759+0000","last_became_peered":"2023-10-14T18:50:45.818759+0000","last_unstale":"2023-10-14T18:50:45.819121+0000","last_undegraded":"2023-10-14T18:50:45.819121+0000","last_fullsized":"2023-10-14T18:50:45.819121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827589+0000","last_change":"2023-10-14T18:50:45.827528+0000","last_active":"2023-10-14T18:50:45.827589+0000","last_peered":"2023-10-14T18:50:45.827589+0000","last_clean":"2023-10-14T18:50:45.827589+0000","last_became_active":"2023-10-14T18:50:45.827086+0000","last_became_peered":"2023-10-14T18:50:45.827086+0000","last_unstale":"2023-10-14T18:50:45.827589+0000","last_undegraded":"2023-10-14T18:50:45.827589+0000","last_fullsized":"2023-10-14T18:50:45.827589+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:27:08.753906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819698+0000","last_change":"2023-10-14T18:50:45.817224+0000","last_active":"2023-10-14T18:50:45.819698+0000","last_peered":"2023-10-14T18:50:45.819698+0000","last_clean":"2023-10-14T18:50:45.819698+0000","last_became_active":"2023-10-14T18:50:45.816658+0000","last_became_peered":"2023-10-14T18:50:45.816658+0000","last_unstale":"2023-10-14T18:50:45.819698+0000","last_undegraded":"2023-10-14T18:50:45.819698+0000","last_fullsized":"2023-10-14T18:50:45.819698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:01.362001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823484+0000","last_change":"2023-10-14T18:50:45.823278+0000","last_active":"2023-10-14T18:50:45.823484+0000","last_peered":"2023-10-14T18:50:45.823484+0000","last_clean":"2023-10-14T18:50:45.823484+0000","last_became_active":"2023-10-14T18:50:45.822659+0000","last_became_peered":"2023-10-14T18:50:45.822659+0000","last_unstale":"2023-10-14T18:50:45.823484+0000","last_undegraded":"2023-10-14T18:50:45.823484+0000","last_fullsized":"2023-10-14T18:50:45.823484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:55.973887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826351+0000","last_change":"2023-10-14T18:50:45.826298+0000","last_active":"2023-10-14T18:50:45.826351+0000","last_peered":"2023-10-14T18:50:45.826351+0000","last_clean":"2023-10-14T18:50:45.826351+0000","last_became_active":"2023-10-14T18:50:45.826171+0000","last_became_peered":"2023-10-14T18:50:45.826171+0000","last_unstale":"2023-10-14T18:50:45.826351+0000","last_undegraded":"2023-10-14T18:50:45.826351+0000","last_fullsized":"2023-10-14T18:50:45.826351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:30.600160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826874+0000","last_change":"2023-10-14T18:50:45.826700+0000","last_active":"2023-10-14T18:50:45.826874+0000","last_peered":"2023-10-14T18:50:45.826874+0000","last_clean":"2023-10-14T18:50:45.826874+0000","last_became_active":"2023-10-14T18:50:45.826364+0000","last_became_peered":"2023-10-14T18:50:45.826364+0000","last_unstale":"2023-10-14T18:50:45.826874+0000","last_undegraded":"2023-10-14T18:50:45.826874+0000","last_fullsized":"2023-10-14T18:50:45.826874+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:18.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820850+0000","last_change":"2023-10-14T18:50:45.820309+0000","last_active":"2023-10-14T18:50:45.820850+0000","last_peered":"2023-10-14T18:50:45.820850+0000","last_clean":"2023-10-14T18:50:45.820850+0000","last_became_active":"2023-10-14T18:50:45.819980+0000","last_became_peered":"2023-10-14T18:50:45.819980+0000","last_unstale":"2023-10-14T18:50:45.820850+0000","last_undegraded":"2023-10-14T18:50:45.820850+0000","last_fullsized":"2023-10-14T18:50:45.820850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822406+0000","last_change":"2023-10-14T18:50:45.822017+0000","last_active":"2023-10-14T18:50:45.822406+0000","last_peered":"2023-10-14T18:50:45.822406+0000","last_clean":"2023-10-14T18:50:45.822406+0000","last_became_active":"2023-10-14T18:50:45.821809+0000","last_became_peered":"2023-10-14T18:50:45.821809+0000","last_unstale":"2023-10-14T18:50:45.822406+0000","last_undegraded":"2023-10-14T18:50:45.822406+0000","last_fullsized":"2023-10-14T18:50:45.822406+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:33.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817138+0000","last_change":"2023-10-14T18:50:45.816656+0000","last_active":"2023-10-14T18:50:45.817138+0000","last_peered":"2023-10-14T18:50:45.817138+0000","last_clean":"2023-10-14T18:50:45.817138+0000","last_became_active":"2023-10-14T18:50:45.816127+0000","last_became_peered":"2023-10-14T18:50:45.816127+0000","last_unstale":"2023-10-14T18:50:45.817138+0000","last_undegraded":"2023-10-14T18:50:45.817138+0000","last_fullsized":"2023-10-14T18:50:45.817138+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:52:40.585030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829493+0000","last_change":"2023-10-14T18:50:44.545811+0000","last_active":"2023-10-14T18:50:45.829493+0000","last_peered":"2023-10-14T18:50:45.829493+0000","last_clean":"2023-10-14T18:50:45.829493+0000","last_became_active":"2023-10-14T18:50:44.545344+0000","last_became_peered":"2023-10-14T18:50:44.545344+0000","last_unstale":"2023-10-14T18:50:45.829493+0000","last_undegraded":"2023-10-14T18:50:45.829493+0000","last_fullsized":"2023-10-14T18:50:45.829493+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:56:54.972036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822235+0000","last_change":"2023-10-14T18:50:45.822186+0000","last_active":"2023-10-14T18:50:45.822235+0000","last_peered":"2023-10-14T18:50:45.822235+0000","last_clean":"2023-10-14T18:50:45.822235+0000","last_became_active":"2023-10-14T18:50:45.821552+0000","last_became_peered":"2023-10-14T18:50:45.821552+0000","last_unstale":"2023-10-14T18:50:45.822235+0000","last_undegraded":"2023-10-14T18:50:45.822235+0000","last_fullsized":"2023-10-14T18:50:45.822235+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:41.777895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827447+0000","last_change":"2023-10-14T18:50:44.540309+0000","last_active":"2023-10-14T18:50:45.827447+0000","last_peered":"2023-10-14T18:50:45.827447+0000","last_clean":"2023-10-14T18:50:45.827447+0000","last_became_active":"2023-10-14T18:50:44.539792+0000","last_became_peered":"2023-10-14T18:50:44.539792+0000","last_unstale":"2023-10-14T18:50:45.827447+0000","last_undegraded":"2023-10-14T18:50:45.827447+0000","last_fullsized":"2023-10-14T18:50:45.827447+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:50:16.639029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820145+0000","last_change":"2023-10-14T18:50:45.819750+0000","last_active":"2023-10-14T18:50:45.820145+0000","last_peered":"2023-10-14T18:50:45.820145+0000","last_clean":"2023-10-14T18:50:45.820145+0000","last_became_active":"2023-10-14T18:50:45.819359+0000","last_became_peered":"2023-10-14T18:50:45.819359+0000","last_unstale":"2023-10-14T18:50:45.820145+0000","last_undegraded":"2023-10-14T18:50:45.820145+0000","last_fullsized":"2023-10-14T18:50:45.820145+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:05.181656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825610+0000","last_change":"2023-10-14T18:50:44.539788+0000","last_active":"2023-10-14T18:50:45.825610+0000","last_peered":"2023-10-14T18:50:45.825610+0000","last_clean":"2023-10-14T18:50:45.825610+0000","last_became_active":"2023-10-14T18:50:44.539503+0000","last_became_peered":"2023-10-14T18:50:44.539503+0000","last_unstale":"2023-10-14T18:50:45.825610+0000","last_undegraded":"2023-10-14T18:50:45.825610+0000","last_fullsized":"2023-10-14T18:50:45.825610+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:10.032267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822612+0000","last_change":"2023-10-14T18:50:45.822481+0000","last_active":"2023-10-14T18:50:45.822612+0000","last_peered":"2023-10-14T18:50:45.822612+0000","last_clean":"2023-10-14T18:50:45.822612+0000","last_became_active":"2023-10-14T18:50:45.821679+0000","last_became_peered":"2023-10-14T18:50:45.821679+0000","last_unstale":"2023-10-14T18:50:45.822612+0000","last_undegraded":"2023-10-14T18:50:45.822612+0000","last_fullsized":"2023-10-14T18:50:45.822612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827395+0000","last_change":"2023-10-14T18:50:44.547260+0000","last_active":"2023-10-14T18:50:45.827395+0000","last_peered":"2023-10-14T18:50:45.827395+0000","last_clean":"2023-10-14T18:50:45.827395+0000","last_became_active":"2023-10-14T18:50:44.547133+0000","last_became_peered":"2023-10-14T18:50:44.547133+0000","last_unstale":"2023-10-14T18:50:45.827395+0000","last_undegraded":"2023-10-14T18:50:45.827395+0000","last_fullsized":"2023-10-14T18:50:45.827395+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:00.360150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820141+0000","last_change":"2023-10-14T18:50:45.818964+0000","last_active":"2023-10-14T18:50:45.820141+0000","last_peered":"2023-10-14T18:50:45.820141+0000","last_clean":"2023-10-14T18:50:45.820141+0000","last_became_active":"2023-10-14T18:50:45.818739+0000","last_became_peered":"2023-10-14T18:50:45.818739+0000","last_unstale":"2023-10-14T18:50:45.820141+0000","last_undegraded":"2023-10-14T18:50:45.820141+0000","last_fullsized":"2023-10-14T18:50:45.820141+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:53.690616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827324+0000","last_change":"2023-10-14T18:50:44.544542+0000","last_active":"2023-10-14T18:50:45.827324+0000","last_peered":"2023-10-14T18:50:45.827324+0000","last_clean":"2023-10-14T18:50:45.827324+0000","last_became_active":"2023-10-14T18:50:44.543597+0000","last_became_peered":"2023-10-14T18:50:44.543597+0000","last_unstale":"2023-10-14T18:50:45.827324+0000","last_undegraded":"2023-10-14T18:50:45.827324+0000","last_fullsized":"2023-10-14T18:50:45.827324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:30:54.499443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820427+0000","last_change":"2023-10-14T18:50:45.820349+0000","last_active":"2023-10-14T18:50:45.820427+0000","last_peered":"2023-10-14T18:50:45.820427+0000","last_clean":"2023-10-14T18:50:45.820427+0000","last_became_active":"2023-10-14T18:50:45.820102+0000","last_became_peered":"2023-10-14T18:50:45.820102+0000","last_unstale":"2023-10-14T18:50:45.820427+0000","last_undegraded":"2023-10-14T18:50:45.820427+0000","last_fullsized":"2023-10-14T18:50:45.820427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829562+0000","last_change":"2023-10-14T18:50:44.546523+0000","last_active":"2023-10-14T18:50:45.829562+0000","last_peered":"2023-10-14T18:50:45.829562+0000","last_clean":"2023-10-14T18:50:45.829562+0000","last_became_active":"2023-10-14T18:50:44.546079+0000","last_became_peered":"2023-10-14T18:50:44.546079+0000","last_unstale":"2023-10-14T18:50:45.829562+0000","last_undegraded":"2023-10-14T18:50:45.829562+0000","last_fullsized":"2023-10-14T18:50:45.829562+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:23:40.776044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826828+0000","last_change":"2023-10-14T18:50:45.826768+0000","last_active":"2023-10-14T18:50:45.826828+0000","last_peered":"2023-10-14T18:50:45.826828+0000","last_clean":"2023-10-14T18:50:45.826828+0000","last_became_active":"2023-10-14T18:50:45.826421+0000","last_became_peered":"2023-10-14T18:50:45.826421+0000","last_unstale":"2023-10-14T18:50:45.826828+0000","last_undegraded":"2023-10-14T18:50:45.826828+0000","last_fullsized":"2023-10-14T18:50:45.826828+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812193+0000","last_change":"2023-10-14T18:50:44.542559+0000","last_active":"2023-10-14T18:50:45.812193+0000","last_peered":"2023-10-14T18:50:45.812193+0000","last_clean":"2023-10-14T18:50:45.812193+0000","last_became_active":"2023-10-14T18:50:44.542328+0000","last_became_peered":"2023-10-14T18:50:44.542328+0000","last_unstale":"2023-10-14T18:50:45.812193+0000","last_undegraded":"2023-10-14T18:50:45.812193+0000","last_fullsized":"2023-10-14T18:50:45.812193+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:29.393312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817111+0000","last_change":"2023-10-14T18:50:45.816987+0000","last_active":"2023-10-14T18:50:45.817111+0000","last_peered":"2023-10-14T18:50:45.817111+0000","last_clean":"2023-10-14T18:50:45.817111+0000","last_became_active":"2023-10-14T18:50:45.816739+0000","last_became_peered":"2023-10-14T18:50:45.816739+0000","last_unstale":"2023-10-14T18:50:45.817111+0000","last_undegraded":"2023-10-14T18:50:45.817111+0000","last_fullsized":"2023-10-14T18:50:45.817111+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:51.786238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809213+0000","last_change":"2023-10-14T18:50:44.542883+0000","last_active":"2023-10-14T18:50:45.809213+0000","last_peered":"2023-10-14T18:50:45.809213+0000","last_clean":"2023-10-14T18:50:45.809213+0000","last_became_active":"2023-10-14T18:50:44.542659+0000","last_became_peered":"2023-10-14T18:50:44.542659+0000","last_unstale":"2023-10-14T18:50:45.809213+0000","last_undegraded":"2023-10-14T18:50:45.809213+0000","last_fullsized":"2023-10-14T18:50:45.809213+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:55:43.270454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828772+0000","last_change":"2023-10-14T18:50:45.828700+0000","last_active":"2023-10-14T18:50:45.828772+0000","last_peered":"2023-10-14T18:50:45.828772+0000","last_clean":"2023-10-14T18:50:45.828772+0000","last_became_active":"2023-10-14T18:50:45.828351+0000","last_became_peered":"2023-10-14T18:50:45.828351+0000","last_unstale":"2023-10-14T18:50:45.828772+0000","last_undegraded":"2023-10-14T18:50:45.828772+0000","last_fullsized":"2023-10-14T18:50:45.828772+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:47:46.701116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809318+0000","last_change":"2023-10-14T18:50:44.544430+0000","last_active":"2023-10-14T18:50:45.809318+0000","last_peered":"2023-10-14T18:50:45.809318+0000","last_clean":"2023-10-14T18:50:45.809318+0000","last_became_active":"2023-10-14T18:50:44.543784+0000","last_became_peered":"2023-10-14T18:50:44.543784+0000","last_unstale":"2023-10-14T18:50:45.809318+0000","last_undegraded":"2023-10-14T18:50:45.809318+0000","last_fullsized":"2023-10-14T18:50:45.809318+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:47.975371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819225+0000","last_change":"2023-10-14T18:50:45.818536+0000","last_active":"2023-10-14T18:50:45.819225+0000","last_peered":"2023-10-14T18:50:45.819225+0000","last_clean":"2023-10-14T18:50:45.819225+0000","last_became_active":"2023-10-14T18:50:45.818041+0000","last_became_peered":"2023-10-14T18:50:45.818041+0000","last_unstale":"2023-10-14T18:50:45.819225+0000","last_undegraded":"2023-10-14T18:50:45.819225+0000","last_fullsized":"2023-10-14T18:50:45.819225+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:49.404870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813577+0000","last_change":"2023-10-14T18:50:44.536713+0000","last_active":"2023-10-14T18:50:45.813577+0000","last_peered":"2023-10-14T18:50:45.813577+0000","last_clean":"2023-10-14T18:50:45.813577+0000","last_became_active":"2023-10-14T18:50:44.536488+0000","last_became_peered":"2023-10-14T18:50:44.536488+0000","last_unstale":"2023-10-14T18:50:45.813577+0000","last_undegraded":"2023-10-14T18:50:45.813577+0000","last_fullsized":"2023-10-14T18:50:45.813577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822400+0000","last_change":"2023-10-14T18:50:45.821375+0000","last_active":"2023-10-14T18:50:45.822400+0000","last_peered":"2023-10-14T18:50:45.822400+0000","last_clean":"2023-10-14T18:50:45.822400+0000","last_became_active":"2023-10-14T18:50:45.819731+0000","last_became_peered":"2023-10-14T18:50:45.819731+0000","last_unstale":"2023-10-14T18:50:45.822400+0000","last_undegraded":"2023-10-14T18:50:45.822400+0000","last_fullsized":"2023-10-14T18:50:45.822400+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825807+0000","last_change":"2023-10-14T18:50:44.542109+0000","last_active":"2023-10-14T18:50:45.825807+0000","last_peered":"2023-10-14T18:50:45.825807+0000","last_clean":"2023-10-14T18:50:45.825807+0000","last_became_active":"2023-10-14T18:50:44.541891+0000","last_became_peered":"2023-10-14T18:50:44.541891+0000","last_unstale":"2023-10-14T18:50:45.825807+0000","last_undegraded":"2023-10-14T18:50:45.825807+0000","last_fullsized":"2023-10-14T18:50:45.825807+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817075+0000","last_change":"2023-10-14T18:50:45.817020+0000","last_active":"2023-10-14T18:50:45.817075+0000","last_peered":"2023-10-14T18:50:45.817075+0000","last_clean":"2023-10-14T18:50:45.817075+0000","last_became_active":"2023-10-14T18:50:45.816711+0000","last_became_peered":"2023-10-14T18:50:45.816711+0000","last_unstale":"2023-10-14T18:50:45.817075+0000","last_undegraded":"2023-10-14T18:50:45.817075+0000","last_fullsized":"2023-10-14T18:50:45.817075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.828804+0000","last_change":"2023-10-14T18:50:44.544803+0000","last_active":"2023-10-14T18:50:45.828804+0000","last_peered":"2023-10-14T18:50:45.828804+0000","last_clean":"2023-10-14T18:50:45.828804+0000","last_became_active":"2023-10-14T18:50:44.544586+0000","last_became_peered":"2023-10-14T18:50:44.544586+0000","last_unstale":"2023-10-14T18:50:45.828804+0000","last_undegraded":"2023-10-14T18:50:45.828804+0000","last_fullsized":"2023-10-14T18:50:45.828804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:04.179805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820815+0000","last_change":"2023-10-14T18:50:45.820183+0000","last_active":"2023-10-14T18:50:45.820815+0000","last_peered":"2023-10-14T18:50:45.820815+0000","last_clean":"2023-10-14T18:50:45.820815+0000","last_became_active":"2023-10-14T18:50:45.819649+0000","last_became_peered":"2023-10-14T18:50:45.819649+0000","last_unstale":"2023-10-14T18:50:45.820815+0000","last_undegraded":"2023-10-14T18:50:45.820815+0000","last_fullsized":"2023-10-14T18:50:45.820815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:41.657701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823079+0000","last_change":"2023-10-14T18:50:44.545892+0000","last_active":"2023-10-14T18:50:45.823079+0000","last_peered":"2023-10-14T18:50:45.823079+0000","last_clean":"2023-10-14T18:50:45.823079+0000","last_became_active":"2023-10-14T18:50:44.545675+0000","last_became_peered":"2023-10-14T18:50:44.545675+0000","last_unstale":"2023-10-14T18:50:45.823079+0000","last_undegraded":"2023-10-14T18:50:45.823079+0000","last_fullsized":"2023-10-14T18:50:45.823079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:52.384948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825660+0000","last_change":"2023-10-14T18:50:45.825425+0000","last_active":"2023-10-14T18:50:45.825660+0000","last_peered":"2023-10-14T18:50:45.825660+0000","last_clean":"2023-10-14T18:50:45.825660+0000","last_became_active":"2023-10-14T18:50:45.825086+0000","last_became_peered":"2023-10-14T18:50:45.825086+0000","last_unstale":"2023-10-14T18:50:45.825660+0000","last_undegraded":"2023-10-14T18:50:45.825660+0000","last_fullsized":"2023-10-14T18:50:45.825660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:38.311624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812759+0000","last_change":"2023-10-14T18:50:44.543357+0000","last_active":"2023-10-14T18:50:45.812759+0000","last_peered":"2023-10-14T18:50:45.812759+0000","last_clean":"2023-10-14T18:50:45.812759+0000","last_became_active":"2023-10-14T18:50:44.543144+0000","last_became_peered":"2023-10-14T18:50:44.543144+0000","last_unstale":"2023-10-14T18:50:45.812759+0000","last_undegraded":"2023-10-14T18:50:45.812759+0000","last_fullsized":"2023-10-14T18:50:45.812759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:11.473597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.821166+0000","last_change":"2023-10-14T18:50:45.820718+0000","last_active":"2023-10-14T18:50:45.821166+0000","last_peered":"2023-10-14T18:50:45.821166+0000","last_clean":"2023-10-14T18:50:45.821166+0000","last_became_active":"2023-10-14T18:50:45.820428+0000","last_became_peered":"2023-10-14T18:50:45.820428+0000","last_unstale":"2023-10-14T18:50:45.821166+0000","last_undegraded":"2023-10-14T18:50:45.821166+0000","last_fullsized":"2023-10-14T18:50:45.821166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:51.527594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815283+0000","last_change":"2023-10-14T18:50:44.546145+0000","last_active":"2023-10-14T18:50:45.815283+0000","last_peered":"2023-10-14T18:50:45.815283+0000","last_clean":"2023-10-14T18:50:45.815283+0000","last_became_active":"2023-10-14T18:50:44.545927+0000","last_became_peered":"2023-10-14T18:50:44.545927+0000","last_unstale":"2023-10-14T18:50:45.815283+0000","last_undegraded":"2023-10-14T18:50:45.815283+0000","last_fullsized":"2023-10-14T18:50:45.815283+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818441+0000","last_change":"2023-10-14T18:50:45.818379+0000","last_active":"2023-10-14T18:50:45.818441+0000","last_peered":"2023-10-14T18:50:45.818441+0000","last_clean":"2023-10-14T18:50:45.818441+0000","last_became_active":"2023-10-14T18:50:45.817568+0000","last_became_peered":"2023-10-14T18:50:45.817568+0000","last_unstale":"2023-10-14T18:50:45.818441+0000","last_undegraded":"2023-10-14T18:50:45.818441+0000","last_fullsized":"2023-10-14T18:50:45.818441+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:43:46.507961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":18,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827444+0000","last_change":"2023-10-14T18:50:44.544087+0000","last_active":"2023-10-14T18:50:45.827444+0000","last_peered":"2023-10-14T18:50:45.827444+0000","last_clean":"2023-10-14T18:50:45.827444+0000","last_became_active":"2023-10-14T18:50:44.543861+0000","last_became_peered":"2023-10-14T18:50:44.543861+0000","last_unstale":"2023-10-14T18:50:45.827444+0000","last_undegraded":"2023-10-14T18:50:45.827444+0000","last_fullsized":"2023-10-14T18:50:45.827444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:51:33.856982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817607+0000","last_change":"2023-10-14T18:50:45.817151+0000","last_active":"2023-10-14T18:50:45.817607+0000","last_peered":"2023-10-14T18:50:45.817607+0000","last_clean":"2023-10-14T18:50:45.817607+0000","last_became_active":"2023-10-14T18:50:45.816906+0000","last_became_peered":"2023-10-14T18:50:45.816906+0000","last_unstale":"2023-10-14T18:50:45.817607+0000","last_undegraded":"2023-10-14T18:50:45.817607+0000","last_fullsized":"2023-10-14T18:50:45.817607+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:54.982267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827241+0000","last_change":"2023-10-14T18:50:44.546883+0000","last_active":"2023-10-14T18:50:45.827241+0000","last_peered":"2023-10-14T18:50:45.827241+0000","last_clean":"2023-10-14T18:50:45.827241+0000","last_became_active":"2023-10-14T18:50:44.546539+0000","last_became_peered":"2023-10-14T18:50:44.546539+0000","last_unstale":"2023-10-14T18:50:45.827241+0000","last_undegraded":"2023-10-14T18:50:45.827241+0000","last_fullsized":"2023-10-14T18:50:45.827241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:37.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.820166+0000","last_change":"2023-10-14T18:50:45.819430+0000","last_active":"2023-10-14T18:50:45.820166+0000","last_peered":"2023-10-14T18:50:45.820166+0000","last_clean":"2023-10-14T18:50:45.820166+0000","last_became_active":"2023-10-14T18:50:45.818305+0000","last_became_peered":"2023-10-14T18:50:45.818305+0000","last_unstale":"2023-10-14T18:50:45.820166+0000","last_undegraded":"2023-10-14T18:50:45.820166+0000","last_fullsized":"2023-10-14T18:50:45.820166+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823730+0000","last_change":"2023-10-14T18:50:44.542020+0000","last_active":"2023-10-14T18:50:45.823730+0000","last_peered":"2023-10-14T18:50:45.823730+0000","last_clean":"2023-10-14T18:50:45.823730+0000","last_became_active":"2023-10-14T18:50:44.541797+0000","last_became_peered":"2023-10-14T18:50:44.541797+0000","last_unstale":"2023-10-14T18:50:45.823730+0000","last_undegraded":"2023-10-14T18:50:45.823730+0000","last_fullsized":"2023-10-14T18:50:45.823730+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:19:32.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819733+0000","last_change":"2023-10-14T18:50:45.817742+0000","last_active":"2023-10-14T18:50:45.819733+0000","last_peered":"2023-10-14T18:50:45.819733+0000","last_clean":"2023-10-14T18:50:45.819733+0000","last_became_active":"2023-10-14T18:50:45.816928+0000","last_became_peered":"2023-10-14T18:50:45.816928+0000","last_unstale":"2023-10-14T18:50:45.819733+0000","last_undegraded":"2023-10-14T18:50:45.819733+0000","last_fullsized":"2023-10-14T18:50:45.819733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:45:57.920593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.818242+0000","last_change":"2023-10-14T18:50:44.547856+0000","last_active":"2023-10-14T18:50:45.818242+0000","last_peered":"2023-10-14T18:50:45.818242+0000","last_clean":"2023-10-14T18:50:45.818242+0000","last_became_active":"2023-10-14T18:50:44.547592+0000","last_became_peered":"2023-10-14T18:50:44.547592+0000","last_unstale":"2023-10-14T18:50:45.818242+0000","last_undegraded":"2023-10-14T18:50:45.818242+0000","last_fullsized":"2023-10-14T18:50:45.818242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:01.487859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823012+0000","last_change":"2023-10-14T18:50:45.821544+0000","last_active":"2023-10-14T18:50:45.823012+0000","last_peered":"2023-10-14T18:50:45.823012+0000","last_clean":"2023-10-14T18:50:45.823012+0000","last_became_active":"2023-10-14T18:50:45.821241+0000","last_became_peered":"2023-10-14T18:50:45.821241+0000","last_unstale":"2023-10-14T18:50:45.823012+0000","last_undegraded":"2023-10-14T18:50:45.823012+0000","last_fullsized":"2023-10-14T18:50:45.823012+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:35.196535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.829131+0000","last_change":"2023-10-14T18:50:44.545684+0000","last_active":"2023-10-14T18:50:45.829131+0000","last_peered":"2023-10-14T18:50:45.829131+0000","last_clean":"2023-10-14T18:50:45.829131+0000","last_became_active":"2023-10-14T18:50:44.545025+0000","last_became_peered":"2023-10-14T18:50:44.545025+0000","last_unstale":"2023-10-14T18:50:45.829131+0000","last_undegraded":"2023-10-14T18:50:45.829131+0000","last_fullsized":"2023-10-14T18:50:45.829131+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:50.517495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822977+0000","last_change":"2023-10-14T18:50:45.820978+0000","last_active":"2023-10-14T18:50:45.822977+0000","last_peered":"2023-10-14T18:50:45.822977+0000","last_clean":"2023-10-14T18:50:45.822977+0000","last_became_active":"2023-10-14T18:50:45.820721+0000","last_became_peered":"2023-10-14T18:50:45.820721+0000","last_unstale":"2023-10-14T18:50:45.822977+0000","last_undegraded":"2023-10-14T18:50:45.822977+0000","last_fullsized":"2023-10-14T18:50:45.822977+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:01:51.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812794+0000","last_change":"2023-10-14T18:50:44.544194+0000","last_active":"2023-10-14T18:50:45.812794+0000","last_peered":"2023-10-14T18:50:45.812794+0000","last_clean":"2023-10-14T18:50:45.812794+0000","last_became_active":"2023-10-14T18:50:44.543942+0000","last_became_peered":"2023-10-14T18:50:44.543942+0000","last_unstale":"2023-10-14T18:50:45.812794+0000","last_undegraded":"2023-10-14T18:50:45.812794+0000","last_fullsized":"2023-10-14T18:50:45.812794+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:53.100844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822994+0000","last_change":"2023-10-14T18:50:45.821162+0000","last_active":"2023-10-14T18:50:45.822994+0000","last_peered":"2023-10-14T18:50:45.822994+0000","last_clean":"2023-10-14T18:50:45.822994+0000","last_became_active":"2023-10-14T18:50:45.820913+0000","last_became_peered":"2023-10-14T18:50:45.820913+0000","last_unstale":"2023-10-14T18:50:45.822994+0000","last_undegraded":"2023-10-14T18:50:45.822994+0000","last_fullsized":"2023-10-14T18:50:45.822994+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:41:02.419686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812909+0000","last_change":"2023-10-14T18:50:44.542926+0000","last_active":"2023-10-14T18:50:45.812909+0000","last_peered":"2023-10-14T18:50:45.812909+0000","last_clean":"2023-10-14T18:50:45.812909+0000","last_became_active":"2023-10-14T18:50:44.542667+0000","last_became_peered":"2023-10-14T18:50:44.542667+0000","last_unstale":"2023-10-14T18:50:45.812909+0000","last_undegraded":"2023-10-14T18:50:45.812909+0000","last_fullsized":"2023-10-14T18:50:45.812909+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:29:55.557938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.827495+0000","last_change":"2023-10-14T18:50:45.827448+0000","last_active":"2023-10-14T18:50:45.827495+0000","last_peered":"2023-10-14T18:50:45.827495+0000","last_clean":"2023-10-14T18:50:45.827495+0000","last_became_active":"2023-10-14T18:50:45.827278+0000","last_became_peered":"2023-10-14T18:50:45.827278+0000","last_unstale":"2023-10-14T18:50:45.827495+0000","last_undegraded":"2023-10-14T18:50:45.827495+0000","last_fullsized":"2023-10-14T18:50:45.827495+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:02.489710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.814987+0000","last_change":"2023-10-14T18:50:44.540631+0000","last_active":"2023-10-14T18:50:45.814987+0000","last_peered":"2023-10-14T18:50:45.814987+0000","last_clean":"2023-10-14T18:50:45.814987+0000","last_became_active":"2023-10-14T18:50:44.540385+0000","last_became_peered":"2023-10-14T18:50:44.540385+0000","last_unstale":"2023-10-14T18:50:45.814987+0000","last_undegraded":"2023-10-14T18:50:45.814987+0000","last_fullsized":"2023-10-14T18:50:45.814987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:48:48.403019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.825436+0000","last_change":"2023-10-14T18:50:45.820760+0000","last_active":"2023-10-14T18:50:45.825436+0000","last_peered":"2023-10-14T18:50:45.825436+0000","last_clean":"2023-10-14T18:50:45.825436+0000","last_became_active":"2023-10-14T18:50:45.820460+0000","last_became_peered":"2023-10-14T18:50:45.820460+0000","last_unstale":"2023-10-14T18:50:45.825436+0000","last_undegraded":"2023-10-14T18:50:45.825436+0000","last_fullsized":"2023-10-14T18:50:45.825436+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:22.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826286+0000","last_change":"2023-10-14T18:50:44.545233+0000","last_active":"2023-10-14T18:50:45.826286+0000","last_peered":"2023-10-14T18:50:45.826286+0000","last_clean":"2023-10-14T18:50:45.826286+0000","last_became_active":"2023-10-14T18:50:44.544792+0000","last_became_peered":"2023-10-14T18:50:44.544792+0000","last_unstale":"2023-10-14T18:50:45.826286+0000","last_undegraded":"2023-10-14T18:50:45.826286+0000","last_fullsized":"2023-10-14T18:50:45.826286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815781+0000","last_change":"2023-10-14T18:50:45.815713+0000","last_active":"2023-10-14T18:50:45.815781+0000","last_peered":"2023-10-14T18:50:45.815781+0000","last_clean":"2023-10-14T18:50:45.815781+0000","last_became_active":"2023-10-14T18:50:45.815482+0000","last_became_peered":"2023-10-14T18:50:45.815482+0000","last_unstale":"2023-10-14T18:50:45.815781+0000","last_undegraded":"2023-10-14T18:50:45.815781+0000","last_fullsized":"2023-10-14T18:50:45.815781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:30.361127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-14T18:50:47.487614+0000","last_change":"2023-10-14T18:50:44.545553+0000","last_active":"2023-10-14T18:50:47.487614+0000","last_peered":"2023-10-14T18:50:47.487614+0000","last_clean":"2023-10-14T18:50:47.487614+0000","last_became_active":"2023-10-14T18:50:44.544744+0000","last_became_peered":"2023-10-14T18:50:44.544744+0000","last_unstale":"2023-10-14T18:50:47.487614+0000","last_undegraded":"2023-10-14T18:50:47.487614+0000","last_fullsized":"2023-10-14T18:50:47.487614+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:50.784388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819761+0000","last_change":"2023-10-14T18:50:45.817923+0000","last_active":"2023-10-14T18:50:45.819761+0000","last_peered":"2023-10-14T18:50:45.819761+0000","last_clean":"2023-10-14T18:50:45.819761+0000","last_became_active":"2023-10-14T18:50:45.817729+0000","last_became_peered":"2023-10-14T18:50:45.817729+0000","last_unstale":"2023-10-14T18:50:45.819761+0000","last_undegraded":"2023-10-14T18:50:45.819761+0000","last_fullsized":"2023-10-14T18:50:45.819761+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:30.395163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.812620+0000","last_change":"2023-10-14T18:50:44.548701+0000","last_active":"2023-10-14T18:50:45.812620+0000","last_peered":"2023-10-14T18:50:45.812620+0000","last_clean":"2023-10-14T18:50:45.812620+0000","last_became_active":"2023-10-14T18:50:44.548107+0000","last_became_peered":"2023-10-14T18:50:44.548107+0000","last_unstale":"2023-10-14T18:50:45.812620+0000","last_undegraded":"2023-10-14T18:50:45.812620+0000","last_fullsized":"2023-10-14T18:50:45.812620+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:50.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.822419+0000","last_change":"2023-10-14T18:50:45.821848+0000","last_active":"2023-10-14T18:50:45.822419+0000","last_peered":"2023-10-14T18:50:45.822419+0000","last_clean":"2023-10-14T18:50:45.822419+0000","last_became_active":"2023-10-14T18:50:45.821632+0000","last_became_peered":"2023-10-14T18:50:45.821632+0000","last_unstale":"2023-10-14T18:50:45.822419+0000","last_undegraded":"2023-10-14T18:50:45.822419+0000","last_fullsized":"2023-10-14T18:50:45.822419+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:11.034117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810729+0000","last_change":"2023-10-14T18:50:44.541670+0000","last_active":"2023-10-14T18:50:45.810729+0000","last_peered":"2023-10-14T18:50:45.810729+0000","last_clean":"2023-10-14T18:50:45.810729+0000","last_became_active":"2023-10-14T18:50:44.541267+0000","last_became_peered":"2023-10-14T18:50:44.541267+0000","last_unstale":"2023-10-14T18:50:45.810729+0000","last_undegraded":"2023-10-14T18:50:45.810729+0000","last_fullsized":"2023-10-14T18:50:45.810729+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:52.688765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817860+0000","last_change":"2023-10-14T18:50:45.817785+0000","last_active":"2023-10-14T18:50:45.817860+0000","last_peered":"2023-10-14T18:50:45.817860+0000","last_clean":"2023-10-14T18:50:45.817860+0000","last_became_active":"2023-10-14T18:50:45.817268+0000","last_became_peered":"2023-10-14T18:50:45.817268+0000","last_unstale":"2023-10-14T18:50:45.817860+0000","last_undegraded":"2023-10-14T18:50:45.817860+0000","last_fullsized":"2023-10-14T18:50:45.817860+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:22:22.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815073+0000","last_change":"2023-10-14T18:50:44.539950+0000","last_active":"2023-10-14T18:50:45.815073+0000","last_peered":"2023-10-14T18:50:45.815073+0000","last_clean":"2023-10-14T18:50:45.815073+0000","last_became_active":"2023-10-14T18:50:44.539282+0000","last_became_peered":"2023-10-14T18:50:44.539282+0000","last_unstale":"2023-10-14T18:50:45.815073+0000","last_undegraded":"2023-10-14T18:50:45.815073+0000","last_fullsized":"2023-10-14T18:50:45.815073+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:33:18.987531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.819244+0000","last_change":"2023-10-14T18:50:45.819015+0000","last_active":"2023-10-14T18:50:45.819244+0000","last_peered":"2023-10-14T18:50:45.819244+0000","last_clean":"2023-10-14T18:50:45.819244+0000","last_became_active":"2023-10-14T18:50:45.818786+0000","last_became_peered":"2023-10-14T18:50:45.818786+0000","last_unstale":"2023-10-14T18:50:45.819244+0000","last_undegraded":"2023-10-14T18:50:45.819244+0000","last_fullsized":"2023-10-14T18:50:45.819244+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.810928+0000","last_change":"2023-10-14T18:50:44.542847+0000","last_active":"2023-10-14T18:50:45.810928+0000","last_peered":"2023-10-14T18:50:45.810928+0000","last_clean":"2023-10-14T18:50:45.810928+0000","last_became_active":"2023-10-14T18:50:44.542585+0000","last_became_peered":"2023-10-14T18:50:44.542585+0000","last_unstale":"2023-10-14T18:50:45.810928+0000","last_undegraded":"2023-10-14T18:50:45.810928+0000","last_fullsized":"2023-10-14T18:50:45.810928+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:36.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.817547+0000","last_change":"2023-10-14T18:50:45.817468+0000","last_active":"2023-10-14T18:50:45.817547+0000","last_peered":"2023-10-14T18:50:45.817547+0000","last_clean":"2023-10-14T18:50:45.817547+0000","last_became_active":"2023-10-14T18:50:45.817236+0000","last_became_peered":"2023-10-14T18:50:45.817236+0000","last_unstale":"2023-10-14T18:50:45.817547+0000","last_undegraded":"2023-10-14T18:50:45.817547+0000","last_fullsized":"2023-10-14T18:50:45.817547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:02.611216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.815412+0000","last_change":"2023-10-14T18:50:44.540475+0000","last_active":"2023-10-14T18:50:45.815412+0000","last_peered":"2023-10-14T18:50:45.815412+0000","last_clean":"2023-10-14T18:50:45.815412+0000","last_became_active":"2023-10-14T18:50:44.540267+0000","last_became_peered":"2023-10-14T18:50:44.540267+0000","last_unstale":"2023-10-14T18:50:45.815412+0000","last_undegraded":"2023-10-14T18:50:45.815412+0000","last_fullsized":"2023-10-14T18:50:45.815412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:29.359276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823498+0000","last_change":"2023-10-14T18:50:45.823412+0000","last_active":"2023-10-14T18:50:45.823498+0000","last_peered":"2023-10-14T18:50:45.823498+0000","last_clean":"2023-10-14T18:50:45.823498+0000","last_became_active":"2023-10-14T18:50:45.822978+0000","last_became_peered":"2023-10-14T18:50:45.822978+0000","last_unstale":"2023-10-14T18:50:45.823498+0000","last_undegraded":"2023-10-14T18:50:45.823498+0000","last_fullsized":"2023-10-14T18:50:45.823498+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:01:51.519345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.813898+0000","last_change":"2023-10-14T18:50:44.547653+0000","last_active":"2023-10-14T18:50:45.813898+0000","last_peered":"2023-10-14T18:50:45.813898+0000","last_clean":"2023-10-14T18:50:45.813898+0000","last_became_active":"2023-10-14T18:50:44.547471+0000","last_became_peered":"2023-10-14T18:50:44.547471+0000","last_unstale":"2023-10-14T18:50:45.813898+0000","last_undegraded":"2023-10-14T18:50:45.813898+0000","last_fullsized":"2023-10-14T18:50:45.813898+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:04.600759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.823026+0000","last_change":"2023-10-14T18:50:45.822597+0000","last_active":"2023-10-14T18:50:45.823026+0000","last_peered":"2023-10-14T18:50:45.823026+0000","last_clean":"2023-10-14T18:50:45.823026+0000","last_became_active":"2023-10-14T18:50:45.822394+0000","last_became_peered":"2023-10-14T18:50:45.822394+0000","last_unstale":"2023-10-14T18:50:45.823026+0000","last_undegraded":"2023-10-14T18:50:45.823026+0000","last_fullsized":"2023-10-14T18:50:45.823026+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:44.530929+0000","last_clean_scrub_stamp":"2023-10-14T18:50:44.530929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:31.776666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.826201+0000","last_change":"2023-10-14T18:50:44.540458+0000","last_active":"2023-10-14T18:50:45.826201+0000","last_peered":"2023-10-14T18:50:45.826201+0000","last_clean":"2023-10-14T18:50:45.826201+0000","last_became_active":"2023-10-14T18:50:44.540085+0000","last_became_peered":"2023-10-14T18:50:44.540085+0000","last_unstale":"2023-10-14T18:50:45.826201+0000","last_undegraded":"2023-10-14T18:50:45.826201+0000","last_fullsized":"2023-10-14T18:50:45.826201+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:50:43.529078+0000","last_clean_scrub_stamp":"2023-10-14T18:50:43.529078+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:29:26.970279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":266,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-14T18:50:45.809981+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:50:45.809981+0000","last_peered":"2023-10-14T18:50:45.809981+0000","last_clean":"2023-10-14T18:50:45.809981+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:50:45.809981+0000","last_undegraded":"2023-10-14T18:50:45.809981+0000","last_fullsized":"2023-10-14T18:50:45.809981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194077,"statfs":{"total":200000000,"available":198735326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53300000000000003,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.752,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70299999999999996,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56100000000000005,"15min":0.63900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":3.8580000000000001,"15min":3.8580000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80600000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.82799999999999996},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70299999999999996,"5min":7.8129999999999997,"15min":7.8129999999999997},"last":0.61799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77900000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59399999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82599999999999996,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.74299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:50:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.877,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325182,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.40600000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.624},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56999999999999995,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66200000000000003,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67400000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56000000000000005},"min":{"1min":0.36299999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71299999999999997,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.871},"min":{"1min":0.372,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":9.5779999999999994,"15min":9.5779999999999994},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63600000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.443},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.379},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73399999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.40999999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64200000000000002,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51000000000000001,"15min":0.52600000000000002},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77500000000000002,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.437}]},{"osd":7,"last update":"Sat Oct 14 18:50:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.371,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.33100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.55700000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.22,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33900000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.26100000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.65900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.38400000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.501,"15min":0.75700000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":10.574,"15min":10.574},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.378},"min":{"1min":0.27700000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64000000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.375}]},{"osd":4,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.28899999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.443},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58499999999999996,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85399999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.006,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.88700000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1234,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194078,"statfs":{"total":200000000,"available":198735895,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.22500000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55700000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52800000000000002,"5min":0.623,"15min":0.623},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.27300000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.47899999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54700000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39200000000000002,"15min":0.372},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42199999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.39500000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.75}]},{"osd":5,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.57299999999999995,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88500000000000001,"5min":1.01,"15min":1.01},"last":0.71099999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.90700000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.44600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.72199999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77400000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.59499999999999997,"15min":0.56499999999999995},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.35599999999999998,"15min":0.33300000000000002},"min":{"1min":0.217,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.51500000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.26000000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.33000000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55500000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.38300000000000001,"15min":0.39300000000000002},"min":{"1min":0.28699999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55900000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.33700000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.006,"15min":1.006},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.251,"15min":0.251},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41699999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71599999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.60699999999999998},"min":{"1min":0.41999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.66700000000000004,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.67500000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:50:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.621},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91300000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324248,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33200000000000002},"min":{"1min":0.23300000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46000000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34699999999999998,"15min":0.33400000000000002},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.379}]},{"osd":1,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34300000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54300000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47799999999999998,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.436},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.307,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.495}]},{"osd":4,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.873},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.748}]},{"osd":5,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.61799999999999999},"min":{"1min":0.375,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.60599999999999998,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72199999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84199999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.88700000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:50:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41599999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.89000000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.83099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.377,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77400000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.46600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.442},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.41599999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.999,"15min":0.999},"last":0.433},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59099999999999997,"15min":0.60699999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71199999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.872,"15min":0.872},"last":0.53300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325736,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.66500000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.442}]},{"osd":1,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.41099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69299999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77400000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70999999999999996,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73799999999999999,"5min":0.748,"15min":0.748},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70999999999999996,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.496}]},{"osd":6,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.69499999999999995,"5min":0.746,"15min":0.746},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.57099999999999995},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58599999999999997}]}]}],"pool_statfs":[]}} 2023-10-14T18:50:54.721 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:50:54.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:50:54.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.877+0000 7f0904663700 1 Processor -- start 2023-10-14T18:50:54.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.877+0000 7f0904663700 1 -- start start 2023-10-14T18:50:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0904663700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 0x7f08fc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0904663700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0904663700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0af8e0 con 0x7f08fc0c4a70 2023-10-14T18:50:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0904663700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0c9960 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0904663700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0c3610 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0901bfe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f09023ff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 0x7f08fc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0902c00700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f08fc0c4a70 0x7f08fc0c4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54730/0 (socket says 172.21.15.79:54730) 2023-10-14T18:50:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.878+0000 7f0902c00700 1 -- 172.21.15.79:0/1058485913 learned_addr learned my addr 172.21.15.79:0/1058485913 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f0901bfe700 1 -- 172.21.15.79:0/1058485913 >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 msgr2=0x7f08fc0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f0901bfe700 1 --2- 172.21.15.79:0/1058485913 >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 0x7f08fc0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f0901bfe700 1 -- 172.21.15.79:0/1058485913 >> v1:172.21.15.144:6789/0 conn(0x7f08fc0c4a70 legacy=0x7f08fc0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f0901bfe700 1 -- 172.21.15.79:0/1058485913 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0af6b0 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f09013fd700 1 -- 172.21.15.79:0/1058485913 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102059657 0 0) 0x7f08fc0af8e0 con 0x7f08fc0c4a70 2023-10-14T18:50:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f09023ff700 1 --2- 172.21.15.79:0/1058485913 >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 0x7f08fc0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:50:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f0901bfe700 1 --2- 172.21.15.79:0/1058485913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0af170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0098e0 tx=0x7f08ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd213d6cae49597 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f09013fd700 1 -- 172.21.15.79:0/1058485913 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00b6d0 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f09013fd700 1 -- 172.21.15.79:0/1058485913 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00b830 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.879+0000 7f09013fd700 1 -- 172.21.15.79:0/1058485913 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00bbd0 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 -- 172.21.15.79:0/1058485913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 msgr2=0x7f08fc0af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 --2- 172.21.15.79:0/1058485913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0af170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0098e0 tx=0x7f08ec0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 -- 172.21.15.79:0/1058485913 shutdown_connections 2023-10-14T18:50:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 --2- 172.21.15.79:0/1058485913 >> v2:172.21.15.144:3300/0 conn(0x7f08fc0cb5d0 0x7f08fc0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 --2- 172.21.15.79:0/1058485913 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0af170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 -- 172.21.15.79:0/1058485913 >> 172.21.15.79:0/1058485913 conn(0x7f08fc06f3e0 msgr2=0x7f08fc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 -- 172.21.15.79:0/1058485913 shutdown_connections 2023-10-14T18:50:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.880+0000 7f0904663700 1 -- 172.21.15.79:0/1058485913 wait complete. 2023-10-14T18:50:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 Processor -- start 2023-10-14T18:50:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 -- start start 2023-10-14T18:50:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08fc0c4a70 0x7f08fc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0c4370 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc069a10 con 0x7f08fc0c4a70 2023-10-14T18:50:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.881+0000 7f0904663700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc069cf0 con 0x7f08fc0cb9a0 2023-10-14T18:50:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59528/0 (socket says 172.21.15.79:59528) 2023-10-14T18:50:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 -- 172.21.15.79:0/1616613672 learned_addr learned my addr 172.21.15.79:0/1616613672 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 -- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 msgr2=0x7f08fc0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0902c00700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f09023ff700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08fc0c4a70 0x7f08fc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 -- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08fc0c4a70 msgr2=0x7f08fc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08fc0c4a70 0x7f08fc15cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 -- 172.21.15.79:0/1616613672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009420 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0901bfe700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0b4b60 tx=0x7f08ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00b9a0 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00bb00 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec025670 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec009420 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.882+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc06a2b0 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.883+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc04c3c0 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.884+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08ec023070 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.884+0000 7f08f27fc700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.884+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08ec085b60 con 0x7f08fc0cb5d0 2023-10-14T18:50:54.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.884+0000 7f09023ff700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:54.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.884+0000 7f09023ff700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 0x7f08e00693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006f00 tx=0x7f08f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:54.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:54.888+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08ec052dd0 con 0x7f08fc0cb5d0 2023-10-14T18:50:55.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.149+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f08fc0c9bb0 con 0x7f08fc0cb5d0 2023-10-14T18:50:55.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.153+0000 7f08f27fc700 1 -- 172.21.15.79:0/1616613672 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f08ec0563f0 con 0x7f08fc0cb5d0 2023-10-14T18:50:55.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 msgr2=0x7f08e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 0x7f08e00693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006f00 tx=0x7f08f8008040 comp rx=0 tx=0).stop 2023-10-14T18:50:55.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 msgr2=0x7f08fc0cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0b4b60 tx=0x7f08ec017000 comp rx=0 tx=0).stop 2023-10-14T18:50:55.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 shutdown_connections 2023-10-14T18:50:55.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08e0066f30 0x7f08e00693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08fc0cb9a0 0x7f08fc0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08fc0c4a70 0x7f08fc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 --2- 172.21.15.79:0/1616613672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08fc0cb5d0 0x7f08fc0cf350 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 >> 172.21.15.79:0/1616613672 conn(0x7f08fc06f3e0 msgr2=0x7f08fc0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 shutdown_connections 2023-10-14T18:50:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.155+0000 7f0904663700 1 -- 172.21.15.79:0/1616613672 wait complete. 2023-10-14T18:50:55.159 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:50:55.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.281+0000 7fc0855f3700 1 Processor -- start 2023-10-14T18:50:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.281+0000 7fc0855f3700 1 -- start start 2023-10-14T18:50:55.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc0855f3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc080159d00 0x7fc0800d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc0855f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc0800b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc0855f3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800b2040 con 0x7fc0800b1660 2023-10-14T18:50:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc0855f3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800af6a0 con 0x7fc080159d00 2023-10-14T18:50:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc0855f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800af980 con 0x7fc0800b4f60 2023-10-14T18:50:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc07f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc0800b1660 0x7fc0800b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38198/0 (socket says 172.21.15.79:38198) 2023-10-14T18:50:55.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.282+0000 7fc07f7fe700 1 -- 172.21.15.79:0/1149436005 learned_addr learned my addr 172.21.15.79:0/1149436005 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:55.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc0800b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07ffff700 1 --2- 172.21.15.79:0/1149436005 >> v2:172.21.15.144:3300/0 conn(0x7fc080159d00 0x7fc0800d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428894049 0 0) 0x7fc0800b2040 con 0x7fc0800b1660 2023-10-14T18:50:55.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc068003570 con 0x7fc0800b1660 2023-10-14T18:50:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173254827 0 0) 0x7fc068003570 con 0x7fc0800b1660 2023-10-14T18:50:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 msgr2=0x7fc0800b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc0800b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 >> v2:172.21.15.144:3300/0 conn(0x7fc080159d00 msgr2=0x7fc0800d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 --2- 172.21.15.79:0/1149436005 >> v2:172.21.15.144:3300/0 conn(0x7fc080159d00 0x7fc0800d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800afc60 con 0x7fc0800b1660 2023-10-14T18:50:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc0700015f0 con 0x7fc0800b1660 2023-10-14T18:50:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 >> v1:172.21.15.79:6789/0 conn(0x7fc0800b1660 legacy=0x7fc0800b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc068003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068003fe0 0x7fc068004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc068004d50 0x7fc0680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800af6a0 con 0x7fc068004d50 2023-10-14T18:50:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800af980 con 0x7fc068003fe0 2023-10-14T18:50:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800ba90 con 0x7fc0800b4f60 2023-10-14T18:50:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc068004d50 0x7fc0680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07ffff700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc068003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07f7fe700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068003fe0 0x7fc068004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 -- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 msgr2=0x7fc068003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0800b4f60 0x7fc068003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 -- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068003fe0 msgr2=0x7fc068004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068003fe0 0x7fc068004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc084df2700 1 -- 172.21.15.79:0/1149436005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068003570 con 0x7fc068004d50 2023-10-14T18:50:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.283+0000 7fc07f7fe700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc068003fe0 0x7fc068004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc084df2700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc068004d50 0x7fc0680051c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc07800e210 tx=0x7fc07800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5839e11f9eef92b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800ea60 con 0x7fc068004d50 2023-10-14T18:50:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800f040 con 0x7fc068004d50 2023-10-14T18:50:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc07effd700 1 -- 172.21.15.79:0/1149436005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800ee10 con 0x7fc068004d50 2023-10-14T18:50:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 -- 172.21.15.79:0/1149436005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc068004d50 msgr2=0x7fc0680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 --2- 172.21.15.79:0/1149436005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc068004d50 0x7fc0680051c0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc07800e210 tx=0x7fc07800b040 comp rx=0 tx=0).stop 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc084df2700 1 -- 172.21.15.79:0/1149436005 reap_dead start 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 -- 172.21.15.79:0/1149436005 shutdown_connections 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 -- 172.21.15.79:0/1149436005 >> 172.21.15.79:0/1149436005 conn(0x7fc080067e40 msgr2=0x7fc0800d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 -- 172.21.15.79:0/1149436005 shutdown_connections 2023-10-14T18:50:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.284+0000 7fc0855f3700 1 -- 172.21.15.79:0/1149436005 wait complete. 2023-10-14T18:50:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.285+0000 7fc0855f3700 1 Processor -- start 2023-10-14T18:50:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 -- start start 2023-10-14T18:50:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0800ce990 0x7fc08016a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc080154d50 0x7fc0800ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801551c0 con 0x7fc08016a610 2023-10-14T18:50:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08016d710 con 0x7fc0800ce990 2023-10-14T18:50:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc0855f3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08016ab80 con 0x7fc080154d50 2023-10-14T18:50:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc07f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc07f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59546/0 (socket says 172.21.15.79:59546) 2023-10-14T18:50:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.286+0000 7fc07f7fe700 1 -- 172.21.15.79:0/3460368329 learned_addr learned my addr 172.21.15.79:0/3460368329 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 -- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc080154d50 msgr2=0x7fc0800ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc080154d50 0x7fc0800ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 -- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0800ce990 msgr2=0x7fc08016a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0800ce990 0x7fc08016a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 -- 172.21.15.79:0/3460368329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08016ae60 con 0x7fc08016a610 2023-10-14T18:50:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc07f7fe700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc070000ef0 tx=0x7fc070009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700072e0 con 0x7fc08016a610 2023-10-14T18:50:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070010040 con 0x7fc08016a610 2023-10-14T18:50:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08016d960 con 0x7fc08016a610 2023-10-14T18:50:55.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070007670 con 0x7fc08016a610 2023-10-14T18:50:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.287+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0801586b0 con 0x7fc08016a610 2023-10-14T18:50:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.288+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08016de80 con 0x7fc08016a610 2023-10-14T18:50:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.288+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc070005a00 con 0x7fc08016a610 2023-10-14T18:50:55.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.289+0000 7fc067fff700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:55.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.289+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc070084190 con 0x7fc08016a610 2023-10-14T18:50:55.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.289+0000 7fc07ffff700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:55.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.289+0000 7fc07ffff700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc074009170 tx=0x7fc0740091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:55.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.293+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc08016de80 con 0x7fc08016a610 2023-10-14T18:50:55.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.517+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc08016de80 con 0x7fc08016a610 2023-10-14T18:50:55.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.517+0000 7fc067fff700 1 -- 172.21.15.79:0/3460368329 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc08016de80 con 0x7fc08016a610 2023-10-14T18:50:55.518 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:55.519 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:50:55.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 msgr2=0x7fc06c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 0x7fc06c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc074009170 tx=0x7fc0740091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 msgr2=0x7fc080154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:55.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc070000ef0 tx=0x7fc070009040 comp rx=0 tx=0).stop 2023-10-14T18:50:55.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 shutdown_connections 2023-10-14T18:50:55.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.519+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc06c066f30 0x7fc06c0693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc080154d50 0x7fc0800ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0800ce990 0x7fc08016a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 --2- 172.21.15.79:0/3460368329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc08016a610 0x7fc080154810 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:55.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 >> 172.21.15.79:0/3460368329 conn(0x7fc080067e40 msgr2=0x7fc0800b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:55.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 shutdown_connections 2023-10-14T18:50:55.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:55.520+0000 7fc0855f3700 1 -- 172.21.15.79:0/3460368329 wait complete. 2023-10-14T18:50:55.523 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:50:55.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:50:44.919609+0000', 'modified': '2023-10-14T18:50:48.827701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6729}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6729': {'gid': 6729, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1942025905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 1942025905}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1942025905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:50:55.935 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:50:55.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T18:50:56.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.051+0000 7fc5fe285700 1 Processor -- start 2023-10-14T18:50:56.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.051+0000 7fc5fe285700 1 -- start start 2023-10-14T18:50:56.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fe285700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fe285700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 0x7fc5f8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fe285700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f815cbb0 con 0x7fc5f8157870 2023-10-14T18:50:56.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fe285700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f815bdb0 con 0x7fc5f815d580 2023-10-14T18:50:56.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fe285700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815bfa0 con 0x7fc5f815a620 2023-10-14T18:50:56.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fc822700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 0x7fc5f8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fc822700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 0x7fc5f8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:38632/0 (socket says 172.21.15.79:38632) 2023-10-14T18:50:56.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46442/0 (socket says 172.21.15.79:46442) 2023-10-14T18:50:56.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5fc822700 1 -- 172.21.15.79:0/2262692933 learned_addr learned my addr 172.21.15.79:0/2262692933 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.052+0000 7fc5f7fff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc5f8157870 0x7fc5f815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:54738/0 (socket says 172.21.15.79:54738) 2023-10-14T18:50:56.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2262692933 >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 msgr2=0x7fc5f8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/2262692933 >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 0x7fc5f8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2262692933 >> v1:172.21.15.144:6789/0 conn(0x7fc5f8157870 legacy=0x7fc5f815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2262692933 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f815c280 con 0x7fc5f815a620 2023-10-14T18:50:56.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/2262692933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098e0 tx=0x7fc5ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f1dd73543c1fe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f6ffd700 1 -- 172.21.15.79:0/2262692933 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00b640 con 0x7fc5f815a620 2023-10-14T18:50:56.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f6ffd700 1 -- 172.21.15.79:0/2262692933 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec00b7a0 con 0x7fc5f815a620 2023-10-14T18:50:56.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5f6ffd700 1 -- 172.21.15.79:0/2262692933 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00bb40 con 0x7fc5f815a620 2023-10-14T18:50:56.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 -- 172.21.15.79:0/2262692933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 msgr2=0x7fc5f815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 --2- 172.21.15.79:0/2262692933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098e0 tx=0x7fc5ec0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 -- 172.21.15.79:0/2262692933 shutdown_connections 2023-10-14T18:50:56.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 --2- 172.21.15.79:0/2262692933 >> v2:172.21.15.144:3300/0 conn(0x7fc5f815d580 0x7fc5f8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 --2- 172.21.15.79:0/2262692933 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f815d040 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.053+0000 7fc5fe285700 1 -- 172.21.15.79:0/2262692933 >> 172.21.15.79:0/2262692933 conn(0x7fc5f8068ce0 msgr2=0x7fc5f80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.054+0000 7fc5fe285700 1 -- 172.21.15.79:0/2262692933 shutdown_connections 2023-10-14T18:50:56.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.054+0000 7fc5fe285700 1 -- 172.21.15.79:0/2262692933 wait complete. 2023-10-14T18:50:56.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.055+0000 7fc5fe285700 1 Processor -- start 2023-10-14T18:50:56.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.055+0000 7fc5fe285700 1 -- start start 2023-10-14T18:50:56.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.055+0000 7fc5fe285700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8157870 0x7fc5f814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.055+0000 7fc5fe285700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f8151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.055+0000 7fc5fe285700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fe285700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f814e0d0 con 0x7fc5f815d580 2023-10-14T18:50:56.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fe285700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f814d4c0 con 0x7fc5f8157870 2023-10-14T18:50:56.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fe285700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f814d7a0 con 0x7fc5f815a620 2023-10-14T18:50:56.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59552/0 (socket says 172.21.15.79:59552) 2023-10-14T18:50:56.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 -- 172.21.15.79:0/288316435 learned_addr learned my addr 172.21.15.79:0/288316435 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f8151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8157870 0x7fc5f814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 -- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 msgr2=0x7fc5f8151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f8151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 -- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8157870 msgr2=0x7fc5f814c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8157870 0x7fc5f814c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 -- 172.21.15.79:0/288316435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009420 con 0x7fc5f815d580 2023-10-14T18:50:56.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fc822700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009d70 tx=0x7fc5f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5dffff700 1 -- 172.21.15.79:0/288316435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000c940 con 0x7fc5f815d580 2023-10-14T18:50:56.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5dffff700 1 -- 172.21.15.79:0/288316435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000f040 con 0x7fc5f815d580 2023-10-14T18:50:56.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f814da80 con 0x7fc5f815d580 2023-10-14T18:50:56.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5dffff700 1 -- 172.21.15.79:0/288316435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000ccd0 con 0x7fc5f815d580 2023-10-14T18:50:56.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.056+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f814cd70 con 0x7fc5f815d580 2023-10-14T18:50:56.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.058+0000 7fc5dffff700 1 -- 172.21.15.79:0/288316435 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5f0014650 con 0x7fc5f815d580 2023-10-14T18:50:56.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.058+0000 7fc5dffff700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.058+0000 7fc5dffff700 1 -- 172.21.15.79:0/288316435 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5f0084bc0 con 0x7fc5f815d580 2023-10-14T18:50:56.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.058+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.059+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8007fd0 tx=0x7fc5e8007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.060+0000 7fc60757eb80 1 Processor -- start 2023-10-14T18:50:56.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.060+0000 7fc60757eb80 1 -- start start 2023-10-14T18:50:56.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4cceebd00 0x55d4ccecaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cce9dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccdf8a70 con 0x55d4ccea1a50 2023-10-14T18:50:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccdf6270 con 0x55d4cceebd00 2023-10-14T18:50:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccdf2060 con 0x55d4ccecaf60 2023-10-14T18:50:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59556/0 (socket says 172.21.15.79:59556) 2023-10-14T18:50:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 -- 172.21.15.79:0/3653479032 learned_addr learned my addr 172.21.15.79:0/3653479032 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5fc822700 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cce9dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4cceebd00 0x55d4ccecaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 -- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 msgr2=0x55d4cce9dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cce9dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 -- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4cceebd00 msgr2=0x55d4ccecaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4cceebd00 0x55d4ccecaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 -- 172.21.15.79:0/3653479032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ccc8c270 con 0x55d4ccea1a50 2023-10-14T18:50:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80158b0 tx=0x7fc5e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d103739731e3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5dd7fa700 1 -- 172.21.15.79:0/3653479032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8015320 con 0x55d4ccea1a50 2023-10-14T18:50:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5dd7fa700 1 -- 172.21.15.79:0/3653479032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e8021450 con 0x55d4ccea1a50 2023-10-14T18:50:56.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.061+0000 7fc5dd7fa700 1 -- 172.21.15.79:0/3653479032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80217d0 con 0x55d4ccea1a50 2023-10-14T18:50:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 -- 172.21.15.79:0/3653479032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 msgr2=0x55d4ccea1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80158b0 tx=0x7fc5e8013000 comp rx=0 tx=0).stop 2023-10-14T18:50:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 -- 172.21.15.79:0/3653479032 shutdown_connections 2023-10-14T18:50:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cce9dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccea1a50 0x55d4ccea1e20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 --2- 172.21.15.79:0/3653479032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4cceebd00 0x55d4ccecaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 -- 172.21.15.79:0/3653479032 >> 172.21.15.79:0/3653479032 conn(0x55d4ccea3370 msgr2=0x55d4ccea3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 -- 172.21.15.79:0/3653479032 shutdown_connections 2023-10-14T18:50:56.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.062+0000 7fc60757eb80 1 -- 172.21.15.79:0/3653479032 wait complete. 2023-10-14T18:50:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 -- start start 2023-10-14T18:50:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 Processor -- start 2023-10-14T18:50:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccec77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4ccee1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccd9d890 con 0x55d4ccecaf60 2023-10-14T18:50:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccdb8ea0 con 0x55d4ccea1a50 2023-10-14T18:50:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccc74e30 con 0x55d4cceebd00 2023-10-14T18:50:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.063+0000 7fc60757eb80 10 client.0 _ll_register_callbacks cb 0x55d4cce65110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:50:56.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59560/0 (socket says 172.21.15.79:59560) 2023-10-14T18:50:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 -- 172.21.15.79:0/133821593 learned_addr learned my addr 172.21.15.79:0/133821593 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccec77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5fc822700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4ccee1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 -- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 msgr2=0x55d4ccee1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4ccee1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 -- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 msgr2=0x55d4ccec77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccec77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 -- 172.21.15.79:0/133821593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e800f040 con 0x55d4ccecaf60 2023-10-14T18:50:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc5f815c0e0 tx=0x7fc5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e743ff36a544689c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:50:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec020070 con 0x55d4ccecaf60 2023-10-14T18:50:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5ec01a630 con 0x55d4ccecaf60 2023-10-14T18:50:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4cce96b70 con 0x55d4ccecaf60 2023-10-14T18:50:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ec01aa00 con 0x55d4ccecaf60 2023-10-14T18:50:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 10 client.6891 fetch_fsmap learned FSMap version 56 2023-10-14T18:50:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55d4ccc2efe0 con 0x55d4ccecaf60 2023-10-14T18:50:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4cce96b70 con 0x55d4ccecaf60 2023-10-14T18:50:56.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5ec01ab60 con 0x55d4ccecaf60 2023-10-14T18:50:56.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 10 client.6891 fetch_fsmap finished waiting for FSMap version 56 2023-10-14T18:50:56.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 10 client.6891 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:50:56.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 20 client.6891 populate_metadata read hostname 'smithi079' 2023-10-14T18:50:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4cceeaea0 0x55d4cceeb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 4 client.6891 mds_command: new command op to 6729 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:50:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.064+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 --> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4cce73aa0 con 0x55d4cceeaea0 2023-10-14T18:50:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4cceeaea0 0x55d4cceeb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4cceeaea0 0x55d4cceeb270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274b0918c158d62f server_cookie=bdfeec7a5eb5dafd in_seq=0 out_seq=0 2023-10-14T18:50:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc5d67fc700 10 client.6891 ms_handle_connect on v2:172.21.15.79:6833/1942025905 2023-10-14T18:50:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc5d67fc700 1 -- 172.21.15.79:0/133821593 <== mds.0 v2:172.21.15.79:6833/1942025905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d4cce73aa0 con 0x55d4cceeaea0 2023-10-14T18:50:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc5d67fc700 10 client.6891 handle_command_reply: tid=0 2023-10-14T18:50:56.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc60757eb80 1 client.6891 shutdown 2023-10-14T18:50:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 msgr2=0x55d4ccee3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.065+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fc5f815c0e0 tx=0x7fc5ec017000 comp rx=0 tx=0).stop 2023-10-14T18:50:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 shutdown_connections 2023-10-14T18:50:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4cceeaea0 0x55d4cceeb270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4ccee1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccec77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 --2- 172.21.15.79:0/133821593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee3b90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc5d67fc700 0 client.6891 ms_handle_reset on v2:172.21.15.79:6833/1942025905 2023-10-14T18:50:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 >> 172.21.15.79:0/133821593 conn(0x55d4ccea3370 msgr2=0x55d4ccee7520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 shutdown_connections 2023-10-14T18:50:56.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 1 -- 172.21.15.79:0/133821593 wait complete. 2023-10-14T18:50:56.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.066+0000 7fc60757eb80 20 client.6891 trim_cache size 0 max 16384 2023-10-14T18:50:56.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.082+0000 7fc60757eb80 1 Processor -- start 2023-10-14T18:50:56.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.082+0000 7fc60757eb80 1 -- start start 2023-10-14T18:50:56.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4cceca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4cce9cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cce9c8a0 con 0x55d4ccecaf60 2023-10-14T18:50:56.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccee6dc0 con 0x55d4ccea1a50 2023-10-14T18:50:56.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccee2e60 con 0x55d4cceebd00 2023-10-14T18:50:56.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59576/0 (socket says 172.21.15.79:59576) 2023-10-14T18:50:56.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2924412471 learned_addr learned my addr 172.21.15.79:0/2924412471 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4cceca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5fc822700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4cce9cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 msgr2=0x55d4cce9cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4cce9cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 msgr2=0x55d4cceca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4cceca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5f77fe700 1 -- 172.21.15.79:0/2924412471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ccdc0780 con 0x55d4ccecaf60 2023-10-14T18:50:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.083+0000 7fc5fc822700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4cce9cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006d80 tx=0x7fc5ec023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5283c12bc5f0b5f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc5ddffb700 1 -- 172.21.15.79:0/2924412471 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec020050 con 0x55d4ccecaf60 2023-10-14T18:50:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc5ddffb700 1 -- 172.21.15.79:0/2924412471 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec021040 con 0x55d4ccecaf60 2023-10-14T18:50:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc5ddffb700 1 -- 172.21.15.79:0/2924412471 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec006a90 con 0x55d4ccecaf60 2023-10-14T18:50:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 -- 172.21.15.79:0/2924412471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 msgr2=0x55d4ccee74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006d80 tx=0x7fc5ec023000 comp rx=0 tx=0).stop 2023-10-14T18:50:56.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 -- 172.21.15.79:0/2924412471 shutdown_connections 2023-10-14T18:50:56.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4cceebd00 0x55d4cce9cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4cceca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 --2- 172.21.15.79:0/2924412471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4ccecaf60 0x55d4ccee74b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 -- 172.21.15.79:0/2924412471 >> 172.21.15.79:0/2924412471 conn(0x55d4ccea3370 msgr2=0x55d4ccee1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 -- 172.21.15.79:0/2924412471 shutdown_connections 2023-10-14T18:50:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.084+0000 7fc60757eb80 1 -- 172.21.15.79:0/2924412471 wait complete. 2023-10-14T18:50:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.085+0000 7fc60757eb80 1 -- start start 2023-10-14T18:50:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.085+0000 7fc60757eb80 1 Processor -- start 2023-10-14T18:50:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccf4dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cceca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccf4e4f0 con 0x55d4cceebd00 2023-10-14T18:50:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccf4e920 con 0x55d4ccea1a50 2023-10-14T18:50:56.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4ccec5d40 con 0x55d4ccecaf60 2023-10-14T18:50:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 10 client.0 _ll_register_callbacks cb 0x55d4cce65110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:50:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59588/0 (socket says 172.21.15.79:59588) 2023-10-14T18:50:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 -- 172.21.15.79:0/1723685819 learned_addr learned my addr 172.21.15.79:0/1723685819 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccf4dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cceca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 -- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 msgr2=0x55d4cceca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cceca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 -- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 msgr2=0x55d4ccf4dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccf4dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 -- 172.21.15.79:0/1723685819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ccc2efe0 con 0x55d4cceebd00 2023-10-14T18:50:56.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5fc822700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0055a80 tx=0x7fc5f0058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f62cd5441a20a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:50:56.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0055af0 con 0x55d4cceebd00 2023-10-14T18:50:56.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5f0058d40 con 0x55d4cceebd00 2023-10-14T18:50:56.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5e8021450 con 0x55d4cceebd00 2023-10-14T18:50:56.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5f005ca90 con 0x55d4cceebd00 2023-10-14T18:50:56.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 10 client.6897 fetch_fsmap learned FSMap version 56 2023-10-14T18:50:56.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.086+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55d4ccda7470 con 0x55d4cceebd00 2023-10-14T18:50:56.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e8021450 con 0x55d4cceebd00 2023-10-14T18:50:56.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc5f0054fe0 con 0x55d4cceebd00 2023-10-14T18:50:56.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 10 client.6897 fetch_fsmap finished waiting for FSMap version 56 2023-10-14T18:50:56.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 10 client.6897 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:50:56.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 20 client.6897 populate_metadata read hostname 'smithi079' 2023-10-14T18:50:56.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4ccf51710 0x55d4ccf51ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 4 client.6897 mds_command: new command op to 6729 tid=0[{"prefix": "status"}] 2023-10-14T18:50:56.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 --> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4ccd94e00 con 0x55d4ccf51710 2023-10-14T18:50:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4ccf51710 0x55d4ccf51ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5f7fff700 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4ccf51710 0x55d4ccf51ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91463e9270556e68 server_cookie=61f8c99e2117ce69 in_seq=0 out_seq=0 2023-10-14T18:50:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 10 client.6897 ms_handle_connect on v2:172.21.15.79:6833/1942025905 2023-10-14T18:50:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 1 -- 172.21.15.79:0/1723685819 <== mds.0 v2:172.21.15.79:6833/1942025905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d4ccd94e00 con 0x55d4ccf51710 2023-10-14T18:50:56.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 10 client.6897 handle_command_reply: tid=0 2023-10-14T18:50:56.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 client.6897 shutdown 2023-10-14T18:50:56.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 msgr2=0x55d4ccec61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0055a80 tx=0x7fc5f0058040 comp rx=0 tx=0).stop 2023-10-14T18:50:56.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 shutdown_connections 2023-10-14T18:50:56.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:6833/1942025905,v1:172.21.15.79:6835/1942025905] conn(0x55d4ccf51710 0x55d4ccf51ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4cceebd00 0x55d4ccec61d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc5d67fc700 0 client.6897 ms_handle_reset on v2:172.21.15.79:6833/1942025905 2023-10-14T18:50:56.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d4ccea1a50 0x55d4ccf4dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 --2- 172.21.15.79:0/1723685819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55d4ccecaf60 0x55d4cceca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 >> 172.21.15.79:0/1723685819 conn(0x55d4ccea3370 msgr2=0x55d4cceea730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 shutdown_connections 2023-10-14T18:50:56.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.087+0000 7fc60757eb80 1 -- 172.21.15.79:0/1723685819 wait complete. 2023-10-14T18:50:56.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc60757eb80 20 client.6897 trim_cache size 0 max 16384 2023-10-14T18:50:56.123 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:50:56.123 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:50:56.123 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:50:56.124 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 6729, 2023-10-14T18:50:56.124 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:50:56.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:50:56.124 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:50:56.124 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 10.280577312, 2023-10-14T18:50:56.125 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 56, 2023-10-14T18:50:56.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 123, 2023-10-14T18:50:56.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 123, 2023-10-14T18:50:56.125 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 16.376151795999998 2023-10-14T18:50:56.125 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:50:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 msgr2=0x7fc5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8007fd0 tx=0x7fc5e8007d70 comp rx=0 tx=0).stop 2023-10-14T18:50:56.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 msgr2=0x7fc5f814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009d70 tx=0x7fc5f000b040 comp rx=0 tx=0).stop 2023-10-14T18:50:56.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 shutdown_connections 2023-10-14T18:50:56.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f815d580 0x7fc5f814e560 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5f8157870 0x7fc5f814c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 --2- 172.21.15.79:0/288316435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc5f815a620 0x7fc5f8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 >> 172.21.15.79:0/288316435 conn(0x7fc5f8068ce0 msgr2=0x7fc5f80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 shutdown_connections 2023-10-14T18:50:56.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.088+0000 7fc5fe285700 1 -- 172.21.15.79:0/288316435 wait complete. 2023-10-14T18:50:56.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:50:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.244+0000 7f8ecbfcc700 1 Processor -- start 2023-10-14T18:50:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.244+0000 7f8ecbfcc700 1 -- start start 2023-10-14T18:50:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 0x7f8ec415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec415a620 0x7f8ec415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec415d580 0x7f8ec4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec415cbb0 con 0x7f8ec415d580 2023-10-14T18:50:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec415bfa0 con 0x7f8ec4157870 2023-10-14T18:50:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ecbfcc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec415c280 con 0x7f8ec415a620 2023-10-14T18:50:56.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8eca569700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec415d580 0x7f8ec4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8eca569700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8ec415d580 0x7f8ec4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59604/0 (socket says 172.21.15.79:59604) 2023-10-14T18:50:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8eca569700 1 -- 172.21.15.79:0/4207355486 learned_addr learned my addr 172.21.15.79:0/4207355486 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ec9567700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec415a620 0x7f8ec415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.245+0000 7f8ec9d68700 1 --2- 172.21.15.79:0/4207355486 >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 0x7f8ec415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 -- 172.21.15.79:0/4207355486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec415a620 msgr2=0x7f8ec415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec415a620 0x7f8ec415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 -- 172.21.15.79:0/4207355486 >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 msgr2=0x7f8ec415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 --2- 172.21.15.79:0/4207355486 >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 0x7f8ec415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 -- 172.21.15.79:0/4207355486 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec415c560 con 0x7f8ec415d580 2023-10-14T18:50:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ec9d68700 1 --2- 172.21.15.79:0/4207355486 >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 0x7f8ec415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8eca569700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec4158110 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4069d80 tx=0x7f8ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c384bb457038ddd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ec8d66700 1 -- 172.21.15.79:0/4207355486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc009e70 con 0x7f8ec415d580 2023-10-14T18:50:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ec8d66700 1 -- 172.21.15.79:0/4207355486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00b860 con 0x7f8ec415d580 2023-10-14T18:50:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ec8d66700 1 -- 172.21.15.79:0/4207355486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00bc00 con 0x7f8ec415d580 2023-10-14T18:50:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/4207355486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 msgr2=0x7f8ec4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec4158110 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4069d80 tx=0x7f8ebc009250 comp rx=0 tx=0).stop 2023-10-14T18:50:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/4207355486 shutdown_connections 2023-10-14T18:50:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec4158110 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/4207355486 >> v2:172.21.15.144:3300/0 conn(0x7f8ec4157870 0x7f8ec415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/4207355486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec415a620 0x7f8ec415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.246+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/4207355486 >> 172.21.15.79:0/4207355486 conn(0x7f8ec4068ce0 msgr2=0x7f8ec40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.247+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/4207355486 shutdown_connections 2023-10-14T18:50:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.247+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/4207355486 wait complete. 2023-10-14T18:50:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 Processor -- start 2023-10-14T18:50:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 -- start start 2023-10-14T18:50:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec4157870 0x7f8ec40b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ec415a620 0x7f8ec40c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40b2770 con 0x7f8ec415d580 2023-10-14T18:50:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40c6c30 con 0x7f8ec415a620 2023-10-14T18:50:56.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ecbfcc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40b1b60 con 0x7f8ec4157870 2023-10-14T18:50:56.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8eca569700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8eca569700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59618/0 (socket says 172.21.15.79:59618) 2023-10-14T18:50:56.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8eca569700 1 -- 172.21.15.79:0/1070274630 learned_addr learned my addr 172.21.15.79:0/1070274630 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:56.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.248+0000 7f8ec9567700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ec415a620 0x7f8ec40c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8ec9d68700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec4157870 0x7f8ec40b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 -- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec4157870 msgr2=0x7f8ec40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec4157870 0x7f8ec40b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 -- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ec415a620 msgr2=0x7f8ec40c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ec415a620 0x7f8ec40c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 -- 172.21.15.79:0/1070274630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc0094f0 con 0x7f8ec415d580 2023-10-14T18:50:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eca569700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0090b0 tx=0x7f8ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00bbe0 con 0x7f8ec415d580 2023-10-14T18:50:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc01f070 con 0x7f8ec415d580 2023-10-14T18:50:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0266b0 con 0x7f8ec415d580 2023-10-14T18:50:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec40b1e40 con 0x7f8ec415d580 2023-10-14T18:50:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.249+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40b2400 con 0x7f8ec415d580 2023-10-14T18:50:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.250+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec40b2920 con 0x7f8ec415d580 2023-10-14T18:50:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.250+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ebc026a20 con 0x7f8ec415d580 2023-10-14T18:50:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.251+0000 7f8eb9ffb700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 0x7f8ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.251+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ebc021070 con 0x7f8ec415d580 2023-10-14T18:50:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.251+0000 7f8ec9d68700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 0x7f8ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.251+0000 7f8ec9d68700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 0x7f8ea80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007740 tx=0x7f8ec00099d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.255+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec40b2920 con 0x7f8ec415d580 2023-10-14T18:50:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.479+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ec40b2920 con 0x7f8ec415d580 2023-10-14T18:50:56.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.479+0000 7f8eb9ffb700 1 -- 172.21.15.79:0/1070274630 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8ec40b2920 con 0x7f8ec415d580 2023-10-14T18:50:56.481 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:50:56.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.481+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 msgr2=0x7f8ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.481+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 0x7f8ea80693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007740 tx=0x7f8ec00099d0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.481+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 msgr2=0x7f8ec416a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:56.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.481+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0090b0 tx=0x7f8ebc017000 comp rx=0 tx=0).stop 2023-10-14T18:50:56.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 shutdown_connections 2023-10-14T18:50:56.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ea8066f30 0x7f8ea80693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ec415d580 0x7f8ec416a670 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8ec4157870 0x7f8ec40b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 --2- 172.21.15.79:0/1070274630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ec415a620 0x7f8ec40c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:56.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 >> 172.21.15.79:0/1070274630 conn(0x7f8ec4068ce0 msgr2=0x7f8ec4155610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:56.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 shutdown_connections 2023-10-14T18:50:56.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:56.482+0000 7f8ecbfcc700 1 -- 172.21.15.79:0/1070274630 wait complete. 2023-10-14T18:50:56.494 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:50:56.494 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:50:56.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:50:56.495 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:50:56.496 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:56.496 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:50:56.496 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:50:56.497 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:50:56.497 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:56.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.498 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:50:56.513 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:50:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:50:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:50:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:50:56.514 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.517 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:56.517 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:50:56.518 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:56.518 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:50:56.519 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:56.519 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:56.520 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:50:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:56.520 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:50:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42178sec preferred_lft 42178sec 2023-10-14T18:50:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:50:56.521 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.522 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:50:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:56.522 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:50:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.523 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:50:56.524 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.524 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:56.524 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:50:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:50:56.525 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.525 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:50:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:50:56.526 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:56.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.528 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:50:56.577 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:50:56.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.579 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:50:56.634 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:50:56.634 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:50:56.635 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:50:56.635 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:50:56.635 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:50:56.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.636 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:50:56.637 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:50:56.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:50:56.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:50:56.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:50:56.638 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:50:56.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.734 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:50:56.749 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:50:56.750 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:50:56.750 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:56.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:56.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:50:56.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:56.814 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:56.869 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:50:56.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:56.870 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:56.924 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:50:56.924 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:50:56.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:57.004 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:57.004 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:57.005 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:57.013 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:57.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:57.013 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:57.013 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:57.014 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:57.034 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:50:57.035 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:50:57.035 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:50:57.035 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:57.035 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:57.036 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:50:57.036 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:50:57.036 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:50:57.037 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:50:57.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:50:57.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:50:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.256+0000 7feabd504700 1 Processor -- start 2023-10-14T18:50:57.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.256+0000 7feabd504700 1 -- start start 2023-10-14T18:50:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabd504700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feab80cdab0 0x7feab815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabd504700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 0x7feab815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabd504700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab80cb7c0 con 0x7feab80cd6e0 2023-10-14T18:50:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabd504700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab815e850 con 0x7feab80cdab0 2023-10-14T18:50:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabd504700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab80cc360 con 0x7feab815dda0 2023-10-14T18:50:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab77fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feab80cdab0 0x7feab815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feab80cd6e0 0x7feab80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38206/0 (socket says 172.21.15.79:38206) 2023-10-14T18:50:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab7fff700 1 -- 172.21.15.79:0/1325235739 learned_addr learned my addr 172.21.15.79:0/1325235739 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:50:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabcd03700 1 --2- 172.21.15.79:0/1325235739 >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 0x7feab815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab77fe700 1 -- 172.21.15.79:0/1325235739 >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 msgr2=0x7feab815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab77fe700 1 --2- 172.21.15.79:0/1325235739 >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 0x7feab815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab77fe700 1 -- 172.21.15.79:0/1325235739 >> v1:172.21.15.79:6789/0 conn(0x7feab80cd6e0 legacy=0x7feab80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab77fe700 1 -- 172.21.15.79:0/1325235739 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab815e290 con 0x7feab80cdab0 2023-10-14T18:50:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feabcd03700 1 --2- 172.21.15.79:0/1325235739 >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 0x7feab815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:50:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.257+0000 7feab6ffd700 1 -- 172.21.15.79:0/1325235739 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553830386 0 0) 0x7feab80cb7c0 con 0x7feab80cd6e0 2023-10-14T18:50:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feab77fe700 1 --2- 172.21.15.79:0/1325235739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cdab0 0x7feab815d860 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feab80cb730 tx=0x7feaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d13a4b555284b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feab6ffd700 1 -- 172.21.15.79:0/1325235739 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00b6b0 con 0x7feab80cdab0 2023-10-14T18:50:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feab6ffd700 1 -- 172.21.15.79:0/1325235739 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00b810 con 0x7feab80cdab0 2023-10-14T18:50:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feab6ffd700 1 -- 172.21.15.79:0/1325235739 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00bbb0 con 0x7feab80cdab0 2023-10-14T18:50:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 -- 172.21.15.79:0/1325235739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cdab0 msgr2=0x7feab815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 --2- 172.21.15.79:0/1325235739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cdab0 0x7feab815d860 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feab80cb730 tx=0x7feaac0091a0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 -- 172.21.15.79:0/1325235739 shutdown_connections 2023-10-14T18:50:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 --2- 172.21.15.79:0/1325235739 >> v2:172.21.15.144:3300/0 conn(0x7feab815dda0 0x7feab815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 --2- 172.21.15.79:0/1325235739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cdab0 0x7feab815d860 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 -- 172.21.15.79:0/1325235739 >> 172.21.15.79:0/1325235739 conn(0x7feab8067660 msgr2=0x7feab8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 -- 172.21.15.79:0/1325235739 shutdown_connections 2023-10-14T18:50:57.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.258+0000 7feabd504700 1 -- 172.21.15.79:0/1325235739 wait complete. 2023-10-14T18:50:57.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.259+0000 7feabd504700 1 Processor -- start 2023-10-14T18:50:57.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 -- start start 2023-10-14T18:50:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feab80cdab0 0x7feab80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feab815dda0 0x7feab80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab81586e0 con 0x7feab80cd6e0 2023-10-14T18:50:57.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab816ad10 con 0x7feab815dda0 2023-10-14T18:50:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabd504700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab816aff0 con 0x7feab80cdab0 2023-10-14T18:50:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feab7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feab7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59642/0 (socket says 172.21.15.79:59642) 2023-10-14T18:50:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feab7fff700 1 -- 172.21.15.79:0/2233935587 learned_addr learned my addr 172.21.15.79:0/2233935587 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:57.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feabcd03700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feab815dda0 0x7feab80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.260+0000 7feab77fe700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feab80cdab0 0x7feab80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 -- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feab80cdab0 msgr2=0x7feab80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feab80cdab0 0x7feab80c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 -- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feab815dda0 msgr2=0x7feab80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feab815dda0 0x7feab80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 -- 172.21.15.79:0/2233935587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009420 con 0x7feab80cd6e0 2023-10-14T18:50:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feab7fff700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c7e0 tx=0x7feaa8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8005b30 con 0x7feab80cd6e0 2023-10-14T18:50:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8005c90 con 0x7feab80cd6e0 2023-10-14T18:50:57.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab816b2d0 con 0x7feab80cd6e0 2023-10-14T18:50:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8007300 con 0x7feab80cd6e0 2023-10-14T18:50:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.261+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab80c9c40 con 0x7feab80cd6e0 2023-10-14T18:50:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.262+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab8089280 con 0x7feab80cd6e0 2023-10-14T18:50:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.262+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feaa801b400 con 0x7feab80cd6e0 2023-10-14T18:50:57.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.262+0000 7fea9ffff700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 0x7feaa4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.263+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feaa8083fd0 con 0x7feab80cd6e0 2023-10-14T18:50:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.263+0000 7feab77fe700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 0x7feaa4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.263+0000 7feab77fe700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 0x7feaa4069410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feaac0093f0 tx=0x7feaac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:57.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.267+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feaa80512c0 con 0x7feab80cd6e0 2023-10-14T18:50:57.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.491+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feab804bb80 con 0x7feab80cd6e0 2023-10-14T18:50:57.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.492+0000 7fea9ffff700 1 -- 172.21.15.79:0/2233935587 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7feaa80548e0 con 0x7feab80cd6e0 2023-10-14T18:50:57.493 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:50:57.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.493+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 msgr2=0x7feaa4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 0x7feaa4069410 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feaac0093f0 tx=0x7feaac017000 comp rx=0 tx=0).stop 2023-10-14T18:50:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 msgr2=0x7feab80aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c7e0 tx=0x7feaa8007df0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 shutdown_connections 2023-10-14T18:50:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f60 0x7feaa4069410 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feab815dda0 0x7feab80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feab80cd6e0 0x7feab80aff70 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 --2- 172.21.15.79:0/2233935587 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feab80cdab0 0x7feab80c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:57.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 >> 172.21.15.79:0/2233935587 conn(0x7feab8067660 msgr2=0x7feab815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:57.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 shutdown_connections 2023-10-14T18:50:57.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:57.494+0000 7feabd504700 1 -- 172.21.15.79:0/2233935587 wait complete. 2023-10-14T18:50:57.506 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:50:57.506 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:50:57.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:50:57.507 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:50:57.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:57.508 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:50:57.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:50:57.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:50:57.509 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:57.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.510 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:50:57.528 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:50:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:50:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:50:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:50:57.529 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.530 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:57.530 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:50:57.530 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:50:57.531 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:50:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42169sec preferred_lft 42169sec 2023-10-14T18:50:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:50:57.532 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.532 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:50:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:50:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:50:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:50:57.533 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.534 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:50:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:50:57.534 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.534 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:50:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:50:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:50:57.535 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:50:57.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.536 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:50:57.596 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:50:57.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.598 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:50:57.655 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:50:57.655 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:50:57.656 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:50:57.656 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:50:57.656 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:50:57.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.657 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:50:57.657 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:50:57.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:50:57.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:50:57.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:50:57.659 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:50:57.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.760 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:50:57.775 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:50:57.775 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:50:57.776 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:57.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:57.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:50:57.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:57.840 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:57.894 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:50:57.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:50:57.895 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:57.950 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:50:57.951 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:50:57.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:58.029 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:58.029 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:58.030 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:58.037 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:58.038 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:58.038 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:58.038 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:58.038 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:50:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:50:58.059 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:50:58.060 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:50:58.060 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:50:58.060 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:50:58.060 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:50:58.060 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:50:58.061 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:50:58.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:58.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:50:58.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:50:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.242+0000 7fbf2cf30700 1 Processor -- start 2023-10-14T18:50:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.242+0000 7fbf2cf30700 1 -- start start 2023-10-14T18:50:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2cf30700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2cf30700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2cf30700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2815cbb0 con 0x7fbf2815d580 2023-10-14T18:50:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2cf30700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2815bfa0 con 0x7fbf28157870 2023-10-14T18:50:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2cf30700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2815c280 con 0x7fbf2815a620 2023-10-14T18:50:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59646/0 (socket says 172.21.15.79:59646) 2023-10-14T18:50:58.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 -- 172.21.15.79:0/1117838131 learned_addr learned my addr 172.21.15.79:0/1117838131 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf25d9b700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 -- 172.21.15.79:0/1117838131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 msgr2=0x7fbf2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 -- 172.21.15.79:0/1117838131 >> v1:172.21.15.144:6789/0 conn(0x7fbf2815d580 legacy=0x7fbf28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 -- 172.21.15.79:0/1117838131 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2815c560 con 0x7fbf28157870 2023-10-14T18:50:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2659c700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf2815b6a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009f20 tx=0x7fbf20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac5df579e8018bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.243+0000 7fbf2559a700 1 -- 172.21.15.79:0/1117838131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2000e070 con 0x7fbf28157870 2023-10-14T18:50:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2559a700 1 -- 172.21.15.79:0/1117838131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2000ba80 con 0x7fbf28157870 2023-10-14T18:50:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2559a700 1 -- 172.21.15.79:0/1117838131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200092e0 con 0x7fbf28157870 2023-10-14T18:50:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 -- 172.21.15.79:0/1117838131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 msgr2=0x7fbf2815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf2815b6a0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009f20 tx=0x7fbf20009840 comp rx=0 tx=0).stop 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 -- 172.21.15.79:0/1117838131 shutdown_connections 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf2815b6a0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/1117838131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 -- 172.21.15.79:0/1117838131 >> 172.21.15.79:0/1117838131 conn(0x7fbf28068ce0 msgr2=0x7fbf280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 -- 172.21.15.79:0/1117838131 shutdown_connections 2023-10-14T18:50:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.244+0000 7fbf2cf30700 1 -- 172.21.15.79:0/1117838131 wait complete. 2023-10-14T18:50:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.245+0000 7fbf2cf30700 1 Processor -- start 2023-10-14T18:50:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.245+0000 7fbf2cf30700 1 -- start start 2023-10-14T18:50:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf280b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf2815d580 0x7fbf280b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28152450 con 0x7fbf28157870 2023-10-14T18:50:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28152730 con 0x7fbf2815d580 2023-10-14T18:50:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2cf30700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28152a10 con 0x7fbf2815a620 2023-10-14T18:50:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:59652/0 (socket says 172.21.15.79:59652) 2023-10-14T18:50:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 -- 172.21.15.79:0/3393229332 learned_addr learned my addr 172.21.15.79:0/3393229332 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf25d9b700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf280b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf26d9d700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf2815d580 0x7fbf280b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 -- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 msgr2=0x7fbf280b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf280b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 -- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf2815d580 msgr2=0x7fbf280b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf2815d580 0x7fbf280b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 -- 172.21.15.79:0/3393229332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20009ae0 con 0x7fbf28157870 2023-10-14T18:50:58.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf25d9b700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf280b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:50:58.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.246+0000 7fbf2659c700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000b6c0 tx=0x7fbf20018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.247+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf20008bb0 con 0x7fbf28157870 2023-10-14T18:50:58.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.247+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf20008d10 con 0x7fbf28157870 2023-10-14T18:50:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.247+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf28152cf0 con 0x7fbf28157870 2023-10-14T18:50:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.247+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200266b0 con 0x7fbf28157870 2023-10-14T18:50:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.247+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280d1330 con 0x7fbf28157870 2023-10-14T18:50:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.248+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2804c3c0 con 0x7fbf28157870 2023-10-14T18:50:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.248+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf20003040 con 0x7fbf28157870 2023-10-14T18:50:58.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.248+0000 7fbf1e7fc700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 0x7fbf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.249+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf20085f00 con 0x7fbf28157870 2023-10-14T18:50:58.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.249+0000 7fbf25d9b700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 0x7fbf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.249+0000 7fbf25d9b700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 0x7fbf080693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbf2816b9e0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.253+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf20053220 con 0x7fbf28157870 2023-10-14T18:50:58.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.476+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf2815c840 con 0x7fbf28157870 2023-10-14T18:50:58.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.477+0000 7fbf1e7fc700 1 -- 172.21.15.79:0/3393229332 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbf20056840 con 0x7fbf28157870 2023-10-14T18:50:58.478 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:50:58.478 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:50:58.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 msgr2=0x7fbf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 0x7fbf080693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbf2816b9e0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2023-10-14T18:50:58.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 msgr2=0x7fbf28156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000b6c0 tx=0x7fbf20018000 comp rx=0 tx=0).stop 2023-10-14T18:50:58.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 shutdown_connections 2023-10-14T18:50:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf08066f30 0x7fbf080693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf2815d580 0x7fbf280b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf28157870 0x7fbf28156360 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 --2- 172.21.15.79:0/3393229332 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf2815a620 0x7fbf280b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 >> 172.21.15.79:0/3393229332 conn(0x7fbf28068ce0 msgr2=0x7fbf2815f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:58.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 shutdown_connections 2023-10-14T18:50:58.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.479+0000 7fbf2cf30700 1 -- 172.21.15.79:0/3393229332 wait complete. 2023-10-14T18:50:58.482 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:50:58.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:50:58.627 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":6729,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.810156507,"mdsmap_epoch":56,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":18.905733908999999} 2023-10-14T18:50:58.628 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 6729, "mdsmap_epoch": 56, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 12.810156507, "state": "up:active", "uptime": 18.905733909, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:50:58.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-14T18:50:58.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.747+0000 7f08f5e19700 1 Processor -- start 2023-10-14T18:50:58.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.747+0000 7f08f5e19700 1 -- start start 2023-10-14T18:50:58.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f0159ef0 0x7f08f015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08f00b6a10 0x7f08f00b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08f00b15e0 0x7f08f00b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b1a60 con 0x7f08f00b15e0 2023-10-14T18:50:58.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b1d40 con 0x7f08f00b6a10 2023-10-14T18:50:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08f5e19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00b2020 con 0x7f08f0159ef0 2023-10-14T18:50:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08f00b15e0 0x7f08f00b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08f00b15e0 0x7f08f00b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41848/0 (socket says 172.21.15.79:41848) 2023-10-14T18:50:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 -- 172.21.15.79:0/90849769 learned_addr learned my addr 172.21.15.79:0/90849769 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:58.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08ef7fe700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f0159ef0 0x7f08f015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08eeffd700 1 --2- 172.21.15.79:0/90849769 >> v2:172.21.15.144:3300/0 conn(0x7f08f00b6a10 0x7f08f00b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 -- 172.21.15.79:0/90849769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f0159ef0 msgr2=0x7f08f015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f0159ef0 0x7f08f015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 -- 172.21.15.79:0/90849769 >> v2:172.21.15.144:3300/0 conn(0x7f08f00b6a10 msgr2=0x7f08f00b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:50:58.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 --2- 172.21.15.79:0/90849769 >> v2:172.21.15.144:3300/0 conn(0x7f08f00b6a10 0x7f08f00b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 -- 172.21.15.79:0/90849769 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00b2300 con 0x7f08f00b15e0 2023-10-14T18:50:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08effff700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f00b15e0 0x7f08f00b46f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f08f00894b0 tx=0x7f08e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979b7b8e632e09bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08ee7fc700 1 -- 172.21.15.79:0/90849769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800e070 con 0x7f08f00b15e0 2023-10-14T18:50:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08ee7fc700 1 -- 172.21.15.79:0/90849769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800ba50 con 0x7f08f00b15e0 2023-10-14T18:50:58.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.748+0000 7f08ee7fc700 1 -- 172.21.15.79:0/90849769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80092e0 con 0x7f08f00b15e0 2023-10-14T18:50:58.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 -- 172.21.15.79:0/90849769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f00b15e0 msgr2=0x7f08f00b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f00b15e0 0x7f08f00b46f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f08f00894b0 tx=0x7f08e8009840 comp rx=0 tx=0).stop 2023-10-14T18:50:58.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 -- 172.21.15.79:0/90849769 shutdown_connections 2023-10-14T18:50:58.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f0159ef0 0x7f08f015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 --2- 172.21.15.79:0/90849769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f00b15e0 0x7f08f00b46f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 --2- 172.21.15.79:0/90849769 >> v2:172.21.15.144:3300/0 conn(0x7f08f00b6a10 0x7f08f00b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 -- 172.21.15.79:0/90849769 >> 172.21.15.79:0/90849769 conn(0x7f08f009a0a0 msgr2=0x7f08f0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:58.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 -- 172.21.15.79:0/90849769 shutdown_connections 2023-10-14T18:50:58.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.749+0000 7f08f5e19700 1 -- 172.21.15.79:0/90849769 wait complete. 2023-10-14T18:50:58.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.750+0000 7f08f5e19700 1 Processor -- start 2023-10-14T18:50:58.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.750+0000 7f08f5e19700 1 -- start start 2023-10-14T18:50:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f00b6a10 0x7f08f0169e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f00aea70 0x7f08f00aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00af450 con 0x7f08f0159ef0 2023-10-14T18:50:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f009b8c0 con 0x7f08f00aea70 2023-10-14T18:50:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08f5e19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f009acb0 con 0x7f08f00b6a10 2023-10-14T18:50:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41860/0 (socket says 172.21.15.79:41860) 2023-10-14T18:50:58.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 -- 172.21.15.79:0/2622043231 learned_addr learned my addr 172.21.15.79:0/2622043231 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:50:58.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08ef7fe700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f00b6a10 0x7f08f0169e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08effff700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f00aea70 0x7f08f00aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 -- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f00b6a10 msgr2=0x7f08f0169e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f00b6a10 0x7f08f0169e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 -- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f00aea70 msgr2=0x7f08f00aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:58.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f00aea70 0x7f08f00aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:58.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.751+0000 7f08eeffd700 1 -- 172.21.15.79:0/2622043231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009ae0 con 0x7f08f0159ef0 2023-10-14T18:50:58.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08eeffd700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d890 tx=0x7f08e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400b600 con 0x7f08f0159ef0 2023-10-14T18:50:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400b760 con 0x7f08f0159ef0 2023-10-14T18:50:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bae0 con 0x7f08f0159ef0 2023-10-14T18:50:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f009af90 con 0x7f08f0159ef0 2023-10-14T18:50:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.752+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f009b550 con 0x7f08f0159ef0 2023-10-14T18:50:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.753+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f004c3c0 con 0x7f08f0159ef0 2023-10-14T18:50:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.753+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08e401e460 con 0x7f08f0159ef0 2023-10-14T18:50:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.753+0000 7f08d77fe700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 0x7f08dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:50:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.754+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08e4084be0 con 0x7f08f0159ef0 2023-10-14T18:50:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.754+0000 7f08ef7fe700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 0x7f08dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:50:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.754+0000 7f08ef7fe700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 0x7f08dc0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f08e0006500 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:50:58.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.758+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e4051e50 con 0x7f08f0159ef0 2023-10-14T18:50:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:58.944+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f08f0069610 con 0x7f08f0159ef0 2023-10-14T18:50:59.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.551+0000 7f08d77fe700 1 -- 172.21.15.79:0/2622043231 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7f08e4055470 con 0x7f08f0159ef0 2023-10-14T18:50:59.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 msgr2=0x7f08dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 0x7f08dc0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f08e0006500 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2023-10-14T18:50:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 msgr2=0x7f08f0157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:50:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d890 tx=0x7f08e4008040 comp rx=0 tx=0).stop 2023-10-14T18:50:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 shutdown_connections 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08dc066f30 0x7f08dc0693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08f00aea70 0x7f08f00aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08f00b6a10 0x7f08f0169e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 --2- 172.21.15.79:0/2622043231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08f0159ef0 0x7f08f0157a20 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 >> 172.21.15.79:0/2622043231 conn(0x7f08f009a0a0 msgr2=0x7f08f015ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:50:59.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 shutdown_connections 2023-10-14T18:50:59.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:50:59.554+0000 7f08f5e19700 1 -- 172.21.15.79:0/2622043231 wait complete. 2023-10-14T18:50:59.557 INFO:teuthology.orchestra.run.smithi079.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-14T18:50:59.568 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:50:59.569 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:50:59.569 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:50:59.569 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:50:59.570 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:50:59.571 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:50:59.571 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:50:59.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:50:59.827 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:50:59.896 INFO:teuthology.orchestra.run.smithi079.stdout:client6906 2023-10-14T18:50:59.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:50:59.898 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client6906/osdmap') 2023-10-14T18:50:59.972 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-14T18:50:59.973 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:50:59.973 INFO:teuthology.orchestra.run.smithi079.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:50:59.973 INFO:teuthology.orchestra.run.smithi079.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:50:59.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:50:59.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:50:59.974 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:50:59.974 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:50:59.974 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:50:59.974 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:50:59.975 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:50:59.975 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:50:59.976 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:50:59.976 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:50:59.976 INFO:teuthology.orchestra.run.smithi079.stderr:799 bytes copied, 3.5811e-05 s, 22.3 MB/s 2023-10-14T18:50:59.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-14T18:51:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.131+0000 7f30cc3f9700 1 Processor -- start 2023-10-14T18:51:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.131+0000 7f30cc3f9700 1 -- start start 2023-10-14T18:51:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30cc3f9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30c4157870 0x7f30c415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30cc3f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415a620 0x7f30c415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30cc3f9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c415cbb0 con 0x7f30c415d580 2023-10-14T18:51:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30cc3f9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c415bfa0 con 0x7f30c4157870 2023-10-14T18:51:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30cc3f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c415c280 con 0x7f30c415a620 2023-10-14T18:51:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30ca195700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f30c4157870 0x7f30c415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30ca996700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f30c415d580 0x7f30c4158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34698/0 (socket says 172.21.15.79:34698) 2023-10-14T18:51:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30ca996700 1 -- 172.21.15.79:0/1457084044 learned_addr learned my addr 172.21.15.79:0/1457084044 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.132+0000 7f30c9994700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415a620 0x7f30c415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30ca195700 1 -- 172.21.15.79:0/1457084044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415a620 msgr2=0x7f30c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30ca195700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415a620 0x7f30c415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30ca195700 1 -- 172.21.15.79:0/1457084044 >> v1:172.21.15.79:6789/0 conn(0x7f30c415d580 legacy=0x7f30c4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30ca195700 1 -- 172.21.15.79:0/1457084044 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c415c560 con 0x7f30c4157870 2023-10-14T18:51:00.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30c9193700 1 -- 172.21.15.79:0/1457084044 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720010044 0 0) 0x7f30c415cbb0 con 0x7f30c415d580 2023-10-14T18:51:00.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30ca195700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4157870 0x7f30c415b6a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e60 tx=0x7f30c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d793b1a4e4b6e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30c9193700 1 -- 172.21.15.79:0/1457084044 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000e070 con 0x7f30c4157870 2023-10-14T18:51:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30c9193700 1 -- 172.21.15.79:0/1457084044 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000bc30 con 0x7f30c4157870 2023-10-14T18:51:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30c9193700 1 -- 172.21.15.79:0/1457084044 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0012430 con 0x7f30c4157870 2023-10-14T18:51:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1457084044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4157870 msgr2=0x7f30c415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4157870 0x7f30c415b6a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e60 tx=0x7f30c0009780 comp rx=0 tx=0).stop 2023-10-14T18:51:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1457084044 shutdown_connections 2023-10-14T18:51:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c4157870 0x7f30c415b6a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1457084044 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415a620 0x7f30c415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.133+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1457084044 >> 172.21.15.79:0/1457084044 conn(0x7f30c4068ce0 msgr2=0x7f30c40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.134+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1457084044 shutdown_connections 2023-10-14T18:51:00.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.134+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1457084044 wait complete. 2023-10-14T18:51:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 Processor -- start 2023-10-14T18:51:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 -- start start 2023-10-14T18:51:00.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4157870 0x7f30c40b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415d580 0x7f30c414c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4152d40 con 0x7f30c415a620 2023-10-14T18:51:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4151eb0 con 0x7f30c4157870 2023-10-14T18:51:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30cc3f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c41531d0 con 0x7f30c415d580 2023-10-14T18:51:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30c9994700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30c9994700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41888/0 (socket says 172.21.15.79:41888) 2023-10-14T18:51:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.135+0000 7f30c9994700 1 -- 172.21.15.79:0/1618849120 learned_addr learned my addr 172.21.15.79:0/1618849120 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30ca195700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4157870 0x7f30c40b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30ca996700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415d580 0x7f30c414c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 -- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415d580 msgr2=0x7f30c414c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415d580 0x7f30c414c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 -- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4157870 msgr2=0x7f30c40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4157870 0x7f30c40b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 -- 172.21.15.79:0/1618849120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009a20 con 0x7f30c415a620 2023-10-14T18:51:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30c9994700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d890 tx=0x7f30b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40125f0 con 0x7f30c415a620 2023-10-14T18:51:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4012750 con 0x7f30c415a620 2023-10-14T18:51:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4012af0 con 0x7f30c415a620 2023-10-14T18:51:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c4152130 con 0x7f30c415a620 2023-10-14T18:51:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.136+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41526f0 con 0x7f30c415a620 2023-10-14T18:51:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.137+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c404c3c0 con 0x7f30c415a620 2023-10-14T18:51:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.137+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30b401e460 con 0x7f30c415a620 2023-10-14T18:51:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.138+0000 7f30ba7fc700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.138+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30b4084a80 con 0x7f30c415a620 2023-10-14T18:51:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.138+0000 7f30ca195700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.138+0000 7f30ca195700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 0x7f30a80693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e60 tx=0x7f30c0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.142+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30b4055780 con 0x7f30c415a620 2023-10-14T18:51:00.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.336+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f30c415c840 con 0x7f30c415a620 2023-10-14T18:51:00.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.558+0000 7f30ba7fc700 1 -- 172.21.15.79:0/1618849120 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) v1 ==== 93+0+0 (secure 0 0 0) 0x7f30b4055310 con 0x7f30c415a620 2023-10-14T18:51:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 msgr2=0x7f30a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 0x7f30a80693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e60 tx=0x7f30c0019000 comp rx=0 tx=0).stop 2023-10-14T18:51:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 msgr2=0x7f30c4151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f30b400d890 tx=0x7f30b4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:00.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 shutdown_connections 2023-10-14T18:51:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f30a8066f30 0x7f30a80693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f30c415d580 0x7f30c414c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30c4157870 0x7f30c40b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 --2- 172.21.15.79:0/1618849120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30c415a620 0x7f30c4151970 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 >> 172.21.15.79:0/1618849120 conn(0x7f30c4068ce0 msgr2=0x7f30c415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 shutdown_connections 2023-10-14T18:51:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.561+0000 7f30cc3f9700 1 -- 172.21.15.79:0/1618849120 wait complete. 2023-10-14T18:51:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:pauserd,pausewr is set 2023-10-14T18:51:00.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-14T18:51:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.688+0000 7fe2e8a70700 1 Processor -- start 2023-10-14T18:51:00.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.688+0000 7fe2e8a70700 1 -- start start 2023-10-14T18:51:00.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e8a70700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2e415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e8a70700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe2e4157c40 0x7fe2e4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e8a70700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e415cbb0 con 0x7fe2e415a620 2023-10-14T18:51:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e8a70700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e415bfa0 con 0x7fe2e4157c40 2023-10-14T18:51:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e8a70700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415c280 con 0x7fe2e4157870 2023-10-14T18:51:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2d9d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2e415a620 0x7fe2e415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34704/0 (socket says 172.21.15.79:34704) 2023-10-14T18:51:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2d9d9b700 1 -- 172.21.15.79:0/307065220 learned_addr learned my addr 172.21.15.79:0/307065220 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673139459 0 0) 0x7fe2e415cbb0 con 0x7fe2e415a620 2023-10-14T18:51:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d0003570 con 0x7fe2e415a620 2023-10-14T18:51:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> v2:172.21.15.144:3300/0 conn(0x7fe2e4157c40 0x7fe2e4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.689+0000 7fe2e259c700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2e415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646386749 0 0) 0x7fe2d0003570 con 0x7fe2e415a620 2023-10-14T18:51:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 msgr2=0x7fe2e415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2e415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 >> v2:172.21.15.144:3300/0 conn(0x7fe2e4157c40 msgr2=0x7fe2e4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 --2- 172.21.15.79:0/307065220 >> v2:172.21.15.144:3300/0 conn(0x7fe2e4157c40 0x7fe2e4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e415c560 con 0x7fe2e415a620 2023-10-14T18:51:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe2cc001470 con 0x7fe2e415a620 2023-10-14T18:51:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> v2:172.21.15.144:3300/0 conn(0x7fe2e4157c40 0x7fe2e4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 >> v1:172.21.15.79:6789/0 conn(0x7fe2e415a620 legacy=0x7fe2e415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2d0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004090 0x7fe2d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d0004d50 0x7fe2d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415bfa0 con 0x7fe2d0004d50 2023-10-14T18:51:00.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415c280 con 0x7fe2d0004090 2023-10-14T18:51:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d000bbf0 con 0x7fe2e4157870 2023-10-14T18:51:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d0004d50 0x7fe2d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2d9d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004090 0x7fe2d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e259c700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2d0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 msgr2=0x7fe2d0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e4157870 0x7fe2d0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004090 msgr2=0x7fe2d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004090 0x7fe2d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/307065220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0003570 con 0x7fe2d0004d50 2023-10-14T18:51:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2d9d9b700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004090 0x7fe2d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d0004d50 0x7fe2d00051c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007580 tx=0x7fe2dc0097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2000f627be3e020b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc009ae0 con 0x7fe2d0004d50 2023-10-14T18:51:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc007dd0 con 0x7fe2d0004d50 2023-10-14T18:51:00.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.690+0000 7fe2e1d9b700 1 -- 172.21.15.79:0/307065220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc014610 con 0x7fe2d0004d50 2023-10-14T18:51:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 -- 172.21.15.79:0/307065220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d0004d50 msgr2=0x7fe2d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/307065220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2d0004d50 0x7fe2d00051c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc007580 tx=0x7fe2dc0097d0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/307065220 reap_dead start 2023-10-14T18:51:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 -- 172.21.15.79:0/307065220 shutdown_connections 2023-10-14T18:51:00.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 -- 172.21.15.79:0/307065220 >> 172.21.15.79:0/307065220 conn(0x7fe2e4068ce0 msgr2=0x7fe2e40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 -- 172.21.15.79:0/307065220 shutdown_connections 2023-10-14T18:51:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.691+0000 7fe2e8a70700 1 -- 172.21.15.79:0/307065220 wait complete. 2023-10-14T18:51:00.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.692+0000 7fe2e8a70700 1 Processor -- start 2023-10-14T18:51:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.692+0000 7fe2e8a70700 1 -- start start 2023-10-14T18:51:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 0x7fe2e41552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e415fc30 0x7fe2e4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e416e0c0 con 0x7fe2e416d710 2023-10-14T18:51:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41550b0 con 0x7fe2d0004d50 2023-10-14T18:51:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e416e2f0 con 0x7fe2e415fc30 2023-10-14T18:51:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41912/0 (socket says 172.21.15.79:41912) 2023-10-14T18:51:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/1931072062 learned_addr learned my addr 172.21.15.79:0/1931072062 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e259c700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 0x7fe2e41552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2d9d9b700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e415fc30 0x7fe2e4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e415fc30 msgr2=0x7fe2e4154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e415fc30 0x7fe2e4154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 msgr2=0x7fe2e41552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 0x7fe2e41552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40c5c40 con 0x7fe2e416d710 2023-10-14T18:51:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e259c700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 0x7fe2e41552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e2d9d700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc014000 tx=0x7fe2dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc01f630 con 0x7fe2e416d710 2023-10-14T18:51:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc01f7b0 con 0x7fe2e416d710 2023-10-14T18:51:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e40c5f20 con 0x7fe2e416d710 2023-10-14T18:51:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc01fb70 con 0x7fe2e416d710 2023-10-14T18:51:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.693+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e4155aa0 con 0x7fe2e416d710 2023-10-14T18:51:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.694+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e4160000 con 0x7fe2e416d710 2023-10-14T18:51:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.695+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2dc003040 con 0x7fe2e416d710 2023-10-14T18:51:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.695+0000 7fe2daffd700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.695+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2dc085bf0 con 0x7fe2e416d710 2023-10-14T18:51:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.695+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=126+}) v3 -- 0x7fe2c406ea50 con 0x7fe2e416d710 2023-10-14T18:51:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.695+0000 7fe2e259c700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.696+0000 7fe2e259c700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 0x7fe2c40693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006fd0 tx=0x7fe2d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.699+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2dc025020 con 0x7fe2e416d710 2023-10-14T18:51:00.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:00.894+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fe2e40c6440 con 0x7fe2e416d710 2023-10-14T18:51:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.558+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(126..126 src has 1..126) v4 ==== 280+0+0 (secure 0 0 0) 0x7fe2dc057220 con 0x7fe2e416d710 2023-10-14T18:51:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.558+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=127}) v3 -- 0x7fe2c406f3a0 con 0x7fe2e416d710 2023-10-14T18:51:01.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.560+0000 7fe2daffd700 1 -- 172.21.15.79:0/1931072062 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe2e40c6440 con 0x7fe2e416d710 2023-10-14T18:51:01.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 msgr2=0x7fe2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 0x7fe2c40693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4006fd0 tx=0x7fe2d4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 msgr2=0x7fe2e416db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc014000 tx=0x7fe2dc018000 comp rx=0 tx=0).stop 2023-10-14T18:51:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 shutdown_connections 2023-10-14T18:51:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe2c4066f30 0x7fe2c40693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2e416d710 0x7fe2e416db80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d0004d50 0x7fe2e41552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 --2- 172.21.15.79:0/1931072062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2e415fc30 0x7fe2e4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 >> 172.21.15.79:0/1931072062 conn(0x7fe2e4068ce0 msgr2=0x7fe2e40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 shutdown_connections 2023-10-14T18:51:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.563+0000 7fe2e8a70700 1 -- 172.21.15.79:0/1931072062 wait complete. 2023-10-14T18:51:01.566 INFO:teuthology.orchestra.run.smithi079.stderr:pauserd,pausewr is unset 2023-10-14T18:51:01.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:01.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.691+0000 7f21cbb5d700 1 Processor -- start 2023-10-14T18:51:01.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.692+0000 7f21cbb5d700 1 -- start start 2023-10-14T18:51:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.692+0000 7f21cbb5d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21c406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.692+0000 7f21cbb5d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c4157c30 con 0x7f21c4157050 2023-10-14T18:51:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.692+0000 7f21cbb5d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c41584f0 con 0x7f21c415a330 2023-10-14T18:51:01.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.692+0000 7f21cbb5d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4157670 con 0x7f21c4156570 2023-10-14T18:51:01.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21ca0fa700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21c4157050 0x7f21c4158980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34710/0 (socket says 172.21.15.79:34710) 2023-10-14T18:51:01.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21ca0fa700 1 -- 172.21.15.79:0/3904420982 learned_addr learned my addr 172.21.15.79:0/3904420982 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:01.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c98f9700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21c406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167853172 0 0) 0x7f21c4157c30 con 0x7f21c4157050 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b0003570 con 0x7f21c4157050 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955526085 0 0) 0x7f21c41584f0 con 0x7f21c415a330 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c4157c30 con 0x7f21c415a330 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1211042626 0 0) 0x7f21b0003570 con 0x7f21c4157050 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 msgr2=0x7f21c406d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21c406d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 >> v1:172.21.15.144:6789/0 conn(0x7f21c415a330 legacy=0x7f21c4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4157950 con 0x7f21c4157050 2023-10-14T18:51:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f21bc0017f0 con 0x7f21c4157050 2023-10-14T18:51:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 >> v1:172.21.15.79:6789/0 conn(0x7f21c4157050 legacy=0x7f21c4158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21b0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21b0004810 0x7f21b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21b0005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4157670 con 0x7f21b0003c20 2023-10-14T18:51:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b000bbf0 con 0x7f21b0004810 2023-10-14T18:51:01.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b000bdb0 con 0x7f21c4156570 2023-10-14T18:51:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c98f9700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21b0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21c90f8700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21b0004810 0x7f21b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.693+0000 7f21ca0fa700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21b0005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 -- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 msgr2=0x7f21b0005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:01.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4156570 0x7f21b0005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 -- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21b0004810 msgr2=0x7f21b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21b0004810 0x7f21b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 -- 172.21.15.79:0/3904420982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0003570 con 0x7f21b0003c20 2023-10-14T18:51:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c90f8700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21b0004810 0x7f21b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:01.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c98f9700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21b0004010 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006f00 tx=0x7f21c000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a89e4509bb283d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000a760 con 0x7f21b0003c20 2023-10-14T18:51:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000fa30 con 0x7f21b0003c20 2023-10-14T18:51:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21c88f7700 1 -- 172.21.15.79:0/3904420982 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000fbc0 con 0x7f21b0003c20 2023-10-14T18:51:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 -- 172.21.15.79:0/3904420982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 msgr2=0x7f21b0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/3904420982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21b0004010 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006f00 tx=0x7f21c000a330 comp rx=0 tx=0).stop 2023-10-14T18:51:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21ca0fa700 1 -- 172.21.15.79:0/3904420982 reap_dead start 2023-10-14T18:51:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 -- 172.21.15.79:0/3904420982 shutdown_connections 2023-10-14T18:51:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 -- 172.21.15.79:0/3904420982 >> 172.21.15.79:0/3904420982 conn(0x7f21c4067660 msgr2=0x7f21c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 -- 172.21.15.79:0/3904420982 shutdown_connections 2023-10-14T18:51:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.694+0000 7f21cbb5d700 1 -- 172.21.15.79:0/3904420982 wait complete. 2023-10-14T18:51:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.695+0000 7f21cbb5d700 1 Processor -- start 2023-10-14T18:51:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.695+0000 7f21cbb5d700 1 -- start start 2023-10-14T18:51:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c40c42e0 0x7f21c40c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4153fa0 0x7f21c4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4154980 con 0x7f21b0003c20 2023-10-14T18:51:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40c4d80 con 0x7f21c40c42e0 2023-10-14T18:51:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21cbb5d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40c5060 con 0x7f21c4153fa0 2023-10-14T18:51:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41932/0 (socket says 172.21.15.79:41932) 2023-10-14T18:51:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 -- 172.21.15.79:0/2242650364 learned_addr learned my addr 172.21.15.79:0/2242650364 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 -- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4153fa0 msgr2=0x7f21c4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4153fa0 0x7f21c4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 -- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c40c42e0 msgr2=0x7f21c40c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c40c42e0 0x7f21c40c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.696+0000 7f21c98f9700 1 -- 172.21.15.79:0/2242650364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40c5340 con 0x7f21b0003c20 2023-10-14T18:51:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21c98f9700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f21c000a370 tx=0x7f21c001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0012460 con 0x7f21b0003c20 2023-10-14T18:51:01.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c00125c0 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c40c5620 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00129a0 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.697+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c40c1f80 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.698+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c404c3c0 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.698+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c0025400 con 0x7f21b0003c20 2023-10-14T18:51:01.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.699+0000 7f21b9ffb700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 0x7f21a80693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.699+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21c0016070 con 0x7f21b0003c20 2023-10-14T18:51:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.699+0000 7f21c90f8700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 0x7f21a80693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:01.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.699+0000 7f21c90f8700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 0x7f21a80693d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21b40011e0 tx=0x7f21b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:01.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.703+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c0053b10 con 0x7f21b0003c20 2023-10-14T18:51:01.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.890+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c406a060 con 0x7f21b0003c20 2023-10-14T18:51:01.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.891+0000 7f21b9ffb700 1 -- 172.21.15.79:0/2242650364 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f21c0057130 con 0x7f21b0003c20 2023-10-14T18:51:01.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:01.892 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:01.557270+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:01.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 msgr2=0x7f21a80693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 0x7f21a80693d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f21b40011e0 tx=0x7f21b4009040 comp rx=0 tx=0).stop 2023-10-14T18:51:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 msgr2=0x7f21c4165aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f21c000a370 tx=0x7f21c001d000 comp rx=0 tx=0).stop 2023-10-14T18:51:01.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 shutdown_connections 2023-10-14T18:51:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a8066f20 0x7f21a80693d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c4153fa0 0x7f21c4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21b0003c20 0x7f21c4165aa0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 --2- 172.21.15.79:0/2242650364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c40c42e0 0x7f21c40c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:01.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 >> 172.21.15.79:0/2242650364 conn(0x7f21c4067660 msgr2=0x7f21c40c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 shutdown_connections 2023-10-14T18:51:01.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:01.893+0000 7f21cbb5d700 1 -- 172.21.15.79:0/2242650364 wait complete. 2023-10-14T18:51:01.906 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:51:01.906 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:51:01.906 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:51:01.907 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:51:01.907 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:51:01.907 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:51:01.908 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:51:02.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:02.161 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:51:02.228 INFO:teuthology.orchestra.run.smithi079.stdout:client6906 2023-10-14T18:51:02.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:02.229 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client6906/osdmap') 2023-10-14T18:51:02.304 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 123 barrier 123 flags 0x588000 2023-10-14T18:51:02.304 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:02.304 INFO:teuthology.orchestra.run.smithi079.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:51:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:51:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:51:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:51:02.306 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:51:02.306 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:51:02.306 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:51:02.306 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:51:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:51:02.307 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:51:02.308 INFO:teuthology.orchestra.run.smithi079.stderr:799 bytes copied, 3.558e-05 s, 22.5 MB/s 2023-10-14T18:51:02.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:02.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.461+0000 7fcf439f4700 1 Processor -- start 2023-10-14T18:51:02.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.461+0000 7fcf439f4700 1 -- start start 2023-10-14T18:51:02.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf3c15a620 0x7fcf3c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf3c15d580 0x7fcf3c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c15cbb0 con 0x7fcf3c15a620 2023-10-14T18:51:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c15bfa0 con 0x7fcf3c15d580 2023-10-14T18:51:02.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf439f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c15c280 con 0x7fcf3c157870 2023-10-14T18:51:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf3c15a620 0x7fcf3c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcf3c15a620 0x7fcf3c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41940/0 (socket says 172.21.15.79:41940) 2023-10-14T18:51:02.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2369292819 learned_addr learned my addr 172.21.15.79:0/2369292819 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:02.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf41f91700 1 --2- 172.21.15.79:0/2369292819 >> v2:172.21.15.144:3300/0 conn(0x7fcf3c15d580 0x7fcf3c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:02.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf41790700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:02.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2369292819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 msgr2=0x7fcf3c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:02.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2369292819 >> v2:172.21.15.144:3300/0 conn(0x7fcf3c15d580 msgr2=0x7fcf3c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:02.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2369292819 >> v2:172.21.15.144:3300/0 conn(0x7fcf3c15d580 0x7fcf3c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2369292819 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c15c560 con 0x7fcf3c15a620 2023-10-14T18:51:02.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c15d040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0b03b0 tx=0x7fcf2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57ead81896ad76a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.462+0000 7fcf33fff700 1 -- 172.21.15.79:0/2369292819 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00b860 con 0x7fcf3c15a620 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf33fff700 1 -- 172.21.15.79:0/2369292819 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c00b9c0 con 0x7fcf3c15a620 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf33fff700 1 -- 172.21.15.79:0/2369292819 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00bd60 con 0x7fcf3c15a620 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 -- 172.21.15.79:0/2369292819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 msgr2=0x7fcf3c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c15d040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0b03b0 tx=0x7fcf2c009250 comp rx=0 tx=0).stop 2023-10-14T18:51:02.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 -- 172.21.15.79:0/2369292819 shutdown_connections 2023-10-14T18:51:02.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2369292819 >> v2:172.21.15.144:3300/0 conn(0x7fcf3c15d580 0x7fcf3c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2369292819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c15d040 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 -- 172.21.15.79:0/2369292819 >> 172.21.15.79:0/2369292819 conn(0x7fcf3c068ce0 msgr2=0x7fcf3c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 -- 172.21.15.79:0/2369292819 shutdown_connections 2023-10-14T18:51:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.463+0000 7fcf439f4700 1 -- 172.21.15.79:0/2369292819 wait complete. 2023-10-14T18:51:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.464+0000 7fcf439f4700 1 Processor -- start 2023-10-14T18:51:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.464+0000 7fcf439f4700 1 -- start start 2023-10-14T18:51:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3c15d580 0x7fcf3c0b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d0ba0 con 0x7fcf3c15a620 2023-10-14T18:51:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d0020 con 0x7fcf3c15d580 2023-10-14T18:51:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf439f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0d0300 con 0x7fcf3c157870 2023-10-14T18:51:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41950/0 (socket says 172.21.15.79:41950) 2023-10-14T18:51:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2783995723 learned_addr learned my addr 172.21.15.79:0/2783995723 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 msgr2=0x7fcf3c0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3c15d580 msgr2=0x7fcf3c0b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3c15d580 0x7fcf3c0b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.465+0000 7fcf40f8f700 1 -- 172.21.15.79:0/2783995723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094f0 con 0x7fcf3c15a620 2023-10-14T18:51:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf40f8f700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c06b530 tx=0x7fcf2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c024440 con 0x7fcf3c15a620 2023-10-14T18:51:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0245a0 con 0x7fcf3c15a620 2023-10-14T18:51:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c0d05e0 con 0x7fcf3c15a620 2023-10-14T18:51:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c024960 con 0x7fcf3c15a620 2023-10-14T18:51:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.466+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0b1570 con 0x7fcf3c15a620 2023-10-14T18:51:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.467+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0b0810 con 0x7fcf3c15a620 2023-10-14T18:51:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.467+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf2c01a420 con 0x7fcf3c15a620 2023-10-14T18:51:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.467+0000 7fcf317fa700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 0x7fcf200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.468+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf2c086350 con 0x7fcf3c15a620 2023-10-14T18:51:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.468+0000 7fcf41790700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 0x7fcf200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.468+0000 7fcf41790700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 0x7fcf200693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcf38007970 tx=0x7fcf38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.472+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf3c0b0810 con 0x7fcf3c15a620 2023-10-14T18:51:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.696+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3c0b0810 con 0x7fcf3c15a620 2023-10-14T18:51:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.697+0000 7fcf317fa700 1 -- 172.21.15.79:0/2783995723 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fcf3c0b0810 con 0x7fcf3c15a620 2023-10-14T18:51:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:51:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 msgr2=0x7fcf200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 0x7fcf200693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcf38007970 tx=0x7fcf38008040 comp rx=0 tx=0).stop 2023-10-14T18:51:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 msgr2=0x7fcf3c0b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c06b530 tx=0x7fcf2c017000 comp rx=0 tx=0).stop 2023-10-14T18:51:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 shutdown_connections 2023-10-14T18:51:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf20066f30 0x7fcf200693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf3c15d580 0x7fcf3c0b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf3c157870 0x7fcf3c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 --2- 172.21.15.79:0/2783995723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf3c15a620 0x7fcf3c0b0af0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 >> 172.21.15.79:0/2783995723 conn(0x7fcf3c068ce0 msgr2=0x7fcf3c15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 shutdown_connections 2023-10-14T18:51:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:02.699+0000 7fcf439f4700 1 -- 172.21.15.79:0/2783995723 wait complete. 2023-10-14T18:51:02.703 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:51:02.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 126 2023-10-14T18:51:02.843 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-14T18:51:02.844 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:51:02.844 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:51:02.844 DEBUG:teuthology.orchestra.run.smithi079:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-14T18:51:02.845 DEBUG:teuthology.orchestra.run.smithi079:> os.fchmod(fd, 0O666) 2023-10-14T18:51:02.845 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(fd) 2023-10-14T18:51:02.845 DEBUG:teuthology.orchestra.run.smithi079:> os.close(fd) 2023-10-14T18:51:02.846 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:51:03.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:03.099 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:51:03.168 INFO:teuthology.orchestra.run.smithi079.stdout:client6906 2023-10-14T18:51:03.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:03.169 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client6906/osdmap') 2023-10-14T18:51:03.244 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 126 barrier 126 flags 0x588000 2023-10-14T18:51:03.245 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.245 INFO:teuthology.orchestra.run.smithi079.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.245 INFO:teuthology.orchestra.run.smithi079.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:51:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:51:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:51:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:51:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:51:03.247 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:51:03.247 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:51:03.247 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:51:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:51:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:51:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:799 bytes copied, 3.5212e-05 s, 22.7 MB/s 2023-10-14T18:51:03.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:03.249 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T18:51:03.316 INFO:teuthology.orchestra.run.smithi079.stdout:client6906 2023-10-14T18:51:03.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:03.317 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73e97ab7-e872-4b12-8e7a-6b299bb24b40.client6906/osdmap') 2023-10-14T18:51:03.392 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 126 barrier 126 flags 0x588000 2023-10-14T18:51:03.392 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.392 INFO:teuthology.orchestra.run.smithi079.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.393 INFO:teuthology.orchestra.run.smithi079.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2023-10-14T18:51:03.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd0 (1)172.21.15.79:6809 100% (exists, up) 100% -1 2023-10-14T18:51:03.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd1 (1)172.21.15.79:6823 100% (exists, up) 100% -1 2023-10-14T18:51:03.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd2 (1)172.21.15.79:6801 100% (exists, up) 100% -1 2023-10-14T18:51:03.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd3 (1)172.21.15.79:6817 100% (exists, up) 100% -1 2023-10-14T18:51:03.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd4 (1)172.21.15.144:6805 100% (exists, up) 100% -1 2023-10-14T18:51:03.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd5 (1)172.21.15.144:6801 100% (exists, up) 100% -1 2023-10-14T18:51:03.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd6 (1)172.21.15.144:6825 100% (exists, up) 100% -1 2023-10-14T18:51:03.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd7 (1)172.21.15.144:6817 100% (exists, up) 100% -1 2023-10-14T18:51:03.395 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records in 2023-10-14T18:51:03.396 INFO:teuthology.orchestra.run.smithi079.stderr:1+1 records out 2023-10-14T18:51:03.396 INFO:teuthology.orchestra.run.smithi079.stderr:799 bytes copied, 3.2739e-05 s, 24.4 MB/s 2023-10-14T18:51:03.396 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:51:03.397 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:51:03.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:03.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:03.517 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:51:03.518 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:51:03.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:03.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:03.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:51:03.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:03.575 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:51:03.595 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:51:03.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:03.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:03.635 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:51:03.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:03.636 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:51:03.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.808+0000 7f95c6133700 1 Processor -- start 2023-10-14T18:51:03.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.808+0000 7f95c6133700 1 -- start start 2023-10-14T18:51:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95c6133700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95c00b0f30 0x7f95c00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95c6133700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00cb8b0 con 0x7f95c00b1300 2023-10-14T18:51:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95c6133700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c0068f80 con 0x7f95c015aea0 2023-10-14T18:51:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95c6133700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c0069260 con 0x7f95c00b0f30 2023-10-14T18:51:03.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95bf7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f95c00b0f30 0x7f95c00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95beffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f95c00b1300 0x7f95c00cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34722/0 (socket says 172.21.15.79:34722) 2023-10-14T18:51:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.809+0000 7f95beffd700 1 -- 172.21.15.79:0/1163198068 learned_addr learned my addr 172.21.15.79:0/1163198068 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95bf7fe700 1 -- 172.21.15.79:0/1163198068 >> v1:172.21.15.144:6789/0 conn(0x7f95c015aea0 legacy=0x7f95c0067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95bf7fe700 1 -- 172.21.15.79:0/1163198068 >> v1:172.21.15.79:6789/0 conn(0x7f95c00b1300 legacy=0x7f95c00cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95bf7fe700 1 -- 172.21.15.79:0/1163198068 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0069540 con 0x7f95c00b0f30 2023-10-14T18:51:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95be7fc700 1 -- 172.21.15.79:0/1163198068 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847890854 0 0) 0x7f95c00cb8b0 con 0x7f95c00b1300 2023-10-14T18:51:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95bf7fe700 1 --2- 172.21.15.79:0/1163198068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c00b0f30 0x7f95c00cc750 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f95b00098e0 tx=0x7f95b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b4249b48d0f113 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95be7fc700 1 -- 172.21.15.79:0/1163198068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0009e80 con 0x7f95c00b0f30 2023-10-14T18:51:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95be7fc700 1 -- 172.21.15.79:0/1163198068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000b820 con 0x7f95c00b0f30 2023-10-14T18:51:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95be7fc700 1 -- 172.21.15.79:0/1163198068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000bba0 con 0x7f95c00b0f30 2023-10-14T18:51:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95c6133700 1 -- 172.21.15.79:0/1163198068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c00b0f30 msgr2=0x7f95c00cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95c6133700 1 --2- 172.21.15.79:0/1163198068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c00b0f30 0x7f95c00cc750 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f95b00098e0 tx=0x7f95b00091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95c6133700 1 -- 172.21.15.79:0/1163198068 shutdown_connections 2023-10-14T18:51:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.810+0000 7f95c6133700 1 --2- 172.21.15.79:0/1163198068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c00b0f30 0x7f95c00cc750 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.811+0000 7f95c6133700 1 -- 172.21.15.79:0/1163198068 >> 172.21.15.79:0/1163198068 conn(0x7f95c006fdc0 msgr2=0x7f95c006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.811+0000 7f95c6133700 1 -- 172.21.15.79:0/1163198068 shutdown_connections 2023-10-14T18:51:03.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.811+0000 7f95c6133700 1 -- 172.21.15.79:0/1163198068 wait complete. 2023-10-14T18:51:03.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.812+0000 7f95c6133700 1 Processor -- start 2023-10-14T18:51:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.812+0000 7f95c6133700 1 -- start start 2023-10-14T18:51:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.812+0000 7f95c6133700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 0x7f95c00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.812+0000 7f95c6133700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c00b1300 0x7f95c00c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:03.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b1ac0 con 0x7f95c015aea0 2023-10-14T18:51:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b1da0 con 0x7f95c00b1300 2023-10-14T18:51:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b2080 con 0x7f95c00b0f30 2023-10-14T18:51:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41968/0 (socket says 172.21.15.79:41968) 2023-10-14T18:51:03.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 -- 172.21.15.79:0/3085009576 learned_addr learned my addr 172.21.15.79:0/3085009576 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95beffd700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c00b1300 0x7f95c00c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bf7fe700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 0x7f95c00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 -- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 msgr2=0x7f95c00b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 0x7f95c00b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:03.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 -- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c00b1300 msgr2=0x7f95c00c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c00b1300 0x7f95c00c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 -- 172.21.15.79:0/3085009576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009420 con 0x7f95c015aea0 2023-10-14T18:51:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bf7fe700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 0x7f95c00b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95bffff700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c930 tx=0x7f95b80026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:03.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8012630 con 0x7f95c015aea0 2023-10-14T18:51:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b80127d0 con 0x7f95c015aea0 2023-10-14T18:51:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c00b2360 con 0x7f95c015aea0 2023-10-14T18:51:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8012b90 con 0x7f95c015aea0 2023-10-14T18:51:03.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.813+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c014eb70 con 0x7f95c015aea0 2023-10-14T18:51:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.814+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c004c3c0 con 0x7f95c015aea0 2023-10-14T18:51:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.815+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95b800a3b0 con 0x7f95c015aea0 2023-10-14T18:51:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.815+0000 7f95a77fe700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.815+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95b8084240 con 0x7f95c015aea0 2023-10-14T18:51:03.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.815+0000 7f95bf7fe700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.816+0000 7f95bf7fe700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 0x7f95ac0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f95b00030c0 tx=0x7f95b0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:03.819+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95b80514b0 con 0x7f95c015aea0 2023-10-14T18:51:04.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.044+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95c00b2550 con 0x7f95c015aea0 2023-10-14T18:51:04.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.045+0000 7f95a77fe700 1 -- 172.21.15.79:0/3085009576 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f95b8054ad0 con 0x7f95c015aea0 2023-10-14T18:51:04.046 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:04.046 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:51:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 msgr2=0x7f95ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 0x7f95ac0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f95b00030c0 tx=0x7f95b0016000 comp rx=0 tx=0).stop 2023-10-14T18:51:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 msgr2=0x7f95c014e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c930 tx=0x7f95b80026e0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 shutdown_connections 2023-10-14T18:51:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f95ac066f30 0x7f95ac0693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95c015aea0 0x7f95c014e630 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f95c00b0f30 0x7f95c00b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 --2- 172.21.15.79:0/3085009576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95c00b1300 0x7f95c00c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 >> 172.21.15.79:0/3085009576 conn(0x7f95c006fdc0 msgr2=0x7f95c01515f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 shutdown_connections 2023-10-14T18:51:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.047+0000 7f95c6133700 1 -- 172.21.15.79:0/3085009576 wait complete. 2023-10-14T18:51:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:51:04.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.172+0000 7fe85cab8700 1 Processor -- start 2023-10-14T18:51:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.172+0000 7fe85cab8700 1 -- start start 2023-10-14T18:51:04.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe85cab8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe8580ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe85cab8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8581523f0 0x7fe85806c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe85cab8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580cbb10 con 0x7fe858152020 2023-10-14T18:51:04.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe85cab8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8580cbfa0 con 0x7fe8581523f0 2023-10-14T18:51:04.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe85cab8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580caca0 con 0x7fe85815bf00 2023-10-14T18:51:04.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.173+0000 7fe856d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8581523f0 0x7fe85806c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8581523f0 0x7fe85806c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41974/0 (socket says 172.21.15.79:41974) 2023-10-14T18:51:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 -- 172.21.15.79:0/3594147738 learned_addr learned my addr 172.21.15.79:0/3594147738 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe855d9b700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe8580ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 -- 172.21.15.79:0/3594147738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 msgr2=0x7fe8580ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe8580ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 -- 172.21.15.79:0/3594147738 >> v1:172.21.15.144:6789/0 conn(0x7fe858152020 legacy=0x7fe85815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 -- 172.21.15.79:0/3594147738 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85806cd30 con 0x7fe8581523f0 2023-10-14T18:51:04.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe856d9d700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8581523f0 0x7fe85806c7f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe8500099b0 tx=0x7fe850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e5fbf7bc6dd36c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe85559a700 1 -- 172.21.15.79:0/3594147738 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850009ea0 con 0x7fe8581523f0 2023-10-14T18:51:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe85559a700 1 -- 172.21.15.79:0/3594147738 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85000b860 con 0x7fe8581523f0 2023-10-14T18:51:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.174+0000 7fe85559a700 1 -- 172.21.15.79:0/3594147738 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000bc00 con 0x7fe8581523f0 2023-10-14T18:51:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 -- 172.21.15.79:0/3594147738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8581523f0 msgr2=0x7fe85806c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8581523f0 0x7fe85806c7f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe8500099b0 tx=0x7fe850009250 comp rx=0 tx=0).stop 2023-10-14T18:51:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 -- 172.21.15.79:0/3594147738 shutdown_connections 2023-10-14T18:51:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8581523f0 0x7fe85806c7f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 --2- 172.21.15.79:0/3594147738 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe8580ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 -- 172.21.15.79:0/3594147738 >> 172.21.15.79:0/3594147738 conn(0x7fe858069870 msgr2=0x7fe858069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 -- 172.21.15.79:0/3594147738 shutdown_connections 2023-10-14T18:51:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.175+0000 7fe85cab8700 1 -- 172.21.15.79:0/3594147738 wait complete. 2023-10-14T18:51:04.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.176+0000 7fe85cab8700 1 Processor -- start 2023-10-14T18:51:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.176+0000 7fe85cab8700 1 -- start start 2023-10-14T18:51:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.176+0000 7fe85cab8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.176+0000 7fe85cab8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 0x7fe8580cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe85814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580ccc30 con 0x7fe858152020 2023-10-14T18:51:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580b27d0 con 0x7fe8581523f0 2023-10-14T18:51:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580b24a0 con 0x7fe85815bf00 2023-10-14T18:51:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41980/0 (socket says 172.21.15.79:41980) 2023-10-14T18:51:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 -- 172.21.15.79:0/1118357954 learned_addr learned my addr 172.21.15.79:0/1118357954 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe855d9b700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 0x7fe8580cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe856d9d700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe85814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 -- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 msgr2=0x7fe85814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe85814d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 -- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 msgr2=0x7fe8580cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 0x7fe8580cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 -- 172.21.15.79:0/1118357954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500094f0 con 0x7fe858152020 2023-10-14T18:51:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe856d9d700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe85814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:04.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe855d9b700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 0x7fe8580cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85659c700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe84800cb10 tx=0x7fe8480017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800a760 con 0x7fe858152020 2023-10-14T18:51:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84800a8e0 con 0x7fe858152020 2023-10-14T18:51:04.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8580cce60 con 0x7fe858152020 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800aca0 con 0x7fe858152020 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.177+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8580cd420 con 0x7fe858152020 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.178+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85804c3c0 con 0x7fe858152020 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.179+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe848003030 con 0x7fe858152020 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.179+0000 7fe8467fc700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.179+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe848084630 con 0x7fe858152020 2023-10-14T18:51:04.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.179+0000 7fe855d9b700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.180+0000 7fe855d9b700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 0x7fe8380693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe85816b0f0 tx=0x7fe84c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.183+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe848051950 con 0x7fe858152020 2023-10-14T18:51:04.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.368+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8580caf00 con 0x7fe858152020 2023-10-14T18:51:04.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.369+0000 7fe8467fc700 1 -- 172.21.15.79:0/1118357954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fe848054f70 con 0x7fe858152020 2023-10-14T18:51:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:04.370 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:01.557270+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:04.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.370+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 msgr2=0x7fe8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 0x7fe8380693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe85816b0f0 tx=0x7fe84c008040 comp rx=0 tx=0).stop 2023-10-14T18:51:04.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 msgr2=0x7fe8580c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe84800cb10 tx=0x7fe8480017b0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 shutdown_connections 2023-10-14T18:51:04.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe85815bf00 0x7fe85814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe858152020 0x7fe8580c7ed0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 --2- 172.21.15.79:0/1118357954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8581523f0 0x7fe8580cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 >> 172.21.15.79:0/1118357954 conn(0x7fe858069870 msgr2=0x7fe8580c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 shutdown_connections 2023-10-14T18:51:04.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.371+0000 7fe85cab8700 1 -- 172.21.15.79:0/1118357954 wait complete. 2023-10-14T18:51:04.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:50:42.563962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:50:43.888336+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:51:04.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:51:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.500+0000 7f17cee6a700 1 Processor -- start 2023-10-14T18:51:04.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.500+0000 7f17cee6a700 1 -- start start 2023-10-14T18:51:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17cee6a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17cee6a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80b0790 con 0x7f17c815a290 2023-10-14T18:51:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17cee6a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80ce1f0 con 0x7f17c8159ec0 2023-10-14T18:51:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17cee6a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80b0b20 con 0x7f17c80d05a0 2023-10-14T18:51:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17ccc06700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f17c8159ec0 0x7f17c80af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:53250/0 (socket says 172.21.15.79:53250) 2023-10-14T18:51:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17cd407700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.501+0000 7f17ccc06700 1 -- 172.21.15.79:0/2358910648 learned_addr learned my addr 172.21.15.79:0/2358910648 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313146542 0 0) 0x7f17c80ce1f0 con 0x7f17c8159ec0 2023-10-14T18:51:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b0003570 con 0x7f17c8159ec0 2023-10-14T18:51:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955943188 0 0) 0x7f17c80b0790 con 0x7f17c815a290 2023-10-14T18:51:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17cd407700 1 -- 172.21.15.79:0/2358910648 >> v1:172.21.15.144:6789/0 conn(0x7f17c8159ec0 legacy=0x7f17c80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17cd407700 1 -- 172.21.15.79:0/2358910648 >> v1:172.21.15.79:6789/0 conn(0x7f17c815a290 legacy=0x7f17c806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17cd407700 1 -- 172.21.15.79:0/2358910648 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80b04b0 con 0x7f17c80d05a0 2023-10-14T18:51:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17cd407700 1 --2- 172.21.15.79:0/2358910648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8164ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009910 tx=0x7f17c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c105ff6d5d73f2fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000b680 con 0x7f17c80d05a0 2023-10-14T18:51:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c000b7e0 con 0x7f17c80d05a0 2023-10-14T18:51:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.502+0000 7f17c77fe700 1 -- 172.21.15.79:0/2358910648 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000bba0 con 0x7f17c80d05a0 2023-10-14T18:51:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 -- 172.21.15.79:0/2358910648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 msgr2=0x7f17c8164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 --2- 172.21.15.79:0/2358910648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8164ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009910 tx=0x7f17c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 -- 172.21.15.79:0/2358910648 shutdown_connections 2023-10-14T18:51:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 --2- 172.21.15.79:0/2358910648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8164ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 -- 172.21.15.79:0/2358910648 >> 172.21.15.79:0/2358910648 conn(0x7f17c80d1880 msgr2=0x7f17c80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 -- 172.21.15.79:0/2358910648 shutdown_connections 2023-10-14T18:51:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.503+0000 7f17cee6a700 1 -- 172.21.15.79:0/2358910648 wait complete. 2023-10-14T18:51:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.504+0000 7f17cee6a700 1 Processor -- start 2023-10-14T18:51:04.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.504+0000 7f17cee6a700 1 -- start start 2023-10-14T18:51:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c8159ec0 0x7f17c80b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8155e60 con 0x7f17c815a290 2023-10-14T18:51:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80b5a50 con 0x7f17c8159ec0 2023-10-14T18:51:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cee6a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80b5d30 con 0x7f17c80d05a0 2023-10-14T18:51:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41996/0 (socket says 172.21.15.79:41996) 2023-10-14T18:51:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 -- 172.21.15.79:0/1407206076 learned_addr learned my addr 172.21.15.79:0/1407206076 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17ccc06700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17c7fff700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c8159ec0 0x7f17c80b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 -- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 msgr2=0x7f17c8155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 -- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c8159ec0 msgr2=0x7f17c80b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c8159ec0 0x7f17c80b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 -- 172.21.15.79:0/1407206076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009420 con 0x7f17c815a290 2023-10-14T18:51:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17cd407700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f17c00093f0 tx=0x7f17c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.505+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000bb60 con 0x7f17c815a290 2023-10-14T18:51:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.506+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0027450 con 0x7f17c815a290 2023-10-14T18:51:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.506+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c80b6010 con 0x7f17c815a290 2023-10-14T18:51:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.506+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c00277f0 con 0x7f17c815a290 2023-10-14T18:51:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.506+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c80b65d0 con 0x7f17c815a290 2023-10-14T18:51:04.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.507+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c804c3c0 con 0x7f17c815a290 2023-10-14T18:51:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.507+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17c001a430 con 0x7f17c815a290 2023-10-14T18:51:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.507+0000 7f17c4ff9700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 0x7f17b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.507+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17c0086590 con 0x7f17c815a290 2023-10-14T18:51:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.508+0000 7f17ccc06700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 0x7f17b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.508+0000 7f17ccc06700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 0x7f17b40693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005c50 tx=0x7f17b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.512+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c00538b0 con 0x7f17c815a290 2023-10-14T18:51:04.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.695+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17c80b67c0 con 0x7f17c815a290 2023-10-14T18:51:04.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.695+0000 7f17c4ff9700 1 -- 172.21.15.79:0/1407206076 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17c0056ed0 con 0x7f17c815a290 2023-10-14T18:51:04.696 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:51:04.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 msgr2=0x7f17b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 0x7f17b40693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005c50 tx=0x7f17b8009040 comp rx=0 tx=0).stop 2023-10-14T18:51:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 msgr2=0x7f17c80c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f17c00093f0 tx=0x7f17c0017000 comp rx=0 tx=0).stop 2023-10-14T18:51:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 shutdown_connections 2023-10-14T18:51:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17b4066f30 0x7f17b40693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c815a290 0x7f17c80c8c60 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c80d05a0 0x7f17c8155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 --2- 172.21.15.79:0/1407206076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c8159ec0 0x7f17c80b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 >> 172.21.15.79:0/1407206076 conn(0x7f17c80d1880 msgr2=0x7f17c80cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 shutdown_connections 2023-10-14T18:51:04.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.697+0000 7f17cee6a700 1 -- 172.21.15.79:0/1407206076 wait complete. 2023-10-14T18:51:04.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:51:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.827+0000 7fab4a30f700 1 Processor -- start 2023-10-14T18:51:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.827+0000 7fab4a30f700 1 -- start start 2023-10-14T18:51:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4a30f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4a30f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4a30f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440b4d70 con 0x7fab440b6580 2023-10-14T18:51:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4a30f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440cd8d0 con 0x7fab440cce30 2023-10-14T18:51:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4a30f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b4440 con 0x7fab4406aa00 2023-10-14T18:51:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4930d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab48b0c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fab440b6580 0x7fab4406a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:53266/0 (socket says 172.21.15.79:53266) 2023-10-14T18:51:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:52014/0 (socket says 172.21.15.79:52014) 2023-10-14T18:51:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab48b0c700 1 -- 172.21.15.79:0/2128128134 learned_addr learned my addr 172.21.15.79:0/2128128134 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4930d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:58276/0 (socket says 172.21.15.79:58276) 2023-10-14T18:51:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 -- 172.21.15.79:0/2128128134 >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 msgr2=0x7fab4415aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 --2- 172.21.15.79:0/2128128134 >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 -- 172.21.15.79:0/2128128134 >> v1:172.21.15.144:6789/0 conn(0x7fab440b6580 legacy=0x7fab4406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab3bfff700 1 -- 172.21.15.79:0/2128128134 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762670079 0 0) 0x7fab440b4d70 con 0x7fab440b6580 2023-10-14T18:51:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab49b0e700 1 -- 172.21.15.79:0/2128128134 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440b4720 con 0x7fab4406aa00 2023-10-14T18:51:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.828+0000 7fab4930d700 1 --2- 172.21.15.79:0/2128128134 >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab49b0e700 1 --2- 172.21.15.79:0/2128128134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e60 tx=0x7fab3c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f7a929dd28127d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab3bfff700 1 -- 172.21.15.79:0/2128128134 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00e070 con 0x7fab4406aa00 2023-10-14T18:51:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab3bfff700 1 -- 172.21.15.79:0/2128128134 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00bb60 con 0x7fab4406aa00 2023-10-14T18:51:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab3bfff700 1 -- 172.21.15.79:0/2128128134 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c012430 con 0x7fab4406aa00 2023-10-14T18:51:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 -- 172.21.15.79:0/2128128134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 msgr2=0x7fab440b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 --2- 172.21.15.79:0/2128128134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e60 tx=0x7fab3c009780 comp rx=0 tx=0).stop 2023-10-14T18:51:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 -- 172.21.15.79:0/2128128134 shutdown_connections 2023-10-14T18:51:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 --2- 172.21.15.79:0/2128128134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab4406aa00 0x7fab440b5200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 --2- 172.21.15.79:0/2128128134 >> v2:172.21.15.144:3300/0 conn(0x7fab440cce30 0x7fab4415aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.829+0000 7fab4a30f700 1 -- 172.21.15.79:0/2128128134 >> 172.21.15.79:0/2128128134 conn(0x7fab44068cb0 msgr2=0x7fab440690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.830+0000 7fab4a30f700 1 -- 172.21.15.79:0/2128128134 shutdown_connections 2023-10-14T18:51:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.830+0000 7fab4a30f700 1 -- 172.21.15.79:0/2128128134 wait complete. 2023-10-14T18:51:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 Processor -- start 2023-10-14T18:51:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 -- start start 2023-10-14T18:51:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab440b6580 0x7fab441529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab440cce30 0x7fab44143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4416d2f0 con 0x7fab4406aa00 2023-10-14T18:51:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4416a260 con 0x7fab440cce30 2023-10-14T18:51:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.831+0000 7fab4a30f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4416a540 con 0x7fab440b6580 2023-10-14T18:51:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41998/0 (socket says 172.21.15.79:41998) 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 -- 172.21.15.79:0/3905813435 learned_addr learned my addr 172.21.15.79:0/3905813435 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab48b0c700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab440b6580 0x7fab441529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab49b0e700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab440cce30 0x7fab44143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 -- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab440b6580 msgr2=0x7fab441529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab440b6580 0x7fab441529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 -- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab440cce30 msgr2=0x7fab44143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab440cce30 0x7fab44143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 -- 172.21.15.79:0/3905813435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009420 con 0x7fab4406aa00 2023-10-14T18:51:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4930d700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fab4000ec80 tx=0x7fab400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000c9d0 con 0x7fab4406aa00 2023-10-14T18:51:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000cb30 con 0x7fab4406aa00 2023-10-14T18:51:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000ceb0 con 0x7fab4406aa00 2023-10-14T18:51:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c009a20 con 0x7fab4406aa00 2023-10-14T18:51:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.832+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4416ab00 con 0x7fab4406aa00 2023-10-14T18:51:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.833+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4416d490 con 0x7fab4406aa00 2023-10-14T18:51:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.834+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab40013680 con 0x7fab4406aa00 2023-10-14T18:51:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.834+0000 7fab397fa700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 0x7fab280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.834+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab400848d0 con 0x7fab4406aa00 2023-10-14T18:51:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.834+0000 7fab48b0c700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 0x7fab280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.835+0000 7fab48b0c700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 0x7fab280693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab44154ca0 tx=0x7fab34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:04.838+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab40051b40 con 0x7fab4406aa00 2023-10-14T18:51:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.018+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab440b4a00 con 0x7fab4406aa00 2023-10-14T18:51:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.018+0000 7fab397fa700 1 -- 172.21.15.79:0/3905813435 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab40055160 con 0x7fab4406aa00 2023-10-14T18:51:05.019 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:51:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 msgr2=0x7fab280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 0x7fab280693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fab44154ca0 tx=0x7fab34009040 comp rx=0 tx=0).stop 2023-10-14T18:51:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 msgr2=0x7fab440b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fab4000ec80 tx=0x7fab400091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 shutdown_connections 2023-10-14T18:51:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fab28066f30 0x7fab280693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab440cce30 0x7fab44143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab4406aa00 0x7fab440b1c30 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 --2- 172.21.15.79:0/3905813435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab440b6580 0x7fab441529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 >> 172.21.15.79:0/3905813435 conn(0x7fab44068cb0 msgr2=0x7fab440d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 shutdown_connections 2023-10-14T18:51:05.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.020+0000 7fab4a30f700 1 -- 172.21.15.79:0/3905813435 wait complete. 2023-10-14T18:51:05.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:51:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.150+0000 7f5f1998d700 1 Processor -- start 2023-10-14T18:51:05.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.150+0000 7f5f1998d700 1 -- start start 2023-10-14T18:51:05.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f1998d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f1415a290 0x7f5f1406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f1998d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f1406aae0 0x7f5f140cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f1998d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f140b0790 con 0x7f5f14159ec0 2023-10-14T18:51:05.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f1998d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1406af20 con 0x7f5f1406aae0 2023-10-14T18:51:05.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f1998d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f140ce1f0 con 0x7f5f1415a290 2023-10-14T18:51:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f1406aae0 0x7f5f140cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5f1406aae0 0x7f5f140cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42002/0 (socket says 172.21.15.79:42002) 2023-10-14T18:51:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 -- 172.21.15.79:0/1977062058 learned_addr learned my addr 172.21.15.79:0/1977062058 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f127fc700 1 --2- 172.21.15.79:0/1977062058 >> v2:172.21.15.144:3300/0 conn(0x7f5f1415a290 0x7f5f1406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 -- 172.21.15.79:0/1977062058 >> v2:172.21.15.144:3300/0 conn(0x7f5f1415a290 msgr2=0x7f5f1406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:05.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 --2- 172.21.15.79:0/1977062058 >> v2:172.21.15.144:3300/0 conn(0x7f5f1415a290 0x7f5f1406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 -- 172.21.15.79:0/1977062058 >> v1:172.21.15.144:6789/0 conn(0x7f5f14159ec0 legacy=0x7f5f140af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:05.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 -- 172.21.15.79:0/1977062058 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f140b0b20 con 0x7f5f1406aae0 2023-10-14T18:51:05.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f137fe700 1 --2- 172.21.15.79:0/1977062058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140cf590 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5f14089910 tx=0x7f5f0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec77b09799fa56fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f11ffb700 1 -- 172.21.15.79:0/1977062058 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00e070 con 0x7f5f1406aae0 2023-10-14T18:51:05.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f11ffb700 1 -- 172.21.15.79:0/1977062058 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c00ba50 con 0x7f5f1406aae0 2023-10-14T18:51:05.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.151+0000 7f5f11ffb700 1 -- 172.21.15.79:0/1977062058 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0092e0 con 0x7f5f1406aae0 2023-10-14T18:51:05.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 -- 172.21.15.79:0/1977062058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 msgr2=0x7f5f140cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 --2- 172.21.15.79:0/1977062058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140cf590 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5f14089910 tx=0x7f5f0c009840 comp rx=0 tx=0).stop 2023-10-14T18:51:05.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 -- 172.21.15.79:0/1977062058 shutdown_connections 2023-10-14T18:51:05.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 --2- 172.21.15.79:0/1977062058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140cf590 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 --2- 172.21.15.79:0/1977062058 >> v2:172.21.15.144:3300/0 conn(0x7f5f1415a290 0x7f5f1406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 -- 172.21.15.79:0/1977062058 >> 172.21.15.79:0/1977062058 conn(0x7f5f140d1880 msgr2=0x7f5f140cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 -- 172.21.15.79:0/1977062058 shutdown_connections 2023-10-14T18:51:05.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.152+0000 7f5f1998d700 1 -- 172.21.15.79:0/1977062058 wait complete. 2023-10-14T18:51:05.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.153+0000 7f5f1998d700 1 Processor -- start 2023-10-14T18:51:05.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.153+0000 7f5f1998d700 1 -- start start 2023-10-14T18:51:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f14159ec0 0x7f5f14141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1415a290 0x7f5f1416a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1416a540 con 0x7f5f1406aae0 2023-10-14T18:51:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f140ca600 con 0x7f5f1415a290 2023-10-14T18:51:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f1998d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1416a230 con 0x7f5f14159ec0 2023-10-14T18:51:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42008/0 (socket says 172.21.15.79:42008) 2023-10-14T18:51:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 -- 172.21.15.79:0/3771391376 learned_addr learned my addr 172.21.15.79:0/3771391376 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f137fe700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1415a290 0x7f5f1416a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f127fc700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f14159ec0 0x7f5f14141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 -- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f14159ec0 msgr2=0x7f5f14141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f14159ec0 0x7f5f14141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 -- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1415a290 msgr2=0x7f5f1416a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1415a290 0x7f5f1416a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 -- 172.21.15.79:0/3771391376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009ae0 con 0x7f5f1406aae0 2023-10-14T18:51:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.154+0000 7f5f12ffd700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c7c0 tx=0x7f5f04007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04011590 con 0x7f5f1406aae0 2023-10-14T18:51:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f040116f0 con 0x7f5f1406aae0 2023-10-14T18:51:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f14155bf0 con 0x7f5f1406aae0 2023-10-14T18:51:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04011ab0 con 0x7f5f1406aae0 2023-10-14T18:51:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f140cab30 con 0x7f5f1406aae0 2023-10-14T18:51:05.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.155+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1404c3c0 con 0x7f5f1406aae0 2023-10-14T18:51:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.156+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f0401b3b0 con 0x7f5f1406aae0 2023-10-14T18:51:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.156+0000 7f5efaffd700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 0x7f5f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.156+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f04083a30 con 0x7f5f1406aae0 2023-10-14T18:51:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.156+0000 7f5f127fc700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 0x7f5f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.157+0000 7f5f127fc700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 0x7f5f000693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5f140c9eb0 tx=0x7f5f08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.160+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f04050ca0 con 0x7f5f1406aae0 2023-10-14T18:51:05.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.342+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f140b04b0 con 0x7f5f1406aae0 2023-10-14T18:51:05.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.342+0000 7f5efaffd700 1 -- 172.21.15.79:0/3771391376 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f04017070 con 0x7f5f1406aae0 2023-10-14T18:51:05.343 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:51:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 msgr2=0x7f5f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 0x7f5f000693e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5f140c9eb0 tx=0x7f5f08008040 comp rx=0 tx=0).stop 2023-10-14T18:51:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 msgr2=0x7f5f140ca0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c7c0 tx=0x7f5f04007f40 comp rx=0 tx=0).stop 2023-10-14T18:51:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 shutdown_connections 2023-10-14T18:51:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5f00066f30 0x7f5f000693e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1415a290 0x7f5f1416a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f1406aae0 0x7f5f140ca0c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 --2- 172.21.15.79:0/3771391376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5f14159ec0 0x7f5f14141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 >> 172.21.15.79:0/3771391376 conn(0x7f5f140d1880 msgr2=0x7f5f140c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 shutdown_connections 2023-10-14T18:51:05.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.344+0000 7f5f1998d700 1 -- 172.21.15.79:0/3771391376 wait complete. 2023-10-14T18:51:05.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:05.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.470+0000 7f5c7595d700 1 Processor -- start 2023-10-14T18:51:05.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.470+0000 7f5c7595d700 1 -- start start 2023-10-14T18:51:05.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c7595d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c700cbc00 0x7f5c700c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c7595d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7015de60 con 0x7f5c700b1220 2023-10-14T18:51:05.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c7595d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7015e140 con 0x7f5c700b0e50 2023-10-14T18:51:05.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c7595d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7015e420 con 0x7f5c700cbc00 2023-10-14T18:51:05.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c6e7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5c700b1220 0x7f5c700cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34730/0 (socket says 172.21.15.79:34730) 2023-10-14T18:51:05.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c6e7fc700 1 -- 172.21.15.79:0/1126192750 learned_addr learned my addr 172.21.15.79:0/1126192750 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:05.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.471+0000 7f5c6f7fe700 1 --2- 172.21.15.79:0/1126192750 >> v2:172.21.15.144:3300/0 conn(0x7f5c700cbc00 0x7f5c700c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235890618 0 0) 0x7f5c7015de60 con 0x7f5c700b1220 2023-10-14T18:51:05.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c58003570 con 0x7f5c700b1220 2023-10-14T18:51:05.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887865592 0 0) 0x7f5c7015e140 con 0x7f5c700b0e50 2023-10-14T18:51:05.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c7015de60 con 0x7f5c700b0e50 2023-10-14T18:51:05.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1126192750 >> v1:172.21.15.144:6789/0 conn(0x7f5c700b0e50 legacy=0x7f5c7006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1126192750 >> v1:172.21.15.79:6789/0 conn(0x7f5c700b1220 legacy=0x7f5c700cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1126192750 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7015e700 con 0x7f5c700cbc00 2023-10-14T18:51:05.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6f7fe700 1 --2- 172.21.15.79:0/1126192750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700cbc00 0x7f5c700c9180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14dbbaadf80b5758 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68011630 con 0x7f5c700cbc00 2023-10-14T18:51:05.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68011790 con 0x7f5c700cbc00 2023-10-14T18:51:05.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.472+0000 7f5c6dffb700 1 -- 172.21.15.79:0/1126192750 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68011b30 con 0x7f5c700cbc00 2023-10-14T18:51:05.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 -- 172.21.15.79:0/1126192750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700cbc00 msgr2=0x7f5c700c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1126192750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700cbc00 0x7f5c700c9180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5c680098e0 tx=0x7f5c680091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 -- 172.21.15.79:0/1126192750 shutdown_connections 2023-10-14T18:51:05.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1126192750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700cbc00 0x7f5c700c9180 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 -- 172.21.15.79:0/1126192750 >> 172.21.15.79:0/1126192750 conn(0x7f5c70069870 msgr2=0x7f5c70069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 -- 172.21.15.79:0/1126192750 shutdown_connections 2023-10-14T18:51:05.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.473+0000 7f5c7595d700 1 -- 172.21.15.79:0/1126192750 wait complete. 2023-10-14T18:51:05.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.474+0000 7f5c7595d700 1 Processor -- start 2023-10-14T18:51:05.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.474+0000 7f5c7595d700 1 -- start start 2023-10-14T18:51:05.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700b0e50 0x7f5c700c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c700b1220 0x7f5c70157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70158f50 con 0x7f5c700cbc00 2023-10-14T18:51:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700c65f0 con 0x7f5c700b0e50 2023-10-14T18:51:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70158990 con 0x7f5c700b1220 2023-10-14T18:51:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42024/0 (socket says 172.21.15.79:42024) 2023-10-14T18:51:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1921120240 learned_addr learned my addr 172.21.15.79:0/1921120240 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6effd700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700b0e50 0x7f5c700c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6e7fc700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c700b1220 0x7f5c70157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c700b1220 msgr2=0x7f5c70157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c700b1220 0x7f5c70157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700b0e50 msgr2=0x7f5c700c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700b0e50 0x7f5c700c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 -- 172.21.15.79:0/1921120240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009420 con 0x7f5c700cbc00 2023-10-14T18:51:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c6f7fe700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5c68013000 tx=0x7f5c68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6801f070 con 0x7f5c700cbc00 2023-10-14T18:51:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c68002f70 con 0x7f5c700cbc00 2023-10-14T18:51:05.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68011630 con 0x7f5c700cbc00 2023-10-14T18:51:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.475+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70158c70 con 0x7f5c700cbc00 2023-10-14T18:51:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.476+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70155c10 con 0x7f5c700cbc00 2023-10-14T18:51:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.476+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c700c6760 con 0x7f5c700cbc00 2023-10-14T18:51:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.477+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c68023070 con 0x7f5c700cbc00 2023-10-14T18:51:05.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.477+0000 7f5c56ffd700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.477+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c68085720 con 0x7f5c700cbc00 2023-10-14T18:51:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.478+0000 7f5c6effd700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.478+0000 7f5c6effd700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 0x7f5c5c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5c60004140 tx=0x7f5c60007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.482+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c68052990 con 0x7f5c700cbc00 2023-10-14T18:51:05.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.706+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c7004c3c0 con 0x7f5c700cbc00 2023-10-14T18:51:05.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.707+0000 7f5c56ffd700 1 -- 172.21.15.79:0/1921120240 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f5c68015090 con 0x7f5c700cbc00 2023-10-14T18:51:05.708 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:05.708 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:51:05.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 msgr2=0x7f5c5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 0x7f5c5c0693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5c60004140 tx=0x7f5c60007f90 comp rx=0 tx=0).stop 2023-10-14T18:51:05.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 msgr2=0x7f5c70157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5c68013000 tx=0x7f5c68017000 comp rx=0 tx=0).stop 2023-10-14T18:51:05.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 shutdown_connections 2023-10-14T18:51:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c5c066f30 0x7f5c5c0693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c700cbc00 0x7f5c70157b70 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c700b0e50 0x7f5c700c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 --2- 172.21.15.79:0/1921120240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c700b1220 0x7f5c70157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.708+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 >> 172.21.15.79:0/1921120240 conn(0x7f5c70069870 msgr2=0x7f5c70067870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.709+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 shutdown_connections 2023-10-14T18:51:05.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.709+0000 7f5c7595d700 1 -- 172.21.15.79:0/1921120240 wait complete. 2023-10-14T18:51:05.712 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:51:05.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:05.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.835+0000 7ff1b1e46700 1 Processor -- start 2023-10-14T18:51:05.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.835+0000 7ff1b1e46700 1 -- start start 2023-10-14T18:51:05.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1b1e46700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1ac0cf1c0 0x7ff1ac15e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1b1e46700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1ac15a0c0 0x7ff1ac068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1b1e46700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0cca20 con 0x7ff1ac159cf0 2023-10-14T18:51:05.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1b1e46700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac15ea40 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1b1e46700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac067660 con 0x7ff1ac0cf1c0 2023-10-14T18:51:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1abfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1ac15a0c0 0x7ff1ac068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1abfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff1ac15a0c0 0x7ff1ac068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42038/0 (socket says 172.21.15.79:42038) 2023-10-14T18:51:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.836+0000 7ff1abfff700 1 -- 172.21.15.79:0/1213345248 learned_addr learned my addr 172.21.15.79:0/1213345248 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1aaffd700 1 --2- 172.21.15.79:0/1213345248 >> v2:172.21.15.144:3300/0 conn(0x7ff1ac0cf1c0 0x7ff1ac15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1abfff700 1 -- 172.21.15.79:0/1213345248 >> v2:172.21.15.144:3300/0 conn(0x7ff1ac0cf1c0 msgr2=0x7ff1ac15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1abfff700 1 --2- 172.21.15.79:0/1213345248 >> v2:172.21.15.144:3300/0 conn(0x7ff1ac0cf1c0 0x7ff1ac15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1abfff700 1 -- 172.21.15.79:0/1213345248 >> v1:172.21.15.144:6789/0 conn(0x7ff1ac159cf0 legacy=0x7ff1ac0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1abfff700 1 -- 172.21.15.79:0/1213345248 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac067f00 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1abfff700 1 --2- 172.21.15.79:0/1213345248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac068390 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac06a870 tx=0x7ff1a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a040e2e106dd699c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1aa7fc700 1 -- 172.21.15.79:0/1213345248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400b860 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1aa7fc700 1 -- 172.21.15.79:0/1213345248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400b9c0 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.837+0000 7ff1aa7fc700 1 -- 172.21.15.79:0/1213345248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400bd60 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 -- 172.21.15.79:0/1213345248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 msgr2=0x7ff1ac068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/1213345248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac068390 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac06a870 tx=0x7ff1a4009250 comp rx=0 tx=0).stop 2023-10-14T18:51:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 -- 172.21.15.79:0/1213345248 shutdown_connections 2023-10-14T18:51:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/1213345248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac068390 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/1213345248 >> v2:172.21.15.144:3300/0 conn(0x7ff1ac0cf1c0 0x7ff1ac15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 -- 172.21.15.79:0/1213345248 >> 172.21.15.79:0/1213345248 conn(0x7ff1ac06c6e0 msgr2=0x7ff1ac069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 -- 172.21.15.79:0/1213345248 shutdown_connections 2023-10-14T18:51:05.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.838+0000 7ff1b1e46700 1 -- 172.21.15.79:0/1213345248 wait complete. 2023-10-14T18:51:05.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.839+0000 7ff1b1e46700 1 Processor -- start 2023-10-14T18:51:05.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.839+0000 7ff1b1e46700 1 -- start start 2023-10-14T18:51:05.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 0x7ff1ac1445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 0x7ff1ac0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0c7d10 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac144af0 con 0x7ff1ac0cf1c0 2023-10-14T18:51:05.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0c6c70 con 0x7ff1ac159cf0 2023-10-14T18:51:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42044/0 (socket says 172.21.15.79:42044) 2023-10-14T18:51:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 -- 172.21.15.79:0/741745194 learned_addr learned my addr 172.21.15.79:0/741745194 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1ab7fe700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 0x7ff1ac1445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1aaffd700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 0x7ff1ac0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 -- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 msgr2=0x7ff1ac0b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 0x7ff1ac0b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 -- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 msgr2=0x7ff1ac1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 0x7ff1ac1445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 -- 172.21.15.79:0/741745194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40094f0 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1ab7fe700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 0x7ff1ac1445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:05.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1aaffd700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 0x7ff1ac0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:05.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1abfff700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009290 tx=0x7ff1a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a401a700 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a401a860 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac0c6f50 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a401ac20 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.840+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac0c7510 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.841+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac0c8e40 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.842+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1a402d440 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.842+0000 7ff1937fe700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.842+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1a40862b0 con 0x7ff1ac15a0c0 2023-10-14T18:51:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.842+0000 7ff1ab7fe700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.843+0000 7ff1ab7fe700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 0x7ff1980693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007fd0 tx=0x7ff19c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:05.846+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1a4053520 con 0x7ff1ac15a0c0 2023-10-14T18:51:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.030+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1ac04c3c0 con 0x7ff1ac15a0c0 2023-10-14T18:51:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.031+0000 7ff1937fe700 1 -- 172.21.15.79:0/741745194 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15372 (secure 0 0 0) 0x7ff1a405c030 con 0x7ff1ac15a0c0 2023-10-14T18:51:06.032 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:06.032 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:01.557270+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:06.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 msgr2=0x7ff1980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 0x7ff1980693e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007fd0 tx=0x7ff19c009040 comp rx=0 tx=0).stop 2023-10-14T18:51:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 msgr2=0x7ff1ac0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009290 tx=0x7ff1a4017000 comp rx=0 tx=0).stop 2023-10-14T18:51:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 shutdown_connections 2023-10-14T18:51:06.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff198066f30 0x7ff1980693e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1ac15a0c0 0x7ff1ac0cb3c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac0cf1c0 0x7ff1ac1445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 --2- 172.21.15.79:0/741745194 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1ac159cf0 0x7ff1ac0b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 >> 172.21.15.79:0/741745194 conn(0x7ff1ac06c6e0 msgr2=0x7ff1ac069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 shutdown_connections 2023-10-14T18:51:06.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.033+0000 7ff1b1e46700 1 -- 172.21.15.79:0/741745194 wait complete. 2023-10-14T18:51:06.046 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:51:06.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.160+0000 7fe7377d2700 1 Processor -- start 2023-10-14T18:51:06.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.160+0000 7fe7377d2700 1 -- start start 2023-10-14T18:51:06.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe73015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe73015a620 0x7fe73015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe73015d580 0x7fe730158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73015cbb0 con 0x7fe73015a620 2023-10-14T18:51:06.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73015bfa0 con 0x7fe73015d580 2023-10-14T18:51:06.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe7377d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73015c280 con 0x7fe730157870 2023-10-14T18:51:06.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe734d6d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe73015a620 0x7fe73015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe734d6d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe73015a620 0x7fe73015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42060/0 (socket says 172.21.15.79:42060) 2023-10-14T18:51:06.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe734d6d700 1 -- 172.21.15.79:0/2170699101 learned_addr learned my addr 172.21.15.79:0/2170699101 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:06.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe735d6f700 1 --2- 172.21.15.79:0/2170699101 >> v2:172.21.15.144:3300/0 conn(0x7fe73015d580 0x7fe730158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.161+0000 7fe73556e700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe73015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 -- 172.21.15.79:0/2170699101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 msgr2=0x7fe73015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe73015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 -- 172.21.15.79:0/2170699101 >> v2:172.21.15.144:3300/0 conn(0x7fe73015d580 msgr2=0x7fe730158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 --2- 172.21.15.79:0/2170699101 >> v2:172.21.15.144:3300/0 conn(0x7fe73015d580 0x7fe730158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 -- 172.21.15.79:0/2170699101 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73015c560 con 0x7fe73015a620 2023-10-14T18:51:06.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe734d6d700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe73015d040 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe7300b03b0 tx=0x7fe720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdebb55283ef77f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe727fff700 1 -- 172.21.15.79:0/2170699101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000b860 con 0x7fe73015a620 2023-10-14T18:51:06.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe727fff700 1 -- 172.21.15.79:0/2170699101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000b9c0 con 0x7fe73015a620 2023-10-14T18:51:06.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe727fff700 1 -- 172.21.15.79:0/2170699101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000bd60 con 0x7fe73015a620 2023-10-14T18:51:06.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe7377d2700 1 -- 172.21.15.79:0/2170699101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 msgr2=0x7fe73015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe7377d2700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe73015d040 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe7300b03b0 tx=0x7fe720009250 comp rx=0 tx=0).stop 2023-10-14T18:51:06.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.162+0000 7fe7377d2700 1 -- 172.21.15.79:0/2170699101 shutdown_connections 2023-10-14T18:51:06.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe73015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 --2- 172.21.15.79:0/2170699101 >> v2:172.21.15.144:3300/0 conn(0x7fe73015d580 0x7fe730158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 --2- 172.21.15.79:0/2170699101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe73015d040 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 -- 172.21.15.79:0/2170699101 >> 172.21.15.79:0/2170699101 conn(0x7fe730068ce0 msgr2=0x7fe7300690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 -- 172.21.15.79:0/2170699101 shutdown_connections 2023-10-14T18:51:06.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.163+0000 7fe7377d2700 1 -- 172.21.15.79:0/2170699101 wait complete. 2023-10-14T18:51:06.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.164+0000 7fe7377d2700 1 Processor -- start 2023-10-14T18:51:06.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.164+0000 7fe7377d2700 1 -- start start 2023-10-14T18:51:06.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.164+0000 7fe7377d2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe7300cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73015d580 0x7fe7300b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300d0ba0 con 0x7fe73015a620 2023-10-14T18:51:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300d0020 con 0x7fe73015d580 2023-10-14T18:51:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300d0300 con 0x7fe730157870 2023-10-14T18:51:06.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42072/0 (socket says 172.21.15.79:42072) 2023-10-14T18:51:06.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 -- 172.21.15.79:0/618293689 learned_addr learned my addr 172.21.15.79:0/618293689 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:06.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe735d6f700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73015d580 0x7fe7300b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe73556e700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe7300cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 -- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 msgr2=0x7fe7300cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe7300cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 -- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73015d580 msgr2=0x7fe7300b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73015d580 0x7fe7300b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 -- 172.21.15.79:0/618293689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200094f0 con 0x7fe73015a620 2023-10-14T18:51:06.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe73556e700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe7300cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:06.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe734d6d700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe73006b530 tx=0x7fe720017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720011e70 con 0x7fe73015a620 2023-10-14T18:51:06.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe720024440 con 0x7fe73015a620 2023-10-14T18:51:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7300d05e0 con 0x7fe73015a620 2023-10-14T18:51:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720024800 con 0x7fe73015a620 2023-10-14T18:51:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.165+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7300b1570 con 0x7fe73015a620 2023-10-14T18:51:06.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.166+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7300b0810 con 0x7fe73015a620 2023-10-14T18:51:06.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.167+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe72001a420 con 0x7fe73015a620 2023-10-14T18:51:06.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.167+0000 7fe7257fa700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 0x7fe7140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.167+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7200863e0 con 0x7fe73015a620 2023-10-14T18:51:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.167+0000 7fe73556e700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 0x7fe7140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.168+0000 7fe73556e700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 0x7fe7140693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0075e0 tx=0x7fe72c0097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.171+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7300b0810 con 0x7fe73015a620 2023-10-14T18:51:06.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.403+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7300b0810 con 0x7fe73015a620 2023-10-14T18:51:06.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.403+0000 7fe7257fa700 1 -- 172.21.15.79:0/618293689 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe7300b0810 con 0x7fe73015a620 2023-10-14T18:51:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:06.404 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:51:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 msgr2=0x7fe7140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 0x7fe7140693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0075e0 tx=0x7fe72c0097e0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 msgr2=0x7fe7300b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe73006b530 tx=0x7fe720017000 comp rx=0 tx=0).stop 2023-10-14T18:51:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 shutdown_connections 2023-10-14T18:51:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe714066f30 0x7fe7140693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73015d580 0x7fe7300b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe730157870 0x7fe7300cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 --2- 172.21.15.79:0/618293689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73015a620 0x7fe7300b0af0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 >> 172.21.15.79:0/618293689 conn(0x7fe730068ce0 msgr2=0x7fe73015da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 shutdown_connections 2023-10-14T18:51:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.405+0000 7fe7377d2700 1 -- 172.21.15.79:0/618293689 wait complete. 2023-10-14T18:51:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:51:06.418 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:06.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.532+0000 7fdf2f59e700 1 Processor -- start 2023-10-14T18:51:06.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.532+0000 7fdf2f59e700 1 -- start start 2023-10-14T18:51:06.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 0x7fdf300cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2f59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf300ab0e0 0x7fdf300ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2f59e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300c76b0 con 0x7fdf3006ae40 2023-10-14T18:51:06.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2f59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300ccc10 con 0x7fdf300ab0e0 2023-10-14T18:51:06.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300c7900 con 0x7fdf3006aa70 2023-10-14T18:51:06.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf300ab0e0 0x7fdf300ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdf3006ae40 0x7fdf300cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34740/0 (socket says 172.21.15.79:34740) 2023-10-14T18:51:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2dd9b700 1 -- 172.21.15.79:0/242828421 learned_addr learned my addr 172.21.15.79:0/242828421 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf300ab0e0 0x7fdf300ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42088/0 (socket says 172.21.15.79:42088) 2023-10-14T18:51:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2e59c700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 0x7fdf300cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2ed9d700 1 -- 172.21.15.79:0/242828421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 msgr2=0x7fdf300cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.533+0000 7fdf2ed9d700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 0x7fdf300cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2ed9d700 1 -- 172.21.15.79:0/242828421 >> v1:172.21.15.79:6789/0 conn(0x7fdf3006ae40 legacy=0x7fdf300cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2d59a700 1 -- 172.21.15.79:0/242828421 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639006031 0 0) 0x7fdf300c76b0 con 0x7fdf3006ae40 2023-10-14T18:51:06.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2ed9d700 1 -- 172.21.15.79:0/242828421 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300c7be0 con 0x7fdf300ab0e0 2023-10-14T18:51:06.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2e59c700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 0x7fdf300cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:06.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2ed9d700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf300ab0e0 0x7fdf300ab540 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e60 tx=0x7fdf28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a0e813af47d387 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2d59a700 1 -- 172.21.15.79:0/242828421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800e070 con 0x7fdf300ab0e0 2023-10-14T18:51:06.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2d59a700 1 -- 172.21.15.79:0/242828421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800bc30 con 0x7fdf300ab0e0 2023-10-14T18:51:06.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2d59a700 1 -- 172.21.15.79:0/242828421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28012430 con 0x7fdf300ab0e0 2023-10-14T18:51:06.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 -- 172.21.15.79:0/242828421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf300ab0e0 msgr2=0x7fdf300ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf300ab0e0 0x7fdf300ab540 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009e60 tx=0x7fdf28009780 comp rx=0 tx=0).stop 2023-10-14T18:51:06.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 -- 172.21.15.79:0/242828421 shutdown_connections 2023-10-14T18:51:06.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf300ab0e0 0x7fdf300ab540 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/242828421 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf3006aa70 0x7fdf300cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 -- 172.21.15.79:0/242828421 >> 172.21.15.79:0/242828421 conn(0x7fdf300cd070 msgr2=0x7fdf300cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 -- 172.21.15.79:0/242828421 shutdown_connections 2023-10-14T18:51:06.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.534+0000 7fdf2f59e700 1 -- 172.21.15.79:0/242828421 wait complete. 2023-10-14T18:51:06.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.535+0000 7fdf2f59e700 1 Processor -- start 2023-10-14T18:51:06.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 -- start start 2023-10-14T18:51:06.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf3006aa70 0x7fdf300afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf300ab0e0 0x7fdf3006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300996a0 con 0x7fdf3006ae40 2023-10-14T18:51:06.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300ac5a0 con 0x7fdf3006aa70 2023-10-14T18:51:06.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300ac2c0 con 0x7fdf300ab0e0 2023-10-14T18:51:06.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42102/0 (socket says 172.21.15.79:42102) 2023-10-14T18:51:06.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.536+0000 7fdf2dd9b700 1 -- 172.21.15.79:0/1619598331 learned_addr learned my addr 172.21.15.79:0/1619598331 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:06.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2e59c700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf3006aa70 0x7fdf300afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2ed9d700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf300ab0e0 0x7fdf3006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 -- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf300ab0e0 msgr2=0x7fdf3006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf300ab0e0 0x7fdf3006dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 -- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf3006aa70 msgr2=0x7fdf300afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf3006aa70 0x7fdf300afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 -- 172.21.15.79:0/1619598331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009a20 con 0x7fdf3006ae40 2023-10-14T18:51:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2dd9b700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400c7e0 tx=0x7fdf24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24005b30 con 0x7fdf3006ae40 2023-10-14T18:51:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf24005c90 con 0x7fdf3006ae40 2023-10-14T18:51:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf30099050 con 0x7fdf3006ae40 2023-10-14T18:51:06.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24007300 con 0x7fdf3006ae40 2023-10-14T18:51:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.537+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf30153920 con 0x7fdf3006ae40 2023-10-14T18:51:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.538+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf30099810 con 0x7fdf3006ae40 2023-10-14T18:51:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.538+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf2401b400 con 0x7fdf3006ae40 2023-10-14T18:51:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.539+0000 7fdf1e7fc700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 0x7fdf100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.539+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf240840f0 con 0x7fdf3006ae40 2023-10-14T18:51:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.539+0000 7fdf2e59c700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 0x7fdf100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.539+0000 7fdf2e59c700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 0x7fdf100693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdf20008a50 tx=0x7fdf20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.543+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf240513e0 con 0x7fdf3006ae40 2023-10-14T18:51:06.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.765+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf300c7ec0 con 0x7fdf3006ae40 2023-10-14T18:51:06.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.765+0000 7fdf1e7fc700 1 -- 172.21.15.79:0/1619598331 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fdf24054a00 con 0x7fdf3006ae40 2023-10-14T18:51:06.766 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:06.767 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:50:44.919609+0000","modified":"2023-10-14T18:50:48.827701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1942025905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1942025905},{"type":"v1","addr":"172.21.15.79:6835","nonce":1942025905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-14T18:51:06.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 msgr2=0x7fdf100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 0x7fdf100693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdf20008a50 tx=0x7fdf20008040 comp rx=0 tx=0).stop 2023-10-14T18:51:06.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 msgr2=0x7fdf301533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400c7e0 tx=0x7fdf24007df0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 shutdown_connections 2023-10-14T18:51:06.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdf10066f30 0x7fdf100693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdf300ab0e0 0x7fdf3006dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf3006aa70 0x7fdf300afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 --2- 172.21.15.79:0/1619598331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf3006ae40 0x7fdf301533e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 >> 172.21.15.79:0/1619598331 conn(0x7fdf300cd070 msgr2=0x7fdf30063bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 shutdown_connections 2023-10-14T18:51:06.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.767+0000 7fdf2f59e700 1 -- 172.21.15.79:0/1619598331 wait complete. 2023-10-14T18:51:06.771 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 56 2023-10-14T18:51:06.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:06.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.893+0000 7fd38c7b5700 1 Processor -- start 2023-10-14T18:51:06.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.894+0000 7fd38c7b5700 1 -- start start 2023-10-14T18:51:06.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.894+0000 7fd38c7b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3841577d0 0x7fd3840cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38c7b5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd384157ba0 0x7fd38406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38c7b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38415b0d0 0x7fd38406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38c7b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38415c360 con 0x7fd38415b0d0 2023-10-14T18:51:06.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38c7b5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38415b790 con 0x7fd384157ba0 2023-10-14T18:51:06.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38c7b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38415ba30 con 0x7fd3841577d0 2023-10-14T18:51:06.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38415b0d0 0x7fd38406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd38415b0d0 0x7fd38406aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42108/0 (socket says 172.21.15.79:42108) 2023-10-14T18:51:06.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 -- 172.21.15.79:0/1466103276 learned_addr learned my addr 172.21.15.79:0/1466103276 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:06.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38a551700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3841577d0 0x7fd3840cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd389d50700 1 --2- 172.21.15.79:0/1466103276 >> v2:172.21.15.144:3300/0 conn(0x7fd384157ba0 0x7fd38406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 -- 172.21.15.79:0/1466103276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3841577d0 msgr2=0x7fd3840cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3841577d0 0x7fd3840cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 -- 172.21.15.79:0/1466103276 >> v2:172.21.15.144:3300/0 conn(0x7fd384157ba0 msgr2=0x7fd38406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:06.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1466103276 >> v2:172.21.15.144:3300/0 conn(0x7fd384157ba0 0x7fd38406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 -- 172.21.15.79:0/1466103276 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38415bd10 con 0x7fd38415b0d0 2023-10-14T18:51:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38406aa60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd38406b840 tx=0x7fd37c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cc9173d9c9f24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38954f700 1 -- 172.21.15.79:0/1466103276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00e070 con 0x7fd38415b0d0 2023-10-14T18:51:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38954f700 1 -- 172.21.15.79:0/1466103276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00ba50 con 0x7fd38415b0d0 2023-10-14T18:51:06.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.895+0000 7fd38954f700 1 -- 172.21.15.79:0/1466103276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0092e0 con 0x7fd38415b0d0 2023-10-14T18:51:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1466103276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 msgr2=0x7fd38406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38406aa60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd38406b840 tx=0x7fd37c009840 comp rx=0 tx=0).stop 2023-10-14T18:51:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1466103276 shutdown_connections 2023-10-14T18:51:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd3841577d0 0x7fd3840cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1466103276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38406aa60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1466103276 >> v2:172.21.15.144:3300/0 conn(0x7fd384157ba0 0x7fd38406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1466103276 >> 172.21.15.79:0/1466103276 conn(0x7fd384068ce0 msgr2=0x7fd3840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:06.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1466103276 shutdown_connections 2023-10-14T18:51:06.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.896+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1466103276 wait complete. 2023-10-14T18:51:06.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.897+0000 7fd38c7b5700 1 Processor -- start 2023-10-14T18:51:06.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.897+0000 7fd38c7b5700 1 -- start start 2023-10-14T18:51:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3841577d0 0x7fd3840b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd384157ba0 0x7fd3840b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b0ba0 con 0x7fd38415b0d0 2023-10-14T18:51:06.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b0e80 con 0x7fd3841577d0 2023-10-14T18:51:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b1160 con 0x7fd384157ba0 2023-10-14T18:51:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42122/0 (socket says 172.21.15.79:42122) 2023-10-14T18:51:06.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 -- 172.21.15.79:0/1930789441 learned_addr learned my addr 172.21.15.79:0/1930789441 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd389d50700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd384157ba0 0x7fd3840b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38a551700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3841577d0 0x7fd3840b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 -- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd384157ba0 msgr2=0x7fd3840b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd384157ba0 0x7fd3840b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 -- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3841577d0 msgr2=0x7fd3840b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:06.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3841577d0 0x7fd3840b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:06.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 -- 172.21.15.79:0/1930789441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009ae0 con 0x7fd38415b0d0 2023-10-14T18:51:06.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38ad52700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd38406b580 tx=0x7fd37c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0032f0 con 0x7fd38415b0d0 2023-10-14T18:51:06.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c007d10 con 0x7fd38415b0d0 2023-10-14T18:51:06.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38416b120 con 0x7fd38415b0d0 2023-10-14T18:51:06.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c01e680 con 0x7fd38415b0d0 2023-10-14T18:51:06.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.898+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3840b1440 con 0x7fd38415b0d0 2023-10-14T18:51:06.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.899+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38404c3c0 con 0x7fd38415b0d0 2023-10-14T18:51:06.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.900+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd37c003040 con 0x7fd38415b0d0 2023-10-14T18:51:06.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.900+0000 7fd37a7fc700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 0x7fd3680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:06.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.900+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd37c086680 con 0x7fd38415b0d0 2023-10-14T18:51:06.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.900+0000 7fd38a551700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 0x7fd3680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:06.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.901+0000 7fd38a551700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 0x7fd3680693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd380006fd0 tx=0x7fd380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:06.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:06.904+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd37c0538f0 con 0x7fd38415b0d0 2023-10-14T18:51:07.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.086+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd38415bff0 con 0x7fd38415b0d0 2023-10-14T18:51:07.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.087+0000 7fd37a7fc700 1 -- 172.21.15.79:0/1930789441 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fd37c009940 con 0x7fd38415b0d0 2023-10-14T18:51:07.088 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:07.088 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":126,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:01.557270+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:50:42.563962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-14T18:50:43.888336+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:07.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 msgr2=0x7fd3680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 0x7fd3680693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd380006fd0 tx=0x7fd380008040 comp rx=0 tx=0).stop 2023-10-14T18:51:07.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 msgr2=0x7fd38414bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd38406b580 tx=0x7fd37c018000 comp rx=0 tx=0).stop 2023-10-14T18:51:07.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 shutdown_connections 2023-10-14T18:51:07.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd368066f30 0x7fd3680693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd38415b0d0 0x7fd38414bc80 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3841577d0 0x7fd3840b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 --2- 172.21.15.79:0/1930789441 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd384157ba0 0x7fd3840b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 >> 172.21.15.79:0/1930789441 conn(0x7fd384068ce0 msgr2=0x7fd38406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 shutdown_connections 2023-10-14T18:51:07.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.089+0000 7fd38c7b5700 1 -- 172.21.15.79:0/1930789441 wait complete. 2023-10-14T18:51:07.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:51:07.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.215+0000 7f084023c700 1 Processor -- start 2023-10-14T18:51:07.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.215+0000 7f084023c700 1 -- start start 2023-10-14T18:51:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f084023c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0838157870 0x7f083815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f084023c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0838157c40 0x7f0838158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f084023c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083815cbb0 con 0x7f083815a620 2023-10-14T18:51:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f084023c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083815bfa0 con 0x7f0838157c40 2023-10-14T18:51:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f084023c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083815c280 con 0x7f0838157870 2023-10-14T18:51:07.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f083e7d9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0838157c40 0x7f0838158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f083d7d7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f083815a620 0x7f083815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34752/0 (socket says 172.21.15.79:34752) 2023-10-14T18:51:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f083d7d7700 1 -- 172.21.15.79:0/1868882851 learned_addr learned my addr 172.21.15.79:0/1868882851 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.216+0000 7f083dfd8700 1 --2- 172.21.15.79:0/1868882851 >> v2:172.21.15.144:3300/0 conn(0x7f0838157870 0x7f083815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083e7d9700 1 -- 172.21.15.79:0/1868882851 >> v2:172.21.15.144:3300/0 conn(0x7f0838157870 msgr2=0x7f083815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:07.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083e7d9700 1 --2- 172.21.15.79:0/1868882851 >> v2:172.21.15.144:3300/0 conn(0x7f0838157870 0x7f083815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083e7d9700 1 -- 172.21.15.79:0/1868882851 >> v1:172.21.15.79:6789/0 conn(0x7f083815a620 legacy=0x7f083815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083e7d9700 1 -- 172.21.15.79:0/1868882851 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083815c560 con 0x7f0838157c40 2023-10-14T18:51:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083cfd6700 1 -- 172.21.15.79:0/1868882851 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465301838 0 0) 0x7f083815cbb0 con 0x7f083815a620 2023-10-14T18:51:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083e7d9700 1 --2- 172.21.15.79:0/1868882851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f0838158110 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0838069d80 tx=0x7f08300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cb02e18f2987df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083cfd6700 1 -- 172.21.15.79:0/1868882851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830011630 con 0x7f0838157c40 2023-10-14T18:51:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083cfd6700 1 -- 172.21.15.79:0/1868882851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830011790 con 0x7f0838157c40 2023-10-14T18:51:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f083cfd6700 1 -- 172.21.15.79:0/1868882851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830011b30 con 0x7f0838157c40 2023-10-14T18:51:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 -- 172.21.15.79:0/1868882851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 msgr2=0x7f0838158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 --2- 172.21.15.79:0/1868882851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f0838158110 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0838069d80 tx=0x7f08300091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 -- 172.21.15.79:0/1868882851 shutdown_connections 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 --2- 172.21.15.79:0/1868882851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f0838158110 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 --2- 172.21.15.79:0/1868882851 >> v2:172.21.15.144:3300/0 conn(0x7f0838157870 0x7f083815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.217+0000 7f084023c700 1 -- 172.21.15.79:0/1868882851 >> 172.21.15.79:0/1868882851 conn(0x7f0838068ce0 msgr2=0x7f08380690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.218+0000 7f084023c700 1 -- 172.21.15.79:0/1868882851 shutdown_connections 2023-10-14T18:51:07.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.218+0000 7f084023c700 1 -- 172.21.15.79:0/1868882851 wait complete. 2023-10-14T18:51:07.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 Processor -- start 2023-10-14T18:51:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 -- start start 2023-10-14T18:51:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0838157870 0x7f08381535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f083815a620 0x7f08381600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083816a3a0 con 0x7f0838157c40 2023-10-14T18:51:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08380b2fe0 con 0x7f083815a620 2023-10-14T18:51:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f084023c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08380b2740 con 0x7f0838157870 2023-10-14T18:51:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.219+0000 7f083d7d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42140/0 (socket says 172.21.15.79:42140) 2023-10-14T18:51:07.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 -- 172.21.15.79:0/1090516484 learned_addr learned my addr 172.21.15.79:0/1090516484 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083dfd8700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0838157870 0x7f08381535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083e7d9700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f083815a620 0x7f08381600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 -- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0838157870 msgr2=0x7f08381535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0838157870 0x7f08381535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 -- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f083815a620 msgr2=0x7f08381600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f083815a620 0x7f08381600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 -- 172.21.15.79:0/1090516484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830009420 con 0x7f0838157c40 2023-10-14T18:51:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f083d7d7700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f082800c5e0 tx=0x7f0828000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828005b30 con 0x7f0838157c40 2023-10-14T18:51:07.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828005c90 con 0x7f0838157c40 2023-10-14T18:51:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280072e0 con 0x7f0838157c40 2023-10-14T18:51:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08380b2a20 con 0x7f0838157c40 2023-10-14T18:51:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.220+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083816a590 con 0x7f0838157c40 2023-10-14T18:51:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.221+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083816a7b0 con 0x7f0838157c40 2023-10-14T18:51:07.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.221+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f082801b3b0 con 0x7f0838157c40 2023-10-14T18:51:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.222+0000 7f082dffb700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 0x7f081c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.222+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0828083880 con 0x7f0838157c40 2023-10-14T18:51:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.222+0000 7f083dfd8700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 0x7f081c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.222+0000 7f083dfd8700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 0x7f081c0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f083400f570 tx=0x7f083400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.226+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f082804b5a0 con 0x7f0838157c40 2023-10-14T18:51:07.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.449+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f083804c3c0 con 0x7f0838157c40 2023-10-14T18:51:07.450 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:51:07.449+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:51:07.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.454+0000 7f082dffb700 1 -- 172.21.15.79:0/1090516484 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0828017090 con 0x7f0838157c40 2023-10-14T18:51:07.456 INFO:tasks.ceph.mds.c.smithi079.stderr: -3441> 2023-10-14T18:50:50.123+0000 7f156de46700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:51:07.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 msgr2=0x7f081c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 0x7f081c0693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f083400f570 tx=0x7f083400b040 comp rx=0 tx=0).stop 2023-10-14T18:51:07.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 msgr2=0x7f083815fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f082800c5e0 tx=0x7f0828000fe0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 shutdown_connections 2023-10-14T18:51:07.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f081c066f30 0x7f081c0693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f083815a620 0x7f08381600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0838157870 0x7f08381535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 --2- 172.21.15.79:0/1090516484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838157c40 0x7f083815fb90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 >> 172.21.15.79:0/1090516484 conn(0x7f0838068ce0 msgr2=0x7f08381580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:07.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.459+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 shutdown_connections 2023-10-14T18:51:07.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.460+0000 7f084023c700 1 -- 172.21.15.79:0/1090516484 wait complete. 2023-10-14T18:51:07.463 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:51:07.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:51:07.481 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:51:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.591+0000 7f4a5759e700 1 Processor -- start 2023-10-14T18:51:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.591+0000 7f4a5759e700 1 -- start start 2023-10-14T18:51:07.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5759e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a58151ce0 0x7f4a581520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a580ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5759e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5815c3c0 con 0x7f4a580ca250 2023-10-14T18:51:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5759e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a581525f0 con 0x7f4a58151ce0 2023-10-14T18:51:07.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58159090 con 0x7f4a5806f4b0 2023-10-14T18:51:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a5659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a58151ce0 0x7f4a581520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a55d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a580ca250 0x7f4a5806eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34766/0 (socket says 172.21.15.79:34766) 2023-10-14T18:51:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.592+0000 7f4a55d9b700 1 -- 172.21.15.79:0/4226110111 learned_addr learned my addr 172.21.15.79:0/4226110111 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a56d9d700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a580ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a5659c700 1 -- 172.21.15.79:0/4226110111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 msgr2=0x7f4a580ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:07.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a5659c700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a580ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a5659c700 1 -- 172.21.15.79:0/4226110111 >> v1:172.21.15.79:6789/0 conn(0x7f4a580ca250 legacy=0x7f4a5806eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a5659c700 1 -- 172.21.15.79:0/4226110111 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5815b7b0 con 0x7f4a58151ce0 2023-10-14T18:51:07.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.593+0000 7f4a5659c700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a581520b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098e0 tx=0x7f4a480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afc81a283550466 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5559a700 1 -- 172.21.15.79:0/4226110111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48009e80 con 0x7f4a58151ce0 2023-10-14T18:51:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5559a700 1 -- 172.21.15.79:0/4226110111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800b860 con 0x7f4a58151ce0 2023-10-14T18:51:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5559a700 1 -- 172.21.15.79:0/4226110111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800bbe0 con 0x7f4a58151ce0 2023-10-14T18:51:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 -- 172.21.15.79:0/4226110111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 msgr2=0x7f4a581520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a581520b0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f4a480098e0 tx=0x7f4a480091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 -- 172.21.15.79:0/4226110111 shutdown_connections 2023-10-14T18:51:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a580ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 --2- 172.21.15.79:0/4226110111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a581520b0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 -- 172.21.15.79:0/4226110111 >> 172.21.15.79:0/4226110111 conn(0x7f4a580cdba0 msgr2=0x7f4a580c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 -- 172.21.15.79:0/4226110111 shutdown_connections 2023-10-14T18:51:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.595+0000 7f4a5759e700 1 -- 172.21.15.79:0/4226110111 wait complete. 2023-10-14T18:51:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.596+0000 7f4a5759e700 1 Processor -- start 2023-10-14T18:51:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.596+0000 7f4a5759e700 1 -- start start 2023-10-14T18:51:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a58154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a580ca250 0x7f4a581527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c4ac0 con 0x7f4a58151ce0 2023-10-14T18:51:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c4da0 con 0x7f4a580ca250 2023-10-14T18:51:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c5080 con 0x7f4a5806f4b0 2023-10-14T18:51:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a56d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a56d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42174/0 (socket says 172.21.15.79:42174) 2023-10-14T18:51:07.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a56d9d700 1 -- 172.21.15.79:0/19327479 learned_addr learned my addr 172.21.15.79:0/19327479 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:07.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a5659c700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a58154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.597+0000 7f4a55d9b700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a580ca250 0x7f4a581527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 -- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 msgr2=0x7f4a58154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a58154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 -- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a580ca250 msgr2=0x7f4a581527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:07.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a580ca250 0x7f4a581527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:07.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 -- 172.21.15.79:0/19327479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009420 con 0x7f4a58151ce0 2023-10-14T18:51:07.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a56d9d700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007f30 tx=0x7f4a500098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000eb90 con 0x7f4a58151ce0 2023-10-14T18:51:07.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000ecf0 con 0x7f4a58151ce0 2023-10-14T18:51:07.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580b17a0 con 0x7f4a58151ce0 2023-10-14T18:51:07.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50014670 con 0x7f4a58151ce0 2023-10-14T18:51:07.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.598+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a58154c60 con 0x7f4a58151ce0 2023-10-14T18:51:07.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.599+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5806cb50 con 0x7f4a58151ce0 2023-10-14T18:51:07.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.599+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a50014a20 con 0x7f4a58151ce0 2023-10-14T18:51:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.599+0000 7f4a467fc700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.600+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4a50084c10 con 0x7f4a58151ce0 2023-10-14T18:51:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.600+0000 7f4a5659c700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.600+0000 7f4a5659c700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 0x7f4a380693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4a480091e0 tx=0x7f4a48017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.604+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a50051e30 con 0x7f4a58151ce0 2023-10-14T18:51:07.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:07.828+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a5815ba90 con 0x7f4a58151ce0 2023-10-14T18:51:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.454+0000 7f4a467fc700 1 -- 172.21.15.79:0/19327479 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a5000ee60 con 0x7f4a58151ce0 2023-10-14T18:51:08.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 msgr2=0x7f4a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 0x7f4a380693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4a480091e0 tx=0x7f4a48017000 comp rx=0 tx=0).stop 2023-10-14T18:51:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 msgr2=0x7f4a580c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4a50007f30 tx=0x7f4a500098e0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 shutdown_connections 2023-10-14T18:51:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58151ce0 0x7f4a580c40e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806f4b0 0x7f4a58154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 --2- 172.21.15.79:0/19327479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a580ca250 0x7f4a581527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 >> 172.21.15.79:0/19327479 conn(0x7f4a580cdba0 msgr2=0x7f4a581598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 shutdown_connections 2023-10-14T18:51:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.456+0000 7f4a5759e700 1 -- 172.21.15.79:0/19327479 wait complete. 2023-10-14T18:51:08.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:51:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.631+0000 7f4171195700 1 Processor -- start 2023-10-14T18:51:08.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.631+0000 7f4171195700 1 -- start start 2023-10-14T18:51:08.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f4171195700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f416c159ef0 0x7f416c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f4171195700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f416c0b46f0 0x7f416c0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f4171195700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c0b17b0 con 0x7f416c0b6a10 2023-10-14T18:51:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f4171195700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c0b5020 con 0x7f416c159ef0 2023-10-14T18:51:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f4171195700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c0b1a60 con 0x7f416c0b46f0 2023-10-14T18:51:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f416ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f416c159ef0 0x7f416c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:08.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f416a59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f416c0b6a10 0x7f416c0b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40722/0 (socket says 172.21.15.79:40722) 2023-10-14T18:51:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f416ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f416c159ef0 0x7f416c15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45948/0 (socket says 172.21.15.79:45948) 2023-10-14T18:51:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.632+0000 7f416a59c700 1 -- 172.21.15.79:0/2015170781 learned_addr learned my addr 172.21.15.79:0/2015170781 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416b59e700 1 --2- 172.21.15.79:0/2015170781 >> v2:172.21.15.144:3300/0 conn(0x7f416c0b46f0 0x7f416c0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416ad9d700 1 -- 172.21.15.79:0/2015170781 >> v2:172.21.15.144:3300/0 conn(0x7f416c0b46f0 msgr2=0x7f416c0b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:08.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416ad9d700 1 --2- 172.21.15.79:0/2015170781 >> v2:172.21.15.144:3300/0 conn(0x7f416c0b46f0 0x7f416c0b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416ad9d700 1 -- 172.21.15.79:0/2015170781 >> v1:172.21.15.79:6789/0 conn(0x7f416c0b6a10 legacy=0x7f416c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416ad9d700 1 -- 172.21.15.79:0/2015170781 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0b1d40 con 0x7f416c159ef0 2023-10-14T18:51:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4169d9b700 1 -- 172.21.15.79:0/2015170781 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046531869 0 0) 0x7f416c0b17b0 con 0x7f416c0b6a10 2023-10-14T18:51:08.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f416ad9d700 1 --2- 172.21.15.79:0/2015170781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c159ef0 0x7f416c15a2c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f416c15a800 tx=0x7f415c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ce2d6a5ad80d42 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4169d9b700 1 -- 172.21.15.79:0/2015170781 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c00e070 con 0x7f416c159ef0 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4169d9b700 1 -- 172.21.15.79:0/2015170781 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c00bc30 con 0x7f416c159ef0 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4169d9b700 1 -- 172.21.15.79:0/2015170781 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c012430 con 0x7f416c159ef0 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 -- 172.21.15.79:0/2015170781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c159ef0 msgr2=0x7f416c15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 --2- 172.21.15.79:0/2015170781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c159ef0 0x7f416c15a2c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f416c15a800 tx=0x7f415c009780 comp rx=0 tx=0).stop 2023-10-14T18:51:08.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 -- 172.21.15.79:0/2015170781 shutdown_connections 2023-10-14T18:51:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 --2- 172.21.15.79:0/2015170781 >> v2:172.21.15.144:3300/0 conn(0x7f416c0b46f0 0x7f416c0b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 --2- 172.21.15.79:0/2015170781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c159ef0 0x7f416c15a2c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 -- 172.21.15.79:0/2015170781 >> 172.21.15.79:0/2015170781 conn(0x7f416c09a0a0 msgr2=0x7f416c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 -- 172.21.15.79:0/2015170781 shutdown_connections 2023-10-14T18:51:08.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.633+0000 7f4171195700 1 -- 172.21.15.79:0/2015170781 wait complete. 2023-10-14T18:51:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 Processor -- start 2023-10-14T18:51:08.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 -- start start 2023-10-14T18:51:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f416c0b6a10 0x7f416c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f416c159ef0 0x7f416c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c150fe0 con 0x7f416c0b46f0 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c1548d0 con 0x7f416c159ef0 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f4171195700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c154bb0 con 0x7f416c0b6a10 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f416ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:08.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f416ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45962/0 (socket says 172.21.15.79:45962) 2023-10-14T18:51:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.635+0000 7f416ad9d700 1 -- 172.21.15.79:0/2075080137 learned_addr learned my addr 172.21.15.79:0/2075080137 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 -- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f416c0b6a10 msgr2=0x7f416c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f416c0b6a10 0x7f416c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 -- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f416c159ef0 msgr2=0x7f416c151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f416c159ef0 0x7f416c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 -- 172.21.15.79:0/2075080137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c009a20 con 0x7f416c0b46f0 2023-10-14T18:51:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f416ad9d700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f415c012580 tx=0x7f415c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c027470 con 0x7f416c0b46f0 2023-10-14T18:51:08.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0275f0 con 0x7f416c0b46f0 2023-10-14T18:51:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c154e90 con 0x7f416c0b46f0 2023-10-14T18:51:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0279b0 con 0x7f416c0b46f0 2023-10-14T18:51:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.636+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c1545e0 con 0x7f416c0b46f0 2023-10-14T18:51:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.637+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c151470 con 0x7f416c0b46f0 2023-10-14T18:51:08.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.637+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f415c024070 con 0x7f416c0b46f0 2023-10-14T18:51:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.638+0000 7f4162ffd700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.638+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f415c086c70 con 0x7f416c0b46f0 2023-10-14T18:51:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.638+0000 7f416a59c700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.638+0000 7f416a59c700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 0x7f414c0693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f41540011e0 tx=0x7f41540079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:08.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.642+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f416c151470 con 0x7f416c0b46f0 2023-10-14T18:51:08.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:08.823+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f416c151470 con 0x7f416c0b46f0 2023-10-14T18:51:09.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.602+0000 7f4162ffd700 1 -- 172.21.15.79:0/2075080137 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f415c02c020 con 0x7f416c0b46f0 2023-10-14T18:51:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 msgr2=0x7f414c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 0x7f414c0693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f41540011e0 tx=0x7f41540079d0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 msgr2=0x7f416c1540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f415c012580 tx=0x7f415c019000 comp rx=0 tx=0).stop 2023-10-14T18:51:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 shutdown_connections 2023-10-14T18:51:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f416c159ef0 0x7f416c151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f416c0b46f0 0x7f416c1540a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 --2- 172.21.15.79:0/2075080137 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f416c0b6a10 0x7f416c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 >> 172.21.15.79:0/2075080137 conn(0x7f416c09a0a0 msgr2=0x7f416c157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 shutdown_connections 2023-10-14T18:51:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.605+0000 7f4171195700 1 -- 172.21.15.79:0/2075080137 wait complete. 2023-10-14T18:51:09.609 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:51:09.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:51:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.737+0000 7ff85ab2a700 1 Processor -- start 2023-10-14T18:51:09.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.737+0000 7ff85ab2a700 1 -- start start 2023-10-14T18:51:09.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff85415d240 0x7ff8540b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8540c59e0 0x7ff8540c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540b3f40 con 0x7ff8540c59e0 2023-10-14T18:51:09.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540cbb80 con 0x7ff85415d240 2023-10-14T18:51:09.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85ab2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540cbe60 con 0x7ff8540cc940 2023-10-14T18:51:09.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85a329700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8540c59e0 0x7ff8540c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85a329700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8540c59e0 0x7ff8540c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45978/0 (socket says 172.21.15.79:45978) 2023-10-14T18:51:09.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff85a329700 1 -- 172.21.15.79:0/1951663219 learned_addr learned my addr 172.21.15.79:0/1951663219 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff859327700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.738+0000 7ff859b28700 1 --2- 172.21.15.79:0/1951663219 >> v2:172.21.15.144:3300/0 conn(0x7ff85415d240 0x7ff8540b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 -- 172.21.15.79:0/1951663219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 msgr2=0x7ff8540ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 -- 172.21.15.79:0/1951663219 >> v2:172.21.15.144:3300/0 conn(0x7ff85415d240 msgr2=0x7ff8540b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 --2- 172.21.15.79:0/1951663219 >> v2:172.21.15.144:3300/0 conn(0x7ff85415d240 0x7ff8540b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 -- 172.21.15.79:0/1951663219 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540cc140 con 0x7ff8540c59e0 2023-10-14T18:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85a329700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff8540c5e60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff85406b540 tx=0x7ff84c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b3800916695d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff858b26700 1 -- 172.21.15.79:0/1951663219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00b640 con 0x7ff8540c59e0 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff858b26700 1 -- 172.21.15.79:0/1951663219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00b7a0 con 0x7ff8540c59e0 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff858b26700 1 -- 172.21.15.79:0/1951663219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00bb60 con 0x7ff8540c59e0 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1951663219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 msgr2=0x7ff8540c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff8540c5e60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff85406b540 tx=0x7ff84c009250 comp rx=0 tx=0).stop 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1951663219 shutdown_connections 2023-10-14T18:51:09.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff8540c5e60 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1951663219 >> v2:172.21.15.144:3300/0 conn(0x7ff85415d240 0x7ff8540b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1951663219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.739+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1951663219 >> 172.21.15.79:0/1951663219 conn(0x7ff854067e40 msgr2=0x7ff8540d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:09.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.740+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1951663219 shutdown_connections 2023-10-14T18:51:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.740+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1951663219 wait complete. 2023-10-14T18:51:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 Processor -- start 2023-10-14T18:51:09.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 -- start start 2023-10-14T18:51:09.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 0x7ff854169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854156e70 con 0x7ff8540c59e0 2023-10-14T18:51:09.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415afe0 con 0x7ff85415d240 2023-10-14T18:51:09.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff85ab2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415a410 con 0x7ff8540cc940 2023-10-14T18:51:09.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff859b28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff859b28700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45992/0 (socket says 172.21.15.79:45992) 2023-10-14T18:51:09.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.741+0000 7ff859b28700 1 -- 172.21.15.79:0/1879174389 learned_addr learned my addr 172.21.15.79:0/1879174389 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:09.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff85a329700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 0x7ff854169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859327700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 -- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 msgr2=0x7ff8540cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:09.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 -- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 msgr2=0x7ff854169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 0x7ff854169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 -- 172.21.15.79:0/1879174389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0094f0 con 0x7ff8540c59e0 2023-10-14T18:51:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff85a329700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 0x7ff854169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:09.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859327700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff859b28700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff850009f40 tx=0x7ff85000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000ccd0 con 0x7ff8540c59e0 2023-10-14T18:51:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000f040 con 0x7ff8540c59e0 2023-10-14T18:51:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85415a6b0 con 0x7ff8540c59e0 2023-10-14T18:51:09.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500146b0 con 0x7ff8540c59e0 2023-10-14T18:51:09.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.742+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85415ac70 con 0x7ff8540c59e0 2023-10-14T18:51:09.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.743+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85406ac60 con 0x7ff8540c59e0 2023-10-14T18:51:09.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.744+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff850014a20 con 0x7ff8540c59e0 2023-10-14T18:51:09.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.744+0000 7ff849ffb700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:09.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.744+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5353+0+0 (secure 0 0 0) 0x7ff850084c10 con 0x7ff8540c59e0 2023-10-14T18:51:09.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.744+0000 7ff859327700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:09.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.745+0000 7ff859327700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 0x7ff8380693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff844006f00 tx=0x7ff844008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:09.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.748+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff850051fe0 con 0x7ff8540c59e0 2023-10-14T18:51:09.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:09.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:09.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:09.938+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8540cc420 con 0x7ff8540c59e0 2023-10-14T18:51:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.611+0000 7ff849ffb700 1 -- 172.21.15.79:0/1879174389 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff850055600 con 0x7ff8540c59e0 2023-10-14T18:51:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 msgr2=0x7ff8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 0x7ff8380693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff844006f00 tx=0x7ff844008040 comp rx=0 tx=0).stop 2023-10-14T18:51:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 msgr2=0x7ff85409a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff850009f40 tx=0x7ff85000b040 comp rx=0 tx=0).stop 2023-10-14T18:51:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 shutdown_connections 2023-10-14T18:51:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff838066f30 0x7ff8380693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff85415d240 0x7ff854169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8540c59e0 0x7ff85409a810 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 --2- 172.21.15.79:0/1879174389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8540cc940 0x7ff8540cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.614+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 >> 172.21.15.79:0/1879174389 conn(0x7ff854067e40 msgr2=0x7ff854157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.615+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 shutdown_connections 2023-10-14T18:51:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.615+0000 7ff85ab2a700 1 -- 172.21.15.79:0/1879174389 wait complete. 2023-10-14T18:51:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:51:10.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:51:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.788+0000 7fc07987c700 1 Processor -- start 2023-10-14T18:51:10.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.788+0000 7fc07987c700 1 -- start start 2023-10-14T18:51:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07987c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0740cc3a0 0x7fc07406c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07987c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc074068750 0x7fc07406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07987c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07406e3d0 con 0x7fc074156ce0 2023-10-14T18:51:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07987c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07406f230 con 0x7fc0740cc3a0 2023-10-14T18:51:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07987c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07406e620 con 0x7fc074068750 2023-10-14T18:51:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc06bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc0740cc3a0 0x7fc07406c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07887a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc074156ce0 0x7fc0740cc860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40726/0 (socket says 172.21.15.79:40726) 2023-10-14T18:51:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.789+0000 7fc07887a700 1 -- 172.21.15.79:0/1809962187 learned_addr learned my addr 172.21.15.79:0/1809962187 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:10.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07907b700 1 --2- 172.21.15.79:0/1809962187 >> v2:172.21.15.144:3300/0 conn(0x7fc074068750 0x7fc07406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06bfff700 1 -- 172.21.15.79:0/1809962187 >> v2:172.21.15.144:3300/0 conn(0x7fc074068750 msgr2=0x7fc07406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1809962187 >> v2:172.21.15.144:3300/0 conn(0x7fc074068750 0x7fc07406c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06b7fe700 1 -- 172.21.15.79:0/1809962187 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039626442 0 0) 0x7fc07406e3d0 con 0x7fc074156ce0 2023-10-14T18:51:10.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06bfff700 1 -- 172.21.15.79:0/1809962187 >> v1:172.21.15.79:6789/0 conn(0x7fc074156ce0 legacy=0x7fc0740cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06bfff700 1 -- 172.21.15.79:0/1809962187 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07406e900 con 0x7fc0740cc3a0 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1809962187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0740cc3a0 0x7fc07406c380 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc07406e1d0 tx=0x7fc0640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3f07a3b7237ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06b7fe700 1 -- 172.21.15.79:0/1809962187 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06400b6b0 con 0x7fc0740cc3a0 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06b7fe700 1 -- 172.21.15.79:0/1809962187 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06400b810 con 0x7fc0740cc3a0 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc06b7fe700 1 -- 172.21.15.79:0/1809962187 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06400bbb0 con 0x7fc0740cc3a0 2023-10-14T18:51:10.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 -- 172.21.15.79:0/1809962187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0740cc3a0 msgr2=0x7fc07406c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 --2- 172.21.15.79:0/1809962187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0740cc3a0 0x7fc07406c380 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc07406e1d0 tx=0x7fc0640091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 -- 172.21.15.79:0/1809962187 shutdown_connections 2023-10-14T18:51:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 --2- 172.21.15.79:0/1809962187 >> v2:172.21.15.144:3300/0 conn(0x7fc074068750 0x7fc07406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 --2- 172.21.15.79:0/1809962187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0740cc3a0 0x7fc07406c380 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.790+0000 7fc07987c700 1 -- 172.21.15.79:0/1809962187 >> 172.21.15.79:0/1809962187 conn(0x7fc0740cb040 msgr2=0x7fc07406bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.791+0000 7fc07987c700 1 -- 172.21.15.79:0/1809962187 shutdown_connections 2023-10-14T18:51:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.791+0000 7fc07987c700 1 -- 172.21.15.79:0/1809962187 wait complete. 2023-10-14T18:51:10.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.792+0000 7fc07987c700 1 Processor -- start 2023-10-14T18:51:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.792+0000 7fc07987c700 1 -- start start 2023-10-14T18:51:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.792+0000 7fc07987c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 0x7fc0740b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 0x7fc074157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740c7f50 con 0x7fc074068750 2023-10-14T18:51:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740b2a00 con 0x7fc0740b2580 2023-10-14T18:51:10.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0741578a0 con 0x7fc074156ce0 2023-10-14T18:51:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46012/0 (socket says 172.21.15.79:46012) 2023-10-14T18:51:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 -- 172.21.15.79:0/1435623062 learned_addr learned my addr 172.21.15.79:0/1435623062 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 0x7fc0740b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07907b700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 0x7fc074157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 -- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 msgr2=0x7fc0740b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 0x7fc0740b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 -- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 msgr2=0x7fc074157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 0x7fc074157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 -- 172.21.15.79:0/1435623062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064009420 con 0x7fc074068750 2023-10-14T18:51:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 0x7fc0740b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07907b700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 0x7fc074157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07887a700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc07000cca0 tx=0x7fc070001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000ab30 con 0x7fc074068750 2023-10-14T18:51:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000ac90 con 0x7fc074068750 2023-10-14T18:51:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0740c7c70 con 0x7fc074068750 2023-10-14T18:51:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070007300 con 0x7fc074068750 2023-10-14T18:51:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.793+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc074157530 con 0x7fc074068750 2023-10-14T18:51:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.794+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0741570b0 con 0x7fc074068750 2023-10-14T18:51:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.795+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0700076f0 con 0x7fc074068750 2023-10-14T18:51:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.795+0000 7fc068ff9700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 0x7fc0600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.795+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc070084720 con 0x7fc074068750 2023-10-14T18:51:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.795+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 0x7fc0600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.796+0000 7fc06bfff700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 0x7fc0600693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc07406e1d0 tx=0x7fc064017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.799+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0741570b0 con 0x7fc074068750 2023-10-14T18:51:10.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.980+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc0741570b0 con 0x7fc074068750 2023-10-14T18:51:10.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.984+0000 7fc068ff9700 1 -- 172.21.15.79:0/1435623062 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0741570b0 con 0x7fc074068750 2023-10-14T18:51:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 msgr2=0x7fc0600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 0x7fc0600693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc07406e1d0 tx=0x7fc064017000 comp rx=0 tx=0).stop 2023-10-14T18:51:10.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 msgr2=0x7fc074152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc07000cca0 tx=0x7fc070001a30 comp rx=0 tx=0).stop 2023-10-14T18:51:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 shutdown_connections 2023-10-14T18:51:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc060066f30 0x7fc0600693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0740b2580 0x7fc074157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc074068750 0x7fc074152fb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 --2- 172.21.15.79:0/1435623062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc074156ce0 0x7fc0740b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 >> 172.21.15.79:0/1435623062 conn(0x7fc0740cb040 msgr2=0x7fc0740c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 shutdown_connections 2023-10-14T18:51:10.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:10.986+0000 7fc07987c700 1 -- 172.21.15.79:0/1435623062 wait complete. 2023-10-14T18:51:10.999 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-14T18:51:11.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.112+0000 7f69d1cec700 1 Processor -- start 2023-10-14T18:51:11.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69d1cec700 1 -- start start 2023-10-14T18:51:11.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69d1cec700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69cc157ba0 0x7f69cc06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69d1cec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc15c360 con 0x7f69cc15b0d0 2023-10-14T18:51:11.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69d1cec700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc15b790 con 0x7f69cc1577d0 2023-10-14T18:51:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69d1cec700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc15ba30 con 0x7f69cc157ba0 2023-10-14T18:51:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69cbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f69cc15b0d0 0x7f69cc15c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40742/0 (socket says 172.21.15.79:40742) 2023-10-14T18:51:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.113+0000 7f69cbfff700 1 -- 172.21.15.79:0/3805848032 learned_addr learned my addr 172.21.15.79:0/3805848032 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:11.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69caffd700 1 --2- 172.21.15.79:0/3805848032 >> v2:172.21.15.144:3300/0 conn(0x7f69cc157ba0 0x7f69cc06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643199176 0 0) 0x7f69cc15c360 con 0x7f69cc15b0d0 2023-10-14T18:51:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b4003570 con 0x7f69cc15b0d0 2023-10-14T18:51:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775096890 0 0) 0x7f69cc15b790 con 0x7f69cc1577d0 2023-10-14T18:51:11.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc15c360 con 0x7f69cc1577d0 2023-10-14T18:51:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020611132 0 0) 0x7f69b4003570 con 0x7f69cc15b0d0 2023-10-14T18:51:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 >> v2:172.21.15.144:3300/0 conn(0x7f69cc157ba0 msgr2=0x7f69cc06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 --2- 172.21.15.79:0/3805848032 >> v2:172.21.15.144:3300/0 conn(0x7f69cc157ba0 0x7f69cc06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 >> v1:172.21.15.144:6789/0 conn(0x7f69cc1577d0 legacy=0x7f69cc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc15bd10 con 0x7f69cc15b0d0 2023-10-14T18:51:11.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f69c4001470 con 0x7f69cc15b0d0 2023-10-14T18:51:11.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 >> v1:172.21.15.79:6789/0 conn(0x7f69cc15b0d0 legacy=0x7f69cc15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69b4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69b4004810 0x7f69b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69b40051c0 0x7f69b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc15ba30 con 0x7f69b4003bf0 2023-10-14T18:51:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b400c160 con 0x7f69b4004810 2023-10-14T18:51:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b400c320 con 0x7f69b40051c0 2023-10-14T18:51:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69caffd700 1 --2- 172.21.15.79:0/3805848032 >> v2:172.21.15.144:3300/0 conn(0x7f69cc157ba0 0x7f69cc06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69b4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cbfff700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69b40051c0 0x7f69b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69caffd700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69b4004810 0x7f69b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 -- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69b40051c0 msgr2=0x7f69b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69b40051c0 0x7f69b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 -- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69b4004810 msgr2=0x7f69b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69b4004810 0x7f69b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cbfff700 1 -- 172.21.15.79:0/3805848032 reap_dead start 2023-10-14T18:51:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.114+0000 7f69cb7fe700 1 -- 172.21.15.79:0/3805848032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4003570 con 0x7f69b4003bf0 2023-10-14T18:51:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69b4003fe0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0013d0 tx=0x7f69bc0017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ede9b2155d0231 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc001ad0 con 0x7f69b4003bf0 2023-10-14T18:51:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc00c870 con 0x7f69b4003bf0 2023-10-14T18:51:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69ca7fc700 1 -- 172.21.15.79:0/3805848032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00cc30 con 0x7f69b4003bf0 2023-10-14T18:51:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 -- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 msgr2=0x7f69b4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69b4003fe0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0013d0 tx=0x7f69bc0017c0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 -- 172.21.15.79:0/3805848032 shutdown_connections 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 --2- 172.21.15.79:0/3805848032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69b4003fe0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 -- 172.21.15.79:0/3805848032 >> 172.21.15.79:0/3805848032 conn(0x7f69cc068ce0 msgr2=0x7f69cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 -- 172.21.15.79:0/3805848032 shutdown_connections 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.115+0000 7f69d1cec700 1 -- 172.21.15.79:0/3805848032 wait complete. 2023-10-14T18:51:11.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 Processor -- start 2023-10-14T18:51:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 -- start start 2023-10-14T18:51:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69cc0b28e0 0x7f69cc0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 0x7f69cc0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0b3290 con 0x7f69b4003bf0 2023-10-14T18:51:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0b12b0 con 0x7f69cc0b28e0 2023-10-14T18:51:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69d1cec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0b1590 con 0x7f69cc0b05c0 2023-10-14T18:51:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46032/0 (socket says 172.21.15.79:46032) 2023-10-14T18:51:11.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.117+0000 7f69cb7fe700 1 -- 172.21.15.79:0/2529471949 learned_addr learned my addr 172.21.15.79:0/2529471949 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69caffd700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69cc0b28e0 0x7f69cc0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cbfff700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 0x7f69cc0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 -- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 msgr2=0x7f69cc0b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 0x7f69cc0b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 -- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69cc0b28e0 msgr2=0x7f69cc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69cc0b28e0 0x7f69cc0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 -- 172.21.15.79:0/2529471949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0b1870 con 0x7f69b4003bf0 2023-10-14T18:51:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cbfff700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 0x7f69cc0b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:11.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69cb7fe700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c6a0 tx=0x7f69bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00c9e0 con 0x7f69b4003bf0 2023-10-14T18:51:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc021070 con 0x7f69b4003bf0 2023-10-14T18:51:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc026430 con 0x7f69b4003bf0 2023-10-14T18:51:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc0b1b50 con 0x7f69b4003bf0 2023-10-14T18:51:11.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.118+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc0b0f70 con 0x7f69b4003bf0 2023-10-14T18:51:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.119+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc159ee0 con 0x7f69b4003bf0 2023-10-14T18:51:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.119+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69bc023030 con 0x7f69b4003bf0 2023-10-14T18:51:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.120+0000 7f69b37fe700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.120+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f69bc086250 con 0x7f69b4003bf0 2023-10-14T18:51:11.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.120+0000 7f69caffd700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.120+0000 7f69caffd700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 0x7f69b80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69c00093f0 tx=0x7f69c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.124+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69bc0537c0 con 0x7f69b4003bf0 2023-10-14T18:51:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.378+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f69cc04c3c0 con 0x7f69b4003bf0 2023-10-14T18:51:11.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.612+0000 7f69b37fe700 1 -- 172.21.15.79:0/2529471949 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v318) v1 ==== 128+0+0 (secure 0 0 0) 0x7f69bc056de0 con 0x7f69b4003bf0 2023-10-14T18:51:11.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 msgr2=0x7f69b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 0x7f69b80693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69c00093f0 tx=0x7f69c0008040 comp rx=0 tx=0).stop 2023-10-14T18:51:11.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 msgr2=0x7f69cc16d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00c6a0 tx=0x7f69bc016000 comp rx=0 tx=0).stop 2023-10-14T18:51:11.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 shutdown_connections 2023-10-14T18:51:11.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f69b8066f30 0x7f69b80693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f69cc0b05c0 0x7f69cc0b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f69b4003bf0 0x7f69cc16d500 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 --2- 172.21.15.79:0/2529471949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69cc0b28e0 0x7f69cc0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 >> 172.21.15.79:0/2529471949 conn(0x7f69cc068ce0 msgr2=0x7f69cc159660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:11.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 shutdown_connections 2023-10-14T18:51:11.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.615+0000 7f69d1cec700 1 -- 172.21.15.79:0/2529471949 wait complete. 2023-10-14T18:51:11.627 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-14T18:51:11.628 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-14T18:51:11.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-14T18:51:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.743+0000 7f2986440700 1 Processor -- start 2023-10-14T18:51:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 -- start start 2023-10-14T18:51:11.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2980152010 0x7f298015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2980158e50 0x7f29800cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298006c010 con 0x7f29801523e0 2023-10-14T18:51:11.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298006bd10 con 0x7f2980152010 2023-10-14T18:51:11.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f2986440700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298015c060 con 0x7f2980158e50 2023-10-14T18:51:11.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f297ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2980152010 0x7f298015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f297f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29801523e0 0x7f298006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40746/0 (socket says 172.21.15.79:40746) 2023-10-14T18:51:11.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.744+0000 7f297f7fe700 1 -- 172.21.15.79:0/555115524 learned_addr learned my addr 172.21.15.79:0/555115524 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:11.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f29849dd700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2980158e50 0x7f29800cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297ffff700 1 -- 172.21.15.79:0/555115524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2980158e50 msgr2=0x7f29800cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:11.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297ffff700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2980158e50 0x7f29800cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297ffff700 1 -- 172.21.15.79:0/555115524 >> v1:172.21.15.79:6789/0 conn(0x7f29801523e0 legacy=0x7f298006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297ffff700 1 -- 172.21.15.79:0/555115524 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298015c340 con 0x7f2980152010 2023-10-14T18:51:11.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297effd700 1 -- 172.21.15.79:0/555115524 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115286749 0 0) 0x7f298006c010 con 0x7f29801523e0 2023-10-14T18:51:11.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297ffff700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980152010 0x7f298015b810 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f29700098e0 tx=0x7f29700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451934d1df51c688 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297effd700 1 -- 172.21.15.79:0/555115524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970009e80 con 0x7f2980152010 2023-10-14T18:51:11.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297effd700 1 -- 172.21.15.79:0/555115524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000b860 con 0x7f2980152010 2023-10-14T18:51:11.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.745+0000 7f297effd700 1 -- 172.21.15.79:0/555115524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000bbe0 con 0x7f2980152010 2023-10-14T18:51:11.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 -- 172.21.15.79:0/555115524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980152010 msgr2=0x7f298015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980152010 0x7f298015b810 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f29700098e0 tx=0x7f29700091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 -- 172.21.15.79:0/555115524 shutdown_connections 2023-10-14T18:51:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2980158e50 0x7f29800cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 --2- 172.21.15.79:0/555115524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980152010 0x7f298015b810 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 -- 172.21.15.79:0/555115524 >> 172.21.15.79:0/555115524 conn(0x7f2980069870 msgr2=0x7f2980069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 -- 172.21.15.79:0/555115524 shutdown_connections 2023-10-14T18:51:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.746+0000 7f2986440700 1 -- 172.21.15.79:0/555115524 wait complete. 2023-10-14T18:51:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.747+0000 7f2986440700 1 Processor -- start 2023-10-14T18:51:11.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.747+0000 7f2986440700 1 -- start start 2023-10-14T18:51:11.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 0x7f29800c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29801523e0 0x7f298014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b37a0 con 0x7f2980158e50 2023-10-14T18:51:11.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b2e70 con 0x7f2980152010 2023-10-14T18:51:11.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800b3150 con 0x7f29801523e0 2023-10-14T18:51:11.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46054/0 (socket says 172.21.15.79:46054) 2023-10-14T18:51:11.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 -- 172.21.15.79:0/3365185915 learned_addr learned my addr 172.21.15.79:0/3365185915 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:11.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f297ffff700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 0x7f29800c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f297f7fe700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29801523e0 0x7f298014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 -- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29801523e0 msgr2=0x7f298014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29801523e0 0x7f298014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 -- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 msgr2=0x7f29800c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:11.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 0x7f29800c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:11.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 -- 172.21.15.79:0/3365185915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970009420 con 0x7f2980158e50 2023-10-14T18:51:11.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f297ffff700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 0x7f29800c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:11.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f29849dd700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2978007f20 tx=0x7f2978009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297800eca0 con 0x7f2980158e50 2023-10-14T18:51:11.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297800ee20 con 0x7f2980158e50 2023-10-14T18:51:11.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.748+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29800b3430 con 0x7f2980158e50 2023-10-14T18:51:11.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.749+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978014670 con 0x7f2980158e50 2023-10-14T18:51:11.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.749+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800b2a90 con 0x7f2980158e50 2023-10-14T18:51:11.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.750+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29800b3910 con 0x7f2980158e50 2023-10-14T18:51:11.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.750+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f29780149e0 con 0x7f2980158e50 2023-10-14T18:51:11.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.750+0000 7f2967fff700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 0x7f296c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:11.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.750+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f29780849b0 con 0x7f2980158e50 2023-10-14T18:51:11.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.750+0000 7f297ffff700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 0x7f296c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:11.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.751+0000 7f297ffff700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 0x7f296c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f29700091e0 tx=0x7f2970017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:11.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:11.754+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2978051f20 con 0x7f2980158e50 2023-10-14T18:51:12.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.013+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f298004c3c0 con 0x7f2980158e50 2023-10-14T18:51:12.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.617+0000 7f2967fff700 1 -- 172.21.15.79:0/3365185915 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v319) v1 ==== 143+0+0 (secure 0 0 0) 0x7f2978055540 con 0x7f2980158e50 2023-10-14T18:51:12.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 msgr2=0x7f296c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 0x7f296c0693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f29700091e0 tx=0x7f2970017000 comp rx=0 tx=0).stop 2023-10-14T18:51:12.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 msgr2=0x7f29800c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2978007f20 tx=0x7f2978009860 comp rx=0 tx=0).stop 2023-10-14T18:51:12.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 shutdown_connections 2023-10-14T18:51:12.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f296c066f30 0x7f296c0693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2980158e50 0x7f29800c48b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2980152010 0x7f29800c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 --2- 172.21.15.79:0/3365185915 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29801523e0 0x7f298014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 >> 172.21.15.79:0/3365185915 conn(0x7f2980069870 msgr2=0x7f2980151550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:12.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 shutdown_connections 2023-10-14T18:51:12.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.619+0000 7f2986440700 1 -- 172.21.15.79:0/3365185915 wait complete. 2023-10-14T18:51:12.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:51:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.749+0000 7f17c8b56700 1 Processor -- start 2023-10-14T18:51:12.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.749+0000 7f17c8b56700 1 -- start start 2023-10-14T18:51:12.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c8b56700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c8b56700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 0x7f17c40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c8b56700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40b0790 con 0x7f17c4159ec0 2023-10-14T18:51:12.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c8b56700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c406af60 con 0x7f17c406aae0 2023-10-14T18:51:12.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c8b56700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40ce1f0 con 0x7f17c415a290 2023-10-14T18:51:12.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f17c4159ec0 0x7f17c40af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40758/0 (socket says 172.21.15.79:40758) 2023-10-14T18:51:12.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c259c700 1 -- 172.21.15.79:0/422385869 learned_addr learned my addr 172.21.15.79:0/422385869 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:12.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c2d9d700 1 --2- 172.21.15.79:0/422385869 >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 0x7f17c40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/422385869 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.750+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234618678 0 0) 0x7f17c40b0790 con 0x7f17c4159ec0 2023-10-14T18:51:12.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b0003570 con 0x7f17c4159ec0 2023-10-14T18:51:12.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833976245 0 0) 0x7f17b0003570 con 0x7f17c4159ec0 2023-10-14T18:51:12.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17b9d9b700 1 -- 172.21.15.79:0/422385869 >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 msgr2=0x7f17c40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:12.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/422385869 >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 0x7f17c40cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17b9d9b700 1 -- 172.21.15.79:0/422385869 >> v1:172.21.15.79:6789/0 conn(0x7f17c4159ec0 legacy=0x7f17c40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17b9d9b700 1 -- 172.21.15.79:0/422385869 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40b0b20 con 0x7f17c415a290 2023-10-14T18:51:12.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c2d9d700 1 --2- 172.21.15.79:0/422385869 >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 0x7f17c40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:12.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/422385869 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c406a5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098e0 tx=0x7f17ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66b52b2e65aed2c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:12.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4001470 con 0x7f17c415a290 2023-10-14T18:51:12.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac011420 con 0x7f17c415a290 2023-10-14T18:51:12.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.751+0000 7f17c1d9b700 1 -- 172.21.15.79:0/422385869 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0117c0 con 0x7f17c415a290 2023-10-14T18:51:12.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 -- 172.21.15.79:0/422385869 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 msgr2=0x7f17c406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 --2- 172.21.15.79:0/422385869 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c406a5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0098e0 tx=0x7f17ac0091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 -- 172.21.15.79:0/422385869 shutdown_connections 2023-10-14T18:51:12.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 --2- 172.21.15.79:0/422385869 >> v2:172.21.15.144:3300/0 conn(0x7f17c406aae0 0x7f17c40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 --2- 172.21.15.79:0/422385869 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c406a5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 -- 172.21.15.79:0/422385869 >> 172.21.15.79:0/422385869 conn(0x7f17c40d1880 msgr2=0x7f17c40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:12.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 -- 172.21.15.79:0/422385869 shutdown_connections 2023-10-14T18:51:12.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.752+0000 7f17c8b56700 1 -- 172.21.15.79:0/422385869 wait complete. 2023-10-14T18:51:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.753+0000 7f17c8b56700 1 Processor -- start 2023-10-14T18:51:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.753+0000 7f17c8b56700 1 -- start start 2023-10-14T18:51:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c406aae0 0x7f17c40c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c40c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40cb340 con 0x7f17c4159ec0 2023-10-14T18:51:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40ca730 con 0x7f17c406aae0 2023-10-14T18:51:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40caa10 con 0x7f17c415a290 2023-10-14T18:51:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46056/0 (socket says 172.21.15.79:46056) 2023-10-14T18:51:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 -- 172.21.15.79:0/1843287195 learned_addr learned my addr 172.21.15.79:0/1843287195 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c259c700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c406aae0 0x7f17c40c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c2d9d700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c40c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 -- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 msgr2=0x7f17c40c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c40c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 -- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c406aae0 msgr2=0x7f17c40c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c406aae0 0x7f17c40c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 -- 172.21.15.79:0/1843287195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc009a20 con 0x7f17c4159ec0 2023-10-14T18:51:12.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17b9d9b700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0030c0 tx=0x7f17ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac01cbe0 con 0x7f17c4159ec0 2023-10-14T18:51:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac01cd40 con 0x7f17c4159ec0 2023-10-14T18:51:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac009420 con 0x7f17c4159ec0 2023-10-14T18:51:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.754+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac01a6a0 con 0x7f17c4159ec0 2023-10-14T18:51:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.755+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c40cafd0 con 0x7f17c4159ec0 2023-10-14T18:51:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.756+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c40cb4f0 con 0x7f17c4159ec0 2023-10-14T18:51:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.756+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17ac01aad0 con 0x7f17c4159ec0 2023-10-14T18:51:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.756+0000 7f17baffd700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.756+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f17ac0859b0 con 0x7f17c4159ec0 2023-10-14T18:51:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.756+0000 7f17c259c700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:12.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.757+0000 7f17c259c700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 0x7f17a40693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f17b40011e0 tx=0x7f17b4001aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:12.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.760+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c40cb4f0 con 0x7f17c4159ec0 2023-10-14T18:51:12.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.941+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f17c40cb4f0 con 0x7f17c4159ec0 2023-10-14T18:51:12.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.945+0000 7f17baffd700 1 -- 172.21.15.79:0/1843287195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f17c40cb4f0 con 0x7f17c4159ec0 2023-10-14T18:51:12.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 msgr2=0x7f17a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 0x7f17a40693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f17b40011e0 tx=0x7f17b4001aa0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 msgr2=0x7f17c40c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0030c0 tx=0x7f17ac016000 comp rx=0 tx=0).stop 2023-10-14T18:51:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 shutdown_connections 2023-10-14T18:51:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17a4066f30 0x7f17a40693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17c415a290 0x7f17c40c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c406aae0 0x7f17c40c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 --2- 172.21.15.79:0/1843287195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c4159ec0 0x7f17c40c7e60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 >> 172.21.15.79:0/1843287195 conn(0x7f17c40d1880 msgr2=0x7f17c41557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:12.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 shutdown_connections 2023-10-14T18:51:12.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:12.947+0000 7f17c8b56700 1 -- 172.21.15.79:0/1843287195 wait complete. 2023-10-14T18:51:12.959 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:51:12.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:12.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:13.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:51:13.044 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:51:13.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.158+0000 7f6abdade700 1 Processor -- start 2023-10-14T18:51:13.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.158+0000 7f6abdade700 1 -- start start 2023-10-14T18:51:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6abdade700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ab815a620 0x7f6ab815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6abdade700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ab815d580 0x7f6ab8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6abdade700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab815cbb0 con 0x7f6ab8157870 2023-10-14T18:51:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6abdade700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab815bdb0 con 0x7f6ab815a620 2023-10-14T18:51:13.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6abdade700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab815bfa0 con 0x7f6ab815d580 2023-10-14T18:51:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6ab6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ab815a620 0x7f6ab815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6ab6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ab815a620 0x7f6ab815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46062/0 (socket says 172.21.15.79:46062) 2023-10-14T18:51:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.159+0000 7f6ab6ffd700 1 -- 172.21.15.79:0/2367565067 learned_addr learned my addr 172.21.15.79:0/2367565067 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:13.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab6ffd700 1 -- 172.21.15.79:0/2367565067 >> v2:172.21.15.144:3300/0 conn(0x7f6ab815d580 msgr2=0x7f6ab8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab7fff700 1 --2- 172.21.15.79:0/2367565067 >> v2:172.21.15.144:3300/0 conn(0x7f6ab815d580 0x7f6ab8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab6ffd700 1 --2- 172.21.15.79:0/2367565067 >> v2:172.21.15.144:3300/0 conn(0x7f6ab815d580 0x7f6ab8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab6ffd700 1 -- 172.21.15.79:0/2367565067 >> v1:172.21.15.144:6789/0 conn(0x7f6ab8157870 legacy=0x7f6ab815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:13.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab6ffd700 1 -- 172.21.15.79:0/2367565067 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab815c280 con 0x7f6ab815a620 2023-10-14T18:51:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab6ffd700 1 --2- 172.21.15.79:0/2367565067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab815a620 0x7f6ab815d040 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6ab806b4e0 tx=0x7f6aac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58660123c04043d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab67fc700 1 -- 172.21.15.79:0/2367565067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00b820 con 0x7f6ab815a620 2023-10-14T18:51:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab67fc700 1 -- 172.21.15.79:0/2367565067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac00b980 con 0x7f6ab815a620 2023-10-14T18:51:13.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6ab67fc700 1 -- 172.21.15.79:0/2367565067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac00bd20 con 0x7f6ab815a620 2023-10-14T18:51:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 -- 172.21.15.79:0/2367565067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab815a620 msgr2=0x7f6ab815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 --2- 172.21.15.79:0/2367565067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab815a620 0x7f6ab815d040 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6ab806b4e0 tx=0x7f6aac009250 comp rx=0 tx=0).stop 2023-10-14T18:51:13.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 -- 172.21.15.79:0/2367565067 shutdown_connections 2023-10-14T18:51:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 --2- 172.21.15.79:0/2367565067 >> v2:172.21.15.144:3300/0 conn(0x7f6ab815d580 0x7f6ab8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 --2- 172.21.15.79:0/2367565067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab815a620 0x7f6ab815d040 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 -- 172.21.15.79:0/2367565067 >> 172.21.15.79:0/2367565067 conn(0x7f6ab8068ce0 msgr2=0x7f6ab80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.160+0000 7f6abdade700 1 -- 172.21.15.79:0/2367565067 shutdown_connections 2023-10-14T18:51:13.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.161+0000 7f6abdade700 1 -- 172.21.15.79:0/2367565067 wait complete. 2023-10-14T18:51:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 Processor -- start 2023-10-14T18:51:13.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 -- start start 2023-10-14T18:51:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ab815a620 0x7f6ab814e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 0x7f6ab81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80b2630 con 0x7f6ab8157870 2023-10-14T18:51:13.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80b1540 con 0x7f6ab815d580 2023-10-14T18:51:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.162+0000 7f6abdade700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab80b1820 con 0x7f6ab815a620 2023-10-14T18:51:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46078/0 (socket says 172.21.15.79:46078) 2023-10-14T18:51:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 -- 172.21.15.79:0/4249876970 learned_addr learned my addr 172.21.15.79:0/4249876970 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:13.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab7fff700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 0x7f6ab81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab6ffd700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ab815a620 0x7f6ab814e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 -- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ab815a620 msgr2=0x7f6ab814e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ab815a620 0x7f6ab814e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 -- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 msgr2=0x7f6ab81544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 0x7f6ab81544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 -- 172.21.15.79:0/4249876970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0094f0 con 0x7f6ab8157870 2023-10-14T18:51:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab7fff700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 0x7f6ab81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6ab77fe700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800c950 tx=0x7f6aa8002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800a7e0 con 0x7f6ab8157870 2023-10-14T18:51:13.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800a940 con 0x7f6ab8157870 2023-10-14T18:51:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab80b1b00 con 0x7f6ab8157870 2023-10-14T18:51:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800ad00 con 0x7f6ab8157870 2023-10-14T18:51:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.163+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab814ce20 con 0x7f6ab8157870 2023-10-14T18:51:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.164+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab804c3c0 con 0x7f6ab8157870 2023-10-14T18:51:13.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.164+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6aa8012630 con 0x7f6ab8157870 2023-10-14T18:51:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.165+0000 7f6a9f7fe700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 0x7f6aa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.165+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6aa8084790 con 0x7f6ab8157870 2023-10-14T18:51:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.165+0000 7f6ab6ffd700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 0x7f6aa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.165+0000 7f6ab6ffd700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 0x7f6aa40693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6ab806b4e0 tx=0x7f6aac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.169+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6aa8051db0 con 0x7f6ab8157870 2023-10-14T18:51:13.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.395+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ab815c560 con 0x7f6ab8157870 2023-10-14T18:51:13.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.396+0000 7f6a9f7fe700 1 -- 172.21.15.79:0/4249876970 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f6aa8016de0 con 0x7f6ab8157870 2023-10-14T18:51:13.397 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:13.397 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1377177922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1377177922},{"type":"v1","addr":"172.21.15.144:6836","nonce":1377177922}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2392254086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2392254086},{"type":"v1","addr":"172.21.15.144:6837","nonce":2392254086}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6726,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/206034238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":206034238},{"type":"v1","addr":"172.21.15.79:6834","nonce":206034238}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1912360174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1912360174},{"type":"v1","addr":"172.21.15.79:6835","nonce":1912360174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-10-14T18:51:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 msgr2=0x7f6aa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 0x7f6aa40693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6ab806b4e0 tx=0x7f6aac016000 comp rx=0 tx=0).stop 2023-10-14T18:51:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 msgr2=0x7f6ab814c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800c950 tx=0x7f6aa8002760 comp rx=0 tx=0).stop 2023-10-14T18:51:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 shutdown_connections 2023-10-14T18:51:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa4066f30 0x7f6aa40693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ab815d580 0x7f6ab81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab8157870 0x7f6ab814c8e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 --2- 172.21.15.79:0/4249876970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ab815a620 0x7f6ab814e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 >> 172.21.15.79:0/4249876970 conn(0x7f6ab8068ce0 msgr2=0x7f6ab815fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 shutdown_connections 2023-10-14T18:51:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.398+0000 7f6abdade700 1 -- 172.21.15.79:0/4249876970 wait complete. 2023-10-14T18:51:13.402 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 58 2023-10-14T18:51:13.411 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:51:13.411 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:51:13.411 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:51:13.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:13.412 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:51:13.412 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:51:13.412 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:51:13.413 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:13.413 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:51:13.413 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:51:13.414 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:51:13.414 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:13.414 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:51:13.414 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:51:13.415 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:51:13.415 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:13.421 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:51:13.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:51:13.422 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:51:13.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:51:13.424 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:51:13.424 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:51:13.425 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:51:13.425 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:51:13.464 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:51:13.465 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:13.466 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:51:13.467 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:13.468 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:51:13.468 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:13.469 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:51:13.469 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:13.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:51:13.538 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:51:13.538 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:51:13.549 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:51:13.550 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:51:13.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.591+0000 7f769b3a4700 1 Processor -- start 2023-10-14T18:51:13.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.591+0000 7f769b3a4700 1 -- start start 2023-10-14T18:51:13.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769b3a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76941577d0 0x7f76940cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769b3a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f769406a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769b3a4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769415c360 con 0x7f769415b0d0 2023-10-14T18:51:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769b3a4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769415b790 con 0x7f76941577d0 2023-10-14T18:51:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769b3a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769415d800 con 0x7f7694157ba0 2023-10-14T18:51:13.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76941577d0 0x7f76940cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76941577d0 0x7f76940cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46130/0 (socket says 172.21.15.79:46130) 2023-10-14T18:51:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 -- 172.21.15.79:0/2471022131 learned_addr learned my addr 172.21.15.79:0/2471022131 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f769893f700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f769406a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 -- 172.21.15.79:0/2471022131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 msgr2=0x7f769406a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f769406a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 -- 172.21.15.79:0/2471022131 >> v1:172.21.15.144:6789/0 conn(0x7f769415b0d0 legacy=0x7f769415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 -- 172.21.15.79:0/2471022131 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769415ba30 con 0x7f76941577d0 2023-10-14T18:51:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f7699140700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76941577d0 0x7f76940cd770 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f76900099b0 tx=0x7f7690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d330b55678e3179f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f768bfff700 1 -- 172.21.15.79:0/2471022131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690009ea0 con 0x7f76941577d0 2023-10-14T18:51:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.592+0000 7f768bfff700 1 -- 172.21.15.79:0/2471022131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000b860 con 0x7f76941577d0 2023-10-14T18:51:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f768bfff700 1 -- 172.21.15.79:0/2471022131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000bc00 con 0x7f76941577d0 2023-10-14T18:51:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 -- 172.21.15.79:0/2471022131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76941577d0 msgr2=0x7f76940cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76941577d0 0x7f76940cd770 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f76900099b0 tx=0x7f7690009250 comp rx=0 tx=0).stop 2023-10-14T18:51:13.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 -- 172.21.15.79:0/2471022131 shutdown_connections 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76941577d0 0x7f76940cd770 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2471022131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f769406a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 -- 172.21.15.79:0/2471022131 >> 172.21.15.79:0/2471022131 conn(0x7f7694068ce0 msgr2=0x7f76940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 -- 172.21.15.79:0/2471022131 shutdown_connections 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.593+0000 7f769b3a4700 1 -- 172.21.15.79:0/2471022131 wait complete. 2023-10-14T18:51:13.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.594+0000 7f769b3a4700 1 Processor -- start 2023-10-14T18:51:13.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.594+0000 7f769b3a4700 1 -- start start 2023-10-14T18:51:13.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76941577d0 0x7f7694146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f76940d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940cf650 con 0x7f769415b0d0 2023-10-14T18:51:13.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76940d0480 con 0x7f76941577d0 2023-10-14T18:51:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769b3a4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76940b1480 con 0x7f7694157ba0 2023-10-14T18:51:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46132/0 (socket says 172.21.15.79:46132) 2023-10-14T18:51:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 -- 172.21.15.79:0/2482652917 learned_addr learned my addr 172.21.15.79:0/2482652917 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:13.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f769893f700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f76940d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699140700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76941577d0 0x7f7694146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 -- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 msgr2=0x7f76940d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f76940d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 -- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76941577d0 msgr2=0x7f7694146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:13.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76941577d0 0x7f7694146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:13.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.595+0000 7f7699941700 1 -- 172.21.15.79:0/2482652917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900094f0 con 0x7f769415b0d0 2023-10-14T18:51:13.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f7699941700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c8e0 tx=0x7f768c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c012630 con 0x7f769415b0d0 2023-10-14T18:51:13.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c012790 con 0x7f769415b0d0 2023-10-14T18:51:13.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76940b11a0 con 0x7f769415b0d0 2023-10-14T18:51:13.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c012b50 con 0x7f769415b0d0 2023-10-14T18:51:13.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.596+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76940d0110 con 0x7f769415b0d0 2023-10-14T18:51:13.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.597+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76940cfb60 con 0x7f769415b0d0 2023-10-14T18:51:13.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.597+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f768c01a3a0 con 0x7f769415b0d0 2023-10-14T18:51:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.597+0000 7f76897fa700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 0x7f76780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.598+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f768c0843a0 con 0x7f769415b0d0 2023-10-14T18:51:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.598+0000 7f7699140700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 0x7f76780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.598+0000 7f7699140700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 0x7f76780693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76900099b0 tx=0x7f7690017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:13.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.602+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f768c0553a0 con 0x7f769415b0d0 2023-10-14T18:51:13.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:13.802+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f769404c3c0 con 0x7f769415b0d0 2023-10-14T18:51:14.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.646+0000 7f76897fa700 1 -- 172.21.15.79:0/2482652917 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) v1 ==== 97+0+0 (secure 0 0 0) 0x7f768c054f30 con 0x7f769415b0d0 2023-10-14T18:51:14.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 msgr2=0x7f76780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 0x7f76780693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76900099b0 tx=0x7f7690017000 comp rx=0 tx=0).stop 2023-10-14T18:51:14.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 msgr2=0x7f76940b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c8e0 tx=0x7f768c001710 comp rx=0 tx=0).stop 2023-10-14T18:51:14.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 shutdown_connections 2023-10-14T18:51:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7678066f30 0x7f76780693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f769415b0d0 0x7f76940b05c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76941577d0 0x7f7694146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 --2- 172.21.15.79:0/2482652917 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7694157ba0 0x7f76940d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 >> 172.21.15.79:0/2482652917 conn(0x7f7694068ce0 msgr2=0x7f76940ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 shutdown_connections 2023-10-14T18:51:14.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.649+0000 7f769b3a4700 1 -- 172.21.15.79:0/2482652917 wait complete. 2023-10-14T18:51:14.652 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:51:14.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:51:14.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.779+0000 7f35c509d700 1 Processor -- start 2023-10-14T18:51:14.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.779+0000 7f35c509d700 1 -- start start 2023-10-14T18:51:14.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35c509d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35c0156570 0x7f35c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35c509d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35c509d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c0157c30 con 0x7f35c0156940 2023-10-14T18:51:14.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35c509d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c01584f0 con 0x7f35c0156570 2023-10-14T18:51:14.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35c509d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0157670 con 0x7f35c015a330 2023-10-14T18:51:14.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35bed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35c0156570 0x7f35c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.780+0000 7f35b659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35b659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:48798/0 (socket says 172.21.15.79:48798) 2023-10-14T18:51:14.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35c0156570 0x7f35c006d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60774/0 (socket says 172.21.15.79:60774) 2023-10-14T18:51:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35b659c700 1 -- 172.21.15.79:0/1214798949 learned_addr learned my addr 172.21.15.79:0/1214798949 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bf59e700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f35c0156940 0x7f35c0156da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:41748/0 (socket says 172.21.15.79:41748) 2023-10-14T18:51:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 -- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 msgr2=0x7f35c006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 -- 172.21.15.79:0/1214798949 >> v1:172.21.15.144:6789/0 conn(0x7f35c0156940 legacy=0x7f35c0156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 -- 172.21.15.79:0/1214798949 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0157950 con 0x7f35c0156570 2023-10-14T18:51:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35b659c700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35bed9d700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156570 0x7f35c006d380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35b00098e0 tx=0x7f35b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4186d3e8ef9557d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35be59c700 1 -- 172.21.15.79:0/1214798949 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000b640 con 0x7f35c0156570 2023-10-14T18:51:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35be59c700 1 -- 172.21.15.79:0/1214798949 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000b7a0 con 0x7f35c0156570 2023-10-14T18:51:14.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.781+0000 7f35be59c700 1 -- 172.21.15.79:0/1214798949 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000bb40 con 0x7f35c0156570 2023-10-14T18:51:14.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 -- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156570 msgr2=0x7f35c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156570 0x7f35c006d380 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35b00098e0 tx=0x7f35b00091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 -- 172.21.15.79:0/1214798949 shutdown_connections 2023-10-14T18:51:14.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156570 0x7f35c006d380 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 --2- 172.21.15.79:0/1214798949 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c015a330 0x7f35c006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 -- 172.21.15.79:0/1214798949 >> 172.21.15.79:0/1214798949 conn(0x7f35c0067660 msgr2=0x7f35c0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:14.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 -- 172.21.15.79:0/1214798949 shutdown_connections 2023-10-14T18:51:14.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.782+0000 7f35c509d700 1 -- 172.21.15.79:0/1214798949 wait complete. 2023-10-14T18:51:14.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.783+0000 7f35c509d700 1 Processor -- start 2023-10-14T18:51:14.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.783+0000 7f35c509d700 1 -- start start 2023-10-14T18:51:14.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c0156570 0x7f35c0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 0x7f35c00c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c6540 con 0x7f35c015a330 2023-10-14T18:51:14.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00afad0 con 0x7f35c0156940 2023-10-14T18:51:14.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35c509d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00c51f0 con 0x7f35c0156570 2023-10-14T18:51:14.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35b659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 0x7f35c00c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35b659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 0x7f35c00c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60778/0 (socket says 172.21.15.79:60778) 2023-10-14T18:51:14.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46146/0 (socket says 172.21.15.79:46146) 2023-10-14T18:51:14.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c0156570 0x7f35c0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35b659c700 1 -- 172.21.15.79:0/3741484041 learned_addr learned my addr 172.21.15.79:0/3741484041 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:14.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 -- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c0156570 msgr2=0x7f35c0153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c0156570 0x7f35c0153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 -- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 msgr2=0x7f35c00c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:14.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 0x7f35c00c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:14.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 -- 172.21.15.79:0/3741484041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a800b780 con 0x7f35c015a330 2023-10-14T18:51:14.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.784+0000 7f35bf59e700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f35b800cc40 tx=0x7f35b8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:14.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.785+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8005df0 con 0x7f35c015a330 2023-10-14T18:51:14.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.785+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800a6a0 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.785+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b0009420 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.785+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800aa60 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.785+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c00c57b0 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.786+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c00afc40 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.786+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35b80070f0 con 0x7f35c015a330 2023-10-14T18:51:14.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.786+0000 7f35b77fe700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 0x7f35a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:14.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.786+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f35b80840d0 con 0x7f35c015a330 2023-10-14T18:51:14.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.787+0000 7f35bed9d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 0x7f35a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:14.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.787+0000 7f35bed9d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 0x7f35a00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f35b00093f0 tx=0x7f35b0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:14.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:14.791+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35b80517c0 con 0x7f35c015a330 2023-10-14T18:51:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.043+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f35c004c3c0 con 0x7f35c015a330 2023-10-14T18:51:15.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.043+0000 7f35b77fe700 1 -- 172.21.15.79:0/3741484041 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f35b8054de0 con 0x7f35c015a330 2023-10-14T18:51:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:15.045 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:51:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:51:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:51:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:51:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:51:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:51:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:51:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:51:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:51:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:51:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:51:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:51:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:51:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:51:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:51:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:51:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:51:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:51:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:51:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:51:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:51:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:51:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:51:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:51:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:51:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:51:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:51:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:51:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:51:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:51:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:51:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:51:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:51:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:51:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:51:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:51:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:51:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:51:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:51:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:51:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:51:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:51:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:51:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:51:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:51:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:51:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:51:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:51:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:51:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:51:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:51:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:51:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:51:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:51:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:51:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:51:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:51:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:51:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:51:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:51:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:51:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:51:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:51:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:51:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:15.083 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:15.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 msgr2=0x7f35a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 0x7f35a00693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f35b00093f0 tx=0x7f35b0017000 comp rx=0 tx=0).stop 2023-10-14T18:51:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 msgr2=0x7f35c00c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f35b800cc40 tx=0x7f35b8001a50 comp rx=0 tx=0).stop 2023-10-14T18:51:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 shutdown_connections 2023-10-14T18:51:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f35a0066f30 0x7f35a00693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35c015a330 0x7f35c00c2ab0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f35c0156570 0x7f35c0153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 --2- 172.21.15.79:0/3741484041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0156940 0x7f35c00c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 >> 172.21.15.79:0/3741484041 conn(0x7f35c0067660 msgr2=0x7f35c00caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 shutdown_connections 2023-10-14T18:51:15.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.046+0000 7f35c509d700 1 -- 172.21.15.79:0/3741484041 wait complete. 2023-10-14T18:51:15.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:15.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.201+0000 7f546bbfe700 1 Processor -- start 2023-10-14T18:51:15.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.201+0000 7f546bbfe700 1 -- start start 2023-10-14T18:51:15.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5464157870 0x7f546415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 0x7f546415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 0x7f5464158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546415cbb0 con 0x7f5464157870 2023-10-14T18:51:15.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546415bfa0 con 0x7f546415a620 2023-10-14T18:51:15.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546bbfe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546415c280 con 0x7f546415d580 2023-10-14T18:51:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546999a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5464157870 0x7f546415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546999a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5464157870 0x7f546415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46160/0 (socket says 172.21.15.79:46160) 2023-10-14T18:51:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546999a700 1 -- 172.21.15.79:0/1939403620 learned_addr learned my addr 172.21.15.79:0/1939403620 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:15.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f546a19b700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 0x7f5464158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.202+0000 7f5469199700 1 --2- 172.21.15.79:0/1939403620 >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 0x7f546415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 -- 172.21.15.79:0/1939403620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 msgr2=0x7f5464158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 0x7f5464158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 -- 172.21.15.79:0/1939403620 >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 msgr2=0x7f546415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:15.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 --2- 172.21.15.79:0/1939403620 >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 0x7f546415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 -- 172.21.15.79:0/1939403620 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546415c560 con 0x7f5464157870 2023-10-14T18:51:15.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546a19b700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 0x7f5464158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:15.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f5469199700 1 --2- 172.21.15.79:0/1939403620 >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 0x7f546415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:15.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546999a700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464157870 0x7f546415b6a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f546415cb20 tx=0x7f5460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fda2202349f7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f5468998700 1 -- 172.21.15.79:0/1939403620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000b860 con 0x7f5464157870 2023-10-14T18:51:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f5468998700 1 -- 172.21.15.79:0/1939403620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546000b9c0 con 0x7f5464157870 2023-10-14T18:51:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f5468998700 1 -- 172.21.15.79:0/1939403620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000bd60 con 0x7f5464157870 2023-10-14T18:51:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546bbfe700 1 -- 172.21.15.79:0/1939403620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464157870 msgr2=0x7f546415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.203+0000 7f546bbfe700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464157870 0x7f546415b6a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f546415cb20 tx=0x7f5460009250 comp rx=0 tx=0).stop 2023-10-14T18:51:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 -- 172.21.15.79:0/1939403620 shutdown_connections 2023-10-14T18:51:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415d580 0x7f5464158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 --2- 172.21.15.79:0/1939403620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5464157870 0x7f546415b6a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 --2- 172.21.15.79:0/1939403620 >> v2:172.21.15.144:3300/0 conn(0x7f546415a620 0x7f546415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 -- 172.21.15.79:0/1939403620 >> 172.21.15.79:0/1939403620 conn(0x7f5464068ce0 msgr2=0x7f54640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 -- 172.21.15.79:0/1939403620 shutdown_connections 2023-10-14T18:51:15.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.204+0000 7f546bbfe700 1 -- 172.21.15.79:0/1939403620 wait complete. 2023-10-14T18:51:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 Processor -- start 2023-10-14T18:51:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 -- start start 2023-10-14T18:51:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 0x7f5464151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 0x7f54641532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b1fe0 con 0x7f546415d580 2023-10-14T18:51:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b13d0 con 0x7f5464157870 2023-10-14T18:51:15.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.205+0000 7f546bbfe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b16b0 con 0x7f546415a620 2023-10-14T18:51:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46162/0 (socket says 172.21.15.79:46162) 2023-10-14T18:51:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 -- 172.21.15.79:0/850015036 learned_addr learned my addr 172.21.15.79:0/850015036 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546999a700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 0x7f5464151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f5469199700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 0x7f54641532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 -- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 msgr2=0x7f54641532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 0x7f54641532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 -- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 msgr2=0x7f5464151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 0x7f5464151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 -- 172.21.15.79:0/850015036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600094f0 con 0x7f546415d580 2023-10-14T18:51:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546999a700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 0x7f5464151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f5469199700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 0x7f54641532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546a19b700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f545c009fd0 tx=0x7f545c009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00dc90 con 0x7f546415d580 2023-10-14T18:51:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00f040 con 0x7f546415d580 2023-10-14T18:51:15.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640b1990 con 0x7f546415d580 2023-10-14T18:51:15.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c015440 con 0x7f546415d580 2023-10-14T18:51:15.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.206+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5464151570 con 0x7f546415d580 2023-10-14T18:51:15.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.207+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546404c3c0 con 0x7f546415d580 2023-10-14T18:51:15.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.207+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f545c01e3b0 con 0x7f546415d580 2023-10-14T18:51:15.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.208+0000 7f5459ffb700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 0x7f54480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.208+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f545c084680 con 0x7f546415d580 2023-10-14T18:51:15.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.208+0000 7f546999a700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 0x7f54480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.208+0000 7f546999a700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 0x7f54480693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f546415cb20 tx=0x7f5460017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.212+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f545c051c40 con 0x7f546415d580 2023-10-14T18:51:15.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.393+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f546415c840 con 0x7f546415d580 2023-10-14T18:51:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.394+0000 7f5459ffb700 1 -- 172.21.15.79:0/850015036 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f545c055260 con 0x7f546415d580 2023-10-14T18:51:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:15.395 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":134,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:14.641940+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 msgr2=0x7f54480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 0x7f54480693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f546415cb20 tx=0x7f5460017000 comp rx=0 tx=0).stop 2023-10-14T18:51:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 msgr2=0x7f546416a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f545c009fd0 tx=0x7f545c009930 comp rx=0 tx=0).stop 2023-10-14T18:51:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 shutdown_connections 2023-10-14T18:51:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5448066f30 0x7f54480693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f546415d580 0x7f546416a700 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5464157870 0x7f5464151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 --2- 172.21.15.79:0/850015036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f546415a620 0x7f54641532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 >> 172.21.15.79:0/850015036 conn(0x7f5464068ce0 msgr2=0x7f54640afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 shutdown_connections 2023-10-14T18:51:15.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.396+0000 7f546bbfe700 1 -- 172.21.15.79:0/850015036 wait complete. 2023-10-14T18:51:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:51:15.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:51:15.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 Processor -- start 2023-10-14T18:51:15.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 -- start start 2023-10-14T18:51:15.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e2815a290 0x7f4e2806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e2806aae0 0x7f4e280cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280b0790 con 0x7f4e28159ec0 2023-10-14T18:51:15.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2806af60 con 0x7f4e2815a290 2023-10-14T18:51:15.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.527+0000 7f4e2cbaf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280ce1f0 con 0x7f4e2806aae0 2023-10-14T18:51:15.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e2815a290 0x7f4e2806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e2659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4e28159ec0 0x7f4e280af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40768/0 (socket says 172.21.15.79:40768) 2023-10-14T18:51:15.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e2659c700 1 -- 172.21.15.79:0/1560272516 learned_addr learned my addr 172.21.15.79:0/1560272516 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:15.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 -- 172.21.15.79:0/1560272516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e2806aae0 msgr2=0x7f4e280cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:15.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e26d9d700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e2806aae0 0x7f4e280cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e2806aae0 0x7f4e280cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 -- 172.21.15.79:0/1560272516 >> v1:172.21.15.79:6789/0 conn(0x7f4e28159ec0 legacy=0x7f4e280af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e25d9b700 1 -- 172.21.15.79:0/1560272516 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616317735 0 0) 0x7f4e280b0790 con 0x7f4e28159ec0 2023-10-14T18:51:15.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 -- 172.21.15.79:0/1560272516 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e280b0b20 con 0x7f4e2815a290 2023-10-14T18:51:15.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e1dd9b700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e2806a5a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4e100098e0 tx=0x7f4e100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63de5b8da97793 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e25d9b700 1 -- 172.21.15.79:0/1560272516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10009e80 con 0x7f4e2815a290 2023-10-14T18:51:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e25d9b700 1 -- 172.21.15.79:0/1560272516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000b860 con 0x7f4e2815a290 2023-10-14T18:51:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.528+0000 7f4e25d9b700 1 -- 172.21.15.79:0/1560272516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000bbe0 con 0x7f4e2815a290 2023-10-14T18:51:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1560272516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 msgr2=0x7f4e2806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e2806a5a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f4e100098e0 tx=0x7f4e100091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1560272516 shutdown_connections 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e2806aae0 0x7f4e280cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1560272516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e2806a5a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1560272516 >> 172.21.15.79:0/1560272516 conn(0x7f4e280d1880 msgr2=0x7f4e280cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1560272516 shutdown_connections 2023-10-14T18:51:15.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.529+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1560272516 wait complete. 2023-10-14T18:51:15.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.530+0000 7f4e2cbaf700 1 Processor -- start 2023-10-14T18:51:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.530+0000 7f4e2cbaf700 1 -- start start 2023-10-14T18:51:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e2806aae0 0x7f4e2815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 0x7f4e28155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b6850 con 0x7f4e2815a290 2023-10-14T18:51:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28155f50 con 0x7f4e2806aae0 2023-10-14T18:51:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280b5bd0 con 0x7f4e28159ec0 2023-10-14T18:51:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46180/0 (socket says 172.21.15.79:46180) 2023-10-14T18:51:15.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 -- 172.21.15.79:0/1879043646 learned_addr learned my addr 172.21.15.79:0/1879043646 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2659c700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e2806aae0 0x7f4e2815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e1dd9b700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 0x7f4e28155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 -- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 msgr2=0x7f4e28155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 0x7f4e28155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 -- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e2806aae0 msgr2=0x7f4e2815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e2806aae0 0x7f4e2815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 -- 172.21.15.79:0/1879043646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009420 con 0x7f4e2815a290 2023-10-14T18:51:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e1dd9b700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 0x7f4e28155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e26d9d700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ceb0 tx=0x7f4e20007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000ae40 con 0x7f4e2815a290 2023-10-14T18:51:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20016430 con 0x7f4e2815a290 2023-10-14T18:51:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e280b5eb0 con 0x7f4e2815a290 2023-10-14T18:51:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e200167d0 con 0x7f4e2815a290 2023-10-14T18:51:15.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.531+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e280b6470 con 0x7f4e2815a290 2023-10-14T18:51:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.532+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e280b6990 con 0x7f4e2815a290 2023-10-14T18:51:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.533+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e20003020 con 0x7f4e2815a290 2023-10-14T18:51:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.533+0000 7f4e1effd700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.533+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e20012070 con 0x7f4e2815a290 2023-10-14T18:51:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.533+0000 7f4e2659c700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.534+0000 7f4e2659c700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4e280caf60 tx=0x7f4e18007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.537+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e200526b0 con 0x7f4e2815a290 2023-10-14T18:51:15.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.719+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e2804c3c0 con 0x7f4e2815a290 2023-10-14T18:51:15.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.719+0000 7f4e1effd700 1 -- 172.21.15.79:0/1879043646 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e20055cd0 con 0x7f4e2815a290 2023-10-14T18:51:15.720 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:51:15.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 msgr2=0x7f4e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4e280caf60 tx=0x7f4e18007d30 comp rx=0 tx=0).stop 2023-10-14T18:51:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 msgr2=0x7f4e28155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000ceb0 tx=0x7f4e20007870 comp rx=0 tx=0).stop 2023-10-14T18:51:15.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 shutdown_connections 2023-10-14T18:51:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e2815a290 0x7f4e28155580 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e2806aae0 0x7f4e2815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 --2- 172.21.15.79:0/1879043646 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e28159ec0 0x7f4e28155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 >> 172.21.15.79:0/1879043646 conn(0x7f4e280d1880 msgr2=0x7f4e280b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 shutdown_connections 2023-10-14T18:51:15.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.721+0000 7f4e2cbaf700 1 -- 172.21.15.79:0/1879043646 wait complete. 2023-10-14T18:51:15.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:51:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.851+0000 7faa88dbf700 1 Processor -- start 2023-10-14T18:51:15.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.851+0000 7faa88dbf700 1 -- start start 2023-10-14T18:51:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faa84157870 0x7faa8415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa8415a620 0x7faa8415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 0x7faa84158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8415cbb0 con 0x7faa84157870 2023-10-14T18:51:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8415bfa0 con 0x7faa8415a620 2023-10-14T18:51:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa88dbf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8415c280 con 0x7faa8415d580 2023-10-14T18:51:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa8259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faa84157870 0x7faa8415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa8259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faa84157870 0x7faa8415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46184/0 (socket says 172.21.15.79:46184) 2023-10-14T18:51:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa8259c700 1 -- 172.21.15.79:0/1997570414 learned_addr learned my addr 172.21.15.79:0/1997570414 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa79d9b700 1 --2- 172.21.15.79:0/1997570414 >> v2:172.21.15.144:3300/0 conn(0x7faa8415a620 0x7faa8415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.852+0000 7faa82d9d700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 0x7faa84158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 -- 172.21.15.79:0/1997570414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 msgr2=0x7faa84158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:15.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 0x7faa84158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 -- 172.21.15.79:0/1997570414 >> v2:172.21.15.144:3300/0 conn(0x7faa8415a620 msgr2=0x7faa8415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 --2- 172.21.15.79:0/1997570414 >> v2:172.21.15.144:3300/0 conn(0x7faa8415a620 0x7faa8415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 -- 172.21.15.79:0/1997570414 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8415c560 con 0x7faa84157870 2023-10-14T18:51:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa82d9d700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 0x7faa84158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:15.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa8259c700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa84157870 0x7faa8415b6a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7faa8415cb20 tx=0x7faa74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b056b48f58c70a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa81d9b700 1 -- 172.21.15.79:0/1997570414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400b860 con 0x7faa84157870 2023-10-14T18:51:15.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa81d9b700 1 -- 172.21.15.79:0/1997570414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400b9c0 con 0x7faa84157870 2023-10-14T18:51:15.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa81d9b700 1 -- 172.21.15.79:0/1997570414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400bd60 con 0x7faa84157870 2023-10-14T18:51:15.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 -- 172.21.15.79:0/1997570414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa84157870 msgr2=0x7faa8415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa84157870 0x7faa8415b6a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7faa8415cb20 tx=0x7faa74009250 comp rx=0 tx=0).stop 2023-10-14T18:51:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 -- 172.21.15.79:0/1997570414 shutdown_connections 2023-10-14T18:51:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa8415d580 0x7faa84158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1997570414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa84157870 0x7faa8415b6a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1997570414 >> v2:172.21.15.144:3300/0 conn(0x7faa8415a620 0x7faa8415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 -- 172.21.15.79:0/1997570414 >> 172.21.15.79:0/1997570414 conn(0x7faa84068ce0 msgr2=0x7faa840690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 -- 172.21.15.79:0/1997570414 shutdown_connections 2023-10-14T18:51:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.853+0000 7faa88dbf700 1 -- 172.21.15.79:0/1997570414 wait complete. 2023-10-14T18:51:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 Processor -- start 2023-10-14T18:51:15.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 -- start start 2023-10-14T18:51:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa84157870 0x7faa84151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa8415d580 0x7faa840b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa840cff50 con 0x7faa8415a620 2023-10-14T18:51:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa84151890 con 0x7faa8415d580 2023-10-14T18:51:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa88dbf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840cf340 con 0x7faa84157870 2023-10-14T18:51:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.855+0000 7faa79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46186/0 (socket says 172.21.15.79:46186) 2023-10-14T18:51:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 -- 172.21.15.79:0/1646100488 learned_addr learned my addr 172.21.15.79:0/1646100488 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa8259c700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa84157870 0x7faa84151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa82d9d700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa8415d580 0x7faa840b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 -- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa84157870 msgr2=0x7faa84151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa84157870 0x7faa84151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 -- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa8415d580 msgr2=0x7faa840b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa8415d580 0x7faa840b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 -- 172.21.15.79:0/1646100488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa740094f0 con 0x7faa8415a620 2023-10-14T18:51:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa79d9b700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d860 tx=0x7faa6c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0125f0 con 0x7faa8415a620 2023-10-14T18:51:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c012750 con 0x7faa8415a620 2023-10-14T18:51:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa840cf620 con 0x7faa8415a620 2023-10-14T18:51:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c012ad0 con 0x7faa8415a620 2023-10-14T18:51:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.856+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa840cfbe0 con 0x7faa8415a620 2023-10-14T18:51:15.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.857+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa840d00c0 con 0x7faa8415a620 2023-10-14T18:51:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.857+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa6c01e460 con 0x7faa8415a620 2023-10-14T18:51:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.858+0000 7faa7affd700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.858+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faa6c0848a0 con 0x7faa8415a620 2023-10-14T18:51:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.858+0000 7faa8259c700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:15.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.858+0000 7faa8259c700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faa8415cb20 tx=0x7faa74017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:15.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:15.862+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa6c0558f0 con 0x7faa8415a620 2023-10-14T18:51:16.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.048+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faa8404c3c0 con 0x7faa8415a620 2023-10-14T18:51:16.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.048+0000 7faa7affd700 1 -- 172.21.15.79:0/1646100488 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) v1 ==== 84+0+65 (secure 0 0 0) 0x7faa6c055480 con 0x7faa8415a620 2023-10-14T18:51:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:16.049 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:51:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:51:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:51:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:16.051 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:51:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 msgr2=0x7faa640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 0x7faa640693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7faa8415cb20 tx=0x7faa74017000 comp rx=0 tx=0).stop 2023-10-14T18:51:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 msgr2=0x7faa840b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00d860 tx=0x7faa6c008040 comp rx=0 tx=0).stop 2023-10-14T18:51:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 shutdown_connections 2023-10-14T18:51:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa64066f30 0x7faa640693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa8415d580 0x7faa840b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa84157870 0x7faa84151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 --2- 172.21.15.79:0/1646100488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa8415a620 0x7faa840b5210 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 >> 172.21.15.79:0/1646100488 conn(0x7faa84068ce0 msgr2=0x7faa84153010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:16.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 shutdown_connections 2023-10-14T18:51:16.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.050+0000 7faa88dbf700 1 -- 172.21.15.79:0/1646100488 wait complete. 2023-10-14T18:51:16.063 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:51:16.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.180+0000 7f050ff98700 1 Processor -- start 2023-10-14T18:51:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 -- start start 2023-10-14T18:51:16.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f05080b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0508068cb0 0x7f0508069110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0508069650 con 0x7f05080b3370 2023-10-14T18:51:16.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080b0d60 con 0x7f0508068cb0 2023-10-14T18:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050ff98700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080d15b0 con 0x7f0508159e50 2023-10-14T18:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050d533700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05080b3370 0x7f05080b11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40772/0 (socket says 172.21.15.79:40772) 2023-10-14T18:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.181+0000 7f050d533700 1 -- 172.21.15.79:0/2539732052 learned_addr learned my addr 172.21.15.79:0/2539732052 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050e535700 1 --2- 172.21.15.79:0/2539732052 >> v2:172.21.15.144:3300/0 conn(0x7f0508068cb0 0x7f0508069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050dd34700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f05080b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936915292 0 0) 0x7f04f8001110 con 0x7f05080b3370 2023-10-14T18:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f4003570 con 0x7f05080b3370 2023-10-14T18:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1614012533 0 0) 0x7f04f4003570 con 0x7f05080b3370 2023-10-14T18:51:16.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 msgr2=0x7f05080b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:16.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f05080b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 >> v2:172.21.15.144:3300/0 conn(0x7f0508068cb0 msgr2=0x7f0508069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:16.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 --2- 172.21.15.79:0/2539732052 >> v2:172.21.15.144:3300/0 conn(0x7f0508068cb0 0x7f0508069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080d1890 con 0x7f05080b3370 2023-10-14T18:51:16.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f04f8001600 con 0x7f05080b3370 2023-10-14T18:51:16.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 >> v1:172.21.15.79:6789/0 conn(0x7f05080b3370 legacy=0x7f05080b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4003a60 0x7f04f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4004810 0x7f04f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f04f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080b0d60 con 0x7f04f4004810 2023-10-14T18:51:16.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080d15b0 con 0x7f04f4003a60 2023-10-14T18:51:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f400ba60 con 0x7f0508159e50 2023-10-14T18:51:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050d533700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4004810 0x7f04f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050dd34700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4003a60 0x7f04f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050e535700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f04f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050d533700 1 -- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 msgr2=0x7f04f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:16.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050d533700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0508159e50 0x7f04f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.182+0000 7f050d533700 1 -- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4003a60 msgr2=0x7f04f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:16.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050d533700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4003a60 0x7f04f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050d533700 1 -- 172.21.15.79:0/2539732052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4003570 con 0x7f04f4004810 2023-10-14T18:51:16.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050d533700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4004810 0x7f04f4004c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c5f0 tx=0x7f05080b0cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b233e8eb133458e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800cdb0 con 0x7f04f4004810 2023-10-14T18:51:16.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8005920 con 0x7f04f4004810 2023-10-14T18:51:16.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050cd32700 1 -- 172.21.15.79:0/2539732052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8005ce0 con 0x7f04f4004810 2023-10-14T18:51:16.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 -- 172.21.15.79:0/2539732052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4004810 msgr2=0x7f04f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 --2- 172.21.15.79:0/2539732052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04f4004810 0x7f04f4004c80 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c5f0 tx=0x7f05080b0cd0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050e535700 1 -- 172.21.15.79:0/2539732052 reap_dead start 2023-10-14T18:51:16.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 -- 172.21.15.79:0/2539732052 shutdown_connections 2023-10-14T18:51:16.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 -- 172.21.15.79:0/2539732052 >> 172.21.15.79:0/2539732052 conn(0x7f0508068130 msgr2=0x7f05080d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:16.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 -- 172.21.15.79:0/2539732052 shutdown_connections 2023-10-14T18:51:16.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.183+0000 7f050ff98700 1 -- 172.21.15.79:0/2539732052 wait complete. 2023-10-14T18:51:16.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.184+0000 7f050ff98700 1 Processor -- start 2023-10-14T18:51:16.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 -- start start 2023-10-14T18:51:16.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04f4004810 0x7f050815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 0x7f05080cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081567f0 con 0x7f050816a3a0 2023-10-14T18:51:16.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508156ad0 con 0x7f0508151180 2023-10-14T18:51:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050ff98700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508156db0 con 0x7f04f4004810 2023-10-14T18:51:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050d533700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050d533700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46200/0 (socket says 172.21.15.79:46200) 2023-10-14T18:51:16.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050d533700 1 -- 172.21.15.79:0/2472345596 learned_addr learned my addr 172.21.15.79:0/2472345596 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050dd34700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04f4004810 0x7f050815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.185+0000 7f050e535700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 0x7f05080cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 -- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04f4004810 msgr2=0x7f050815cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04f4004810 0x7f050815cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 -- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 msgr2=0x7f05080cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 0x7f05080cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 -- 172.21.15.79:0/2472345596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508157090 con 0x7f050816a3a0 2023-10-14T18:51:16.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050e535700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 0x7f05080cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050d533700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f04f800cbe0 tx=0x7f04f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80010e0 con 0x7f050816a3a0 2023-10-14T18:51:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80072e0 con 0x7f050816a3a0 2023-10-14T18:51:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050816a7f0 con 0x7f050816a3a0 2023-10-14T18:51:16.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80076a0 con 0x7f050816a3a0 2023-10-14T18:51:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.186+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05081515b0 con 0x7f050816a3a0 2023-10-14T18:51:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.187+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050804c3c0 con 0x7f050816a3a0 2023-10-14T18:51:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.187+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04f8019030 con 0x7f050816a3a0 2023-10-14T18:51:16.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.188+0000 7f04fdffb700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 0x7f04ec069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.188+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f04f80853b0 con 0x7f050816a3a0 2023-10-14T18:51:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.188+0000 7f050dd34700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 0x7f04ec069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.189+0000 7f050dd34700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 0x7f04ec069410 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05040094d0 tx=0x7f050400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.192+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04f8052970 con 0x7f050816a3a0 2023-10-14T18:51:16.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.373+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0508159420 con 0x7f050816a3a0 2023-10-14T18:51:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.654+0000 7f04fdffb700 1 -- 172.21.15.79:0/2472345596 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) v1 ==== 138+0+0 (secure 0 0 0) 0x7f04f8055f90 con 0x7f050816a3a0 2023-10-14T18:51:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.657+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 msgr2=0x7f04ec069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.657+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 0x7f04ec069410 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05040094d0 tx=0x7f050400b040 comp rx=0 tx=0).stop 2023-10-14T18:51:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.657+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 msgr2=0x7f050815ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.657+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f04f800cbe0 tx=0x7f04f8015000 comp rx=0 tx=0).stop 2023-10-14T18:51:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 shutdown_connections 2023-10-14T18:51:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04ec066f60 0x7f04ec069410 secure :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05040094d0 tx=0x7f050400b040 comp rx=0 tx=0).stop 2023-10-14T18:51:16.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0508151180 0x7f05080cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04f4004810 0x7f050815cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 --2- 172.21.15.79:0/2472345596 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f050816a3a0 0x7f050815ef40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 >> 172.21.15.79:0/2472345596 conn(0x7f0508068130 msgr2=0x7f05080d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 shutdown_connections 2023-10-14T18:51:16.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.658+0000 7f050ff98700 1 -- 172.21.15.79:0/2472345596 wait complete. 2023-10-14T18:51:16.661 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:51:16.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:51:16.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 Processor -- start 2023-10-14T18:51:16.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 -- start start 2023-10-14T18:51:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840b0790 con 0x7f0d8415a290 2023-10-14T18:51:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840ce1f0 con 0x7f0d84159ec0 2023-10-14T18:51:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.791+0000 7f0d88a78700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b0b20 con 0x7f0d8406acb0 2023-10-14T18:51:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d8259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d8259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60866/0 (socket says 172.21.15.79:60866) 2023-10-14T18:51:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:48874/0 (socket says 172.21.15.79:48874) 2023-10-14T18:51:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d8259c700 1 -- 172.21.15.79:0/2525002193 learned_addr learned my addr 172.21.15.79:0/2525002193 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d79d9b700 1 --1- 172.21.15.79:0/2525002193 >> v1:172.21.15.144:6789/0 conn(0x7f0d8415a290 0x7f0d8406a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:41750/0 (socket says 172.21.15.79:41750) 2023-10-14T18:51:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 -- 172.21.15.79:0/2525002193 >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 msgr2=0x7f0d840af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:16.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 --2- 172.21.15.79:0/2525002193 >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 -- 172.21.15.79:0/2525002193 >> v1:172.21.15.144:6789/0 conn(0x7f0d8415a290 legacy=0x7f0d8406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 -- 172.21.15.79:0/2525002193 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840b04b0 con 0x7f0d8406acb0 2023-10-14T18:51:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d8259c700 1 --2- 172.21.15.79:0/2525002193 >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.792+0000 7f0d82d9d700 1 --2- 172.21.15.79:0/2525002193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009e60 tx=0x7f0d7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba0c34cc0693940 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d81d9b700 1 -- 172.21.15.79:0/2525002193 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00e070 con 0x7f0d8406acb0 2023-10-14T18:51:16.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d81d9b700 1 -- 172.21.15.79:0/2525002193 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00bb60 con 0x7f0d8406acb0 2023-10-14T18:51:16.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d81d9b700 1 -- 172.21.15.79:0/2525002193 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c012430 con 0x7f0d8406acb0 2023-10-14T18:51:16.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 -- 172.21.15.79:0/2525002193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 msgr2=0x7f0d840afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 --2- 172.21.15.79:0/2525002193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009e60 tx=0x7f0d7c009780 comp rx=0 tx=0).stop 2023-10-14T18:51:16.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 -- 172.21.15.79:0/2525002193 shutdown_connections 2023-10-14T18:51:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 --2- 172.21.15.79:0/2525002193 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840afe80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 --2- 172.21.15.79:0/2525002193 >> v2:172.21.15.144:3300/0 conn(0x7f0d84159ec0 0x7f0d840af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 -- 172.21.15.79:0/2525002193 >> 172.21.15.79:0/2525002193 conn(0x7f0d840d1880 msgr2=0x7f0d840cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 -- 172.21.15.79:0/2525002193 shutdown_connections 2023-10-14T18:51:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.793+0000 7f0d88a78700 1 -- 172.21.15.79:0/2525002193 wait complete. 2023-10-14T18:51:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.794+0000 7f0d88a78700 1 Processor -- start 2023-10-14T18:51:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.794+0000 7f0d88a78700 1 -- start start 2023-10-14T18:51:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8415a290 0x7f0d840b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8414df00 con 0x7f0d84159ec0 2023-10-14T18:51:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b68f0 con 0x7f0d8415a290 2023-10-14T18:51:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d88a78700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840b4e70 con 0x7f0d8406acb0 2023-10-14T18:51:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46216/0 (socket says 172.21.15.79:46216) 2023-10-14T18:51:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d79d9b700 1 -- 172.21.15.79:0/158312131 learned_addr learned my addr 172.21.15.79:0/158312131 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d8259c700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.795+0000 7f0d82d9d700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8415a290 0x7f0d840b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 -- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 msgr2=0x7f0d840b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 -- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8415a290 msgr2=0x7f0d840b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8415a290 0x7f0d840b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 -- 172.21.15.79:0/158312131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740094f0 con 0x7f0d84159ec0 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d79d9b700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c590 tx=0x7f0d6c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c005a70 con 0x7f0d84159ec0 2023-10-14T18:51:16.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c005bd0 con 0x7f0d84159ec0 2023-10-14T18:51:16.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0070d0 con 0x7f0d84159ec0 2023-10-14T18:51:16.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c009a20 con 0x7f0d84159ec0 2023-10-14T18:51:16.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.796+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d840b4540 con 0x7f0d84159ec0 2023-10-14T18:51:16.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.797+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8404c3c0 con 0x7f0d84159ec0 2023-10-14T18:51:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.797+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d6c007480 con 0x7f0d84159ec0 2023-10-14T18:51:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.798+0000 7f0d7affd700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 0x7f0d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.798+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f0d6c083800 con 0x7f0d84159ec0 2023-10-14T18:51:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.798+0000 7f0d8259c700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 0x7f0d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.799+0000 7f0d8259c700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 0x7f0d640693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006fd0 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:16.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.802+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d6c050c50 con 0x7f0d84159ec0 2023-10-14T18:51:16.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:16.984+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0d840cbea0 con 0x7f0d84159ec0 2023-10-14T18:51:17.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.660+0000 7f0d7affd700 1 -- 172.21.15.79:0/158312131 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0d6c017070 con 0x7f0d84159ec0 2023-10-14T18:51:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.665+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 msgr2=0x7f0d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.665+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 0x7f0d640693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0d74006fd0 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2023-10-14T18:51:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.665+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 msgr2=0x7f0d8414d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:17.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.665+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c590 tx=0x7f0d6c007f70 comp rx=0 tx=0).stop 2023-10-14T18:51:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 shutdown_connections 2023-10-14T18:51:17.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0d64066f30 0x7f0d640693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d8415a290 0x7f0d840b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0d8406acb0 0x7f0d840b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 --2- 172.21.15.79:0/158312131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d84159ec0 0x7f0d8414d9c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.666+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 >> 172.21.15.79:0/158312131 conn(0x7f0d840d1880 msgr2=0x7f0d84153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:17.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.669+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 shutdown_connections 2023-10-14T18:51:17.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.672+0000 7f0d88a78700 1 -- 172.21.15.79:0/158312131 wait complete. 2023-10-14T18:51:17.675 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:51:17.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:51:17.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.803+0000 7f2349f7f700 1 Processor -- start 2023-10-14T18:51:17.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.803+0000 7f2349f7f700 1 -- start start 2023-10-14T18:51:17.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2349f7f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23440adc80 0x7f23440b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2349f7f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440cf0f0 0x7f23440b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2349f7f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440b0e40 con 0x7f23440b0460 2023-10-14T18:51:17.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2349f7f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440b1850 con 0x7f23440cf0f0 2023-10-14T18:51:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2349f7f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440b20f0 con 0x7f23440adc80 2023-10-14T18:51:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440cf0f0 0x7f23440b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440cf0f0 0x7f23440b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46222/0 (socket says 172.21.15.79:46222) 2023-10-14T18:51:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 -- 172.21.15.79:0/4091609202 learned_addr learned my addr 172.21.15.79:0/4091609202 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 -- 172.21.15.79:0/4091609202 >> v2:172.21.15.144:3300/0 conn(0x7f23440adc80 msgr2=0x7f23440b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f2348f7d700 1 --2- 172.21.15.79:0/4091609202 >> v2:172.21.15.144:3300/0 conn(0x7f23440adc80 0x7f23440b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 --2- 172.21.15.79:0/4091609202 >> v2:172.21.15.144:3300/0 conn(0x7f23440adc80 0x7f23440b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 -- 172.21.15.79:0/4091609202 >> v1:172.21.15.144:6789/0 conn(0x7f23440b0460 legacy=0x7f23440ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 -- 172.21.15.79:0/4091609202 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440cf500 con 0x7f23440cf0f0 2023-10-14T18:51:17.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f234977e700 1 --2- 172.21.15.79:0/4091609202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440b0900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2344070300 tx=0x7f233c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb55cbb00e0bc4d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f23437fe700 1 -- 172.21.15.79:0/4091609202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00e070 con 0x7f23440cf0f0 2023-10-14T18:51:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f23437fe700 1 -- 172.21.15.79:0/4091609202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00ba10 con 0x7f23440cf0f0 2023-10-14T18:51:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.804+0000 7f23437fe700 1 -- 172.21.15.79:0/4091609202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0092e0 con 0x7f23440cf0f0 2023-10-14T18:51:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 -- 172.21.15.79:0/4091609202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 msgr2=0x7f23440b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:17.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 --2- 172.21.15.79:0/4091609202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440b0900 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2344070300 tx=0x7f233c009840 comp rx=0 tx=0).stop 2023-10-14T18:51:17.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 -- 172.21.15.79:0/4091609202 shutdown_connections 2023-10-14T18:51:17.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 --2- 172.21.15.79:0/4091609202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440b0900 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 --2- 172.21.15.79:0/4091609202 >> v2:172.21.15.144:3300/0 conn(0x7f23440adc80 0x7f23440b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 -- 172.21.15.79:0/4091609202 >> 172.21.15.79:0/4091609202 conn(0x7f234406c700 msgr2=0x7f2344069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:17.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 -- 172.21.15.79:0/4091609202 shutdown_connections 2023-10-14T18:51:17.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.805+0000 7f2349f7f700 1 -- 172.21.15.79:0/4091609202 wait complete. 2023-10-14T18:51:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.806+0000 7f2349f7f700 1 Processor -- start 2023-10-14T18:51:17.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.806+0000 7f2349f7f700 1 -- start start 2023-10-14T18:51:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440adc80 0x7f234414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b0460 0x7f2344068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440aa870 con 0x7f23440cf0f0 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440ab0d0 con 0x7f23440adc80 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2349f7f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344068ad0 con 0x7f23440b0460 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46230/0 (socket says 172.21.15.79:46230) 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 -- 172.21.15.79:0/2804847568 learned_addr learned my addr 172.21.15.79:0/2804847568 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 -- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b0460 msgr2=0x7f2344068010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b0460 0x7f2344068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f2348f7d700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440adc80 0x7f234414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 -- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440adc80 msgr2=0x7f234414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440adc80 0x7f234414b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:17.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 -- 172.21.15.79:0/2804847568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009ae0 con 0x7f23440cf0f0 2023-10-14T18:51:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.807+0000 7f234977e700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.808+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00bee0 con 0x7f23440cf0f0 2023-10-14T18:51:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.808+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c012e60 con 0x7f23440cf0f0 2023-10-14T18:51:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.808+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440aaa80 con 0x7f23440cf0f0 2023-10-14T18:51:17.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.808+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c01d650 con 0x7f23440cf0f0 2023-10-14T18:51:17.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.808+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234416ab00 con 0x7f23440cf0f0 2023-10-14T18:51:17.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.809+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440ab280 con 0x7f23440cf0f0 2023-10-14T18:51:17.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.809+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f233c01da40 con 0x7f23440cf0f0 2023-10-14T18:51:17.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.810+0000 7f2340ff9700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:17.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.810+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f233c085cf0 con 0x7f23440cf0f0 2023-10-14T18:51:17.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.810+0000 7f2348f7d700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:17.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.810+0000 7f2348f7d700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f23380089b0 tx=0x7f2338008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:17.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:17.814+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23440ab280 con 0x7f23440cf0f0 2023-10-14T18:51:18.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.039+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f234404c430 con 0x7f23440cf0f0 2023-10-14T18:51:18.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.675+0000 7f2340ff9700 1 -- 172.21.15.79:0/2804847568 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7f234404c430 con 0x7f23440cf0f0 2023-10-14T18:51:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 msgr2=0x7f23280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f23380089b0 tx=0x7f2338008040 comp rx=0 tx=0).stop 2023-10-14T18:51:18.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 msgr2=0x7f23440cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c017000 comp rx=0 tx=0).stop 2023-10-14T18:51:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 shutdown_connections 2023-10-14T18:51:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440cf0f0 0x7f23440cc080 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440adc80 0x7f234414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 --2- 172.21.15.79:0/2804847568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b0460 0x7f2344068010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 >> 172.21.15.79:0/2804847568 conn(0x7f234406c700 msgr2=0x7f23441575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:18.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 shutdown_connections 2023-10-14T18:51:18.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.683+0000 7f2349f7f700 1 -- 172.21.15.79:0/2804847568 wait complete. 2023-10-14T18:51:18.687 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 16 and data pool 17 2023-10-14T18:51:18.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:18.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.810+0000 7fa2e73b4700 1 Processor -- start 2023-10-14T18:51:18.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.810+0000 7fa2e73b4700 1 -- start start 2023-10-14T18:51:18.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e73b4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e00cdab0 0x7fa2e015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:18.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e73b4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00cb7c0 con 0x7fa2e00cd6e0 2023-10-14T18:51:18.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e73b4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e015e290 con 0x7fa2e015dda0 2023-10-14T18:51:18.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e73b4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e015e850 con 0x7fa2e00cdab0 2023-10-14T18:51:18.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e00cdab0 0x7fa2e015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:18.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2e00cdab0 0x7fa2e015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35368/0 (socket says 172.21.15.79:35368) 2023-10-14T18:51:18.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e63b2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa2e00cd6e0 0x7fa2e00cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35216/0 (socket says 172.21.15.79:35216) 2023-10-14T18:51:18.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 -- 172.21.15.79:0/753466630 learned_addr learned my addr 172.21.15.79:0/753466630 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:18.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 -- 172.21.15.79:0/753466630 >> v1:172.21.15.144:6789/0 conn(0x7fa2e015dda0 legacy=0x7fa2e015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 -- 172.21.15.79:0/753466630 >> v1:172.21.15.79:6789/0 conn(0x7fa2e00cd6e0 legacy=0x7fa2e00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 -- 172.21.15.79:0/753466630 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e015e570 con 0x7fa2e00cdab0 2023-10-14T18:51:18.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.811+0000 7fa2e5bb1700 1 --2- 172.21.15.79:0/753466630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e00cdab0 0x7fa2e015d860 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6b485653078a48 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:18.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e53b0700 1 -- 172.21.15.79:0/753466630 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000b860 con 0x7fa2e00cdab0 2023-10-14T18:51:18.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e53b0700 1 -- 172.21.15.79:0/753466630 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000b9c0 con 0x7fa2e00cdab0 2023-10-14T18:51:18.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e53b0700 1 -- 172.21.15.79:0/753466630 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000bd60 con 0x7fa2e00cdab0 2023-10-14T18:51:18.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 -- 172.21.15.79:0/753466630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e00cdab0 msgr2=0x7fa2e015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/753466630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e00cdab0 0x7fa2e015d860 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00099b0 tx=0x7fa2d0009250 comp rx=0 tx=0).stop 2023-10-14T18:51:18.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 -- 172.21.15.79:0/753466630 shutdown_connections 2023-10-14T18:51:18.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/753466630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e00cdab0 0x7fa2e015d860 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 -- 172.21.15.79:0/753466630 >> 172.21.15.79:0/753466630 conn(0x7fa2e0067660 msgr2=0x7fa2e0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:18.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 -- 172.21.15.79:0/753466630 shutdown_connections 2023-10-14T18:51:18.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.812+0000 7fa2e73b4700 1 -- 172.21.15.79:0/753466630 wait complete. 2023-10-14T18:51:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.813+0000 7fa2e73b4700 1 Processor -- start 2023-10-14T18:51:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.813+0000 7fa2e73b4700 1 -- start start 2023-10-14T18:51:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 0x7fa2e014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:18.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2e00cdab0 0x7fa2e00b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:18.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:18.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00cc360 con 0x7fa2e015dda0 2023-10-14T18:51:18.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0160c30 con 0x7fa2e00cd6e0 2023-10-14T18:51:18.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e73b4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00cabd0 con 0x7fa2e00cdab0 2023-10-14T18:51:18.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:18.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35372/0 (socket says 172.21.15.79:35372) 2023-10-14T18:51:18.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 -- 172.21.15.79:0/4227859653 learned_addr learned my addr 172.21.15.79:0/4227859653 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:18.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e63b2700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 0x7fa2e014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:18.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e5bb1700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2e00cdab0 0x7fa2e00b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:18.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 -- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2e00cdab0 msgr2=0x7fa2e00b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2e00cdab0 0x7fa2e00b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 -- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 msgr2=0x7fa2e014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:18.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 0x7fa2e014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:18.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e6bb3700 1 -- 172.21.15.79:0/4227859653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00094f0 con 0x7fa2e015dda0 2023-10-14T18:51:18.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.814+0000 7fa2e63b2700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 0x7fa2e014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:18.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2e6bb3700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c810 tx=0x7fa2d8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:18.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8012630 con 0x7fa2e015dda0 2023-10-14T18:51:18.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d80127b0 con 0x7fa2e015dda0 2023-10-14T18:51:18.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00c9fc0 con 0x7fa2e015dda0 2023-10-14T18:51:18.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8012b70 con 0x7fa2e015dda0 2023-10-14T18:51:18.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.815+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e00ca580 con 0x7fa2e015dda0 2023-10-14T18:51:18.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.816+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e00b3a10 con 0x7fa2e015dda0 2023-10-14T18:51:18.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.816+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2d8003030 con 0x7fa2e015dda0 2023-10-14T18:51:18.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.816+0000 7fa2d67fc700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:18.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.816+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2d8084450 con 0x7fa2e015dda0 2023-10-14T18:51:18.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.817+0000 7fa2e63b2700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:18.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.817+0000 7fa2e63b2700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0161560 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:18.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:18.821+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2e00b3a10 con 0x7fa2e015dda0 2023-10-14T18:51:19.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.004+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2e00b3a10 con 0x7fa2e015dda0 2023-10-14T18:51:19.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.005+0000 7fa2d67fc700 1 -- 172.21.15.79:0/4227859653 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fa2e00b3a10 con 0x7fa2e015dda0 2023-10-14T18:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:19.007 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":137,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:18.040612+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:19.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 msgr2=0x7fa2c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 0x7fa2c40693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0161560 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2023-10-14T18:51:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 msgr2=0x7fa2e00b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c810 tx=0x7fa2d8001650 comp rx=0 tx=0).stop 2023-10-14T18:51:19.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 shutdown_connections 2023-10-14T18:51:19.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa2c4066f30 0x7fa2c40693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2e015dda0 0x7fa2e00b2490 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00cd6e0 0x7fa2e014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 --2- 172.21.15.79:0/4227859653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2e00cdab0 0x7fa2e00b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 >> 172.21.15.79:0/4227859653 conn(0x7fa2e0067660 msgr2=0x7fa2e00d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:19.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 shutdown_connections 2023-10-14T18:51:19.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.007+0000 7fa2e73b4700 1 -- 172.21.15.79:0/4227859653 wait complete. 2023-10-14T18:51:19.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:19.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.133+0000 7fd8795d0700 1 Processor -- start 2023-10-14T18:51:19.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.133+0000 7fd8795d0700 1 -- start start 2023-10-14T18:51:19.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd8795d0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd87415a620 0x7fd87415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd8795d0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87415cbb0 con 0x7fd874157870 2023-10-14T18:51:19.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd8795d0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87415bfa0 con 0x7fd87415d580 2023-10-14T18:51:19.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd8795d0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87415bdb0 con 0x7fd87415a620 2023-10-14T18:51:19.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd872ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd874157870 0x7fd87415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35228/0 (socket says 172.21.15.79:35228) 2023-10-14T18:51:19.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd872ffd700 1 -- 172.21.15.79:0/513437484 learned_addr learned my addr 172.21.15.79:0/513437484 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd8727fc700 1 --2- 172.21.15.79:0/513437484 >> v2:172.21.15.144:3300/0 conn(0x7fd87415a620 0x7fd87415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392668912 0 0) 0x7fd87415cbb0 con 0x7fd874157870 2023-10-14T18:51:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003570 con 0x7fd874157870 2023-10-14T18:51:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 891481790 0 0) 0x7fd860003570 con 0x7fd874157870 2023-10-14T18:51:19.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 >> v2:172.21.15.144:3300/0 conn(0x7fd87415a620 msgr2=0x7fd87415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 --2- 172.21.15.79:0/513437484 >> v2:172.21.15.144:3300/0 conn(0x7fd87415a620 0x7fd87415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 >> v1:172.21.15.144:6789/0 conn(0x7fd87415d580 legacy=0x7fd874158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87415c280 con 0x7fd874157870 2023-10-14T18:51:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd8640017f0 con 0x7fd874157870 2023-10-14T18:51:19.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 >> v1:172.21.15.79:6789/0 conn(0x7fd874157870 legacy=0x7fd87415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 0x7fd860003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd860004810 0x7fd860004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8600051c0 0x7fd86000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000c0b0 con 0x7fd860003a60 2023-10-14T18:51:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000c220 con 0x7fd8600051c0 2023-10-14T18:51:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.134+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000c3e0 con 0x7fd860004810 2023-10-14T18:51:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 0x7fd860003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd8737fe700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8600051c0 0x7fd86000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd8727fc700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd860004810 0x7fd860004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 -- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd860004810 msgr2=0x7fd860004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd860004810 0x7fd860004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 -- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8600051c0 msgr2=0x7fd86000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8600051c0 0x7fd86000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 -- 172.21.15.79:0/513437484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003570 con 0x7fd860003a60 2023-10-14T18:51:19.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd8737fe700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8600051c0 0x7fd86000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd8737fe700 1 -- 172.21.15.79:0/513437484 reap_dead start 2023-10-14T18:51:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd872ffd700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 0x7fd860003e30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd86400a950 tx=0x7fd8640021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76da73d824cdeb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640070d0 con 0x7fd860003a60 2023-10-14T18:51:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864007250 con 0x7fd860003a60 2023-10-14T18:51:19.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.135+0000 7fd871ffb700 1 -- 172.21.15.79:0/513437484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864007610 con 0x7fd860003a60 2023-10-14T18:51:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 -- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 msgr2=0x7fd860003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 0x7fd860003e30 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd86400a950 tx=0x7fd8640021f0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 -- 172.21.15.79:0/513437484 shutdown_connections 2023-10-14T18:51:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 --2- 172.21.15.79:0/513437484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd860003a60 0x7fd860003e30 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 -- 172.21.15.79:0/513437484 >> 172.21.15.79:0/513437484 conn(0x7fd874068ce0 msgr2=0x7fd8740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 -- 172.21.15.79:0/513437484 shutdown_connections 2023-10-14T18:51:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.136+0000 7fd8795d0700 1 -- 172.21.15.79:0/513437484 wait complete. 2023-10-14T18:51:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.137+0000 7fd8795d0700 1 Processor -- start 2023-10-14T18:51:19.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.137+0000 7fd8795d0700 1 -- start start 2023-10-14T18:51:19.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 0x7fd87414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd87414eb50 0x7fd87414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740b1e60 con 0x7fd8740b3410 2023-10-14T18:51:19.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740b0fb0 con 0x7fd860003a60 2023-10-14T18:51:19.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740b1250 con 0x7fd87414eb50 2023-10-14T18:51:19.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35396/0 (socket says 172.21.15.79:35396) 2023-10-14T18:51:19.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 -- 172.21.15.79:0/2306601940 learned_addr learned my addr 172.21.15.79:0/2306601940 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:19.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8737fe700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd87414eb50 0x7fd87414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd872ffd700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 0x7fd87414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 -- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd87414eb50 msgr2=0x7fd87414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd87414eb50 0x7fd87414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 -- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 msgr2=0x7fd87414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 0x7fd87414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 -- 172.21.15.79:0/2306601940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740b1530 con 0x7fd8740b3410 2023-10-14T18:51:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd872ffd700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 0x7fd87414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8727fc700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd85c011b40 tx=0x7fd85c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00fa70 con 0x7fd8740b3410 2023-10-14T18:51:19.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00fbd0 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c014440 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8740b1810 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.138+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740b22f0 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.139+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8740b2010 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.140+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd85c014870 con 0x7fd8740b3410 2023-10-14T18:51:19.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.140+0000 7fd86affd700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 0x7fd8540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.140+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd85c018030 con 0x7fd8740b3410 2023-10-14T18:51:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.140+0000 7fd872ffd700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 0x7fd8540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.141+0000 7fd872ffd700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 0x7fd8540693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd86400b010 tx=0x7fd864015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.144+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8740b2010 con 0x7fd8740b3410 2023-10-14T18:51:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.328+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd87404c3c0 con 0x7fd8740b3410 2023-10-14T18:51:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.329+0000 7fd86affd700 1 -- 172.21.15.79:0/2306601940 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fd85c059e60 con 0x7fd8740b3410 2023-10-14T18:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:19.330 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":137,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:18.040612+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:19.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.331+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 msgr2=0x7fd8540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.331+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 0x7fd8540693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd86400b010 tx=0x7fd864015000 comp rx=0 tx=0).stop 2023-10-14T18:51:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.331+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 msgr2=0x7fd8740b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.331+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd85c011b40 tx=0x7fd85c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 shutdown_connections 2023-10-14T18:51:19.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd854066f30 0x7fd8540693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd87414eb50 0x7fd87414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd860003a60 0x7fd87414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 --2- 172.21.15.79:0/2306601940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8740b3410 0x7fd8740b0a70 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 >> 172.21.15.79:0/2306601940 conn(0x7fd874068ce0 msgr2=0x7fd8740cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:19.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 shutdown_connections 2023-10-14T18:51:19.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.332+0000 7fd8795d0700 1 -- 172.21.15.79:0/2306601940 wait complete. 2023-10-14T18:51:19.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:51:19.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.461+0000 7f8f9cdb8700 1 Processor -- start 2023-10-14T18:51:19.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.461+0000 7f8f9cdb8700 1 -- start start 2023-10-14T18:51:19.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9cdb8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f98152300 0x7f8f9815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9cdb8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9815c8d0 con 0x7f8f9806d370 2023-10-14T18:51:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9cdb8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f980c9370 con 0x7f8f98158df0 2023-10-14T18:51:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9cdb8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f980b1400 con 0x7f8f98152300 2023-10-14T18:51:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f98152300 0x7f8f9815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f96d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8f9806d370 0x7f8f9806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35236/0 (socket says 172.21.15.79:35236) 2023-10-14T18:51:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f9659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f98152300 0x7f8f9815b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35406/0 (socket says 172.21.15.79:35406) 2023-10-14T18:51:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.462+0000 7f8f96d9d700 1 -- 172.21.15.79:0/2395400336 learned_addr learned my addr 172.21.15.79:0/2395400336 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9659c700 1 -- 172.21.15.79:0/2395400336 >> v1:172.21.15.144:6789/0 conn(0x7f8f98158df0 legacy=0x7f8f980caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9659c700 1 -- 172.21.15.79:0/2395400336 >> v1:172.21.15.79:6789/0 conn(0x7f8f9806d370 legacy=0x7f8f9806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9659c700 1 -- 172.21.15.79:0/2395400336 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9815c030 con 0x7f8f98152300 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9559a700 1 -- 172.21.15.79:0/2395400336 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267940428 0 0) 0x7f8f9815c8d0 con 0x7f8f9806d370 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9659c700 1 --2- 172.21.15.79:0/2395400336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f98152300 0x7f8f9815b9a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009e60 tx=0x7f8f88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634052ca1af6fa71 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9559a700 1 -- 172.21.15.79:0/2395400336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800e070 con 0x7f8f98152300 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9559a700 1 -- 172.21.15.79:0/2395400336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800bbf0 con 0x7f8f98152300 2023-10-14T18:51:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9559a700 1 -- 172.21.15.79:0/2395400336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88012430 con 0x7f8f98152300 2023-10-14T18:51:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/2395400336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f98152300 msgr2=0x7f8f9815b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.463+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/2395400336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f98152300 0x7f8f9815b9a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009e60 tx=0x7f8f88009780 comp rx=0 tx=0).stop 2023-10-14T18:51:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.464+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/2395400336 shutdown_connections 2023-10-14T18:51:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.464+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/2395400336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f98152300 0x7f8f9815b9a0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.464+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/2395400336 >> 172.21.15.79:0/2395400336 conn(0x7f8f98069870 msgr2=0x7f8f98069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:19.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.464+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/2395400336 shutdown_connections 2023-10-14T18:51:19.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.464+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/2395400336 wait complete. 2023-10-14T18:51:19.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 Processor -- start 2023-10-14T18:51:19.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 -- start start 2023-10-14T18:51:19.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 0x7f8f9816a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f98158df0 0x7f8f980c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980c78b0 con 0x7f8f9806d370 2023-10-14T18:51:19.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980c7a40 con 0x7f8f98152300 2023-10-14T18:51:19.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9cdb8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98067cd0 con 0x7f8f98158df0 2023-10-14T18:51:19.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.465+0000 7f8f9659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35408/0 (socket says 172.21.15.79:35408) 2023-10-14T18:51:19.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 -- 172.21.15.79:0/1389313613 learned_addr learned my addr 172.21.15.79:0/1389313613 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f95d9b700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 0x7f8f9816a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f96d9d700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f98158df0 0x7f8f980c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 -- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f98158df0 msgr2=0x7f8f980c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f98158df0 0x7f8f980c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 -- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 msgr2=0x7f8f9816a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 0x7f8f9816a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 -- 172.21.15.79:0/1389313613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009a20 con 0x7f8f9806d370 2023-10-14T18:51:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f95d9b700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 0x7f8f9816a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9659c700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800b6c0 tx=0x7f8f88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88012e80 con 0x7f8f9806d370 2023-10-14T18:51:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8801e640 con 0x7f8f9806d370 2023-10-14T18:51:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f98067fb0 con 0x7f8f9806d370 2023-10-14T18:51:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8801e9e0 con 0x7f8f9806d370 2023-10-14T18:51:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.466+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98068570 con 0x7f8f9806d370 2023-10-14T18:51:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.467+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9804c3c0 con 0x7f8f9806d370 2023-10-14T18:51:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.467+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f88024070 con 0x7f8f9806d370 2023-10-14T18:51:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.468+0000 7f8f867fc700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 0x7f8f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.468+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f88086ec0 con 0x7f8f9806d370 2023-10-14T18:51:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.468+0000 7f8f95d9b700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 0x7f8f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.468+0000 7f8f95d9b700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 0x7f8f780693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806a350 tx=0x7f8f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:19.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.472+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f880541e0 con 0x7f8f9806d370 2023-10-14T18:51:19.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:19.698+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8f980cdf10 con 0x7f8f9806d370 2023-10-14T18:51:20.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.690+0000 7f8f867fc700 1 -- 172.21.15.79:0/1389313613 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8f88057800 con 0x7f8f9806d370 2023-10-14T18:51:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 msgr2=0x7f8f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 0x7f8f780693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806a350 tx=0x7f8f8c008040 comp rx=0 tx=0).stop 2023-10-14T18:51:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 msgr2=0x7f8f98067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800b6c0 tx=0x7f8f88018000 comp rx=0 tx=0).stop 2023-10-14T18:51:20.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 shutdown_connections 2023-10-14T18:51:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8f78066f30 0x7f8f780693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8f98158df0 0x7f8f980c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f9806d370 0x7f8f98067660 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 --2- 172.21.15.79:0/1389313613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f98152300 0x7f8f9816a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 >> 172.21.15.79:0/1389313613 conn(0x7f8f98069870 msgr2=0x7f8f9815b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 shutdown_connections 2023-10-14T18:51:20.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.693+0000 7f8f9cdb8700 1 -- 172.21.15.79:0/1389313613 wait complete. 2023-10-14T18:51:20.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:51:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.824+0000 7fb9801e5700 1 Processor -- start 2023-10-14T18:51:20.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.824+0000 7fb9801e5700 1 -- start start 2023-10-14T18:51:20.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb9801e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb978159ec0 0x7fb9780af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb9801e5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780b0790 con 0x7fb97806acb0 2023-10-14T18:51:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb9801e5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9780ce1f0 con 0x7fb97815a290 2023-10-14T18:51:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb9801e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9780b0b20 con 0x7fb978159ec0 2023-10-14T18:51:20.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb97e782700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb97806acb0 0x7fb9780cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35240/0 (socket says 172.21.15.79:35240) 2023-10-14T18:51:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb97e782700 1 -- 172.21.15.79:0/1171769898 learned_addr learned my addr 172.21.15.79:0/1171769898 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb97df81700 1 --2- 172.21.15.79:0/1171769898 >> v2:172.21.15.144:3300/0 conn(0x7fb978159ec0 0x7fb9780af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331676914 0 0) 0x7fb9780b0790 con 0x7fb97806acb0 2023-10-14T18:51:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.825+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb964003570 con 0x7fb97806acb0 2023-10-14T18:51:20.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685481506 0 0) 0x7fb9780ce1f0 con 0x7fb97815a290 2023-10-14T18:51:20.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9780b0790 con 0x7fb97815a290 2023-10-14T18:51:20.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301317391 0 0) 0x7fb964003570 con 0x7fb97806acb0 2023-10-14T18:51:20.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 >> v2:172.21.15.144:3300/0 conn(0x7fb978159ec0 msgr2=0x7fb9780af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 --2- 172.21.15.79:0/1171769898 >> v2:172.21.15.144:3300/0 conn(0x7fb978159ec0 0x7fb9780af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 >> v1:172.21.15.144:6789/0 conn(0x7fb97815a290 legacy=0x7fb97806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780b04b0 con 0x7fb97806acb0 2023-10-14T18:51:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb9700017f0 con 0x7fb97806acb0 2023-10-14T18:51:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 >> v1:172.21.15.79:6789/0 conn(0x7fb97806acb0 legacy=0x7fb9780cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb964003c40 0x7fb964004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb964005210 0x7fb96400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780b0b20 con 0x7fb964004810 2023-10-14T18:51:20.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c1b0 con 0x7fb964003c40 2023-10-14T18:51:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c370 con 0x7fb964005210 2023-10-14T18:51:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97df81700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb964003c40 0x7fb964004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97e782700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb964005210 0x7fb96400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 -- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb964005210 msgr2=0x7fb96400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb964005210 0x7fb96400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 -- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb964003c40 msgr2=0x7fb964004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb964003c40 0x7fb964004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97e782700 1 -- 172.21.15.79:0/1171769898 reap_dead start 2023-10-14T18:51:20.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 -- 172.21.15.79:0/1171769898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964003570 con 0x7fb964004810 2023-10-14T18:51:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97d780700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb964004c80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb9680019e0 tx=0x7fb968007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5487f7fb03347cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96800c590 con 0x7fb964004810 2023-10-14T18:51:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.826+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96800c6f0 con 0x7fb964004810 2023-10-14T18:51:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb97cf7f700 1 -- 172.21.15.79:0/1171769898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96800ca90 con 0x7fb964004810 2023-10-14T18:51:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 -- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 msgr2=0x7fb964004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb964004c80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb9680019e0 tx=0x7fb968007d30 comp rx=0 tx=0).stop 2023-10-14T18:51:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 -- 172.21.15.79:0/1171769898 shutdown_connections 2023-10-14T18:51:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 --2- 172.21.15.79:0/1171769898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb964004c80 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 -- 172.21.15.79:0/1171769898 >> 172.21.15.79:0/1171769898 conn(0x7fb9780d1880 msgr2=0x7fb9780cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:20.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 -- 172.21.15.79:0/1171769898 shutdown_connections 2023-10-14T18:51:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.827+0000 7fb9801e5700 1 -- 172.21.15.79:0/1171769898 wait complete. 2023-10-14T18:51:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.828+0000 7fb9801e5700 1 Processor -- start 2023-10-14T18:51:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.828+0000 7fb9801e5700 1 -- start start 2023-10-14T18:51:20.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780c5b50 0x7fb9780c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 0x7fb9780c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978149e20 con 0x7fb964004810 2023-10-14T18:51:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780c6500 con 0x7fb9780c5b50 2023-10-14T18:51:20.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb9801e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780b6710 con 0x7fb9780c8bf0 2023-10-14T18:51:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35420/0 (socket says 172.21.15.79:35420) 2023-10-14T18:51:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 -- 172.21.15.79:0/107192206 learned_addr learned my addr 172.21.15.79:0/107192206 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:20.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97e782700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 0x7fb9780c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97d780700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780c5b50 0x7fb9780c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 -- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 msgr2=0x7fb9780c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 0x7fb9780c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 -- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780c5b50 msgr2=0x7fb9780c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780c5b50 0x7fb9780c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 -- 172.21.15.79:0/107192206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780b5b00 con 0x7fb964004810 2023-10-14T18:51:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97e782700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 0x7fb9780c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.829+0000 7fb97df81700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb974011d70 tx=0x7fb9740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.830+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974009e20 con 0x7fb964004810 2023-10-14T18:51:20.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.830+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400fcd0 con 0x7fb964004810 2023-10-14T18:51:20.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.830+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974014650 con 0x7fb964004810 2023-10-14T18:51:20.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.830+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9780b5de0 con 0x7fb964004810 2023-10-14T18:51:20.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.830+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9780b63a0 con 0x7fb964004810 2023-10-14T18:51:20.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.831+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97804c3c0 con 0x7fb964004810 2023-10-14T18:51:20.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.831+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb974014a80 con 0x7fb964004810 2023-10-14T18:51:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.831+0000 7fb96dffb700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 0x7fb95c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.831+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb974018030 con 0x7fb964004810 2023-10-14T18:51:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.832+0000 7fb97d780700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 0x7fb95c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.832+0000 7fb97d780700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 0x7fb95c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9780b5a30 tx=0x7fb968015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:20.835+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb974052210 con 0x7fb964004810 2023-10-14T18:51:21.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.059+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb9780ceab0 con 0x7fb964004810 2023-10-14T18:51:21.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.692+0000 7fb96dffb700 1 -- 172.21.15.79:0/107192206 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb9740220c0 con 0x7fb964004810 2023-10-14T18:51:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 msgr2=0x7fb95c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:21.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 0x7fb95c0693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9780b5a30 tx=0x7fb968015000 comp rx=0 tx=0).stop 2023-10-14T18:51:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 msgr2=0x7fb9781498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb974011d70 tx=0x7fb9740091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 shutdown_connections 2023-10-14T18:51:21.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb95c066f30 0x7fb95c0693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9780c8bf0 0x7fb9780c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb964004810 0x7fb9781498e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 --2- 172.21.15.79:0/107192206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9780c5b50 0x7fb9780c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 >> 172.21.15.79:0/107192206 conn(0x7fb9780d1880 msgr2=0x7fb9780cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:21.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 shutdown_connections 2023-10-14T18:51:21.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.694+0000 7fb9801e5700 1 -- 172.21.15.79:0/107192206 wait complete. 2023-10-14T18:51:21.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.823+0000 7fbd4ffff700 1 Processor -- start 2023-10-14T18:51:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.823+0000 7fbd4ffff700 1 -- start start 2023-10-14T18:51:21.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd500d0970 0x7fbd5015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd50153e50 0x7fbd501542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4ffff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd500cf0c0 con 0x7fbd5015aea0 2023-10-14T18:51:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4ffff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5015e8f0 con 0x7fbd500d0970 2023-10-14T18:51:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5015b320 con 0x7fbd50153e50 2023-10-14T18:51:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd500d0970 0x7fbd5015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd500d0970 0x7fbd5015b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35422/0 (socket says 172.21.15.79:35422) 2023-10-14T18:51:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 -- 172.21.15.79:0/40574091 learned_addr learned my addr 172.21.15.79:0/40574091 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4f7fe700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd50153e50 0x7fbd501542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 -- 172.21.15.79:0/40574091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd50153e50 msgr2=0x7fbd501542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd50153e50 0x7fbd501542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 -- 172.21.15.79:0/40574091 >> v1:172.21.15.144:6789/0 conn(0x7fbd5015aea0 legacy=0x7fbd500d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.824+0000 7fbd4effd700 1 -- 172.21.15.79:0/40574091 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd501547f0 con 0x7fbd500d0970 2023-10-14T18:51:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4effd700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd500d0970 0x7fbd5015b540 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fbd400099b0 tx=0x7fbd40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57054fdedf699352 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4e7fc700 1 -- 172.21.15.79:0/40574091 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000b820 con 0x7fbd500d0970 2023-10-14T18:51:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4e7fc700 1 -- 172.21.15.79:0/40574091 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000b980 con 0x7fbd500d0970 2023-10-14T18:51:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4e7fc700 1 -- 172.21.15.79:0/40574091 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000bd20 con 0x7fbd500d0970 2023-10-14T18:51:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 -- 172.21.15.79:0/40574091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd500d0970 msgr2=0x7fbd5015b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd500d0970 0x7fbd5015b540 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fbd400099b0 tx=0x7fbd40009250 comp rx=0 tx=0).stop 2023-10-14T18:51:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 -- 172.21.15.79:0/40574091 shutdown_connections 2023-10-14T18:51:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd50153e50 0x7fbd501542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/40574091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd500d0970 0x7fbd5015b540 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 -- 172.21.15.79:0/40574091 >> 172.21.15.79:0/40574091 conn(0x7fbd50068c00 msgr2=0x7fbd50069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 -- 172.21.15.79:0/40574091 shutdown_connections 2023-10-14T18:51:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.825+0000 7fbd4ffff700 1 -- 172.21.15.79:0/40574091 wait complete. 2023-10-14T18:51:21.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.826+0000 7fbd4ffff700 1 Processor -- start 2023-10-14T18:51:21.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 -- start start 2023-10-14T18:51:21.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 0x7fbd501445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd5015aea0 0x7fbd500c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50156850 con 0x7fbd50153e50 2023-10-14T18:51:21.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50155c40 con 0x7fbd500d0970 2023-10-14T18:51:21.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd4ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50155f20 con 0x7fbd5015aea0 2023-10-14T18:51:21.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:21.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35430/0 (socket says 172.21.15.79:35430) 2023-10-14T18:51:21.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.827+0000 7fbd467fc700 1 -- 172.21.15.79:0/3321668395 learned_addr learned my addr 172.21.15.79:0/3321668395 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:21.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 -- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd5015aea0 msgr2=0x7fbd500c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:21.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd5015aea0 0x7fbd500c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 -- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 msgr2=0x7fbd501445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:21.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd4effd700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 0x7fbd501445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:21.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 0x7fbd501445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:21.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 -- 172.21.15.79:0/3321668395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400094f0 con 0x7fbd50153e50 2023-10-14T18:51:21.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd4effd700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 0x7fbd501445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:21.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd467fc700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800b5e0 tx=0x7fbd38009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:21.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800f510 con 0x7fbd50153e50 2023-10-14T18:51:21.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800f670 con 0x7fbd50153e50 2023-10-14T18:51:21.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd50156200 con 0x7fbd50153e50 2023-10-14T18:51:21.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3800fa30 con 0x7fbd50153e50 2023-10-14T18:51:21.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.828+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd50144ae0 con 0x7fbd50153e50 2023-10-14T18:51:21.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.829+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd50089290 con 0x7fbd50153e50 2023-10-14T18:51:21.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.829+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd3801a400 con 0x7fbd50153e50 2023-10-14T18:51:21.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.830+0000 7fbd477fe700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:21.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.830+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd38084060 con 0x7fbd50153e50 2023-10-14T18:51:21.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.830+0000 7fbd4effd700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:21.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.830+0000 7fbd4effd700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd400099b0 tx=0x7fbd40016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:21.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:21.834+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd38051350 con 0x7fbd50153e50 2023-10-14T18:51:22.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.058+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd5015e050 con 0x7fbd50153e50 2023-10-14T18:51:22.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.059+0000 7fbd477fe700 1 -- 172.21.15.79:0/3321668395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fbd38054970 con 0x7fbd50153e50 2023-10-14T18:51:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:22.060 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:22.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 msgr2=0x7fbd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbd400099b0 tx=0x7fbd40016000 comp rx=0 tx=0).stop 2023-10-14T18:51:22.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 msgr2=0x7fbd500c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fbd3800b5e0 tx=0x7fbd38009120 comp rx=0 tx=0).stop 2023-10-14T18:51:22.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 shutdown_connections 2023-10-14T18:51:22.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbd5015aea0 0x7fbd500c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd500d0970 0x7fbd501445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 --2- 172.21.15.79:0/3321668395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd50153e50 0x7fbd500c5bf0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 >> 172.21.15.79:0/3321668395 conn(0x7fbd50068c00 msgr2=0x7fbd500b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 shutdown_connections 2023-10-14T18:51:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.061+0000 7fbd4ffff700 1 -- 172.21.15.79:0/3321668395 wait complete. 2023-10-14T18:51:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:22.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.188+0000 7fd7e9d2b700 1 Processor -- start 2023-10-14T18:51:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.188+0000 7fd7e9d2b700 1 -- start start 2023-10-14T18:51:22.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e9d2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7e4152010 0x7fd7e415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e9d2b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e406c010 con 0x7fd7e41523e0 2023-10-14T18:51:22.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e9d2b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e406bd10 con 0x7fd7e4158e50 2023-10-14T18:51:22.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e9d2b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e415c060 con 0x7fd7e4152010 2023-10-14T18:51:22.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7e4152010 0x7fd7e415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd7e41523e0 0x7fd7e406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35246/0 (socket says 172.21.15.79:35246) 2023-10-14T18:51:22.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.189+0000 7fd7e2ffd700 1 -- 172.21.15.79:0/3649486533 learned_addr learned my addr 172.21.15.79:0/3649486533 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:22.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e37fe700 1 -- 172.21.15.79:0/3649486533 >> v1:172.21.15.144:6789/0 conn(0x7fd7e4158e50 legacy=0x7fd7e40cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:22.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e27fc700 1 -- 172.21.15.79:0/3649486533 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974543430 0 0) 0x7fd7e406c010 con 0x7fd7e41523e0 2023-10-14T18:51:22.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e37fe700 1 -- 172.21.15.79:0/3649486533 >> v1:172.21.15.79:6789/0 conn(0x7fd7e41523e0 legacy=0x7fd7e406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e37fe700 1 -- 172.21.15.79:0/3649486533 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e415c340 con 0x7fd7e4152010 2023-10-14T18:51:22.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e37fe700 1 --2- 172.21.15.79:0/3649486533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4152010 0x7fd7e415b810 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009e60 tx=0x7fd7d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5eb4ca07e443de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e27fc700 1 -- 172.21.15.79:0/3649486533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400e070 con 0x7fd7e4152010 2023-10-14T18:51:22.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e27fc700 1 -- 172.21.15.79:0/3649486533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d400bbf0 con 0x7fd7e4152010 2023-10-14T18:51:22.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e27fc700 1 -- 172.21.15.79:0/3649486533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4012430 con 0x7fd7e4152010 2023-10-14T18:51:22.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3649486533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4152010 msgr2=0x7fd7e415b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.190+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3649486533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4152010 0x7fd7e415b810 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009e60 tx=0x7fd7d4009780 comp rx=0 tx=0).stop 2023-10-14T18:51:22.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.191+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3649486533 shutdown_connections 2023-10-14T18:51:22.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.191+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3649486533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4152010 0x7fd7e415b810 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.191+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3649486533 >> 172.21.15.79:0/3649486533 conn(0x7fd7e4069870 msgr2=0x7fd7e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.191+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3649486533 shutdown_connections 2023-10-14T18:51:22.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.191+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3649486533 wait complete. 2023-10-14T18:51:22.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 Processor -- start 2023-10-14T18:51:22.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 -- start start 2023-10-14T18:51:22.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7e4152010 0x7fd7e414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 0x7fd7e414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40c52b0 con 0x7fd7e4158e50 2023-10-14T18:51:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e414f960 con 0x7fd7e4152010 2023-10-14T18:51:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.192+0000 7fd7e9d2b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40b3f50 con 0x7fd7e41523e0 2023-10-14T18:51:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35452/0 (socket says 172.21.15.79:35452) 2023-10-14T18:51:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 -- 172.21.15.79:0/3369524653 learned_addr learned my addr 172.21.15.79:0/3369524653 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e37fe700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7e4152010 0x7fd7e414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e2ffd700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 0x7fd7e414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 -- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 msgr2=0x7fd7e414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 0x7fd7e414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 -- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7e4152010 msgr2=0x7fd7e414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7e4152010 0x7fd7e414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 -- 172.21.15.79:0/3369524653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4009a20 con 0x7fd7e4158e50 2023-10-14T18:51:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e2ffd700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 0x7fd7e414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e3fff700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00b4e0 tx=0x7fd7dc006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00f5e0 con 0x7fd7e4158e50 2023-10-14T18:51:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc00f740 con 0x7fd7e4158e50 2023-10-14T18:51:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e40c5c90 con 0x7fd7e4158e50 2023-10-14T18:51:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc00fb00 con 0x7fd7e4158e50 2023-10-14T18:51:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.193+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e40c6250 con 0x7fd7e4158e50 2023-10-14T18:51:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.194+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e404c3c0 con 0x7fd7e4158e50 2023-10-14T18:51:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.195+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7dc01a400 con 0x7fd7e4158e50 2023-10-14T18:51:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.195+0000 7fd7cb7fe700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 0x7fd7d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.195+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7dc084110 con 0x7fd7e4158e50 2023-10-14T18:51:22.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.195+0000 7fd7e37fe700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 0x7fd7d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.196+0000 7fd7e37fe700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 0x7fd7d00693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b43f0 tx=0x7fd7d4018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.199+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7dc051400 con 0x7fd7e4158e50 2023-10-14T18:51:22.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.381+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7e406d1b0 con 0x7fd7e4158e50 2023-10-14T18:51:22.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.382+0000 7fd7cb7fe700 1 -- 172.21.15.79:0/3369524653 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fd7dc054a20 con 0x7fd7e4158e50 2023-10-14T18:51:22.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:22.383 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":138,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:19.658581+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:22.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 msgr2=0x7fd7d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 0x7fd7d00693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b43f0 tx=0x7fd7d4018000 comp rx=0 tx=0).stop 2023-10-14T18:51:22.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 msgr2=0x7fd7e41501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc00b4e0 tx=0x7fd7dc006f90 comp rx=0 tx=0).stop 2023-10-14T18:51:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 shutdown_connections 2023-10-14T18:51:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd7d0066f30 0x7fd7d00693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7e4158e50 0x7fd7e41501f0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7e4152010 0x7fd7e414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 --2- 172.21.15.79:0/3369524653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd7e41523e0 0x7fd7e414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 >> 172.21.15.79:0/3369524653 conn(0x7fd7e4069870 msgr2=0x7fd7e40ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 shutdown_connections 2023-10-14T18:51:22.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.384+0000 7fd7e9d2b700 1 -- 172.21.15.79:0/3369524653 wait complete. 2023-10-14T18:51:22.397 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:51:22.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:51:22.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.511+0000 7f87be54c700 1 Processor -- start 2023-10-14T18:51:22.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.511+0000 7f87be54c700 1 -- start start 2023-10-14T18:51:22.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87be54c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87b8164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87be54c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b815c360 con 0x7f87b8157ba0 2023-10-14T18:51:22.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87be54c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b815b790 con 0x7f87b81577d0 2023-10-14T18:51:22.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87be54c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815d800 con 0x7f87b806ac30 2023-10-14T18:51:22.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87b77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f87b8157ba0 0x7f87b806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35252/0 (socket says 172.21.15.79:35252) 2023-10-14T18:51:22.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.512+0000 7f87b77fe700 1 -- 172.21.15.79:0/3034453205 learned_addr learned my addr 172.21.15.79:0/3034453205 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:22.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87b8164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294359096 0 0) 0x7f87b815c360 con 0x7f87b8157ba0 2023-10-14T18:51:22.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a0003570 con 0x7f87b8157ba0 2023-10-14T18:51:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249914197 0 0) 0x7f87a0003570 con 0x7f87b8157ba0 2023-10-14T18:51:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 msgr2=0x7f87b8164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87b8164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 >> v1:172.21.15.144:6789/0 conn(0x7f87b81577d0 legacy=0x7f87b80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b815ba30 con 0x7f87b8157ba0 2023-10-14T18:51:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f87a8001470 con 0x7f87b8157ba0 2023-10-14T18:51:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 >> v1:172.21.15.79:6789/0 conn(0x7f87b8157ba0 legacy=0x7f87b806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87a0003a90 0x7f87a0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87a0004d50 0x7f87a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815d800 con 0x7f87a0004d50 2023-10-14T18:51:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a000bb10 con 0x7f87a0003a90 2023-10-14T18:51:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a000bcd0 con 0x7f87b806ac30 2023-10-14T18:51:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87a0004d50 0x7f87a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b77fe700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87b7fff700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87a0003a90 0x7f87a0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 -- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 msgr2=0x7f87a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:22.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b806ac30 0x7f87a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 -- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87a0003a90 msgr2=0x7f87a0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:22.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87a0003a90 0x7f87a0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.513+0000 7f87bcae9700 1 -- 172.21.15.79:0/3034453205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0003570 con 0x7f87a0004d50 2023-10-14T18:51:22.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87bcae9700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87a0004d50 0x7f87a00051c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f87b806b030 tx=0x7f87b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46397289b238c6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000ea90 con 0x7f87a0004d50 2023-10-14T18:51:22.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b000f040 con 0x7f87a0004d50 2023-10-14T18:51:22.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87b6ffd700 1 -- 172.21.15.79:0/3034453205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b000ee40 con 0x7f87a0004d50 2023-10-14T18:51:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 -- 172.21.15.79:0/3034453205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87a0004d50 msgr2=0x7f87a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 --2- 172.21.15.79:0/3034453205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87a0004d50 0x7f87a00051c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f87b806b030 tx=0x7f87b000b040 comp rx=0 tx=0).stop 2023-10-14T18:51:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87bcae9700 1 -- 172.21.15.79:0/3034453205 reap_dead start 2023-10-14T18:51:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 -- 172.21.15.79:0/3034453205 shutdown_connections 2023-10-14T18:51:22.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 -- 172.21.15.79:0/3034453205 >> 172.21.15.79:0/3034453205 conn(0x7f87b8068ce0 msgr2=0x7f87b80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 -- 172.21.15.79:0/3034453205 shutdown_connections 2023-10-14T18:51:22.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.514+0000 7f87be54c700 1 -- 172.21.15.79:0/3034453205 wait complete. 2023-10-14T18:51:22.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.515+0000 7f87be54c700 1 Processor -- start 2023-10-14T18:51:22.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 -- start start 2023-10-14T18:51:22.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 0x7f87b815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 0x7f87b81692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815e380 con 0x7f87b80aeec0 2023-10-14T18:51:22.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b816c270 con 0x7f87b815df10 2023-10-14T18:51:22.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87be54c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80af290 con 0x7f87b816ab50 2023-10-14T18:51:22.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35470/0 (socket says 172.21.15.79:35470) 2023-10-14T18:51:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.516+0000 7f87b7fff700 1 -- 172.21.15.79:0/677952815 learned_addr learned my addr 172.21.15.79:0/677952815 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 -- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 msgr2=0x7f87b815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b77fe700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 0x7f87b815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87bcae9700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 0x7f87b81692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 0x7f87b815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 -- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 msgr2=0x7f87b81692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 0x7f87b81692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 -- 172.21.15.79:0/677952815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b816b660 con 0x7f87b80aeec0 2023-10-14T18:51:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b77fe700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 0x7f87b815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87bcae9700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 0x7f87b81692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87b7fff700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0029e0 tx=0x7f87ac007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac00f8d0 con 0x7f87b80aeec0 2023-10-14T18:51:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac00fa50 con 0x7f87b80aeec0 2023-10-14T18:51:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b816b940 con 0x7f87b80aeec0 2023-10-14T18:51:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac00fe10 con 0x7f87b80aeec0 2023-10-14T18:51:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.517+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b816bf00 con 0x7f87b80aeec0 2023-10-14T18:51:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.518+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b804c3c0 con 0x7f87b80aeec0 2023-10-14T18:51:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.518+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87ac013600 con 0x7f87b80aeec0 2023-10-14T18:51:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.519+0000 7f879ffff700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 0x7f87a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.519+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87ac084ac0 con 0x7f87b80aeec0 2023-10-14T18:51:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.519+0000 7f87b77fe700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 0x7f87a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.520+0000 7f87b77fe700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 0x7f87a40693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87a8004890 tx=0x7f87a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.523+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87ac051d30 con 0x7f87b80aeec0 2023-10-14T18:51:22.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.705+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87b815bd10 con 0x7f87a4066f30 2023-10-14T18:51:22.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.714+0000 7f879ffff700 1 -- 172.21.15.79:0/677952815 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285646 (secure 0 0 0) 0x7f87b815bd10 con 0x7f87a4066f30 2023-10-14T18:51:22.719 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:22.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.717+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 msgr2=0x7f87a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.717+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 0x7f87a40693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f87a8004890 tx=0x7f87a8009040 comp rx=0 tx=0).stop 2023-10-14T18:51:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.717+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 msgr2=0x7f87b8167d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.717+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0029e0 tx=0x7f87ac007d10 comp rx=0 tx=0).stop 2023-10-14T18:51:22.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 shutdown_connections 2023-10-14T18:51:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87a4066f30 0x7f87a40693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87b815df10 0x7f87b81692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87b80aeec0 0x7f87b8167d60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 --2- 172.21.15.79:0/677952815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87b816ab50 0x7f87b815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 >> 172.21.15.79:0/677952815 conn(0x7f87b8068ce0 msgr2=0x7f87b80b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 shutdown_connections 2023-10-14T18:51:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.718+0000 7f87be54c700 1 -- 172.21.15.79:0/677952815 wait complete. 2023-10-14T18:51:22.724 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:51:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-10-14T18:51:22.423542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555458,"statfs":{"total":1600000000,"available":1592789202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771671"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672090+0000","last_change":"2023-10-14T18:51:18.672090+0000","last_active":"2023-10-14T18:51:18.672090+0000","last_peered":"2023-10-14T18:51:18.672090+0000","last_clean":"2023-10-14T18:51:18.672090+0000","last_became_active":"2023-10-14T18:51:18.671244+0000","last_became_peered":"2023-10-14T18:51:18.671244+0000","last_unstale":"2023-10-14T18:51:18.672090+0000","last_undegraded":"2023-10-14T18:51:18.672090+0000","last_fullsized":"2023-10-14T18:51:18.672090+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:14.547700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671655+0000","last_change":"2023-10-14T18:51:18.671655+0000","last_active":"2023-10-14T18:51:18.671655+0000","last_peered":"2023-10-14T18:51:18.671655+0000","last_clean":"2023-10-14T18:51:18.671655+0000","last_became_active":"2023-10-14T18:51:18.670505+0000","last_became_peered":"2023-10-14T18:51:18.670505+0000","last_unstale":"2023-10-14T18:51:18.671655+0000","last_undegraded":"2023-10-14T18:51:18.671655+0000","last_fullsized":"2023-10-14T18:51:18.671655+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:57.095334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666852+0000","last_change":"2023-10-14T18:51:18.666852+0000","last_active":"2023-10-14T18:51:18.666852+0000","last_peered":"2023-10-14T18:51:18.666852+0000","last_clean":"2023-10-14T18:51:18.666852+0000","last_became_active":"2023-10-14T18:51:18.666628+0000","last_became_peered":"2023-10-14T18:51:18.666628+0000","last_unstale":"2023-10-14T18:51:18.666852+0000","last_undegraded":"2023-10-14T18:51:18.666852+0000","last_fullsized":"2023-10-14T18:51:18.666852+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.665851+0000","last_change":"2023-10-14T18:51:18.665851+0000","last_active":"2023-10-14T18:51:18.665851+0000","last_peered":"2023-10-14T18:51:18.665851+0000","last_clean":"2023-10-14T18:51:18.665851+0000","last_became_active":"2023-10-14T18:51:18.665606+0000","last_became_peered":"2023-10-14T18:51:18.665606+0000","last_unstale":"2023-10-14T18:51:18.665851+0000","last_undegraded":"2023-10-14T18:51:18.665851+0000","last_fullsized":"2023-10-14T18:51:18.665851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:21.104100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672080+0000","last_change":"2023-10-14T18:51:18.672080+0000","last_active":"2023-10-14T18:51:18.672080+0000","last_peered":"2023-10-14T18:51:18.672080+0000","last_clean":"2023-10-14T18:51:18.672080+0000","last_became_active":"2023-10-14T18:51:18.671882+0000","last_became_peered":"2023-10-14T18:51:18.671882+0000","last_unstale":"2023-10-14T18:51:18.672080+0000","last_undegraded":"2023-10-14T18:51:18.672080+0000","last_fullsized":"2023-10-14T18:51:18.672080+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:55.280015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670113+0000","last_change":"2023-10-14T18:51:18.670113+0000","last_active":"2023-10-14T18:51:18.670113+0000","last_peered":"2023-10-14T18:51:18.670113+0000","last_clean":"2023-10-14T18:51:18.670113+0000","last_became_active":"2023-10-14T18:51:18.669744+0000","last_became_peered":"2023-10-14T18:51:18.669744+0000","last_unstale":"2023-10-14T18:51:18.670113+0000","last_undegraded":"2023-10-14T18:51:18.670113+0000","last_fullsized":"2023-10-14T18:51:18.670113+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:40:57.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674557+0000","last_change":"2023-10-14T18:51:18.674557+0000","last_active":"2023-10-14T18:51:18.674557+0000","last_peered":"2023-10-14T18:51:18.674557+0000","last_clean":"2023-10-14T18:51:18.674557+0000","last_became_active":"2023-10-14T18:51:18.674315+0000","last_became_peered":"2023-10-14T18:51:18.674315+0000","last_unstale":"2023-10-14T18:51:18.674557+0000","last_undegraded":"2023-10-14T18:51:18.674557+0000","last_fullsized":"2023-10-14T18:51:18.674557+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:51.645281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667375+0000","last_change":"2023-10-14T18:51:18.667375+0000","last_active":"2023-10-14T18:51:18.667375+0000","last_peered":"2023-10-14T18:51:18.667375+0000","last_clean":"2023-10-14T18:51:18.667375+0000","last_became_active":"2023-10-14T18:51:18.667076+0000","last_became_peered":"2023-10-14T18:51:18.667076+0000","last_unstale":"2023-10-14T18:51:18.667375+0000","last_undegraded":"2023-10-14T18:51:18.667375+0000","last_fullsized":"2023-10-14T18:51:18.667375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:05.653611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668911+0000","last_change":"2023-10-14T18:51:18.668911+0000","last_active":"2023-10-14T18:51:18.668911+0000","last_peered":"2023-10-14T18:51:18.668911+0000","last_clean":"2023-10-14T18:51:18.668911+0000","last_became_active":"2023-10-14T18:51:18.668588+0000","last_became_peered":"2023-10-14T18:51:18.668588+0000","last_unstale":"2023-10-14T18:51:18.668911+0000","last_undegraded":"2023-10-14T18:51:18.668911+0000","last_fullsized":"2023-10-14T18:51:18.668911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:24.546062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669918+0000","last_change":"2023-10-14T18:51:18.669918+0000","last_active":"2023-10-14T18:51:18.669918+0000","last_peered":"2023-10-14T18:51:18.669918+0000","last_clean":"2023-10-14T18:51:18.669918+0000","last_became_active":"2023-10-14T18:51:18.669129+0000","last_became_peered":"2023-10-14T18:51:18.669129+0000","last_unstale":"2023-10-14T18:51:18.669918+0000","last_undegraded":"2023-10-14T18:51:18.669918+0000","last_fullsized":"2023-10-14T18:51:18.669918+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:59.829392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673531+0000","last_change":"2023-10-14T18:51:18.673531+0000","last_active":"2023-10-14T18:51:18.673531+0000","last_peered":"2023-10-14T18:51:18.673531+0000","last_clean":"2023-10-14T18:51:18.673531+0000","last_became_active":"2023-10-14T18:51:18.673259+0000","last_became_peered":"2023-10-14T18:51:18.673259+0000","last_unstale":"2023-10-14T18:51:18.673531+0000","last_undegraded":"2023-10-14T18:51:18.673531+0000","last_fullsized":"2023-10-14T18:51:18.673531+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668241+0000","last_change":"2023-10-14T18:51:18.668241+0000","last_active":"2023-10-14T18:51:18.668241+0000","last_peered":"2023-10-14T18:51:18.668241+0000","last_clean":"2023-10-14T18:51:18.668241+0000","last_became_active":"2023-10-14T18:51:18.667560+0000","last_became_peered":"2023-10-14T18:51:18.667560+0000","last_unstale":"2023-10-14T18:51:18.668241+0000","last_undegraded":"2023-10-14T18:51:18.668241+0000","last_fullsized":"2023-10-14T18:51:18.668241+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:02.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670236+0000","last_change":"2023-10-14T18:51:18.670236+0000","last_active":"2023-10-14T18:51:18.670236+0000","last_peered":"2023-10-14T18:51:18.670236+0000","last_clean":"2023-10-14T18:51:18.670236+0000","last_became_active":"2023-10-14T18:51:18.669551+0000","last_became_peered":"2023-10-14T18:51:18.669551+0000","last_unstale":"2023-10-14T18:51:18.670236+0000","last_undegraded":"2023-10-14T18:51:18.670236+0000","last_fullsized":"2023-10-14T18:51:18.670236+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:02.409030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674552+0000","last_change":"2023-10-14T18:51:18.674552+0000","last_active":"2023-10-14T18:51:18.674552+0000","last_peered":"2023-10-14T18:51:18.674552+0000","last_clean":"2023-10-14T18:51:18.674552+0000","last_became_active":"2023-10-14T18:51:18.674187+0000","last_became_peered":"2023-10-14T18:51:18.674187+0000","last_unstale":"2023-10-14T18:51:18.674552+0000","last_undegraded":"2023-10-14T18:51:18.674552+0000","last_fullsized":"2023-10-14T18:51:18.674552+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:44.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670921+0000","last_change":"2023-10-14T18:51:18.670921+0000","last_active":"2023-10-14T18:51:18.670921+0000","last_peered":"2023-10-14T18:51:18.670921+0000","last_clean":"2023-10-14T18:51:18.670921+0000","last_became_active":"2023-10-14T18:51:18.670540+0000","last_became_peered":"2023-10-14T18:51:18.670540+0000","last_unstale":"2023-10-14T18:51:18.670921+0000","last_undegraded":"2023-10-14T18:51:18.670921+0000","last_fullsized":"2023-10-14T18:51:18.670921+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:18.390222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668064+0000","last_change":"2023-10-14T18:51:18.668064+0000","last_active":"2023-10-14T18:51:18.668064+0000","last_peered":"2023-10-14T18:51:18.668064+0000","last_clean":"2023-10-14T18:51:18.668064+0000","last_became_active":"2023-10-14T18:51:18.667830+0000","last_became_peered":"2023-10-14T18:51:18.667830+0000","last_unstale":"2023-10-14T18:51:18.668064+0000","last_undegraded":"2023-10-14T18:51:18.668064+0000","last_fullsized":"2023-10-14T18:51:18.668064+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:52:27.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673589+0000","last_change":"2023-10-14T18:51:18.673589+0000","last_active":"2023-10-14T18:51:18.673589+0000","last_peered":"2023-10-14T18:51:18.673589+0000","last_clean":"2023-10-14T18:51:18.673589+0000","last_became_active":"2023-10-14T18:51:18.673352+0000","last_became_peered":"2023-10-14T18:51:18.673352+0000","last_unstale":"2023-10-14T18:51:18.673589+0000","last_undegraded":"2023-10-14T18:51:18.673589+0000","last_fullsized":"2023-10-14T18:51:18.673589+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672038+0000","last_change":"2023-10-14T18:51:18.672038+0000","last_active":"2023-10-14T18:51:18.672038+0000","last_peered":"2023-10-14T18:51:18.672038+0000","last_clean":"2023-10-14T18:51:18.672038+0000","last_became_active":"2023-10-14T18:51:18.671681+0000","last_became_peered":"2023-10-14T18:51:18.671681+0000","last_unstale":"2023-10-14T18:51:18.672038+0000","last_undegraded":"2023-10-14T18:51:18.672038+0000","last_fullsized":"2023-10-14T18:51:18.672038+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:05.980414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668988+0000","last_change":"2023-10-14T18:51:18.668988+0000","last_active":"2023-10-14T18:51:18.668988+0000","last_peered":"2023-10-14T18:51:18.668988+0000","last_clean":"2023-10-14T18:51:18.668988+0000","last_became_active":"2023-10-14T18:51:18.668770+0000","last_became_peered":"2023-10-14T18:51:18.668770+0000","last_unstale":"2023-10-14T18:51:18.668988+0000","last_undegraded":"2023-10-14T18:51:18.668988+0000","last_fullsized":"2023-10-14T18:51:18.668988+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:15:11.206765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671200+0000","last_change":"2023-10-14T18:51:18.671200+0000","last_active":"2023-10-14T18:51:18.671200+0000","last_peered":"2023-10-14T18:51:18.671200+0000","last_clean":"2023-10-14T18:51:18.671200+0000","last_became_active":"2023-10-14T18:51:18.670963+0000","last_became_peered":"2023-10-14T18:51:18.670963+0000","last_unstale":"2023-10-14T18:51:18.671200+0000","last_undegraded":"2023-10-14T18:51:18.671200+0000","last_fullsized":"2023-10-14T18:51:18.671200+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:16.621287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670229+0000","last_change":"2023-10-14T18:51:18.670229+0000","last_active":"2023-10-14T18:51:18.670229+0000","last_peered":"2023-10-14T18:51:18.670229+0000","last_clean":"2023-10-14T18:51:18.670229+0000","last_became_active":"2023-10-14T18:51:18.669997+0000","last_became_peered":"2023-10-14T18:51:18.669997+0000","last_unstale":"2023-10-14T18:51:18.670229+0000","last_undegraded":"2023-10-14T18:51:18.670229+0000","last_fullsized":"2023-10-14T18:51:18.670229+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:21.330689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672703+0000","last_change":"2023-10-14T18:51:18.672703+0000","last_active":"2023-10-14T18:51:18.672703+0000","last_peered":"2023-10-14T18:51:18.672703+0000","last_clean":"2023-10-14T18:51:18.672703+0000","last_became_active":"2023-10-14T18:51:18.672546+0000","last_became_peered":"2023-10-14T18:51:18.672546+0000","last_unstale":"2023-10-14T18:51:18.672703+0000","last_undegraded":"2023-10-14T18:51:18.672703+0000","last_fullsized":"2023-10-14T18:51:18.672703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670843+0000","last_change":"2023-10-14T18:51:18.670843+0000","last_active":"2023-10-14T18:51:18.670843+0000","last_peered":"2023-10-14T18:51:18.670843+0000","last_clean":"2023-10-14T18:51:18.670843+0000","last_became_active":"2023-10-14T18:51:18.670584+0000","last_became_peered":"2023-10-14T18:51:18.670584+0000","last_unstale":"2023-10-14T18:51:18.670843+0000","last_undegraded":"2023-10-14T18:51:18.670843+0000","last_fullsized":"2023-10-14T18:51:18.670843+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:45.820701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.675525+0000","last_change":"2023-10-14T18:51:18.675525+0000","last_active":"2023-10-14T18:51:18.675525+0000","last_peered":"2023-10-14T18:51:18.675525+0000","last_clean":"2023-10-14T18:51:18.675525+0000","last_became_active":"2023-10-14T18:51:18.675320+0000","last_became_peered":"2023-10-14T18:51:18.675320+0000","last_unstale":"2023-10-14T18:51:18.675525+0000","last_undegraded":"2023-10-14T18:51:18.675525+0000","last_fullsized":"2023-10-14T18:51:18.675525+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669097+0000","last_change":"2023-10-14T18:51:18.669097+0000","last_active":"2023-10-14T18:51:18.669097+0000","last_peered":"2023-10-14T18:51:18.669097+0000","last_clean":"2023-10-14T18:51:18.669097+0000","last_became_active":"2023-10-14T18:51:18.668847+0000","last_became_peered":"2023-10-14T18:51:18.668847+0000","last_unstale":"2023-10-14T18:51:18.669097+0000","last_undegraded":"2023-10-14T18:51:18.669097+0000","last_fullsized":"2023-10-14T18:51:18.669097+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672397+0000","last_change":"2023-10-14T18:51:18.672397+0000","last_active":"2023-10-14T18:51:18.672397+0000","last_peered":"2023-10-14T18:51:18.672397+0000","last_clean":"2023-10-14T18:51:18.672397+0000","last_became_active":"2023-10-14T18:51:18.671841+0000","last_became_peered":"2023-10-14T18:51:18.671841+0000","last_unstale":"2023-10-14T18:51:18.672397+0000","last_undegraded":"2023-10-14T18:51:18.672397+0000","last_fullsized":"2023-10-14T18:51:18.672397+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:48.380725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666690+0000","last_change":"2023-10-14T18:51:18.666690+0000","last_active":"2023-10-14T18:51:18.666690+0000","last_peered":"2023-10-14T18:51:18.666690+0000","last_clean":"2023-10-14T18:51:18.666690+0000","last_became_active":"2023-10-14T18:51:18.665726+0000","last_became_peered":"2023-10-14T18:51:18.665726+0000","last_unstale":"2023-10-14T18:51:18.666690+0000","last_undegraded":"2023-10-14T18:51:18.666690+0000","last_fullsized":"2023-10-14T18:51:18.666690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:46.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673085+0000","last_change":"2023-10-14T18:51:18.673085+0000","last_active":"2023-10-14T18:51:18.673085+0000","last_peered":"2023-10-14T18:51:18.673085+0000","last_clean":"2023-10-14T18:51:18.673085+0000","last_became_active":"2023-10-14T18:51:18.672507+0000","last_became_peered":"2023-10-14T18:51:18.672507+0000","last_unstale":"2023-10-14T18:51:18.673085+0000","last_undegraded":"2023-10-14T18:51:18.673085+0000","last_fullsized":"2023-10-14T18:51:18.673085+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:43.320484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668693+0000","last_change":"2023-10-14T18:51:18.668693+0000","last_active":"2023-10-14T18:51:18.668693+0000","last_peered":"2023-10-14T18:51:18.668693+0000","last_clean":"2023-10-14T18:51:18.668693+0000","last_became_active":"2023-10-14T18:51:18.666763+0000","last_became_peered":"2023-10-14T18:51:18.666763+0000","last_unstale":"2023-10-14T18:51:18.668693+0000","last_undegraded":"2023-10-14T18:51:18.668693+0000","last_fullsized":"2023-10-14T18:51:18.668693+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674001+0000","last_change":"2023-10-14T18:51:18.674001+0000","last_active":"2023-10-14T18:51:18.674001+0000","last_peered":"2023-10-14T18:51:18.674001+0000","last_clean":"2023-10-14T18:51:18.674001+0000","last_became_active":"2023-10-14T18:51:18.673771+0000","last_became_peered":"2023-10-14T18:51:18.673771+0000","last_unstale":"2023-10-14T18:51:18.674001+0000","last_undegraded":"2023-10-14T18:51:18.674001+0000","last_fullsized":"2023-10-14T18:51:18.674001+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:46.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672237+0000","last_change":"2023-10-14T18:51:18.672237+0000","last_active":"2023-10-14T18:51:18.672237+0000","last_peered":"2023-10-14T18:51:18.672237+0000","last_clean":"2023-10-14T18:51:18.672237+0000","last_became_active":"2023-10-14T18:51:18.671537+0000","last_became_peered":"2023-10-14T18:51:18.671537+0000","last_unstale":"2023-10-14T18:51:18.672237+0000","last_undegraded":"2023-10-14T18:51:18.672237+0000","last_fullsized":"2023-10-14T18:51:18.672237+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:14.659491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670561+0000","last_change":"2023-10-14T18:51:18.670561+0000","last_active":"2023-10-14T18:51:18.670561+0000","last_peered":"2023-10-14T18:51:18.670561+0000","last_clean":"2023-10-14T18:51:18.670561+0000","last_became_active":"2023-10-14T18:51:18.670342+0000","last_became_peered":"2023-10-14T18:51:18.670342+0000","last_unstale":"2023-10-14T18:51:18.670561+0000","last_undegraded":"2023-10-14T18:51:18.670561+0000","last_fullsized":"2023-10-14T18:51:18.670561+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:58.682986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.664688+0000","last_change":"2023-10-14T18:51:18.664688+0000","last_active":"2023-10-14T18:51:18.664688+0000","last_peered":"2023-10-14T18:51:18.664688+0000","last_clean":"2023-10-14T18:51:18.664688+0000","last_became_active":"2023-10-14T18:51:18.664464+0000","last_became_peered":"2023-10-14T18:51:18.664464+0000","last_unstale":"2023-10-14T18:51:18.664688+0000","last_undegraded":"2023-10-14T18:51:18.664688+0000","last_fullsized":"2023-10-14T18:51:18.664688+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:10.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.680405+0000","last_change":"2023-10-14T18:51:17.671674+0000","last_active":"2023-10-14T18:51:18.680405+0000","last_peered":"2023-10-14T18:51:18.680405+0000","last_clean":"2023-10-14T18:51:18.680405+0000","last_became_active":"2023-10-14T18:51:17.671427+0000","last_became_peered":"2023-10-14T18:51:17.671427+0000","last_unstale":"2023-10-14T18:51:18.680405+0000","last_undegraded":"2023-10-14T18:51:18.680405+0000","last_fullsized":"2023-10-14T18:51:18.680405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:08.526275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.676520+0000","last_change":"2023-10-14T18:51:18.676520+0000","last_active":"2023-10-14T18:51:18.676520+0000","last_peered":"2023-10-14T18:51:18.676520+0000","last_clean":"2023-10-14T18:51:18.676520+0000","last_became_active":"2023-10-14T18:51:18.676277+0000","last_became_peered":"2023-10-14T18:51:18.676277+0000","last_unstale":"2023-10-14T18:51:18.676520+0000","last_undegraded":"2023-10-14T18:51:18.676520+0000","last_fullsized":"2023-10-14T18:51:18.676520+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.116376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.663691+0000","last_change":"2023-10-14T18:51:17.670002+0000","last_active":"2023-10-14T18:51:18.663691+0000","last_peered":"2023-10-14T18:51:18.663691+0000","last_clean":"2023-10-14T18:51:18.663691+0000","last_became_active":"2023-10-14T18:51:17.669746+0000","last_became_peered":"2023-10-14T18:51:17.669746+0000","last_unstale":"2023-10-14T18:51:18.663691+0000","last_undegraded":"2023-10-14T18:51:18.663691+0000","last_fullsized":"2023-10-14T18:51:18.663691+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:24.598152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669974+0000","last_change":"2023-10-14T18:51:18.669974+0000","last_active":"2023-10-14T18:51:18.669974+0000","last_peered":"2023-10-14T18:51:18.669974+0000","last_clean":"2023-10-14T18:51:18.669974+0000","last_became_active":"2023-10-14T18:51:18.669447+0000","last_became_peered":"2023-10-14T18:51:18.669447+0000","last_unstale":"2023-10-14T18:51:18.669974+0000","last_undegraded":"2023-10-14T18:51:18.669974+0000","last_fullsized":"2023-10-14T18:51:18.669974+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:34:34.042001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.683206+0000","last_change":"2023-10-14T18:51:17.669299+0000","last_active":"2023-10-14T18:51:18.683206+0000","last_peered":"2023-10-14T18:51:18.683206+0000","last_clean":"2023-10-14T18:51:18.683206+0000","last_became_active":"2023-10-14T18:51:17.669111+0000","last_became_peered":"2023-10-14T18:51:17.669111+0000","last_unstale":"2023-10-14T18:51:18.683206+0000","last_undegraded":"2023-10-14T18:51:18.683206+0000","last_fullsized":"2023-10-14T18:51:18.683206+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:48.579165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674362+0000","last_change":"2023-10-14T18:51:18.674362+0000","last_active":"2023-10-14T18:51:18.674362+0000","last_peered":"2023-10-14T18:51:18.674362+0000","last_clean":"2023-10-14T18:51:18.674362+0000","last_became_active":"2023-10-14T18:51:18.673853+0000","last_became_peered":"2023-10-14T18:51:18.673853+0000","last_unstale":"2023-10-14T18:51:18.674362+0000","last_undegraded":"2023-10-14T18:51:18.674362+0000","last_fullsized":"2023-10-14T18:51:18.674362+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:30.836755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682809+0000","last_change":"2023-10-14T18:51:17.669241+0000","last_active":"2023-10-14T18:51:18.682809+0000","last_peered":"2023-10-14T18:51:18.682809+0000","last_clean":"2023-10-14T18:51:18.682809+0000","last_became_active":"2023-10-14T18:51:17.669040+0000","last_became_peered":"2023-10-14T18:51:17.669040+0000","last_unstale":"2023-10-14T18:51:18.682809+0000","last_undegraded":"2023-10-14T18:51:18.682809+0000","last_fullsized":"2023-10-14T18:51:18.682809+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:23.683405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669792+0000","last_change":"2023-10-14T18:51:18.669792+0000","last_active":"2023-10-14T18:51:18.669792+0000","last_peered":"2023-10-14T18:51:18.669792+0000","last_clean":"2023-10-14T18:51:18.669792+0000","last_became_active":"2023-10-14T18:51:18.668854+0000","last_became_peered":"2023-10-14T18:51:18.668854+0000","last_unstale":"2023-10-14T18:51:18.669792+0000","last_undegraded":"2023-10-14T18:51:18.669792+0000","last_fullsized":"2023-10-14T18:51:18.669792+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:32.522941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668712+0000","last_change":"2023-10-14T18:51:17.669191+0000","last_active":"2023-10-14T18:51:18.668712+0000","last_peered":"2023-10-14T18:51:18.668712+0000","last_clean":"2023-10-14T18:51:18.668712+0000","last_became_active":"2023-10-14T18:51:17.668996+0000","last_became_peered":"2023-10-14T18:51:17.668996+0000","last_unstale":"2023-10-14T18:51:18.668712+0000","last_undegraded":"2023-10-14T18:51:18.668712+0000","last_fullsized":"2023-10-14T18:51:18.668712+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:20.573706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671800+0000","last_change":"2023-10-14T18:51:18.671800+0000","last_active":"2023-10-14T18:51:18.671800+0000","last_peered":"2023-10-14T18:51:18.671800+0000","last_clean":"2023-10-14T18:51:18.671800+0000","last_became_active":"2023-10-14T18:51:18.670788+0000","last_became_peered":"2023-10-14T18:51:18.670788+0000","last_unstale":"2023-10-14T18:51:18.671800+0000","last_undegraded":"2023-10-14T18:51:18.671800+0000","last_fullsized":"2023-10-14T18:51:18.671800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:30.836755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666903+0000","last_change":"2023-10-14T18:51:17.667717+0000","last_active":"2023-10-14T18:51:18.666903+0000","last_peered":"2023-10-14T18:51:18.666903+0000","last_clean":"2023-10-14T18:51:18.666903+0000","last_became_active":"2023-10-14T18:51:17.667422+0000","last_became_peered":"2023-10-14T18:51:17.667422+0000","last_unstale":"2023-10-14T18:51:18.666903+0000","last_undegraded":"2023-10-14T18:51:18.666903+0000","last_fullsized":"2023-10-14T18:51:18.666903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670084+0000","last_change":"2023-10-14T18:51:18.670084+0000","last_active":"2023-10-14T18:51:18.670084+0000","last_peered":"2023-10-14T18:51:18.670084+0000","last_clean":"2023-10-14T18:51:18.670084+0000","last_became_active":"2023-10-14T18:51:18.669427+0000","last_became_peered":"2023-10-14T18:51:18.669427+0000","last_unstale":"2023-10-14T18:51:18.670084+0000","last_undegraded":"2023-10-14T18:51:18.670084+0000","last_fullsized":"2023-10-14T18:51:18.670084+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:34.021855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.668144+0000","last_change":"2023-10-14T18:51:17.668061+0000","last_active":"2023-10-14T18:51:17.668144+0000","last_peered":"2023-10-14T18:51:17.668144+0000","last_clean":"2023-10-14T18:51:17.668144+0000","last_became_active":"2023-10-14T18:51:17.667844+0000","last_became_peered":"2023-10-14T18:51:17.667844+0000","last_unstale":"2023-10-14T18:51:17.668144+0000","last_undegraded":"2023-10-14T18:51:17.668144+0000","last_fullsized":"2023-10-14T18:51:17.668144+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:09.913664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673290+0000","last_change":"2023-10-14T18:51:18.673290+0000","last_active":"2023-10-14T18:51:18.673290+0000","last_peered":"2023-10-14T18:51:18.673290+0000","last_clean":"2023-10-14T18:51:18.673290+0000","last_became_active":"2023-10-14T18:51:18.673042+0000","last_became_peered":"2023-10-14T18:51:18.673042+0000","last_unstale":"2023-10-14T18:51:18.673290+0000","last_undegraded":"2023-10-14T18:51:18.673290+0000","last_fullsized":"2023-10-14T18:51:18.673290+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:18.390222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.664601+0000","last_change":"2023-10-14T18:51:17.664490+0000","last_active":"2023-10-14T18:51:17.664601+0000","last_peered":"2023-10-14T18:51:17.664601+0000","last_clean":"2023-10-14T18:51:17.664601+0000","last_became_active":"2023-10-14T18:51:17.664268+0000","last_became_peered":"2023-10-14T18:51:17.664268+0000","last_unstale":"2023-10-14T18:51:17.664601+0000","last_undegraded":"2023-10-14T18:51:17.664601+0000","last_fullsized":"2023-10-14T18:51:17.664601+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:32.410614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672497+0000","last_change":"2023-10-14T18:51:18.672497+0000","last_active":"2023-10-14T18:51:18.672497+0000","last_peered":"2023-10-14T18:51:18.672497+0000","last_clean":"2023-10-14T18:51:18.672497+0000","last_became_active":"2023-10-14T18:51:18.672068+0000","last_became_peered":"2023-10-14T18:51:18.672068+0000","last_unstale":"2023-10-14T18:51:18.672497+0000","last_undegraded":"2023-10-14T18:51:18.672497+0000","last_fullsized":"2023-10-14T18:51:18.672497+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:10.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.670815+0000","last_change":"2023-10-14T18:51:17.670750+0000","last_active":"2023-10-14T18:51:17.670815+0000","last_peered":"2023-10-14T18:51:17.670815+0000","last_clean":"2023-10-14T18:51:17.670815+0000","last_became_active":"2023-10-14T18:51:17.670541+0000","last_became_peered":"2023-10-14T18:51:17.670541+0000","last_unstale":"2023-10-14T18:51:17.670815+0000","last_undegraded":"2023-10-14T18:51:17.670815+0000","last_fullsized":"2023-10-14T18:51:17.670815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:03.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674527+0000","last_change":"2023-10-14T18:51:18.674527+0000","last_active":"2023-10-14T18:51:18.674527+0000","last_peered":"2023-10-14T18:51:18.674527+0000","last_clean":"2023-10-14T18:51:18.674527+0000","last_became_active":"2023-10-14T18:51:18.674111+0000","last_became_peered":"2023-10-14T18:51:18.674111+0000","last_unstale":"2023-10-14T18:51:18.674527+0000","last_undegraded":"2023-10-14T18:51:18.674527+0000","last_fullsized":"2023-10-14T18:51:18.674527+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.668025+0000","last_change":"2023-10-14T18:51:17.667698+0000","last_active":"2023-10-14T18:51:17.668025+0000","last_peered":"2023-10-14T18:51:17.668025+0000","last_clean":"2023-10-14T18:51:17.668025+0000","last_became_active":"2023-10-14T18:51:17.667239+0000","last_became_peered":"2023-10-14T18:51:17.667239+0000","last_unstale":"2023-10-14T18:51:17.668025+0000","last_undegraded":"2023-10-14T18:51:17.668025+0000","last_fullsized":"2023-10-14T18:51:17.668025+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:09.913664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674523+0000","last_change":"2023-10-14T18:51:18.674523+0000","last_active":"2023-10-14T18:51:18.674523+0000","last_peered":"2023-10-14T18:51:18.674523+0000","last_clean":"2023-10-14T18:51:18.674523+0000","last_became_active":"2023-10-14T18:51:18.674368+0000","last_became_peered":"2023-10-14T18:51:18.674368+0000","last_unstale":"2023-10-14T18:51:18.674523+0000","last_undegraded":"2023-10-14T18:51:18.674523+0000","last_fullsized":"2023-10-14T18:51:18.674523+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:21.330689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.680553+0000","last_change":"2023-10-14T18:51:17.668769+0000","last_active":"2023-10-14T18:51:18.680553+0000","last_peered":"2023-10-14T18:51:18.680553+0000","last_clean":"2023-10-14T18:51:18.680553+0000","last_became_active":"2023-10-14T18:51:17.665459+0000","last_became_peered":"2023-10-14T18:51:17.665459+0000","last_unstale":"2023-10-14T18:51:18.680553+0000","last_undegraded":"2023-10-14T18:51:18.680553+0000","last_fullsized":"2023-10-14T18:51:18.680553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:04:50.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.675223+0000","last_change":"2023-10-14T18:51:18.675223+0000","last_active":"2023-10-14T18:51:18.675223+0000","last_peered":"2023-10-14T18:51:18.675223+0000","last_clean":"2023-10-14T18:51:18.675223+0000","last_became_active":"2023-10-14T18:51:18.674979+0000","last_became_peered":"2023-10-14T18:51:18.674979+0000","last_unstale":"2023-10-14T18:51:18.675223+0000","last_undegraded":"2023-10-14T18:51:18.675223+0000","last_fullsized":"2023-10-14T18:51:18.675223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:40:57.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.681142+0000","last_change":"2023-10-14T18:51:17.663712+0000","last_active":"2023-10-14T18:51:18.681142+0000","last_peered":"2023-10-14T18:51:18.681142+0000","last_clean":"2023-10-14T18:51:18.681142+0000","last_became_active":"2023-10-14T18:51:17.663495+0000","last_became_peered":"2023-10-14T18:51:17.663495+0000","last_unstale":"2023-10-14T18:51:18.681142+0000","last_undegraded":"2023-10-14T18:51:18.681142+0000","last_fullsized":"2023-10-14T18:51:18.681142+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:15:10.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673146+0000","last_change":"2023-10-14T18:51:18.673146+0000","last_active":"2023-10-14T18:51:18.673146+0000","last_peered":"2023-10-14T18:51:18.673146+0000","last_clean":"2023-10-14T18:51:18.673146+0000","last_became_active":"2023-10-14T18:51:18.672997+0000","last_became_peered":"2023-10-14T18:51:18.672997+0000","last_unstale":"2023-10-14T18:51:18.673146+0000","last_undegraded":"2023-10-14T18:51:18.673146+0000","last_fullsized":"2023-10-14T18:51:18.673146+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.116376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.684079+0000","last_change":"2023-10-14T18:51:17.670090+0000","last_active":"2023-10-14T18:51:18.684079+0000","last_peered":"2023-10-14T18:51:18.684079+0000","last_clean":"2023-10-14T18:51:18.684079+0000","last_became_active":"2023-10-14T18:51:17.669544+0000","last_became_peered":"2023-10-14T18:51:17.669544+0000","last_unstale":"2023-10-14T18:51:18.684079+0000","last_undegraded":"2023-10-14T18:51:18.684079+0000","last_fullsized":"2023-10-14T18:51:18.684079+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:08.526275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671981+0000","last_change":"2023-10-14T18:51:18.671981+0000","last_active":"2023-10-14T18:51:18.671981+0000","last_peered":"2023-10-14T18:51:18.671981+0000","last_clean":"2023-10-14T18:51:18.671981+0000","last_became_active":"2023-10-14T18:51:18.671768+0000","last_became_peered":"2023-10-14T18:51:18.671768+0000","last_unstale":"2023-10-14T18:51:18.671981+0000","last_undegraded":"2023-10-14T18:51:18.671981+0000","last_fullsized":"2023-10-14T18:51:18.671981+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.671870+0000","last_change":"2023-10-14T18:51:17.671711+0000","last_active":"2023-10-14T18:51:17.671870+0000","last_peered":"2023-10-14T18:51:17.671870+0000","last_clean":"2023-10-14T18:51:17.671870+0000","last_became_active":"2023-10-14T18:51:17.671281+0000","last_became_peered":"2023-10-14T18:51:17.671281+0000","last_unstale":"2023-10-14T18:51:17.671870+0000","last_undegraded":"2023-10-14T18:51:17.671870+0000","last_fullsized":"2023-10-14T18:51:17.671870+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:44.815027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669922+0000","last_change":"2023-10-14T18:51:18.669922+0000","last_active":"2023-10-14T18:51:18.669922+0000","last_peered":"2023-10-14T18:51:18.669922+0000","last_clean":"2023-10-14T18:51:18.669922+0000","last_became_active":"2023-10-14T18:51:18.669666+0000","last_became_peered":"2023-10-14T18:51:18.669666+0000","last_unstale":"2023-10-14T18:51:18.669922+0000","last_undegraded":"2023-10-14T18:51:18.669922+0000","last_fullsized":"2023-10-14T18:51:18.669922+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.684329+0000","last_change":"2023-10-14T18:51:17.672391+0000","last_active":"2023-10-14T18:51:18.684329+0000","last_peered":"2023-10-14T18:51:18.684329+0000","last_clean":"2023-10-14T18:51:18.684329+0000","last_became_active":"2023-10-14T18:51:17.672028+0000","last_became_peered":"2023-10-14T18:51:17.672028+0000","last_unstale":"2023-10-14T18:51:18.684329+0000","last_undegraded":"2023-10-14T18:51:18.684329+0000","last_fullsized":"2023-10-14T18:51:18.684329+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:46.984780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671465+0000","last_change":"2023-10-14T18:51:18.671465+0000","last_active":"2023-10-14T18:51:18.671465+0000","last_peered":"2023-10-14T18:51:18.671465+0000","last_clean":"2023-10-14T18:51:18.671465+0000","last_became_active":"2023-10-14T18:51:18.670695+0000","last_became_peered":"2023-10-14T18:51:18.670695+0000","last_unstale":"2023-10-14T18:51:18.671465+0000","last_undegraded":"2023-10-14T18:51:18.671465+0000","last_fullsized":"2023-10-14T18:51:18.671465+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:23:40.507352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.662904+0000","last_change":"2023-10-14T18:51:17.670060+0000","last_active":"2023-10-14T18:51:18.662904+0000","last_peered":"2023-10-14T18:51:18.662904+0000","last_clean":"2023-10-14T18:51:18.662904+0000","last_became_active":"2023-10-14T18:51:17.669828+0000","last_became_peered":"2023-10-14T18:51:17.669828+0000","last_unstale":"2023-10-14T18:51:18.662904+0000","last_undegraded":"2023-10-14T18:51:18.662904+0000","last_fullsized":"2023-10-14T18:51:18.662904+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.933128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667063+0000","last_change":"2023-10-14T18:51:18.667063+0000","last_active":"2023-10-14T18:51:18.667063+0000","last_peered":"2023-10-14T18:51:18.667063+0000","last_clean":"2023-10-14T18:51:18.667063+0000","last_became_active":"2023-10-14T18:51:18.666820+0000","last_became_peered":"2023-10-14T18:51:18.666820+0000","last_unstale":"2023-10-14T18:51:18.667063+0000","last_undegraded":"2023-10-14T18:51:18.667063+0000","last_fullsized":"2023-10-14T18:51:18.667063+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:51.645281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682590+0000","last_change":"2023-10-14T18:51:17.668918+0000","last_active":"2023-10-14T18:51:18.682590+0000","last_peered":"2023-10-14T18:51:18.682590+0000","last_clean":"2023-10-14T18:51:18.682590+0000","last_became_active":"2023-10-14T18:51:17.668630+0000","last_became_peered":"2023-10-14T18:51:17.668630+0000","last_unstale":"2023-10-14T18:51:18.682590+0000","last_undegraded":"2023-10-14T18:51:18.682590+0000","last_fullsized":"2023-10-14T18:51:18.682590+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:54.383912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672556+0000","last_change":"2023-10-14T18:51:18.672556+0000","last_active":"2023-10-14T18:51:18.672556+0000","last_peered":"2023-10-14T18:51:18.672556+0000","last_clean":"2023-10-14T18:51:18.672556+0000","last_became_active":"2023-10-14T18:51:18.672336+0000","last_became_peered":"2023-10-14T18:51:18.672336+0000","last_unstale":"2023-10-14T18:51:18.672556+0000","last_undegraded":"2023-10-14T18:51:18.672556+0000","last_fullsized":"2023-10-14T18:51:18.672556+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669372+0000","last_change":"2023-10-14T18:51:17.667977+0000","last_active":"2023-10-14T18:51:18.669372+0000","last_peered":"2023-10-14T18:51:18.669372+0000","last_clean":"2023-10-14T18:51:18.669372+0000","last_became_active":"2023-10-14T18:51:17.667718+0000","last_became_peered":"2023-10-14T18:51:17.667718+0000","last_unstale":"2023-10-14T18:51:18.669372+0000","last_undegraded":"2023-10-14T18:51:18.669372+0000","last_fullsized":"2023-10-14T18:51:18.669372+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:27.150622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671050+0000","last_change":"2023-10-14T18:51:18.671050+0000","last_active":"2023-10-14T18:51:18.671050+0000","last_peered":"2023-10-14T18:51:18.671050+0000","last_clean":"2023-10-14T18:51:18.671050+0000","last_became_active":"2023-10-14T18:51:18.670828+0000","last_became_peered":"2023-10-14T18:51:18.670828+0000","last_unstale":"2023-10-14T18:51:18.671050+0000","last_undegraded":"2023-10-14T18:51:18.671050+0000","last_fullsized":"2023-10-14T18:51:18.671050+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:16.152461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672571+0000","last_change":"2023-10-14T18:51:17.672525+0000","last_active":"2023-10-14T18:51:17.672571+0000","last_peered":"2023-10-14T18:51:17.672571+0000","last_clean":"2023-10-14T18:51:17.672571+0000","last_became_active":"2023-10-14T18:51:17.672069+0000","last_became_peered":"2023-10-14T18:51:17.672069+0000","last_unstale":"2023-10-14T18:51:17.672571+0000","last_undegraded":"2023-10-14T18:51:17.672571+0000","last_fullsized":"2023-10-14T18:51:17.672571+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:19.969233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666673+0000","last_change":"2023-10-14T18:51:18.666673+0000","last_active":"2023-10-14T18:51:18.666673+0000","last_peered":"2023-10-14T18:51:18.666673+0000","last_clean":"2023-10-14T18:51:18.666673+0000","last_became_active":"2023-10-14T18:51:18.666461+0000","last_became_peered":"2023-10-14T18:51:18.666461+0000","last_unstale":"2023-10-14T18:51:18.666673+0000","last_undegraded":"2023-10-14T18:51:18.666673+0000","last_fullsized":"2023-10-14T18:51:18.666673+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:17.938802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682330+0000","last_change":"2023-10-14T18:51:17.664974+0000","last_active":"2023-10-14T18:51:18.682330+0000","last_peered":"2023-10-14T18:51:18.682330+0000","last_clean":"2023-10-14T18:51:18.682330+0000","last_became_active":"2023-10-14T18:51:17.664762+0000","last_became_peered":"2023-10-14T18:51:17.664762+0000","last_unstale":"2023-10-14T18:51:18.682330+0000","last_undegraded":"2023-10-14T18:51:18.682330+0000","last_fullsized":"2023-10-14T18:51:18.682330+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:19.969233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669925+0000","last_change":"2023-10-14T18:51:18.669925+0000","last_active":"2023-10-14T18:51:18.669925+0000","last_peered":"2023-10-14T18:51:18.669925+0000","last_clean":"2023-10-14T18:51:18.669925+0000","last_became_active":"2023-10-14T18:51:18.669206+0000","last_became_peered":"2023-10-14T18:51:18.669206+0000","last_unstale":"2023-10-14T18:51:18.669925+0000","last_undegraded":"2023-10-14T18:51:18.669925+0000","last_fullsized":"2023-10-14T18:51:18.669925+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:27.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.671809+0000","last_change":"2023-10-14T18:51:17.671126+0000","last_active":"2023-10-14T18:51:17.671809+0000","last_peered":"2023-10-14T18:51:17.671809+0000","last_clean":"2023-10-14T18:51:17.671809+0000","last_became_active":"2023-10-14T18:51:17.670909+0000","last_became_peered":"2023-10-14T18:51:17.670909+0000","last_unstale":"2023-10-14T18:51:17.671809+0000","last_undegraded":"2023-10-14T18:51:17.671809+0000","last_fullsized":"2023-10-14T18:51:17.671809+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:34.249001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667919+0000","last_change":"2023-10-14T18:51:18.667919+0000","last_active":"2023-10-14T18:51:18.667919+0000","last_peered":"2023-10-14T18:51:18.667919+0000","last_clean":"2023-10-14T18:51:18.667919+0000","last_became_active":"2023-10-14T18:51:18.667662+0000","last_became_peered":"2023-10-14T18:51:18.667662+0000","last_unstale":"2023-10-14T18:51:18.667919+0000","last_undegraded":"2023-10-14T18:51:18.667919+0000","last_fullsized":"2023-10-14T18:51:18.667919+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.666686+0000","last_change":"2023-10-14T18:51:17.666639+0000","last_active":"2023-10-14T18:51:17.666686+0000","last_peered":"2023-10-14T18:51:17.666686+0000","last_clean":"2023-10-14T18:51:17.666686+0000","last_became_active":"2023-10-14T18:51:17.666364+0000","last_became_peered":"2023-10-14T18:51:17.666364+0000","last_unstale":"2023-10-14T18:51:17.666686+0000","last_undegraded":"2023-10-14T18:51:17.666686+0000","last_fullsized":"2023-10-14T18:51:17.666686+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:22.835940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674347+0000","last_change":"2023-10-14T18:51:18.674347+0000","last_active":"2023-10-14T18:51:18.674347+0000","last_peered":"2023-10-14T18:51:18.674347+0000","last_clean":"2023-10-14T18:51:18.674347+0000","last_became_active":"2023-10-14T18:51:18.674133+0000","last_became_peered":"2023-10-14T18:51:18.674133+0000","last_unstale":"2023-10-14T18:51:18.674347+0000","last_undegraded":"2023-10-14T18:51:18.674347+0000","last_fullsized":"2023-10-14T18:51:18.674347+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672255+0000","last_change":"2023-10-14T18:51:17.671775+0000","last_active":"2023-10-14T18:51:17.672255+0000","last_peered":"2023-10-14T18:51:17.672255+0000","last_clean":"2023-10-14T18:51:17.672255+0000","last_became_active":"2023-10-14T18:51:17.671341+0000","last_became_peered":"2023-10-14T18:51:17.671341+0000","last_unstale":"2023-10-14T18:51:17.672255+0000","last_undegraded":"2023-10-14T18:51:17.672255+0000","last_fullsized":"2023-10-14T18:51:17.672255+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:19.673437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671904+0000","last_change":"2023-10-14T18:51:18.671904+0000","last_active":"2023-10-14T18:51:18.671904+0000","last_peered":"2023-10-14T18:51:18.671904+0000","last_clean":"2023-10-14T18:51:18.671904+0000","last_became_active":"2023-10-14T18:51:18.671436+0000","last_became_peered":"2023-10-14T18:51:18.671436+0000","last_unstale":"2023-10-14T18:51:18.671904+0000","last_undegraded":"2023-10-14T18:51:18.671904+0000","last_fullsized":"2023-10-14T18:51:18.671904+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682538+0000","last_change":"2023-10-14T18:51:17.670915+0000","last_active":"2023-10-14T18:51:18.682538+0000","last_peered":"2023-10-14T18:51:18.682538+0000","last_clean":"2023-10-14T18:51:18.682538+0000","last_became_active":"2023-10-14T18:51:17.670661+0000","last_became_peered":"2023-10-14T18:51:17.670661+0000","last_unstale":"2023-10-14T18:51:18.682538+0000","last_undegraded":"2023-10-14T18:51:18.682538+0000","last_fullsized":"2023-10-14T18:51:18.682538+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:45.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668374+0000","last_change":"2023-10-14T18:51:18.668374+0000","last_active":"2023-10-14T18:51:18.668374+0000","last_peered":"2023-10-14T18:51:18.668374+0000","last_clean":"2023-10-14T18:51:18.668374+0000","last_became_active":"2023-10-14T18:51:18.667950+0000","last_became_peered":"2023-10-14T18:51:18.667950+0000","last_unstale":"2023-10-14T18:51:18.668374+0000","last_undegraded":"2023-10-14T18:51:18.668374+0000","last_fullsized":"2023-10-14T18:51:18.668374+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:35:20.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.669117+0000","last_change":"2023-10-14T18:51:17.668618+0000","last_active":"2023-10-14T18:51:17.669117+0000","last_peered":"2023-10-14T18:51:17.669117+0000","last_clean":"2023-10-14T18:51:17.669117+0000","last_became_active":"2023-10-14T18:51:17.668304+0000","last_became_peered":"2023-10-14T18:51:17.668304+0000","last_unstale":"2023-10-14T18:51:17.669117+0000","last_undegraded":"2023-10-14T18:51:17.669117+0000","last_fullsized":"2023-10-14T18:51:17.669117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:22.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670211+0000","last_change":"2023-10-14T18:51:18.670211+0000","last_active":"2023-10-14T18:51:18.670211+0000","last_peered":"2023-10-14T18:51:18.670211+0000","last_clean":"2023-10-14T18:51:18.670211+0000","last_became_active":"2023-10-14T18:51:18.669706+0000","last_became_peered":"2023-10-14T18:51:18.669706+0000","last_unstale":"2023-10-14T18:51:18.670211+0000","last_undegraded":"2023-10-14T18:51:18.670211+0000","last_fullsized":"2023-10-14T18:51:18.670211+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:36.059016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.673322+0000","last_change":"2023-10-14T18:51:17.673088+0000","last_active":"2023-10-14T18:51:17.673322+0000","last_peered":"2023-10-14T18:51:17.673322+0000","last_clean":"2023-10-14T18:51:17.673322+0000","last_became_active":"2023-10-14T18:51:17.671506+0000","last_became_peered":"2023-10-14T18:51:17.671506+0000","last_unstale":"2023-10-14T18:51:17.673322+0000","last_undegraded":"2023-10-14T18:51:17.673322+0000","last_fullsized":"2023-10-14T18:51:17.673322+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:43.952171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.676025+0000","last_change":"2023-10-14T18:51:18.676025+0000","last_active":"2023-10-14T18:51:18.676025+0000","last_peered":"2023-10-14T18:51:18.676025+0000","last_clean":"2023-10-14T18:51:18.676025+0000","last_became_active":"2023-10-14T18:51:18.675735+0000","last_became_peered":"2023-10-14T18:51:18.675735+0000","last_unstale":"2023-10-14T18:51:18.676025+0000","last_undegraded":"2023-10-14T18:51:18.676025+0000","last_fullsized":"2023-10-14T18:51:18.676025+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.669052+0000","last_change":"2023-10-14T18:51:17.668992+0000","last_active":"2023-10-14T18:51:17.669052+0000","last_peered":"2023-10-14T18:51:17.669052+0000","last_clean":"2023-10-14T18:51:17.669052+0000","last_became_active":"2023-10-14T18:51:17.668736+0000","last_became_peered":"2023-10-14T18:51:17.668736+0000","last_unstale":"2023-10-14T18:51:17.669052+0000","last_undegraded":"2023-10-14T18:51:17.669052+0000","last_fullsized":"2023-10-14T18:51:17.669052+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:17.384549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671944+0000","last_change":"2023-10-14T18:51:18.671944+0000","last_active":"2023-10-14T18:51:18.671944+0000","last_peered":"2023-10-14T18:51:18.671944+0000","last_clean":"2023-10-14T18:51:18.671944+0000","last_became_active":"2023-10-14T18:51:18.671078+0000","last_became_peered":"2023-10-14T18:51:18.671078+0000","last_unstale":"2023-10-14T18:51:18.671944+0000","last_undegraded":"2023-10-14T18:51:18.671944+0000","last_fullsized":"2023-10-14T18:51:18.671944+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:43.320484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.670951+0000","last_change":"2023-10-14T18:51:17.670846+0000","last_active":"2023-10-14T18:51:17.670951+0000","last_peered":"2023-10-14T18:51:17.670951+0000","last_clean":"2023-10-14T18:51:17.670951+0000","last_became_active":"2023-10-14T18:51:17.670610+0000","last_became_peered":"2023-10-14T18:51:17.670610+0000","last_unstale":"2023-10-14T18:51:17.670951+0000","last_undegraded":"2023-10-14T18:51:17.670951+0000","last_fullsized":"2023-10-14T18:51:17.670951+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:13.832244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666269+0000","last_change":"2023-10-14T18:51:18.666269+0000","last_active":"2023-10-14T18:51:18.666269+0000","last_peered":"2023-10-14T18:51:18.666269+0000","last_clean":"2023-10-14T18:51:18.666269+0000","last_became_active":"2023-10-14T18:51:18.666043+0000","last_became_peered":"2023-10-14T18:51:18.666043+0000","last_unstale":"2023-10-14T18:51:18.666269+0000","last_undegraded":"2023-10-14T18:51:18.666269+0000","last_fullsized":"2023-10-14T18:51:18.666269+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.674876+0000","last_change":"2023-10-14T18:51:17.674823+0000","last_active":"2023-10-14T18:51:17.674876+0000","last_peered":"2023-10-14T18:51:17.674876+0000","last_clean":"2023-10-14T18:51:17.674876+0000","last_became_active":"2023-10-14T18:51:17.674685+0000","last_became_peered":"2023-10-14T18:51:17.674685+0000","last_unstale":"2023-10-14T18:51:17.674876+0000","last_undegraded":"2023-10-14T18:51:17.674876+0000","last_fullsized":"2023-10-14T18:51:17.674876+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:45.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674412+0000","last_change":"2023-10-14T18:51:18.674412+0000","last_active":"2023-10-14T18:51:18.674412+0000","last_peered":"2023-10-14T18:51:18.674412+0000","last_clean":"2023-10-14T18:51:18.674412+0000","last_became_active":"2023-10-14T18:51:18.673846+0000","last_became_peered":"2023-10-14T18:51:18.673846+0000","last_unstale":"2023-10-14T18:51:18.674412+0000","last_undegraded":"2023-10-14T18:51:18.674412+0000","last_fullsized":"2023-10-14T18:51:18.674412+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:43:49.262984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672298+0000","last_change":"2023-10-14T18:51:17.672239+0000","last_active":"2023-10-14T18:51:17.672298+0000","last_peered":"2023-10-14T18:51:17.672298+0000","last_clean":"2023-10-14T18:51:17.672298+0000","last_became_active":"2023-10-14T18:51:17.671746+0000","last_became_peered":"2023-10-14T18:51:17.671746+0000","last_unstale":"2023-10-14T18:51:17.672298+0000","last_undegraded":"2023-10-14T18:51:17.672298+0000","last_fullsized":"2023-10-14T18:51:17.672298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:21.689116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666412+0000","last_change":"2023-10-14T18:51:18.666412+0000","last_active":"2023-10-14T18:51:18.666412+0000","last_peered":"2023-10-14T18:51:18.666412+0000","last_clean":"2023-10-14T18:51:18.666412+0000","last_became_active":"2023-10-14T18:51:18.666200+0000","last_became_peered":"2023-10-14T18:51:18.666200+0000","last_unstale":"2023-10-14T18:51:18.666412+0000","last_undegraded":"2023-10-14T18:51:18.666412+0000","last_fullsized":"2023-10-14T18:51:18.666412+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:42.936110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.673055+0000","last_change":"2023-10-14T18:51:17.672943+0000","last_active":"2023-10-14T18:51:17.673055+0000","last_peered":"2023-10-14T18:51:17.673055+0000","last_clean":"2023-10-14T18:51:17.673055+0000","last_became_active":"2023-10-14T18:51:17.671180+0000","last_became_peered":"2023-10-14T18:51:17.671180+0000","last_unstale":"2023-10-14T18:51:17.673055+0000","last_undegraded":"2023-10-14T18:51:17.673055+0000","last_fullsized":"2023-10-14T18:51:17.673055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:04.647938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672945+0000","last_change":"2023-10-14T18:51:18.672945+0000","last_active":"2023-10-14T18:51:18.672945+0000","last_peered":"2023-10-14T18:51:18.672945+0000","last_clean":"2023-10-14T18:51:18.672945+0000","last_became_active":"2023-10-14T18:51:18.672196+0000","last_became_peered":"2023-10-14T18:51:18.672196+0000","last_unstale":"2023-10-14T18:51:18.672945+0000","last_undegraded":"2023-10-14T18:51:18.672945+0000","last_fullsized":"2023-10-14T18:51:18.672945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:05.980414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672647+0000","last_change":"2023-10-14T18:51:17.672611+0000","last_active":"2023-10-14T18:51:17.672647+0000","last_peered":"2023-10-14T18:51:17.672647+0000","last_clean":"2023-10-14T18:51:17.672647+0000","last_became_active":"2023-10-14T18:51:17.672361+0000","last_became_peered":"2023-10-14T18:51:17.672361+0000","last_unstale":"2023-10-14T18:51:17.672647+0000","last_undegraded":"2023-10-14T18:51:17.672647+0000","last_fullsized":"2023-10-14T18:51:17.672647+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:30.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":280,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.661711+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:51:17.661711+0000","last_peered":"2023-10-14T18:51:17.661711+0000","last_clean":"2023-10-14T18:51:17.661711+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:51:17.661711+0000","last_undegraded":"2023-10-14T18:51:17.661711+0000","last_fullsized":"2023-10-14T18:51:17.661711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193998,"statfs":{"total":200000000,"available":198654685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66600000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52200000000000002,"15min":0.626},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":3.8580000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.89800000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68600000000000005,"5min":0.83999999999999997,"15min":7.8129999999999997},"last":0.496}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.377,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.83899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.501},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"max":{"1min":0.80500000000000005,"5min":0.877,"15min":0.95699999999999996},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.67500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.76100000000000001,"15min":0.76300000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.76000000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":3.4489999999999998},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.83599999999999997},"last":0.435},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":9.5779999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.68300000000000005,"15min":0.84099999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68300000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.504}]},{"osd":5,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46300000000000002,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78600000000000003},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.78500000000000003,"15min":0.89700000000000002},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.40799999999999997,"5min":0.60799999999999998,"15min":1.0900000000000001},"last":0.31},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.56399999999999995,"15min":0.90700000000000003},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.39200000000000002,"5min":0.60299999999999998,"15min":0.89100000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35599999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.46800000000000003,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.72099999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.44400000000000001,"5min":0.66000000000000003,"15min":10.574},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.93899999999999995},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.88200000000000001,"15min":0.96499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.66200000000000003,"5min":0.85399999999999998,"15min":0.92200000000000004},"last":0.624}]},{"osd":6,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.90800000000000003,"15min":0.94699999999999995},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194006,"statfs":{"total":200000000,"available":198663047,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34699999999999998,"15min":0.33600000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.432,"5min":0.623,"15min":0.623},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.29599999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.46000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35699999999999998,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58199999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.373}]},{"osd":5,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.01},"last":0.38100000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.435}]},{"osd":7,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.879,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48299999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.49199999999999999,"5min":0.61499999999999999,"15min":0.67200000000000004},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.379,"15min":0.39200000000000002},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.54400000000000004,"5min":0.70199999999999996,"15min":0.78900000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.54900000000000004,"5min":1.006,"15min":1.006},"last":0.312},{"interface":"front","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66300000000000003,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.45400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.77800000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":738,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.44400000000000001,"5min":0.50700000000000001,"15min":0.68100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.33300000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.222,"15min":0.222},"max":{"1min":0.47999999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.379,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.60499999999999998,"15min":0.64600000000000002},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51300000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29599999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.495,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91200000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56100000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78300000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83099999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.44}]},{"osd":1,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.999,"15min":0.999},"last":0.316},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.33100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.371}]},{"osd":7,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.38500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.40500000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67300000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68100000000000005,"5min":0.748,"15min":0.748},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38500000000000001},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.5,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.76200000000000001,"15min":0.92800000000000005},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.746},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63600000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:51:22.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:51:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.884+0000 7f8c6bfff700 1 Processor -- start 2023-10-14T18:51:22.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.884+0000 7f8c6bfff700 1 -- start start 2023-10-14T18:51:22.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 0x7f8c6c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6bfff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0cb7c0 con 0x7f8c6c0cdab0 2023-10-14T18:51:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6bfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c15e850 con 0x7f8c6c0cd6e0 2023-10-14T18:51:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0cd030 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6affd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 0x7f8c6c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6a7fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8c6c0cdab0 0x7f8c6c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:47804/0 (socket says 172.21.15.79:47804) 2023-10-14T18:51:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6a7fc700 1 -- 172.21.15.79:0/2080891042 learned_addr learned my addr 172.21.15.79:0/2080891042 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:22.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.885+0000 7f8c6affd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:60454/0 (socket says 172.21.15.79:60454) 2023-10-14T18:51:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/2080891042 >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 msgr2=0x7f8c6c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6b7fe700 1 --2- 172.21.15.79:0/2080891042 >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/2080891042 >> v1:172.21.15.144:6789/0 conn(0x7f8c6c0cdab0 legacy=0x7f8c6c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/2080891042 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c15e290 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6affd700 1 --2- 172.21.15.79:0/2080891042 >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c6b7fe700 1 --2- 172.21.15.79:0/2080891042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 0x7f8c6c15d020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098e0 tx=0x7f8c640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e745fe182b457a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c69ffb700 1 -- 172.21.15.79:0/2080891042 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400b640 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c69ffb700 1 -- 172.21.15.79:0/2080891042 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400b7a0 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.886+0000 7f8c69ffb700 1 -- 172.21.15.79:0/2080891042 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400bb40 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 -- 172.21.15.79:0/2080891042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 msgr2=0x7f8c6c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/2080891042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 0x7f8c6c15d020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8c640098e0 tx=0x7f8c640091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 -- 172.21.15.79:0/2080891042 shutdown_connections 2023-10-14T18:51:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/2080891042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c15cbd0 0x7f8c6c15d020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/2080891042 >> v2:172.21.15.144:3300/0 conn(0x7f8c6c0cd6e0 0x7f8c6c0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 -- 172.21.15.79:0/2080891042 >> 172.21.15.79:0/2080891042 conn(0x7f8c6c067660 msgr2=0x7f8c6c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:22.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 -- 172.21.15.79:0/2080891042 shutdown_connections 2023-10-14T18:51:22.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.887+0000 7f8c6bfff700 1 -- 172.21.15.79:0/2080891042 wait complete. 2023-10-14T18:51:22.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.888+0000 7f8c6bfff700 1 Processor -- start 2023-10-14T18:51:22.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.888+0000 7f8c6bfff700 1 -- start start 2023-10-14T18:51:22.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c0cd6e0 0x7f8c6c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c6c0cdab0 0x7f8c6c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c8c50 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c15bdc0 con 0x7f8c6c0cdab0 2023-10-14T18:51:22.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c15c0a0 con 0x7f8c6c0cd6e0 2023-10-14T18:51:22.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35484/0 (socket says 172.21.15.79:35484) 2023-10-14T18:51:22.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/1475568656 learned_addr learned my addr 172.21.15.79:0/1475568656 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:22.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6affd700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c0cd6e0 0x7f8c6c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6a7fc700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c6c0cdab0 0x7f8c6c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c0cd6e0 msgr2=0x7f8c6c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c0cd6e0 0x7f8c6c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c6c0cdab0 msgr2=0x7f8c6c14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:22.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c6c0cdab0 0x7f8c6c14a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:22.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 -- 172.21.15.79:0/1475568656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009a20 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c6b7fe700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ccdd0 tx=0x7f8c64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.889+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400b910 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.890+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400ba90 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.890+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c64009420 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.890+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64025670 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.890+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c1595d0 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.890+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c15c5c0 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.891+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c64023070 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.891+0000 7f8c52ffd700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.891+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c64085ca0 con 0x7f8c6c15cbd0 2023-10-14T18:51:22.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.892+0000 7f8c6affd700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:22.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.892+0000 7f8c6affd700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00f650 tx=0x7f8c5c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:22.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:22.896+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c6c15c5c0 con 0x7f8c6c15cbd0 2023-10-14T18:51:23.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.074+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c6c15c5c0 con 0x7f8c58066f30 2023-10-14T18:51:23.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.083+0000 7f8c52ffd700 1 -- 172.21.15.79:0/1475568656 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285646 (secure 0 0 0) 0x7f8c6c15c5c0 con 0x7f8c58066f30 2023-10-14T18:51:23.087 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:23.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.085+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 msgr2=0x7f8c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.085+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00f650 tx=0x7f8c5c00b040 comp rx=0 tx=0).stop 2023-10-14T18:51:23.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.085+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 msgr2=0x7f8c6c0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.085+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ccdd0 tx=0x7f8c64017000 comp rx=0 tx=0).stop 2023-10-14T18:51:23.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 shutdown_connections 2023-10-14T18:51:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c15cbd0 0x7f8c6c0b49e0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6c0cd6e0 0x7f8c6c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 --2- 172.21.15.79:0/1475568656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c6c0cdab0 0x7f8c6c14a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 >> 172.21.15.79:0/1475568656 conn(0x7f8c6c067660 msgr2=0x7f8c6c0d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 shutdown_connections 2023-10-14T18:51:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.086+0000 7f8c6bfff700 1 -- 172.21.15.79:0/1475568656 wait complete. 2023-10-14T18:51:23.094 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:51:23.100 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-10-14T18:51:22.423542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7041,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555458,"statfs":{"total":1600000000,"available":1592789202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.771671"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672090+0000","last_change":"2023-10-14T18:51:18.672090+0000","last_active":"2023-10-14T18:51:18.672090+0000","last_peered":"2023-10-14T18:51:18.672090+0000","last_clean":"2023-10-14T18:51:18.672090+0000","last_became_active":"2023-10-14T18:51:18.671244+0000","last_became_peered":"2023-10-14T18:51:18.671244+0000","last_unstale":"2023-10-14T18:51:18.672090+0000","last_undegraded":"2023-10-14T18:51:18.672090+0000","last_fullsized":"2023-10-14T18:51:18.672090+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:14.547700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671655+0000","last_change":"2023-10-14T18:51:18.671655+0000","last_active":"2023-10-14T18:51:18.671655+0000","last_peered":"2023-10-14T18:51:18.671655+0000","last_clean":"2023-10-14T18:51:18.671655+0000","last_became_active":"2023-10-14T18:51:18.670505+0000","last_became_peered":"2023-10-14T18:51:18.670505+0000","last_unstale":"2023-10-14T18:51:18.671655+0000","last_undegraded":"2023-10-14T18:51:18.671655+0000","last_fullsized":"2023-10-14T18:51:18.671655+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:57.095334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666852+0000","last_change":"2023-10-14T18:51:18.666852+0000","last_active":"2023-10-14T18:51:18.666852+0000","last_peered":"2023-10-14T18:51:18.666852+0000","last_clean":"2023-10-14T18:51:18.666852+0000","last_became_active":"2023-10-14T18:51:18.666628+0000","last_became_peered":"2023-10-14T18:51:18.666628+0000","last_unstale":"2023-10-14T18:51:18.666852+0000","last_undegraded":"2023-10-14T18:51:18.666852+0000","last_fullsized":"2023-10-14T18:51:18.666852+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.665851+0000","last_change":"2023-10-14T18:51:18.665851+0000","last_active":"2023-10-14T18:51:18.665851+0000","last_peered":"2023-10-14T18:51:18.665851+0000","last_clean":"2023-10-14T18:51:18.665851+0000","last_became_active":"2023-10-14T18:51:18.665606+0000","last_became_peered":"2023-10-14T18:51:18.665606+0000","last_unstale":"2023-10-14T18:51:18.665851+0000","last_undegraded":"2023-10-14T18:51:18.665851+0000","last_fullsized":"2023-10-14T18:51:18.665851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:21.104100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672080+0000","last_change":"2023-10-14T18:51:18.672080+0000","last_active":"2023-10-14T18:51:18.672080+0000","last_peered":"2023-10-14T18:51:18.672080+0000","last_clean":"2023-10-14T18:51:18.672080+0000","last_became_active":"2023-10-14T18:51:18.671882+0000","last_became_peered":"2023-10-14T18:51:18.671882+0000","last_unstale":"2023-10-14T18:51:18.672080+0000","last_undegraded":"2023-10-14T18:51:18.672080+0000","last_fullsized":"2023-10-14T18:51:18.672080+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:55.280015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670113+0000","last_change":"2023-10-14T18:51:18.670113+0000","last_active":"2023-10-14T18:51:18.670113+0000","last_peered":"2023-10-14T18:51:18.670113+0000","last_clean":"2023-10-14T18:51:18.670113+0000","last_became_active":"2023-10-14T18:51:18.669744+0000","last_became_peered":"2023-10-14T18:51:18.669744+0000","last_unstale":"2023-10-14T18:51:18.670113+0000","last_undegraded":"2023-10-14T18:51:18.670113+0000","last_fullsized":"2023-10-14T18:51:18.670113+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:40:57.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674557+0000","last_change":"2023-10-14T18:51:18.674557+0000","last_active":"2023-10-14T18:51:18.674557+0000","last_peered":"2023-10-14T18:51:18.674557+0000","last_clean":"2023-10-14T18:51:18.674557+0000","last_became_active":"2023-10-14T18:51:18.674315+0000","last_became_peered":"2023-10-14T18:51:18.674315+0000","last_unstale":"2023-10-14T18:51:18.674557+0000","last_undegraded":"2023-10-14T18:51:18.674557+0000","last_fullsized":"2023-10-14T18:51:18.674557+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:51.645281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667375+0000","last_change":"2023-10-14T18:51:18.667375+0000","last_active":"2023-10-14T18:51:18.667375+0000","last_peered":"2023-10-14T18:51:18.667375+0000","last_clean":"2023-10-14T18:51:18.667375+0000","last_became_active":"2023-10-14T18:51:18.667076+0000","last_became_peered":"2023-10-14T18:51:18.667076+0000","last_unstale":"2023-10-14T18:51:18.667375+0000","last_undegraded":"2023-10-14T18:51:18.667375+0000","last_fullsized":"2023-10-14T18:51:18.667375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:05.653611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668911+0000","last_change":"2023-10-14T18:51:18.668911+0000","last_active":"2023-10-14T18:51:18.668911+0000","last_peered":"2023-10-14T18:51:18.668911+0000","last_clean":"2023-10-14T18:51:18.668911+0000","last_became_active":"2023-10-14T18:51:18.668588+0000","last_became_peered":"2023-10-14T18:51:18.668588+0000","last_unstale":"2023-10-14T18:51:18.668911+0000","last_undegraded":"2023-10-14T18:51:18.668911+0000","last_fullsized":"2023-10-14T18:51:18.668911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:11:24.546062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669918+0000","last_change":"2023-10-14T18:51:18.669918+0000","last_active":"2023-10-14T18:51:18.669918+0000","last_peered":"2023-10-14T18:51:18.669918+0000","last_clean":"2023-10-14T18:51:18.669918+0000","last_became_active":"2023-10-14T18:51:18.669129+0000","last_became_peered":"2023-10-14T18:51:18.669129+0000","last_unstale":"2023-10-14T18:51:18.669918+0000","last_undegraded":"2023-10-14T18:51:18.669918+0000","last_fullsized":"2023-10-14T18:51:18.669918+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:18:59.829392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673531+0000","last_change":"2023-10-14T18:51:18.673531+0000","last_active":"2023-10-14T18:51:18.673531+0000","last_peered":"2023-10-14T18:51:18.673531+0000","last_clean":"2023-10-14T18:51:18.673531+0000","last_became_active":"2023-10-14T18:51:18.673259+0000","last_became_peered":"2023-10-14T18:51:18.673259+0000","last_unstale":"2023-10-14T18:51:18.673531+0000","last_undegraded":"2023-10-14T18:51:18.673531+0000","last_fullsized":"2023-10-14T18:51:18.673531+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668241+0000","last_change":"2023-10-14T18:51:18.668241+0000","last_active":"2023-10-14T18:51:18.668241+0000","last_peered":"2023-10-14T18:51:18.668241+0000","last_clean":"2023-10-14T18:51:18.668241+0000","last_became_active":"2023-10-14T18:51:18.667560+0000","last_became_peered":"2023-10-14T18:51:18.667560+0000","last_unstale":"2023-10-14T18:51:18.668241+0000","last_undegraded":"2023-10-14T18:51:18.668241+0000","last_fullsized":"2023-10-14T18:51:18.668241+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:02.549937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670236+0000","last_change":"2023-10-14T18:51:18.670236+0000","last_active":"2023-10-14T18:51:18.670236+0000","last_peered":"2023-10-14T18:51:18.670236+0000","last_clean":"2023-10-14T18:51:18.670236+0000","last_became_active":"2023-10-14T18:51:18.669551+0000","last_became_peered":"2023-10-14T18:51:18.669551+0000","last_unstale":"2023-10-14T18:51:18.670236+0000","last_undegraded":"2023-10-14T18:51:18.670236+0000","last_fullsized":"2023-10-14T18:51:18.670236+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:29:02.409030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674552+0000","last_change":"2023-10-14T18:51:18.674552+0000","last_active":"2023-10-14T18:51:18.674552+0000","last_peered":"2023-10-14T18:51:18.674552+0000","last_clean":"2023-10-14T18:51:18.674552+0000","last_became_active":"2023-10-14T18:51:18.674187+0000","last_became_peered":"2023-10-14T18:51:18.674187+0000","last_unstale":"2023-10-14T18:51:18.674552+0000","last_undegraded":"2023-10-14T18:51:18.674552+0000","last_fullsized":"2023-10-14T18:51:18.674552+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:44.957845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670921+0000","last_change":"2023-10-14T18:51:18.670921+0000","last_active":"2023-10-14T18:51:18.670921+0000","last_peered":"2023-10-14T18:51:18.670921+0000","last_clean":"2023-10-14T18:51:18.670921+0000","last_became_active":"2023-10-14T18:51:18.670540+0000","last_became_peered":"2023-10-14T18:51:18.670540+0000","last_unstale":"2023-10-14T18:51:18.670921+0000","last_undegraded":"2023-10-14T18:51:18.670921+0000","last_fullsized":"2023-10-14T18:51:18.670921+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:18.390222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668064+0000","last_change":"2023-10-14T18:51:18.668064+0000","last_active":"2023-10-14T18:51:18.668064+0000","last_peered":"2023-10-14T18:51:18.668064+0000","last_clean":"2023-10-14T18:51:18.668064+0000","last_became_active":"2023-10-14T18:51:18.667830+0000","last_became_peered":"2023-10-14T18:51:18.667830+0000","last_unstale":"2023-10-14T18:51:18.668064+0000","last_undegraded":"2023-10-14T18:51:18.668064+0000","last_fullsized":"2023-10-14T18:51:18.668064+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:52:27.573799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673589+0000","last_change":"2023-10-14T18:51:18.673589+0000","last_active":"2023-10-14T18:51:18.673589+0000","last_peered":"2023-10-14T18:51:18.673589+0000","last_clean":"2023-10-14T18:51:18.673589+0000","last_became_active":"2023-10-14T18:51:18.673352+0000","last_became_peered":"2023-10-14T18:51:18.673352+0000","last_unstale":"2023-10-14T18:51:18.673589+0000","last_undegraded":"2023-10-14T18:51:18.673589+0000","last_fullsized":"2023-10-14T18:51:18.673589+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672038+0000","last_change":"2023-10-14T18:51:18.672038+0000","last_active":"2023-10-14T18:51:18.672038+0000","last_peered":"2023-10-14T18:51:18.672038+0000","last_clean":"2023-10-14T18:51:18.672038+0000","last_became_active":"2023-10-14T18:51:18.671681+0000","last_became_peered":"2023-10-14T18:51:18.671681+0000","last_unstale":"2023-10-14T18:51:18.672038+0000","last_undegraded":"2023-10-14T18:51:18.672038+0000","last_fullsized":"2023-10-14T18:51:18.672038+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:05.980414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668988+0000","last_change":"2023-10-14T18:51:18.668988+0000","last_active":"2023-10-14T18:51:18.668988+0000","last_peered":"2023-10-14T18:51:18.668988+0000","last_clean":"2023-10-14T18:51:18.668988+0000","last_became_active":"2023-10-14T18:51:18.668770+0000","last_became_peered":"2023-10-14T18:51:18.668770+0000","last_unstale":"2023-10-14T18:51:18.668988+0000","last_undegraded":"2023-10-14T18:51:18.668988+0000","last_fullsized":"2023-10-14T18:51:18.668988+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:15:11.206765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671200+0000","last_change":"2023-10-14T18:51:18.671200+0000","last_active":"2023-10-14T18:51:18.671200+0000","last_peered":"2023-10-14T18:51:18.671200+0000","last_clean":"2023-10-14T18:51:18.671200+0000","last_became_active":"2023-10-14T18:51:18.670963+0000","last_became_peered":"2023-10-14T18:51:18.670963+0000","last_unstale":"2023-10-14T18:51:18.671200+0000","last_undegraded":"2023-10-14T18:51:18.671200+0000","last_fullsized":"2023-10-14T18:51:18.671200+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:16.621287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670229+0000","last_change":"2023-10-14T18:51:18.670229+0000","last_active":"2023-10-14T18:51:18.670229+0000","last_peered":"2023-10-14T18:51:18.670229+0000","last_clean":"2023-10-14T18:51:18.670229+0000","last_became_active":"2023-10-14T18:51:18.669997+0000","last_became_peered":"2023-10-14T18:51:18.669997+0000","last_unstale":"2023-10-14T18:51:18.670229+0000","last_undegraded":"2023-10-14T18:51:18.670229+0000","last_fullsized":"2023-10-14T18:51:18.670229+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:21.330689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672703+0000","last_change":"2023-10-14T18:51:18.672703+0000","last_active":"2023-10-14T18:51:18.672703+0000","last_peered":"2023-10-14T18:51:18.672703+0000","last_clean":"2023-10-14T18:51:18.672703+0000","last_became_active":"2023-10-14T18:51:18.672546+0000","last_became_peered":"2023-10-14T18:51:18.672546+0000","last_unstale":"2023-10-14T18:51:18.672703+0000","last_undegraded":"2023-10-14T18:51:18.672703+0000","last_fullsized":"2023-10-14T18:51:18.672703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670843+0000","last_change":"2023-10-14T18:51:18.670843+0000","last_active":"2023-10-14T18:51:18.670843+0000","last_peered":"2023-10-14T18:51:18.670843+0000","last_clean":"2023-10-14T18:51:18.670843+0000","last_became_active":"2023-10-14T18:51:18.670584+0000","last_became_peered":"2023-10-14T18:51:18.670584+0000","last_unstale":"2023-10-14T18:51:18.670843+0000","last_undegraded":"2023-10-14T18:51:18.670843+0000","last_fullsized":"2023-10-14T18:51:18.670843+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:45.820701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.675525+0000","last_change":"2023-10-14T18:51:18.675525+0000","last_active":"2023-10-14T18:51:18.675525+0000","last_peered":"2023-10-14T18:51:18.675525+0000","last_clean":"2023-10-14T18:51:18.675525+0000","last_became_active":"2023-10-14T18:51:18.675320+0000","last_became_peered":"2023-10-14T18:51:18.675320+0000","last_unstale":"2023-10-14T18:51:18.675525+0000","last_undegraded":"2023-10-14T18:51:18.675525+0000","last_fullsized":"2023-10-14T18:51:18.675525+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669097+0000","last_change":"2023-10-14T18:51:18.669097+0000","last_active":"2023-10-14T18:51:18.669097+0000","last_peered":"2023-10-14T18:51:18.669097+0000","last_clean":"2023-10-14T18:51:18.669097+0000","last_became_active":"2023-10-14T18:51:18.668847+0000","last_became_peered":"2023-10-14T18:51:18.668847+0000","last_unstale":"2023-10-14T18:51:18.669097+0000","last_undegraded":"2023-10-14T18:51:18.669097+0000","last_fullsized":"2023-10-14T18:51:18.669097+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672397+0000","last_change":"2023-10-14T18:51:18.672397+0000","last_active":"2023-10-14T18:51:18.672397+0000","last_peered":"2023-10-14T18:51:18.672397+0000","last_clean":"2023-10-14T18:51:18.672397+0000","last_became_active":"2023-10-14T18:51:18.671841+0000","last_became_peered":"2023-10-14T18:51:18.671841+0000","last_unstale":"2023-10-14T18:51:18.672397+0000","last_undegraded":"2023-10-14T18:51:18.672397+0000","last_fullsized":"2023-10-14T18:51:18.672397+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:48.380725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666690+0000","last_change":"2023-10-14T18:51:18.666690+0000","last_active":"2023-10-14T18:51:18.666690+0000","last_peered":"2023-10-14T18:51:18.666690+0000","last_clean":"2023-10-14T18:51:18.666690+0000","last_became_active":"2023-10-14T18:51:18.665726+0000","last_became_peered":"2023-10-14T18:51:18.665726+0000","last_unstale":"2023-10-14T18:51:18.666690+0000","last_undegraded":"2023-10-14T18:51:18.666690+0000","last_fullsized":"2023-10-14T18:51:18.666690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:46.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673085+0000","last_change":"2023-10-14T18:51:18.673085+0000","last_active":"2023-10-14T18:51:18.673085+0000","last_peered":"2023-10-14T18:51:18.673085+0000","last_clean":"2023-10-14T18:51:18.673085+0000","last_became_active":"2023-10-14T18:51:18.672507+0000","last_became_peered":"2023-10-14T18:51:18.672507+0000","last_unstale":"2023-10-14T18:51:18.673085+0000","last_undegraded":"2023-10-14T18:51:18.673085+0000","last_fullsized":"2023-10-14T18:51:18.673085+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:43.320484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668693+0000","last_change":"2023-10-14T18:51:18.668693+0000","last_active":"2023-10-14T18:51:18.668693+0000","last_peered":"2023-10-14T18:51:18.668693+0000","last_clean":"2023-10-14T18:51:18.668693+0000","last_became_active":"2023-10-14T18:51:18.666763+0000","last_became_peered":"2023-10-14T18:51:18.666763+0000","last_unstale":"2023-10-14T18:51:18.668693+0000","last_undegraded":"2023-10-14T18:51:18.668693+0000","last_fullsized":"2023-10-14T18:51:18.668693+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674001+0000","last_change":"2023-10-14T18:51:18.674001+0000","last_active":"2023-10-14T18:51:18.674001+0000","last_peered":"2023-10-14T18:51:18.674001+0000","last_clean":"2023-10-14T18:51:18.674001+0000","last_became_active":"2023-10-14T18:51:18.673771+0000","last_became_peered":"2023-10-14T18:51:18.673771+0000","last_unstale":"2023-10-14T18:51:18.674001+0000","last_undegraded":"2023-10-14T18:51:18.674001+0000","last_fullsized":"2023-10-14T18:51:18.674001+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:46.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672237+0000","last_change":"2023-10-14T18:51:18.672237+0000","last_active":"2023-10-14T18:51:18.672237+0000","last_peered":"2023-10-14T18:51:18.672237+0000","last_clean":"2023-10-14T18:51:18.672237+0000","last_became_active":"2023-10-14T18:51:18.671537+0000","last_became_peered":"2023-10-14T18:51:18.671537+0000","last_unstale":"2023-10-14T18:51:18.672237+0000","last_undegraded":"2023-10-14T18:51:18.672237+0000","last_fullsized":"2023-10-14T18:51:18.672237+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:14.659491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670561+0000","last_change":"2023-10-14T18:51:18.670561+0000","last_active":"2023-10-14T18:51:18.670561+0000","last_peered":"2023-10-14T18:51:18.670561+0000","last_clean":"2023-10-14T18:51:18.670561+0000","last_became_active":"2023-10-14T18:51:18.670342+0000","last_became_peered":"2023-10-14T18:51:18.670342+0000","last_unstale":"2023-10-14T18:51:18.670561+0000","last_undegraded":"2023-10-14T18:51:18.670561+0000","last_fullsized":"2023-10-14T18:51:18.670561+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:58.682986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.664688+0000","last_change":"2023-10-14T18:51:18.664688+0000","last_active":"2023-10-14T18:51:18.664688+0000","last_peered":"2023-10-14T18:51:18.664688+0000","last_clean":"2023-10-14T18:51:18.664688+0000","last_became_active":"2023-10-14T18:51:18.664464+0000","last_became_peered":"2023-10-14T18:51:18.664464+0000","last_unstale":"2023-10-14T18:51:18.664688+0000","last_undegraded":"2023-10-14T18:51:18.664688+0000","last_fullsized":"2023-10-14T18:51:18.664688+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:10.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.680405+0000","last_change":"2023-10-14T18:51:17.671674+0000","last_active":"2023-10-14T18:51:18.680405+0000","last_peered":"2023-10-14T18:51:18.680405+0000","last_clean":"2023-10-14T18:51:18.680405+0000","last_became_active":"2023-10-14T18:51:17.671427+0000","last_became_peered":"2023-10-14T18:51:17.671427+0000","last_unstale":"2023-10-14T18:51:18.680405+0000","last_undegraded":"2023-10-14T18:51:18.680405+0000","last_fullsized":"2023-10-14T18:51:18.680405+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:08.526275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.676520+0000","last_change":"2023-10-14T18:51:18.676520+0000","last_active":"2023-10-14T18:51:18.676520+0000","last_peered":"2023-10-14T18:51:18.676520+0000","last_clean":"2023-10-14T18:51:18.676520+0000","last_became_active":"2023-10-14T18:51:18.676277+0000","last_became_peered":"2023-10-14T18:51:18.676277+0000","last_unstale":"2023-10-14T18:51:18.676520+0000","last_undegraded":"2023-10-14T18:51:18.676520+0000","last_fullsized":"2023-10-14T18:51:18.676520+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.116376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.663691+0000","last_change":"2023-10-14T18:51:17.670002+0000","last_active":"2023-10-14T18:51:18.663691+0000","last_peered":"2023-10-14T18:51:18.663691+0000","last_clean":"2023-10-14T18:51:18.663691+0000","last_became_active":"2023-10-14T18:51:17.669746+0000","last_became_peered":"2023-10-14T18:51:17.669746+0000","last_unstale":"2023-10-14T18:51:18.663691+0000","last_undegraded":"2023-10-14T18:51:18.663691+0000","last_fullsized":"2023-10-14T18:51:18.663691+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:24.598152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669974+0000","last_change":"2023-10-14T18:51:18.669974+0000","last_active":"2023-10-14T18:51:18.669974+0000","last_peered":"2023-10-14T18:51:18.669974+0000","last_clean":"2023-10-14T18:51:18.669974+0000","last_became_active":"2023-10-14T18:51:18.669447+0000","last_became_peered":"2023-10-14T18:51:18.669447+0000","last_unstale":"2023-10-14T18:51:18.669974+0000","last_undegraded":"2023-10-14T18:51:18.669974+0000","last_fullsized":"2023-10-14T18:51:18.669974+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:34:34.042001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.683206+0000","last_change":"2023-10-14T18:51:17.669299+0000","last_active":"2023-10-14T18:51:18.683206+0000","last_peered":"2023-10-14T18:51:18.683206+0000","last_clean":"2023-10-14T18:51:18.683206+0000","last_became_active":"2023-10-14T18:51:17.669111+0000","last_became_peered":"2023-10-14T18:51:17.669111+0000","last_unstale":"2023-10-14T18:51:18.683206+0000","last_undegraded":"2023-10-14T18:51:18.683206+0000","last_fullsized":"2023-10-14T18:51:18.683206+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:37:48.579165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674362+0000","last_change":"2023-10-14T18:51:18.674362+0000","last_active":"2023-10-14T18:51:18.674362+0000","last_peered":"2023-10-14T18:51:18.674362+0000","last_clean":"2023-10-14T18:51:18.674362+0000","last_became_active":"2023-10-14T18:51:18.673853+0000","last_became_peered":"2023-10-14T18:51:18.673853+0000","last_unstale":"2023-10-14T18:51:18.674362+0000","last_undegraded":"2023-10-14T18:51:18.674362+0000","last_fullsized":"2023-10-14T18:51:18.674362+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:30.836755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682809+0000","last_change":"2023-10-14T18:51:17.669241+0000","last_active":"2023-10-14T18:51:18.682809+0000","last_peered":"2023-10-14T18:51:18.682809+0000","last_clean":"2023-10-14T18:51:18.682809+0000","last_became_active":"2023-10-14T18:51:17.669040+0000","last_became_peered":"2023-10-14T18:51:17.669040+0000","last_unstale":"2023-10-14T18:51:18.682809+0000","last_undegraded":"2023-10-14T18:51:18.682809+0000","last_fullsized":"2023-10-14T18:51:18.682809+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:23.683405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669792+0000","last_change":"2023-10-14T18:51:18.669792+0000","last_active":"2023-10-14T18:51:18.669792+0000","last_peered":"2023-10-14T18:51:18.669792+0000","last_clean":"2023-10-14T18:51:18.669792+0000","last_became_active":"2023-10-14T18:51:18.668854+0000","last_became_peered":"2023-10-14T18:51:18.668854+0000","last_unstale":"2023-10-14T18:51:18.669792+0000","last_undegraded":"2023-10-14T18:51:18.669792+0000","last_fullsized":"2023-10-14T18:51:18.669792+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:32.522941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668712+0000","last_change":"2023-10-14T18:51:17.669191+0000","last_active":"2023-10-14T18:51:18.668712+0000","last_peered":"2023-10-14T18:51:18.668712+0000","last_clean":"2023-10-14T18:51:18.668712+0000","last_became_active":"2023-10-14T18:51:17.668996+0000","last_became_peered":"2023-10-14T18:51:17.668996+0000","last_unstale":"2023-10-14T18:51:18.668712+0000","last_undegraded":"2023-10-14T18:51:18.668712+0000","last_fullsized":"2023-10-14T18:51:18.668712+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:03:20.573706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671800+0000","last_change":"2023-10-14T18:51:18.671800+0000","last_active":"2023-10-14T18:51:18.671800+0000","last_peered":"2023-10-14T18:51:18.671800+0000","last_clean":"2023-10-14T18:51:18.671800+0000","last_became_active":"2023-10-14T18:51:18.670788+0000","last_became_peered":"2023-10-14T18:51:18.670788+0000","last_unstale":"2023-10-14T18:51:18.671800+0000","last_undegraded":"2023-10-14T18:51:18.671800+0000","last_fullsized":"2023-10-14T18:51:18.671800+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:58:30.836755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666903+0000","last_change":"2023-10-14T18:51:17.667717+0000","last_active":"2023-10-14T18:51:18.666903+0000","last_peered":"2023-10-14T18:51:18.666903+0000","last_clean":"2023-10-14T18:51:18.666903+0000","last_became_active":"2023-10-14T18:51:17.667422+0000","last_became_peered":"2023-10-14T18:51:17.667422+0000","last_unstale":"2023-10-14T18:51:18.666903+0000","last_undegraded":"2023-10-14T18:51:18.666903+0000","last_fullsized":"2023-10-14T18:51:18.666903+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:50.639608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670084+0000","last_change":"2023-10-14T18:51:18.670084+0000","last_active":"2023-10-14T18:51:18.670084+0000","last_peered":"2023-10-14T18:51:18.670084+0000","last_clean":"2023-10-14T18:51:18.670084+0000","last_became_active":"2023-10-14T18:51:18.669427+0000","last_became_peered":"2023-10-14T18:51:18.669427+0000","last_unstale":"2023-10-14T18:51:18.670084+0000","last_undegraded":"2023-10-14T18:51:18.670084+0000","last_fullsized":"2023-10-14T18:51:18.670084+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:42:34.021855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.668144+0000","last_change":"2023-10-14T18:51:17.668061+0000","last_active":"2023-10-14T18:51:17.668144+0000","last_peered":"2023-10-14T18:51:17.668144+0000","last_clean":"2023-10-14T18:51:17.668144+0000","last_became_active":"2023-10-14T18:51:17.667844+0000","last_became_peered":"2023-10-14T18:51:17.667844+0000","last_unstale":"2023-10-14T18:51:17.668144+0000","last_undegraded":"2023-10-14T18:51:17.668144+0000","last_fullsized":"2023-10-14T18:51:17.668144+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:09.913664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673290+0000","last_change":"2023-10-14T18:51:18.673290+0000","last_active":"2023-10-14T18:51:18.673290+0000","last_peered":"2023-10-14T18:51:18.673290+0000","last_clean":"2023-10-14T18:51:18.673290+0000","last_became_active":"2023-10-14T18:51:18.673042+0000","last_became_peered":"2023-10-14T18:51:18.673042+0000","last_unstale":"2023-10-14T18:51:18.673290+0000","last_undegraded":"2023-10-14T18:51:18.673290+0000","last_fullsized":"2023-10-14T18:51:18.673290+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:18.390222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.664601+0000","last_change":"2023-10-14T18:51:17.664490+0000","last_active":"2023-10-14T18:51:17.664601+0000","last_peered":"2023-10-14T18:51:17.664601+0000","last_clean":"2023-10-14T18:51:17.664601+0000","last_became_active":"2023-10-14T18:51:17.664268+0000","last_became_peered":"2023-10-14T18:51:17.664268+0000","last_unstale":"2023-10-14T18:51:17.664601+0000","last_undegraded":"2023-10-14T18:51:17.664601+0000","last_fullsized":"2023-10-14T18:51:17.664601+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:32.410614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672497+0000","last_change":"2023-10-14T18:51:18.672497+0000","last_active":"2023-10-14T18:51:18.672497+0000","last_peered":"2023-10-14T18:51:18.672497+0000","last_clean":"2023-10-14T18:51:18.672497+0000","last_became_active":"2023-10-14T18:51:18.672068+0000","last_became_peered":"2023-10-14T18:51:18.672068+0000","last_unstale":"2023-10-14T18:51:18.672497+0000","last_undegraded":"2023-10-14T18:51:18.672497+0000","last_fullsized":"2023-10-14T18:51:18.672497+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:10.919338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.670815+0000","last_change":"2023-10-14T18:51:17.670750+0000","last_active":"2023-10-14T18:51:17.670815+0000","last_peered":"2023-10-14T18:51:17.670815+0000","last_clean":"2023-10-14T18:51:17.670815+0000","last_became_active":"2023-10-14T18:51:17.670541+0000","last_became_peered":"2023-10-14T18:51:17.670541+0000","last_unstale":"2023-10-14T18:51:17.670815+0000","last_undegraded":"2023-10-14T18:51:17.670815+0000","last_fullsized":"2023-10-14T18:51:17.670815+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:03.543579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674527+0000","last_change":"2023-10-14T18:51:18.674527+0000","last_active":"2023-10-14T18:51:18.674527+0000","last_peered":"2023-10-14T18:51:18.674527+0000","last_clean":"2023-10-14T18:51:18.674527+0000","last_became_active":"2023-10-14T18:51:18.674111+0000","last_became_peered":"2023-10-14T18:51:18.674111+0000","last_unstale":"2023-10-14T18:51:18.674527+0000","last_undegraded":"2023-10-14T18:51:18.674527+0000","last_fullsized":"2023-10-14T18:51:18.674527+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:54:12.170633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.668025+0000","last_change":"2023-10-14T18:51:17.667698+0000","last_active":"2023-10-14T18:51:17.668025+0000","last_peered":"2023-10-14T18:51:17.668025+0000","last_clean":"2023-10-14T18:51:17.668025+0000","last_became_active":"2023-10-14T18:51:17.667239+0000","last_became_peered":"2023-10-14T18:51:17.667239+0000","last_unstale":"2023-10-14T18:51:17.668025+0000","last_undegraded":"2023-10-14T18:51:17.668025+0000","last_fullsized":"2023-10-14T18:51:17.668025+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:09.913664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674523+0000","last_change":"2023-10-14T18:51:18.674523+0000","last_active":"2023-10-14T18:51:18.674523+0000","last_peered":"2023-10-14T18:51:18.674523+0000","last_clean":"2023-10-14T18:51:18.674523+0000","last_became_active":"2023-10-14T18:51:18.674368+0000","last_became_peered":"2023-10-14T18:51:18.674368+0000","last_unstale":"2023-10-14T18:51:18.674523+0000","last_undegraded":"2023-10-14T18:51:18.674523+0000","last_fullsized":"2023-10-14T18:51:18.674523+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:21.330689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.680553+0000","last_change":"2023-10-14T18:51:17.668769+0000","last_active":"2023-10-14T18:51:18.680553+0000","last_peered":"2023-10-14T18:51:18.680553+0000","last_clean":"2023-10-14T18:51:18.680553+0000","last_became_active":"2023-10-14T18:51:17.665459+0000","last_became_peered":"2023-10-14T18:51:17.665459+0000","last_unstale":"2023-10-14T18:51:18.680553+0000","last_undegraded":"2023-10-14T18:51:18.680553+0000","last_fullsized":"2023-10-14T18:51:18.680553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:04:50.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.675223+0000","last_change":"2023-10-14T18:51:18.675223+0000","last_active":"2023-10-14T18:51:18.675223+0000","last_peered":"2023-10-14T18:51:18.675223+0000","last_clean":"2023-10-14T18:51:18.675223+0000","last_became_active":"2023-10-14T18:51:18.674979+0000","last_became_peered":"2023-10-14T18:51:18.674979+0000","last_unstale":"2023-10-14T18:51:18.675223+0000","last_undegraded":"2023-10-14T18:51:18.675223+0000","last_fullsized":"2023-10-14T18:51:18.675223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:40:57.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.681142+0000","last_change":"2023-10-14T18:51:17.663712+0000","last_active":"2023-10-14T18:51:18.681142+0000","last_peered":"2023-10-14T18:51:18.681142+0000","last_clean":"2023-10-14T18:51:18.681142+0000","last_became_active":"2023-10-14T18:51:17.663495+0000","last_became_peered":"2023-10-14T18:51:17.663495+0000","last_unstale":"2023-10-14T18:51:18.681142+0000","last_undegraded":"2023-10-14T18:51:18.681142+0000","last_fullsized":"2023-10-14T18:51:18.681142+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:15:10.201092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.673146+0000","last_change":"2023-10-14T18:51:18.673146+0000","last_active":"2023-10-14T18:51:18.673146+0000","last_peered":"2023-10-14T18:51:18.673146+0000","last_clean":"2023-10-14T18:51:18.673146+0000","last_became_active":"2023-10-14T18:51:18.672997+0000","last_became_peered":"2023-10-14T18:51:18.672997+0000","last_unstale":"2023-10-14T18:51:18.673146+0000","last_undegraded":"2023-10-14T18:51:18.673146+0000","last_fullsized":"2023-10-14T18:51:18.673146+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.116376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.684079+0000","last_change":"2023-10-14T18:51:17.670090+0000","last_active":"2023-10-14T18:51:18.684079+0000","last_peered":"2023-10-14T18:51:18.684079+0000","last_clean":"2023-10-14T18:51:18.684079+0000","last_became_active":"2023-10-14T18:51:17.669544+0000","last_became_peered":"2023-10-14T18:51:17.669544+0000","last_unstale":"2023-10-14T18:51:18.684079+0000","last_undegraded":"2023-10-14T18:51:18.684079+0000","last_fullsized":"2023-10-14T18:51:18.684079+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:08.526275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671981+0000","last_change":"2023-10-14T18:51:18.671981+0000","last_active":"2023-10-14T18:51:18.671981+0000","last_peered":"2023-10-14T18:51:18.671981+0000","last_clean":"2023-10-14T18:51:18.671981+0000","last_became_active":"2023-10-14T18:51:18.671768+0000","last_became_peered":"2023-10-14T18:51:18.671768+0000","last_unstale":"2023-10-14T18:51:18.671981+0000","last_undegraded":"2023-10-14T18:51:18.671981+0000","last_fullsized":"2023-10-14T18:51:18.671981+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.671870+0000","last_change":"2023-10-14T18:51:17.671711+0000","last_active":"2023-10-14T18:51:17.671870+0000","last_peered":"2023-10-14T18:51:17.671870+0000","last_clean":"2023-10-14T18:51:17.671870+0000","last_became_active":"2023-10-14T18:51:17.671281+0000","last_became_peered":"2023-10-14T18:51:17.671281+0000","last_unstale":"2023-10-14T18:51:17.671870+0000","last_undegraded":"2023-10-14T18:51:17.671870+0000","last_fullsized":"2023-10-14T18:51:17.671870+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:44.815027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669922+0000","last_change":"2023-10-14T18:51:18.669922+0000","last_active":"2023-10-14T18:51:18.669922+0000","last_peered":"2023-10-14T18:51:18.669922+0000","last_clean":"2023-10-14T18:51:18.669922+0000","last_became_active":"2023-10-14T18:51:18.669666+0000","last_became_peered":"2023-10-14T18:51:18.669666+0000","last_unstale":"2023-10-14T18:51:18.669922+0000","last_undegraded":"2023-10-14T18:51:18.669922+0000","last_fullsized":"2023-10-14T18:51:18.669922+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.684329+0000","last_change":"2023-10-14T18:51:17.672391+0000","last_active":"2023-10-14T18:51:18.684329+0000","last_peered":"2023-10-14T18:51:18.684329+0000","last_clean":"2023-10-14T18:51:18.684329+0000","last_became_active":"2023-10-14T18:51:17.672028+0000","last_became_peered":"2023-10-14T18:51:17.672028+0000","last_unstale":"2023-10-14T18:51:18.684329+0000","last_undegraded":"2023-10-14T18:51:18.684329+0000","last_fullsized":"2023-10-14T18:51:18.684329+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:10:46.984780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671465+0000","last_change":"2023-10-14T18:51:18.671465+0000","last_active":"2023-10-14T18:51:18.671465+0000","last_peered":"2023-10-14T18:51:18.671465+0000","last_clean":"2023-10-14T18:51:18.671465+0000","last_became_active":"2023-10-14T18:51:18.670695+0000","last_became_peered":"2023-10-14T18:51:18.670695+0000","last_unstale":"2023-10-14T18:51:18.671465+0000","last_undegraded":"2023-10-14T18:51:18.671465+0000","last_fullsized":"2023-10-14T18:51:18.671465+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:23:40.507352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.662904+0000","last_change":"2023-10-14T18:51:17.670060+0000","last_active":"2023-10-14T18:51:18.662904+0000","last_peered":"2023-10-14T18:51:18.662904+0000","last_clean":"2023-10-14T18:51:18.662904+0000","last_became_active":"2023-10-14T18:51:17.669828+0000","last_became_peered":"2023-10-14T18:51:17.669828+0000","last_unstale":"2023-10-14T18:51:18.662904+0000","last_undegraded":"2023-10-14T18:51:18.662904+0000","last_fullsized":"2023-10-14T18:51:18.662904+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.933128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667063+0000","last_change":"2023-10-14T18:51:18.667063+0000","last_active":"2023-10-14T18:51:18.667063+0000","last_peered":"2023-10-14T18:51:18.667063+0000","last_clean":"2023-10-14T18:51:18.667063+0000","last_became_active":"2023-10-14T18:51:18.666820+0000","last_became_peered":"2023-10-14T18:51:18.666820+0000","last_unstale":"2023-10-14T18:51:18.667063+0000","last_undegraded":"2023-10-14T18:51:18.667063+0000","last_fullsized":"2023-10-14T18:51:18.667063+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:51.645281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682590+0000","last_change":"2023-10-14T18:51:17.668918+0000","last_active":"2023-10-14T18:51:18.682590+0000","last_peered":"2023-10-14T18:51:18.682590+0000","last_clean":"2023-10-14T18:51:18.682590+0000","last_became_active":"2023-10-14T18:51:17.668630+0000","last_became_peered":"2023-10-14T18:51:17.668630+0000","last_unstale":"2023-10-14T18:51:18.682590+0000","last_undegraded":"2023-10-14T18:51:18.682590+0000","last_fullsized":"2023-10-14T18:51:18.682590+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:22:54.383912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672556+0000","last_change":"2023-10-14T18:51:18.672556+0000","last_active":"2023-10-14T18:51:18.672556+0000","last_peered":"2023-10-14T18:51:18.672556+0000","last_clean":"2023-10-14T18:51:18.672556+0000","last_became_active":"2023-10-14T18:51:18.672336+0000","last_became_peered":"2023-10-14T18:51:18.672336+0000","last_unstale":"2023-10-14T18:51:18.672556+0000","last_undegraded":"2023-10-14T18:51:18.672556+0000","last_fullsized":"2023-10-14T18:51:18.672556+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:59:33.650211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669372+0000","last_change":"2023-10-14T18:51:17.667977+0000","last_active":"2023-10-14T18:51:18.669372+0000","last_peered":"2023-10-14T18:51:18.669372+0000","last_clean":"2023-10-14T18:51:18.669372+0000","last_became_active":"2023-10-14T18:51:17.667718+0000","last_became_peered":"2023-10-14T18:51:17.667718+0000","last_unstale":"2023-10-14T18:51:18.669372+0000","last_undegraded":"2023-10-14T18:51:18.669372+0000","last_fullsized":"2023-10-14T18:51:18.669372+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:00:27.150622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671050+0000","last_change":"2023-10-14T18:51:18.671050+0000","last_active":"2023-10-14T18:51:18.671050+0000","last_peered":"2023-10-14T18:51:18.671050+0000","last_clean":"2023-10-14T18:51:18.671050+0000","last_became_active":"2023-10-14T18:51:18.670828+0000","last_became_peered":"2023-10-14T18:51:18.670828+0000","last_unstale":"2023-10-14T18:51:18.671050+0000","last_undegraded":"2023-10-14T18:51:18.671050+0000","last_fullsized":"2023-10-14T18:51:18.671050+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:16.152461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672571+0000","last_change":"2023-10-14T18:51:17.672525+0000","last_active":"2023-10-14T18:51:17.672571+0000","last_peered":"2023-10-14T18:51:17.672571+0000","last_clean":"2023-10-14T18:51:17.672571+0000","last_became_active":"2023-10-14T18:51:17.672069+0000","last_became_peered":"2023-10-14T18:51:17.672069+0000","last_unstale":"2023-10-14T18:51:17.672571+0000","last_undegraded":"2023-10-14T18:51:17.672571+0000","last_fullsized":"2023-10-14T18:51:17.672571+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:19.969233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666673+0000","last_change":"2023-10-14T18:51:18.666673+0000","last_active":"2023-10-14T18:51:18.666673+0000","last_peered":"2023-10-14T18:51:18.666673+0000","last_clean":"2023-10-14T18:51:18.666673+0000","last_became_active":"2023-10-14T18:51:18.666461+0000","last_became_peered":"2023-10-14T18:51:18.666461+0000","last_unstale":"2023-10-14T18:51:18.666673+0000","last_undegraded":"2023-10-14T18:51:18.666673+0000","last_fullsized":"2023-10-14T18:51:18.666673+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:17.938802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682330+0000","last_change":"2023-10-14T18:51:17.664974+0000","last_active":"2023-10-14T18:51:18.682330+0000","last_peered":"2023-10-14T18:51:18.682330+0000","last_clean":"2023-10-14T18:51:18.682330+0000","last_became_active":"2023-10-14T18:51:17.664762+0000","last_became_peered":"2023-10-14T18:51:17.664762+0000","last_unstale":"2023-10-14T18:51:18.682330+0000","last_undegraded":"2023-10-14T18:51:18.682330+0000","last_fullsized":"2023-10-14T18:51:18.682330+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:30:19.969233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.669925+0000","last_change":"2023-10-14T18:51:18.669925+0000","last_active":"2023-10-14T18:51:18.669925+0000","last_peered":"2023-10-14T18:51:18.669925+0000","last_clean":"2023-10-14T18:51:18.669925+0000","last_became_active":"2023-10-14T18:51:18.669206+0000","last_became_peered":"2023-10-14T18:51:18.669206+0000","last_unstale":"2023-10-14T18:51:18.669925+0000","last_undegraded":"2023-10-14T18:51:18.669925+0000","last_fullsized":"2023-10-14T18:51:18.669925+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:27.874711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.671809+0000","last_change":"2023-10-14T18:51:17.671126+0000","last_active":"2023-10-14T18:51:17.671809+0000","last_peered":"2023-10-14T18:51:17.671809+0000","last_clean":"2023-10-14T18:51:17.671809+0000","last_became_active":"2023-10-14T18:51:17.670909+0000","last_became_peered":"2023-10-14T18:51:17.670909+0000","last_unstale":"2023-10-14T18:51:17.671809+0000","last_undegraded":"2023-10-14T18:51:17.671809+0000","last_fullsized":"2023-10-14T18:51:17.671809+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:54:34.249001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.667919+0000","last_change":"2023-10-14T18:51:18.667919+0000","last_active":"2023-10-14T18:51:18.667919+0000","last_peered":"2023-10-14T18:51:18.667919+0000","last_clean":"2023-10-14T18:51:18.667919+0000","last_became_active":"2023-10-14T18:51:18.667662+0000","last_became_peered":"2023-10-14T18:51:18.667662+0000","last_unstale":"2023-10-14T18:51:18.667919+0000","last_undegraded":"2023-10-14T18:51:18.667919+0000","last_fullsized":"2023-10-14T18:51:18.667919+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.666686+0000","last_change":"2023-10-14T18:51:17.666639+0000","last_active":"2023-10-14T18:51:17.666686+0000","last_peered":"2023-10-14T18:51:17.666686+0000","last_clean":"2023-10-14T18:51:17.666686+0000","last_became_active":"2023-10-14T18:51:17.666364+0000","last_became_peered":"2023-10-14T18:51:17.666364+0000","last_unstale":"2023-10-14T18:51:17.666686+0000","last_undegraded":"2023-10-14T18:51:17.666686+0000","last_fullsized":"2023-10-14T18:51:17.666686+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:55:22.835940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674347+0000","last_change":"2023-10-14T18:51:18.674347+0000","last_active":"2023-10-14T18:51:18.674347+0000","last_peered":"2023-10-14T18:51:18.674347+0000","last_clean":"2023-10-14T18:51:18.674347+0000","last_became_active":"2023-10-14T18:51:18.674133+0000","last_became_peered":"2023-10-14T18:51:18.674133+0000","last_unstale":"2023-10-14T18:51:18.674347+0000","last_undegraded":"2023-10-14T18:51:18.674347+0000","last_fullsized":"2023-10-14T18:51:18.674347+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:06:16.098639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672255+0000","last_change":"2023-10-14T18:51:17.671775+0000","last_active":"2023-10-14T18:51:17.672255+0000","last_peered":"2023-10-14T18:51:17.672255+0000","last_clean":"2023-10-14T18:51:17.672255+0000","last_became_active":"2023-10-14T18:51:17.671341+0000","last_became_peered":"2023-10-14T18:51:17.671341+0000","last_unstale":"2023-10-14T18:51:17.672255+0000","last_undegraded":"2023-10-14T18:51:17.672255+0000","last_fullsized":"2023-10-14T18:51:17.672255+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:19.673437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671904+0000","last_change":"2023-10-14T18:51:18.671904+0000","last_active":"2023-10-14T18:51:18.671904+0000","last_peered":"2023-10-14T18:51:18.671904+0000","last_clean":"2023-10-14T18:51:18.671904+0000","last_became_active":"2023-10-14T18:51:18.671436+0000","last_became_peered":"2023-10-14T18:51:18.671436+0000","last_unstale":"2023-10-14T18:51:18.671904+0000","last_undegraded":"2023-10-14T18:51:18.671904+0000","last_fullsized":"2023-10-14T18:51:18.671904+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.682538+0000","last_change":"2023-10-14T18:51:17.670915+0000","last_active":"2023-10-14T18:51:18.682538+0000","last_peered":"2023-10-14T18:51:18.682538+0000","last_clean":"2023-10-14T18:51:18.682538+0000","last_became_active":"2023-10-14T18:51:17.670661+0000","last_became_peered":"2023-10-14T18:51:17.670661+0000","last_unstale":"2023-10-14T18:51:18.682538+0000","last_undegraded":"2023-10-14T18:51:18.682538+0000","last_fullsized":"2023-10-14T18:51:18.682538+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:45.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.668374+0000","last_change":"2023-10-14T18:51:18.668374+0000","last_active":"2023-10-14T18:51:18.668374+0000","last_peered":"2023-10-14T18:51:18.668374+0000","last_clean":"2023-10-14T18:51:18.668374+0000","last_became_active":"2023-10-14T18:51:18.667950+0000","last_became_peered":"2023-10-14T18:51:18.667950+0000","last_unstale":"2023-10-14T18:51:18.668374+0000","last_undegraded":"2023-10-14T18:51:18.668374+0000","last_fullsized":"2023-10-14T18:51:18.668374+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:35:20.816672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.669117+0000","last_change":"2023-10-14T18:51:17.668618+0000","last_active":"2023-10-14T18:51:17.669117+0000","last_peered":"2023-10-14T18:51:17.669117+0000","last_clean":"2023-10-14T18:51:17.669117+0000","last_became_active":"2023-10-14T18:51:17.668304+0000","last_became_peered":"2023-10-14T18:51:17.668304+0000","last_unstale":"2023-10-14T18:51:17.669117+0000","last_undegraded":"2023-10-14T18:51:17.669117+0000","last_fullsized":"2023-10-14T18:51:17.669117+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:52:22.427964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.670211+0000","last_change":"2023-10-14T18:51:18.670211+0000","last_active":"2023-10-14T18:51:18.670211+0000","last_peered":"2023-10-14T18:51:18.670211+0000","last_clean":"2023-10-14T18:51:18.670211+0000","last_became_active":"2023-10-14T18:51:18.669706+0000","last_became_peered":"2023-10-14T18:51:18.669706+0000","last_unstale":"2023-10-14T18:51:18.670211+0000","last_undegraded":"2023-10-14T18:51:18.670211+0000","last_fullsized":"2023-10-14T18:51:18.670211+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:57:36.059016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.673322+0000","last_change":"2023-10-14T18:51:17.673088+0000","last_active":"2023-10-14T18:51:17.673322+0000","last_peered":"2023-10-14T18:51:17.673322+0000","last_clean":"2023-10-14T18:51:17.673322+0000","last_became_active":"2023-10-14T18:51:17.671506+0000","last_became_peered":"2023-10-14T18:51:17.671506+0000","last_unstale":"2023-10-14T18:51:17.673322+0000","last_undegraded":"2023-10-14T18:51:17.673322+0000","last_fullsized":"2023-10-14T18:51:17.673322+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:43.952171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.676025+0000","last_change":"2023-10-14T18:51:18.676025+0000","last_active":"2023-10-14T18:51:18.676025+0000","last_peered":"2023-10-14T18:51:18.676025+0000","last_clean":"2023-10-14T18:51:18.676025+0000","last_became_active":"2023-10-14T18:51:18.675735+0000","last_became_peered":"2023-10-14T18:51:18.675735+0000","last_unstale":"2023-10-14T18:51:18.676025+0000","last_undegraded":"2023-10-14T18:51:18.676025+0000","last_fullsized":"2023-10-14T18:51:18.676025+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:18.511059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.669052+0000","last_change":"2023-10-14T18:51:17.668992+0000","last_active":"2023-10-14T18:51:17.669052+0000","last_peered":"2023-10-14T18:51:17.669052+0000","last_clean":"2023-10-14T18:51:17.669052+0000","last_became_active":"2023-10-14T18:51:17.668736+0000","last_became_peered":"2023-10-14T18:51:17.668736+0000","last_unstale":"2023-10-14T18:51:17.669052+0000","last_undegraded":"2023-10-14T18:51:17.669052+0000","last_fullsized":"2023-10-14T18:51:17.669052+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:17.384549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.671944+0000","last_change":"2023-10-14T18:51:18.671944+0000","last_active":"2023-10-14T18:51:18.671944+0000","last_peered":"2023-10-14T18:51:18.671944+0000","last_clean":"2023-10-14T18:51:18.671944+0000","last_became_active":"2023-10-14T18:51:18.671078+0000","last_became_peered":"2023-10-14T18:51:18.671078+0000","last_unstale":"2023-10-14T18:51:18.671944+0000","last_undegraded":"2023-10-14T18:51:18.671944+0000","last_fullsized":"2023-10-14T18:51:18.671944+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:14:43.320484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.670951+0000","last_change":"2023-10-14T18:51:17.670846+0000","last_active":"2023-10-14T18:51:17.670951+0000","last_peered":"2023-10-14T18:51:17.670951+0000","last_clean":"2023-10-14T18:51:17.670951+0000","last_became_active":"2023-10-14T18:51:17.670610+0000","last_became_peered":"2023-10-14T18:51:17.670610+0000","last_unstale":"2023-10-14T18:51:17.670951+0000","last_undegraded":"2023-10-14T18:51:17.670951+0000","last_fullsized":"2023-10-14T18:51:17.670951+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:50:13.832244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666269+0000","last_change":"2023-10-14T18:51:18.666269+0000","last_active":"2023-10-14T18:51:18.666269+0000","last_peered":"2023-10-14T18:51:18.666269+0000","last_clean":"2023-10-14T18:51:18.666269+0000","last_became_active":"2023-10-14T18:51:18.666043+0000","last_became_peered":"2023-10-14T18:51:18.666043+0000","last_unstale":"2023-10-14T18:51:18.666269+0000","last_undegraded":"2023-10-14T18:51:18.666269+0000","last_fullsized":"2023-10-14T18:51:18.666269+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:35:39.996951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.674876+0000","last_change":"2023-10-14T18:51:17.674823+0000","last_active":"2023-10-14T18:51:17.674876+0000","last_peered":"2023-10-14T18:51:17.674876+0000","last_clean":"2023-10-14T18:51:17.674876+0000","last_became_active":"2023-10-14T18:51:17.674685+0000","last_became_peered":"2023-10-14T18:51:17.674685+0000","last_unstale":"2023-10-14T18:51:17.674876+0000","last_undegraded":"2023-10-14T18:51:17.674876+0000","last_fullsized":"2023-10-14T18:51:17.674876+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:19:45.451104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.674412+0000","last_change":"2023-10-14T18:51:18.674412+0000","last_active":"2023-10-14T18:51:18.674412+0000","last_peered":"2023-10-14T18:51:18.674412+0000","last_clean":"2023-10-14T18:51:18.674412+0000","last_became_active":"2023-10-14T18:51:18.673846+0000","last_became_peered":"2023-10-14T18:51:18.673846+0000","last_unstale":"2023-10-14T18:51:18.674412+0000","last_undegraded":"2023-10-14T18:51:18.674412+0000","last_fullsized":"2023-10-14T18:51:18.674412+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:43:49.262984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672298+0000","last_change":"2023-10-14T18:51:17.672239+0000","last_active":"2023-10-14T18:51:17.672298+0000","last_peered":"2023-10-14T18:51:17.672298+0000","last_clean":"2023-10-14T18:51:17.672298+0000","last_became_active":"2023-10-14T18:51:17.671746+0000","last_became_peered":"2023-10-14T18:51:17.671746+0000","last_unstale":"2023-10-14T18:51:17.672298+0000","last_undegraded":"2023-10-14T18:51:17.672298+0000","last_fullsized":"2023-10-14T18:51:17.672298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:21.689116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.666412+0000","last_change":"2023-10-14T18:51:18.666412+0000","last_active":"2023-10-14T18:51:18.666412+0000","last_peered":"2023-10-14T18:51:18.666412+0000","last_clean":"2023-10-14T18:51:18.666412+0000","last_became_active":"2023-10-14T18:51:18.666200+0000","last_became_peered":"2023-10-14T18:51:18.666200+0000","last_unstale":"2023-10-14T18:51:18.666412+0000","last_undegraded":"2023-10-14T18:51:18.666412+0000","last_fullsized":"2023-10-14T18:51:18.666412+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:20:42.936110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.673055+0000","last_change":"2023-10-14T18:51:17.672943+0000","last_active":"2023-10-14T18:51:17.673055+0000","last_peered":"2023-10-14T18:51:17.673055+0000","last_clean":"2023-10-14T18:51:17.673055+0000","last_became_active":"2023-10-14T18:51:17.671180+0000","last_became_peered":"2023-10-14T18:51:17.671180+0000","last_unstale":"2023-10-14T18:51:17.673055+0000","last_undegraded":"2023-10-14T18:51:17.673055+0000","last_fullsized":"2023-10-14T18:51:17.673055+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:04.647938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-14T18:51:18.672945+0000","last_change":"2023-10-14T18:51:18.672945+0000","last_active":"2023-10-14T18:51:18.672945+0000","last_peered":"2023-10-14T18:51:18.672945+0000","last_clean":"2023-10-14T18:51:18.672945+0000","last_became_active":"2023-10-14T18:51:18.672196+0000","last_became_peered":"2023-10-14T18:51:18.672196+0000","last_unstale":"2023-10-14T18:51:18.672945+0000","last_undegraded":"2023-10-14T18:51:18.672945+0000","last_fullsized":"2023-10-14T18:51:18.672945+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:17.651374+0000","last_clean_scrub_stamp":"2023-10-14T18:51:17.651374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:50:05.980414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.672647+0000","last_change":"2023-10-14T18:51:17.672611+0000","last_active":"2023-10-14T18:51:17.672647+0000","last_peered":"2023-10-14T18:51:17.672647+0000","last_clean":"2023-10-14T18:51:17.672647+0000","last_became_active":"2023-10-14T18:51:17.672361+0000","last_became_peered":"2023-10-14T18:51:17.672361+0000","last_unstale":"2023-10-14T18:51:17.672647+0000","last_undegraded":"2023-10-14T18:51:17.672647+0000","last_fullsized":"2023-10-14T18:51:17.672647+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:51:16.645700+0000","last_clean_scrub_stamp":"2023-10-14T18:51:16.645700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:13:30.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":280,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-14T18:51:17.661711+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:51:17.661711+0000","last_peered":"2023-10-14T18:51:17.661711+0000","last_clean":"2023-10-14T18:51:17.661711+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:51:17.661711+0000","last_undegraded":"2023-10-14T18:51:17.661711+0000","last_fullsized":"2023-10-14T18:51:17.661711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193998,"statfs":{"total":200000000,"available":198654685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66600000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57499999999999996}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52200000000000002,"15min":0.626},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":3.8580000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.89800000000000002},"last":0.629},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68600000000000005,"5min":0.83999999999999997,"15min":7.8129999999999997},"last":0.496}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.377,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.83899999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46600000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.501},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"max":{"1min":0.80500000000000005,"5min":0.877,"15min":0.95699999999999996},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245571,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.67500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.76100000000000001,"15min":0.76300000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.76000000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":3.4489999999999998},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.83599999999999997},"last":0.435},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":9.5779999999999994},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.68300000000000005,"15min":0.84099999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68300000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.504}]},{"osd":5,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46300000000000002,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78600000000000003},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.78500000000000003,"15min":0.89700000000000002},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245517,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.40799999999999997,"5min":0.60799999999999998,"15min":1.0900000000000001},"last":0.31},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.56399999999999995,"15min":0.90700000000000003},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.39200000000000002,"5min":0.60299999999999998,"15min":0.89100000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35599999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.46800000000000003,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.72099999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.44400000000000001,"5min":0.66000000000000003,"15min":10.574},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.93899999999999995},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.88200000000000001,"15min":0.96499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.66200000000000003,"5min":0.85399999999999998,"15min":0.92200000000000004},"last":0.624}]},{"osd":6,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.90800000000000003,"15min":0.94699999999999995},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1305,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194006,"statfs":{"total":200000000,"available":198663047,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34699999999999998,"15min":0.33600000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.432,"5min":0.623,"15min":0.623},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.29599999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.46000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.28499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35699999999999998,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58199999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.373}]},{"osd":5,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.01},"last":0.38100000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.435}]},{"osd":7,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.879,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.42699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48299999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.49199999999999999,"5min":0.61499999999999999,"15min":0.67200000000000004},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.379,"15min":0.39200000000000002},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.54400000000000004,"5min":0.70199999999999996,"15min":0.78900000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.54900000000000004,"5min":1.006,"15min":1.006},"last":0.312},{"interface":"front","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.35199999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66300000000000003,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.45400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.77800000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":738,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244035,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.44400000000000001,"5min":0.50700000000000001,"15min":0.68100000000000005},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.33300000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.222,"15min":0.222},"max":{"1min":0.47999999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.379,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.60499999999999998,"15min":0.64600000000000002},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51300000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29599999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.495,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91200000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.56100000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78300000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83099999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":736,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245641,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.44}]},{"osd":1,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.497},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56399999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.999,"15min":0.999},"last":0.316},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.33100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.371}]},{"osd":7,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.38500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194575,"statfs":{"total":200000000,"available":199245065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.40500000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67300000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68100000000000005,"5min":0.748,"15min":0.748},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38500000000000001},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.5,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.76200000000000001,"15min":0.92800000000000005},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.746},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63600000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:51:23.106 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:51:23.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:51:23.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.260+0000 7fbbc504d700 1 Processor -- start 2023-10-14T18:51:23.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.260+0000 7fbbc504d700 1 -- start start 2023-10-14T18:51:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbc0159ec0 0x7fbbc00af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 0x7fbbc006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc006af60 con 0x7fbbc0159ec0 2023-10-14T18:51:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc00b0790 con 0x7fbbc006a5a0 2023-10-14T18:51:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbc504d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00ce1f0 con 0x7fbbc015a290 2023-10-14T18:51:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbc0159ec0 0x7fbbc00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbc0159ec0 0x7fbbc00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35486/0 (socket says 172.21.15.79:35486) 2023-10-14T18:51:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 -- 172.21.15.79:0/4169088880 learned_addr learned my addr 172.21.15.79:0/4169088880 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbe59c700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbf59e700 1 --2- 172.21.15.79:0/4169088880 >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 0x7fbbc006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 -- 172.21.15.79:0/4169088880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 msgr2=0x7fbbc00afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 -- 172.21.15.79:0/4169088880 >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 msgr2=0x7fbbc006aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/4169088880 >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 0x7fbbc006aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 -- 172.21.15.79:0/4169088880 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00b0b20 con 0x7fbbc0159ec0 2023-10-14T18:51:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbe59c700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbf59e700 1 --2- 172.21.15.79:0/4169088880 >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 0x7fbbc006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc0159ec0 0x7fbbc00af940 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b03c0 tx=0x7fbbb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a34d5627c796f48 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbdd9b700 1 -- 172.21.15.79:0/4169088880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800e070 con 0x7fbbc0159ec0 2023-10-14T18:51:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbdd9b700 1 -- 172.21.15.79:0/4169088880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb800ba50 con 0x7fbbc0159ec0 2023-10-14T18:51:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.261+0000 7fbbbdd9b700 1 -- 172.21.15.79:0/4169088880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80092e0 con 0x7fbbc0159ec0 2023-10-14T18:51:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 -- 172.21.15.79:0/4169088880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc0159ec0 msgr2=0x7fbbc00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc0159ec0 0x7fbbc00af940 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b03c0 tx=0x7fbbb8009840 comp rx=0 tx=0).stop 2023-10-14T18:51:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 -- 172.21.15.79:0/4169088880 shutdown_connections 2023-10-14T18:51:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 --2- 172.21.15.79:0/4169088880 >> v2:172.21.15.144:3300/0 conn(0x7fbbc006a5a0 0x7fbbc006aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc0159ec0 0x7fbbc00af940 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 --2- 172.21.15.79:0/4169088880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 -- 172.21.15.79:0/4169088880 >> 172.21.15.79:0/4169088880 conn(0x7fbbc00d1880 msgr2=0x7fbbc00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 -- 172.21.15.79:0/4169088880 shutdown_connections 2023-10-14T18:51:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.262+0000 7fbbc504d700 1 -- 172.21.15.79:0/4169088880 wait complete. 2023-10-14T18:51:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.263+0000 7fbbc504d700 1 Processor -- start 2023-10-14T18:51:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.263+0000 7fbbc504d700 1 -- start start 2023-10-14T18:51:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbc0159ec0 0x7fbbc0147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc015ca30 con 0x7fbbc006a5a0 2023-10-14T18:51:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00b4430 con 0x7fbbc0159ec0 2023-10-14T18:51:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbc504d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0147d80 con 0x7fbbc015a290 2023-10-14T18:51:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35490/0 (socket says 172.21.15.79:35490) 2023-10-14T18:51:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 -- 172.21.15.79:0/2406194601 learned_addr learned my addr 172.21.15.79:0/2406194601 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbe59c700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbc0159ec0 0x7fbbc0147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbf59e700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 -- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 msgr2=0x7fbbc00b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 -- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbc0159ec0 msgr2=0x7fbbc0147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbc0159ec0 0x7fbbc0147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 -- 172.21.15.79:0/2406194601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8009ae0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbbbed9d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009880 tx=0x7fbbb8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.264+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8008930 con 0x7fbbc006a5a0 2023-10-14T18:51:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.265+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8008ab0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.265+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc00c81d0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.265+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8008e70 con 0x7fbbc006a5a0 2023-10-14T18:51:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.265+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc00c8790 con 0x7fbbc006a5a0 2023-10-14T18:51:23.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.266+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc004c3c0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.266+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbb8003040 con 0x7fbbc006a5a0 2023-10-14T18:51:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.266+0000 7fbba6ffd700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.267+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbb8086250 con 0x7fbbc006a5a0 2023-10-14T18:51:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.267+0000 7fbbbe59c700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.267+0000 7fbbbe59c700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0064800 tx=0x7fbbb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.271+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbb80534c0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.525+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbbc00b04b0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.529+0000 7fbba6ffd700 1 -- 172.21.15.79:0/2406194601 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbbb8056ae0 con 0x7fbbc006a5a0 2023-10-14T18:51:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 msgr2=0x7fbbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0064800 tx=0x7fbbb4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:23.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 msgr2=0x7fbbc015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009880 tx=0x7fbbb8018000 comp rx=0 tx=0).stop 2023-10-14T18:51:23.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 shutdown_connections 2023-10-14T18:51:23.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbbc015a290 0x7fbbc00b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbc006a5a0 0x7fbbc015c4f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 --2- 172.21.15.79:0/2406194601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbc0159ec0 0x7fbbc0147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 >> 172.21.15.79:0/2406194601 conn(0x7fbbc00d1880 msgr2=0x7fbbc0153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:23.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 shutdown_connections 2023-10-14T18:51:23.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.531+0000 7fbbc504d700 1 -- 172.21.15.79:0/2406194601 wait complete. 2023-10-14T18:51:23.536 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:51:23.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.657+0000 7f7085a04700 1 Processor -- start 2023-10-14T18:51:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.657+0000 7f7085a04700 1 -- start start 2023-10-14T18:51:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085a04700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f70800cd6e0 0x7f70800cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085a04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f708015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085a04700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70800cb7c0 con 0x7f70800cdab0 2023-10-14T18:51:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085a04700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708015e850 con 0x7f70800cd6e0 2023-10-14T18:51:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085a04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800cd030 con 0x7f708015cbd0 2023-10-14T18:51:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7077fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f70800cdab0 0x7f708015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35268/0 (socket says 172.21.15.79:35268) 2023-10-14T18:51:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7077fff700 1 -- 172.21.15.79:0/2196604767 learned_addr learned my addr 172.21.15.79:0/2196604767 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7084a02700 1 --2- 172.21.15.79:0/2196604767 >> v2:172.21.15.79:3300/0 conn(0x7f70800cd6e0 0x7f70800cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722566990 0 0) 0x7f70800cb7c0 con 0x7f70800cdab0 2023-10-14T18:51:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f7085203700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f708015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.658+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7068003570 con 0x7f70800cdab0 2023-10-14T18:51:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432141604 0 0) 0x7f7068003570 con 0x7f70800cdab0 2023-10-14T18:51:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f7084a02700 1 -- 172.21.15.79:0/2196604767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 msgr2=0x7f708015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f7084a02700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f708015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f7084a02700 1 -- 172.21.15.79:0/2196604767 >> v1:172.21.15.79:6789/0 conn(0x7f70800cdab0 legacy=0x7f708015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f7084a02700 1 -- 172.21.15.79:0/2196604767 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708015e290 con 0x7f70800cd6e0 2023-10-14T18:51:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f7084a02700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cd6e0 0x7f70800cbc50 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f707c0098e0 tx=0x7f707c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8825956a96bca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070001470 con 0x7f70800cd6e0 2023-10-14T18:51:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c011420 con 0x7f70800cd6e0 2023-10-14T18:51:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.659+0000 7f70777fe700 1 -- 172.21.15.79:0/2196604767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0117a0 con 0x7f70800cd6e0 2023-10-14T18:51:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 -- 172.21.15.79:0/2196604767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cd6e0 msgr2=0x7f70800cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cd6e0 0x7f70800cbc50 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f707c0098e0 tx=0x7f707c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 -- 172.21.15.79:0/2196604767 shutdown_connections 2023-10-14T18:51:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f708015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 --2- 172.21.15.79:0/2196604767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cd6e0 0x7f70800cbc50 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 -- 172.21.15.79:0/2196604767 >> 172.21.15.79:0/2196604767 conn(0x7f7080067660 msgr2=0x7f7080067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 -- 172.21.15.79:0/2196604767 shutdown_connections 2023-10-14T18:51:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.660+0000 7f7085a04700 1 -- 172.21.15.79:0/2196604767 wait complete. 2023-10-14T18:51:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.661+0000 7f7085a04700 1 Processor -- start 2023-10-14T18:51:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.661+0000 7f7085a04700 1 -- start start 2023-10-14T18:51:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70800cd6e0 0x7f708016b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f7080158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708016a6a0 con 0x7f70800cdab0 2023-10-14T18:51:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708016a980 con 0x7f70800cd6e0 2023-10-14T18:51:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708016ac60 con 0x7f708015cbd0 2023-10-14T18:51:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35510/0 (socket says 172.21.15.79:35510) 2023-10-14T18:51:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 -- 172.21.15.79:0/891084677 learned_addr learned my addr 172.21.15.79:0/891084677 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085203700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f7080158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7084a02700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70800cd6e0 0x7f708016b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 -- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 msgr2=0x7f7080158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f7080158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 -- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70800cd6e0 msgr2=0x7f708016b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70800cd6e0 0x7f708016b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 -- 172.21.15.79:0/891084677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c009420 con 0x7f70800cdab0 2023-10-14T18:51:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7077fff700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f707000cb90 tx=0x7f7070001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070001d60 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7070007360 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070007700 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.662+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708016af40 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.663+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708016d3e0 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.663+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7080089280 con 0x7f70800cdab0 2023-10-14T18:51:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.664+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7070004a40 con 0x7f70800cdab0 2023-10-14T18:51:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.664+0000 7f7074ff9700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 0x7f706c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.664+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7070083d90 con 0x7f70800cdab0 2023-10-14T18:51:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.664+0000 7f7084a02700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 0x7f706c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.665+0000 7f7084a02700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 0x7f706c0693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f707c0091e0 tx=0x7f707c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.668+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7070051080 con 0x7f70800cdab0 2023-10-14T18:51:23.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.896+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f708015e570 con 0x7f70800cdab0 2023-10-14T18:51:23.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.897+0000 7f7074ff9700 1 -- 172.21.15.79:0/891084677 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f7070018020 con 0x7f70800cdab0 2023-10-14T18:51:23.899 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:23.899 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:23.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 msgr2=0x7f706c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 0x7f706c0693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f707c0091e0 tx=0x7f707c016000 comp rx=0 tx=0).stop 2023-10-14T18:51:23.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 msgr2=0x7f708016cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:23.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f707000cb90 tx=0x7f7070001ad0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 shutdown_connections 2023-10-14T18:51:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f706c066f30 0x7f706c0693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f708015cbd0 0x7f7080158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70800cd6e0 0x7f708016b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 --2- 172.21.15.79:0/891084677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70800cdab0 0x7f708016cea0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 >> 172.21.15.79:0/891084677 conn(0x7f7080067660 msgr2=0x7f70800d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:23.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 shutdown_connections 2023-10-14T18:51:23.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:23.899+0000 7f7085a04700 1 -- 172.21.15.79:0/891084677 wait complete. 2023-10-14T18:51:23.903 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:23.952 INFO:tasks.ceph.mds.a.smithi079.stderr:2023-10-14T18:51:23.950+0000 7ffaa3d9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:51:24.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:51:18.040958+0000', 'modified': '2023-10-14T18:51:21.690362+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7101}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7101': {'gid': 7101, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/2840925690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 2840925690}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 2840925690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:51:24.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:51:24.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T18:51:24.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.435+0000 7ff2d3540700 1 Processor -- start 2023-10-14T18:51:24.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.435+0000 7ff2d3540700 1 -- start start 2023-10-14T18:51:24.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d3540700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2cc157870 0x7ff2cc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d3540700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2cc157c40 0x7ff2cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d3540700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc15cbb0 con 0x7ff2cc15a620 2023-10-14T18:51:24.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d3540700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc15bfa0 con 0x7ff2cc157870 2023-10-14T18:51:24.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d3540700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc15c280 con 0x7ff2cc157c40 2023-10-14T18:51:24.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d12dc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2cc157870 0x7ff2cc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d0adb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff2cc15a620 0x7ff2cc15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35284/0 (socket says 172.21.15.79:35284) 2023-10-14T18:51:24.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2877959012 learned_addr learned my addr 172.21.15.79:0/2877959012 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:24.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d1add700 1 --2- 172.21.15.79:0/2877959012 >> v2:172.21.15.144:3300/0 conn(0x7ff2cc157c40 0x7ff2cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2877959012 >> v2:172.21.15.144:3300/0 conn(0x7ff2cc157c40 msgr2=0x7ff2cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.436+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2877959012 >> v2:172.21.15.144:3300/0 conn(0x7ff2cc157c40 0x7ff2cc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2877959012 >> v1:172.21.15.79:6789/0 conn(0x7ff2cc15a620 legacy=0x7ff2cc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2c3fff700 1 -- 172.21.15.79:0/2877959012 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736033742 0 0) 0x7ff2cc15cbb0 con 0x7ff2cc15a620 2023-10-14T18:51:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2877959012 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc15c560 con 0x7ff2cc157870 2023-10-14T18:51:24.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2877959012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157870 0x7ff2cc15b6a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b4e0 tx=0x7ff2c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5f06fde80c603a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2c3fff700 1 -- 172.21.15.79:0/2877959012 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800e070 con 0x7ff2cc157870 2023-10-14T18:51:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2c3fff700 1 -- 172.21.15.79:0/2877959012 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800bc30 con 0x7ff2cc157870 2023-10-14T18:51:24.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2c3fff700 1 -- 172.21.15.79:0/2877959012 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8012430 con 0x7ff2cc157870 2023-10-14T18:51:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 -- 172.21.15.79:0/2877959012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157870 msgr2=0x7ff2cc15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2877959012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157870 0x7ff2cc15b6a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b4e0 tx=0x7ff2c8009780 comp rx=0 tx=0).stop 2023-10-14T18:51:24.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 -- 172.21.15.79:0/2877959012 shutdown_connections 2023-10-14T18:51:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2877959012 >> v2:172.21.15.144:3300/0 conn(0x7ff2cc157c40 0x7ff2cc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2877959012 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157870 0x7ff2cc15b6a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 -- 172.21.15.79:0/2877959012 >> 172.21.15.79:0/2877959012 conn(0x7ff2cc068ce0 msgr2=0x7ff2cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 -- 172.21.15.79:0/2877959012 shutdown_connections 2023-10-14T18:51:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.437+0000 7ff2d3540700 1 -- 172.21.15.79:0/2877959012 wait complete. 2023-10-14T18:51:24.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.438+0000 7ff2d3540700 1 Processor -- start 2023-10-14T18:51:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 -- start start 2023-10-14T18:51:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc157870 0x7ff2cc148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2cc15a620 0x7ff2cc16a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c5b10 con 0x7ff2cc157c40 2023-10-14T18:51:24.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc148590 con 0x7ff2cc157870 2023-10-14T18:51:24.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.439+0000 7ff2d3540700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c7830 con 0x7ff2cc15a620 2023-10-14T18:51:24.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35536/0 (socket says 172.21.15.79:35536) 2023-10-14T18:51:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2083716866 learned_addr learned my addr 172.21.15.79:0/2083716866 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc157870 0x7ff2cc148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d1add700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2cc15a620 0x7ff2cc16a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2cc15a620 msgr2=0x7ff2cc16a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2cc15a620 0x7ff2cc16a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc157870 msgr2=0x7ff2cc148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc157870 0x7ff2cc148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2083716866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c8009a20 con 0x7ff2cc157c40 2023-10-14T18:51:24.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c5e0 tx=0x7ff2bc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2c17fa700 1 -- 172.21.15.79:0/2083716866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc005b30 con 0x7ff2cc157c40 2023-10-14T18:51:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2c17fa700 1 -- 172.21.15.79:0/2083716866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc005c90 con 0x7ff2cc157c40 2023-10-14T18:51:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc0c5db0 con 0x7ff2cc157c40 2023-10-14T18:51:24.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2c17fa700 1 -- 172.21.15.79:0/2083716866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc007300 con 0x7ff2cc157c40 2023-10-14T18:51:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.440+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc148b00 con 0x7ff2cc157c40 2023-10-14T18:51:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.441+0000 7ff2c17fa700 1 -- 172.21.15.79:0/2083716866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2bc01b3b0 con 0x7ff2cc157c40 2023-10-14T18:51:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.442+0000 7ff2c17fa700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 0x7ff2b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.442+0000 7ff2c17fa700 1 -- 172.21.15.79:0/2083716866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2bc083a70 con 0x7ff2cc157c40 2023-10-14T18:51:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.442+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 0x7ff2b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.443+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 0x7ff2b00693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b4e0 tx=0x7ff2c8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.444+0000 7ff2dc839b80 1 Processor -- start 2023-10-14T18:51:24.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.444+0000 7ff2dc839b80 1 -- start start 2023-10-14T18:51:24.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.444+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cbae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.444+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759cb6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759c11a70 con 0x561759d04d00 2023-10-14T18:51:24.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759c0f270 con 0x561759ce3f60 2023-10-14T18:51:24.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x561759c0b060 con 0x561759cbaa50 2023-10-14T18:51:24.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35546/0 (socket says 172.21.15.79:35546) 2023-10-14T18:51:24.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2175871254 learned_addr learned my addr 172.21.15.79:0/2175871254 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cbae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d1add700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759cb6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 msgr2=0x561759cbae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cbae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 msgr2=0x561759cb6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759cb6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 -- 172.21.15.79:0/2175871254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561759aa5270 con 0x561759d04d00 2023-10-14T18:51:24.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cbae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d1add700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759cb6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:24.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0550a0 tx=0x7ff2bc081ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dede274c1a669b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2b67fc700 1 -- 172.21.15.79:0/2175871254 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc057bf0 con 0x561759d04d00 2023-10-14T18:51:24.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2b67fc700 1 -- 172.21.15.79:0/2175871254 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc05b940 con 0x561759d04d00 2023-10-14T18:51:24.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.445+0000 7ff2b67fc700 1 -- 172.21.15.79:0/2175871254 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc005e00 con 0x561759d04d00 2023-10-14T18:51:24.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2175871254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 msgr2=0x561759ce3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0550a0 tx=0x7ff2bc081ef0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2175871254 shutdown_connections 2023-10-14T18:51:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759cb6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cbae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2175871254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759ce3a20 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2175871254 >> 172.21.15.79:0/2175871254 conn(0x561759cbc370 msgr2=0x561759cbc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2175871254 shutdown_connections 2023-10-14T18:51:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2175871254 wait complete. 2023-10-14T18:51:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.446+0000 7ff2dc839b80 1 -- start start 2023-10-14T18:51:24.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 Processor -- start 2023-10-14T18:51:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759ce0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759d01b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759bb6890 con 0x561759d04d00 2023-10-14T18:51:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759bd1ea0 con 0x561759ce3f60 2023-10-14T18:51:24.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x561759a8de30 con 0x561759cbaa50 2023-10-14T18:51:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2dc839b80 10 client.0 _ll_register_callbacks cb 0x561759c7e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:51:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2d1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2d1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35560/0 (socket says 172.21.15.79:35560) 2023-10-14T18:51:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.447+0000 7ff2d1add700 1 -- 172.21.15.79:0/1431866979 learned_addr learned my addr 172.21.15.79:0/1431866979 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759ce0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759d01b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 -- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 msgr2=0x561759ce0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759ce0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 -- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 msgr2=0x561759d01b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759d01b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 -- 172.21.15.79:0/1431866979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc148b00 con 0x561759d04d00 2023-10-14T18:51:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400dfa0 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abf6d8450626d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:51:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400fe20 con 0x561759d04d00 2023-10-14T18:51:24.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2c4014480 con 0x561759d04d00 2023-10-14T18:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561759cafb70 con 0x561759d04d00 2023-10-14T18:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2c4014850 con 0x561759d04d00 2023-10-14T18:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 10 client.7242 fetch_fsmap learned FSMap version 64 2023-10-14T18:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x561759a47fe0 con 0x561759d04d00 2023-10-14T18:51:24.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561759cafb70 con 0x561759d04d00 2023-10-14T18:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2c40149b0 con 0x561759d04d00 2023-10-14T18:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 10 client.7242 fetch_fsmap finished waiting for FSMap version 64 2023-10-14T18:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 10 client.7242 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 20 client.7242 populate_metadata read hostname 'smithi079' 2023-10-14T18:51:24.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d14cb0 0x561759d15080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 4 client.7242 mds_command: new command op to 7101 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 --> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561759c8caa0 con 0x561759d14cb0 2023-10-14T18:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.448+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d14cb0 0x561759d15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2ab7fe700 10 client.7242 ms_handle_connect on v2:172.21.15.79:6833/2840925690 2023-10-14T18:51:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d14cb0 0x561759d15080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2045d3b9121906 server_cookie=c215bef0bb019a97 in_seq=0 out_seq=0 2023-10-14T18:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/1431866979 <== mds.0 v2:172.21.15.79:6833/2840925690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561759c8caa0 con 0x561759d14cb0 2023-10-14T18:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2ab7fe700 10 client.7242 handle_command_reply: tid=0 2023-10-14T18:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 client.7242 shutdown 2023-10-14T18:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 msgr2=0x561759cfae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400dfa0 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 shutdown_connections 2023-10-14T18:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d14cb0 0x561759d15080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759d04d00 0x561759cfae70 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759ce0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2ab7fe700 0 client.7242 ms_handle_reset on v2:172.21.15.79:6833/2840925690 2023-10-14T18:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1431866979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759ce3f60 0x561759d01b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.449+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 >> 172.21.15.79:0/1431866979 conn(0x561759cbc370 msgr2=0x561759cb7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.450+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 shutdown_connections 2023-10-14T18:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.450+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1431866979 wait complete. 2023-10-14T18:51:24.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.450+0000 7ff2dc839b80 20 client.7242 trim_cache size 0 max 16384 2023-10-14T18:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.466+0000 7ff2dc839b80 1 Processor -- start 2023-10-14T18:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.466+0000 7ff2dc839b80 1 -- start start 2023-10-14T18:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759c9a5b0 con 0x561759ce3f60 2023-10-14T18:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759cb9910 con 0x561759cbc370 2023-10-14T18:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x561759d00130 con 0x561759cbaa50 2023-10-14T18:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35570/0 (socket says 172.21.15.79:35570) 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 -- 172.21.15.79:0/1446639573 learned_addr learned my addr 172.21.15.79:0/1446639573 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 -- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 msgr2=0x561759cb70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cb70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 -- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 msgr2=0x561759cb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cb6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 -- 172.21.15.79:0/1446639573 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561759cb88b0 con 0x561759ce3f60 2023-10-14T18:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.467+0000 7ff2d1add700 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e010 tx=0x7ff2c4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e35f8c219e632d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2b6ffd700 1 -- 172.21.15.79:0/1446639573 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400d400 con 0x561759ce3f60 2023-10-14T18:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2b6ffd700 1 -- 172.21.15.79:0/1446639573 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400c030 con 0x561759ce3f60 2023-10-14T18:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2b6ffd700 1 -- 172.21.15.79:0/1446639573 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4000bc0 con 0x561759ce3f60 2023-10-14T18:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1446639573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 msgr2=0x561759cb5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400e010 tx=0x7ff2c4020000 comp rx=0 tx=0).stop 2023-10-14T18:51:24.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1446639573 shutdown_connections 2023-10-14T18:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/1446639573 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759cbaa50 0x561759cb70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1446639573 >> 172.21.15.79:0/1446639573 conn(0x561759d02530 msgr2=0x561759cbc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1446639573 shutdown_connections 2023-10-14T18:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.468+0000 7ff2dc839b80 1 -- 172.21.15.79:0/1446639573 wait complete. 2023-10-14T18:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.469+0000 7ff2dc839b80 1 -- start start 2023-10-14T18:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.469+0000 7ff2dc839b80 1 Processor -- start 2023-10-14T18:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cfdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759d67ca0 con 0x561759cbaa50 2023-10-14T18:51:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759d149d0 con 0x561759cbc370 2023-10-14T18:51:24.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x561759cb6be0 con 0x561759ce3f60 2023-10-14T18:51:24.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 10 client.0 _ll_register_callbacks cb 0x561759c7e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:51:24.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35582/0 (socket says 172.21.15.79:35582) 2023-10-14T18:51:24.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2936711891 learned_addr learned my addr 172.21.15.79:0/2936711891 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d1add700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cfdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759ce3f60 msgr2=0x561759cb5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 msgr2=0x561759cfdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cfdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 -- 172.21.15.79:0/2936711891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561759a47fe0 con 0x561759cbaa50 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2d12dc700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8013000 tx=0x7ff2c8032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5c9a6995ca45fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8032070 con 0x561759cbaa50 2023-10-14T18:51:24.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2c801e630 con 0x561759cbaa50 2023-10-14T18:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2bc05b940 con 0x561759cbaa50 2023-10-14T18:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2c801ea00 con 0x561759cbaa50 2023-10-14T18:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 10 client.7248 fetch_fsmap learned FSMap version 64 2023-10-14T18:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.470+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x561759bd9780 con 0x561759cbaa50 2023-10-14T18:51:24.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc05b940 con 0x561759cbaa50 2023-10-14T18:51:24.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff2c801eb60 con 0x561759cbaa50 2023-10-14T18:51:24.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 10 client.7248 fetch_fsmap finished waiting for FSMap version 64 2023-10-14T18:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 10 client.7248 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T18:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 20 client.7248 populate_metadata read hostname 'smithi079' 2023-10-14T18:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d04d00 0x561759cb6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 4 client.7248 mds_command: new command op to 7101 tid=0[{"prefix": "status"}] 2023-10-14T18:51:24.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 --> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561759bade00 con 0x561759d04d00 2023-10-14T18:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d04d00 0x561759cb6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2ab7fe700 10 client.7248 ms_handle_connect on v2:172.21.15.79:6833/2840925690 2023-10-14T18:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2d0adb700 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d04d00 0x561759cb6160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a890b732c7b81e3 server_cookie=44f0e72f33f12de6 in_seq=0 out_seq=0 2023-10-14T18:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2ab7fe700 1 -- 172.21.15.79:0/2936711891 <== mds.0 v2:172.21.15.79:6833/2840925690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561759bade00 con 0x561759d04d00 2023-10-14T18:51:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2ab7fe700 10 client.7248 handle_command_reply: tid=0 2023-10-14T18:51:24.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 1 client.7248 shutdown 2023-10-14T18:51:24.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 msgr2=0x561759cfd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.471+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8013000 tx=0x7ff2c8032250 comp rx=0 tx=0).stop 2023-10-14T18:51:24.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 shutdown_connections 2023-10-14T18:51:24.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:6833/2840925690,v1:172.21.15.79:6835/2840925690] conn(0x561759d04d00 0x561759cb6160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x561759ce3f60 0x561759cb5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2ab7fe700 0 client.7248 ms_handle_reset on v2:172.21.15.79:6833/2840925690 2023-10-14T18:51:24.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561759cbaa50 0x561759cfd680 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 --2- 172.21.15.79:0/2936711891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759cbc370 0x561759cfdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 >> 172.21.15.79:0/2936711891 conn(0x561759d02530 msgr2=0x561759d00fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 shutdown_connections 2023-10-14T18:51:24.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 1 -- 172.21.15.79:0/2936711891 wait complete. 2023-10-14T18:51:24.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2dc839b80 20 client.7248 trim_cache size 0 max 16384 2023-10-14T18:51:24.527 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:51:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7101, 2023-10-14T18:51:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:51:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:51:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:51:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.7991682369999999, 2023-10-14T18:51:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 64, 2023-10-14T18:51:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 138, 2023-10-14T18:51:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 138, 2023-10-14T18:51:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 10.933604268 2023-10-14T18:51:24.529 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:24.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 msgr2=0x7ff2b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 0x7ff2b00693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06b4e0 tx=0x7ff2c8019000 comp rx=0 tx=0).stop 2023-10-14T18:51:24.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 msgr2=0x7ff2cc147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c5e0 tx=0x7ff2bc000fe0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 shutdown_connections 2023-10-14T18:51:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff2b0066f30 0x7ff2b00693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2cc15a620 0x7ff2cc16a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc157870 0x7ff2cc148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 --2- 172.21.15.79:0/2083716866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2cc157c40 0x7ff2cc147870 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 >> 172.21.15.79:0/2083716866 conn(0x7ff2cc068ce0 msgr2=0x7ff2cc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 shutdown_connections 2023-10-14T18:51:24.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.472+0000 7ff2d3540700 1 -- 172.21.15.79:0/2083716866 wait complete. 2023-10-14T18:51:24.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:51:24.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.647+0000 7feac9c9a700 1 Processor -- start 2023-10-14T18:51:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.647+0000 7feac9c9a700 1 -- start start 2023-10-14T18:51:24.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac9c9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feac415a620 0x7feac415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac9c9a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feac415d580 0x7feac4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac9c9a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac415cbb0 con 0x7feac4157870 2023-10-14T18:51:24.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac9c9a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac415bdb0 con 0x7feac415a620 2023-10-14T18:51:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac9c9a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac415bfa0 con 0x7feac415d580 2023-10-14T18:51:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feac415a620 0x7feac415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feac415a620 0x7feac415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35598/0 (socket says 172.21.15.79:35598) 2023-10-14T18:51:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 -- 172.21.15.79:0/1100270265 learned_addr learned my addr 172.21.15.79:0/1100270265 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac3fff700 1 --2- 172.21.15.79:0/1100270265 >> v2:172.21.15.144:3300/0 conn(0x7feac415d580 0x7feac4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 -- 172.21.15.79:0/1100270265 >> v2:172.21.15.144:3300/0 conn(0x7feac415d580 msgr2=0x7feac4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 --2- 172.21.15.79:0/1100270265 >> v2:172.21.15.144:3300/0 conn(0x7feac415d580 0x7feac4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 -- 172.21.15.79:0/1100270265 >> v1:172.21.15.144:6789/0 conn(0x7feac4157870 legacy=0x7feac415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 -- 172.21.15.79:0/1100270265 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac415c280 con 0x7feac415a620 2023-10-14T18:51:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac2ffd700 1 --2- 172.21.15.79:0/1100270265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415a620 0x7feac415d040 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7feac406b4e0 tx=0x7feaac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545bf5ab714d2334 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac27fc700 1 -- 172.21.15.79:0/1100270265 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac009e70 con 0x7feac415a620 2023-10-14T18:51:24.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac27fc700 1 -- 172.21.15.79:0/1100270265 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00b860 con 0x7feac415a620 2023-10-14T18:51:24.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.648+0000 7feac27fc700 1 -- 172.21.15.79:0/1100270265 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00bc00 con 0x7feac415a620 2023-10-14T18:51:24.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 -- 172.21.15.79:0/1100270265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415a620 msgr2=0x7feac415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 --2- 172.21.15.79:0/1100270265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415a620 0x7feac415d040 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7feac406b4e0 tx=0x7feaac009250 comp rx=0 tx=0).stop 2023-10-14T18:51:24.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 -- 172.21.15.79:0/1100270265 shutdown_connections 2023-10-14T18:51:24.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 --2- 172.21.15.79:0/1100270265 >> v2:172.21.15.144:3300/0 conn(0x7feac415d580 0x7feac4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 --2- 172.21.15.79:0/1100270265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415a620 0x7feac415d040 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 -- 172.21.15.79:0/1100270265 >> 172.21.15.79:0/1100270265 conn(0x7feac4068ce0 msgr2=0x7feac40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 -- 172.21.15.79:0/1100270265 shutdown_connections 2023-10-14T18:51:24.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.649+0000 7feac9c9a700 1 -- 172.21.15.79:0/1100270265 wait complete. 2023-10-14T18:51:24.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.650+0000 7feac9c9a700 1 Processor -- start 2023-10-14T18:51:24.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.650+0000 7feac9c9a700 1 -- start start 2023-10-14T18:51:24.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feac4157870 0x7feac40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac415a620 0x7feac40cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4152780 con 0x7feac415d580 2023-10-14T18:51:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4151eb0 con 0x7feac415a620 2023-10-14T18:51:24.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac9c9a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac40b1b20 con 0x7feac4157870 2023-10-14T18:51:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35610/0 (socket says 172.21.15.79:35610) 2023-10-14T18:51:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 -- 172.21.15.79:0/2859018581 learned_addr learned my addr 172.21.15.79:0/2859018581 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac37fe700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feac4157870 0x7feac40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac2ffd700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac415a620 0x7feac40cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 -- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feac4157870 msgr2=0x7feac40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feac4157870 0x7feac40b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 -- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac415a620 msgr2=0x7feac40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac415a620 0x7feac40cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 -- 172.21.15.79:0/2859018581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0094f0 con 0x7feac415d580 2023-10-14T18:51:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feac3fff700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7feab400e900 tx=0x7feab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4013680 con 0x7feac415d580 2023-10-14T18:51:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.651+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4013800 con 0x7feac415d580 2023-10-14T18:51:24.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.652+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac4152130 con 0x7feac415d580 2023-10-14T18:51:24.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.652+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4013bc0 con 0x7feac415d580 2023-10-14T18:51:24.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.652+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac40b17e0 con 0x7feac415d580 2023-10-14T18:51:24.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.652+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac41528f0 con 0x7feac415d580 2023-10-14T18:51:24.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.653+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feab40123d0 con 0x7feac415d580 2023-10-14T18:51:24.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.653+0000 7feabb7fe700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 0x7feaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:24.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.653+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feab4084710 con 0x7feac415d580 2023-10-14T18:51:24.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.654+0000 7feac37fe700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 0x7feaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:24.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.654+0000 7feac37fe700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 0x7feaa40693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feabc007fd0 tx=0x7feabc0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:24.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.658+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feab40518e0 con 0x7feac415d580 2023-10-14T18:51:24.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.886+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feac404c3c0 con 0x7feac415d580 2023-10-14T18:51:24.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.886+0000 7feabb7fe700 1 -- 172.21.15.79:0/2859018581 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7feab4054f00 con 0x7feac415d580 2023-10-14T18:51:24.888 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:51:24.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 msgr2=0x7feaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 0x7feaa40693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feabc007fd0 tx=0x7feabc0016f0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 msgr2=0x7feac414c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:24.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7feab400e900 tx=0x7feab40091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 shutdown_connections 2023-10-14T18:51:24.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feaa4066f30 0x7feaa40693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feac415d580 0x7feac414c440 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7feac4157870 0x7feac40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 --2- 172.21.15.79:0/2859018581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac415a620 0x7feac40cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:24.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 >> 172.21.15.79:0/2859018581 conn(0x7feac4068ce0 msgr2=0x7feac40b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:24.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 shutdown_connections 2023-10-14T18:51:24.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:24.888+0000 7feac9c9a700 1 -- 172.21.15.79:0/2859018581 wait complete. 2023-10-14T18:51:24.901 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:51:24.902 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:51:24.902 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:51:24.903 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:51:24.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:24.903 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:51:24.904 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:51:24.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:51:24.904 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:51:24.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:24.905 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:51:24.920 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:51:24.920 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:51:24.921 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:51:24.921 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.921 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:51:24.921 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.922 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:24.922 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:24.922 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:51:24.922 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:24.922 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:24.923 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:51:24.923 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:24.923 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:24.923 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:51:24.923 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:24.924 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:51:24.924 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42149sec preferred_lft 42149sec 2023-10-14T18:51:24.924 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:51:24.924 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.924 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:51:24.925 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:24.925 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:51:24.925 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.925 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:51:24.925 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.926 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:51:24.926 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:51:24.926 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:51:24.926 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.927 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:51:24.927 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:51:24.927 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:51:24.927 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:24.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:24.931 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:51:24.983 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:51:24.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:24.985 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:51:25.040 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:51:25.040 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:51:25.040 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:51:25.040 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:51:25.041 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:51:25.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.042 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:51:25.042 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:51:25.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:51:25.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:51:25.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:51:25.044 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:51:25.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.140 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:51:25.154 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:51:25.154 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:51:25.155 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:51:25.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:51:25.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:51:25.219 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:25.273 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:51:25.274 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:51:25.274 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:25.327 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:51:25.328 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:51:25.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:51:25.407 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:51:25.407 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:51:25.407 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:51:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:51:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:51:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:51:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:51:25.417 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:51:25.437 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:51:25.437 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:51:25.437 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:51:25.438 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:51:25.438 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:51:25.439 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:51:25.439 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:51:25.439 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:51:25.441 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:51:25.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:25.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:51:25.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 Processor -- start 2023-10-14T18:51:25.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 -- start start 2023-10-14T18:51:25.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c5415a620 0x7f5c5415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:25.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5415cbb0 con 0x7f5c5415d580 2023-10-14T18:51:25.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5415bfa0 con 0x7f5c54157870 2023-10-14T18:51:25.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.660+0000 7f5c5947e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5415bdb0 con 0x7f5c5415a620 2023-10-14T18:51:25.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c537fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5c5415d580 0x7f5c54158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35298/0 (socket says 172.21.15.79:35298) 2023-10-14T18:51:25.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c537fe700 1 -- 172.21.15.79:0/3163333924 learned_addr learned my addr 172.21.15.79:0/3163333924 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:25.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c4a7fc700 1 --2- 172.21.15.79:0/3163333924 >> v2:172.21.15.144:3300/0 conn(0x7f5c5415a620 0x7f5c5415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:25.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c527fc700 1 -- 172.21.15.79:0/3163333924 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33414170 0 0) 0x7f5c5415cbb0 con 0x7f5c5415d580 2023-10-14T18:51:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c527fc700 1 -- 172.21.15.79:0/3163333924 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c40003570 con 0x7f5c5415d580 2023-10-14T18:51:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3163333924 >> v1:172.21.15.144:6789/0 conn(0x7f5c54157870 legacy=0x7f5c5415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3163333924 >> v1:172.21.15.79:6789/0 conn(0x7f5c5415d580 legacy=0x7f5c54158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3163333924 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5415c280 con 0x7f5c5415a620 2023-10-14T18:51:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c4a7fc700 1 --2- 172.21.15.79:0/3163333924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c5415a620 0x7f5c5415d040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0098e0 tx=0x7f5c3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f18cd9d966350f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c527fc700 1 -- 172.21.15.79:0/3163333924 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00b640 con 0x7f5c5415a620 2023-10-14T18:51:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.661+0000 7f5c527fc700 1 -- 172.21.15.79:0/3163333924 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00b7a0 con 0x7f5c5415a620 2023-10-14T18:51:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c527fc700 1 -- 172.21.15.79:0/3163333924 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00bb20 con 0x7f5c5415a620 2023-10-14T18:51:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 -- 172.21.15.79:0/3163333924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c5415a620 msgr2=0x7f5c5415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3163333924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c5415a620 0x7f5c5415d040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0098e0 tx=0x7f5c3c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 -- 172.21.15.79:0/3163333924 shutdown_connections 2023-10-14T18:51:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3163333924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c5415a620 0x7f5c5415d040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 -- 172.21.15.79:0/3163333924 >> 172.21.15.79:0/3163333924 conn(0x7f5c54068ce0 msgr2=0x7f5c540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 -- 172.21.15.79:0/3163333924 shutdown_connections 2023-10-14T18:51:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.662+0000 7f5c5947e700 1 -- 172.21.15.79:0/3163333924 wait complete. 2023-10-14T18:51:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.663+0000 7f5c5947e700 1 Processor -- start 2023-10-14T18:51:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.663+0000 7f5c5947e700 1 -- start start 2023-10-14T18:51:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c54157870 0x7f5c540b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:25.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 0x7f5c54154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:25.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540b06c0 con 0x7f5c5415a620 2023-10-14T18:51:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540b09a0 con 0x7f5c54157870 2023-10-14T18:51:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c5947e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5416e990 con 0x7f5c5415d580 2023-10-14T18:51:25.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35614/0 (socket says 172.21.15.79:35614) 2023-10-14T18:51:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3838057705 learned_addr learned my addr 172.21.15.79:0/3838057705 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c52ffd700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c54157870 0x7f5c540b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c537fe700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 0x7f5c54154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 msgr2=0x7f5c54154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 0x7f5c54154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.664+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c54157870 msgr2=0x7f5c540b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4a7fc700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c54157870 0x7f5c540b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4a7fc700 1 -- 172.21.15.79:0/3838057705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c009420 con 0x7f5c5415a620 2023-10-14T18:51:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c537fe700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 0x7f5c54154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4a7fc700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c013000 tx=0x7f5c3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00bb20 con 0x7f5c5415a620 2023-10-14T18:51:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c000d10 con 0x7f5c5415a620 2023-10-14T18:51:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5416ec30 con 0x7f5c5415a620 2023-10-14T18:51:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011690 con 0x7f5c5415a620 2023-10-14T18:51:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.665+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5416f1f0 con 0x7f5c5415a620 2023-10-14T18:51:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.666+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c540b0b30 con 0x7f5c5415a620 2023-10-14T18:51:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.667+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3c011ac0 con 0x7f5c5415a620 2023-10-14T18:51:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.667+0000 7f5c4b7fe700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.667+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c3c085ec0 con 0x7f5c5415a620 2023-10-14T18:51:25.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.667+0000 7f5c52ffd700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:25.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.668+0000 7f5c52ffd700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 0x7f5c340693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5c44003aa0 tx=0x7f5c44000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:25.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.672+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c3c053130 con 0x7f5c5415a620 2023-10-14T18:51:25.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.898+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c5404c3c0 con 0x7f5c5415a620 2023-10-14T18:51:25.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.898+0000 7f5c4b7fe700 1 -- 172.21.15.79:0/3838057705 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c3c056750 con 0x7f5c5415a620 2023-10-14T18:51:25.900 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 msgr2=0x7f5c340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 0x7f5c340693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5c44003aa0 tx=0x7f5c44000bc0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 msgr2=0x7f5c5416e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c013000 tx=0x7f5c3c017000 comp rx=0 tx=0).stop 2023-10-14T18:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 shutdown_connections 2023-10-14T18:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c34066f30 0x7f5c340693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c5415d580 0x7f5c54154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c54157870 0x7f5c540b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 --2- 172.21.15.79:0/3838057705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c5415a620 0x7f5c5416e450 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 >> 172.21.15.79:0/3838057705 conn(0x7f5c54068ce0 msgr2=0x7f5c54158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 shutdown_connections 2023-10-14T18:51:25.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:25.900+0000 7f5c5947e700 1 -- 172.21.15.79:0/3838057705 wait complete. 2023-10-14T18:51:25.914 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:51:25.915 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:51:25.915 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:51:25.915 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:51:25.916 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:25.916 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:51:25.916 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:51:25.917 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:51:25.917 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:51:25.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.918 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:51:25.937 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:51:25.938 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:51:25.938 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:51:25.938 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.938 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:51:25.939 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.939 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:25.939 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:25.939 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:51:25.939 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:25.940 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:25.940 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:51:25.940 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:51:25.940 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:25.940 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42140sec preferred_lft 42140sec 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.941 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:51:25.942 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:51:25.942 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:51:25.943 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.943 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:51:25.943 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.943 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:51:25.943 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:51:25.944 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:51:25.944 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.944 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:51:25.944 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:51:25.944 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:51:25.945 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:51:25.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:25.946 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:51:26.004 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:51:26.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:26.006 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:51:26.063 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:51:26.064 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:51:26.064 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:51:26.064 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:51:26.064 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:51:26.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:26.065 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:51:26.066 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:51:26.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:51:26.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:51:26.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:51:26.067 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:51:26.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:26.169 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:51:26.184 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:51:26.184 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:51:26.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:51:26.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:26.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:51:26.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:51:26.249 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:26.304 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:51:26.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:51:26.305 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:26.358 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:51:26.359 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:51:26.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:51:26.439 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:51:26.439 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:51:26.439 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:51:26.447 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:51:26.447 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:51:26.447 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:51:26.448 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:51:26.448 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:51:26.469 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:51:26.469 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:51:26.469 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:51:26.469 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:51:26.470 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:51:26.470 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:51:26.470 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:51:26.470 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:51:26.471 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:51:26.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:26.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:26.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:26.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.654+0000 7f7094f29700 1 Processor -- start 2023-10-14T18:51:26.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.654+0000 7f7094f29700 1 -- start start 2023-10-14T18:51:26.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7094f29700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70900cdab0 0x7f709015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7094f29700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900cb7c0 con 0x7f70900cd6e0 2023-10-14T18:51:26.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7094f29700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709015e290 con 0x7f709015dda0 2023-10-14T18:51:26.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7094f29700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709015e850 con 0x7f70900cdab0 2023-10-14T18:51:26.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f70900cd6e0 0x7f70900cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35302/0 (socket says 172.21.15.79:35302) 2023-10-14T18:51:26.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708f7fe700 1 -- 172.21.15.79:0/2033917828 learned_addr learned my addr 172.21.15.79:0/2033917828 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:26.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7086ffd700 1 --2- 172.21.15.79:0/2033917828 >> v2:172.21.15.144:3300/0 conn(0x7f70900cdab0 0x7f709015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109252152 0 0) 0x7f70900cb7c0 con 0x7f70900cd6e0 2023-10-14T18:51:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7070003570 con 0x7f70900cd6e0 2023-10-14T18:51:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348826224 0 0) 0x7f709015e290 con 0x7f709015dda0 2023-10-14T18:51:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70900cb7c0 con 0x7f709015dda0 2023-10-14T18:51:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997340883 0 0) 0x7f7070003570 con 0x7f70900cd6e0 2023-10-14T18:51:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 >> v2:172.21.15.144:3300/0 conn(0x7f70900cdab0 msgr2=0x7f709015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 --2- 172.21.15.79:0/2033917828 >> v2:172.21.15.144:3300/0 conn(0x7f70900cdab0 0x7f709015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 >> v1:172.21.15.144:6789/0 conn(0x7f709015dda0 legacy=0x7f709015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709015e570 con 0x7f70900cd6e0 2023-10-14T18:51:26.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f7080001470 con 0x7f70900cd6e0 2023-10-14T18:51:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f7086ffd700 1 --2- 172.21.15.79:0/2033917828 >> v2:172.21.15.144:3300/0 conn(0x7f70900cdab0 0x7f709015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:51:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 >> v1:172.21.15.79:6789/0 conn(0x7f70900cd6e0 legacy=0x7f70900cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7070003bf0 0x7f7070003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709015e850 con 0x7f70700051c0 2023-10-14T18:51:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707000c0b0 con 0x7f7070004810 2023-10-14T18:51:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.655+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707000c270 con 0x7f7070003bf0 2023-10-14T18:51:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f7086ffd700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708f7fe700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7070003bf0 0x7f7070003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 -- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7070003bf0 msgr2=0x7f7070003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7070003bf0 0x7f7070003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 -- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7070004810 msgr2=0x7f7070004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 -- 172.21.15.79:0/2033917828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070003570 con 0x7f70700051c0 2023-10-14T18:51:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708f7fe700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7070003bf0 0x7f7070003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 -- 172.21.15.79:0/2033917828 reap_dead start 2023-10-14T18:51:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708ffff700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 0x7f707000ba60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f70880020f0 tx=0x7f70880017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cb6eb4a475aef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800c8b0 con 0x7f70700051c0 2023-10-14T18:51:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800ca10 con 0x7f70700051c0 2023-10-14T18:51:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.656+0000 7f708effd700 1 -- 172.21.15.79:0/2033917828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800cd90 con 0x7f70700051c0 2023-10-14T18:51:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 -- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 msgr2=0x7f707000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 0x7f707000ba60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f70880020f0 tx=0x7f70880017a0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 -- 172.21.15.79:0/2033917828 shutdown_connections 2023-10-14T18:51:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 --2- 172.21.15.79:0/2033917828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 -- 172.21.15.79:0/2033917828 >> 172.21.15.79:0/2033917828 conn(0x7f7090067660 msgr2=0x7f7090067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 -- 172.21.15.79:0/2033917828 shutdown_connections 2023-10-14T18:51:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.657+0000 7f7094f29700 1 -- 172.21.15.79:0/2033917828 wait complete. 2023-10-14T18:51:26.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.658+0000 7f7094f29700 1 Processor -- start 2023-10-14T18:51:26.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.658+0000 7f7094f29700 1 -- start start 2023-10-14T18:51:26.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70700051c0 0x7f7090168240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f709016b6f0 0x7f70900b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900cc360 con 0x7f70900c7d20 2023-10-14T18:51:26.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900b16f0 con 0x7f709016b6f0 2023-10-14T18:51:26.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709013a1b0 con 0x7f70700051c0 2023-10-14T18:51:26.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35634/0 (socket says 172.21.15.79:35634) 2023-10-14T18:51:26.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 -- 172.21.15.79:0/4054831905 learned_addr learned my addr 172.21.15.79:0/4054831905 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:26.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708f7fe700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70700051c0 0x7f7090168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7086ffd700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f709016b6f0 0x7f70900b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 -- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70700051c0 msgr2=0x7f7090168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70700051c0 0x7f7090168240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 -- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f709016b6f0 msgr2=0x7f70900b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f709016b6f0 0x7f70900b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 -- 172.21.15.79:0/4054831905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900c86d0 con 0x7f70900c7d20 2023-10-14T18:51:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f708ffff700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f70900c7cd0 tx=0x7f7088016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800c8b0 con 0x7f70900c7d20 2023-10-14T18:51:26.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088012e40 con 0x7f70900c7d20 2023-10-14T18:51:26.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708801e430 con 0x7f70900c7d20 2023-10-14T18:51:26.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70900b2510 con 0x7f70900c7d20 2023-10-14T18:51:26.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.659+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70900b1900 con 0x7f70900c7d20 2023-10-14T18:51:26.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.660+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900b26a0 con 0x7f70900c7d20 2023-10-14T18:51:26.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.661+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7088003030 con 0x7f70900c7d20 2023-10-14T18:51:26.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.661+0000 7f7087fff700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:26.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.661+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7088085830 con 0x7f70900c7d20 2023-10-14T18:51:26.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.661+0000 7f708f7fe700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:26.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.662+0000 7f708f7fe700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 0x7f70740693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f7080007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:26.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.665+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7088052aa0 con 0x7f70900c7d20 2023-10-14T18:51:26.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.893+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7090158400 con 0x7f70900c7d20 2023-10-14T18:51:26.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.893+0000 7f7087fff700 1 -- 172.21.15.79:0/4054831905 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f7088085020 con 0x7f70900c7d20 2023-10-14T18:51:26.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:26.896 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:26.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 msgr2=0x7f70740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 0x7f70740693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7080000c00 tx=0x7f7080007040 comp rx=0 tx=0).stop 2023-10-14T18:51:26.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 msgr2=0x7f70900c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f70900c7cd0 tx=0x7f7088016000 comp rx=0 tx=0).stop 2023-10-14T18:51:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 shutdown_connections 2023-10-14T18:51:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70900c7d20 0x7f70900c8190 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70700051c0 0x7f7090168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 --2- 172.21.15.79:0/4054831905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f709016b6f0 0x7f70900b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 >> 172.21.15.79:0/4054831905 conn(0x7f7090067660 msgr2=0x7f7090157920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 shutdown_connections 2023-10-14T18:51:26.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:26.895+0000 7f7094f29700 1 -- 172.21.15.79:0/4054831905 wait complete. 2023-10-14T18:51:26.900 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:26.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:51:27.041 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3579140889999994,"mdsmap_epoch":64,"osdmap_epoch":138,"osdmap_epoch_barrier":138,"uptime":13.492351821} 2023-10-14T18:51:27.042 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 64, "osdmap_epoch": 138, "osdmap_epoch_barrier": 138, "rank_uptime": 8.357914089, "state": "up:active", "uptime": 13.492351821, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:51:27.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-14T18:51:27.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.159+0000 7ffa93fff700 1 Processor -- start 2023-10-14T18:51:27.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.159+0000 7ffa93fff700 1 -- start start 2023-10-14T18:51:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa93fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 0x7ffa940b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa93fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffa940cc940 0x7ffa940ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa93fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa940b3f40 con 0x7ffa940c59e0 2023-10-14T18:51:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa93fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940cbb80 con 0x7ffa940cc940 2023-10-14T18:51:27.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa93fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa940cbe60 con 0x7ffa9415d240 2023-10-14T18:51:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa8a7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffa940cc940 0x7ffa940ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa8a7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffa940cc940 0x7ffa940ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35636/0 (socket says 172.21.15.79:35636) 2023-10-14T18:51:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa937fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffa940c59e0 0x7ffa940c5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:35304/0 (socket says 172.21.15.79:35304) 2023-10-14T18:51:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.160+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2538920556 learned_addr learned my addr 172.21.15.79:0/2538920556 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:27.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa92ffd700 1 --2- 172.21.15.79:0/2538920556 >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 0x7ffa940b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2538920556 >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 msgr2=0x7ffa940b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa8a7fc700 1 --2- 172.21.15.79:0/2538920556 >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 0x7ffa940b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2538920556 >> v1:172.21.15.79:6789/0 conn(0x7ffa940c59e0 legacy=0x7ffa940c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2538920556 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940cc140 con 0x7ffa940cc940 2023-10-14T18:51:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa927fc700 1 -- 172.21.15.79:0/2538920556 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235834771 0 0) 0x7ffa940b3f40 con 0x7ffa940c59e0 2023-10-14T18:51:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa92ffd700 1 --2- 172.21.15.79:0/2538920556 >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 0x7ffa940b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa8a7fc700 1 --2- 172.21.15.79:0/2538920556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa940ccde0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffa9406b540 tx=0x7ffa7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217b441641799600 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa927fc700 1 -- 172.21.15.79:0/2538920556 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00b860 con 0x7ffa940cc940 2023-10-14T18:51:27.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa927fc700 1 -- 172.21.15.79:0/2538920556 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c00b9c0 con 0x7ffa940cc940 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa927fc700 1 -- 172.21.15.79:0/2538920556 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c00bd60 con 0x7ffa940cc940 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa93fff700 1 -- 172.21.15.79:0/2538920556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 msgr2=0x7ffa940ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.161+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2538920556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa940ccde0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffa9406b540 tx=0x7ffa7c009250 comp rx=0 tx=0).stop 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 -- 172.21.15.79:0/2538920556 shutdown_connections 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2538920556 >> v2:172.21.15.144:3300/0 conn(0x7ffa9415d240 0x7ffa940b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2538920556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa940ccde0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 -- 172.21.15.79:0/2538920556 >> 172.21.15.79:0/2538920556 conn(0x7ffa94067e40 msgr2=0x7ffa940d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 -- 172.21.15.79:0/2538920556 shutdown_connections 2023-10-14T18:51:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.162+0000 7ffa93fff700 1 -- 172.21.15.79:0/2538920556 wait complete. 2023-10-14T18:51:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.163+0000 7ffa93fff700 1 Processor -- start 2023-10-14T18:51:27.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.163+0000 7ffa93fff700 1 -- start start 2023-10-14T18:51:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.163+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa940c59e0 0x7ffa9409e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa9415d240 0x7ffa9409c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409e8f0 con 0x7ffa940cc940 2023-10-14T18:51:27.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409df20 con 0x7ffa940c59e0 2023-10-14T18:51:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409d310 con 0x7ffa9415d240 2023-10-14T18:51:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35648/0 (socket says 172.21.15.79:35648) 2023-10-14T18:51:27.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2551038097 learned_addr learned my addr 172.21.15.79:0/2551038097 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa92ffd700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa940c59e0 0x7ffa9409e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa937fe700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa9415d240 0x7ffa9409c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa9415d240 msgr2=0x7ffa9409c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa9415d240 0x7ffa9409c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa940c59e0 msgr2=0x7ffa9409e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa940c59e0 0x7ffa9409e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 -- 172.21.15.79:0/2551038097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0094f0 con 0x7ffa940cc940 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8a7fc700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c006f50 tx=0x7ffa7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c011e40 con 0x7ffa940cc940 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c024440 con 0x7ffa940cc940 2023-10-14T18:51:27.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9409d5f0 con 0x7ffa940cc940 2023-10-14T18:51:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0247e0 con 0x7ffa940cc940 2023-10-14T18:51:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.164+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9409dbb0 con 0x7ffa940cc940 2023-10-14T18:51:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.165+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9409e0b0 con 0x7ffa940cc940 2023-10-14T18:51:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.166+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa7c02d440 con 0x7ffa940cc940 2023-10-14T18:51:27.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.166+0000 7ffa8b7fe700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.166+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa7c085eb0 con 0x7ffa940cc940 2023-10-14T18:51:27.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.166+0000 7ffa92ffd700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.167+0000 7ffa92ffd700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 0x7ffa740693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400aca0 tx=0x7ffa84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:27.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.170+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa7c053120 con 0x7ffa940cc940 2023-10-14T18:51:27.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.355+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7ffa9406ac60 con 0x7ffa940cc940 2023-10-14T18:51:27.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.716+0000 7ffa8b7fe700 1 -- 172.21.15.79:0/2551038097 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v139) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffa7c056740 con 0x7ffa940cc940 2023-10-14T18:51:27.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 msgr2=0x7ffa740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 0x7ffa740693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400aca0 tx=0x7ffa84008040 comp rx=0 tx=0).stop 2023-10-14T18:51:27.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 msgr2=0x7ffa94156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:27.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c006f50 tx=0x7ffa7c017000 comp rx=0 tx=0).stop 2023-10-14T18:51:27.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 shutdown_connections 2023-10-14T18:51:27.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffa74066f30 0x7ffa740693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa9415d240 0x7ffa9409c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa940c59e0 0x7ffa9409e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 --2- 172.21.15.79:0/2551038097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa940cc940 0x7ffa94156eb0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 >> 172.21.15.79:0/2551038097 conn(0x7ffa94067e40 msgr2=0x7ffa940cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:27.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 shutdown_connections 2023-10-14T18:51:27.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:27.718+0000 7ffa93fff700 1 -- 172.21.15.79:0/2551038097 wait complete. 2023-10-14T18:51:27.725 INFO:teuthology.orchestra.run.smithi079.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-14T18:51:27.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:51:27.862 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:51:27.862 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:51:27.863 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-14T18:51:27.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:27.864 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-14T18:51:27.974 INFO:teuthology.orchestra.run.smithi079.stderr:16+0 records in 2023-10-14T18:51:27.974 INFO:teuthology.orchestra.run.smithi079.stderr:16+0 records out 2023-10-14T18:51:27.974 INFO:teuthology.orchestra.run.smithi079.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0913304 s, 184 MB/s 2023-10-14T18:51:27.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:27.975 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-14T18:51:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:17+0 records in 2023-10-14T18:51:28.098 INFO:teuthology.orchestra.run.smithi079.stderr:17+0 records out 2023-10-14T18:51:28.098 INFO:teuthology.orchestra.run.smithi079.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.105944 s, 168 MB/s 2023-10-14T18:51:28.098 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-14T18:51:28.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:28.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 Processor -- start 2023-10-14T18:51:28.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 -- start start 2023-10-14T18:51:28.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59fc0abae0 0x7f59fc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0c8b10 0x7f59fc0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc0c9cb0 con 0x7f59fc0abeb0 2023-10-14T18:51:28.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc0c90a0 con 0x7f59fc0abae0 2023-10-14T18:51:28.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f5a01864700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0c9380 con 0x7f59fc0c8b10 2023-10-14T18:51:28.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59fc0abae0 0x7f59fc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59fc0abae0 0x7f59fc0c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35652/0 (socket says 172.21.15.79:35652) 2023-10-14T18:51:28.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 -- 172.21.15.79:0/1279075921 learned_addr learned my addr 172.21.15.79:0/1279075921 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:28.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59fb7fe700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0c8b10 0x7f59fc0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 -- 172.21.15.79:0/1279075921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0c8b10 msgr2=0x7f59fc0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:28.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0c8b10 0x7f59fc0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 -- 172.21.15.79:0/1279075921 >> v1:172.21.15.144:6789/0 conn(0x7f59fc0abeb0 legacy=0x7f59fc0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 -- 172.21.15.79:0/1279075921 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0c9660 con 0x7f59fc0abae0 2023-10-14T18:51:28.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.212+0000 7f59faffd700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0abae0 0x7f59fc0c6eb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c55bd5770c3613 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:28.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f59fa7fc700 1 -- 172.21.15.79:0/1279075921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00b860 con 0x7f59fc0abae0 2023-10-14T18:51:28.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f59fa7fc700 1 -- 172.21.15.79:0/1279075921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec00b9c0 con 0x7f59fc0abae0 2023-10-14T18:51:28.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f59fa7fc700 1 -- 172.21.15.79:0/1279075921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00bd60 con 0x7f59fc0abae0 2023-10-14T18:51:28.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 -- 172.21.15.79:0/1279075921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0abae0 msgr2=0x7f59fc0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0abae0 0x7f59fc0c6eb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec009250 comp rx=0 tx=0).stop 2023-10-14T18:51:28.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 -- 172.21.15.79:0/1279075921 shutdown_connections 2023-10-14T18:51:28.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0c8b10 0x7f59fc0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 --2- 172.21.15.79:0/1279075921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0abae0 0x7f59fc0c6eb0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 -- 172.21.15.79:0/1279075921 >> 172.21.15.79:0/1279075921 conn(0x7f59fc067660 msgr2=0x7f59fc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:28.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 -- 172.21.15.79:0/1279075921 shutdown_connections 2023-10-14T18:51:28.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.213+0000 7f5a01864700 1 -- 172.21.15.79:0/1279075921 wait complete. 2023-10-14T18:51:28.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.214+0000 7f5a01864700 1 Processor -- start 2023-10-14T18:51:28.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.214+0000 7f5a01864700 1 -- start start 2023-10-14T18:51:28.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0abae0 0x7f59fc0aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc0abeb0 0x7f59fc0a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0aacc0 con 0x7f59fc0c8b10 2023-10-14T18:51:28.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0aafa0 con 0x7f59fc0abeb0 2023-10-14T18:51:28.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f5a01864700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc0ab280 con 0x7f59fc0abae0 2023-10-14T18:51:28.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f59fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:35656/0 (socket says 172.21.15.79:35656) 2023-10-14T18:51:28.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f59fb7fe700 1 -- 172.21.15.79:0/3878487599 learned_addr learned my addr 172.21.15.79:0/3878487599 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:28.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f59faffd700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0abae0 0x7f59fc0aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.215+0000 7f59f27fc700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc0abeb0 0x7f59fc0a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 -- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0abae0 msgr2=0x7f59fc0aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0abae0 0x7f59fc0aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 -- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc0abeb0 msgr2=0x7f59fc0a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc0abeb0 0x7f59fc0a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 -- 172.21.15.79:0/3878487599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0094f0 con 0x7f59fc0c8b10 2023-10-14T18:51:28.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59fb7fe700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007f20 tx=0x7f59f4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:28.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400eb90 con 0x7f59fc0c8b10 2023-10-14T18:51:28.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400ed10 con 0x7f59fc0c8b10 2023-10-14T18:51:28.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc0c1340 con 0x7f59fc0c8b10 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4014670 con 0x7f59fc0c8b10 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.216+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc0a69b0 con 0x7f59fc0c8b10 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.217+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc0c1860 con 0x7f59fc0c8b10 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.217+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59f40149e0 con 0x7f59fc0c8b10 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.218+0000 7f59f37fe700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:28.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.218+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59f4084b30 con 0x7f59fc0c8b10 2023-10-14T18:51:28.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.218+0000 7f59faffd700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:28.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.218+0000 7f59faffd700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:28.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.223+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59fc0c1860 con 0x7f59fc0c8b10 2023-10-14T18:51:28.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.406+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f59fc0c1860 con 0x7f59fc0c8b10 2023-10-14T18:51:28.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.407+0000 7f59f37fe700 1 -- 172.21.15.79:0/3878487599 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f59fc0c1860 con 0x7f59fc0c8b10 2023-10-14T18:51:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:28.409 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 139, 2023-10-14T18:51:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:27.708516+0000", 2023-10-14T18:51:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "139", 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:28.516 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:28.517 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.517 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:28.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.519 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:28.520 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.520 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:28.521 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:28.522 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:28.523 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.525 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:28.525 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.525 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.526 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.526 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.526 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.527 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.527 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.527 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.527 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.527 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:28.528 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.529 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.530 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:28.531 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:28.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.533 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:28.534 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:28.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.537 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:28.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:28.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:28.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.542 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:28.542 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:28.542 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:28.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:28.543 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.543 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.545 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:28.546 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.546 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.546 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.547 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.547 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.547 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.548 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.548 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.548 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:28.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:28.550 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.551 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:28.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:28.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.557 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:28.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:28.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:28.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.560 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:28.560 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:28.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:28.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:28.561 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.561 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.561 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.562 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:28.562 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.562 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.562 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.563 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.563 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.564 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.564 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.564 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.564 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:28.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:28.569 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.569 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.570 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:28.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:28.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.573 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:28.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:28.575 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:28.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:28.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:28.576 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.576 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.577 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:28.578 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:28.578 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:28.578 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:28.578 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:28.579 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:28.579 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:28.579 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:28.579 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:28.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:28.580 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:28.580 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:28.580 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:28.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:28.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:28.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.583 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:28.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:28.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:28.585 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.586 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.587 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:28.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:28.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:28.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.591 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:28.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:28.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:28.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:28.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:28.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:28.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:28.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.596 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:28.596 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:28.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:28.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:28.597 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:28.598 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:28.598 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:28.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:28.600 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.600 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.600 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.600 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.600 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:28.601 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.602 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.602 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.602 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.602 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:28.603 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.604 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.604 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.604 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.604 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.604 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:28.605 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:28.607 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.609 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.610 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.612 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:28.613 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:28.614 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:28.617 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:28.618 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:28.619 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:28.620 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:28.621 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:28.622 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:28.623 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:28.624 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:28.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:28.625 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:28.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 msgr2=0x7f59dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 0x7f59dc0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0099b0 tx=0x7f59ec017000 comp rx=0 tx=0).stop 2023-10-14T18:51:28.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 msgr2=0x7f59fc157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:28.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f59f4007f20 tx=0x7f59f4009860 comp rx=0 tx=0).stop 2023-10-14T18:51:28.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 shutdown_connections 2023-10-14T18:51:28.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59dc066f30 0x7f59dc0693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59fc0c8b10 0x7f59fc157e60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59fc0abae0 0x7f59fc0aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 --2- 172.21.15.79:0/3878487599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc0abeb0 0x7f59fc0a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:28.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 >> 172.21.15.79:0/3878487599 conn(0x7f59fc067660 msgr2=0x7f59fc1586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:28.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 shutdown_connections 2023-10-14T18:51:28.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:28.409+0000 7f5a01864700 1 -- 172.21.15.79:0/3878487599 wait complete. 2023-10-14T18:51:28.632 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:51:33.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.763+0000 7f5b16267700 1 Processor -- start 2023-10-14T18:51:33.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.763+0000 7f5b16267700 1 -- start start 2023-10-14T18:51:33.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b16267700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cdab0 0x7f5b1015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b16267700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b1015dda0 0x7f5b1015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b16267700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100cb7c0 con 0x7f5b100cd6e0 2023-10-14T18:51:33.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b16267700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1015e850 con 0x7f5b1015dda0 2023-10-14T18:51:33.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b16267700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100cc360 con 0x7f5b100cdab0 2023-10-14T18:51:33.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b1015dda0 0x7f5b1015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5b1015dda0 0x7f5b1015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47940/0 (socket says 172.21.15.79:47940) 2023-10-14T18:51:33.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 -- 172.21.15.79:0/2584622708 learned_addr learned my addr 172.21.15.79:0/2584622708 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:33.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b14a64700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cdab0 0x7f5b1015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 -- 172.21.15.79:0/2584622708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cdab0 msgr2=0x7f5b1015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:33.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cdab0 0x7f5b1015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:33.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 -- 172.21.15.79:0/2584622708 >> v1:172.21.15.144:6789/0 conn(0x7f5b100cd6e0 legacy=0x7f5b100cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:33.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.764+0000 7f5b15a66700 1 -- 172.21.15.79:0/2584622708 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1015e290 con 0x7f5b1015dda0 2023-10-14T18:51:33.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b15a66700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b1015dda0 0x7f5b1015cbd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f20 tx=0x7f5b08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710655206965f913 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:33.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b07fff700 1 -- 172.21.15.79:0/2584622708 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800e070 con 0x7f5b1015dda0 2023-10-14T18:51:33.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b07fff700 1 -- 172.21.15.79:0/2584622708 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800b9d0 con 0x7f5b1015dda0 2023-10-14T18:51:33.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b07fff700 1 -- 172.21.15.79:0/2584622708 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b080092e0 con 0x7f5b1015dda0 2023-10-14T18:51:33.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 -- 172.21.15.79:0/2584622708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b1015dda0 msgr2=0x7f5b1015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:33.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b1015dda0 0x7f5b1015cbd0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f20 tx=0x7f5b08009840 comp rx=0 tx=0).stop 2023-10-14T18:51:33.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 -- 172.21.15.79:0/2584622708 shutdown_connections 2023-10-14T18:51:33.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b1015dda0 0x7f5b1015cbd0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:33.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 --2- 172.21.15.79:0/2584622708 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cdab0 0x7f5b1015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:33.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 -- 172.21.15.79:0/2584622708 >> 172.21.15.79:0/2584622708 conn(0x7f5b10067660 msgr2=0x7f5b10067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:33.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 -- 172.21.15.79:0/2584622708 shutdown_connections 2023-10-14T18:51:33.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.765+0000 7f5b16267700 1 -- 172.21.15.79:0/2584622708 wait complete. 2023-10-14T18:51:33.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.766+0000 7f5b16267700 1 Processor -- start 2023-10-14T18:51:33.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 -- start start 2023-10-14T18:51:33.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cd6e0 0x7f5b1014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b1015dda0 0x7f5b100b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100c8650 con 0x7f5b100cdab0 2023-10-14T18:51:33.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1014d030 con 0x7f5b1015dda0 2023-10-14T18:51:33.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b16267700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100b49e0 con 0x7f5b100cd6e0 2023-10-14T18:51:33.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.767+0000 7f5b14a64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47952/0 (socket says 172.21.15.79:47952) 2023-10-14T18:51:33.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 -- 172.21.15.79:0/3363490572 learned_addr learned my addr 172.21.15.79:0/3363490572 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:33.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b15a66700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b1015dda0 0x7f5b100b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b15265700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cd6e0 0x7f5b1014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 -- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cd6e0 msgr2=0x7f5b1014caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:33.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cd6e0 0x7f5b1014caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:33.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 -- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b1015dda0 msgr2=0x7f5b100b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:33.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b1015dda0 0x7f5b100b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:33.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009ae0 con 0x7f5b100cdab0 2023-10-14T18:51:33.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b14a64700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000ec80 tx=0x7f5b000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:33.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000c850 con 0x7f5b100cdab0 2023-10-14T18:51:33.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000c9b0 con 0x7f5b100cdab0 2023-10-14T18:51:33.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b100c7d20 con 0x7f5b100cdab0 2023-10-14T18:51:33.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000cd50 con 0x7f5b100cdab0 2023-10-14T18:51:33.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.768+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100c82e0 con 0x7f5b100cdab0 2023-10-14T18:51:33.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.769+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10089280 con 0x7f5b100cdab0 2023-10-14T18:51:33.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.770+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b00013680 con 0x7f5b100cdab0 2023-10-14T18:51:33.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.770+0000 7f5b057fa700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 0x7f5af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:33.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.770+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b000847b0 con 0x7f5b100cdab0 2023-10-14T18:51:33.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.770+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f5af406ea50 con 0x7f5b100cdab0 2023-10-14T18:51:33.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.770+0000 7f5b15265700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 0x7f5af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:33.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.771+0000 7f5b15265700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 0x7f5af40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c003a80 tx=0x7f5b0c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:33.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.774+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b00017060 con 0x7f5b100cdab0 2023-10-14T18:51:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.960+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5b100cfa70 con 0x7f5b100cdab0 2023-10-14T18:51:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.961+0000 7f5b057fa700 1 -- 172.21.15.79:0/3363490572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f5b00051a20 con 0x7f5b100cdab0 2023-10-14T18:51:33.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:33.962 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:33.962 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 140, 2023-10-14T18:51:33.962 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:32.536737+0000", 2023-10-14T18:51:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:33.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:33.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:33.964 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:33.964 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:33.964 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:33.965 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:33.965 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:33.965 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:33.965 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:33.965 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:33.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:33.966 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:33.966 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:33.966 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:33.966 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:33.967 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:33.968 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:33.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:33.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:33.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:33.968 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:33.969 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:33.969 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:33.969 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:33.969 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:33.969 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:33.970 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:33.971 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:33.971 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:33.971 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:33.971 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:33.971 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:33.972 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:33.972 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:33.972 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:33.972 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:33.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.973 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:33.973 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:33.973 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:33.973 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:33.973 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:33.974 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:33.975 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:33.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:33.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:33.975 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:33.975 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:33.976 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:33.976 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:33.976 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:33.976 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:33.976 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:33.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:33.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.978 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:33.978 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:33.978 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:33.978 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:33.979 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:33.979 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:33.979 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:33.979 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:33.979 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:33.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.981 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:33.981 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:33.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:33.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:33.982 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:33.982 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:33.982 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:33.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:33.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:33.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:33.983 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:33.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:33.983 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:33.983 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:33.984 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:33.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:33.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:33.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:33.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:33.985 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:33.986 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:33.987 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:33.987 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:33.987 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:33.988 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:33.988 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:33.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:33.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:33.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:33.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:33.990 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:33.990 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:33.990 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:33.990 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:33.991 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:33.992 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:33.992 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:33.992 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:33.992 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:33.992 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:33.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:33.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:33.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:33.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:33.993 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:33.994 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:33.994 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:33.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:33.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.994 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:33.995 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:33.995 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:33.995 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:33.995 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:33.996 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:33.996 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:33.996 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:33.996 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:33.996 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:33.997 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:33.997 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:33.997 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:33.997 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:33.997 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:34.000 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:34.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:51:34.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:51:34.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:34.000 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:34.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:34.001 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:34.001 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:34.001 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:34.002 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:34.002 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:34.002 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:34.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:34.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:34.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:34.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:34.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:34.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:34.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:34.004 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:34.004 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:34.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:34.004 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:34.005 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:34.005 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:34.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.005 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "140", 2023-10-14T18:51:34.005 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:34.006 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:34.006 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:34.006 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:34.006 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:34.006 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:34.007 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:34.007 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:34.007 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:34.007 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:34.007 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:34.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:34.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:34.008 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:34.008 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:34.009 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:34.010 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:34.010 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:34.010 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:34.010 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:34.010 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:34.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:34.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.011 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:34.012 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:34.012 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:34.012 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:34.012 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:34.012 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:34.014 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:34.014 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:34.015 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:34.015 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:34.015 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:34.015 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:34.015 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:34.016 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:34.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.016 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:34.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:34.016 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:34.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.017 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.017 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:34.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.018 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:34.018 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.018 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.018 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.019 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.020 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.020 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.020 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:34.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:34.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:34.025 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.025 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:34.026 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:34.027 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:34.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:34.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:34.031 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.032 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.032 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.033 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:34.033 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.033 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.033 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.033 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.034 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.034 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.034 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.034 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.034 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:34.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:34.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.038 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:34.039 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.041 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:34.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.042 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.043 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.043 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:34.044 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:34.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.046 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:34.046 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:34.046 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:34.046 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:34.046 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.047 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.047 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.048 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.049 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.049 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.049 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.049 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.049 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.050 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.050 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:34.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.052 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:34.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:34.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.056 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:34.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:34.057 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.058 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.059 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.060 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.061 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.063 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.063 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.063 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.063 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.063 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.064 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:34.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:34.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.067 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:34.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.070 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:34.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:34.073 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.074 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:34.074 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.075 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:34.075 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:34.076 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:34.076 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:34.076 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.076 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.076 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.077 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.078 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.078 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.078 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.078 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.079 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.079 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.079 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:34.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.082 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:34.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:34.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:34.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:34.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:34.088 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.090 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:34.090 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:34.090 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:34.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:34.091 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.091 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.091 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.092 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:34.092 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.092 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.093 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.093 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.093 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.093 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:34.095 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:34.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:34.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:34.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:34.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:34.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:34.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.105 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:34.105 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:34.105 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:34.105 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.107 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:34.107 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.107 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.107 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.107 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.108 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.109 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.109 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.110 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:34.110 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:34.112 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:34.113 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.114 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:34.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.117 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:34.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.119 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:34.120 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:34.120 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:34.120 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:34.120 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.120 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.121 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.121 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:34.122 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.122 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.122 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.122 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.122 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.123 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.123 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.123 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.123 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.123 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:34.126 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.126 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:34.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:34.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.129 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.129 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:34.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:34.131 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:34.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.135 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:34.135 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:34.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:34.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:34.135 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.136 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.136 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.136 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.137 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:34.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.137 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:34.137 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.137 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.138 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.138 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.138 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.138 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:34.138 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.139 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.140 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.140 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.140 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:34.140 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.141 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:34.141 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.141 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.141 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.143 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.144 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.144 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:34.144 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:34.145 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.145 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.146 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:34.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.147 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.147 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.148 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:34.148 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.148 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:34.149 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.149 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.149 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.150 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.151 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:34.152 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.152 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.152 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:34.152 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:34.153 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:34.153 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:34.153 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:34.153 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:34.153 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:34.154 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:34.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.155 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:34.155 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:34.155 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:34.156 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:34.157 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:34.157 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:34.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.157 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:34.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 msgr2=0x7f5af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 0x7f5af40693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c003a80 tx=0x7f5b0c007ec0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 msgr2=0x7f5b100b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000ec80 tx=0x7f5b000091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 shutdown_connections 2023-10-14T18:51:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af4066f30 0x7f5af40693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b1015dda0 0x7f5b100b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b100cd6e0 0x7f5b1014caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 --2- 172.21.15.79:0/3363490572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b100cdab0 0x7f5b100b2570 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 >> 172.21.15.79:0/3363490572 conn(0x7f5b10067660 msgr2=0x7f5b100d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:34.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 shutdown_connections 2023-10-14T18:51:34.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:33.963+0000 7f5b16267700 1 -- 172.21.15.79:0/3363490572 wait complete. 2023-10-14T18:51:34.162 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-14T18:51:34.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:34.163 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-14T18:51:34.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:51:34.409 INFO:teuthology.orchestra.run.smithi079.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-14T18:51:34.410 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:51:34.410 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:51:34.410 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.227926 s, 230 MB/s 2023-10-14T18:51:34.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.532+0000 7f049ad7f700 1 Processor -- start 2023-10-14T18:51:34.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.532+0000 7f049ad7f700 1 -- start start 2023-10-14T18:51:34.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049ad7f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 0x7f04940c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049ad7f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04940b1220 0x7f049406d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049ad7f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049415de60 con 0x7f049406dad0 2023-10-14T18:51:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049ad7f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049415e140 con 0x7f04940b1220 2023-10-14T18:51:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049ad7f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049415e420 con 0x7f04940b0e50 2023-10-14T18:51:34.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f048bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f04940b1220 0x7f049406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049931c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f049406dad0 0x7f04940cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59750/0 (socket says 172.21.15.79:59750) 2023-10-14T18:51:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.533+0000 7f049931c700 1 -- 172.21.15.79:0/1406272994 learned_addr learned my addr 172.21.15.79:0/1406272994 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048bfff700 1 -- 172.21.15.79:0/1406272994 >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 msgr2=0x7f04940c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f0498b1b700 1 --2- 172.21.15.79:0/1406272994 >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 0x7f04940c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048bfff700 1 --2- 172.21.15.79:0/1406272994 >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 0x7f04940c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048bfff700 1 -- 172.21.15.79:0/1406272994 >> v1:172.21.15.79:6789/0 conn(0x7f049406dad0 legacy=0x7f04940cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048b7fe700 1 -- 172.21.15.79:0/1406272994 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501815082 0 0) 0x7f049415de60 con 0x7f049406dad0 2023-10-14T18:51:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048bfff700 1 -- 172.21.15.79:0/1406272994 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049415e700 con 0x7f04940b1220 2023-10-14T18:51:34.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f0498b1b700 1 --2- 172.21.15.79:0/1406272994 >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 0x7f04940c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048bfff700 1 --2- 172.21.15.79:0/1406272994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f049406d590 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f0494069840 tx=0x7f04840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49150baae541f87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048b7fe700 1 -- 172.21.15.79:0/1406272994 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400b6b0 con 0x7f04940b1220 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048b7fe700 1 -- 172.21.15.79:0/1406272994 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048400b810 con 0x7f04940b1220 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f048b7fe700 1 -- 172.21.15.79:0/1406272994 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400bbb0 con 0x7f04940b1220 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f049ad7f700 1 -- 172.21.15.79:0/1406272994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 msgr2=0x7f049406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.534+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1406272994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f049406d590 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f0494069840 tx=0x7f04840091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 -- 172.21.15.79:0/1406272994 shutdown_connections 2023-10-14T18:51:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1406272994 >> v2:172.21.15.144:3300/0 conn(0x7f04940b0e50 0x7f04940c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1406272994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f049406d590 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 -- 172.21.15.79:0/1406272994 >> 172.21.15.79:0/1406272994 conn(0x7f0494069870 msgr2=0x7f0494069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:34.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 -- 172.21.15.79:0/1406272994 shutdown_connections 2023-10-14T18:51:34.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.535+0000 7f049ad7f700 1 -- 172.21.15.79:0/1406272994 wait complete. 2023-10-14T18:51:34.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.536+0000 7f049ad7f700 1 Processor -- start 2023-10-14T18:51:34.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.536+0000 7f049ad7f700 1 -- start start 2023-10-14T18:51:34.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.536+0000 7f049ad7f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f049406dad0 0x7f049415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 0x7f04940c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c7cf0 con 0x7f04940b1220 2023-10-14T18:51:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c8b30 con 0x7f04940b0e50 2023-10-14T18:51:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940c7f20 con 0x7f049406dad0 2023-10-14T18:51:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47972/0 (socket says 172.21.15.79:47972) 2023-10-14T18:51:34.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 -- 172.21.15.79:0/1986628822 learned_addr learned my addr 172.21.15.79:0/1986628822 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:34.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f048bfff700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 0x7f04940c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f0498b1b700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f049406dad0 0x7f049415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 -- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f049406dad0 msgr2=0x7f049415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f049406dad0 0x7f049415ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 -- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 msgr2=0x7f04940c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 0x7f04940c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009420 con 0x7f04940b1220 2023-10-14T18:51:34.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f048bfff700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 0x7f04940c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:34.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049931c700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c5b0 tx=0x7f048c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:34.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c005b30 con 0x7f04940b1220 2023-10-14T18:51:34.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c005c90 con 0x7f04940b1220 2023-10-14T18:51:34.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940c8200 con 0x7f04940b1220 2023-10-14T18:51:34.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c0072e0 con 0x7f04940b1220 2023-10-14T18:51:34.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.537+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940c87c0 con 0x7f04940b1220 2023-10-14T18:51:34.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.538+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04940c8ca0 con 0x7f04940b1220 2023-10-14T18:51:34.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.539+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f048c007690 con 0x7f04940b1220 2023-10-14T18:51:34.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.539+0000 7f0488ff9700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:34.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.539+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f048c083900 con 0x7f04940b1220 2023-10-14T18:51:34.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.539+0000 7f0498b1b700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:34.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.539+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f048006ea50 con 0x7f04940b1220 2023-10-14T18:51:34.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.540+0000 7f0498b1b700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 0x7f04800693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f049000e650 tx=0x7f0490007710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:34.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.543+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f048c04b5a0 con 0x7f04940b1220 2023-10-14T18:51:34.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.730+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f049404c3c0 con 0x7f04940b1220 2023-10-14T18:51:34.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.732+0000 7f0488ff9700 1 -- 172.21.15.79:0/1986628822 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f048c017020 con 0x7f04940b1220 2023-10-14T18:51:34.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:34.734 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 140, 2023-10-14T18:51:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:34.734 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:34.735 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:32.536737+0000", 2023-10-14T18:51:34.735 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:34.735 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:34.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:34.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:34.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:34.736 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:34.736 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:34.736 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:34.736 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:34.737 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.737 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:34.737 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:34.737 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:34.737 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:34.738 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:34.738 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:34.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:34.738 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:34.738 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:34.739 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:34.739 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:34.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.739 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:34.739 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:34.740 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:34.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:34.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:34.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:34.740 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:34.741 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:34.741 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:34.741 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:34.741 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:34.741 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:34.742 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:34.742 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:34.742 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:34.742 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:34.742 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:34.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:34.744 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:34.744 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:34.744 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:34.744 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:34.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:34.745 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:34.746 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:34.746 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:34.746 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:34.746 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:34.746 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:34.747 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:34.747 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:34.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:34.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:34.748 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:34.748 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:34.749 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:34.749 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:34.749 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:34.750 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:34.750 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:34.750 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:34.751 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:34.751 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:34.751 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:34.752 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:34.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:34.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.753 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:34.753 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:34.753 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:34.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:34.753 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:34.754 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:34.754 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:34.754 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:34.754 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:34.754 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:34.755 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:34.755 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:34.755 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:34.755 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:34.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:34.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:34.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:34.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:34.758 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:34.758 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:34.758 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:34.759 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:34.759 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:34.759 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:34.759 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:34.759 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:34.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:34.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:34.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:34.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:34.760 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:34.762 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:34.762 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:34.762 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:34.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.762 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:34.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:34.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:34.763 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:34.763 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:34.764 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:34.764 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:34.764 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:34.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:34.765 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:34.765 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:34.765 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:34.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:34.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:34.766 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:34.766 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:34.766 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:34.766 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:34.766 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:34.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:34.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:34.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:34.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:34.768 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:34.768 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:34.768 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:34.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:34.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.769 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:34.769 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:34.769 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:34.769 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:34.770 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:34.770 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:34.770 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:34.770 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:34.770 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:34.771 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:34.771 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:34.771 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:34.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:34.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:34.772 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:34.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.772 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:34.772 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:34.772 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:34.773 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:34.774 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:34.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:51:34.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:51:34.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:34.775 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:34.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:34.775 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:34.775 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:34.775 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:34.776 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:34.776 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:34.776 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:34.776 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:34.776 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:34.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:34.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:34.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:34.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:34.778 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:34.778 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:34.779 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:34.779 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:34.779 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:34.779 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:34.780 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:34.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "140", 2023-10-14T18:51:34.780 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:34.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:34.781 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:34.781 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:34.781 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:34.781 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:34.782 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:34.782 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:34.782 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:34.782 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:34.782 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:34.783 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:34.784 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:34.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:34.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:34.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:34.784 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:34.785 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:34.785 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:34.785 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:34.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:34.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.786 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:34.786 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:34.786 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:34.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:34.787 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:34.787 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:34.787 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:34.787 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:34.788 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:34.788 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:34.788 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:34.788 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:34.788 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:34.789 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:34.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.789 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:34.789 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:34.789 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:34.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.790 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.790 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:34.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.791 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:34.791 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.791 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.792 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.792 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.792 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.792 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.792 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.793 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.793 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.793 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.793 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.793 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:34.794 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.795 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:34.795 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:34.797 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.798 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:34.798 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.799 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.800 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:34.800 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.801 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:34.801 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.802 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.802 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.802 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.805 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:34.805 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:34.805 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:34.805 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:34.805 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.806 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.806 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.806 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.807 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:34.807 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.807 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.807 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.810 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:34.810 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.814 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:34.814 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.815 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:34.817 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.818 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.818 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.819 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:34.819 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.820 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:34.820 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:34.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.820 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.821 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:34.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:34.821 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:34.821 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:34.822 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.822 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.822 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.823 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.824 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.824 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.824 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.824 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.825 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.825 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.825 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.825 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.826 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.826 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:34.826 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.827 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:34.827 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.829 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:34.829 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.830 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:34.830 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.830 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.831 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:34.832 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.832 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:34.833 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.833 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.834 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.834 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:34.834 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:34.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.836 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:34.836 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:34.836 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:34.837 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:34.837 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.837 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.837 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.837 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.838 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:34.838 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.838 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.839 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.840 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.840 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.840 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.840 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.840 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.841 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:34.841 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.842 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:34.842 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.844 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:34.844 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.845 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:34.845 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.845 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.846 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.846 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.846 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:34.847 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.848 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:34.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:34.851 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.852 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.853 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.854 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.856 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.857 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:34.858 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:34.859 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.860 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:34.869 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.871 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.872 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.873 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.874 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.875 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.876 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.878 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.879 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.880 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.883 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.884 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.885 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.886 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:34.888 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.890 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.891 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:34.893 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:34.895 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.896 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:34.898 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.899 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.900 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.901 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.902 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.907 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.912 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.917 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.920 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:34.922 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:34.925 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:34.926 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:34.927 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:34.928 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:34.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:34.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:34.937 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.939 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:34.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:34.970 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 msgr2=0x7f04800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 0x7f04800693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f049000e650 tx=0x7f0490007710 comp rx=0 tx=0).stop 2023-10-14T18:51:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 msgr2=0x7f0494144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c5b0 tx=0x7f048c007d30 comp rx=0 tx=0).stop 2023-10-14T18:51:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 shutdown_connections 2023-10-14T18:51:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0480066f30 0x7f04800693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04940b1220 0x7f0494144160 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f049406dad0 0x7f049415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 --2- 172.21.15.79:0/1986628822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04940b0e50 0x7f04940c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.734+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 >> 172.21.15.79:0/1986628822 conn(0x7f0494069870 msgr2=0x7f0494156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.735+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 shutdown_connections 2023-10-14T18:51:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:34.735+0000 7f049ad7f700 1 -- 172.21.15.79:0/1986628822 wait complete. 2023-10-14T18:51:34.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.088+0000 7f858d92b700 1 Processor -- start 2023-10-14T18:51:35.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.088+0000 7f858d92b700 1 -- start start 2023-10-14T18:51:35.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f858d92b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85880a7b20 0x7f85880b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f858d92b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85880990a0 con 0x7f858806f1c0 2023-10-14T18:51:35.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f858d92b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8588064120 con 0x7f8588063cf0 2023-10-14T18:51:35.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f858d92b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85880984b0 con 0x7f85880a7b20 2023-10-14T18:51:35.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f8586ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f85880a7b20 0x7f85880b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f85877fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f858806f1c0 0x7f8588099530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59754/0 (socket says 172.21.15.79:59754) 2023-10-14T18:51:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.089+0000 7f85877fe700 1 -- 172.21.15.79:0/1434781571 learned_addr learned my addr 172.21.15.79:0/1434781571 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8586ffd700 1 -- 172.21.15.79:0/1434781571 >> v1:172.21.15.144:6789/0 conn(0x7f8588063cf0 legacy=0x7f858806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8586ffd700 1 -- 172.21.15.79:0/1434781571 >> v1:172.21.15.79:6789/0 conn(0x7f858806f1c0 legacy=0x7f8588099530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8586ffd700 1 -- 172.21.15.79:0/1434781571 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588098770 con 0x7f85880a7b20 2023-10-14T18:51:35.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8585ffb700 1 -- 172.21.15.79:0/1434781571 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936501794 0 0) 0x7f85880990a0 con 0x7f858806f1c0 2023-10-14T18:51:35.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8586ffd700 1 --2- 172.21.15.79:0/1434781571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85880a7b20 0x7f85880b2ce0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8578009e60 tx=0x7f8578009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c8ad9b7cd91972 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8585ffb700 1 -- 172.21.15.79:0/1434781571 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857800e070 con 0x7f85880a7b20 2023-10-14T18:51:35.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8585ffb700 1 -- 172.21.15.79:0/1434781571 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857800bbf0 con 0x7f85880a7b20 2023-10-14T18:51:35.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f8585ffb700 1 -- 172.21.15.79:0/1434781571 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8578012430 con 0x7f85880a7b20 2023-10-14T18:51:35.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f858d92b700 1 -- 172.21.15.79:0/1434781571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85880a7b20 msgr2=0x7f85880b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f858d92b700 1 --2- 172.21.15.79:0/1434781571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85880a7b20 0x7f85880b2ce0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f8578009e60 tx=0x7f8578009780 comp rx=0 tx=0).stop 2023-10-14T18:51:35.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f858d92b700 1 -- 172.21.15.79:0/1434781571 shutdown_connections 2023-10-14T18:51:35.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f858d92b700 1 --2- 172.21.15.79:0/1434781571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85880a7b20 0x7f85880b2ce0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.090+0000 7f858d92b700 1 -- 172.21.15.79:0/1434781571 >> 172.21.15.79:0/1434781571 conn(0x7f85880cd1e0 msgr2=0x7f85880cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:35.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.091+0000 7f858d92b700 1 -- 172.21.15.79:0/1434781571 shutdown_connections 2023-10-14T18:51:35.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.091+0000 7f858d92b700 1 -- 172.21.15.79:0/1434781571 wait complete. 2023-10-14T18:51:35.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 Processor -- start 2023-10-14T18:51:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 -- start start 2023-10-14T18:51:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8588063cf0 0x7f858816cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85880a7b20 0x7f85880aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858815eac0 con 0x7f858806f1c0 2023-10-14T18:51:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858815deb0 con 0x7f8588063cf0 2023-10-14T18:51:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.092+0000 7f858d92b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858815e190 con 0x7f85880a7b20 2023-10-14T18:51:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47992/0 (socket says 172.21.15.79:47992) 2023-10-14T18:51:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 -- 172.21.15.79:0/3878414865 learned_addr learned my addr 172.21.15.79:0/3878414865 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f8586ffd700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8588063cf0 0x7f858816cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85877fe700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85880a7b20 0x7f85880aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 -- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85880a7b20 msgr2=0x7f85880aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85880a7b20 0x7f85880aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 -- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8588063cf0 msgr2=0x7f858816cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8588063cf0 0x7f858816cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8578009a20 con 0x7f858806f1c0 2023-10-14T18:51:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f85867fc700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c5d0 tx=0x7f857c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c011590 con 0x7f858806f1c0 2023-10-14T18:51:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c011710 con 0x7f858806f1c0 2023-10-14T18:51:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858815e470 con 0x7f858806f1c0 2023-10-14T18:51:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c011ad0 con 0x7f858806f1c0 2023-10-14T18:51:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.093+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858816d440 con 0x7f858806f1c0 2023-10-14T18:51:35.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.094+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858815ec70 con 0x7f858806f1c0 2023-10-14T18:51:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.095+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f857c01c460 con 0x7f858806f1c0 2023-10-14T18:51:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.095+0000 7f856effd700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 0x7f85740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.095+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f857c084330 con 0x7f858806f1c0 2023-10-14T18:51:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.095+0000 7f8586ffd700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 0x7f85740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.095+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f857406ea50 con 0x7f858806f1c0 2023-10-14T18:51:35.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.096+0000 7f8586ffd700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 0x7f85740693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f85780099f0 tx=0x7f8578018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.099+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f858815ec70 con 0x7f858806f1c0 2023-10-14T18:51:35.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.323+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f858804c3c0 con 0x7f858806f1c0 2023-10-14T18:51:35.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.324+0000 7f856effd700 1 -- 172.21.15.79:0/3878414865 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f857c0515a0 con 0x7f858806f1c0 2023-10-14T18:51:35.325 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:35.325 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:35.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 msgr2=0x7f85740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 0x7f85740693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f85780099f0 tx=0x7f8578018000 comp rx=0 tx=0).stop 2023-10-14T18:51:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 msgr2=0x7f85880aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c5d0 tx=0x7f857c007f60 comp rx=0 tx=0).stop 2023-10-14T18:51:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 shutdown_connections 2023-10-14T18:51:35.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8574066f30 0x7f85740693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85880a7b20 0x7f85880aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8588063cf0 0x7f858816cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 --2- 172.21.15.79:0/3878414865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f858806f1c0 0x7f85880aeab0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 >> 172.21.15.79:0/3878414865 conn(0x7f85880cd1e0 msgr2=0x7f85880999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 shutdown_connections 2023-10-14T18:51:35.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.326+0000 7f858d92b700 1 -- 172.21.15.79:0/3878414865 wait complete. 2023-10-14T18:51:35.329 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:35.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:51:35.470 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.787425431999999,"mdsmap_epoch":64,"osdmap_epoch":140,"osdmap_epoch_barrier":140,"uptime":21.921865124} 2023-10-14T18:51:35.471 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 64, "osdmap_epoch": 140, "osdmap_epoch_barrier": 140, "rank_uptime": 16.787425432, "state": "up:active", "uptime": 21.921865124, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:51:35.471 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:51:35.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:35.472 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-14T18:51:35.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:35.489 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-14T18:51:35.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.699+0000 7f4e38f42700 1 Processor -- start 2023-10-14T18:51:35.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.699+0000 7f4e38f42700 1 -- start start 2023-10-14T18:51:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e38f42700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e34157870 0x7f4e3415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e38f42700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e34158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e38f42700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3415cbb0 con 0x7f4e3415a620 2023-10-14T18:51:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e38f42700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3415bfa0 con 0x7f4e34157870 2023-10-14T18:51:35.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e38f42700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3415c280 con 0x7f4e34157c40 2023-10-14T18:51:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e3259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e34157870 0x7f4e3415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e29d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4e3415a620 0x7f4e3415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59766/0 (socket says 172.21.15.79:59766) 2023-10-14T18:51:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.700+0000 7f4e29d9b700 1 -- 172.21.15.79:0/1581113864 learned_addr learned my addr 172.21.15.79:0/1581113864 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e32d9d700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e34158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e3259c700 1 -- 172.21.15.79:0/1581113864 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 msgr2=0x7f4e34158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e3259c700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e34158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e3259c700 1 -- 172.21.15.79:0/1581113864 >> v1:172.21.15.79:6789/0 conn(0x7f4e3415a620 legacy=0x7f4e3415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e31d9b700 1 -- 172.21.15.79:0/1581113864 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288443158 0 0) 0x7f4e3415cbb0 con 0x7f4e3415a620 2023-10-14T18:51:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e3259c700 1 -- 172.21.15.79:0/1581113864 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3415c560 con 0x7f4e34157870 2023-10-14T18:51:35.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e32d9d700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e34158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e3259c700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e34157870 0x7f4e3415b6a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4e240098e0 tx=0x7f4e240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f3f81bda7e206b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e31d9b700 1 -- 172.21.15.79:0/1581113864 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24009e80 con 0x7f4e34157870 2023-10-14T18:51:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e31d9b700 1 -- 172.21.15.79:0/1581113864 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2400b860 con 0x7f4e34157870 2023-10-14T18:51:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e31d9b700 1 -- 172.21.15.79:0/1581113864 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2400bbe0 con 0x7f4e34157870 2023-10-14T18:51:35.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 -- 172.21.15.79:0/1581113864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e34157870 msgr2=0x7f4e3415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e34157870 0x7f4e3415b6a0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4e240098e0 tx=0x7f4e240091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 -- 172.21.15.79:0/1581113864 shutdown_connections 2023-10-14T18:51:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e34158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 --2- 172.21.15.79:0/1581113864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e34157870 0x7f4e3415b6a0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 -- 172.21.15.79:0/1581113864 >> 172.21.15.79:0/1581113864 conn(0x7f4e34068ce0 msgr2=0x7f4e340690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:35.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 -- 172.21.15.79:0/1581113864 shutdown_connections 2023-10-14T18:51:35.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.701+0000 7f4e38f42700 1 -- 172.21.15.79:0/1581113864 wait complete. 2023-10-14T18:51:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 Processor -- start 2023-10-14T18:51:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 -- start start 2023-10-14T18:51:35.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e34157870 0x7f4e34151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e3414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340b2500 con 0x7f4e3415a620 2023-10-14T18:51:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3414e290 con 0x7f4e34157870 2023-10-14T18:51:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e38f42700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340b0fe0 con 0x7f4e34157c40 2023-10-14T18:51:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e32d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e32d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48010/0 (socket says 172.21.15.79:48010) 2023-10-14T18:51:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.703+0000 7f4e32d9d700 1 -- 172.21.15.79:0/2364641525 learned_addr learned my addr 172.21.15.79:0/2364641525 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:35.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e29d9b700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e3414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 -- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 msgr2=0x7f4e3414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e3259c700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e34157870 0x7f4e34151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e3414fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 -- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e34157870 msgr2=0x7f4e34151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e34157870 0x7f4e34151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:35.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e24009420 con 0x7f4e3415a620 2023-10-14T18:51:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e32d9d700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a380 tx=0x7f4e2c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00ae10 con 0x7f4e3415a620 2023-10-14T18:51:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00d650 con 0x7f4e3415a620 2023-10-14T18:51:35.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3414dfb0 con 0x7f4e3415a620 2023-10-14T18:51:35.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00da10 con 0x7f4e3415a620 2023-10-14T18:51:35.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.704+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340b0990 con 0x7f4e3415a620 2023-10-14T18:51:35.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.705+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3404c3c0 con 0x7f4e3415a620 2023-10-14T18:51:35.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.705+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e2c01e3b0 con 0x7f4e3415a620 2023-10-14T18:51:35.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.706+0000 7f4e2affd700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 0x7f4e14069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:35.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.706+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e2c084e20 con 0x7f4e3415a620 2023-10-14T18:51:35.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.706+0000 7f4e3259c700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 0x7f4e14069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:35.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.706+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f4e1406ea80 con 0x7f4e3415a620 2023-10-14T18:51:35.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.706+0000 7f4e3259c700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 0x7f4e14069410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e240091e0 tx=0x7f4e24017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:35.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.710+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e2c01a020 con 0x7f4e3415a620 2023-10-14T18:51:35.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.893+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4e3415c840 con 0x7f4e3415a620 2023-10-14T18:51:35.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.894+0000 7f4e2affd700 1 -- 172.21.15.79:0/2364641525 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f4e2c052090 con 0x7f4e3415a620 2023-10-14T18:51:35.894 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:35.895 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:35.895 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 140, 2023-10-14T18:51:35.895 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:35.895 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:35.896 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:32.536737+0000", 2023-10-14T18:51:35.896 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:35.896 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:35.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:35.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:35.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:35.897 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:35.897 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:35.897 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:35.897 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:35.898 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:35.898 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:35.898 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:35.898 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:35.898 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:35.899 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:35.900 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:35.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.900 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:35.900 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:35.900 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:35.901 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:35.902 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:35.902 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:35.902 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:35.902 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:35.902 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:35.903 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:35.904 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:35.904 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:35.904 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:35.904 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:35.904 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:35.905 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:35.905 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:35.905 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:35.905 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:35.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:35.906 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:35.907 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:35.907 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:35.907 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:35.907 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:35.907 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:35.908 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:35.908 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:35.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:35.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:35.908 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:35.910 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:35.910 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:35.910 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:35.910 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:35.910 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:35.911 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:35.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:35.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.911 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:35.911 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:35.912 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:35.913 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:35.913 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:35.913 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:35.913 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:35.913 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:35.914 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:35.914 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:35.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.914 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:35.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:35.915 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:35.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:35.916 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:35.916 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:35.916 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:35.916 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:35.917 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:35.917 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:35.917 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:35.917 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:35.917 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:35.918 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:35.918 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:35.918 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:35.918 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:35.918 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:35.919 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:35.919 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:35.919 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:35.919 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:35.919 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:35.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:35.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:35.920 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:35.920 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:35.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.921 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:35.921 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:35.921 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:35.921 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:35.921 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:35.922 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:35.922 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:35.922 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:35.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:35.922 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:35.924 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:35.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:35.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:35.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:35.925 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:35.925 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:35.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:35.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:35.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:35.926 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:35.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:35.927 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:35.927 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:35.927 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:35.927 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:35.928 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:35.928 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:35.928 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:35.928 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:35.928 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:35.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:35.929 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:35.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.929 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:35.929 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:35.930 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:35.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:51:35.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:35.932 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:35.932 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:35.932 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:35.932 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:35.933 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:35.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:35.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:35.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:35.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:35.934 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:35.935 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:35.935 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:35.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:35.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:35.935 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:35.936 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:35.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "140", 2023-10-14T18:51:35.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:35.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:35.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:35.937 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:35.937 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:35.937 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:35.937 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:35.938 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:35.938 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:35.938 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:35.938 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:35.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:35.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:35.939 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:35.939 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:35.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:35.939 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:35.940 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:35.940 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:35.940 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:35.940 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:35.940 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:35.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:35.941 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:35.941 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:35.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:35.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.942 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:35.942 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:35.942 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:35.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:35.942 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:35.943 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:35.944 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:35.944 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:35.944 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:35.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.944 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:35.945 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:35.945 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:35.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.946 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:35.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:35.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:35.946 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:35.947 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:35.947 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:35.947 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:35.947 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:35.947 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:35.948 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:35.948 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:35.948 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:35.948 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:35.948 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:35.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:35.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:35.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:35.952 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:35.953 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.954 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:35.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:35.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:35.956 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.957 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:35.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.958 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:35.958 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:35.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:35.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:35.960 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:35.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:35.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.961 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:35.962 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:35.962 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:35.962 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:35.962 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:35.962 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:35.963 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:35.963 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:35.963 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:35.963 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:35.963 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:35.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:35.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.966 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.967 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:35.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:35.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:35.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:35.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:35.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.972 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:35.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.973 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:35.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:35.974 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:35.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.975 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:35.975 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:35.975 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:35.976 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:35.976 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:35.976 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:35.976 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:35.976 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:35.977 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:35.977 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:35.978 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:35.978 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:35.978 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:35.978 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:35.978 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:35.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.980 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:35.980 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.982 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:35.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:35.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:35.984 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.986 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:35.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:35.987 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.988 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:35.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:35.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:35.990 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:35.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.991 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:35.991 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:35.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:35.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:35.991 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:35.992 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:35.992 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:35.992 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.993 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:35.993 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:35.993 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:35.993 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:35.993 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:35.994 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:35.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:35.994 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:35.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:35.994 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:35.995 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:35.995 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:35.995 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:35.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.996 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:35.996 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:35.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:35.997 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:35.997 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:35.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:35.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:35.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.998 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:35.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:35.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:35.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.000 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:36.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:36.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.001 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:36.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:36.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:36.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:36.003 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:36.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.003 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:36.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:36.004 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:36.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:36.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.006 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:36.006 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:36.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:36.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:36.007 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:36.007 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:36.007 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:36.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.008 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:36.008 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:36.009 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:36.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:36.010 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:36.010 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:36.010 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:36.011 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.012 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:36.013 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.013 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:36.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:36.014 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.016 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:36.016 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:36.017 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:36.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.019 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:36.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:36.020 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.022 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:36.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:36.022 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:36.022 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:36.023 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:36.023 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:36.023 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:36.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:36.024 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:36.025 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:36.025 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:36.025 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:36.025 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:36.025 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:36.026 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:36.026 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:36.026 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:36.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:36.027 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:36.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:36.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.031 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:36.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:36.032 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:36.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:36.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:36.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:36.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.037 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:36.037 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:36.037 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:36.037 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:36.038 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:36.038 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:36.038 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:36.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.039 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:36.039 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:36.039 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:36.039 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:36.040 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:36.040 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:36.040 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:36.040 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:36.040 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:36.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:36.041 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:36.041 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:36.041 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:36.041 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.042 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:36.042 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.043 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:36.043 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.044 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:36.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:36.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:36.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.047 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:36.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:36.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.049 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:36.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:36.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:36.052 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:36.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.052 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:36.053 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:36.053 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:36.053 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:36.053 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:36.053 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:36.054 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:36.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.054 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:36.055 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:36.056 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:36.056 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:36.056 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:36.056 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:36.056 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:36.057 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:36.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:36.058 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.058 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:36.059 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.059 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:36.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:36.060 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:36.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.062 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:36.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:36.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:36.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:36.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:36.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:36.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:36.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.068 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:36.068 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:36.068 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:36.068 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:36.068 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:36.069 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:36.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.070 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:36.070 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.070 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.070 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.071 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.071 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.071 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:36.071 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.072 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:36.072 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.072 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.072 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.073 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.073 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.073 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:36.073 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.074 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:36.074 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.074 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.074 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.075 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.075 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:36.075 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.076 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:36.076 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.076 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.076 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.078 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:36.078 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.078 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.078 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:36.080 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.080 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.080 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.080 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.081 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.081 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:36.081 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.082 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.083 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.083 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:36.083 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:36.084 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:36.084 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:36.084 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:36.084 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:36.084 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:36.085 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:36.085 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:36.085 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:36.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.085 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:36.086 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:36.086 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:36.086 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:36.086 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:36.086 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:36.087 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:36.087 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:36.087 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:36.087 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:36.087 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:36.088 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:36.088 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:36.088 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:36.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:36.089 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:36.090 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:36.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:36.091 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:36.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 msgr2=0x7f4e14069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:36.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 0x7f4e14069410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4e240091e0 tx=0x7f4e24017000 comp rx=0 tx=0).stop 2023-10-14T18:51:36.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 msgr2=0x7f4e34153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:36.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00a380 tx=0x7f4e2c0078d0 comp rx=0 tx=0).stop 2023-10-14T18:51:36.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 shutdown_connections 2023-10-14T18:51:36.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4e14066f60 0x7f4e14069410 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:36.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e3415a620 0x7f4e34153a90 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:36.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e34157870 0x7f4e34151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:36.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 --2- 172.21.15.79:0/2364641525 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e34157c40 0x7f4e3414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:36.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 >> 172.21.15.79:0/2364641525 conn(0x7f4e34068ce0 msgr2=0x7f4e340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:36.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.895+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 shutdown_connections 2023-10-14T18:51:36.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:35.896+0000 7f4e38f42700 1 -- 172.21.15.79:0/2364641525 wait complete. 2023-10-14T18:51:36.096 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:51:39.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:39.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:41.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.221+0000 7f2564842700 1 Processor -- start 2023-10-14T18:51:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.221+0000 7f2564842700 1 -- start start 2023-10-14T18:51:41.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2560152020 0x7f25600ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f25601523f0 0x7f256006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f256015b7f0 0x7f256015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256015c1b0 con 0x7f256015b7f0 2023-10-14T18:51:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600cbb10 con 0x7f25601523f0 2023-10-14T18:51:41.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.222+0000 7f2564842700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600cbfa0 con 0x7f2560152020 2023-10-14T18:51:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f256015b7f0 0x7f256015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f256015b7f0 0x7f256015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48862/0 (socket says 172.21.15.79:48862) 2023-10-14T18:51:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 -- 172.21.15.79:0/1650193377 learned_addr learned my addr 172.21.15.79:0/1650193377 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:41.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255e59c700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2560152020 0x7f25600ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255dd9b700 1 --2- 172.21.15.79:0/1650193377 >> v2:172.21.15.144:3300/0 conn(0x7f25601523f0 0x7f256006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 -- 172.21.15.79:0/1650193377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2560152020 msgr2=0x7f25600ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2560152020 0x7f25600ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 -- 172.21.15.79:0/1650193377 >> v2:172.21.15.144:3300/0 conn(0x7f25601523f0 msgr2=0x7f256006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:41.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 --2- 172.21.15.79:0/1650193377 >> v2:172.21.15.144:3300/0 conn(0x7f25601523f0 0x7f256006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 -- 172.21.15.79:0/1650193377 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600caca0 con 0x7f256015b7f0 2023-10-14T18:51:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255ed9d700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f256015b7f0 0x7f256015bc70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f25600cae30 tx=0x7f2558009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2557fc2cd1b8214 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255d59a700 1 -- 172.21.15.79:0/1650193377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011630 con 0x7f256015b7f0 2023-10-14T18:51:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255d59a700 1 -- 172.21.15.79:0/1650193377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011790 con 0x7f256015b7f0 2023-10-14T18:51:41.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.223+0000 7f255d59a700 1 -- 172.21.15.79:0/1650193377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011b50 con 0x7f256015b7f0 2023-10-14T18:51:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 -- 172.21.15.79:0/1650193377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f256015b7f0 msgr2=0x7f256015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f256015b7f0 0x7f256015bc70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f25600cae30 tx=0x7f2558009250 comp rx=0 tx=0).stop 2023-10-14T18:51:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 -- 172.21.15.79:0/1650193377 shutdown_connections 2023-10-14T18:51:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2560152020 0x7f25600ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 --2- 172.21.15.79:0/1650193377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f256015b7f0 0x7f256015bc70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 --2- 172.21.15.79:0/1650193377 >> v2:172.21.15.144:3300/0 conn(0x7f25601523f0 0x7f256006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 -- 172.21.15.79:0/1650193377 >> 172.21.15.79:0/1650193377 conn(0x7f2560069870 msgr2=0x7f2560069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 -- 172.21.15.79:0/1650193377 shutdown_connections 2023-10-14T18:51:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.224+0000 7f2564842700 1 -- 172.21.15.79:0/1650193377 wait complete. 2023-10-14T18:51:41.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.225+0000 7f2564842700 1 Processor -- start 2023-10-14T18:51:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.225+0000 7f2564842700 1 -- start start 2023-10-14T18:51:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25601523f0 0x7f25600cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f256015b7f0 0x7f25600ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600c6530 con 0x7f2560152020 2023-10-14T18:51:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600cee50 con 0x7f25601523f0 2023-10-14T18:51:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600cf130 con 0x7f256015b7f0 2023-10-14T18:51:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48870/0 (socket says 172.21.15.79:48870) 2023-10-14T18:51:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 -- 172.21.15.79:0/97450592 learned_addr learned my addr 172.21.15.79:0/97450592 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255dd9b700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25601523f0 0x7f25600cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255ed9d700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f256015b7f0 0x7f25600ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 -- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f256015b7f0 msgr2=0x7f25600ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f256015b7f0 0x7f25600ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 -- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25601523f0 msgr2=0x7f25600cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25601523f0 0x7f25600cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580094f0 con 0x7f2560152020 2023-10-14T18:51:41.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f255e59c700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2550009ef0 tx=0x7f255000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000cb70 con 0x7f2560152020 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255000f040 con 0x7f2560152020 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600cf410 con 0x7f2560152020 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550014480 con 0x7f2560152020 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.226+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256016b4f0 con 0x7f2560152020 2023-10-14T18:51:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.227+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256004c3c0 con 0x7f2560152020 2023-10-14T18:51:41.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.228+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25500147f0 con 0x7f2560152020 2023-10-14T18:51:41.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.228+0000 7f25567fc700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 0x7f25400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:41.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.228+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2550084e60 con 0x7f2560152020 2023-10-14T18:51:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.228+0000 7f255dd9b700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 0x7f25400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.228+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=141}) v3 -- 0x7f254006ea50 con 0x7f2560152020 2023-10-14T18:51:41.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.229+0000 7f255dd9b700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 0x7f25400693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f256016c600 tx=0x7f25480091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:41.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.233+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25500520d0 con 0x7f2560152020 2023-10-14T18:51:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.416+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f25600c6810 con 0x7f2560152020 2023-10-14T18:51:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.417+0000 7f25567fc700 1 -- 172.21.15.79:0/97450592 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f25500556f0 con 0x7f2560152020 2023-10-14T18:51:41.419 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:41.419 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:41.419 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 140, 2023-10-14T18:51:41.419 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:41.420 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:41.420 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:32.536737+0000", 2023-10-14T18:51:41.420 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:41.420 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:41.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:41.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:41.421 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:41.421 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:41.421 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:41.421 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:41.422 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:41.422 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:41.422 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:41.423 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:41.423 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:41.423 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:41.423 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:41.423 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:41.424 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:41.424 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:41.424 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:41.424 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:41.425 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:41.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.425 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:41.425 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:41.425 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:41.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:41.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:41.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:41.426 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:41.427 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:41.427 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:41.427 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:41.427 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:41.427 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:41.428 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:41.428 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:41.428 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:41.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:41.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:41.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:41.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:41.429 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:41.430 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:41.430 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:41.430 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:41.430 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:41.431 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:41.431 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:41.431 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:41.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:41.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:41.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:41.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:41.432 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:41.433 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:41.433 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:41.433 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:41.433 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:41.433 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:41.434 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:41.434 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:41.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:41.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:41.434 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:41.435 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:41.435 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:41.435 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:41.435 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:41.435 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:41.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:41.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:41.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:41.436 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:41.436 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:41.437 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:41.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:41.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.437 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:41.437 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:41.438 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:41.438 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:41.438 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:41.438 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:41.438 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:41.439 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:41.439 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:41.440 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:41.440 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:41.440 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:41.440 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:41.441 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:41.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.442 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:41.442 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:41.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.443 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:41.443 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:41.443 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:41.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:41.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:41.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:41.444 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:41.444 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:41.444 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:41.445 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:41.445 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:41.445 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:41.445 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:41.445 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:41.446 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:41.446 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:41.446 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:41.446 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:41.448 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:41.448 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:41.448 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:41.449 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:41.449 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:41.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.449 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:41.450 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:41.450 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:41.450 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:41.450 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:41.451 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:41.451 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:41.451 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:41.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:41.451 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:41.452 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:41.452 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:41.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:41.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:41.453 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:41.454 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:41.454 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:41.454 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:41.454 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:41.454 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:41.455 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:41.455 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:41.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:41.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.455 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:41.456 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:41.456 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:41.456 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:41.456 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:41.457 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:41.457 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:41.457 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:41.457 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:41.457 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:41.458 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:41.458 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:41.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:41.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:41.458 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:41.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.459 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:41.459 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:41.459 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:41.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.461 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:41.461 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:41.461 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:41.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:51:41.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:51:41.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:41.462 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:41.462 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:41.462 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:41.463 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:41.463 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:41.463 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:41.463 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:41.464 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:41.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:41.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:41.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:41.464 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:41.465 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:41.465 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:41.465 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:41.465 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:41.465 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:41.466 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:41.466 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:41.466 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:41.466 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:41.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "140", 2023-10-14T18:51:41.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:41.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:41.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:41.467 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:41.468 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:41.468 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:41.468 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:41.468 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:41.468 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:41.469 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:41.469 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:41.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:41.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:41.469 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:41.470 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:41.470 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:41.471 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:41.471 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:41.471 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:41.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:41.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:41.473 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:41.473 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:41.473 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:41.474 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:41.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:41.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.475 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:41.475 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:41.476 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:41.476 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:41.477 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:41.477 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:41.477 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:41.478 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:41.478 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:41.478 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:41.479 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:41.479 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:41.480 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:41.480 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:41.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.481 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:41.481 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:41.482 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:41.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.483 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:41.484 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:41.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.485 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:41.485 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.485 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.486 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.486 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.487 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.487 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.487 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.488 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.488 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.489 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.489 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.490 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.491 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.492 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:41.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.494 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.495 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:41.496 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.500 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.501 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.502 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.503 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.504 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.505 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:41.510 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:41.511 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.512 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.513 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:41.513 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:41.514 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.515 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.518 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:41.518 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:41.518 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:41.518 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:41.518 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.519 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.519 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.520 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:41.520 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.520 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.520 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.520 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.521 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.521 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.521 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.521 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.521 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.522 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.522 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.522 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.524 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:41.524 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.525 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:41.526 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.526 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:41.527 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.528 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.529 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:41.529 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.530 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:41.530 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.531 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:41.533 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:41.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.533 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:41.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:41.534 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:41.534 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:41.535 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.535 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.535 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.535 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.536 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.537 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.537 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.538 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.538 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.538 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.538 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.539 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.539 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.539 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:41.540 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:41.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.542 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.543 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:41.543 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:41.544 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.545 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:41.547 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.548 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:41.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:41.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.550 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:41.550 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:41.551 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:41.551 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:41.551 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.551 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.551 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.554 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.554 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.554 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.554 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.554 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.555 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:41.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.557 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:41.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:41.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:41.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:41.562 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:41.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:41.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.566 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:41.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:41.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:41.567 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:41.567 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.567 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.568 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.569 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.569 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.570 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.570 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.570 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:41.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.573 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:41.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:41.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.575 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.576 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:41.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:41.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.578 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:41.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:41.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:41.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.581 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:41.581 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:41.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:41.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:41.582 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.582 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.582 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.583 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:41.583 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.584 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.584 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.584 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.584 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.584 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.585 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.585 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:41.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:41.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.588 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:41.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:41.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:41.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:41.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:41.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.597 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.598 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.598 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:41.599 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:41.600 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:41.600 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:41.600 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:41.600 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:41.600 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:41.601 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:41.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:41.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.603 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:41.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.604 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:41.604 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.606 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:41.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:41.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:41.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:41.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:41.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:41.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:41.610 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:41.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:41.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:41.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.612 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:41.612 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:41.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:41.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:41.612 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:41.613 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:41.613 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:41.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:41.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.613 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:41.614 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:41.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.614 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:41.614 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.614 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.615 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.615 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.615 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.615 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:41.615 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.616 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:41.616 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.616 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.617 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.617 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.617 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.617 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:41.617 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.618 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:41.618 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.619 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.620 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.621 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.621 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.621 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:41.621 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.622 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:41.622 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.622 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.623 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.623 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.623 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.623 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:41.623 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.624 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:41.624 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.624 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.625 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.625 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.625 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.625 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:41.625 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:41.626 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.626 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.627 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.627 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.627 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:41.627 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:41.628 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:41.629 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:41.629 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:41.629 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:41.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:41.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.630 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:41.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:41.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:41.630 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:41.630 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:41.631 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:41.631 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:41.631 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:41.631 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:41.631 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:41.632 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:41.632 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:41.632 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:41.632 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:41.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:41.633 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:41.634 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:41.634 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:41.634 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:41.634 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:41.635 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:41.635 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:41.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:41.635 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.419+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 msgr2=0x7f25400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 0x7f25400693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f256016c600 tx=0x7f25480091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 msgr2=0x7f25600ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f2550009ef0 tx=0x7f255000b040 comp rx=0 tx=0).stop 2023-10-14T18:51:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 shutdown_connections 2023-10-14T18:51:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2540066f30 0x7f25400693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f256015b7f0 0x7f25600ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560152020 0x7f25600ce790 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 --2- 172.21.15.79:0/97450592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25601523f0 0x7f25600cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 >> 172.21.15.79:0/97450592 conn(0x7f2560069870 msgr2=0x7f256014e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 shutdown_connections 2023-10-14T18:51:41.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:41.420+0000 7f2564842700 1 -- 172.21.15.79:0/97450592 wait complete. 2023-10-14T18:51:41.640 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:51:46.641 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.769+0000 7fcebb4c1700 1 Processor -- start 2023-10-14T18:51:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.770+0000 7fcebb4c1700 1 -- start start 2023-10-14T18:51:46.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fcebb4c1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fceb415a620 0x7fceb415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fcebb4c1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb415d580 0x7fceb4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fcebb4c1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb415cbb0 con 0x7fceb4157870 2023-10-14T18:51:46.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fcebb4c1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb415bdb0 con 0x7fceb415a620 2023-10-14T18:51:46.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fcebb4c1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415bfa0 con 0x7fceb415d580 2023-10-14T18:51:46.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb925d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fceb4157870 0x7fceb415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53974/0 (socket says 172.21.15.79:53974) 2023-10-14T18:51:46.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb925d700 1 -- 172.21.15.79:0/2392822139 learned_addr learned my addr 172.21.15.79:0/2392822139 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905282093 0 0) 0x7fceb415cbb0 con 0x7fceb4157870 2023-10-14T18:51:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003570 con 0x7fceb4157870 2023-10-14T18:51:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb415d580 0x7fceb4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/2392822139 >> v2:172.21.15.144:3300/0 conn(0x7fceb415a620 0x7fceb415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396740200 0 0) 0x7fcea0003570 con 0x7fceb4157870 2023-10-14T18:51:46.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb415d580 msgr2=0x7fceb4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:46.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb415d580 0x7fceb4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 >> v2:172.21.15.144:3300/0 conn(0x7fceb415a620 msgr2=0x7fceb415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:46.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 --2- 172.21.15.79:0/2392822139 >> v2:172.21.15.144:3300/0 conn(0x7fceb415a620 0x7fceb415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb415c280 con 0x7fceb4157870 2023-10-14T18:51:46.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fceb0001470 con 0x7fceb4157870 2023-10-14T18:51:46.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 >> v1:172.21.15.79:6789/0 conn(0x7fceb4157870 legacy=0x7fceb415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:46.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea00051c0 0x7fcea000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415bfa0 con 0x7fcea0004810 2023-10-14T18:51:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000bfd0 con 0x7fcea00051c0 2023-10-14T18:51:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000c190 con 0x7fcea0003a60 2023-10-14T18:51:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb415d580 0x7fceb4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:46.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.771+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb925d700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea00051c0 0x7fcea000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 -- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcea0003a60 msgr2=0x7fcea0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 -- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea00051c0 msgr2=0x7fcea000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:46.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea00051c0 0x7fcea000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 -- 172.21.15.79:0/2392822139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0003570 con 0x7fcea0004810 2023-10-14T18:51:46.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb925d700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcea0003a60 0x7fcea0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:46.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcea400bb60 tx=0x7fcea4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65062a61db79d48d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:46.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400d5d0 con 0x7fcea0004810 2023-10-14T18:51:46.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400d730 con 0x7fcea0004810 2023-10-14T18:51:46.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.772+0000 7fceabfff700 1 -- 172.21.15.79:0/2392822139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400daf0 con 0x7fcea0004810 2023-10-14T18:51:46.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 -- 172.21.15.79:0/2392822139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea0004810 msgr2=0x7fcea0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:46.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/2392822139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea0004810 0x7fcea0004c80 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fcea400bb60 tx=0x7fcea4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:46.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fceb9a5e700 1 -- 172.21.15.79:0/2392822139 reap_dead start 2023-10-14T18:51:46.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 -- 172.21.15.79:0/2392822139 shutdown_connections 2023-10-14T18:51:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 -- 172.21.15.79:0/2392822139 >> 172.21.15.79:0/2392822139 conn(0x7fceb4068ce0 msgr2=0x7fceb40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 -- 172.21.15.79:0/2392822139 shutdown_connections 2023-10-14T18:51:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.773+0000 7fcebb4c1700 1 -- 172.21.15.79:0/2392822139 wait complete. 2023-10-14T18:51:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.774+0000 7fcebb4c1700 1 Processor -- start 2023-10-14T18:51:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.774+0000 7fcebb4c1700 1 -- start start 2023-10-14T18:51:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 0x7fceb40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb4155320 0x7fceb40d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4154e90 con 0x7fceb4155790 2023-10-14T18:51:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40b3190 con 0x7fcea0004810 2023-10-14T18:51:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcebb4c1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4153fa0 con 0x7fceb4155320 2023-10-14T18:51:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48890/0 (socket says 172.21.15.79:48890) 2023-10-14T18:51:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 -- 172.21.15.79:0/3324676431 learned_addr learned my addr 172.21.15.79:0/3324676431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb8a5c700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb4155320 0x7fceb40d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb925d700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 0x7fceb40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 -- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb4155320 msgr2=0x7fceb40d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:46.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb4155320 0x7fceb40d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 -- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 msgr2=0x7fceb40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:46.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 0x7fceb40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:46.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 -- 172.21.15.79:0/3324676431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4154280 con 0x7fceb4155790 2023-10-14T18:51:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb925d700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 0x7fceb40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fceb9a5e700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fceb415d9e0 tx=0x7fceac0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac002b00 con 0x7fceb4155790 2023-10-14T18:51:46.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.775+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00f050 con 0x7fceb4155790 2023-10-14T18:51:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.776+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb4154560 con 0x7fceb4155790 2023-10-14T18:51:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.776+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac002e70 con 0x7fceb4155790 2023-10-14T18:51:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.776+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb4154b20 con 0x7fceb4155790 2023-10-14T18:51:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.776+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb404c3c0 con 0x7fceb4155790 2023-10-14T18:51:46.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.777+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fceac003040 con 0x7fceb4155790 2023-10-14T18:51:46.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.777+0000 7fcea97fa700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:46.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.777+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fceac084760 con 0x7fceb4155790 2023-10-14T18:51:46.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.778+0000 7fceb925d700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:46.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.778+0000 7fceb925d700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000e10 tx=0x7fceb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:46.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.781+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fceac0519d0 con 0x7fceb4155790 2023-10-14T18:51:46.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.964+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fceb4154fd0 con 0x7fceb4155790 2023-10-14T18:51:46.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.965+0000 7fcea97fa700 1 -- 172.21.15.79:0/3324676431 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fceac054ff0 con 0x7fceb4155790 2023-10-14T18:51:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:46.966 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 141, 2023-10-14T18:51:46.966 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:42.538675+0000", 2023-10-14T18:51:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:46.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:46.968 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:46.969 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:46.970 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:46.971 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:46.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:46.973 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:46.974 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:46.975 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:46.976 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:46.977 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:46.978 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:46.980 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:46.981 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:46.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:46.983 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:46.984 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.985 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:46.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:46.988 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:46.989 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:46.990 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:46.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:46.992 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:46.993 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:46.994 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:46.995 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:46.996 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:46.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:46.998 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:46.999 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:47.000 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:47.001 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:47.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:47.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:47.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:47.006 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:47.007 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "141", 2023-10-14T18:51:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:47.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:47.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:47.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:47.011 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:47.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.013 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:47.014 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:47.015 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:47.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.017 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.018 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.019 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.026 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.028 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:47.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:47.031 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.033 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.034 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.035 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.036 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.040 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:47.041 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.042 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:47.048 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.050 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.051 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.052 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:47.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:47.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.055 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:47.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:47.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:47.063 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.064 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:47.065 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.066 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.067 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:47.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:47.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:47.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:47.078 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:47.080 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.081 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.082 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:47.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:47.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:47.092 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:47.093 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.094 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:47.095 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.096 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.097 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:47.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:47.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.108 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.109 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.110 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.111 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.112 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:47.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:47.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.115 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:47.116 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:47.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.118 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.119 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:47.119 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.120 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:47.120 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.122 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:47.122 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:47.123 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.124 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:47.125 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:47.131 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:47.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.133 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:47.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:47.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.136 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.136 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:47.137 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.139 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.140 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.140 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.140 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:47.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.141 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:47.141 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.141 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.141 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.142 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.142 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.142 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:47.142 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.143 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:47.143 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.143 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.144 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.144 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.144 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:47.144 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.145 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:47.145 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.145 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.146 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.146 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.146 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:47.146 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.147 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:47.147 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.147 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.148 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.148 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.148 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:47.148 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.149 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:47.149 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.149 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.150 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.150 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.150 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:47.150 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.151 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:47.151 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.151 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.152 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.152 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.152 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:47.152 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.153 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:47.153 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.153 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.153 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.154 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.154 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.154 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:47.154 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.155 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:47.155 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.155 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.155 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.156 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.156 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.156 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:47.156 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.157 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.157 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:47.157 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:47.157 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:47.157 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:47.158 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:47.158 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:47.158 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:47.158 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:47.158 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.160 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:47.160 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:47.160 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:47.160 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:47.160 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:47.161 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:47.161 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:47.161 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:47.161 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:47.161 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:47.162 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:47.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.162 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:47.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 msgr2=0x7fce980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 0x7fce980693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000e10 tx=0x7fceb0009040 comp rx=0 tx=0).stop 2023-10-14T18:51:47.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 msgr2=0x7fceb40d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fceb415d9e0 tx=0x7fceac0098b0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 shutdown_connections 2023-10-14T18:51:47.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fce98066f30 0x7fce980693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fceb4155790 0x7fceb40d12a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea0004810 0x7fceb40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 --2- 172.21.15.79:0/3324676431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fceb4155320 0x7fceb40d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 >> 172.21.15.79:0/3324676431 conn(0x7fceb4068ce0 msgr2=0x7fceb414c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:47.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 shutdown_connections 2023-10-14T18:51:47.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:46.967+0000 7fcebb4c1700 1 -- 172.21.15.79:0/3324676431 wait complete. 2023-10-14T18:51:47.167 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-14T18:51:47.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:51:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.281+0000 7fd585aa8700 1 Processor -- start 2023-10-14T18:51:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.281+0000 7fd585aa8700 1 -- start start 2023-10-14T18:51:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd580157870 0x7fd58015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd58015a620 0x7fd58015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd580158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58015cbb0 con 0x7fd58015a620 2023-10-14T18:51:47.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58015bfa0 con 0x7fd580157870 2023-10-14T18:51:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd585aa8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58015c280 con 0x7fd58015d580 2023-10-14T18:51:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd57effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd58015a620 0x7fd58015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd57effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd58015a620 0x7fd58015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48900/0 (socket says 172.21.15.79:48900) 2023-10-14T18:51:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd57effd700 1 -- 172.21.15.79:0/1386780563 learned_addr learned my addr 172.21.15.79:0/1386780563 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:47.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd57f7fe700 1 --2- 172.21.15.79:0/1386780563 >> v2:172.21.15.144:3300/0 conn(0x7fd580157870 0x7fd58015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.282+0000 7fd57ffff700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd580158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 -- 172.21.15.79:0/1386780563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 msgr2=0x7fd580158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd580158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 -- 172.21.15.79:0/1386780563 >> v2:172.21.15.144:3300/0 conn(0x7fd580157870 msgr2=0x7fd58015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:47.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 --2- 172.21.15.79:0/1386780563 >> v2:172.21.15.144:3300/0 conn(0x7fd580157870 0x7fd58015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 -- 172.21.15.79:0/1386780563 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58015c560 con 0x7fd58015a620 2023-10-14T18:51:47.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57effd700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd58015a620 0x7fd58015d040 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd580069d80 tx=0x7fd574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3a38c93de6fa29 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57e7fc700 1 -- 172.21.15.79:0/1386780563 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400b640 con 0x7fd58015a620 2023-10-14T18:51:47.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57e7fc700 1 -- 172.21.15.79:0/1386780563 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57400b7a0 con 0x7fd58015a620 2023-10-14T18:51:47.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd57e7fc700 1 -- 172.21.15.79:0/1386780563 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57400bb60 con 0x7fd58015a620 2023-10-14T18:51:47.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 -- 172.21.15.79:0/1386780563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd58015a620 msgr2=0x7fd58015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd58015a620 0x7fd58015d040 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd580069d80 tx=0x7fd574009250 comp rx=0 tx=0).stop 2023-10-14T18:51:47.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 -- 172.21.15.79:0/1386780563 shutdown_connections 2023-10-14T18:51:47.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd580158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 --2- 172.21.15.79:0/1386780563 >> v2:172.21.15.144:3300/0 conn(0x7fd580157870 0x7fd58015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 --2- 172.21.15.79:0/1386780563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd58015a620 0x7fd58015d040 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 -- 172.21.15.79:0/1386780563 >> 172.21.15.79:0/1386780563 conn(0x7fd580068ce0 msgr2=0x7fd5800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 -- 172.21.15.79:0/1386780563 shutdown_connections 2023-10-14T18:51:47.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.283+0000 7fd585aa8700 1 -- 172.21.15.79:0/1386780563 wait complete. 2023-10-14T18:51:47.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 Processor -- start 2023-10-14T18:51:47.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 -- start start 2023-10-14T18:51:47.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 0x7fd5800b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd58014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800b2290 con 0x7fd580157870 2023-10-14T18:51:47.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800b2570 con 0x7fd58015a620 2023-10-14T18:51:47.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd585aa8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800b2850 con 0x7fd58015d580 2023-10-14T18:51:47.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd57f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48906/0 (socket says 172.21.15.79:48906) 2023-10-14T18:51:47.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.285+0000 7fd57f7fe700 1 -- 172.21.15.79:0/3882147999 learned_addr learned my addr 172.21.15.79:0/3882147999 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:47.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 -- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 msgr2=0x7fd58014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57effd700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 0x7fd5800b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57ffff700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd58014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd58014b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 -- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 msgr2=0x7fd5800b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 0x7fd5800b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 -- 172.21.15.79:0/3882147999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740094f0 con 0x7fd580157870 2023-10-14T18:51:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57ffff700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd58014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57effd700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 0x7fd5800b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd57f7fe700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ec80 tx=0x7fd5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57000c9d0 con 0x7fd580157870 2023-10-14T18:51:47.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000cb30 con 0x7fd580157870 2023-10-14T18:51:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5800b2b30 con 0x7fd580157870 2023-10-14T18:51:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570013470 con 0x7fd580157870 2023-10-14T18:51:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.286+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5800b1df0 con 0x7fd580157870 2023-10-14T18:51:47.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.287+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5800b2d20 con 0x7fd580157870 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.287+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd570013820 con 0x7fd580157870 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.288+0000 7fd5677fe700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.288+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5700848c0 con 0x7fd580157870 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.288+0000 7fd57effd700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.288+0000 7fd57effd700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 0x7fd56c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd580069d80 tx=0x7fd574017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.292+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd570051b30 con 0x7fd580157870 2023-10-14T18:51:47.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.476+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd58015e020 con 0x7fd580157870 2023-10-14T18:51:47.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.477+0000 7fd5677fe700 1 -- 172.21.15.79:0/3882147999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fd570055150 con 0x7fd580157870 2023-10-14T18:51:47.478 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:47.478 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:51:47.478 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 141, 2023-10-14T18:51:47.479 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:51:47.479 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:51:47.479 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:51:42.538675+0000", 2023-10-14T18:51:47.479 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:51:47.479 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:51:47.480 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:51:47.480 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:51:47.480 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:51:47.480 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:51:47.480 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:51:47.481 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:51:47.481 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:51:47.481 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.481 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:51:47.481 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:51:47.482 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:51:47.482 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:51:47.482 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:51:47.482 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 17, 2023-10-14T18:51:47.482 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:51:47.483 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:51:47.483 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:51:47.483 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:51:47.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:51:47.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:51:47.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:51:47.484 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:51:47.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:47.485 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:47.486 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:47.486 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:47.486 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:47.486 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:51:47.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:51:47.488 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:47.488 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:47.488 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:47.488 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:47.488 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:47.489 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:47.489 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:47.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.489 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:51:47.489 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:47.490 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:47.491 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:47.491 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:47.491 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:47.491 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:47.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:47.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:47.492 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:47.492 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:47.493 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:47.493 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:47.493 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:47.493 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:47.493 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:47.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:47.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.495 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:47.495 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:47.495 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:47.495 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:47.496 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:47.496 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:47.496 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:47.496 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:47.496 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:51:47.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.498 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:47.498 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:51:47.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 16, 2023-10-14T18:51:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:51:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:16.391202+0000", 2023-10-14T18:51:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:47.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:47.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:47.500 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:47.500 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:47.500 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:47.500 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:47.501 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:47.501 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:47.501 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:47.501 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:47.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:47.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:51:47.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:51:47.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:51:47.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:51:47.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:51:47.503 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:47.503 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:47.503 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:47.503 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:47.503 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:47.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:47.505 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:47.506 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:47.506 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:47.506 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:51:47.506 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:47.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:47.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:47.507 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:47.507 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:47.507 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:47.507 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:47.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:47.509 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:47.509 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:47.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:47.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.509 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:47.510 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:47.510 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:47.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:47.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:47.510 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:47.511 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:47.511 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:47.511 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:47.511 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:47.511 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:47.512 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:47.512 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:51:47.512 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:51:47.512 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:51:47.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:51:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.514 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 17, 2023-10-14T18:51:47.514 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:51:47.514 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:51:17.003227+0000", 2023-10-14T18:51:47.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:51:47.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:51:47.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:51:47.515 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:51:47.515 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:51:47.516 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:51:47.516 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:51:47.516 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:51:47.516 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:51:47.516 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:51:47.517 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:51:47.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:51:47.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:51:47.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:51:47.517 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:51:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:51:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:51:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:51:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:51:47.518 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:51:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:51:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:51:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:51:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:51:47.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.520 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "141", 2023-10-14T18:51:47.520 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:51:47.520 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:51:47.520 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:51:47.520 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:51:47.521 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:51:47.521 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:51:47.521 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:51:47.521 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:51:47.521 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:51:47.522 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:51:47.522 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:51:47.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:51:47.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:51:47.522 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:51:47.523 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:51:47.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:51:47.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:51:47.524 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:51:47.524 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:51:47.524 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:51:47.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:51:47.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.525 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:51:47.525 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:51:47.525 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:51:47.526 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:51:47.526 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:51:47.526 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:51:47.526 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:51:47.526 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:51:47.527 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:51:47.527 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:51:47.527 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:51:47.527 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:51:47.527 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:51:47.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.529 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.529 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:51:47.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.530 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:47.530 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.530 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.530 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.530 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.531 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.531 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.531 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.531 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.533 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:51:47.533 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:51:47.534 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:51:47.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:51:47.536 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.537 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:51:47.538 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:51:47.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:51:47.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:51:47.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:51:47.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:51:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:51:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:51:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:51:47.543 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.544 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:47.545 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.545 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.545 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.545 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.545 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.546 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.546 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.546 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.547 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.547 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:51:47.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:51:47.549 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.550 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:51:47.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.552 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:51:47.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:51:47.554 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:51:47.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:51:47.557 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:51:47.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.558 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:51:47.558 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:51:47.558 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:51:47.558 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:51:47.558 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.560 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:47.560 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.560 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.560 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.560 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.561 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.562 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.562 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.562 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:51:47.563 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.565 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:51:47.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:51:47.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.567 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:51:47.569 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:51:47.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:51:47.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:51:47.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:51:47.573 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.574 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.574 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.575 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:47.575 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.575 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.575 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.575 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.576 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.577 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.577 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:51:47.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:51:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:51:47.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:51:47.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.582 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:51:47.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:51:47.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:51:47.586 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.588 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:51:47.588 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:51:47.588 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:51:47.588 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:51:47.588 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.589 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.589 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.590 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:47.590 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.590 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.590 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.590 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.591 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.592 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.592 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:51:47.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:51:47.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:51:47.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:51:47.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:51:47.599 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:51:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:51:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:51:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:51:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:51:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:51:47.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:51:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.605 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.606 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:51:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:51:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:51:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:51:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:51:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:51:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:51:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:51:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:51:47.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.620 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:51:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:51:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:51:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:51:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:51:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:51:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.633 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.634 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:51:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:51:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:51:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:51:47.635 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 136, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:51:47.636 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:51:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:51:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:51:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.638 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:51:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.639 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:51:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:51:47.640 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:51:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:51:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:51:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.645 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:51:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:51:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:51:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:51:47.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:51:47.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:51:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:51:47.648 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:51:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:51:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:51:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:51:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:51:47.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:51:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:51:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.650 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.651 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:51:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:51:47.652 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.653 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:51:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:51:47.654 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.655 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:51:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:51:47.656 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.657 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:51:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:51:47.658 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.659 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:51:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:51:47.660 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:51:47.661 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:51:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.662 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:51:47.663 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:51:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:51:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:51:47.664 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:51:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:51:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:51:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:51:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:51:47.665 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:51:47.666 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:51:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:51:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:51:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:51:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:51:47.667 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:51:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:51:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:51:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:51:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:51:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:51:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:51:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:51:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:51:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:51:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:51:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:51:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:51:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:51:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:51:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:51:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:51:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:51:47.671 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:51:47.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 msgr2=0x7fd56c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 0x7fd56c0693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd580069d80 tx=0x7fd574017000 comp rx=0 tx=0).stop 2023-10-14T18:51:47.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 msgr2=0x7fd580149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd57000ec80 tx=0x7fd5700091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 shutdown_connections 2023-10-14T18:51:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd56c066f30 0x7fd56c0693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd58015d580 0x7fd58014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd580157870 0x7fd580149560 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 --2- 172.21.15.79:0/3882147999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd58015a620 0x7fd5800b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 >> 172.21.15.79:0/3882147999 conn(0x7fd580068ce0 msgr2=0x7fd58015a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:47.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 shutdown_connections 2023-10-14T18:51:47.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.479+0000 7fd585aa8700 1 -- 172.21.15.79:0/3882147999 wait complete. 2023-10-14T18:51:47.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:47.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 Processor -- start 2023-10-14T18:51:47.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 -- start start 2023-10-14T18:51:47.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1c015a620 0x7fe1c015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c015cbb0 con 0x7fe1c0157870 2023-10-14T18:51:47.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c015bfa0 con 0x7fe1c015d580 2023-10-14T18:51:47.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.790+0000 7fe1c49a2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c015bdb0 con 0x7fe1c015a620 2023-10-14T18:51:47.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1b5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1c015a620 0x7fe1c015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1be59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1c0157870 0x7fe1c015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53986/0 (socket says 172.21.15.79:53986) 2023-10-14T18:51:47.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1be59c700 1 -- 172.21.15.79:0/3486924729 learned_addr learned my addr 172.21.15.79:0/3486924729 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:47.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1bdd9b700 1 -- 172.21.15.79:0/3486924729 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489511575 0 0) 0x7fe1c015cbb0 con 0x7fe1c0157870 2023-10-14T18:51:47.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1bdd9b700 1 -- 172.21.15.79:0/3486924729 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1ac003570 con 0x7fe1c0157870 2023-10-14T18:51:47.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/3486924729 >> v1:172.21.15.144:6789/0 conn(0x7fe1c015d580 legacy=0x7fe1c0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/3486924729 >> v1:172.21.15.79:6789/0 conn(0x7fe1c0157870 legacy=0x7fe1c015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/3486924729 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c015c280 con 0x7fe1c015a620 2023-10-14T18:51:47.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1b5d9b700 1 --2- 172.21.15.79:0/3486924729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c015d040 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80098e0 tx=0x7fe1a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b42aec5a0b64543 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1bdd9b700 1 -- 172.21.15.79:0/3486924729 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800b640 con 0x7fe1c015a620 2023-10-14T18:51:47.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1bdd9b700 1 -- 172.21.15.79:0/3486924729 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a800b7a0 con 0x7fe1c015a620 2023-10-14T18:51:47.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.791+0000 7fe1bdd9b700 1 -- 172.21.15.79:0/3486924729 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800bb40 con 0x7fe1c015a620 2023-10-14T18:51:47.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 -- 172.21.15.79:0/3486924729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 msgr2=0x7fe1c015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/3486924729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c015d040 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80098e0 tx=0x7fe1a80091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 -- 172.21.15.79:0/3486924729 shutdown_connections 2023-10-14T18:51:47.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/3486924729 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c015d040 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 -- 172.21.15.79:0/3486924729 >> 172.21.15.79:0/3486924729 conn(0x7fe1c0068ce0 msgr2=0x7fe1c00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:47.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 -- 172.21.15.79:0/3486924729 shutdown_connections 2023-10-14T18:51:47.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.792+0000 7fe1c49a2700 1 -- 172.21.15.79:0/3486924729 wait complete. 2023-10-14T18:51:47.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.793+0000 7fe1c49a2700 1 Processor -- start 2023-10-14T18:51:47.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.793+0000 7fe1c49a2700 1 -- start start 2023-10-14T18:51:47.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 0x7fe1c014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1c015d580 0x7fe1c0154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b2890 con 0x7fe1c015a620 2023-10-14T18:51:47.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b1c80 con 0x7fe1c015d580 2023-10-14T18:51:47.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b1f60 con 0x7fe1c0157870 2023-10-14T18:51:47.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48926/0 (socket says 172.21.15.79:48926) 2023-10-14T18:51:47.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/78676654 learned_addr learned my addr 172.21.15.79:0/78676654 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:47.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1be59c700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 0x7fe1c014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1bed9d700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1c015d580 0x7fe1c0154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 msgr2=0x7fe1c014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 0x7fe1c014bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1c015d580 msgr2=0x7fe1c0154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:47.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1c015d580 0x7fe1c0154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:47.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 -- 172.21.15.79:0/78676654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8009420 con 0x7fe1c015a620 2023-10-14T18:51:47.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1be59c700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 0x7fe1c014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:47.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b5d9b700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8013000 tx=0x7fe1a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800bb20 con 0x7fe1c015a620 2023-10-14T18:51:47.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8011420 con 0x7fe1c015a620 2023-10-14T18:51:47.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00b2240 con 0x7fe1c015a620 2023-10-14T18:51:47.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80117c0 con 0x7fe1c015a620 2023-10-14T18:51:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.794+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00b18e0 con 0x7fe1c015a620 2023-10-14T18:51:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.795+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c004c3c0 con 0x7fe1c015a620 2023-10-14T18:51:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.796+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1a8011b70 con 0x7fe1c015a620 2023-10-14T18:51:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.796+0000 7fe1b6ffd700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 0x7fe1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:47.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.796+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1a8085c30 con 0x7fe1c015a620 2023-10-14T18:51:47.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.796+0000 7fe1be59c700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 0x7fe1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:47.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.797+0000 7fe1be59c700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 0x7fe1a00693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00058d0 tx=0x7fe1b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:47.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:47.800+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1a8052ea0 con 0x7fe1c015a620 2023-10-14T18:51:48.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.024+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1c015c560 con 0x7fe1c015a620 2023-10-14T18:51:48.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.024+0000 7fe1b6ffd700 1 -- 172.21.15.79:0/78676654 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fe1a80564c0 con 0x7fe1c015a620 2023-10-14T18:51:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:48.025 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 msgr2=0x7fe1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 0x7fe1a00693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00058d0 tx=0x7fe1b0009040 comp rx=0 tx=0).stop 2023-10-14T18:51:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 msgr2=0x7fe1c00cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8013000 tx=0x7fe1a8017000 comp rx=0 tx=0).stop 2023-10-14T18:51:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 shutdown_connections 2023-10-14T18:51:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1a0066f30 0x7fe1a00693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1c015d580 0x7fe1c0154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe1c0157870 0x7fe1c014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 --2- 172.21.15.79:0/78676654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c015a620 0x7fe1c00cfc70 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 >> 172.21.15.79:0/78676654 conn(0x7fe1c0068ce0 msgr2=0x7fe1c0158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 shutdown_connections 2023-10-14T18:51:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.026+0000 7fe1c49a2700 1 -- 172.21.15.79:0/78676654 wait complete. 2023-10-14T18:51:48.029 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:48.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-10-14T18:51:48.171 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":7101,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.486267130000002,"mdsmap_epoch":64,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":34.620705825000002} 2023-10-14T18:51:48.171 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 7101, "mdsmap_epoch": 64, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 29.48626713, "state": "up:active", "uptime": 34.620705825, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:51:48.172 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:51:48.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:48.173 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-14T18:51:48.461 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:51:48.462 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:51:48.462 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.272886 s, 192 MB/s 2023-10-14T18:51:48.463 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:51:48.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:48.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:48.543 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:51:48.543 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:51:48.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:48.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:51:48.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:51:48.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:48.609 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:51:48.624 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:51:48.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:51:48.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:51:48.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:51:48.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:51:48.665 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:51:48.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:48.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.835+0000 7f18d521c700 1 Processor -- start 2023-10-14T18:51:48.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.835+0000 7f18d521c700 1 -- start start 2023-10-14T18:51:48.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18d521c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d015a620 0x7f18d015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18d521c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 0x7f18d0158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18d521c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d015cbb0 con 0x7f18d0157870 2023-10-14T18:51:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18d521c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d015bdb0 con 0x7f18d015a620 2023-10-14T18:51:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18d521c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d015bfa0 con 0x7f18d015d580 2023-10-14T18:51:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d015a620 0x7f18d015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f18d015a620 0x7f18d015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33252/0 (socket says 172.21.15.79:33252) 2023-10-14T18:51:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 -- 172.21.15.79:0/2593727389 learned_addr learned my addr 172.21.15.79:0/2593727389 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18cf59e700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 0x7f18d0158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 -- 172.21.15.79:0/2593727389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 msgr2=0x7f18d0158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 0x7f18d0158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 -- 172.21.15.79:0/2593727389 >> v1:172.21.15.144:6789/0 conn(0x7f18d0157870 legacy=0x7f18d015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 -- 172.21.15.79:0/2593727389 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d015c280 con 0x7f18d015a620 2023-10-14T18:51:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18cf59e700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 0x7f18d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:48.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18ce59c700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d015a620 0x7f18d015d040 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f18c40099b0 tx=0x7f18c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dbf0a2c9ba61ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18cdd9b700 1 -- 172.21.15.79:0/2593727389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400b860 con 0x7f18d015a620 2023-10-14T18:51:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18cdd9b700 1 -- 172.21.15.79:0/2593727389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400b9c0 con 0x7f18d015a620 2023-10-14T18:51:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.836+0000 7f18cdd9b700 1 -- 172.21.15.79:0/2593727389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400bd60 con 0x7f18d015a620 2023-10-14T18:51:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 -- 172.21.15.79:0/2593727389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d015a620 msgr2=0x7f18d015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d015a620 0x7f18d015d040 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f18c40099b0 tx=0x7f18c4009250 comp rx=0 tx=0).stop 2023-10-14T18:51:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 -- 172.21.15.79:0/2593727389 shutdown_connections 2023-10-14T18:51:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015d580 0x7f18d0158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 --2- 172.21.15.79:0/2593727389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d015a620 0x7f18d015d040 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 -- 172.21.15.79:0/2593727389 >> 172.21.15.79:0/2593727389 conn(0x7f18d0068ce0 msgr2=0x7f18d00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:48.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 -- 172.21.15.79:0/2593727389 shutdown_connections 2023-10-14T18:51:48.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.837+0000 7f18d521c700 1 -- 172.21.15.79:0/2593727389 wait complete. 2023-10-14T18:51:48.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.838+0000 7f18d521c700 1 Processor -- start 2023-10-14T18:51:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.838+0000 7f18d521c700 1 -- start start 2023-10-14T18:51:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 0x7f18d01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 0x7f18d0154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d014dfb0 con 0x7f18d0157870 2023-10-14T18:51:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d014d680 con 0x7f18d015d580 2023-10-14T18:51:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18d521c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d014d960 con 0x7f18d015a620 2023-10-14T18:51:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33266/0 (socket says 172.21.15.79:33266) 2023-10-14T18:51:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 -- 172.21.15.79:0/1777670446 learned_addr learned my addr 172.21.15.79:0/1777670446 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ce59c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 0x7f18d01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18cf59e700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 0x7f18d0154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 -- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 msgr2=0x7f18d01548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 0x7f18d01548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 -- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 msgr2=0x7f18d0154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:48.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 0x7f18d0154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:48.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ced9d700 1 -- 172.21.15.79:0/1777670446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c40094f0 con 0x7f18d0157870 2023-10-14T18:51:48.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18ce59c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 0x7f18d01548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.839+0000 7f18cf59e700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 0x7f18d0154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18ced9d700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f18c000c590 tx=0x7f18c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0011590 con 0x7f18d0157870 2023-10-14T18:51:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00116f0 con 0x7f18d0157870 2023-10-14T18:51:48.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c0011ab0 con 0x7f18d0157870 2023-10-14T18:51:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d014dc40 con 0x7f18d0157870 2023-10-14T18:51:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.840+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d00d1480 con 0x7f18d0157870 2023-10-14T18:51:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.841+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d014e340 con 0x7f18d0157870 2023-10-14T18:51:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.841+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18c001b3b0 con 0x7f18d0157870 2023-10-14T18:51:48.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.841+0000 7f18b6ffd700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 0x7f18bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:48.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.841+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18c0083ae0 con 0x7f18d0157870 2023-10-14T18:51:48.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.842+0000 7f18ce59c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 0x7f18bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:48.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.842+0000 7f18ce59c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 0x7f18bc0693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f18c40099b0 tx=0x7f18c4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:48.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:48.846+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18d014e340 con 0x7f18d0157870 2023-10-14T18:51:49.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.070+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18d014e340 con 0x7f18d0157870 2023-10-14T18:51:49.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.070+0000 7f18b6ffd700 1 -- 172.21.15.79:0/1777670446 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f18d014e340 con 0x7f18d0157870 2023-10-14T18:51:49.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:49.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 msgr2=0x7f18bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 0x7f18bc0693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f18c40099b0 tx=0x7f18c4017000 comp rx=0 tx=0).stop 2023-10-14T18:51:49.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 msgr2=0x7f18d00d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f18c000c590 tx=0x7f18c000c950 comp rx=0 tx=0).stop 2023-10-14T18:51:49.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 shutdown_connections 2023-10-14T18:51:49.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f18bc066f30 0x7f18bc0693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18d015d580 0x7f18d0154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18d0157870 0x7f18d00d0f40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 --2- 172.21.15.79:0/1777670446 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f18d015a620 0x7f18d01548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 >> 172.21.15.79:0/1777670446 conn(0x7f18d0068ce0 msgr2=0x7f18d014fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 shutdown_connections 2023-10-14T18:51:49.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.072+0000 7f18d521c700 1 -- 172.21.15.79:0/1777670446 wait complete. 2023-10-14T18:51:49.078 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:49.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:49.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.199+0000 7f3259df0700 1 Processor -- start 2023-10-14T18:51:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.199+0000 7f3259df0700 1 -- start start 2023-10-14T18:51:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3259df0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3254157870 0x7f325415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3259df0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3254157c40 0x7f3254158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3259df0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325415cbb0 con 0x7f325415a620 2023-10-14T18:51:49.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3259df0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325415bfa0 con 0x7f3254157c40 2023-10-14T18:51:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3259df0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325415c280 con 0x7f3254157870 2023-10-14T18:51:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3254157c40 0x7f3254158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3252ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f325415a620 0x7f325415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44428/0 (socket says 172.21.15.79:44428) 2023-10-14T18:51:49.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3252ffd700 1 -- 172.21.15.79:0/1174322151 learned_addr learned my addr 172.21.15.79:0/1174322151 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f32537fe700 1 --2- 172.21.15.79:0/1174322151 >> v2:172.21.15.144:3300/0 conn(0x7f3254157870 0x7f325415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 -- 172.21.15.79:0/1174322151 >> v2:172.21.15.144:3300/0 conn(0x7f3254157870 msgr2=0x7f325415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 --2- 172.21.15.79:0/1174322151 >> v2:172.21.15.144:3300/0 conn(0x7f3254157870 0x7f325415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 -- 172.21.15.79:0/1174322151 >> v1:172.21.15.79:6789/0 conn(0x7f325415a620 legacy=0x7f325415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 -- 172.21.15.79:0/1174322151 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325415c560 con 0x7f3254157c40 2023-10-14T18:51:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f3253fff700 1 --2- 172.21.15.79:0/1174322151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f3254158110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3254069d80 tx=0x7f324c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f9e728b98a4c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f32527fc700 1 -- 172.21.15.79:0/1174322151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00b6b0 con 0x7f3254157c40 2023-10-14T18:51:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f32527fc700 1 -- 172.21.15.79:0/1174322151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00b810 con 0x7f3254157c40 2023-10-14T18:51:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.200+0000 7f32527fc700 1 -- 172.21.15.79:0/1174322151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00bbb0 con 0x7f3254157c40 2023-10-14T18:51:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 -- 172.21.15.79:0/1174322151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 msgr2=0x7f3254158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 --2- 172.21.15.79:0/1174322151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f3254158110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3254069d80 tx=0x7f324c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 -- 172.21.15.79:0/1174322151 shutdown_connections 2023-10-14T18:51:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 --2- 172.21.15.79:0/1174322151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f3254158110 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 --2- 172.21.15.79:0/1174322151 >> v2:172.21.15.144:3300/0 conn(0x7f3254157870 0x7f325415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 -- 172.21.15.79:0/1174322151 >> 172.21.15.79:0/1174322151 conn(0x7f3254068ce0 msgr2=0x7f32540690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 -- 172.21.15.79:0/1174322151 shutdown_connections 2023-10-14T18:51:49.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.201+0000 7f3259df0700 1 -- 172.21.15.79:0/1174322151 wait complete. 2023-10-14T18:51:49.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.202+0000 7f3259df0700 1 Processor -- start 2023-10-14T18:51:49.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.202+0000 7f3259df0700 1 -- start start 2023-10-14T18:51:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3254157870 0x7f325414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 0x7f3254150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3254150610 con 0x7f3254157c40 2023-10-14T18:51:49.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325413fe60 con 0x7f325415a620 2023-10-14T18:51:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3259df0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325414ee70 con 0x7f3254157870 2023-10-14T18:51:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33290/0 (socket says 172.21.15.79:33290) 2023-10-14T18:51:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 -- 172.21.15.79:0/3245951903 learned_addr learned my addr 172.21.15.79:0/3245951903 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f32537fe700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3254157870 0x7f325414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3253fff700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 0x7f3254150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 -- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3254157870 msgr2=0x7f325414e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3254157870 0x7f325414e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 -- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 msgr2=0x7f3254150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 0x7f3254150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3252ffd700 1 -- 172.21.15.79:0/3245951903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c009420 con 0x7f3254157c40 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.203+0000 7f3253fff700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 0x7f3254150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f3252ffd700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f324800c590 tx=0x7f3248001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248005b30 con 0x7f3254157c40 2023-10-14T18:51:49.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3248005cb0 con 0x7f3254157c40 2023-10-14T18:51:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248007320 con 0x7f3254157c40 2023-10-14T18:51:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325414fcb0 con 0x7f3254157c40 2023-10-14T18:51:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.204+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325414ff50 con 0x7f3254157c40 2023-10-14T18:51:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.205+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325404c3c0 con 0x7f3254157c40 2023-10-14T18:51:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.205+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f324801b3b0 con 0x7f3254157c40 2023-10-14T18:51:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.205+0000 7f323b7fe700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.205+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3248083920 con 0x7f3254157c40 2023-10-14T18:51:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.206+0000 7f32537fe700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.206+0000 7f32537fe700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3244009fd0 tx=0x7f3244009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.210+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3248050b90 con 0x7f3254157c40 2023-10-14T18:51:49.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.392+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f325415c840 con 0x7f3254157c40 2023-10-14T18:51:49.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.392+0000 7f323b7fe700 1 -- 172.21.15.79:0/3245951903 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f3248017090 con 0x7f3254157c40 2023-10-14T18:51:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:49.394 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":141,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:42.538675+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:49.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 msgr2=0x7f32400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3244009fd0 tx=0x7f3244009880 comp rx=0 tx=0).stop 2023-10-14T18:51:49.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 msgr2=0x7f325413f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f324800c590 tx=0x7f3248001020 comp rx=0 tx=0).stop 2023-10-14T18:51:49.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 shutdown_connections 2023-10-14T18:51:49.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f325415a620 0x7f3254150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3254157870 0x7f325414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 --2- 172.21.15.79:0/3245951903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3254157c40 0x7f325413f920 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 >> 172.21.15.79:0/3245951903 conn(0x7f3254068ce0 msgr2=0x7f32540b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.394+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 shutdown_connections 2023-10-14T18:51:49.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.395+0000 7f3259df0700 1 -- 172.21.15.79:0/3245951903 wait complete. 2023-10-14T18:51:49.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:51:16.391202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:51:17.003227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:51:49.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:51:49.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.524+0000 7fccb4929700 1 Processor -- start 2023-10-14T18:51:49.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.524+0000 7fccb4929700 1 -- start start 2023-10-14T18:51:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccb4929700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fccb0159e60 0x7fccb015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccb4929700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb015ea90 con 0x7fccb015a230 2023-10-14T18:51:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccb4929700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb00b3100 con 0x7fccb00697c0 2023-10-14T18:51:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccb4929700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb00d1cf0 con 0x7fccb0159e60 2023-10-14T18:51:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccae59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fccb0159e60 0x7fccb015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccadd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fccb015a230 0x7fccb00690b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44440/0 (socket says 172.21.15.79:44440) 2023-10-14T18:51:49.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccadd9b700 1 -- 172.21.15.79:0/2830599349 learned_addr learned my addr 172.21.15.79:0/2830599349 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:49.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccae59c700 1 -- 172.21.15.79:0/2830599349 >> v1:172.21.15.144:6789/0 conn(0x7fccb00697c0 legacy=0x7fccb00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:49.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccae59c700 1 -- 172.21.15.79:0/2830599349 >> v1:172.21.15.79:6789/0 conn(0x7fccb015a230 legacy=0x7fccb00690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccae59c700 1 -- 172.21.15.79:0/2830599349 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00d10e0 con 0x7fccb0159e60 2023-10-14T18:51:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.525+0000 7fccad59a700 1 -- 172.21.15.79:0/2830599349 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738947927 0 0) 0x7fccb015ea90 con 0x7fccb015a230 2023-10-14T18:51:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccae59c700 1 --2- 172.21.15.79:0/2830599349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb015e550 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009e60 tx=0x7fcca0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a28738c02d2c96c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccad59a700 1 -- 172.21.15.79:0/2830599349 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000e070 con 0x7fccb0159e60 2023-10-14T18:51:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccad59a700 1 -- 172.21.15.79:0/2830599349 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000bbf0 con 0x7fccb0159e60 2023-10-14T18:51:49.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccad59a700 1 -- 172.21.15.79:0/2830599349 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0012430 con 0x7fccb0159e60 2023-10-14T18:51:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 -- 172.21.15.79:0/2830599349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 msgr2=0x7fccb015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 --2- 172.21.15.79:0/2830599349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb015e550 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009e60 tx=0x7fcca0009780 comp rx=0 tx=0).stop 2023-10-14T18:51:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 -- 172.21.15.79:0/2830599349 shutdown_connections 2023-10-14T18:51:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 --2- 172.21.15.79:0/2830599349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb015e550 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 -- 172.21.15.79:0/2830599349 >> 172.21.15.79:0/2830599349 conn(0x7fccb0070700 msgr2=0x7fccb0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 -- 172.21.15.79:0/2830599349 shutdown_connections 2023-10-14T18:51:49.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.526+0000 7fccb4929700 1 -- 172.21.15.79:0/2830599349 wait complete. 2023-10-14T18:51:49.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.527+0000 7fccb4929700 1 Processor -- start 2023-10-14T18:51:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 -- start start 2023-10-14T18:51:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb00697c0 0x7fccb01584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 0x7fccb00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c56f0 con 0x7fccb0159e60 2023-10-14T18:51:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c7420 con 0x7fccb015a230 2023-10-14T18:51:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccb4929700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb016a520 con 0x7fccb00697c0 2023-10-14T18:51:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccadd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccadd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33302/0 (socket says 172.21.15.79:33302) 2023-10-14T18:51:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.528+0000 7fccadd9b700 1 -- 172.21.15.79:0/35457431 learned_addr learned my addr 172.21.15.79:0/35457431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccae59c700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb00697c0 0x7fccb01584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccaed9d700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 0x7fccb00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 -- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb00697c0 msgr2=0x7fccb01584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb00697c0 0x7fccb01584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 -- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 msgr2=0x7fccb00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 0x7fccb00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 -- 172.21.15.79:0/35457431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009a20 con 0x7fccb0159e60 2023-10-14T18:51:49.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccaed9d700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 0x7fccb00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:49.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccadd9b700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c810 tx=0x7fcc98007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98005c00 con 0x7fccb0159e60 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98005d60 con 0x7fccb0159e60 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb00c58e0 con 0x7fccb0159e60 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98007320 con 0x7fccb0159e60 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.529+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb00c5ea0 con 0x7fccb0159e60 2023-10-14T18:51:49.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.530+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb016a6b0 con 0x7fccb0159e60 2023-10-14T18:51:49.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.530+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc9801b400 con 0x7fccb0159e60 2023-10-14T18:51:49.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.531+0000 7fcca67fc700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.531+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc98084010 con 0x7fccb0159e60 2023-10-14T18:51:49.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.531+0000 7fccae59c700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.531+0000 7fccae59c700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 0x7fcc900693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcca00097c0 tx=0x7fcca0018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.535+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc98051300 con 0x7fccb0159e60 2023-10-14T18:51:49.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.717+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccb004c3c0 con 0x7fccb0159e60 2023-10-14T18:51:49.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.717+0000 7fcca67fc700 1 -- 172.21.15.79:0/35457431 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc98054920 con 0x7fccb0159e60 2023-10-14T18:51:49.718 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:51:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 msgr2=0x7fcc900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 0x7fcc900693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcca00097c0 tx=0x7fcca0018000 comp rx=0 tx=0).stop 2023-10-14T18:51:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 msgr2=0x7fccb00c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800c810 tx=0x7fcc98007db0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 shutdown_connections 2023-10-14T18:51:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb015a230 0x7fccb00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb00697c0 0x7fccb01584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 --2- 172.21.15.79:0/35457431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fccb0159e60 0x7fccb00c51b0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 >> 172.21.15.79:0/35457431 conn(0x7fccb0070700 msgr2=0x7fccb00af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 shutdown_connections 2023-10-14T18:51:49.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.720+0000 7fccb4929700 1 -- 172.21.15.79:0/35457431 wait complete. 2023-10-14T18:51:49.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:51:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.848+0000 7f10a622f700 1 Processor -- start 2023-10-14T18:51:49.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.848+0000 7f10a622f700 1 -- start start 2023-10-14T18:51:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a622f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10a00b6580 0x7f10a006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a622f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a006a830 0x7f10a00b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a622f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a006ac90 con 0x7f10a00cce30 2023-10-14T18:51:49.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a622f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00b4d70 con 0x7f10a00b6580 2023-10-14T18:51:49.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a622f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a015b3b0 con 0x7f10a006a830 2023-10-14T18:51:49.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a4a2c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f10a00b6580 0x7f10a006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a522d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f10a00cce30 0x7f10a015aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44450/0 (socket says 172.21.15.79:44450) 2023-10-14T18:51:49.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a522d700 1 -- 172.21.15.79:0/2943053067 learned_addr learned my addr 172.21.15.79:0/2943053067 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:49.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a4a2c700 1 -- 172.21.15.79:0/2943053067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a006a830 msgr2=0x7f10a00b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:49.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a5a2e700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a006a830 0x7f10a00b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a4a2c700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a006a830 0x7f10a00b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f1097fff700 1 -- 172.21.15.79:0/2943053067 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850918980 0 0) 0x7f109c001490 con 0x7f10a00cce30 2023-10-14T18:51:49.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a4a2c700 1 -- 172.21.15.79:0/2943053067 >> v1:172.21.15.79:6789/0 conn(0x7f10a00cce30 legacy=0x7f10a015aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.849+0000 7f10a4a2c700 1 -- 172.21.15.79:0/2943053067 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00cd8d0 con 0x7f10a00b6580 2023-10-14T18:51:49.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a4a2c700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00b6580 0x7f10a006a2f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f10900098e0 tx=0x7f10900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6921c4acaeb37d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f1097fff700 1 -- 172.21.15.79:0/2943053067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090009e80 con 0x7f10a00b6580 2023-10-14T18:51:49.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f1097fff700 1 -- 172.21.15.79:0/2943053067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000b860 con 0x7f10a00b6580 2023-10-14T18:51:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f1097fff700 1 -- 172.21.15.79:0/2943053067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000bbe0 con 0x7f10a00b6580 2023-10-14T18:51:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 -- 172.21.15.79:0/2943053067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00b6580 msgr2=0x7f10a006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00b6580 0x7f10a006a2f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f10900098e0 tx=0x7f10900091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 -- 172.21.15.79:0/2943053067 shutdown_connections 2023-10-14T18:51:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a006a830 0x7f10a00b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 --2- 172.21.15.79:0/2943053067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00b6580 0x7f10a006a2f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 -- 172.21.15.79:0/2943053067 >> 172.21.15.79:0/2943053067 conn(0x7f10a0068cb0 msgr2=0x7f10a00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 -- 172.21.15.79:0/2943053067 shutdown_connections 2023-10-14T18:51:49.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.850+0000 7f10a622f700 1 -- 172.21.15.79:0/2943053067 wait complete. 2023-10-14T18:51:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.851+0000 7f10a622f700 1 Processor -- start 2023-10-14T18:51:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.851+0000 7f10a622f700 1 -- start start 2023-10-14T18:51:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 0x7f10a00b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a00b6580 0x7f10a01559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0155f00 con 0x7f10a00cce30 2023-10-14T18:51:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0156d40 con 0x7f10a006a830 2023-10-14T18:51:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a622f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0156130 con 0x7f10a00b6580 2023-10-14T18:51:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a5a2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a5a2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33328/0 (socket says 172.21.15.79:33328) 2023-10-14T18:51:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a5a2e700 1 -- 172.21.15.79:0/894223078 learned_addr learned my addr 172.21.15.79:0/894223078 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a522d700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 0x7f10a00b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.852+0000 7f10a4a2c700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a00b6580 0x7f10a01559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 -- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a00b6580 msgr2=0x7f10a01559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a00b6580 0x7f10a01559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 -- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 msgr2=0x7f10a00b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 0x7f10a00b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 -- 172.21.15.79:0/894223078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090009420 con 0x7f10a00cce30 2023-10-14T18:51:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a522d700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 0x7f10a00b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:49.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a5a2e700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f109800c880 tx=0x7f1098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011600 con 0x7f10a00cce30 2023-10-14T18:51:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098011760 con 0x7f10a00cce30 2023-10-14T18:51:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a0156410 con 0x7f10a00cce30 2023-10-14T18:51:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011ae0 con 0x7f10a00cce30 2023-10-14T18:51:49.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.853+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a01569d0 con 0x7f10a00cce30 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.854+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0156eb0 con 0x7f10a00cce30 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.854+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10980193f0 con 0x7f10a00cce30 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.855+0000 7f10957fa700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.855+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1098084920 con 0x7f10a00cce30 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.855+0000 7f10a522d700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:49.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.855+0000 7f10a522d700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 0x7f10840693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e280 tx=0x7f109c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:49.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:49.859+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1098055620 con 0x7f10a00cce30 2023-10-14T18:51:50.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.038+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10a00b4440 con 0x7f10a00cce30 2023-10-14T18:51:50.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.039+0000 7f10957fa700 1 -- 172.21.15.79:0/894223078 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10980551b0 con 0x7f10a00cce30 2023-10-14T18:51:50.040 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:51:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 msgr2=0x7f10840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 0x7f10840693e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e280 tx=0x7f109c009040 comp rx=0 tx=0).stop 2023-10-14T18:51:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 msgr2=0x7f10a01571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f109800c880 tx=0x7f1098008040 comp rx=0 tx=0).stop 2023-10-14T18:51:50.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 shutdown_connections 2023-10-14T18:51:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1084066f30 0x7f10840693e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a00cce30 0x7f10a01571d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10a006a830 0x7f10a00b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 --2- 172.21.15.79:0/894223078 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f10a00b6580 0x7f10a01559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 >> 172.21.15.79:0/894223078 conn(0x7f10a0068cb0 msgr2=0x7f10a015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 shutdown_connections 2023-10-14T18:51:50.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.041+0000 7f10a622f700 1 -- 172.21.15.79:0/894223078 wait complete. 2023-10-14T18:51:50.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:51:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.169+0000 7f97f7fff700 1 Processor -- start 2023-10-14T18:51:50.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.169+0000 7f97f7fff700 1 -- start start 2023-10-14T18:51:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f80cce30 0x7f97f815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97f806aa00 0x7f97f80b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f7fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80b4d70 con 0x7f97f80b6580 2023-10-14T18:51:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f7fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80cd8d0 con 0x7f97f806aa00 2023-10-14T18:51:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80b4440 con 0x7f97f80cce30 2023-10-14T18:51:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97f806aa00 0x7f97f80b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f97f806aa00 0x7f97f80b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33332/0 (socket says 172.21.15.79:33332) 2023-10-14T18:51:50.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 -- 172.21.15.79:0/1462197024 learned_addr learned my addr 172.21.15.79:0/1462197024 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f6ffd700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f80cce30 0x7f97f815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 -- 172.21.15.79:0/1462197024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f80cce30 msgr2=0x7f97f815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f80cce30 0x7f97f815aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 -- 172.21.15.79:0/1462197024 >> v1:172.21.15.144:6789/0 conn(0x7f97f80b6580 legacy=0x7f97f806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 -- 172.21.15.79:0/1462197024 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80b4720 con 0x7f97f806aa00 2023-10-14T18:51:50.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.170+0000 7f97f77fe700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f806aa00 0x7f97f80b5200 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f97f00099b0 tx=0x7f97f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631dba245cd9e851 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f5ffb700 1 -- 172.21.15.79:0/1462197024 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000b820 con 0x7f97f806aa00 2023-10-14T18:51:50.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f5ffb700 1 -- 172.21.15.79:0/1462197024 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f000b980 con 0x7f97f806aa00 2023-10-14T18:51:50.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f5ffb700 1 -- 172.21.15.79:0/1462197024 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000bd20 con 0x7f97f806aa00 2023-10-14T18:51:50.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 -- 172.21.15.79:0/1462197024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f806aa00 msgr2=0x7f97f80b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f806aa00 0x7f97f80b5200 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f97f00099b0 tx=0x7f97f0009250 comp rx=0 tx=0).stop 2023-10-14T18:51:50.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 -- 172.21.15.79:0/1462197024 shutdown_connections 2023-10-14T18:51:50.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f806aa00 0x7f97f80b5200 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 --2- 172.21.15.79:0/1462197024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f80cce30 0x7f97f815aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 -- 172.21.15.79:0/1462197024 >> 172.21.15.79:0/1462197024 conn(0x7f97f8068cb0 msgr2=0x7f97f80690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 -- 172.21.15.79:0/1462197024 shutdown_connections 2023-10-14T18:51:50.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.171+0000 7f97f7fff700 1 -- 172.21.15.79:0/1462197024 wait complete. 2023-10-14T18:51:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.172+0000 7f97f7fff700 1 Processor -- start 2023-10-14T18:51:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.172+0000 7f97f7fff700 1 -- start start 2023-10-14T18:51:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f806aa00 0x7f97f81437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f80b6580 0x7f97f816a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8152db0 con 0x7f97f80cce30 2023-10-14T18:51:50.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8143ce0 con 0x7f97f80b6580 2023-10-14T18:51:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f8152a80 con 0x7f97f806aa00 2023-10-14T18:51:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33338/0 (socket says 172.21.15.79:33338) 2023-10-14T18:51:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f77fe700 1 -- 172.21.15.79:0/2790450213 learned_addr learned my addr 172.21.15.79:0/2790450213 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:50.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f6ffd700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f806aa00 0x7f97f81437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.173+0000 7f97f67fc700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f80b6580 0x7f97f816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 -- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f806aa00 msgr2=0x7f97f81437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f806aa00 0x7f97f81437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 -- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f80b6580 msgr2=0x7f97f816a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f80b6580 0x7f97f816a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 -- 172.21.15.79:0/2790450213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00094f0 con 0x7f97f80cce30 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f77fe700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f97f00094c0 tx=0x7f97f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000b820 con 0x7f97f80cce30 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f001b680 con 0x7f97f80cce30 2023-10-14T18:51:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0011ea0 con 0x7f97f80cce30 2023-10-14T18:51:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f816a9e0 con 0x7f97f80cce30 2023-10-14T18:51:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.174+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f816afa0 con 0x7f97f80cce30 2023-10-14T18:51:50.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.175+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f8152f60 con 0x7f97f80cce30 2023-10-14T18:51:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.175+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97f001bcb0 con 0x7f97f80cce30 2023-10-14T18:51:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.176+0000 7f97eeffd700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 0x7f97d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.176+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97f0086150 con 0x7f97f80cce30 2023-10-14T18:51:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.176+0000 7f97f6ffd700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 0x7f97d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.176+0000 7f97f6ffd700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 0x7f97d80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d0e80 tx=0x7f97e80097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.180+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97f00533c0 con 0x7f97f80cce30 2023-10-14T18:51:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.360+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97f80b4a00 con 0x7f97f80cce30 2023-10-14T18:51:50.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.361+0000 7f97eeffd700 1 -- 172.21.15.79:0/2790450213 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97f002a020 con 0x7f97f80cce30 2023-10-14T18:51:50.362 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:51:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 msgr2=0x7f97d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 0x7f97d80693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d0e80 tx=0x7f97e80097e0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 msgr2=0x7f97f80d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f97f00094c0 tx=0x7f97f0016000 comp rx=0 tx=0).stop 2023-10-14T18:51:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 shutdown_connections 2023-10-14T18:51:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f97d8066f30 0x7f97d80693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97f80cce30 0x7f97f80d0160 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97f806aa00 0x7f97f81437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 --2- 172.21.15.79:0/2790450213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f80b6580 0x7f97f816a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 >> 172.21.15.79:0/2790450213 conn(0x7f97f8068cb0 msgr2=0x7f97f8150340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 shutdown_connections 2023-10-14T18:51:50.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.363+0000 7f97f7fff700 1 -- 172.21.15.79:0/2790450213 wait complete. 2023-10-14T18:51:50.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:50.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.489+0000 7f07d759e700 1 Processor -- start 2023-10-14T18:51:50.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.489+0000 7f07d759e700 1 -- start start 2023-10-14T18:51:50.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d759e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d80cdab0 0x7f07d815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d815dda0 0x7f07d815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d80cb7c0 con 0x7f07d80cd6e0 2023-10-14T18:51:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d759e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d815e850 con 0x7f07d80cdab0 2023-10-14T18:51:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80cc360 con 0x7f07d815dda0 2023-10-14T18:51:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d80cdab0 0x7f07d815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d6d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d815dda0 0x7f07d815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07d80cdab0 0x7f07d815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33348/0 (socket says 172.21.15.79:33348) 2023-10-14T18:51:50.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 -- 172.21.15.79:0/3852722428 learned_addr learned my addr 172.21.15.79:0/3852722428 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:50.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07d659c700 1 --1- 172.21.15.79:0/3852722428 >> v1:172.21.15.144:6789/0 conn(0x7f07d80cd6e0 0x7f07d80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:58536/0 (socket says 172.21.15.79:58536) 2023-10-14T18:51:50.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 -- 172.21.15.79:0/3852722428 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d815dda0 msgr2=0x7f07d815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:50.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 --2- 172.21.15.79:0/3852722428 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d815dda0 0x7f07d815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 -- 172.21.15.79:0/3852722428 >> v1:172.21.15.144:6789/0 conn(0x7f07d80cd6e0 legacy=0x7f07d80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 -- 172.21.15.79:0/3852722428 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d815e290 con 0x7f07d80cdab0 2023-10-14T18:51:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.490+0000 7f07cdd9b700 1 --2- 172.21.15.79:0/3852722428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d80cdab0 0x7f07d815d860 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f07c00099b0 tx=0x7f07c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4609d988492ac7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d5d9b700 1 -- 172.21.15.79:0/3852722428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0009ea0 con 0x7f07d80cdab0 2023-10-14T18:51:50.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d5d9b700 1 -- 172.21.15.79:0/3852722428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c000b860 con 0x7f07d80cdab0 2023-10-14T18:51:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d5d9b700 1 -- 172.21.15.79:0/3852722428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000bc00 con 0x7f07d80cdab0 2023-10-14T18:51:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 -- 172.21.15.79:0/3852722428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d80cdab0 msgr2=0x7f07d815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 --2- 172.21.15.79:0/3852722428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d80cdab0 0x7f07d815d860 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f07c00099b0 tx=0x7f07c0009250 comp rx=0 tx=0).stop 2023-10-14T18:51:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 -- 172.21.15.79:0/3852722428 shutdown_connections 2023-10-14T18:51:50.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 --2- 172.21.15.79:0/3852722428 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d815dda0 0x7f07d815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 --2- 172.21.15.79:0/3852722428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d80cdab0 0x7f07d815d860 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 -- 172.21.15.79:0/3852722428 >> 172.21.15.79:0/3852722428 conn(0x7f07d8067660 msgr2=0x7f07d8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 -- 172.21.15.79:0/3852722428 shutdown_connections 2023-10-14T18:51:50.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.491+0000 7f07d759e700 1 -- 172.21.15.79:0/3852722428 wait complete. 2023-10-14T18:51:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.492+0000 7f07d759e700 1 Processor -- start 2023-10-14T18:51:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.492+0000 7f07d759e700 1 -- start start 2023-10-14T18:51:50.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d80cd6e0 0x7f07d816b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d80cdab0 0x7f07d816ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d816b3c0 con 0x7f07d815dda0 2023-10-14T18:51:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d814e2b0 con 0x7f07d80cd6e0 2023-10-14T18:51:50.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d814e590 con 0x7f07d80cdab0 2023-10-14T18:51:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33350/0 (socket says 172.21.15.79:33350) 2023-10-14T18:51:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 -- 172.21.15.79:0/2679487192 learned_addr learned my addr 172.21.15.79:0/2679487192 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:50.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07cdd9b700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d80cdab0 0x7f07d816ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d659c700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d80cd6e0 0x7f07d816b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 -- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d80cdab0 msgr2=0x7f07d816ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d80cdab0 0x7f07d816ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 -- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d80cd6e0 msgr2=0x7f07d816b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d80cd6e0 0x7f07d816b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.493+0000 7f07d6d9d700 1 -- 172.21.15.79:0/2679487192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00094f0 con 0x7f07d815dda0 2023-10-14T18:51:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07d6d9d700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009e90 tx=0x7f07d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000cc20 con 0x7f07d815dda0 2023-10-14T18:51:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d000f040 con 0x7f07d815dda0 2023-10-14T18:51:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d814e870 con 0x7f07d815dda0 2023-10-14T18:51:50.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0014480 con 0x7f07d815dda0 2023-10-14T18:51:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.494+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d814ee30 con 0x7f07d815dda0 2023-10-14T18:51:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.495+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d814f050 con 0x7f07d815dda0 2023-10-14T18:51:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.495+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07d0014830 con 0x7f07d815dda0 2023-10-14T18:51:50.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.496+0000 7f07ceffd700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 0x7f07b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.496+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07d0084eb0 con 0x7f07d815dda0 2023-10-14T18:51:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.496+0000 7f07d659c700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 0x7f07b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.496+0000 7f07d659c700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 0x7f07b80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c8007fd0 tx=0x7f07c8007d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.500+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07d0052120 con 0x7f07d815dda0 2023-10-14T18:51:50.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.728+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07d804bb80 con 0x7f07d815dda0 2023-10-14T18:51:50.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.728+0000 7f07ceffd700 1 -- 172.21.15.79:0/2679487192 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f07d0055740 con 0x7f07d815dda0 2023-10-14T18:51:50.729 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:50.730 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 msgr2=0x7f07b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 0x7f07b80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c8007fd0 tx=0x7f07c8007d70 comp rx=0 tx=0).stop 2023-10-14T18:51:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 msgr2=0x7f07d816cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009e90 tx=0x7f07d000b040 comp rx=0 tx=0).stop 2023-10-14T18:51:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 shutdown_connections 2023-10-14T18:51:50.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f07b8066f30 0x7f07b80693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d815dda0 0x7f07d816cfb0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07d80cd6e0 0x7f07d816b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 --2- 172.21.15.79:0/2679487192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07d80cdab0 0x7f07d816ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 >> 172.21.15.79:0/2679487192 conn(0x7f07d8067660 msgr2=0x7f07d815c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 shutdown_connections 2023-10-14T18:51:50.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.731+0000 7f07d759e700 1 -- 172.21.15.79:0/2679487192 wait complete. 2023-10-14T18:51:50.734 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:50.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:50.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.858+0000 7fa4f5f55700 1 Processor -- start 2023-10-14T18:51:50.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.858+0000 7fa4f5f55700 1 -- start start 2023-10-14T18:51:50.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f5f55700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4f015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f5f55700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f00cb7c0 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f5f55700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f015e290 con 0x7fa4f00cdab0 2023-10-14T18:51:50.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f5f55700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f015e850 con 0x7fa4f015cbd0 2023-10-14T18:51:50.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f4f53700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa4f00cd6e0 0x7fa4f00cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44462/0 (socket says 172.21.15.79:44462) 2023-10-14T18:51:50.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f4f53700 1 -- 172.21.15.79:0/40641004 learned_addr learned my addr 172.21.15.79:0/40641004 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4f5754700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4f015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153040996 0 0) 0x7fa4f00cb7c0 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d8003570 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.859+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449460674 0 0) 0x7fa4f015e290 con 0x7fa4f00cdab0 2023-10-14T18:51:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f00cb7c0 con 0x7fa4f00cdab0 2023-10-14T18:51:50.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116988046 0 0) 0x7fa4d8003570 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 msgr2=0x7fa4f015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:50.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4f015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 >> v1:172.21.15.144:6789/0 conn(0x7fa4f00cdab0 legacy=0x7fa4f015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f015e570 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fa4ec001470 con 0x7fa4f00cd6e0 2023-10-14T18:51:50.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 >> v1:172.21.15.79:6789/0 conn(0x7fa4f00cd6e0 legacy=0x7fa4f00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4d8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f015e850 con 0x7fa4d8004180 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d800bba0 con 0x7fa4d8004d50 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d800bd60 con 0x7fa4f015cbd0 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4f4f53700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4d8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4f5754700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 -- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 msgr2=0x7fa4d8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f015cbd0 0x7fa4d8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 -- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d8004d50 msgr2=0x7fa4d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:50.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4d8004d50 0x7fa4d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 -- 172.21.15.79:0/40641004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8003570 con 0x7fa4d8004180 2023-10-14T18:51:50.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4d8004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0001a10 tx=0x7fa4e0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f82c08b045579fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000c5d0 con 0x7fa4d8004180 2023-10-14T18:51:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e000c730 con 0x7fa4d8004180 2023-10-14T18:51:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.860+0000 7fa4e77fe700 1 -- 172.21.15.79:0/40641004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000cad0 con 0x7fa4d8004180 2023-10-14T18:51:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 -- 172.21.15.79:0/40641004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 msgr2=0x7fa4d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/40641004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4d8004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0001a10 tx=0x7fa4e0007d30 comp rx=0 tx=0).stop 2023-10-14T18:51:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5754700 1 -- 172.21.15.79:0/40641004 reap_dead start 2023-10-14T18:51:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 -- 172.21.15.79:0/40641004 shutdown_connections 2023-10-14T18:51:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 -- 172.21.15.79:0/40641004 >> 172.21.15.79:0/40641004 conn(0x7fa4f0067660 msgr2=0x7fa4f0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 -- 172.21.15.79:0/40641004 shutdown_connections 2023-10-14T18:51:50.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.861+0000 7fa4f5f55700 1 -- 172.21.15.79:0/40641004 wait complete. 2023-10-14T18:51:50.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.862+0000 7fa4f5f55700 1 Processor -- start 2023-10-14T18:51:50.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.862+0000 7fa4f5f55700 1 -- start start 2023-10-14T18:51:50.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4f0150f80 0x7fa4f0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 0x7fa4f014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00cc360 con 0x7fa4d8004180 2023-10-14T18:51:50.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0156750 con 0x7fa4f0150f80 2023-10-14T18:51:50.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5f55700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00c8cf0 con 0x7fa4f01562b0 2023-10-14T18:51:50.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33374/0 (socket says 172.21.15.79:33374) 2023-10-14T18:51:50.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 -- 172.21.15.79:0/308642848 learned_addr learned my addr 172.21.15.79:0/308642848 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:50.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4f0150f80 0x7fa4f0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5754700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 0x7fa4f014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 -- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 msgr2=0x7fa4f014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 0x7fa4f014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 -- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4f0150f80 msgr2=0x7fa4f0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:50.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4f0150f80 0x7fa4f0155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:50.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 -- 172.21.15.79:0/308642848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00c80e0 con 0x7fa4d8004180 2023-10-14T18:51:50.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f5754700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 0x7fa4f014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:50.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.863+0000 7fa4f4f53700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0073c0 tx=0x7fa4ec001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec018030 con 0x7fa4d8004180 2023-10-14T18:51:50.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00f8d0 con 0x7fa4d8004180 2023-10-14T18:51:50.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f00c83c0 con 0x7fa4d8004180 2023-10-14T18:51:50.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00fc50 con 0x7fa4d8004180 2023-10-14T18:51:50.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f00c8980 con 0x7fa4d8004180 2023-10-14T18:51:50.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.864+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f0089280 con 0x7fa4d8004180 2023-10-14T18:51:50.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.865+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4ec01b070 con 0x7fa4d8004180 2023-10-14T18:51:50.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.865+0000 7fa4e4ff9700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 0x7fa4dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:50.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.865+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4ec019070 con 0x7fa4d8004180 2023-10-14T18:51:50.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.865+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 0x7fa4dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:50.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.866+0000 7fa4e7fff700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 0x7fa4dc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa4f014e580 tx=0x7fa4e0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:50.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:50.869+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4ec051560 con 0x7fa4d8004180 2023-10-14T18:51:51.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.053+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4f00c8b10 con 0x7fa4d8004180 2023-10-14T18:51:51.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.054+0000 7fa4e4ff9700 1 -- 172.21.15.79:0/308642848 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fa4ec054b80 con 0x7fa4d8004180 2023-10-14T18:51:51.054 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:51.055 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":141,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:42.538675+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 msgr2=0x7fa4dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 0x7fa4dc0693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa4f014e580 tx=0x7fa4e0015000 comp rx=0 tx=0).stop 2023-10-14T18:51:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 msgr2=0x7fa4f014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0073c0 tx=0x7fa4ec001df0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 shutdown_connections 2023-10-14T18:51:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa4dc066f30 0x7fa4dc0693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa4f01562b0 0x7fa4f014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4d8004180 0x7fa4f014cc20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 --2- 172.21.15.79:0/308642848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4f0150f80 0x7fa4f0155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.055+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 >> 172.21.15.79:0/308642848 conn(0x7fa4f0067660 msgr2=0x7fa4f00b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.056+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 shutdown_connections 2023-10-14T18:51:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.056+0000 7fa4f5f55700 1 -- 172.21.15.79:0/308642848 wait complete. 2023-10-14T18:51:51.070 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:51:51.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.184+0000 7f151a807700 1 Processor -- start 2023-10-14T18:51:51.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.184+0000 7f151a807700 1 -- start start 2023-10-14T18:51:51.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a807700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f15140cd6e0 0x7f15140cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a807700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f151415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a807700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15140cb7c0 con 0x7f151415dda0 2023-10-14T18:51:51.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a807700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151415e850 con 0x7f15140cd6e0 2023-10-14T18:51:51.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a807700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140cd030 con 0x7f15140cdab0 2023-10-14T18:51:51.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f1519805700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f15140cd6e0 0x7f15140cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a006700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f151415dda0 0x7f151415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:58552/0 (socket says 172.21.15.79:58552) 2023-10-14T18:51:51.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f151a006700 1 -- 172.21.15.79:0/4098284878 learned_addr learned my addr 172.21.15.79:0/4098284878 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.185+0000 7f1519004700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f151415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1519805700 1 -- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 msgr2=0x7f151415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1519805700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f151415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1519805700 1 -- 172.21.15.79:0/4098284878 >> v1:172.21.15.144:6789/0 conn(0x7f151415dda0 legacy=0x7f151415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1519805700 1 -- 172.21.15.79:0/4098284878 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151415e290 con 0x7f15140cd6e0 2023-10-14T18:51:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1519805700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15140cd6e0 0x7f15140cbc50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15100098e0 tx=0x7f15100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42be44f8a887a13 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1518803700 1 -- 172.21.15.79:0/4098284878 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000b640 con 0x7f15140cd6e0 2023-10-14T18:51:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1518803700 1 -- 172.21.15.79:0/4098284878 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000b7a0 con 0x7f15140cd6e0 2023-10-14T18:51:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f1518803700 1 -- 172.21.15.79:0/4098284878 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000bb40 con 0x7f15140cd6e0 2023-10-14T18:51:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f151a807700 1 -- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15140cd6e0 msgr2=0x7f15140cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.186+0000 7f151a807700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15140cd6e0 0x7f15140cbc50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f15100098e0 tx=0x7f15100091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 -- 172.21.15.79:0/4098284878 shutdown_connections 2023-10-14T18:51:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15140cd6e0 0x7f15140cbc50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 --2- 172.21.15.79:0/4098284878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f151415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 -- 172.21.15.79:0/4098284878 >> 172.21.15.79:0/4098284878 conn(0x7f1514067660 msgr2=0x7f1514067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 -- 172.21.15.79:0/4098284878 shutdown_connections 2023-10-14T18:51:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.187+0000 7f151a807700 1 -- 172.21.15.79:0/4098284878 wait complete. 2023-10-14T18:51:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 Processor -- start 2023-10-14T18:51:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 -- start start 2023-10-14T18:51:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f15140afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415dda0 0x7f15140c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514158b20 con 0x7f15140cd6e0 2023-10-14T18:51:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151416b1f0 con 0x7f151415dda0 2023-10-14T18:51:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.188+0000 7f151a807700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151416a5e0 con 0x7f15140cdab0 2023-10-14T18:51:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33390/0 (socket says 172.21.15.79:33390) 2023-10-14T18:51:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 -- 172.21.15.79:0/3529131391 learned_addr learned my addr 172.21.15.79:0/3529131391 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:51.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519004700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f15140afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f151a006700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415dda0 0x7f15140c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 -- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 msgr2=0x7f15140afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f15140afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 -- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415dda0 msgr2=0x7f15140c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415dda0 0x7f15140c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 -- 172.21.15.79:0/3529131391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510009420 con 0x7f15140cd6e0 2023-10-14T18:51:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1519805700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1510009f80 tx=0x7f1510017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510000d10 con 0x7f15140cd6e0 2023-10-14T18:51:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000bb20 con 0x7f15140cd6e0 2023-10-14T18:51:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151416a8c0 con 0x7f15140cd6e0 2023-10-14T18:51:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.189+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510011650 con 0x7f15140cd6e0 2023-10-14T18:51:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.190+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151416ae80 con 0x7f15140cd6e0 2023-10-14T18:51:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.190+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1514089280 con 0x7f15140cd6e0 2023-10-14T18:51:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.191+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15100119c0 con 0x7f15140cd6e0 2023-10-14T18:51:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.191+0000 7f1509ffb700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.191+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1510085ea0 con 0x7f15140cd6e0 2023-10-14T18:51:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.191+0000 7f1519004700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.192+0000 7f1519004700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f15140cadb0 tx=0x7f15040091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.195+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1510053110 con 0x7f15140cd6e0 2023-10-14T18:51:51.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.423+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f151415b3a0 con 0x7f15140cd6e0 2023-10-14T18:51:51.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.424+0000 7f1509ffb700 1 -- 172.21.15.79:0/3529131391 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f1510056730 con 0x7f15140cd6e0 2023-10-14T18:51:51.425 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:51.425 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:51.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 msgr2=0x7f14f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f15140cadb0 tx=0x7f15040091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 msgr2=0x7f1514155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1510009f80 tx=0x7f1510017000 comp rx=0 tx=0).stop 2023-10-14T18:51:51.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 shutdown_connections 2023-10-14T18:51:51.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415dda0 0x7f15140c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15140cd6e0 0x7f1514155c40 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 --2- 172.21.15.79:0/3529131391 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f15140cdab0 0x7f15140afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 >> 172.21.15.79:0/3529131391 conn(0x7f1514067660 msgr2=0x7f15140d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 shutdown_connections 2023-10-14T18:51:51.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.426+0000 7f151a807700 1 -- 172.21.15.79:0/3529131391 wait complete. 2023-10-14T18:51:51.430 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:51.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:51.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.552+0000 7f947f59e700 1 Processor -- start 2023-10-14T18:51:51.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.552+0000 7f947f59e700 1 -- start start 2023-10-14T18:51:51.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947f59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94800cdab0 0x7f948015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947f59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800cb7c0 con 0x7f94800cd6e0 2023-10-14T18:51:51.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947f59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948015e850 con 0x7f94800cdab0 2023-10-14T18:51:51.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94800cc360 con 0x7f948015dda0 2023-10-14T18:51:51.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f9475d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94800cdab0 0x7f948015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947ed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f9475d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94800cdab0 0x7f948015d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:40694/0 (socket says 172.21.15.79:40694) 2023-10-14T18:51:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f947e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f94800cd6e0 0x7f94800cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:58564/0 (socket says 172.21.15.79:58564) 2023-10-14T18:51:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.553+0000 7f9475d9b700 1 -- 172.21.15.79:0/598581254 learned_addr learned my addr 172.21.15.79:0/598581254 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f9475d9b700 1 -- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 msgr2=0x7f948015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:51.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f9475d9b700 1 --2- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f9475d9b700 1 -- 172.21.15.79:0/598581254 >> v1:172.21.15.144:6789/0 conn(0x7f94800cd6e0 legacy=0x7f94800cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f9475d9b700 1 -- 172.21.15.79:0/598581254 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948015e290 con 0x7f94800cdab0 2023-10-14T18:51:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f9475d9b700 1 --2- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f948015d860 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52fdbb09d443daf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947dd9b700 1 -- 172.21.15.79:0/598581254 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468009ea0 con 0x7f94800cdab0 2023-10-14T18:51:51.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947dd9b700 1 -- 172.21.15.79:0/598581254 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946800b860 con 0x7f94800cdab0 2023-10-14T18:51:51.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947dd9b700 1 -- 172.21.15.79:0/598581254 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946800bc00 con 0x7f94800cdab0 2023-10-14T18:51:51.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 -- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 msgr2=0x7f948015d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 --2- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f948015d860 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468009250 comp rx=0 tx=0).stop 2023-10-14T18:51:51.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 -- 172.21.15.79:0/598581254 shutdown_connections 2023-10-14T18:51:51.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 --2- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 --2- 172.21.15.79:0/598581254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f948015d860 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 -- 172.21.15.79:0/598581254 >> 172.21.15.79:0/598581254 conn(0x7f9480067660 msgr2=0x7f9480067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.554+0000 7f947f59e700 1 -- 172.21.15.79:0/598581254 shutdown_connections 2023-10-14T18:51:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.555+0000 7f947f59e700 1 -- 172.21.15.79:0/598581254 wait complete. 2023-10-14T18:51:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 Processor -- start 2023-10-14T18:51:51.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 -- start start 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f9480156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800c9ef0 con 0x7f94800cd6e0 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800c92e0 con 0x7f94800cdab0 2023-10-14T18:51:51.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.556+0000 7f947f59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94800c95c0 con 0x7f948015dda0 2023-10-14T18:51:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33400/0 (socket says 172.21.15.79:33400) 2023-10-14T18:51:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 -- 172.21.15.79:0/1144548020 learned_addr learned my addr 172.21.15.79:0/1144548020 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:51.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f9475d9b700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f9480156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947ed9d700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 -- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 msgr2=0x7f948015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 -- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 msgr2=0x7f9480156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f9480156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 -- 172.21.15.79:0/1144548020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680094f0 con 0x7f94800cd6e0 2023-10-14T18:51:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947ed9d700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947e59c700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f947000c560 tx=0x7f9470007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470005a70 con 0x7f94800cd6e0 2023-10-14T18:51:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470005bd0 con 0x7f94800cd6e0 2023-10-14T18:51:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94800c98a0 con 0x7f94800cd6e0 2023-10-14T18:51:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94700070d0 con 0x7f94800cd6e0 2023-10-14T18:51:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.557+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9480156980 con 0x7f94800cd6e0 2023-10-14T18:51:51.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.558+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9480089280 con 0x7f94800cd6e0 2023-10-14T18:51:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.559+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9470007480 con 0x7f94800cd6e0 2023-10-14T18:51:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.559+0000 7f9476ffd700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.559+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9470083a40 con 0x7f94800cd6e0 2023-10-14T18:51:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.559+0000 7f9475d9b700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.560+0000 7f9475d9b700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.563+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9470085e60 con 0x7f94800cd6e0 2023-10-14T18:51:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.785+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f948004bb80 con 0x7f94800cd6e0 2023-10-14T18:51:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.785+0000 7f9476ffd700 1 -- 172.21.15.79:0/1144548020 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9470017070 con 0x7f94800cd6e0 2023-10-14T18:51:51.786 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:51.786 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:51:18.040958+0000","modified":"2023-10-14T18:51:21.690362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7101},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7101":{"gid":7101,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/2840925690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":2840925690},{"type":"v1","addr":"172.21.15.79:6835","nonce":2840925690}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-14T18:51:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 msgr2=0x7f94600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 0x7f94600693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f94680099b0 tx=0x7f9468017000 comp rx=0 tx=0).stop 2023-10-14T18:51:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 msgr2=0x7f9480159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f947000c560 tx=0x7f9470007f70 comp rx=0 tx=0).stop 2023-10-14T18:51:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 shutdown_connections 2023-10-14T18:51:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9460066f30 0x7f94600693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f948015dda0 0x7f948015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94800cd6e0 0x7f9480159ee0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 --2- 172.21.15.79:0/1144548020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94800cdab0 0x7f9480156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.787+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 >> 172.21.15.79:0/1144548020 conn(0x7f9480067660 msgr2=0x7f94800d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.788+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 shutdown_connections 2023-10-14T18:51:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.788+0000 7f947f59e700 1 -- 172.21.15.79:0/1144548020 wait complete. 2023-10-14T18:51:51.792 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 64 2023-10-14T18:51:51.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:51:51.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.914+0000 7f163759e700 1 Processor -- start 2023-10-14T18:51:51.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.914+0000 7f163759e700 1 -- start start 2023-10-14T18:51:51.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cd6e0 0x7f16380cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16380cdab0 0x7f163815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 0x7f163815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163815e850 con 0x7f16380cdab0 2023-10-14T18:51:51.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380cd030 con 0x7f163815dda0 2023-10-14T18:51:51.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380cb7c0 con 0x7f16380cd6e0 2023-10-14T18:51:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16380cdab0 0x7f163815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16380cdab0 0x7f163815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33410/0 (socket says 172.21.15.79:33410) 2023-10-14T18:51:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 -- 172.21.15.79:0/273185606 learned_addr learned my addr 172.21.15.79:0/273185606 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f163659c700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cd6e0 0x7f16380cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f1636d9d700 1 --2- 172.21.15.79:0/273185606 >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 0x7f163815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 -- 172.21.15.79:0/273185606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cd6e0 msgr2=0x7f16380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cd6e0 0x7f16380cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 -- 172.21.15.79:0/273185606 >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 msgr2=0x7f163815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 --2- 172.21.15.79:0/273185606 >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 0x7f163815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 -- 172.21.15.79:0/273185606 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163815e290 con 0x7f16380cdab0 2023-10-14T18:51:51.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f1636d9d700 1 --2- 172.21.15.79:0/273185606 >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 0x7f163815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:51.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f162dd9b700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cdab0 0x7f163815d860 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1638089ac0 tx=0x7f1620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4dbc2855c47f43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f1635d9b700 1 -- 172.21.15.79:0/273185606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000b860 con 0x7f16380cdab0 2023-10-14T18:51:51.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f1635d9b700 1 -- 172.21.15.79:0/273185606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000b9c0 con 0x7f16380cdab0 2023-10-14T18:51:51.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.915+0000 7f1635d9b700 1 -- 172.21.15.79:0/273185606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000bd60 con 0x7f16380cdab0 2023-10-14T18:51:51.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 -- 172.21.15.79:0/273185606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cdab0 msgr2=0x7f163815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cdab0 0x7f163815d860 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1638089ac0 tx=0x7f1620009250 comp rx=0 tx=0).stop 2023-10-14T18:51:51.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 -- 172.21.15.79:0/273185606 shutdown_connections 2023-10-14T18:51:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cd6e0 0x7f16380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 --2- 172.21.15.79:0/273185606 >> v2:172.21.15.144:3300/0 conn(0x7f163815dda0 0x7f163815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 --2- 172.21.15.79:0/273185606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cdab0 0x7f163815d860 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 -- 172.21.15.79:0/273185606 >> 172.21.15.79:0/273185606 conn(0x7f1638067660 msgr2=0x7f1638067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:51.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 -- 172.21.15.79:0/273185606 shutdown_connections 2023-10-14T18:51:51.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.916+0000 7f163759e700 1 -- 172.21.15.79:0/273185606 wait complete. 2023-10-14T18:51:51.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.917+0000 7f163759e700 1 Processor -- start 2023-10-14T18:51:51.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.917+0000 7f163759e700 1 -- start start 2023-10-14T18:51:51.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cdab0 0x7f163816e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 0x7f1638159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c94f0 con 0x7f16380cd6e0 2023-10-14T18:51:51.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1638159670 con 0x7f163815dda0 2023-10-14T18:51:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1638159c00 con 0x7f16380cdab0 2023-10-14T18:51:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33420/0 (socket says 172.21.15.79:33420) 2023-10-14T18:51:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 -- 172.21.15.79:0/2312028319 learned_addr learned my addr 172.21.15.79:0/2312028319 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:51.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f1636d9d700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 0x7f1638159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f162dd9b700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cdab0 0x7f163816e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 -- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cdab0 msgr2=0x7f163816e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cdab0 0x7f163816e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 -- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 msgr2=0x7f1638159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 0x7f1638159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 -- 172.21.15.79:0/2312028319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200094f0 con 0x7f16380cd6e0 2023-10-14T18:51:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f1636d9d700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 0x7f1638159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:51.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f163659c700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f162800d860 tx=0x7f1628008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.918+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628009610 con 0x7f16380cd6e0 2023-10-14T18:51:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.919+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638159920 con 0x7f16380cd6e0 2023-10-14T18:51:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.919+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628009770 con 0x7f16380cd6e0 2023-10-14T18:51:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.919+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628009b30 con 0x7f16380cd6e0 2023-10-14T18:51:51.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.919+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380c9180 con 0x7f16380cd6e0 2023-10-14T18:51:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.919+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1638089280 con 0x7f16380cd6e0 2023-10-14T18:51:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.920+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f162801e460 con 0x7f16380cd6e0 2023-10-14T18:51:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.920+0000 7f162effd700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.920+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1628084c20 con 0x7f16380cd6e0 2023-10-14T18:51:51.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.920+0000 7f162dd9b700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.921+0000 7f162dd9b700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 0x7f16180693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1638089ac0 tx=0x7f1620017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:51.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:51.924+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1628051e90 con 0x7f16380cd6e0 2023-10-14T18:51:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.105+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16380c97d0 con 0x7f16380cd6e0 2023-10-14T18:51:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.106+0000 7f162effd700 1 -- 172.21.15.79:0/2312028319 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f1628070c20 con 0x7f16380cd6e0 2023-10-14T18:51:52.108 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:52.108 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":141,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:42.538675+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:51:16.391202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-14T18:51:17.003227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:51:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 msgr2=0x7f16180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 0x7f16180693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1638089ac0 tx=0x7f1620017000 comp rx=0 tx=0).stop 2023-10-14T18:51:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 msgr2=0x7f16380b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f162800d860 tx=0x7f1628008040 comp rx=0 tx=0).stop 2023-10-14T18:51:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 shutdown_connections 2023-10-14T18:51:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1618066f30 0x7f16180693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f163815dda0 0x7f1638159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16380cd6e0 0x7f16380b4ca0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 --2- 172.21.15.79:0/2312028319 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f16380cdab0 0x7f163816e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 >> 172.21.15.79:0/2312028319 conn(0x7f1638067660 msgr2=0x7f16380c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 shutdown_connections 2023-10-14T18:51:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.108+0000 7f163759e700 1 -- 172.21.15.79:0/2312028319 wait complete. 2023-10-14T18:51:52.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:51:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.235+0000 7f3a57b89700 1 Processor -- start 2023-10-14T18:51:52.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.235+0000 7f3a57b89700 1 -- start start 2023-10-14T18:51:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a57b89700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3a500a79f0 0x7f3a5006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a57b89700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a500b15e0 0x7f3a5006eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a57b89700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500b26d0 con 0x7f3a500a7dc0 2023-10-14T18:51:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a57b89700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500aeab0 con 0x7f3a500b15e0 2023-10-14T18:51:52.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a57b89700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500b2b60 con 0x7f3a500a79f0 2023-10-14T18:51:52.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a55124700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a500b15e0 0x7f3a5006eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a55124700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3a500b15e0 0x7f3a5006eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33422/0 (socket says 172.21.15.79:33422) 2023-10-14T18:51:52.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.236+0000 7f3a55124700 1 -- 172.21.15.79:0/2001940485 learned_addr learned my addr 172.21.15.79:0/2001940485 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:52.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55925700 1 --2- 172.21.15.79:0/2001940485 >> v2:172.21.15.144:3300/0 conn(0x7f3a500a79f0 0x7f3a5006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55124700 1 -- 172.21.15.79:0/2001940485 >> v2:172.21.15.144:3300/0 conn(0x7f3a500a79f0 msgr2=0x7f3a5006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55124700 1 --2- 172.21.15.79:0/2001940485 >> v2:172.21.15.144:3300/0 conn(0x7f3a500a79f0 0x7f3a5006eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55124700 1 -- 172.21.15.79:0/2001940485 >> v1:172.21.15.144:6789/0 conn(0x7f3a500a7dc0 legacy=0x7f3a5015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55124700 1 -- 172.21.15.79:0/2001940485 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500b1ac0 con 0x7f3a500b15e0 2023-10-14T18:51:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a55124700 1 --2- 172.21.15.79:0/2001940485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500b15e0 0x7f3a5006eff0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3a5006c5e0 tx=0x7f3a44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca4bfb1f5b9db43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a54923700 1 -- 172.21.15.79:0/2001940485 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400b860 con 0x7f3a500b15e0 2023-10-14T18:51:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a54923700 1 -- 172.21.15.79:0/2001940485 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400b9c0 con 0x7f3a500b15e0 2023-10-14T18:51:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a54923700 1 -- 172.21.15.79:0/2001940485 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400bd60 con 0x7f3a500b15e0 2023-10-14T18:51:52.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a57b89700 1 -- 172.21.15.79:0/2001940485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500b15e0 msgr2=0x7f3a5006eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.237+0000 7f3a57b89700 1 --2- 172.21.15.79:0/2001940485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500b15e0 0x7f3a5006eff0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3a5006c5e0 tx=0x7f3a44009250 comp rx=0 tx=0).stop 2023-10-14T18:51:52.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 -- 172.21.15.79:0/2001940485 shutdown_connections 2023-10-14T18:51:52.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 --2- 172.21.15.79:0/2001940485 >> v2:172.21.15.144:3300/0 conn(0x7f3a500a79f0 0x7f3a5006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 --2- 172.21.15.79:0/2001940485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500b15e0 0x7f3a5006eff0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 -- 172.21.15.79:0/2001940485 >> 172.21.15.79:0/2001940485 conn(0x7f3a500cd1e0 msgr2=0x7f3a500cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:52.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 -- 172.21.15.79:0/2001940485 shutdown_connections 2023-10-14T18:51:52.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.238+0000 7f3a57b89700 1 -- 172.21.15.79:0/2001940485 wait complete. 2023-10-14T18:51:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 Processor -- start 2023-10-14T18:51:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 -- start start 2023-10-14T18:51:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a500a79f0 0x7f3a500c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a500b15e0 0x7f3a5015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c4350 con 0x7f3a500a7dc0 2023-10-14T18:51:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c3980 con 0x7f3a500b15e0 2023-10-14T18:51:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.239+0000 7f3a57b89700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c2d70 con 0x7f3a500a79f0 2023-10-14T18:51:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33432/0 (socket says 172.21.15.79:33432) 2023-10-14T18:51:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 -- 172.21.15.79:0/1347874270 learned_addr learned my addr 172.21.15.79:0/1347874270 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55925700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a500a79f0 0x7f3a500c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a56126700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a500b15e0 0x7f3a5015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 -- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a500a79f0 msgr2=0x7f3a500c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a500a79f0 0x7f3a500c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 -- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a500b15e0 msgr2=0x7f3a5015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a500b15e0 0x7f3a5015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 -- 172.21.15.79:0/1347874270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a440094f0 con 0x7f3a500a7dc0 2023-10-14T18:51:52.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a55124700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3a50071fd0 tx=0x7f3a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44024440 con 0x7f3a500a7dc0 2023-10-14T18:51:52.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a440245a0 con 0x7f3a500a7dc0 2023-10-14T18:51:52.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44024960 con 0x7f3a500a7dc0 2023-10-14T18:51:52.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a500c3050 con 0x7f3a500a7dc0 2023-10-14T18:51:52.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.240+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a500c3610 con 0x7f3a500a7dc0 2023-10-14T18:51:52.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.241+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500c3b10 con 0x7f3a500a7dc0 2023-10-14T18:51:52.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.242+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a4401a420 con 0x7f3a500a7dc0 2023-10-14T18:51:52.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.242+0000 7f3a4dffb700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 0x7f3a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.242+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a440861c0 con 0x7f3a500a7dc0 2023-10-14T18:51:52.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.242+0000 7f3a55925700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 0x7f3a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.243+0000 7f3a55925700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 0x7f3a3c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3a40007640 tx=0x7f3a40009850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.246+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a44053430 con 0x7f3a500a7dc0 2023-10-14T18:51:52.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.471+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a5004c3c0 con 0x7f3a500a7dc0 2023-10-14T18:51:52.472 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:51:52.472+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:51:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.476+0000 7f3a4dffb700 1 -- 172.21.15.79:0/1347874270 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a44056a50 con 0x7f3a500a7dc0 2023-10-14T18:51:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 msgr2=0x7f3a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 0x7f3a3c0693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3a40007640 tx=0x7f3a40009850 comp rx=0 tx=0).stop 2023-10-14T18:51:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 msgr2=0x7f3a501586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3a50071fd0 tx=0x7f3a44017000 comp rx=0 tx=0).stop 2023-10-14T18:51:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 shutdown_connections 2023-10-14T18:51:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3a3c066f30 0x7f3a3c0693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a500b15e0 0x7f3a5015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3a500a79f0 0x7f3a500c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 --2- 172.21.15.79:0/1347874270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a500a7dc0 0x7f3a501586d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.478+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 >> 172.21.15.79:0/1347874270 conn(0x7f3a500cd1e0 msgr2=0x7f3a5006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.479+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 shutdown_connections 2023-10-14T18:51:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.479+0000 7f3a57b89700 1 -- 172.21.15.79:0/1347874270 wait complete. 2023-10-14T18:51:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:51:52.482 INFO:tasks.ceph.mds.a.smithi079.stderr: -7464> 2023-10-14T18:51:23.950+0000 7ffaa3d9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:51:52.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:51:52.508 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:51:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.609+0000 7ff93805d700 1 Processor -- start 2023-10-14T18:51:52.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.609+0000 7ff93805d700 1 -- start start 2023-10-14T18:51:52.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff93805d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff930164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff93805d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9301513f0 con 0x7ff9300cd300 2023-10-14T18:51:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff93805d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93015db20 con 0x7ff93015afb0 2023-10-14T18:51:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff93805d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015e7a0 con 0x7ff9300d1470 2023-10-14T18:51:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff935df9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9300cd300 0x7ff9300b6760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44490/0 (socket says 172.21.15.79:44490) 2023-10-14T18:51:52.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.610+0000 7ff935df9700 1 -- 172.21.15.79:0/859409842 learned_addr learned my addr 172.21.15.79:0/859409842 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff930164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687610934 0 0) 0x7ff9301513f0 con 0x7ff9300cd300 2023-10-14T18:51:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff918003570 con 0x7ff9300cd300 2023-10-14T18:51:52.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206250109 0 0) 0x7ff918003570 con 0x7ff9300cd300 2023-10-14T18:51:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 msgr2=0x7ff930164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff930164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 >> v1:172.21.15.144:6789/0 conn(0x7ff93015afb0 legacy=0x7ff9300d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93015de00 con 0x7ff9300cd300 2023-10-14T18:51:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff9200017f0 con 0x7ff9300cd300 2023-10-14T18:51:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 >> v1:172.21.15.79:6789/0 conn(0x7ff9300cd300 legacy=0x7ff9300b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff918003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918004010 0x7ff918004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff918004d50 0x7ff9180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015e7a0 con 0x7ff918004d50 2023-10-14T18:51:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800bbf0 con 0x7ff918004010 2023-10-14T18:51:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800bdb0 con 0x7ff9300d1470 2023-10-14T18:51:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff918004d50 0x7ff9180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9355f8700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918004010 0x7ff918004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff935df9700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff918003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 -- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 msgr2=0x7ff918003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9300d1470 0x7ff918003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 -- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918004010 msgr2=0x7ff918004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:52.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918004010 0x7ff918004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 -- 172.21.15.79:0/859409842 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918003570 con 0x7ff918004d50 2023-10-14T18:51:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9355f8700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff918004010 0x7ff918004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.611+0000 7ff9365fa700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff918004d50 0x7ff9180051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff928006f00 tx=0x7ff9280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920abfb9b7416af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800e6e0 con 0x7ff918004d50 2023-10-14T18:51:52.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800e840 con 0x7ff918004d50 2023-10-14T18:51:52.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff934df7700 1 -- 172.21.15.79:0/859409842 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800ec00 con 0x7ff918004d50 2023-10-14T18:51:52.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 -- 172.21.15.79:0/859409842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff918004d50 msgr2=0x7ff9180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 --2- 172.21.15.79:0/859409842 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff918004d50 0x7ff9180051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff928006f00 tx=0x7ff9280091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff9365fa700 1 -- 172.21.15.79:0/859409842 reap_dead start 2023-10-14T18:51:52.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 -- 172.21.15.79:0/859409842 shutdown_connections 2023-10-14T18:51:52.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 -- 172.21.15.79:0/859409842 >> 172.21.15.79:0/859409842 conn(0x7ff930068d90 msgr2=0x7ff930069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:52.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 -- 172.21.15.79:0/859409842 shutdown_connections 2023-10-14T18:51:52.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.612+0000 7ff93805d700 1 -- 172.21.15.79:0/859409842 wait complete. 2023-10-14T18:51:52.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.613+0000 7ff93805d700 1 Processor -- start 2023-10-14T18:51:52.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.613+0000 7ff93805d700 1 -- start start 2023-10-14T18:51:52.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff93014f730 0x7ff93015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 0x7ff93016a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301577d0 con 0x7ff93016a710 2023-10-14T18:51:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930151880 con 0x7ff930151b00 2023-10-14T18:51:52.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff93805d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015c980 con 0x7ff93014f730 2023-10-14T18:51:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9365fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9365fa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33474/0 (socket says 172.21.15.79:33474) 2023-10-14T18:51:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9365fa700 1 -- 172.21.15.79:0/109053431 learned_addr learned my addr 172.21.15.79:0/109053431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9355f8700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 0x7ff93016a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff935df9700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff93014f730 0x7ff93015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9365fa700 1 -- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff93014f730 msgr2=0x7ff93015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.614+0000 7ff9365fa700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff93014f730 0x7ff93015ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff9365fa700 1 -- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 msgr2=0x7ff93016a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff9365fa700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 0x7ff93016a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:52.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff9365fa700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93014fb00 con 0x7ff93016a710 2023-10-14T18:51:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff9355f8700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 0x7ff93016a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff9365fa700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff9300d1870 tx=0x7ff92801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928022070 con 0x7ff93016a710 2023-10-14T18:51:52.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928013e10 con 0x7ff93016a710 2023-10-14T18:51:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93015c370 con 0x7ff93016a710 2023-10-14T18:51:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800e6e0 con 0x7ff93016a710 2023-10-14T18:51:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.615+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93015c610 con 0x7ff93016a710 2023-10-14T18:51:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.616+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93015c1a0 con 0x7ff93016a710 2023-10-14T18:51:52.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.616+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff928027980 con 0x7ff93016a710 2023-10-14T18:51:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.617+0000 7ff92dffb700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.617+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ff928000e40 con 0x7ff93016a710 2023-10-14T18:51:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.617+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7ff91c06eaf0 con 0x7ff93016a710 2023-10-14T18:51:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.617+0000 7ff935df9700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:52.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.617+0000 7ff935df9700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff920001190 tx=0x7ff920006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:52.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.621+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff928052680 con 0x7ff93016a710 2023-10-14T18:51:52.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:52.849+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff93004c3c0 con 0x7ff93016a710 2023-10-14T18:51:53.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.476+0000 7ff92dffb700 1 -- 172.21.15.79:0/109053431 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff928017070 con 0x7ff93016a710 2023-10-14T18:51:53.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 msgr2=0x7ff91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff920001190 tx=0x7ff920006040 comp rx=0 tx=0).stop 2023-10-14T18:51:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 msgr2=0x7ff93016ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff9300d1870 tx=0x7ff92801a000 comp rx=0 tx=0).stop 2023-10-14T18:51:53.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 shutdown_connections 2023-10-14T18:51:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff93016a710 0x7ff93016ab80 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff93014f730 0x7ff93015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 --2- 172.21.15.79:0/109053431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff930151b00 0x7ff93016a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 >> 172.21.15.79:0/109053431 conn(0x7ff930068d90 msgr2=0x7ff93015a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 shutdown_connections 2023-10-14T18:51:53.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.479+0000 7ff93805d700 1 -- 172.21.15.79:0/109053431 wait complete. 2023-10-14T18:51:53.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:51:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.651+0000 7f28b2386700 1 Processor -- start 2023-10-14T18:51:53.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.651+0000 7f28b2386700 1 -- start start 2023-10-14T18:51:53.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28b2386700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28ac0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28b2386700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0b0d60 con 0x7f28ac0b11f0 2023-10-14T18:51:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28b2386700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0b3540 con 0x7f28ac159e50 2023-10-14T18:51:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28b2386700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d15b0 con 0x7f28ac0693c0 2023-10-14T18:51:53.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28ab7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28ac0b11f0 0x7f28ac068cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44498/0 (socket says 172.21.15.79:44498) 2023-10-14T18:51:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28ab7fe700 1 -- 172.21.15.79:0/549153377 learned_addr learned my addr 172.21.15.79:0/549153377 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.652+0000 7f28b0923700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28ac0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609889128 0 0) 0x7f28ac0b0d60 con 0x7f28ac0b11f0 2023-10-14T18:51:53.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894003570 con 0x7f28ac0b11f0 2023-10-14T18:51:53.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016399193 0 0) 0x7f2894003570 con 0x7f28ac0b11f0 2023-10-14T18:51:53.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 msgr2=0x7f28ac0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:53.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28ac0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 >> v1:172.21.15.144:6789/0 conn(0x7f28ac159e50 legacy=0x7f28ac0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0d1890 con 0x7f28ac0b11f0 2023-10-14T18:51:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f28a0001470 con 0x7f28ac0b11f0 2023-10-14T18:51:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 >> v1:172.21.15.79:6789/0 conn(0x7f28ac0b11f0 legacy=0x7f28ac068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2894003a90 0x7f2894003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894004810 0x7f2894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28940051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0d15b0 con 0x7f2894003a90 2023-10-14T18:51:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289400bb60 con 0x7f2894004810 2023-10-14T18:51:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289400bd20 con 0x7f28ac0693c0 2023-10-14T18:51:53.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2894003a90 0x7f2894003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28ab7fe700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894004810 0x7f2894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28b0923700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28940051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 -- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 msgr2=0x7f28940051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:53.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac0693c0 0x7f28940051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 -- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894004810 msgr2=0x7f2894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894004810 0x7f2894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 -- 172.21.15.79:0/549153377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894003570 con 0x7f2894003a90 2023-10-14T18:51:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.653+0000 7f28abfff700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2894003a90 0x7f2894003ea0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f289c0018b0 tx=0x7f289c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24723dfcfebf0ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:53.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c012420 con 0x7f2894003a90 2023-10-14T18:51:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c012580 con 0x7f2894003a90 2023-10-14T18:51:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28aaffd700 1 -- 172.21.15.79:0/549153377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c012920 con 0x7f2894003a90 2023-10-14T18:51:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 -- 172.21.15.79:0/549153377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2894003a90 msgr2=0x7f2894003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 --2- 172.21.15.79:0/549153377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2894003a90 0x7f2894003ea0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f289c0018b0 tx=0x7f289c007d30 comp rx=0 tx=0).stop 2023-10-14T18:51:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b0923700 1 -- 172.21.15.79:0/549153377 reap_dead start 2023-10-14T18:51:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 -- 172.21.15.79:0/549153377 shutdown_connections 2023-10-14T18:51:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 -- 172.21.15.79:0/549153377 >> 172.21.15.79:0/549153377 conn(0x7f28ac068130 msgr2=0x7f28ac0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 -- 172.21.15.79:0/549153377 shutdown_connections 2023-10-14T18:51:53.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.654+0000 7f28b2386700 1 -- 172.21.15.79:0/549153377 wait complete. 2023-10-14T18:51:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.655+0000 7f28b2386700 1 Processor -- start 2023-10-14T18:51:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.655+0000 7f28b2386700 1 -- start start 2023-10-14T18:51:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894003a90 0x7f28ac14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac1569d0 0x7f28ac157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac152b60 con 0x7f28ac156e20 2023-10-14T18:51:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac1533c0 con 0x7f2894003a90 2023-10-14T18:51:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b2386700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c5af0 con 0x7f28ac1569d0 2023-10-14T18:51:53.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b0923700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b0923700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33494/0 (socket says 172.21.15.79:33494) 2023-10-14T18:51:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b0923700 1 -- 172.21.15.79:0/61194087 learned_addr learned my addr 172.21.15.79:0/61194087 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28ab7fe700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac1569d0 0x7f28ac157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28abfff700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894003a90 0x7f28ac14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b0923700 1 -- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac1569d0 msgr2=0x7f28ac157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.656+0000 7f28b0923700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac1569d0 0x7f28ac157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b0923700 1 -- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894003a90 msgr2=0x7f28ac14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:53.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b0923700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894003a90 0x7f28ac14f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b0923700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac14f9d0 con 0x7f28ac156e20 2023-10-14T18:51:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b0923700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0697c0 tx=0x7f28a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400e070 con 0x7f28ac156e20 2023-10-14T18:51:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a4011d00 con 0x7f28ac156e20 2023-10-14T18:51:53.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac1573e0 con 0x7f28ac156e20 2023-10-14T18:51:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a40166c0 con 0x7f28ac156e20 2023-10-14T18:51:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.657+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac153050 con 0x7f28ac156e20 2023-10-14T18:51:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.658+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac1531e0 con 0x7f28ac156e20 2023-10-14T18:51:53.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.658+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28a4016af0 con 0x7f28ac156e20 2023-10-14T18:51:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.658+0000 7f2893fff700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 0x7f28980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.659+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f28a4085060 con 0x7f28ac156e20 2023-10-14T18:51:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.659+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f289806eaf0 con 0x7f28ac156e20 2023-10-14T18:51:53.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.659+0000 7f28abfff700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 0x7f28980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.659+0000 7f28abfff700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 0x7f28980693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f289c001010 tx=0x7f289c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:53.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.663+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28a4052280 con 0x7f28ac156e20 2023-10-14T18:51:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:53.846+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28ac071390 con 0x7f28ac156e20 2023-10-14T18:51:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.779+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(144..144 src has 1..144) v4 ==== 288+0+0 (secure 0 0 0) 0x7f28a4011e70 con 0x7f28ac156e20 2023-10-14T18:51:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.780+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f289806cf20 con 0x7f28ac156e20 2023-10-14T18:51:54.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.784+0000 7f2893fff700 1 -- 172.21.15.79:0/61194087 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) v1 ==== 181+0+0 (secure 0 0 0) 0x7f28ac071390 con 0x7f28ac156e20 2023-10-14T18:51:54.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.788+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 msgr2=0x7f28980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.788+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 0x7f28980693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f289c001010 tx=0x7f289c015000 comp rx=0 tx=0).stop 2023-10-14T18:51:54.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.788+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 msgr2=0x7f28ac157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.788+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0697c0 tx=0x7f28a400b040 comp rx=0 tx=0).stop 2023-10-14T18:51:54.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 shutdown_connections 2023-10-14T18:51:54.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2898066f30 0x7f28980693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ac156e20 0x7f28ac157cd0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2894003a90 0x7f28ac14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 --2- 172.21.15.79:0/61194087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28ac1569d0 0x7f28ac157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 >> 172.21.15.79:0/61194087 conn(0x7f28ac068130 msgr2=0x7f28ac159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:54.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 shutdown_connections 2023-10-14T18:51:54.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.790+0000 7f28b2386700 1 -- 172.21.15.79:0/61194087 wait complete. 2023-10-14T18:51:54.793 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:51:54.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:51:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.928+0000 7f059cd4a700 1 Processor -- start 2023-10-14T18:51:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.928+0000 7f059cd4a700 1 -- start start 2023-10-14T18:51:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059cd4a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f059815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059cd4a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05980b46f0 0x7f05980b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059cd4a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05980b5090 con 0x7f0598159ef0 2023-10-14T18:51:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059cd4a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05980b17b0 con 0x7f05980b46f0 2023-10-14T18:51:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059cd4a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b1a60 con 0x7f05980b6a10 2023-10-14T18:51:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0598159ef0 0x7f05980b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44500/0 (socket says 172.21.15.79:44500) 2023-10-14T18:51:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059659c700 1 -- 172.21.15.79:0/1319781621 learned_addr learned my addr 172.21.15.79:0/1319781621 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.929+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942296221 0 0) 0x7f0588001610 con 0x7f0598159ef0 2023-10-14T18:51:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0580003570 con 0x7f0598159ef0 2023-10-14T18:51:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f0595d9b700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f059815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f0596d9d700 1 --2- 172.21.15.79:0/1319781621 >> v2:172.21.15.144:3300/0 conn(0x7f05980b46f0 0x7f05980b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2130770621 0 0) 0x7f0580003570 con 0x7f0598159ef0 2023-10-14T18:51:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 msgr2=0x7f059815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f059815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 >> v2:172.21.15.144:3300/0 conn(0x7f05980b46f0 msgr2=0x7f05980b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 --2- 172.21.15.79:0/1319781621 >> v2:172.21.15.144:3300/0 conn(0x7f05980b46f0 0x7f05980b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980b1d40 con 0x7f0598159ef0 2023-10-14T18:51:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0588001b00 con 0x7f0598159ef0 2023-10-14T18:51:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 >> v1:172.21.15.79:6789/0 conn(0x7f0598159ef0 legacy=0x7f05980b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0580003ae0 0x7f0580003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f0580004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0580004d50 0x7f05800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b17b0 con 0x7f0580003ae0 2023-10-14T18:51:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05980b1a60 con 0x7f0580004d50 2023-10-14T18:51:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058000bb10 con 0x7f05980b6a10 2023-10-14T18:51:54.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0580003ae0 0x7f0580003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f0595d9b700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f0580004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f0596d9d700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0580004d50 0x7f05800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 -- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 msgr2=0x7f0580004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:54.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f0580004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 -- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0580004d50 msgr2=0x7f05800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0580004d50 0x7f05800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 -- 172.21.15.79:0/1319781621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580003570 con 0x7f0580003ae0 2023-10-14T18:51:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f0595d9b700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05980b6a10 0x7f0580004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:54.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059659c700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0580003ae0 0x7f0580003ef0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f058800c750 tx=0x7f0588007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d0f5e9bc3f3244 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005b70 con 0x7f0580003ae0 2023-10-14T18:51:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588005cf0 con 0x7f0580003ae0 2023-10-14T18:51:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.930+0000 7f059559a700 1 -- 172.21.15.79:0/1319781621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588007320 con 0x7f0580003ae0 2023-10-14T18:51:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 -- 172.21.15.79:0/1319781621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0580003ae0 msgr2=0x7f0580003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 --2- 172.21.15.79:0/1319781621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0580003ae0 0x7f0580003ef0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f058800c750 tx=0x7f0588007d70 comp rx=0 tx=0).stop 2023-10-14T18:51:54.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f0596d9d700 1 -- 172.21.15.79:0/1319781621 reap_dead start 2023-10-14T18:51:54.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 -- 172.21.15.79:0/1319781621 shutdown_connections 2023-10-14T18:51:54.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 -- 172.21.15.79:0/1319781621 >> 172.21.15.79:0/1319781621 conn(0x7f059809a0a0 msgr2=0x7f0598067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:54.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 -- 172.21.15.79:0/1319781621 shutdown_connections 2023-10-14T18:51:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.931+0000 7f059cd4a700 1 -- 172.21.15.79:0/1319781621 wait complete. 2023-10-14T18:51:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.932+0000 7f059cd4a700 1 Processor -- start 2023-10-14T18:51:54.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.932+0000 7f059cd4a700 1 -- start start 2023-10-14T18:51:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 0x7f0598151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05981562f0 0x7f059815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598152c00 con 0x7f059809b740 2023-10-14T18:51:54.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598151ff0 con 0x7f05981562f0 2023-10-14T18:51:54.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059cd4a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05981522d0 con 0x7f0580003ae0 2023-10-14T18:51:54.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33502/0 (socket says 172.21.15.79:33502) 2023-10-14T18:51:54.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 -- 172.21.15.79:0/3642072710 learned_addr learned my addr 172.21.15.79:0/3642072710 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:54.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0595d9b700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05981562f0 0x7f059815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059659c700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 0x7f0598151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 -- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 msgr2=0x7f0598151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 0x7f0598151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 -- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05981562f0 msgr2=0x7f059815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:54.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05981562f0 0x7f059815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:54.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05981525b0 con 0x7f059809b740 2023-10-14T18:51:54.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f059659c700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 0x7f0598151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.933+0000 7f0596d9d700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f059809ece0 tx=0x7f0590008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.934+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590015670 con 0x7f059809b740 2023-10-14T18:51:54.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.934+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900157d0 con 0x7f059809b740 2023-10-14T18:51:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.934+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0598152890 con 0x7f059809b740 2023-10-14T18:51:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.934+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590015bd0 con 0x7f059809b740 2023-10-14T18:51:54.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.934+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059815d110 con 0x7f059809b740 2023-10-14T18:51:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.935+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059815d330 con 0x7f059809b740 2023-10-14T18:51:54.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.935+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f059001f410 con 0x7f059809b740 2023-10-14T18:51:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.935+0000 7f05867fc700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 0x7f05780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.936+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f0590084020 con 0x7f059809b740 2023-10-14T18:51:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.936+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7f057806dcf0 con 0x7f059809b740 2023-10-14T18:51:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.936+0000 7f059659c700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 0x7f05780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:54.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.936+0000 7f059659c700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 0x7f05780693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0588003260 tx=0x7f0588015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:54.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:54.940+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05900513f0 con 0x7f059809b740 2023-10-14T18:51:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.121+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f059815a640 con 0x7f059809b740 2023-10-14T18:51:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.781+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(145..145 src has 1..145) v4 ==== 288+0+0 (secure 0 0 0) 0x7f059000f300 con 0x7f059809b740 2023-10-14T18:51:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.782+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f057806ca80 con 0x7f059809b740 2023-10-14T18:51:55.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.784+0000 7f05867fc700 1 -- 172.21.15.79:0/3642072710 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0590054a10 con 0x7f059809b740 2023-10-14T18:51:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.792+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 msgr2=0x7f05780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.792+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 0x7f05780693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0588003260 tx=0x7f0588015000 comp rx=0 tx=0).stop 2023-10-14T18:51:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.792+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 msgr2=0x7f059809bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.792+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f059809ece0 tx=0x7f0590008040 comp rx=0 tx=0).stop 2023-10-14T18:51:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 shutdown_connections 2023-10-14T18:51:55.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0578066f30 0x7f05780693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f059809b740 0x7f059809bbe0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0580003ae0 0x7f0598151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 --2- 172.21.15.79:0/3642072710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05981562f0 0x7f059815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.793+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 >> 172.21.15.79:0/3642072710 conn(0x7f059809a0a0 msgr2=0x7f0598159270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.794+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 shutdown_connections 2023-10-14T18:51:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.794+0000 7f059cd4a700 1 -- 172.21.15.79:0/3642072710 wait complete. 2023-10-14T18:51:55.796 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:51:55.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:51:55.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.925+0000 7f21c6ab6700 1 Processor -- start 2023-10-14T18:51:55.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.925+0000 7f21c6ab6700 1 -- start start 2023-10-14T18:51:55.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c6ab6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f21c0143970 0x7f21c0069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c6ab6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21c0070e10 0x7f21c006a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c6ab6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c015e380 con 0x7f21c01435a0 2023-10-14T18:51:55.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c6ab6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c006fb70 con 0x7f21c0070e10 2023-10-14T18:51:55.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c6ab6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c006a8c0 con 0x7f21c0143970 2023-10-14T18:51:55.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c5053700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21c0070e10 0x7f21c006a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:55.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c4852700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f21c01435a0 0x7f21c0070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44514/0 (socket says 172.21.15.79:44514) 2023-10-14T18:51:55.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c5053700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21c0070e10 0x7f21c006a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33506/0 (socket says 172.21.15.79:33506) 2023-10-14T18:51:55.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.926+0000 7f21c4852700 1 -- 172.21.15.79:0/2504590392 learned_addr learned my addr 172.21.15.79:0/2504590392 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:55.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c5053700 1 -- 172.21.15.79:0/2504590392 >> v2:172.21.15.144:3300/0 conn(0x7f21c0143970 msgr2=0x7f21c0069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:55.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c5053700 1 --2- 172.21.15.79:0/2504590392 >> v2:172.21.15.144:3300/0 conn(0x7f21c0143970 0x7f21c0069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c5053700 1 -- 172.21.15.79:0/2504590392 >> v1:172.21.15.79:6789/0 conn(0x7f21c01435a0 legacy=0x7f21c0070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c5053700 1 -- 172.21.15.79:0/2504590392 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c006ab70 con 0x7f21c0070e10 2023-10-14T18:51:55.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21bf7fe700 1 -- 172.21.15.79:0/2504590392 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926110724 0 0) 0x7f21c015e380 con 0x7f21c01435a0 2023-10-14T18:51:55.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c5053700 1 --2- 172.21.15.79:0/2504590392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0070e10 0x7f21c006a380 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f21c00cb630 tx=0x7f21b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b24577a160fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21bf7fe700 1 -- 172.21.15.79:0/2504590392 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800e070 con 0x7f21c0070e10 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21bf7fe700 1 -- 172.21.15.79:0/2504590392 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800bc30 con 0x7f21c0070e10 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21bf7fe700 1 -- 172.21.15.79:0/2504590392 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8012430 con 0x7f21c0070e10 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c6ab6700 1 -- 172.21.15.79:0/2504590392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0070e10 msgr2=0x7f21c006a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.927+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/2504590392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0070e10 0x7f21c006a380 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f21c00cb630 tx=0x7f21b8009780 comp rx=0 tx=0).stop 2023-10-14T18:51:55.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 -- 172.21.15.79:0/2504590392 shutdown_connections 2023-10-14T18:51:55.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/2504590392 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0070e10 0x7f21c006a380 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/2504590392 >> v2:172.21.15.144:3300/0 conn(0x7f21c0143970 0x7f21c0069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 -- 172.21.15.79:0/2504590392 >> 172.21.15.79:0/2504590392 conn(0x7f21c00ca520 msgr2=0x7f21c00ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:55.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 -- 172.21.15.79:0/2504590392 shutdown_connections 2023-10-14T18:51:55.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.928+0000 7f21c6ab6700 1 -- 172.21.15.79:0/2504590392 wait complete. 2023-10-14T18:51:55.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 Processor -- start 2023-10-14T18:51:55.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 -- start start 2023-10-14T18:51:55.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 0x7f21c013e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 0x7f21c006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0142260 con 0x7f21c0143970 2023-10-14T18:51:55.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00aedf0 con 0x7f21c0070e10 2023-10-14T18:51:55.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.929+0000 7f21c6ab6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00b18c0 con 0x7f21c01435a0 2023-10-14T18:51:55.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:55.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33510/0 (socket says 172.21.15.79:33510) 2023-10-14T18:51:55.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 -- 172.21.15.79:0/1292130450 learned_addr learned my addr 172.21.15.79:0/1292130450 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:55.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c4852700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 0x7f21c013e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:55.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 -- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 msgr2=0x7f21c006eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21bffff700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 0x7f21c006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 0x7f21c006eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 -- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 msgr2=0x7f21c013e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 0x7f21c013e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:55.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 -- 172.21.15.79:0/1292130450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009a20 con 0x7f21c0143970 2023-10-14T18:51:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c4852700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 0x7f21c013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21bffff700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 0x7f21c006eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c5053700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f21b8013000 tx=0x7f21b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:55.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b801d630 con 0x7f21c0143970 2023-10-14T18:51:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b801d790 con 0x7f21c0143970 2023-10-14T18:51:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c013ea90 con 0x7f21c0143970 2023-10-14T18:51:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b801db30 con 0x7f21c0143970 2023-10-14T18:51:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.930+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00ae830 con 0x7f21c0143970 2023-10-14T18:51:55.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.931+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c004c3c0 con 0x7f21c0143970 2023-10-14T18:51:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.931+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b8024070 con 0x7f21c0143970 2023-10-14T18:51:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.932+0000 7f21bcff9700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.932+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f21b8086b90 con 0x7f21c0143970 2023-10-14T18:51:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.932+0000 7f21c4852700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:55.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.932+0000 7f21c4852700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 0x7f21a00693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f21b00018d0 tx=0x7f21b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:55.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:55.936+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b8054100 con 0x7f21c0143970 2023-10-14T18:51:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.118+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f21c006e940 con 0x7f21c0143970 2023-10-14T18:51:56.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.122+0000 7f21bcff9700 1 -- 172.21.15.79:0/1292130450 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21b8009880 con 0x7f21c0143970 2023-10-14T18:51:56.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 msgr2=0x7f21a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 0x7f21a00693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f21b00018d0 tx=0x7f21b0009040 comp rx=0 tx=0).stop 2023-10-14T18:51:56.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 msgr2=0x7f21c006f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f21b8013000 tx=0x7f21b8019000 comp rx=0 tx=0).stop 2023-10-14T18:51:56.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 shutdown_connections 2023-10-14T18:51:56.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f21a0066f30 0x7f21a00693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c0143970 0x7f21c006f0a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21c0070e10 0x7f21c013e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 --2- 172.21.15.79:0/1292130450 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f21c01435a0 0x7f21c006eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.124+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 >> 172.21.15.79:0/1292130450 conn(0x7f21c00ca520 msgr2=0x7f21c00c3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.125+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 shutdown_connections 2023-10-14T18:51:56.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.125+0000 7f21c6ab6700 1 -- 172.21.15.79:0/1292130450 wait complete. 2023-10-14T18:51:56.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-14T18:51:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 Processor -- start 2023-10-14T18:51:56.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 -- start start 2023-10-14T18:51:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab00157870 0x7fab0015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab0015a620 0x7fab0015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015d580 0x7fab00158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0015cbb0 con 0x7fab0015a620 2023-10-14T18:51:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0015bfa0 con 0x7fab00157870 2023-10-14T18:51:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.250+0000 7fab04a5e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0015c280 con 0x7fab0015d580 2023-10-14T18:51:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab0015a620 0x7fab0015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab0015a620 0x7fab0015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33522/0 (socket says 172.21.15.79:33522) 2023-10-14T18:51:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 -- 172.21.15.79:0/2536652232 learned_addr learned my addr 172.21.15.79:0/2536652232 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 -- 172.21.15.79:0/2536652232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015d580 msgr2=0x7fab00158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/2536652232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015d580 0x7fab00158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 -- 172.21.15.79:0/2536652232 >> v2:172.21.15.144:3300/0 conn(0x7fab00157870 msgr2=0x7fab0015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faafe59c700 1 --2- 172.21.15.79:0/2536652232 >> v2:172.21.15.144:3300/0 conn(0x7fab00157870 0x7fab0015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/2536652232 >> v2:172.21.15.144:3300/0 conn(0x7fab00157870 0x7fab0015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 -- 172.21.15.79:0/2536652232 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0015c560 con 0x7fab0015a620 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/2536652232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab0015a620 0x7fab0015d040 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fab00069d80 tx=0x7faae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdaf0627e4ca8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faafdd9b700 1 -- 172.21.15.79:0/2536652232 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800b860 con 0x7fab0015a620 2023-10-14T18:51:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faafdd9b700 1 -- 172.21.15.79:0/2536652232 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae800b9c0 con 0x7fab0015a620 2023-10-14T18:51:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.251+0000 7faafdd9b700 1 -- 172.21.15.79:0/2536652232 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae800bd60 con 0x7fab0015a620 2023-10-14T18:51:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 -- 172.21.15.79:0/2536652232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab0015a620 msgr2=0x7fab0015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 --2- 172.21.15.79:0/2536652232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab0015a620 0x7fab0015d040 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fab00069d80 tx=0x7faae8009250 comp rx=0 tx=0).stop 2023-10-14T18:51:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 -- 172.21.15.79:0/2536652232 shutdown_connections 2023-10-14T18:51:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 --2- 172.21.15.79:0/2536652232 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015d580 0x7fab00158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 --2- 172.21.15.79:0/2536652232 >> v2:172.21.15.144:3300/0 conn(0x7fab00157870 0x7fab0015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 --2- 172.21.15.79:0/2536652232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab0015a620 0x7fab0015d040 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 -- 172.21.15.79:0/2536652232 >> 172.21.15.79:0/2536652232 conn(0x7fab00068ce0 msgr2=0x7fab000690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 -- 172.21.15.79:0/2536652232 shutdown_connections 2023-10-14T18:51:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.252+0000 7fab04a5e700 1 -- 172.21.15.79:0/2536652232 wait complete. 2023-10-14T18:51:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.253+0000 7fab04a5e700 1 Processor -- start 2023-10-14T18:51:56.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.253+0000 7fab04a5e700 1 -- start start 2023-10-14T18:51:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 0x7fab0014c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 0x7fab0016dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0014dd20 con 0x7fab00157870 2023-10-14T18:51:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0014cd20 con 0x7fab0015d580 2023-10-14T18:51:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0014d270 con 0x7fab0015a620 2023-10-14T18:51:56.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33534/0 (socket says 172.21.15.79:33534) 2023-10-14T18:51:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 -- 172.21.15.79:0/3271644618 learned_addr learned my addr 172.21.15.79:0/3271644618 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 0x7fab0014c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafed9d700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 0x7fab0016dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 -- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 msgr2=0x7fab0014c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 0x7fab0014c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 -- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 msgr2=0x7fab0016dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 0x7fab0016dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 -- 172.21.15.79:0/3271644618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80094f0 con 0x7fab00157870 2023-10-14T18:51:56.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 0x7fab0014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafed9d700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 0x7fab0016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faafe59c700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7d0 tx=0x7faaf0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011600 con 0x7fab00157870 2023-10-14T18:51:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0011760 con 0x7fab00157870 2023-10-14T18:51:56.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011b20 con 0x7fab00157870 2023-10-14T18:51:56.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0016e860 con 0x7fab00157870 2023-10-14T18:51:56.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.254+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0014d9b0 con 0x7fab00157870 2023-10-14T18:51:56.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.255+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0004c3c0 con 0x7fab00157870 2023-10-14T18:51:56.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.256+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faaf00193f0 con 0x7fab00157870 2023-10-14T18:51:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.256+0000 7faaf6ffd700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.256+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7faaf0084700 con 0x7fab00157870 2023-10-14T18:51:56.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.256+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.257+0000 7faaf5d9b700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fab00069d80 tx=0x7faae8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.260+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faaf0055700 con 0x7fab00157870 2023-10-14T18:51:56.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.520+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fab0015c840 con 0x7fab00157870 2023-10-14T18:51:56.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.798+0000 7faaf6ffd700 1 -- 172.21.15.79:0/3271644618 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v358) v1 ==== 140+0+0 (secure 0 0 0) 0x7faaf0055290 con 0x7fab00157870 2023-10-14T18:51:56.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 msgr2=0x7faae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fab00069d80 tx=0x7faae8017000 comp rx=0 tx=0).stop 2023-10-14T18:51:56.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 msgr2=0x7fab0014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c7d0 tx=0x7faaf0008040 comp rx=0 tx=0).stop 2023-10-14T18:51:56.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 shutdown_connections 2023-10-14T18:51:56.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab0015d580 0x7fab0016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab00157870 0x7fab0014e1b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 --2- 172.21.15.79:0/3271644618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fab0015a620 0x7fab0014c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 >> 172.21.15.79:0/3271644618 conn(0x7fab00068ce0 msgr2=0x7fab001598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:56.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 shutdown_connections 2023-10-14T18:51:56.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.800+0000 7fab04a5e700 1 -- 172.21.15.79:0/3271644618 wait complete. 2023-10-14T18:51:56.812 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-14T18:51:56.813 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-14T18:51:56.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-14T18:51:56.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.927+0000 7f49226f2700 1 Processor -- start 2023-10-14T18:51:56.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.927+0000 7f49226f2700 1 -- start start 2023-10-14T18:51:56.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.927+0000 7f49226f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 0x7f491c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f49226f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c157c40 0x7f491c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f49226f2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c15cbb0 con 0x7f491c15a620 2023-10-14T18:51:56.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f49226f2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c15bfa0 con 0x7f491c157c40 2023-10-14T18:51:56.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f49226f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c15c280 con 0x7f491c157870 2023-10-14T18:51:56.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c157c40 0x7f491c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c157c40 0x7f491c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33548/0 (socket says 172.21.15.79:33548) 2023-10-14T18:51:56.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 -- 172.21.15.79:0/2798450665 learned_addr learned my addr 172.21.15.79:0/2798450665 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:56.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f491bfff700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 0x7f491c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 -- 172.21.15.79:0/2798450665 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 msgr2=0x7f491c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:56.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 0x7f491c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 -- 172.21.15.79:0/2798450665 >> v1:172.21.15.144:6789/0 conn(0x7f491c15a620 legacy=0x7f491c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:56.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 -- 172.21.15.79:0/2798450665 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c15c560 con 0x7f491c157c40 2023-10-14T18:51:56.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f491bfff700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 0x7f491c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:51:56.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f4920c8f700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c157c40 0x7f491c158110 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4914009f20 tx=0x7f4914009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210165c8417d68f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f491affd700 1 -- 172.21.15.79:0/2798450665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400e070 con 0x7f491c157c40 2023-10-14T18:51:56.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f491affd700 1 -- 172.21.15.79:0/2798450665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400ba40 con 0x7f491c157c40 2023-10-14T18:51:56.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.928+0000 7f491affd700 1 -- 172.21.15.79:0/2798450665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140092e0 con 0x7f491c157c40 2023-10-14T18:51:56.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 -- 172.21.15.79:0/2798450665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c157c40 msgr2=0x7f491c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c157c40 0x7f491c158110 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4914009f20 tx=0x7f4914009840 comp rx=0 tx=0).stop 2023-10-14T18:51:56.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 -- 172.21.15.79:0/2798450665 shutdown_connections 2023-10-14T18:51:56.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c157c40 0x7f491c158110 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 --2- 172.21.15.79:0/2798450665 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157870 0x7f491c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 -- 172.21.15.79:0/2798450665 >> 172.21.15.79:0/2798450665 conn(0x7f491c068ce0 msgr2=0x7f491c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:56.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 -- 172.21.15.79:0/2798450665 shutdown_connections 2023-10-14T18:51:56.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.929+0000 7f49226f2700 1 -- 172.21.15.79:0/2798450665 wait complete. 2023-10-14T18:51:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.930+0000 7f49226f2700 1 Processor -- start 2023-10-14T18:51:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.930+0000 7f49226f2700 1 -- start start 2023-10-14T18:51:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c157870 0x7f491c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157c40 0x7f491c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c151ae0 con 0x7f491c15a620 2023-10-14T18:51:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c12a4b0 con 0x7f491c157870 2023-10-14T18:51:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f49226f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b30b0 con 0x7f491c157c40 2023-10-14T18:51:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33556/0 (socket says 172.21.15.79:33556) 2023-10-14T18:51:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 -- 172.21.15.79:0/182520530 learned_addr learned my addr 172.21.15.79:0/182520530 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f491bfff700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c157870 0x7f491c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f491b7fe700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157c40 0x7f491c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 -- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157c40 msgr2=0x7f491c151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157c40 0x7f491c151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 -- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c157870 msgr2=0x7f491c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c157870 0x7f491c13eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 -- 172.21.15.79:0/182520530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009ae0 con 0x7f491c15a620 2023-10-14T18:51:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.931+0000 7f4920c8f700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f491400b6c0 tx=0x7f4914017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140032f0 con 0x7f491c15a620 2023-10-14T18:51:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914012d30 con 0x7f491c15a620 2023-10-14T18:51:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c0b2dd0 con 0x7f491c15a620 2023-10-14T18:51:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914012ea0 con 0x7f491c15a620 2023-10-14T18:51:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c12a140 con 0x7f491c15a620 2023-10-14T18:51:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.932+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c12a660 con 0x7f491c15a620 2023-10-14T18:51:56.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.933+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f491401d900 con 0x7f491c15a620 2023-10-14T18:51:56.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.933+0000 7f4903fff700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:56.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.933+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4914085a20 con 0x7f491c15a620 2023-10-14T18:51:56.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.934+0000 7f491bfff700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:56.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.934+0000 7f491bfff700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 0x7f49080693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f490c00adc0 tx=0x7f490c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:56.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:56.937+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4914052f90 con 0x7f491c15a620 2023-10-14T18:51:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.194+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f491c04c3c0 con 0x7f491c15a620 2023-10-14T18:51:57.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.802+0000 7f4903fff700 1 -- 172.21.15.79:0/182520530 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v359) v1 ==== 135+0+0 (secure 0 0 0) 0x7f4914009420 con 0x7f491c15a620 2023-10-14T18:51:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 msgr2=0x7f49080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 0x7f49080693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f490c00adc0 tx=0x7f490c006f90 comp rx=0 tx=0).stop 2023-10-14T18:51:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 msgr2=0x7f491c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f491400b6c0 tx=0x7f4914017000 comp rx=0 tx=0).stop 2023-10-14T18:51:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 shutdown_connections 2023-10-14T18:51:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4908066f30 0x7f49080693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c15a620 0x7f491c1515a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c157870 0x7f491c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 --2- 172.21.15.79:0/182520530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c157c40 0x7f491c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 >> 172.21.15.79:0/182520530 conn(0x7f491c068ce0 msgr2=0x7f491c0b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 shutdown_connections 2023-10-14T18:51:57.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.804+0000 7f49226f2700 1 -- 172.21.15.79:0/182520530 wait complete. 2023-10-14T18:51:57.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:51:57.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.934+0000 7fddd0fd2700 1 Processor -- start 2023-10-14T18:51:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.934+0000 7fddd0fd2700 1 -- start start 2023-10-14T18:51:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddd0fd2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddcc15a290 0x7fddcc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddd0fd2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc06aae0 0x7fddcc0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddd0fd2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0b0790 con 0x7fddcc159ec0 2023-10-14T18:51:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddd0fd2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc06af20 con 0x7fddcc06aae0 2023-10-14T18:51:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddd0fd2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0ce1f0 con 0x7fddcc15a290 2023-10-14T18:51:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc06aae0 0x7fddcc0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fddcc06aae0 0x7fddcc0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33568/0 (socket says 172.21.15.79:33568) 2023-10-14T18:51:57.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 -- 172.21.15.79:0/4185384884 learned_addr learned my addr 172.21.15.79:0/4185384884 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:57.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddc3fff700 1 --2- 172.21.15.79:0/4185384884 >> v2:172.21.15.144:3300/0 conn(0x7fddcc15a290 0x7fddcc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 -- 172.21.15.79:0/4185384884 >> v2:172.21.15.144:3300/0 conn(0x7fddcc15a290 msgr2=0x7fddcc06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:57.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 --2- 172.21.15.79:0/4185384884 >> v2:172.21.15.144:3300/0 conn(0x7fddcc15a290 0x7fddcc06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 -- 172.21.15.79:0/4185384884 >> v1:172.21.15.144:6789/0 conn(0x7fddcc159ec0 legacy=0x7fddcc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 -- 172.21.15.79:0/4185384884 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0b0b20 con 0x7fddcc06aae0 2023-10-14T18:51:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddcad9d700 1 --2- 172.21.15.79:0/4185384884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc06aae0 0x7fddcc0cf590 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fddcc089910 tx=0x7fddc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb26ec29061d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddc9d9b700 1 -- 172.21.15.79:0/4185384884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400e070 con 0x7fddcc06aae0 2023-10-14T18:51:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddc9d9b700 1 -- 172.21.15.79:0/4185384884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400ba50 con 0x7fddcc06aae0 2023-10-14T18:51:57.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.935+0000 7fddc9d9b700 1 -- 172.21.15.79:0/4185384884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc40092e0 con 0x7fddcc06aae0 2023-10-14T18:51:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 -- 172.21.15.79:0/4185384884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc06aae0 msgr2=0x7fddcc0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/4185384884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc06aae0 0x7fddcc0cf590 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fddcc089910 tx=0x7fddc4009840 comp rx=0 tx=0).stop 2023-10-14T18:51:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 -- 172.21.15.79:0/4185384884 shutdown_connections 2023-10-14T18:51:57.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/4185384884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc06aae0 0x7fddcc0cf590 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/4185384884 >> v2:172.21.15.144:3300/0 conn(0x7fddcc15a290 0x7fddcc06a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 -- 172.21.15.79:0/4185384884 >> 172.21.15.79:0/4185384884 conn(0x7fddcc0d1880 msgr2=0x7fddcc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 -- 172.21.15.79:0/4185384884 shutdown_connections 2023-10-14T18:51:57.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.936+0000 7fddd0fd2700 1 -- 172.21.15.79:0/4185384884 wait complete. 2023-10-14T18:51:57.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.937+0000 7fddd0fd2700 1 Processor -- start 2023-10-14T18:51:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.937+0000 7fddd0fd2700 1 -- start start 2023-10-14T18:51:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aae0 0x7fddcc0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc15a290 0x7fddcc1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0cb970 con 0x7fddcc159ec0 2023-10-14T18:51:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b4130 con 0x7fddcc15a290 2023-10-14T18:51:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b4410 con 0x7fddcc06aae0 2023-10-14T18:51:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33580/0 (socket says 172.21.15.79:33580) 2023-10-14T18:51:57.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 -- 172.21.15.79:0/1196214159 learned_addr learned my addr 172.21.15.79:0/1196214159 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:57.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddca59c700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aae0 0x7fddcc0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddcad9d700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc15a290 0x7fddcc1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 -- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aae0 msgr2=0x7fddcc0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aae0 0x7fddcc0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 -- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc15a290 msgr2=0x7fddcc1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:57.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc15a290 0x7fddcc1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:57.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 -- 172.21.15.79:0/1196214159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009ae0 con 0x7fddcc159ec0 2023-10-14T18:51:57.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc3fff700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fddb400d860 tx=0x7fddb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:57.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40125f0 con 0x7fddcc159ec0 2023-10-14T18:51:57.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4012750 con 0x7fddcc159ec0 2023-10-14T18:51:57.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0b46f0 con 0x7fddcc159ec0 2023-10-14T18:51:57.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4012b10 con 0x7fddcc159ec0 2023-10-14T18:51:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.938+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc155de0 con 0x7fddcc159ec0 2023-10-14T18:51:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.939+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc0b51e0 con 0x7fddcc159ec0 2023-10-14T18:51:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.940+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddb401e460 con 0x7fddcc159ec0 2023-10-14T18:51:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.940+0000 7fddc27fc700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.940+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fddb4084720 con 0x7fddcc159ec0 2023-10-14T18:51:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.940+0000 7fddca59c700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.941+0000 7fddca59c700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fddbc003a80 tx=0x7fddbc007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:57.944+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddb4055720 con 0x7fddcc159ec0 2023-10-14T18:51:58.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.126+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fddcc04c3c0 con 0x7fddcc159ec0 2023-10-14T18:51:58.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.129+0000 7fddc27fc700 1 -- 172.21.15.79:0/1196214159 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fddb40552b0 con 0x7fddcc159ec0 2023-10-14T18:51:58.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 msgr2=0x7fddac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fddbc003a80 tx=0x7fddbc007ec0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 msgr2=0x7fddcc0cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fddb400d860 tx=0x7fddb4008040 comp rx=0 tx=0).stop 2023-10-14T18:51:58.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 shutdown_connections 2023-10-14T18:51:58.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddcc15a290 0x7fddcc1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fddcc06aae0 0x7fddcc0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 --2- 172.21.15.79:0/1196214159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddcc159ec0 0x7fddcc0cb430 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 >> 172.21.15.79:0/1196214159 conn(0x7fddcc0d1880 msgr2=0x7fddcc0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:58.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 shutdown_connections 2023-10-14T18:51:58.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.132+0000 7fddd0fd2700 1 -- 172.21.15.79:0/1196214159 wait complete. 2023-10-14T18:51:58.144 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:51:58.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:58.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:51:58.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:51:58.228 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:51:58.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:51:58.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.342+0000 7f17ee2ba700 1 Processor -- start 2023-10-14T18:51:58.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.342+0000 7f17ee2ba700 1 -- start start 2023-10-14T18:51:58.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ee2ba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17e80bf970 0x7f17e80bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ee2ba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17e806d4c0 0x7f17e806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ee2ba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e80c7960 con 0x7f17e806f1a0 2023-10-14T18:51:58.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ee2ba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80c7c40 con 0x7f17e80bf970 2023-10-14T18:51:58.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ee2ba700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e80c7f20 con 0x7f17e806d4c0 2023-10-14T18:51:58.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17e7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f17e80bf970 0x7f17e80bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ec857700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f17e806f1a0 0x7f17e80ac1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52826/0 (socket says 172.21.15.79:52826) 2023-10-14T18:51:58.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.343+0000 7f17ec857700 1 -- 172.21.15.79:0/2669620907 learned_addr learned my addr 172.21.15.79:0/2669620907 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:51:58.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e77fe700 1 --2- 172.21.15.79:0/2669620907 >> v2:172.21.15.144:3300/0 conn(0x7f17e806d4c0 0x7f17e806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e7fff700 1 -- 172.21.15.79:0/2669620907 >> v2:172.21.15.144:3300/0 conn(0x7f17e806d4c0 msgr2=0x7f17e806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:58.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e7fff700 1 --2- 172.21.15.79:0/2669620907 >> v2:172.21.15.144:3300/0 conn(0x7f17e806d4c0 0x7f17e806ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e7fff700 1 -- 172.21.15.79:0/2669620907 >> v1:172.21.15.79:6789/0 conn(0x7f17e806f1a0 legacy=0x7f17e80ac1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e7fff700 1 -- 172.21.15.79:0/2669620907 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80c8200 con 0x7f17e80bf970 2023-10-14T18:51:58.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e6ffd700 1 -- 172.21.15.79:0/2669620907 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029301168 0 0) 0x7f17e80c7960 con 0x7f17e806f1a0 2023-10-14T18:51:58.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e7fff700 1 --2- 172.21.15.79:0/2669620907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e80bf970 0x7f17e80bfd40 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f17d80098e0 tx=0x7f17d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4252ad297aade52 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e6ffd700 1 -- 172.21.15.79:0/2669620907 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8009e80 con 0x7f17e80bf970 2023-10-14T18:51:58.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e6ffd700 1 -- 172.21.15.79:0/2669620907 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800b820 con 0x7f17e80bf970 2023-10-14T18:51:58.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.344+0000 7f17e6ffd700 1 -- 172.21.15.79:0/2669620907 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d800bba0 con 0x7f17e80bf970 2023-10-14T18:51:58.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 -- 172.21.15.79:0/2669620907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e80bf970 msgr2=0x7f17e80bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/2669620907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e80bf970 0x7f17e80bfd40 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f17d80098e0 tx=0x7f17d80091a0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 -- 172.21.15.79:0/2669620907 shutdown_connections 2023-10-14T18:51:58.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/2669620907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e80bf970 0x7f17e80bfd40 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/2669620907 >> v2:172.21.15.144:3300/0 conn(0x7f17e806d4c0 0x7f17e806ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 -- 172.21.15.79:0/2669620907 >> 172.21.15.79:0/2669620907 conn(0x7f17e8067660 msgr2=0x7f17e8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:58.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 -- 172.21.15.79:0/2669620907 shutdown_connections 2023-10-14T18:51:58.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.345+0000 7f17ee2ba700 1 -- 172.21.15.79:0/2669620907 wait complete. 2023-10-14T18:51:58.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.346+0000 7f17ee2ba700 1 Processor -- start 2023-10-14T18:51:58.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.346+0000 7f17ee2ba700 1 -- start start 2023-10-14T18:51:58.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 0x7f17e815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 0x7f17e8068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80c1f10 con 0x7f17e806f1a0 2023-10-14T18:51:58.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80c4d50 con 0x7f17e80bf970 2023-10-14T18:51:58.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80c5030 con 0x7f17e806d4c0 2023-10-14T18:51:58.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55272/0 (socket says 172.21.15.79:55272) 2023-10-14T18:51:58.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 -- 172.21.15.79:0/131256770 learned_addr learned my addr 172.21.15.79:0/131256770 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:58.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ec857700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 0x7f17e8068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e7fff700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 0x7f17e815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 -- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 msgr2=0x7f17e815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 0x7f17e815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 -- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 msgr2=0x7f17e8068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 0x7f17e8068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 -- 172.21.15.79:0/131256770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d8009420 con 0x7f17e806f1a0 2023-10-14T18:51:58.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e7fff700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 0x7f17e815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:58.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ec857700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 0x7f17e8068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:58.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17e77fe700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d890 tx=0x7f17dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00b600 con 0x7f17e806f1a0 2023-10-14T18:51:58.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00b760 con 0x7f17e806f1a0 2023-10-14T18:51:58.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e80c5310 con 0x7f17e806f1a0 2023-10-14T18:51:58.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00bae0 con 0x7f17e806f1a0 2023-10-14T18:51:58.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.347+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e80c4990 con 0x7f17e806f1a0 2023-10-14T18:51:58.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.348+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e80c20c0 con 0x7f17e806f1a0 2023-10-14T18:51:58.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.349+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17dc01e460 con 0x7f17e806f1a0 2023-10-14T18:51:58.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.349+0000 7f17cffff700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.349+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f17dc084910 con 0x7f17e806f1a0 2023-10-14T18:51:58.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.349+0000 7f17e7fff700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.350+0000 7f17e7fff700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 0x7f17d40693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17d80093f0 tx=0x7f17d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.353+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17e80c20c0 con 0x7f17e806f1a0 2023-10-14T18:51:58.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.580+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17e804c3c0 con 0x7f17e806f1a0 2023-10-14T18:51:58.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.581+0000 7f17cffff700 1 -- 172.21.15.79:0/131256770 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f17dc051e80 con 0x7f17e806f1a0 2023-10-14T18:51:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:51:58.582 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6529,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1196083187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1196083187},{"type":"v1","addr":"172.21.15.144:6836","nonce":1196083187}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6532,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/258430870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":258430870},{"type":"v1","addr":"172.21.15.144:6837","nonce":258430870}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7098,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3500148291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3500148291},{"type":"v1","addr":"172.21.15.79:6834","nonce":3500148291}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":7419,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/715642563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":715642563},{"type":"v1","addr":"172.21.15.79:6835","nonce":715642563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[]} 2023-10-14T18:51:58.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 msgr2=0x7f17d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 0x7f17d40693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f17d80093f0 tx=0x7f17d8017000 comp rx=0 tx=0).stop 2023-10-14T18:51:58.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 msgr2=0x7f17e80c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00d890 tx=0x7f17dc008040 comp rx=0 tx=0).stop 2023-10-14T18:51:58.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 shutdown_connections 2023-10-14T18:51:58.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f17d4066f30 0x7f17d40693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17e80bf970 0x7f17e8068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17e806d4c0 0x7f17e815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 --2- 172.21.15.79:0/131256770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17e806f1a0 0x7f17e80c4450 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 >> 172.21.15.79:0/131256770 conn(0x7f17e8067660 msgr2=0x7f17e80cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:58.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 shutdown_connections 2023-10-14T18:51:58.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.583+0000 7f17ee2ba700 1 -- 172.21.15.79:0/131256770 wait complete. 2023-10-14T18:51:58.586 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 66 2023-10-14T18:51:58.595 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:51:58.596 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:51:58.596 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:51:58.596 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:58.597 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:51:58.597 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:51:58.597 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:51:58.597 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:58.598 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:51:58.598 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:51:58.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:51:58.599 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:58.599 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:51:58.599 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:51:58.600 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:51:58.600 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:51:58.605 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:51:58.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:51:58.607 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:51:58.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:51:58.608 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:51:58.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:51:58.609 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:51:58.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:51:58.648 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:51:58.649 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:58.650 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:51:58.650 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:58.651 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:51:58.651 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:58.652 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:51:58.653 DEBUG:teuthology.parallel:result is None 2023-10-14T18:51:58.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:51:58.722 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:51:58.722 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:51:58.729 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:51:58.730 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:51:58.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.774+0000 7f59f2c25700 1 Processor -- start 2023-10-14T18:51:58.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.774+0000 7f59f2c25700 1 -- start start 2023-10-14T18:51:58.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f2c25700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59ec0cb940 0x7f59ec0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f2c25700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59ec15d4e0 0x7f59ec06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f2c25700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec15d960 con 0x7f59ec0cb570 2023-10-14T18:51:58.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f2c25700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec06fff0 con 0x7f59ec0cb940 2023-10-14T18:51:58.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f2c25700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec067660 con 0x7f59ec15d4e0 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f1422700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59ec0cb940 0x7f59ec0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f1422700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59ec0cb940 0x7f59ec0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55302/0 (socket says 172.21.15.79:55302) 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.775+0000 7f59f1422700 1 -- 172.21.15.79:0/1580328559 learned_addr learned my addr 172.21.15.79:0/1580328559 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f1422700 1 -- 172.21.15.79:0/1580328559 >> v2:172.21.15.144:3300/0 conn(0x7f59ec15d4e0 msgr2=0x7f59ec06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f2424700 1 --2- 172.21.15.79:0/1580328559 >> v2:172.21.15.144:3300/0 conn(0x7f59ec15d4e0 0x7f59ec06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f1422700 1 --2- 172.21.15.79:0/1580328559 >> v2:172.21.15.144:3300/0 conn(0x7f59ec15d4e0 0x7f59ec06fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f1422700 1 -- 172.21.15.79:0/1580328559 >> v1:172.21.15.144:6789/0 conn(0x7f59ec0cb570 legacy=0x7f59ec15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:58.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f1422700 1 -- 172.21.15.79:0/1580328559 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0cace0 con 0x7f59ec0cb940 2023-10-14T18:51:58.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f1422700 1 --2- 172.21.15.79:0/1580328559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb940 0x7f59ec0ca6e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f59e00099b0 tx=0x7f59e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49f2095c3af45e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f0c21700 1 -- 172.21.15.79:0/1580328559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000b7e0 con 0x7f59ec0cb940 2023-10-14T18:51:58.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f0c21700 1 -- 172.21.15.79:0/1580328559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000b940 con 0x7f59ec0cb940 2023-10-14T18:51:58.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f0c21700 1 -- 172.21.15.79:0/1580328559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000bce0 con 0x7f59ec0cb940 2023-10-14T18:51:58.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.776+0000 7f59f2c25700 1 -- 172.21.15.79:0/1580328559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb940 msgr2=0x7f59ec0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 --2- 172.21.15.79:0/1580328559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb940 0x7f59ec0ca6e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f59e00099b0 tx=0x7f59e0009250 comp rx=0 tx=0).stop 2023-10-14T18:51:58.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 -- 172.21.15.79:0/1580328559 shutdown_connections 2023-10-14T18:51:58.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 --2- 172.21.15.79:0/1580328559 >> v2:172.21.15.144:3300/0 conn(0x7f59ec15d4e0 0x7f59ec06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 --2- 172.21.15.79:0/1580328559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb940 0x7f59ec0ca6e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 -- 172.21.15.79:0/1580328559 >> 172.21.15.79:0/1580328559 conn(0x7f59ec069870 msgr2=0x7f59ec069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:58.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 -- 172.21.15.79:0/1580328559 shutdown_connections 2023-10-14T18:51:58.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.777+0000 7f59f2c25700 1 -- 172.21.15.79:0/1580328559 wait complete. 2023-10-14T18:51:58.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 Processor -- start 2023-10-14T18:51:58.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 -- start start 2023-10-14T18:51:58.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59ec0cb940 0x7f59ec0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 0x7f59ec0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c5eb0 con 0x7f59ec0cb570 2023-10-14T18:51:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec147890 con 0x7f59ec0cb940 2023-10-14T18:51:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f2c25700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c60e0 con 0x7f59ec15d4e0 2023-10-14T18:51:58.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.778+0000 7f59f1c23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55304/0 (socket says 172.21.15.79:55304) 2023-10-14T18:51:58.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 -- 172.21.15.79:0/2975082728 learned_addr learned my addr 172.21.15.79:0/2975082728 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:58.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1422700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59ec0cb940 0x7f59ec0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f2424700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 0x7f59ec0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 -- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 msgr2=0x7f59ec0c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 0x7f59ec0c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 -- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59ec0cb940 msgr2=0x7f59ec0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59ec0cb940 0x7f59ec0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 -- 172.21.15.79:0/2975082728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00094f0 con 0x7f59ec0cb570 2023-10-14T18:51:58.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f2424700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 0x7f59ec0c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:51:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f1c23700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b5e0 tx=0x7f59dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00f510 con 0x7f59ec0cb570 2023-10-14T18:51:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc00f670 con 0x7f59ec0cb570 2023-10-14T18:51:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec0c63c0 con 0x7f59ec0cb570 2023-10-14T18:51:58.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00fa30 con 0x7f59ec0cb570 2023-10-14T18:51:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.779+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec147520 con 0x7f59ec0cb570 2023-10-14T18:51:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.780+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec06de20 con 0x7f59ec0cb570 2023-10-14T18:51:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.780+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59dc01a400 con 0x7f59ec0cb570 2023-10-14T18:51:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.781+0000 7f59e9ffb700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:58.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.781+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59dc083c40 con 0x7f59ec0cb570 2023-10-14T18:51:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.781+0000 7f59f1422700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.782+0000 7f59f1422700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 0x7f59d80693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f59e00099b0 tx=0x7f59e0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:58.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.785+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59dc051230 con 0x7f59ec0cb570 2023-10-14T18:51:58.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:58.986+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f59ec0caa00 con 0x7f59ec0cb570 2023-10-14T18:51:59.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.817+0000 7f59e9ffb700 1 -- 172.21.15.79:0/2975082728 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v150) v1 ==== 97+0+0 (secure 0 0 0) 0x7f59dc054850 con 0x7f59ec0cb570 2023-10-14T18:51:59.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 msgr2=0x7f59d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:59.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 0x7f59d80693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f59e00099b0 tx=0x7f59e0016000 comp rx=0 tx=0).stop 2023-10-14T18:51:59.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 msgr2=0x7f59ec146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:59.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b5e0 tx=0x7f59dc009120 comp rx=0 tx=0).stop 2023-10-14T18:51:59.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 shutdown_connections 2023-10-14T18:51:59.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f59d8066f30 0x7f59d80693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59ec15d4e0 0x7f59ec0c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59ec0cb570 0x7f59ec146be0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.819+0000 7f59f2c25700 1 --2- 172.21.15.79:0/2975082728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59ec0cb940 0x7f59ec0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.820+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 >> 172.21.15.79:0/2975082728 conn(0x7f59ec069870 msgr2=0x7f59ec0ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:59.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.820+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 shutdown_connections 2023-10-14T18:51:59.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.820+0000 7f59f2c25700 1 -- 172.21.15.79:0/2975082728 wait complete. 2023-10-14T18:51:59.823 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:51:59.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:51:59.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.953+0000 7fa3a2d0b700 1 Processor -- start 2023-10-14T18:51:59.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.953+0000 7fa3a2d0b700 1 -- start start 2023-10-14T18:51:59.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c157870 0x7fa39c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa39c15a620 0x7fa39c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa39c15d580 0x7fa39c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c15cbb0 con 0x7fa39c15a620 2023-10-14T18:51:59.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c15bfa0 con 0x7fa39c15d580 2023-10-14T18:51:59.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa3a2d0b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15c280 con 0x7fa39c157870 2023-10-14T18:51:59.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa393fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa39c15a620 0x7fa39c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa393fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa39c15a620 0x7fa39c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55310/0 (socket says 172.21.15.79:55310) 2023-10-14T18:51:59.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.954+0000 7fa393fff700 1 -- 172.21.15.79:0/1903264844 learned_addr learned my addr 172.21.15.79:0/1903264844 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:59.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 -- 172.21.15.79:0/1903264844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c157870 msgr2=0x7fa39c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:59.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a12a8700 1 --2- 172.21.15.79:0/1903264844 >> v2:172.21.15.144:3300/0 conn(0x7fa39c15d580 0x7fa39c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 --2- 172.21.15.79:0/1903264844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c157870 0x7fa39c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 -- 172.21.15.79:0/1903264844 >> v2:172.21.15.144:3300/0 conn(0x7fa39c15d580 msgr2=0x7fa39c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:51:59.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 --2- 172.21.15.79:0/1903264844 >> v2:172.21.15.144:3300/0 conn(0x7fa39c15d580 0x7fa39c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 -- 172.21.15.79:0/1903264844 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c15c560 con 0x7fa39c15a620 2023-10-14T18:51:59.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa393fff700 1 --2- 172.21.15.79:0/1903264844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15a620 0x7fa39c15d040 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0b03b0 tx=0x7fa38c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8388667f51e2f02c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:59.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3937fe700 1 -- 172.21.15.79:0/1903264844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00b860 con 0x7fa39c15a620 2023-10-14T18:51:59.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3937fe700 1 -- 172.21.15.79:0/1903264844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00b9c0 con 0x7fa39c15a620 2023-10-14T18:51:59.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3937fe700 1 -- 172.21.15.79:0/1903264844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00bd60 con 0x7fa39c15a620 2023-10-14T18:51:59.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/1903264844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15a620 msgr2=0x7fa39c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:59.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/1903264844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15a620 0x7fa39c15d040 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0b03b0 tx=0x7fa38c009250 comp rx=0 tx=0).stop 2023-10-14T18:51:59.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/1903264844 shutdown_connections 2023-10-14T18:51:59.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/1903264844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c157870 0x7fa39c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/1903264844 >> v2:172.21.15.144:3300/0 conn(0x7fa39c15d580 0x7fa39c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/1903264844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15a620 0x7fa39c15d040 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/1903264844 >> 172.21.15.79:0/1903264844 conn(0x7fa39c068ce0 msgr2=0x7fa39c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:51:59.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/1903264844 shutdown_connections 2023-10-14T18:51:59.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.955+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/1903264844 wait complete. 2023-10-14T18:51:59.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.956+0000 7fa3a2d0b700 1 Processor -- start 2023-10-14T18:51:59.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 -- start start 2023-10-14T18:51:59.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa39c157870 0x7fa39c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c15a620 0x7fa39c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c14cf30 con 0x7fa39c15d580 2023-10-14T18:51:59.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b1670 con 0x7fa39c157870 2023-10-14T18:51:59.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a2d0b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0b1950 con 0x7fa39c15a620 2023-10-14T18:51:59.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.957+0000 7fa3a12a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55320/0 (socket says 172.21.15.79:55320) 2023-10-14T18:51:59.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 -- 172.21.15.79:0/251355311 learned_addr learned my addr 172.21.15.79:0/251355311 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:51:59.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a0aa7700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa39c157870 0x7fa39c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa393fff700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c15a620 0x7fa39c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 -- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c15a620 msgr2=0x7fa39c0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:59.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c15a620 0x7fa39c0b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 -- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa39c157870 msgr2=0x7fa39c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:51:59.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa39c157870 0x7fa39c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:51:59.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 -- 172.21.15.79:0/251355311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0094f0 con 0x7fa39c15d580 2023-10-14T18:51:59.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a12a8700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c880 tx=0x7fa394008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394011600 con 0x7fa39c15d580 2023-10-14T18:51:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394011780 con 0x7fa39c15d580 2023-10-14T18:51:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c0b1c30 con 0x7fa39c15d580 2023-10-14T18:51:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394011b40 con 0x7fa39c15d580 2023-10-14T18:51:59.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.958+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c14e2b0 con 0x7fa39c15d580 2023-10-14T18:51:59.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.959+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c04c3c0 con 0x7fa39c15d580 2023-10-14T18:51:59.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.959+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa394018360 con 0x7fa39c15d580 2023-10-14T18:51:59.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.960+0000 7fa390ff9700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:51:59.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.960+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa394083f20 con 0x7fa39c15d580 2023-10-14T18:51:59.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.960+0000 7fa3a0aa7700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:51:59.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.961+0000 7fa3a0aa7700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 0x7fa3880693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa398001250 tx=0x7fa398009620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:51:59.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:51:59.964+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3940514e0 con 0x7fa39c15d580 2023-10-14T18:52:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.222+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa39c15c840 con 0x7fa39c15d580 2023-10-14T18:52:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.223+0000 7fa390ff9700 1 -- 172.21.15.79:0/251355311 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa39401e090 con 0x7fa39c15d580 2023-10-14T18:52:00.224 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:00.224 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:52:00.224 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:52:00.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.225 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:52:00.225 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:52:00.225 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.225 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.225 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:52:00.226 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:52:00.226 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:52:00.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:52:00.228 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.228 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:52:00.229 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:52:00.229 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:52:00.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:52:00.230 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.231 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:52:00.231 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:52:00.231 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:52:00.232 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:52:00.232 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.233 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.234 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:52:00.234 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:52:00.235 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.235 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.235 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.235 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.236 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:52:00.236 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:52:00.237 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.237 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.237 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.237 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.238 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:52:00.238 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:52:00.238 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.240 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:52:00.240 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:52:00.240 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.240 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.240 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.241 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:52:00.242 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:52:00.242 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.242 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.242 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.242 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.243 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:52:00.243 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:52:00.244 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.244 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.244 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.244 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.245 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:52:00.245 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:52:00.246 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.246 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:52:00.246 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:52:00.246 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.247 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.248 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:52:00.248 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:52:00.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:52:00.249 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:52:00.250 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:52:00.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.250 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:52:00.251 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:52:00.251 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.251 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.251 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:52:00.251 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:52:00.252 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:52:00.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.252 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:52:00.253 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:52:00.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.254 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:52:00.254 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:52:00.255 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.255 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:52:00.255 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:52:00.255 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:52:00.255 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.256 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:52:00.256 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:52:00.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:00.258 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:52:00.258 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:52:00.258 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:52:00.258 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:52:00.259 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:52:00.259 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:52:00.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:00.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:52:00.260 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:52:00.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 msgr2=0x7fa3880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 0x7fa3880693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa398001250 tx=0x7fa398009620 comp rx=0 tx=0).stop 2023-10-14T18:52:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 msgr2=0x7fa39c0b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c880 tx=0x7fa394008040 comp rx=0 tx=0).stop 2023-10-14T18:52:00.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 shutdown_connections 2023-10-14T18:52:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa388066f30 0x7fa3880693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa39c15d580 0x7fa39c0b6590 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa39c157870 0x7fa39c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 --2- 172.21.15.79:0/251355311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa39c15a620 0x7fa39c0b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 >> 172.21.15.79:0/251355311 conn(0x7fa39c068ce0 msgr2=0x7fa39c158270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:00.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 shutdown_connections 2023-10-14T18:52:00.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.225+0000 7fa3a2d0b700 1 -- 172.21.15.79:0/251355311 wait complete. 2023-10-14T18:52:00.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:52:00.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.379+0000 7f76ca1ac700 1 Processor -- start 2023-10-14T18:52:00.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.379+0000 7f76ca1ac700 1 -- start start 2023-10-14T18:52:00.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76ca1ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 0x7f76c40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76ca1ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76c415cbd0 0x7f76c415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76ca1ac700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c40cb7c0 con 0x7f76c40cdab0 2023-10-14T18:52:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76ca1ac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c415e850 con 0x7f76c415cbd0 2023-10-14T18:52:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76ca1ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40cd030 con 0x7f76c40cd6e0 2023-10-14T18:52:00.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76c415cbd0 0x7f76c415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76c415cbd0 0x7f76c415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55334/0 (socket says 172.21.15.79:55334) 2023-10-14T18:52:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 -- 172.21.15.79:0/3474067687 learned_addr learned my addr 172.21.15.79:0/3474067687 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c91aa700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 0x7f76c40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 -- 172.21.15.79:0/3474067687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 msgr2=0x7f76c40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:00.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 0x7f76c40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 -- 172.21.15.79:0/3474067687 >> v1:172.21.15.144:6789/0 conn(0x7f76c40cdab0 legacy=0x7f76c415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c99ab700 1 -- 172.21.15.79:0/3474067687 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c415e290 con 0x7f76c415cbd0 2023-10-14T18:52:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.380+0000 7f76c91aa700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 0x7f76c40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76c99ab700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c415cbd0 0x7f76c415d020 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0099b0 tx=0x7f76bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66622104cf448a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76bbfff700 1 -- 172.21.15.79:0/3474067687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00b860 con 0x7f76c415cbd0 2023-10-14T18:52:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76bbfff700 1 -- 172.21.15.79:0/3474067687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc00b9c0 con 0x7f76c415cbd0 2023-10-14T18:52:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76bbfff700 1 -- 172.21.15.79:0/3474067687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00bd60 con 0x7f76c415cbd0 2023-10-14T18:52:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 -- 172.21.15.79:0/3474067687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c415cbd0 msgr2=0x7f76c415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c415cbd0 0x7f76c415d020 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0099b0 tx=0x7f76bc009250 comp rx=0 tx=0).stop 2023-10-14T18:52:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 -- 172.21.15.79:0/3474067687 shutdown_connections 2023-10-14T18:52:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c415cbd0 0x7f76c415d020 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/3474067687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cd6e0 0x7f76c40cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 -- 172.21.15.79:0/3474067687 >> 172.21.15.79:0/3474067687 conn(0x7f76c4067660 msgr2=0x7f76c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 -- 172.21.15.79:0/3474067687 shutdown_connections 2023-10-14T18:52:00.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.381+0000 7f76ca1ac700 1 -- 172.21.15.79:0/3474067687 wait complete. 2023-10-14T18:52:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.382+0000 7f76ca1ac700 1 Processor -- start 2023-10-14T18:52:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.382+0000 7f76ca1ac700 1 -- start start 2023-10-14T18:52:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cdab0 0x7f76c40b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c415cbd0 0x7f76c40c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40b6770 con 0x7f76c40cd6e0 2023-10-14T18:52:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40c9920 con 0x7f76c415cbd0 2023-10-14T18:52:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76ca1ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c416de00 con 0x7f76c40cdab0 2023-10-14T18:52:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76c91aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76c91aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55340/0 (socket says 172.21.15.79:55340) 2023-10-14T18:52:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76c91aa700 1 -- 172.21.15.79:0/1350571829 learned_addr learned my addr 172.21.15.79:0/1350571829 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.383+0000 7f76c99ab700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c415cbd0 0x7f76c40c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c89a9700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cdab0 0x7f76c40b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 -- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cdab0 msgr2=0x7f76c40b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cdab0 0x7f76c40b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 -- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c415cbd0 msgr2=0x7f76c40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c415cbd0 0x7f76c40c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 -- 172.21.15.79:0/1350571829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0094f0 con 0x7f76c40cd6e0 2023-10-14T18:52:00.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76c91aa700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f76c000d1d0 tx=0x7f76c0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000dd10 con 0x7f76c40cd6e0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c000f040 con 0x7f76c40cd6e0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0015670 con 0x7f76c40cd6e0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c416e0e0 con 0x7f76c40cd6e0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.384+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c416e6a0 con 0x7f76c40cd6e0 2023-10-14T18:52:00.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.385+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4089280 con 0x7f76c40cd6e0 2023-10-14T18:52:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.385+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76c0015a60 con 0x7f76c40cd6e0 2023-10-14T18:52:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.386+0000 7f76b97fa700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.386+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f76c0084540 con 0x7f76c40cd6e0 2023-10-14T18:52:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.386+0000 7f76c89a9700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.386+0000 7f76c89a9700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 0x7f76a80693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c4154630 tx=0x7f76b4007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.390+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76c004e5a0 con 0x7f76c40cd6e0 2023-10-14T18:52:00.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.573+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c415e570 con 0x7f76c40cd6e0 2023-10-14T18:52:00.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.574+0000 7f76b97fa700 1 -- 172.21.15.79:0/1350571829 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f76c001a090 con 0x7f76c40cd6e0 2023-10-14T18:52:00.575 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:00.575 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":150,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:51:59.810735+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:52:00.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 msgr2=0x7f76a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 0x7f76a80693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c4154630 tx=0x7f76b4007ec0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 msgr2=0x7f76c41513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f76c000d1d0 tx=0x7f76c0009a90 comp rx=0 tx=0).stop 2023-10-14T18:52:00.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 shutdown_connections 2023-10-14T18:52:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f76a8066f30 0x7f76a80693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c415cbd0 0x7f76c40c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76c40cd6e0 0x7f76c41513c0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 --2- 172.21.15.79:0/1350571829 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76c40cdab0 0x7f76c40b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 >> 172.21.15.79:0/1350571829 conn(0x7f76c4067660 msgr2=0x7f76c40c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 shutdown_connections 2023-10-14T18:52:00.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.576+0000 7f76ca1ac700 1 -- 172.21.15.79:0/1350571829 wait complete. 2023-10-14T18:52:00.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:52:00.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:52:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.706+0000 7f46cc7b4700 1 Processor -- start 2023-10-14T18:52:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.706+0000 7f46cc7b4700 1 -- start start 2023-10-14T18:52:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46c4159ec0 0x7f46c40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46c415a290 0x7f46c40afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c406aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c406af60 con 0x7f46c415a290 2023-10-14T18:52:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c40b0790 con 0x7f46c4159ec0 2023-10-14T18:52:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cc7b4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40ce1f0 con 0x7f46c406a5a0 2023-10-14T18:52:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46c9d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46c415a290 0x7f46c40afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46c9d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46c415a290 0x7f46c40afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55342/0 (socket says 172.21.15.79:55342) 2023-10-14T18:52:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46c9d4f700 1 -- 172.21.15.79:0/99061648 learned_addr learned my addr 172.21.15.79:0/99061648 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46ca550700 1 --2- 172.21.15.79:0/99061648 >> v2:172.21.15.144:3300/0 conn(0x7f46c4159ec0 0x7f46c40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.707+0000 7f46cad51700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c406aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 -- 172.21.15.79:0/99061648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 msgr2=0x7f46c406aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c406aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 -- 172.21.15.79:0/99061648 >> v2:172.21.15.144:3300/0 conn(0x7f46c4159ec0 msgr2=0x7f46c40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 --2- 172.21.15.79:0/99061648 >> v2:172.21.15.144:3300/0 conn(0x7f46c4159ec0 0x7f46c40af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 -- 172.21.15.79:0/99061648 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40b0b20 con 0x7f46c415a290 2023-10-14T18:52:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c9d4f700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c40afe80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f46c40898e0 tx=0x7f46b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6753eb374fa0d521 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c954e700 1 -- 172.21.15.79:0/99061648 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400b640 con 0x7f46c415a290 2023-10-14T18:52:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c954e700 1 -- 172.21.15.79:0/99061648 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b400b7a0 con 0x7f46c415a290 2023-10-14T18:52:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46c954e700 1 -- 172.21.15.79:0/99061648 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b400bb60 con 0x7f46c415a290 2023-10-14T18:52:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 -- 172.21.15.79:0/99061648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 msgr2=0x7f46c40afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c40afe80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f46c40898e0 tx=0x7f46b4009250 comp rx=0 tx=0).stop 2023-10-14T18:52:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 -- 172.21.15.79:0/99061648 shutdown_connections 2023-10-14T18:52:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c406aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/99061648 >> v2:172.21.15.144:3300/0 conn(0x7f46c4159ec0 0x7f46c40af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/99061648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c40afe80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 -- 172.21.15.79:0/99061648 >> 172.21.15.79:0/99061648 conn(0x7f46c40d1880 msgr2=0x7f46c40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 -- 172.21.15.79:0/99061648 shutdown_connections 2023-10-14T18:52:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.708+0000 7f46cc7b4700 1 -- 172.21.15.79:0/99061648 wait complete. 2023-10-14T18:52:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 Processor -- start 2023-10-14T18:52:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 -- start start 2023-10-14T18:52:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c4159ec0 0x7f46c415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40b6a70 con 0x7f46c415a290 2023-10-14T18:52:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c415e8d0 con 0x7f46c4159ec0 2023-10-14T18:52:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cc7b4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c415dcc0 con 0x7f46c406a5a0 2023-10-14T18:52:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cad51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cad51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55352/0 (socket says 172.21.15.79:55352) 2023-10-14T18:52:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46cad51700 1 -- 172.21.15.79:0/1928779088 learned_addr learned my addr 172.21.15.79:0/1928779088 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46ca550700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.710+0000 7f46c9d4f700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c4159ec0 0x7f46c415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 -- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 msgr2=0x7f46c415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 -- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c4159ec0 msgr2=0x7f46c415cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c4159ec0 0x7f46c415cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 -- 172.21.15.79:0/1928779088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40094f0 con 0x7f46c415a290 2023-10-14T18:52:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cad51700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e90 tx=0x7f46bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00cb70 con 0x7f46c415a290 2023-10-14T18:52:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00f040 con 0x7f46c415a290 2023-10-14T18:52:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c415dfa0 con 0x7f46c415a290 2023-10-14T18:52:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc014480 con 0x7f46c415a290 2023-10-14T18:52:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.711+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c415e560 con 0x7f46c415a290 2023-10-14T18:52:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.712+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c415ea60 con 0x7f46c415a290 2023-10-14T18:52:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.712+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46bc014830 con 0x7f46c415a290 2023-10-14T18:52:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.713+0000 7f46ba7fc700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 0x7f46a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.713+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f46bc084bb0 con 0x7f46c415a290 2023-10-14T18:52:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.713+0000 7f46ca550700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 0x7f46a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.713+0000 7f46ca550700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 0x7f46a80693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d20 tx=0x7f46c00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.717+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46bc052170 con 0x7f46c415a290 2023-10-14T18:52:00.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.898+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46c404c3c0 con 0x7f46c415a290 2023-10-14T18:52:00.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.899+0000 7f46ba7fc700 1 -- 172.21.15.79:0/1928779088 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46bc018020 con 0x7f46c415a290 2023-10-14T18:52:00.900 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:52:00.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.900+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 msgr2=0x7f46a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.900+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 0x7f46a80693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d20 tx=0x7f46c00091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.900+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 msgr2=0x7f46c416d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.900+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e90 tx=0x7f46bc00b040 comp rx=0 tx=0).stop 2023-10-14T18:52:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 shutdown_connections 2023-10-14T18:52:00.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f46a8066f30 0x7f46a80693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46c415a290 0x7f46c416d750 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f46c406a5a0 0x7f46c415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 --2- 172.21.15.79:0/1928779088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c4159ec0 0x7f46c415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 >> 172.21.15.79:0/1928779088 conn(0x7f46c40d1880 msgr2=0x7f46c40cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 shutdown_connections 2023-10-14T18:52:00.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:00.901+0000 7f46cc7b4700 1 -- 172.21.15.79:0/1928779088 wait complete. 2023-10-14T18:52:00.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:52:01.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.027+0000 7f7343048700 1 Processor -- start 2023-10-14T18:52:01.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.027+0000 7f7343048700 1 -- start start 2023-10-14T18:52:01.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7343048700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f733c157870 0x7f733c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7343048700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f733c157c40 0x7f733c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7343048700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c15cbb0 con 0x7f733c15a620 2023-10-14T18:52:01.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7343048700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c15bfa0 con 0x7f733c157870 2023-10-14T18:52:01.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7343048700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c15c280 con 0x7f733c157c40 2023-10-14T18:52:01.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f733c157870 0x7f733c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f733c157870 0x7f733c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55358/0 (socket says 172.21.15.79:55358) 2023-10-14T18:52:01.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 -- 172.21.15.79:0/4140966826 learned_addr learned my addr 172.21.15.79:0/4140966826 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:01.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f73415e5700 1 --2- 172.21.15.79:0/4140966826 >> v2:172.21.15.144:3300/0 conn(0x7f733c157c40 0x7f733c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 -- 172.21.15.79:0/4140966826 >> v2:172.21.15.144:3300/0 conn(0x7f733c157c40 msgr2=0x7f733c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:01.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 --2- 172.21.15.79:0/4140966826 >> v2:172.21.15.144:3300/0 conn(0x7f733c157c40 0x7f733c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 -- 172.21.15.79:0/4140966826 >> v1:172.21.15.144:6789/0 conn(0x7f733c15a620 legacy=0x7f733c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:01.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 -- 172.21.15.79:0/4140966826 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c15c560 con 0x7f733c157870 2023-10-14T18:52:01.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f7340de4700 1 --2- 172.21.15.79:0/4140966826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157870 0x7f733c15b6a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f733c06b4e0 tx=0x7f7330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc200683c49a3c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f733b7fe700 1 -- 172.21.15.79:0/4140966826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000b820 con 0x7f733c157870 2023-10-14T18:52:01.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f733b7fe700 1 -- 172.21.15.79:0/4140966826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733000b980 con 0x7f733c157870 2023-10-14T18:52:01.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.028+0000 7f733b7fe700 1 -- 172.21.15.79:0/4140966826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000bd20 con 0x7f733c157870 2023-10-14T18:52:01.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 -- 172.21.15.79:0/4140966826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157870 msgr2=0x7f733c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 --2- 172.21.15.79:0/4140966826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157870 0x7f733c15b6a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f733c06b4e0 tx=0x7f7330009250 comp rx=0 tx=0).stop 2023-10-14T18:52:01.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 -- 172.21.15.79:0/4140966826 shutdown_connections 2023-10-14T18:52:01.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 --2- 172.21.15.79:0/4140966826 >> v2:172.21.15.144:3300/0 conn(0x7f733c157c40 0x7f733c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 --2- 172.21.15.79:0/4140966826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157870 0x7f733c15b6a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 -- 172.21.15.79:0/4140966826 >> 172.21.15.79:0/4140966826 conn(0x7f733c068ce0 msgr2=0x7f733c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:01.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 -- 172.21.15.79:0/4140966826 shutdown_connections 2023-10-14T18:52:01.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.029+0000 7f7343048700 1 -- 172.21.15.79:0/4140966826 wait complete. 2023-10-14T18:52:01.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.030+0000 7f7343048700 1 Processor -- start 2023-10-14T18:52:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.030+0000 7f7343048700 1 -- start start 2023-10-14T18:52:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 0x7f733c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f733c15a620 0x7f733c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c150fb0 con 0x7f733c157c40 2023-10-14T18:52:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c153be0 con 0x7f733c157870 2023-10-14T18:52:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7343048700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c14e220 con 0x7f733c15a620 2023-10-14T18:52:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55362/0 (socket says 172.21.15.79:55362) 2023-10-14T18:52:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 -- 172.21.15.79:0/3584126464 learned_addr learned my addr 172.21.15.79:0/3584126464 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f73415e5700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f733c15a620 0x7f733c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7340de4700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 0x7f733c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 -- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f733c15a620 msgr2=0x7f733c150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f733c15a620 0x7f733c150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 -- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 msgr2=0x7f733c154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 0x7f733c154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 -- 172.21.15.79:0/3584126464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73300094f0 con 0x7f733c157c40 2023-10-14T18:52:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f7340de4700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 0x7f733c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.031+0000 7f733bfff700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f732800b5e0 tx=0x7f73280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.032+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800f510 con 0x7f733c157c40 2023-10-14T18:52:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.032+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800f6b0 con 0x7f733c157c40 2023-10-14T18:52:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.032+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c14e500 con 0x7f733c157c40 2023-10-14T18:52:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.032+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800fa70 con 0x7f733c157c40 2023-10-14T18:52:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.032+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c151220 con 0x7f733c157c40 2023-10-14T18:52:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.033+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c04c3c0 con 0x7f733c157c40 2023-10-14T18:52:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.033+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f732801a400 con 0x7f733c157c40 2023-10-14T18:52:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.034+0000 7f7338ff9700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.034+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7328083cd0 con 0x7f733c157c40 2023-10-14T18:52:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.034+0000 7f7340de4700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.034+0000 7f7340de4700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 0x7f73200693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f733c06b4e0 tx=0x7f7330016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.038+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7328051310 con 0x7f733c157c40 2023-10-14T18:52:01.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.225+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f733c153d20 con 0x7f733c157c40 2023-10-14T18:52:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.225+0000 7f7338ff9700 1 -- 172.21.15.79:0/3584126464 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7328054930 con 0x7f733c157c40 2023-10-14T18:52:01.226 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:01.227 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:52:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:52:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:52:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:52:01.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:52:01.228 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:52:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 msgr2=0x7f73200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 0x7f73200693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f733c06b4e0 tx=0x7f7330016000 comp rx=0 tx=0).stop 2023-10-14T18:52:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 msgr2=0x7f733c13cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f732800b5e0 tx=0x7f73280090f0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 shutdown_connections 2023-10-14T18:52:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7320066f30 0x7f73200693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f733c15a620 0x7f733c150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733c157870 0x7f733c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 --2- 172.21.15.79:0/3584126464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f733c157c40 0x7f733c13cd40 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.227+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 >> 172.21.15.79:0/3584126464 conn(0x7f733c068ce0 msgr2=0x7f733c14d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.228+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 shutdown_connections 2023-10-14T18:52:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.228+0000 7f7343048700 1 -- 172.21.15.79:0/3584126464 wait complete. 2023-10-14T18:52:01.240 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:52:01.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:52:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.359+0000 7f00f46b1700 1 Processor -- start 2023-10-14T18:52:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.359+0000 7f00f46b1700 1 -- start start 2023-10-14T18:52:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f46b1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f46b1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 0x7f00ec0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f46b1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec0b1a60 con 0x7f00ec0b15e0 2023-10-14T18:52:01.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f46b1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec0b1d40 con 0x7f00ec0b6a10 2023-10-14T18:52:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f46b1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0b2020 con 0x7f00ec159ef0 2023-10-14T18:52:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f244d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f1c4c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 0x7f00ec0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f244d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:51948/0 (socket says 172.21.15.79:51948) 2023-10-14T18:52:01.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.360+0000 7f00f244d700 1 -- 172.21.15.79:0/2746927722 learned_addr learned my addr 172.21.15.79:0/2746927722 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:01.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f244d700 1 -- 172.21.15.79:0/2746927722 >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 msgr2=0x7f00ec0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:01.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f244d700 1 --2- 172.21.15.79:0/2746927722 >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 0x7f00ec0b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f244d700 1 -- 172.21.15.79:0/2746927722 >> v1:172.21.15.144:6789/0 conn(0x7f00ec0b15e0 legacy=0x7f00ec0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f244d700 1 -- 172.21.15.79:0/2746927722 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0b2300 con 0x7f00ec159ef0 2023-10-14T18:52:01.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f1c4c700 1 --2- 172.21.15.79:0/2746927722 >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 0x7f00ec0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:52:01.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f244d700 1 --2- 172.21.15.79:0/2746927722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009f70 tx=0x7f00e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8cedfde885f00b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f144b700 1 -- 172.21.15.79:0/2746927722 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800e070 con 0x7f00ec159ef0 2023-10-14T18:52:01.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f144b700 1 -- 172.21.15.79:0/2746927722 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800ba20 con 0x7f00ec159ef0 2023-10-14T18:52:01.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.361+0000 7f00f144b700 1 -- 172.21.15.79:0/2746927722 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e80092e0 con 0x7f00ec159ef0 2023-10-14T18:52:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 -- 172.21.15.79:0/2746927722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 msgr2=0x7f00ec15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 --2- 172.21.15.79:0/2746927722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009f70 tx=0x7f00e8009840 comp rx=0 tx=0).stop 2023-10-14T18:52:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 -- 172.21.15.79:0/2746927722 shutdown_connections 2023-10-14T18:52:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 --2- 172.21.15.79:0/2746927722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec159ef0 0x7f00ec15a2c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 --2- 172.21.15.79:0/2746927722 >> v2:172.21.15.144:3300/0 conn(0x7f00ec0b6a10 0x7f00ec0b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 -- 172.21.15.79:0/2746927722 >> 172.21.15.79:0/2746927722 conn(0x7f00ec09a0a0 msgr2=0x7f00ec067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:01.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 -- 172.21.15.79:0/2746927722 shutdown_connections 2023-10-14T18:52:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.362+0000 7f00f46b1700 1 -- 172.21.15.79:0/2746927722 wait complete. 2023-10-14T18:52:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.363+0000 7f00f46b1700 1 Processor -- start 2023-10-14T18:52:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.363+0000 7f00f46b1700 1 -- start start 2023-10-14T18:52:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec0b6a10 0x7f00ec150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00ec155b60 0x7f00ec1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0ab200 con 0x7f00ec159ef0 2023-10-14T18:52:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec156740 con 0x7f00ec155b60 2023-10-14T18:52:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f46b1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec155fc0 con 0x7f00ec0b6a10 2023-10-14T18:52:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55368/0 (socket says 172.21.15.79:55368) 2023-10-14T18:52:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 -- 172.21.15.79:0/4116872223 learned_addr learned my addr 172.21.15.79:0/4116872223 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f244d700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec0b6a10 0x7f00ec150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f2c4e700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00ec155b60 0x7f00ec1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 -- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec0b6a10 msgr2=0x7f00ec150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec0b6a10 0x7f00ec150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 -- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00ec155b60 msgr2=0x7f00ec1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00ec155b60 0x7f00ec1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 -- 172.21.15.79:0/4116872223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc009420 con 0x7f00ec159ef0 2023-10-14T18:52:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00f1c4c700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ec80 tx=0x7f00dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.364+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00c8c0 con 0x7f00ec159ef0 2023-10-14T18:52:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.365+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc00ca20 con 0x7f00ec159ef0 2023-10-14T18:52:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.365+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8009ae0 con 0x7f00ec159ef0 2023-10-14T18:52:01.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.365+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00cda0 con 0x7f00ec159ef0 2023-10-14T18:52:01.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.365+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec16b1c0 con 0x7f00ec159ef0 2023-10-14T18:52:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.365+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec1509d0 con 0x7f00ec159ef0 2023-10-14T18:52:01.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.366+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00dc013680 con 0x7f00ec159ef0 2023-10-14T18:52:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.366+0000 7f00e27fc700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 0x7f00d0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.366+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f00dc0845b0 con 0x7f00ec159ef0 2023-10-14T18:52:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.366+0000 7f00f244d700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 0x7f00d0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.367+0000 7f00f244d700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 0x7f00d0069460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009880 tx=0x7f00e8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.370+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00dc051ad0 con 0x7f00ec159ef0 2023-10-14T18:52:01.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.550+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f00ec04c3c0 con 0x7f00ec159ef0 2023-10-14T18:52:01.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.830+0000 7f00e27fc700 1 -- 172.21.15.79:0/4116872223 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) v1 ==== 138+0+0 (secure 0 0 0) 0x7f00dc0550f0 con 0x7f00ec159ef0 2023-10-14T18:52:01.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 msgr2=0x7f00d0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 0x7f00d0069460 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009880 tx=0x7f00e8018000 comp rx=0 tx=0).stop 2023-10-14T18:52:01.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 msgr2=0x7f00ec155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ec80 tx=0x7f00dc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 shutdown_connections 2023-10-14T18:52:01.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f00d0066fb0 0x7f00d0069460 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00ec155b60 0x7f00ec1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00ec0b6a10 0x7f00ec150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 --2- 172.21.15.79:0/4116872223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00ec159ef0 0x7f00ec155620 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 >> 172.21.15.79:0/4116872223 conn(0x7f00ec09a0a0 msgr2=0x7f00ec152550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:01.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 shutdown_connections 2023-10-14T18:52:01.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.834+0000 7f00f46b1700 1 -- 172.21.15.79:0/4116872223 wait complete. 2023-10-14T18:52:01.838 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:52:01.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:52:01.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.969+0000 7f6e9de4d700 1 Processor -- start 2023-10-14T18:52:01.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.969+0000 7f6e9de4d700 1 -- start start 2023-10-14T18:52:01.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e9de4d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e9de4d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980b0790 con 0x7f6e9815a290 2023-10-14T18:52:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e9de4d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980ce1f0 con 0x7f6e98159ec0 2023-10-14T18:52:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e9de4d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980b0b20 con 0x7f6e980d05a0 2023-10-14T18:52:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e8effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6e9815a290 0x7f6e9806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52840/0 (socket says 172.21.15.79:52840) 2023-10-14T18:52:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e8effd700 1 -- 172.21.15.79:0/1404449726 learned_addr learned my addr 172.21.15.79:0/1404449726 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:01.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e97fff700 1 --2- 172.21.15.79:0/1404449726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871841329 0 0) 0x7f6e980b0790 con 0x7f6e9815a290 2023-10-14T18:52:01.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003570 con 0x7f6e9815a290 2023-10-14T18:52:01.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340788601 0 0) 0x7f6e980ce1f0 con 0x7f6e98159ec0 2023-10-14T18:52:01.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e980b0790 con 0x7f6e98159ec0 2023-10-14T18:52:01.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e97fff700 1 -- 172.21.15.79:0/1404449726 >> v1:172.21.15.144:6789/0 conn(0x7f6e98159ec0 legacy=0x7f6e980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e97fff700 1 -- 172.21.15.79:0/1404449726 >> v1:172.21.15.79:6789/0 conn(0x7f6e9815a290 legacy=0x7f6e9806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.970+0000 7f6e97fff700 1 -- 172.21.15.79:0/1404449726 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980b04b0 con 0x7f6e980d05a0 2023-10-14T18:52:01.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e97fff700 1 --2- 172.21.15.79:0/1404449726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98164ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009e90 tx=0x7f6e90009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf8834601048ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000e070 con 0x7f6e980d05a0 2023-10-14T18:52:01.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000bb80 con 0x7f6e980d05a0 2023-10-14T18:52:01.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e96ffd700 1 -- 172.21.15.79:0/1404449726 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90012430 con 0x7f6e980d05a0 2023-10-14T18:52:01.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 -- 172.21.15.79:0/1404449726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 msgr2=0x7f6e98164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/1404449726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98164ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009e90 tx=0x7f6e90009780 comp rx=0 tx=0).stop 2023-10-14T18:52:01.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 -- 172.21.15.79:0/1404449726 shutdown_connections 2023-10-14T18:52:01.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/1404449726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98164ed0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 -- 172.21.15.79:0/1404449726 >> 172.21.15.79:0/1404449726 conn(0x7f6e980d1880 msgr2=0x7f6e980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:01.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 -- 172.21.15.79:0/1404449726 shutdown_connections 2023-10-14T18:52:01.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.971+0000 7f6e9de4d700 1 -- 172.21.15.79:0/1404449726 wait complete. 2023-10-14T18:52:01.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.972+0000 7f6e9de4d700 1 Processor -- start 2023-10-14T18:52:01.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 -- start start 2023-10-14T18:52:01.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e98159ec0 0x7f6e9815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98154ff0 con 0x7f6e9815a290 2023-10-14T18:52:01.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98157c70 con 0x7f6e98159ec0 2023-10-14T18:52:01.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.973+0000 7f6e9de4d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98157380 con 0x7f6e980d05a0 2023-10-14T18:52:01.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55380/0 (socket says 172.21.15.79:55380) 2023-10-14T18:52:01.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 -- 172.21.15.79:0/305976962 learned_addr learned my addr 172.21.15.79:0/305976962 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:01.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e8effd700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e98159ec0 0x7f6e9815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e977fe700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 -- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 msgr2=0x7f6e98154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 -- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e98159ec0 msgr2=0x7f6e9815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e98159ec0 0x7f6e9815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 -- 172.21.15.79:0/305976962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90009a20 con 0x7f6e9815a290 2023-10-14T18:52:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e97fff700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6e90013000 tx=0x7f6e90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90012e00 con 0x7f6e9815a290 2023-10-14T18:52:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9001b630 con 0x7f6e9815a290 2023-10-14T18:52:01.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e98157620 con 0x7f6e9815a290 2023-10-14T18:52:01.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9001b9f0 con 0x7f6e9815a290 2023-10-14T18:52:01.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.974+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980c93c0 con 0x7f6e9815a290 2023-10-14T18:52:01.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.975+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9804c3c0 con 0x7f6e9815a290 2023-10-14T18:52:01.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.976+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e9001c400 con 0x7f6e9815a290 2023-10-14T18:52:01.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.976+0000 7f6e8ffff700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:01.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.976+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6e90086100 con 0x7f6e9815a290 2023-10-14T18:52:01.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.976+0000 7f6e977fe700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:01.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.977+0000 7f6e977fe700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 0x7f6e780693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6e9816d430 tx=0x7f6e88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:01.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:01.981+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e900534b0 con 0x7f6e9815a290 2023-10-14T18:52:02.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.164+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6e980ceab0 con 0x7f6e9815a290 2023-10-14T18:52:02.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.837+0000 7f6e8ffff700 1 -- 172.21.15.79:0/305976962 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6e90056ad0 con 0x7f6e9815a290 2023-10-14T18:52:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.844+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 msgr2=0x7f6e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.844+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 0x7f6e780693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6e9816d430 tx=0x7f6e88009040 comp rx=0 tx=0).stop 2023-10-14T18:52:02.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.844+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 msgr2=0x7f6e980c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.844+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6e90013000 tx=0x7f6e90019000 comp rx=0 tx=0).stop 2023-10-14T18:52:02.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 shutdown_connections 2023-10-14T18:52:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6e78066f30 0x7f6e780693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e9815a290 0x7f6e980c8960 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e980d05a0 0x7f6e98154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 --2- 172.21.15.79:0/305976962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e98159ec0 0x7f6e9815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.845+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 >> 172.21.15.79:0/305976962 conn(0x7f6e980d1880 msgr2=0x7f6e981557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.846+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 shutdown_connections 2023-10-14T18:52:02.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.846+0000 7f6e9de4d700 1 -- 172.21.15.79:0/305976962 wait complete. 2023-10-14T18:52:02.849 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:52:02.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:52:02.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.979+0000 7f6ac7fff700 1 Processor -- start 2023-10-14T18:52:02.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.979+0000 7f6ac7fff700 1 -- start start 2023-10-14T18:52:02.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ac8159c00 0x7f6ac815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ac80cc580 0x7f6ac80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80c8ff0 con 0x7f6ac8159c00 2023-10-14T18:52:02.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80c92d0 con 0x7f6ac80cc580 2023-10-14T18:52:02.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac815e120 con 0x7f6ac8159fd0 2023-10-14T18:52:02.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ac8159c00 0x7f6ac815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ac8159c00 0x7f6ac815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55390/0 (socket says 172.21.15.79:55390) 2023-10-14T18:52:02.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 -- 172.21.15.79:0/1261993133 learned_addr learned my addr 172.21.15.79:0/1261993133 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:02.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac77fe700 1 --2- 172.21.15.79:0/1261993133 >> v2:172.21.15.144:3300/0 conn(0x7f6ac80cc580 0x7f6ac80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac67fc700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 -- 172.21.15.79:0/1261993133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 msgr2=0x7f6ac80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:02.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 -- 172.21.15.79:0/1261993133 >> v2:172.21.15.144:3300/0 conn(0x7f6ac80cc580 msgr2=0x7f6ac80cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:02.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/1261993133 >> v2:172.21.15.144:3300/0 conn(0x7f6ac80cc580 0x7f6ac80cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.980+0000 7f6ac6ffd700 1 -- 172.21.15.79:0/1261993133 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac815e400 con 0x7f6ac8159c00 2023-10-14T18:52:02.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac815d8d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80cb070 tx=0x7f6ab8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60d5049cff18943 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:02.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac5ffb700 1 -- 172.21.15.79:0/1261993133 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800e070 con 0x7f6ac8159c00 2023-10-14T18:52:02.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac5ffb700 1 -- 172.21.15.79:0/1261993133 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800b970 con 0x7f6ac8159c00 2023-10-14T18:52:02.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac5ffb700 1 -- 172.21.15.79:0/1261993133 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab80092e0 con 0x7f6ac8159c00 2023-10-14T18:52:02.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 -- 172.21.15.79:0/1261993133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 msgr2=0x7f6ac815d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:02.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac815d8d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80cb070 tx=0x7f6ab8009840 comp rx=0 tx=0).stop 2023-10-14T18:52:02.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 -- 172.21.15.79:0/1261993133 shutdown_connections 2023-10-14T18:52:02.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/1261993133 >> v2:172.21.15.144:3300/0 conn(0x7f6ac80cc580 0x7f6ac80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac815d8d0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/1261993133 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 -- 172.21.15.79:0/1261993133 >> 172.21.15.79:0/1261993133 conn(0x7f6ac806c700 msgr2=0x7f6ac8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:02.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 -- 172.21.15.79:0/1261993133 shutdown_connections 2023-10-14T18:52:02.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.981+0000 7f6ac7fff700 1 -- 172.21.15.79:0/1261993133 wait complete. 2023-10-14T18:52:02.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 Processor -- start 2023-10-14T18:52:02.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 -- start start 2023-10-14T18:52:02.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ac80cc580 0x7f6ac80ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac816dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80b4580 con 0x7f6ac8159c00 2023-10-14T18:52:02.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80687f0 con 0x7f6ac80cc580 2023-10-14T18:52:02.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80b42a0 con 0x7f6ac8159fd0 2023-10-14T18:52:02.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55392/0 (socket says 172.21.15.79:55392) 2023-10-14T18:52:02.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.983+0000 7f6ac67fc700 1 -- 172.21.15.79:0/2245226867 learned_addr learned my addr 172.21.15.79:0/2245226867 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:02.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ac80cc580 0x7f6ac80ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac77fe700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac816dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 -- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 msgr2=0x7f6ac816dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:02.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac816dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 -- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ac80cc580 msgr2=0x7f6ac80ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:02.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ac80cc580 0x7f6ac80ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:02.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 -- 172.21.15.79:0/2245226867 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009ae0 con 0x7f6ac8159c00 2023-10-14T18:52:02.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac67fc700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e950 tx=0x7f6ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:02.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0009530 con 0x7f6ac8159c00 2023-10-14T18:52:02.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000c850 con 0x7f6ac8159c00 2023-10-14T18:52:02.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80681a0 con 0x7f6ac8159c00 2023-10-14T18:52:02.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000cc10 con 0x7f6ac8159c00 2023-10-14T18:52:02.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.984+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac80ad540 con 0x7f6ac8159c00 2023-10-14T18:52:02.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.985+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac8068960 con 0x7f6ac8159c00 2023-10-14T18:52:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.985+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ab0013470 con 0x7f6ac8159c00 2023-10-14T18:52:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.986+0000 7f6abeffd700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 0x7f6aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.986+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6ab0084670 con 0x7f6ac8159c00 2023-10-14T18:52:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.986+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 0x7f6aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.986+0000 7f6ac6ffd700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 0x7f6aa80693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009880 tx=0x7f6ab8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:02.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:02.990+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ab0051940 con 0x7f6ac8159c00 2023-10-14T18:52:03.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.216+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6ac815e6e0 con 0x7f6ac8159c00 2023-10-14T18:52:03.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.839+0000 7f6abeffd700 1 -- 172.21.15.79:0/2245226867 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v68) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6ab0054f60 con 0x7f6ac8159c00 2023-10-14T18:52:03.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.846+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 msgr2=0x7f6aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.846+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 0x7f6aa80693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009880 tx=0x7f6ab8018000 comp rx=0 tx=0).stop 2023-10-14T18:52:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.846+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 msgr2=0x7f6ac8169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.846+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000e950 tx=0x7f6ab00091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 shutdown_connections 2023-10-14T18:52:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6aa8066f30 0x7f6aa80693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ac8159fd0 0x7f6ac816dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ac80cc580 0x7f6ac80ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 --2- 172.21.15.79:0/2245226867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac8159c00 0x7f6ac8169f50 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.847+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 >> 172.21.15.79:0/2245226867 conn(0x7f6ac806c700 msgr2=0x7f6ac80c3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:03.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.849+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 shutdown_connections 2023-10-14T18:52:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.850+0000 7f6ac7fff700 1 -- 172.21.15.79:0/2245226867 wait complete. 2023-10-14T18:52:03.851 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 18 and data pool 19 2023-10-14T18:52:03.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:52:03.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.981+0000 7ff323b5b700 1 Processor -- start 2023-10-14T18:52:03.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.981+0000 7ff323b5b700 1 -- start start 2023-10-14T18:52:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff323b5b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff323b5b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff323b5b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c15cbb0 con 0x7ff31c15a620 2023-10-14T18:52:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff323b5b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c15bfa0 con 0x7ff31c157c40 2023-10-14T18:52:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff323b5b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c15c280 con 0x7ff31c157870 2023-10-14T18:52:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff3220f8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff3218f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff3218f7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:52000/0 (socket says 172.21.15.79:52000) 2023-10-14T18:52:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff3220f8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:39390/0 (socket says 172.21.15.79:39390) 2023-10-14T18:52:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.982+0000 7ff3218f7700 1 -- 172.21.15.79:0/859289681 learned_addr learned my addr 172.21.15.79:0/859289681 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3218f7700 1 -- 172.21.15.79:0/859289681 >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 msgr2=0x7ff31c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:03.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3218f7700 1 --2- 172.21.15.79:0/859289681 >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3218f7700 1 -- 172.21.15.79:0/859289681 >> v1:172.21.15.144:6789/0 conn(0x7ff31c15a620 legacy=0x7ff31c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3218f7700 1 -- 172.21.15.79:0/859289681 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c15c560 con 0x7ff31c157870 2023-10-14T18:52:03.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3220f8700 1 --2- 172.21.15.79:0/859289681 >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:52:03.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3218f7700 1 --2- 172.21.15.79:0/859289681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff318009f20 tx=0x7ff318009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d11cc92e2d6b7bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:03.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3208f5700 1 -- 172.21.15.79:0/859289681 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800e070 con 0x7ff31c157870 2023-10-14T18:52:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3208f5700 1 -- 172.21.15.79:0/859289681 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800b9d0 con 0x7ff31c157870 2023-10-14T18:52:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.983+0000 7ff3208f5700 1 -- 172.21.15.79:0/859289681 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3180092e0 con 0x7ff31c157870 2023-10-14T18:52:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 -- 172.21.15.79:0/859289681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 msgr2=0x7ff31c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 --2- 172.21.15.79:0/859289681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff318009f20 tx=0x7ff318009840 comp rx=0 tx=0).stop 2023-10-14T18:52:03.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 -- 172.21.15.79:0/859289681 shutdown_connections 2023-10-14T18:52:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 --2- 172.21.15.79:0/859289681 >> v2:172.21.15.144:3300/0 conn(0x7ff31c157c40 0x7ff31c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 --2- 172.21.15.79:0/859289681 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c15b6a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 -- 172.21.15.79:0/859289681 >> 172.21.15.79:0/859289681 conn(0x7ff31c068ce0 msgr2=0x7ff31c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 -- 172.21.15.79:0/859289681 shutdown_connections 2023-10-14T18:52:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.984+0000 7ff323b5b700 1 -- 172.21.15.79:0/859289681 wait complete. 2023-10-14T18:52:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.985+0000 7ff323b5b700 1 Processor -- start 2023-10-14T18:52:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.985+0000 7ff323b5b700 1 -- start start 2023-10-14T18:52:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.985+0000 7ff323b5b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c14f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.985+0000 7ff323b5b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.985+0000 7ff323b5b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff31c15a620 0x7ff31c148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff323b5b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c149d50 con 0x7ff31c157c40 2023-10-14T18:52:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff323b5b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c14a030 con 0x7ff31c15a620 2023-10-14T18:52:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff323b5b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c14a310 con 0x7ff31c157870 2023-10-14T18:52:03.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55400/0 (socket says 172.21.15.79:55400) 2023-10-14T18:52:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 -- 172.21.15.79:0/8710966 learned_addr learned my addr 172.21.15.79:0/8710966 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3218f7700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c14f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3220f8700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff31c15a620 0x7ff31c148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 -- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 msgr2=0x7ff31c14f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c14f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 -- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff31c15a620 msgr2=0x7ff31c148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:03.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff31c15a620 0x7ff31c148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:03.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 -- 172.21.15.79:0/8710966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314009420 con 0x7ff31c157c40 2023-10-14T18:52:03.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff3210f6700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c4e0 tx=0x7ff30c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:03.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c011590 con 0x7ff31c157c40 2023-10-14T18:52:03.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c011710 con 0x7ff31c157c40 2023-10-14T18:52:03.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c011ad0 con 0x7ff31c157c40 2023-10-14T18:52:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.986+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318009ae0 con 0x7ff31c157c40 2023-10-14T18:52:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.987+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c14a8d0 con 0x7ff31c157c40 2023-10-14T18:52:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.987+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c14aaf0 con 0x7ff31c157c40 2023-10-14T18:52:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.988+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff30c01b3b0 con 0x7ff31c157c40 2023-10-14T18:52:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.988+0000 7ff311ffb700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 0x7ff3000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.988+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff30c083880 con 0x7ff31c157c40 2023-10-14T18:52:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.988+0000 7ff3218f7700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 0x7ff3000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.989+0000 7ff3218f7700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 0x7ff3000693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff318009880 tx=0x7ff318018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:03.992+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff30c050bb0 con 0x7ff31c157c40 2023-10-14T18:52:04.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.176+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff31c04c3c0 con 0x7ff31c157c40 2023-10-14T18:52:04.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.176+0000 7ff311ffb700 1 -- 172.21.15.79:0/8710966 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15378 (secure 0 0 0) 0x7ff30c017070 con 0x7ff31c157c40 2023-10-14T18:52:04.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:04.177 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":153,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:52:03.217741+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:52:04.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 msgr2=0x7ff3000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 0x7ff3000693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff318009880 tx=0x7ff318018000 comp rx=0 tx=0).stop 2023-10-14T18:52:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 msgr2=0x7ff31c1492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c4e0 tx=0x7ff30c00c7f0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 shutdown_connections 2023-10-14T18:52:04.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff300066f30 0x7ff3000693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff31c15a620 0x7ff31c148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff31c157870 0x7ff31c14f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 --2- 172.21.15.79:0/8710966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff31c157c40 0x7ff31c1492d0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 >> 172.21.15.79:0/8710966 conn(0x7ff31c068ce0 msgr2=0x7ff31c0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:04.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 shutdown_connections 2023-10-14T18:52:04.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.179+0000 7ff323b5b700 1 -- 172.21.15.79:0/8710966 wait complete. 2023-10-14T18:52:04.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:52:04.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.305+0000 7fa693fff700 1 Processor -- start 2023-10-14T18:52:04.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.305+0000 7fa693fff700 1 -- start start 2023-10-14T18:52:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa693fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cd6e0 0x7fa6940cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa693fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa69415cbd0 0x7fa69415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa693fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940cb7c0 con 0x7fa6940cdab0 2023-10-14T18:52:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa693fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69415e850 con 0x7fa69415cbd0 2023-10-14T18:52:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa693fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940cd030 con 0x7fa6940cd6e0 2023-10-14T18:52:04.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa69415cbd0 0x7fa69415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa69415cbd0 0x7fa69415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55406/0 (socket says 172.21.15.79:55406) 2023-10-14T18:52:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 -- 172.21.15.79:0/1917216192 learned_addr learned my addr 172.21.15.79:0/1917216192 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa692ffd700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cd6e0 0x7fa6940cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 -- 172.21.15.79:0/1917216192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cd6e0 msgr2=0x7fa6940cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:04.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cd6e0 0x7fa6940cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 -- 172.21.15.79:0/1917216192 >> v1:172.21.15.144:6789/0 conn(0x7fa6940cdab0 legacy=0x7fa69415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 -- 172.21.15.79:0/1917216192 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69415e290 con 0x7fa69415cbd0 2023-10-14T18:52:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.306+0000 7fa6937fe700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415d020 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0099b0 tx=0x7fa68c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5c4fdd05908df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa691ffb700 1 -- 172.21.15.79:0/1917216192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c009ea0 con 0x7fa69415cbd0 2023-10-14T18:52:04.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa691ffb700 1 -- 172.21.15.79:0/1917216192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c00b860 con 0x7fa69415cbd0 2023-10-14T18:52:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa691ffb700 1 -- 172.21.15.79:0/1917216192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00bc00 con 0x7fa69415cbd0 2023-10-14T18:52:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 -- 172.21.15.79:0/1917216192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 msgr2=0x7fa69415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415d020 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0099b0 tx=0x7fa68c009250 comp rx=0 tx=0).stop 2023-10-14T18:52:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 -- 172.21.15.79:0/1917216192 shutdown_connections 2023-10-14T18:52:04.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415d020 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 --2- 172.21.15.79:0/1917216192 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cd6e0 0x7fa6940cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 -- 172.21.15.79:0/1917216192 >> 172.21.15.79:0/1917216192 conn(0x7fa694067660 msgr2=0x7fa694067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 -- 172.21.15.79:0/1917216192 shutdown_connections 2023-10-14T18:52:04.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.307+0000 7fa693fff700 1 -- 172.21.15.79:0/1917216192 wait complete. 2023-10-14T18:52:04.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 Processor -- start 2023-10-14T18:52:04.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 -- start start 2023-10-14T18:52:04.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 0x7fa6940b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cdab0 0x7fa694158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940c8d00 con 0x7fa69415cbd0 2023-10-14T18:52:04.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b1df0 con 0x7fa6940cd6e0 2023-10-14T18:52:04.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa693fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa694155980 con 0x7fa6940cdab0 2023-10-14T18:52:04.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa6937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa6937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55412/0 (socket says 172.21.15.79:55412) 2023-10-14T18:52:04.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.309+0000 7fa6937fe700 1 -- 172.21.15.79:0/2543602971 learned_addr learned my addr 172.21.15.79:0/2543602971 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:04.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa692ffd700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 0x7fa6940b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6927fc700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cdab0 0x7fa694158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 -- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cdab0 msgr2=0x7fa694158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cdab0 0x7fa694158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 -- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 msgr2=0x7fa6940b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 0x7fa6940b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 -- 172.21.15.79:0/2543602971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0094f0 con 0x7fa69415cbd0 2023-10-14T18:52:04.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa692ffd700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 0x7fa6940b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa6937fe700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00bba0 con 0x7fa69415cbd0 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c011630 con 0x7fa69415cbd0 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0119f0 con 0x7fa69415cbd0 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940b0f00 con 0x7fa69415cbd0 2023-10-14T18:52:04.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.310+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940b14c0 con 0x7fa69415cbd0 2023-10-14T18:52:04.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.311+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6940b1f80 con 0x7fa69415cbd0 2023-10-14T18:52:04.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.311+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa68c0253f0 con 0x7fa69415cbd0 2023-10-14T18:52:04.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.312+0000 7fa67affd700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.312+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa68c085fa0 con 0x7fa69415cbd0 2023-10-14T18:52:04.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.312+0000 7fa692ffd700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.312+0000 7fa692ffd700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 0x7fa6800693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa6840094d0 tx=0x7fa68400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.316+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa68c0b75a0 con 0x7fa69415cbd0 2023-10-14T18:52:04.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.499+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa69415e570 con 0x7fa69415cbd0 2023-10-14T18:52:04.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.500+0000 7fa67affd700 1 -- 172.21.15.79:0/2543602971 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fa68c05ae60 con 0x7fa69415cbd0 2023-10-14T18:52:04.501 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:04.501 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":153,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:52:03.217741+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:52:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 msgr2=0x7fa6800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 0x7fa6800693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa6840094d0 tx=0x7fa68400b040 comp rx=0 tx=0).stop 2023-10-14T18:52:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 msgr2=0x7fa69415ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006fd0 tx=0x7fa68c017000 comp rx=0 tx=0).stop 2023-10-14T18:52:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 shutdown_connections 2023-10-14T18:52:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa69415cbd0 0x7fa69415ab60 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6940cd6e0 0x7fa6940b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 --2- 172.21.15.79:0/2543602971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6940cdab0 0x7fa694158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.501+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 >> 172.21.15.79:0/2543602971 conn(0x7fa694067660 msgr2=0x7fa6940b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.502+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 shutdown_connections 2023-10-14T18:52:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.502+0000 7fa693fff700 1 -- 172.21.15.79:0/2543602971 wait complete. 2023-10-14T18:52:04.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:52:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.631+0000 7f814e321700 1 Processor -- start 2023-10-14T18:52:04.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.631+0000 7f814e321700 1 -- start start 2023-10-14T18:52:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f814e321700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f8148164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f814e321700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480b0790 con 0x7f814815a290 2023-10-14T18:52:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f814e321700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480ce1f0 con 0x7f8148159ec0 2023-10-14T18:52:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f814e321700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480b0b20 con 0x7f81480d05a0 2023-10-14T18:52:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f81477fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f814815a290 0x7f814806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52846/0 (socket says 172.21.15.79:52846) 2023-10-14T18:52:04.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f81477fe700 1 -- 172.21.15.79:0/3961773361 learned_addr learned my addr 172.21.15.79:0/3961773361 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.632+0000 7f814c8be700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f8148164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630628940 0 0) 0x7f81480b0790 con 0x7f814815a290 2023-10-14T18:52:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8130003570 con 0x7f814815a290 2023-10-14T18:52:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681901227 0 0) 0x7f81480ce1f0 con 0x7f8148159ec0 2023-10-14T18:52:04.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81480b0790 con 0x7f8148159ec0 2023-10-14T18:52:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197259859 0 0) 0x7f8130003570 con 0x7f814815a290 2023-10-14T18:52:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 msgr2=0x7f8148164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f8148164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 >> v1:172.21.15.144:6789/0 conn(0x7f8148159ec0 legacy=0x7f81480af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480b04b0 con 0x7f814815a290 2023-10-14T18:52:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f813c001470 con 0x7f814815a290 2023-10-14T18:52:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 >> v1:172.21.15.79:6789/0 conn(0x7f814815a290 legacy=0x7f814806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130003c20 0x7f8130004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f81300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480b0b20 con 0x7f8130004810 2023-10-14T18:52:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813000bb40 con 0x7f8130003c20 2023-10-14T18:52:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813000bd00 con 0x7f81480d05a0 2023-10-14T18:52:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8147fff700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130003c20 0x7f8130004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f814c8be700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f81300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 -- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 msgr2=0x7f81300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f81300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 -- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130003c20 msgr2=0x7f8130004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:04.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130003c20 0x7f8130004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 -- 172.21.15.79:0/3961773361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130003570 con 0x7f8130004810 2023-10-14T18:52:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f814c8be700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f81480d05a0 0x7f81300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f81477fe700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8130004c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c2d0 tx=0x7f813c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f493736c29e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c00cbc0 con 0x7f8130004810 2023-10-14T18:52:04.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c00cd20 con 0x7f8130004810 2023-10-14T18:52:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.633+0000 7f8146ffd700 1 -- 172.21.15.79:0/3961773361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c005b70 con 0x7f8130004810 2023-10-14T18:52:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 -- 172.21.15.79:0/3961773361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 msgr2=0x7f8130004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 --2- 172.21.15.79:0/3961773361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8130004c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c2d0 tx=0x7f813c001e10 comp rx=0 tx=0).stop 2023-10-14T18:52:04.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814c8be700 1 -- 172.21.15.79:0/3961773361 reap_dead start 2023-10-14T18:52:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 -- 172.21.15.79:0/3961773361 shutdown_connections 2023-10-14T18:52:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 -- 172.21.15.79:0/3961773361 >> 172.21.15.79:0/3961773361 conn(0x7f81480d1880 msgr2=0x7f81480cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 -- 172.21.15.79:0/3961773361 shutdown_connections 2023-10-14T18:52:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.634+0000 7f814e321700 1 -- 172.21.15.79:0/3961773361 wait complete. 2023-10-14T18:52:04.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.635+0000 7f814e321700 1 Processor -- start 2023-10-14T18:52:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.635+0000 7f814e321700 1 -- start start 2023-10-14T18:52:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f814815c150 0x7f814815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814815fc70 0x7f81481600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148160600 con 0x7f8130004810 2023-10-14T18:52:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c8e10 con 0x7f814815fc70 2023-10-14T18:52:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814e321700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81480c8200 con 0x7f814815c150 2023-10-14T18:52:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55426/0 (socket says 172.21.15.79:55426) 2023-10-14T18:52:04.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 -- 172.21.15.79:0/3511755787 learned_addr learned my addr 172.21.15.79:0/3511755787 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f81477fe700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f814815c150 0x7f814815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 -- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f814815c150 msgr2=0x7f814815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f814815c150 0x7f814815c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 -- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814815fc70 msgr2=0x7f81481600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:04.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f814c8be700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814815fc70 0x7f81481600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814815fc70 0x7f81481600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 -- 172.21.15.79:0/3511755787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480c84e0 con 0x7f8130004810 2023-10-14T18:52:04.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.636+0000 7f8147fff700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f8138002bd0 tx=0x7f8138007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.637+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813800f9d0 con 0x7f8130004810 2023-10-14T18:52:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.637+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813800fb50 con 0x7f8130004810 2023-10-14T18:52:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.637+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81480c87c0 con 0x7f8130004810 2023-10-14T18:52:04.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.637+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81380133f0 con 0x7f8130004810 2023-10-14T18:52:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.637+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481595c0 con 0x7f8130004810 2023-10-14T18:52:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.638+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814804c3c0 con 0x7f8130004810 2023-10-14T18:52:04.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.638+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81380137a0 con 0x7f8130004810 2023-10-14T18:52:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.638+0000 7f812ffff700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 0x7f8134069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.639+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8138084c40 con 0x7f8130004810 2023-10-14T18:52:04.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.639+0000 7f81477fe700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 0x7f8134069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:04.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.639+0000 7f81477fe700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 0x7f8134069460 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f813c008fd0 tx=0x7f813c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:04.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.643+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8138051ec0 con 0x7f8130004810 2023-10-14T18:52:04.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:04.873+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81480ceab0 con 0x7f8130004810 2023-10-14T18:52:05.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.874+0000 7f812ffff700 1 -- 172.21.15.79:0/3511755787 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81380170b0 con 0x7f8130004810 2023-10-14T18:52:05.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 msgr2=0x7f8134069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:05.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 0x7f8134069460 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f813c008fd0 tx=0x7f813c015000 comp rx=0 tx=0).stop 2023-10-14T18:52:05.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 msgr2=0x7f8148159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:05.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f8138002bd0 tx=0x7f8138007d30 comp rx=0 tx=0).stop 2023-10-14T18:52:05.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 shutdown_connections 2023-10-14T18:52:05.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8134066fb0 0x7f8134069460 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:05.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f814815fc70 0x7f81481600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:05.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8130004810 0x7f8148159080 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:05.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 --2- 172.21.15.79:0/3511755787 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f814815c150 0x7f814815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:05.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 >> 172.21.15.79:0/3511755787 conn(0x7f81480d1880 msgr2=0x7f81480b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:05.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 shutdown_connections 2023-10-14T18:52:05.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:05.877+0000 7f814e321700 1 -- 172.21.15.79:0/3511755787 wait complete. 2023-10-14T18:52:05.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:52:06.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.009+0000 7efd9e3e8700 1 Processor -- start 2023-10-14T18:52:06.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.009+0000 7efd9e3e8700 1 -- start start 2023-10-14T18:52:06.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd9e3e8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd980af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd9e3e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd9815a290 0x7efd980afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd9e3e8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd980b0790 con 0x7efd9806a5a0 2023-10-14T18:52:06.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd9e3e8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd980ce1f0 con 0x7efd9815a290 2023-10-14T18:52:06.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd9e3e8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd980b0b20 con 0x7efd98159ec0 2023-10-14T18:52:06.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd9815a290 0x7efd980afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd9815a290 0x7efd980afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55440/0 (socket says 172.21.15.79:55440) 2023-10-14T18:52:06.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 -- 172.21.15.79:0/996449425 learned_addr learned my addr 172.21.15.79:0/996449425 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:06.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd97fff700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd980af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 -- 172.21.15.79:0/996449425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 msgr2=0x7efd980af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:06.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd980af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 -- 172.21.15.79:0/996449425 >> v1:172.21.15.144:6789/0 conn(0x7efd9806a5a0 legacy=0x7efd9815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:06.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd977fe700 1 -- 172.21.15.79:0/996449425 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980b04b0 con 0x7efd9815a290 2023-10-14T18:52:06.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.010+0000 7efd97fff700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd980af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:06.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd977fe700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980afe80 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0099b0 tx=0x7efd8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7259547cfcb8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:06.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd96ffd700 1 -- 172.21.15.79:0/996449425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00b820 con 0x7efd9815a290 2023-10-14T18:52:06.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd96ffd700 1 -- 172.21.15.79:0/996449425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8c00b980 con 0x7efd9815a290 2023-10-14T18:52:06.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd96ffd700 1 -- 172.21.15.79:0/996449425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00bd20 con 0x7efd9815a290 2023-10-14T18:52:06.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 -- 172.21.15.79:0/996449425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 msgr2=0x7efd980afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:06.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980afe80 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0099b0 tx=0x7efd8c009250 comp rx=0 tx=0).stop 2023-10-14T18:52:06.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 -- 172.21.15.79:0/996449425 shutdown_connections 2023-10-14T18:52:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd980af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/996449425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980afe80 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 -- 172.21.15.79:0/996449425 >> 172.21.15.79:0/996449425 conn(0x7efd980d1880 msgr2=0x7efd980cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 -- 172.21.15.79:0/996449425 shutdown_connections 2023-10-14T18:52:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.011+0000 7efd9e3e8700 1 -- 172.21.15.79:0/996449425 wait complete. 2023-10-14T18:52:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.012+0000 7efd9e3e8700 1 Processor -- start 2023-10-14T18:52:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 -- start start 2023-10-14T18:52:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd9806a5a0 0x7efd9815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd98144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980cb7c0 con 0x7efd9815a290 2023-10-14T18:52:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980c88c0 con 0x7efd9806a5a0 2023-10-14T18:52:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9e3e8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9815dc30 con 0x7efd98159ec0 2023-10-14T18:52:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9c985700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9c985700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55450/0 (socket says 172.21.15.79:55450) 2023-10-14T18:52:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd9c985700 1 -- 172.21.15.79:0/59555523 learned_addr learned my addr 172.21.15.79:0/59555523 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd977fe700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd98144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.013+0000 7efd97fff700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd9806a5a0 0x7efd9815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 -- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 msgr2=0x7efd98144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd98144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 -- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd9806a5a0 msgr2=0x7efd9815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd9806a5a0 0x7efd9815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 -- 172.21.15.79:0/59555523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0094f0 con 0x7efd9815a290 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9c985700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efd9000bc30 tx=0x7efd90009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000c840 con 0x7efd9815a290 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9000c9e0 con 0x7efd9815a290 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd980c7f90 con 0x7efd9815a290 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000cda0 con 0x7efd9815a290 2023-10-14T18:52:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.014+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd980c8550 con 0x7efd9815a290 2023-10-14T18:52:06.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.015+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9804c3c0 con 0x7efd9815a290 2023-10-14T18:52:06.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.015+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd90014620 con 0x7efd9815a290 2023-10-14T18:52:06.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.016+0000 7efd7ffff700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:06.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.016+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd90084470 con 0x7efd9815a290 2023-10-14T18:52:06.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.016+0000 7efd97fff700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:06.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.016+0000 7efd97fff700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd8800adc0 tx=0x7efd88006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:06.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.020+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd9004c5a0 con 0x7efd9815a290 2023-10-14T18:52:06.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.244+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efd980ceab0 con 0x7efd9815a290 2023-10-14T18:52:06.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.883+0000 7efd7ffff700 1 -- 172.21.15.79:0/59555523 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd900516e0 con 0x7efd9815a290 2023-10-14T18:52:06.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 msgr2=0x7efd840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd8800adc0 tx=0x7efd88006f90 comp rx=0 tx=0).stop 2023-10-14T18:52:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 msgr2=0x7efd980caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efd9000bc30 tx=0x7efd90009820 comp rx=0 tx=0).stop 2023-10-14T18:52:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 shutdown_connections 2023-10-14T18:52:06.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd9815a290 0x7efd980caa40 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd9806a5a0 0x7efd9815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 --2- 172.21.15.79:0/59555523 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd98159ec0 0x7efd98144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 >> 172.21.15.79:0/59555523 conn(0x7efd980d1880 msgr2=0x7efd980cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:06.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 shutdown_connections 2023-10-14T18:52:06.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:06.886+0000 7efd9e3e8700 1 -- 172.21.15.79:0/59555523 wait complete. 2023-10-14T18:52:06.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:52:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.016+0000 7f121cbd3700 1 Processor -- start 2023-10-14T18:52:07.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.016+0000 7f121cbd3700 1 -- start start 2023-10-14T18:52:07.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f121cbd3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f121815a620 0x7f121815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f121cbd3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f121815d580 0x7f1218158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f121cbd3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121815cbb0 con 0x7f1218157870 2023-10-14T18:52:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f121cbd3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121815bdb0 con 0x7f121815a620 2023-10-14T18:52:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f121cbd3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121815bfa0 con 0x7f121815d580 2023-10-14T18:52:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f121815a620 0x7f121815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f121815a620 0x7f121815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55462/0 (socket says 172.21.15.79:55462) 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 -- 172.21.15.79:0/2176059455 learned_addr learned my addr 172.21.15.79:0/2176059455 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f1216d9d700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f121815d580 0x7f1218158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 -- 172.21.15.79:0/2176059455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f121815d580 msgr2=0x7f1218158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f121815d580 0x7f1218158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 -- 172.21.15.79:0/2176059455 >> v1:172.21.15.144:6789/0 conn(0x7f1218157870 legacy=0x7f121815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 -- 172.21.15.79:0/2176059455 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121815c280 con 0x7f121815a620 2023-10-14T18:52:07.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.017+0000 7f120dd9b700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815a620 0x7f121815d040 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f12000099b0 tx=0x7f1200009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee9af4b8441b647 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f1215d9b700 1 -- 172.21.15.79:0/2176059455 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200009ea0 con 0x7f121815a620 2023-10-14T18:52:07.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f1215d9b700 1 -- 172.21.15.79:0/2176059455 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120000b860 con 0x7f121815a620 2023-10-14T18:52:07.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f1215d9b700 1 -- 172.21.15.79:0/2176059455 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120000bc00 con 0x7f121815a620 2023-10-14T18:52:07.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 -- 172.21.15.79:0/2176059455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815a620 msgr2=0x7f121815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815a620 0x7f121815d040 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f12000099b0 tx=0x7f1200009250 comp rx=0 tx=0).stop 2023-10-14T18:52:07.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 -- 172.21.15.79:0/2176059455 shutdown_connections 2023-10-14T18:52:07.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f121815d580 0x7f1218158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 --2- 172.21.15.79:0/2176059455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815a620 0x7f121815d040 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 -- 172.21.15.79:0/2176059455 >> 172.21.15.79:0/2176059455 conn(0x7f1218068ce0 msgr2=0x7f12180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 -- 172.21.15.79:0/2176059455 shutdown_connections 2023-10-14T18:52:07.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.018+0000 7f121cbd3700 1 -- 172.21.15.79:0/2176059455 wait complete. 2023-10-14T18:52:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.019+0000 7f121cbd3700 1 Processor -- start 2023-10-14T18:52:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.019+0000 7f121cbd3700 1 -- start start 2023-10-14T18:52:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1218157870 0x7f12180b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815a620 0x7f1218153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1218152a50 con 0x7f121815d580 2023-10-14T18:52:07.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180b1940 con 0x7f121815a620 2023-10-14T18:52:07.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121cbd3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180b0d30 con 0x7f1218157870 2023-10-14T18:52:07.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f1216d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f1216d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55474/0 (socket says 172.21.15.79:55474) 2023-10-14T18:52:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f1216d9d700 1 -- 172.21.15.79:0/738750356 learned_addr learned my addr 172.21.15.79:0/738750356 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.020+0000 7f121659c700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1218157870 0x7f12180b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f120dd9b700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815a620 0x7f1218153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 -- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1218157870 msgr2=0x7f12180b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1218157870 0x7f12180b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 -- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815a620 msgr2=0x7f1218153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815a620 0x7f1218153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 -- 172.21.15.79:0/738750356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000094f0 con 0x7f121815d580 2023-10-14T18:52:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f1216d9d700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f1210009d70 tx=0x7f121000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000cb50 con 0x7f121815d580 2023-10-14T18:52:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000f040 con 0x7f121815d580 2023-10-14T18:52:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12180b1010 con 0x7f121815d580 2023-10-14T18:52:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210014480 con 0x7f121815d580 2023-10-14T18:52:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.021+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12180b15d0 con 0x7f121815d580 2023-10-14T18:52:07.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.022+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121814ce20 con 0x7f121815d580 2023-10-14T18:52:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.022+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12100147f0 con 0x7f121815d580 2023-10-14T18:52:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.023+0000 7f120effd700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 0x7f11f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.023+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1210085150 con 0x7f121815d580 2023-10-14T18:52:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.023+0000 7f121659c700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 0x7f11f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.023+0000 7f121659c700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 0x7f11f80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12080037c0 tx=0x7f1208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.027+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12100523c0 con 0x7f121815d580 2023-10-14T18:52:07.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.253+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12180b1ab0 con 0x7f121815d580 2023-10-14T18:52:07.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.253+0000 7f120effd700 1 -- 172.21.15.79:0/738750356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f12100559e0 con 0x7f121815d580 2023-10-14T18:52:07.254 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:07.255 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:52:07.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 msgr2=0x7f11f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 0x7f11f80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f12080037c0 tx=0x7f1208009040 comp rx=0 tx=0).stop 2023-10-14T18:52:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 msgr2=0x7f1218150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f1210009d70 tx=0x7f121000b040 comp rx=0 tx=0).stop 2023-10-14T18:52:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 shutdown_connections 2023-10-14T18:52:07.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f11f8066f30 0x7f11f80693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f121815d580 0x7f1218150c70 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1218157870 0x7f12180b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 --2- 172.21.15.79:0/738750356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815a620 0x7f1218153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 >> 172.21.15.79:0/738750356 conn(0x7f1218068ce0 msgr2=0x7f12181599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 shutdown_connections 2023-10-14T18:52:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.255+0000 7f121cbd3700 1 -- 172.21.15.79:0/738750356 wait complete. 2023-10-14T18:52:07.259 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:52:07.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:52:07.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.380+0000 7fb816955700 1 Processor -- start 2023-10-14T18:52:07.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.380+0000 7fb816955700 1 -- start start 2023-10-14T18:52:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816955700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb8100cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816955700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb81015cbd0 0x7fb81015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816955700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8100cb7c0 con 0x7fb8100cdab0 2023-10-14T18:52:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816955700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81015e850 con 0x7fb81015cbd0 2023-10-14T18:52:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816955700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cd030 con 0x7fb8100cd6e0 2023-10-14T18:52:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb815152700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb8100cdab0 0x7fb81015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52862/0 (socket says 172.21.15.79:52862) 2023-10-14T18:52:07.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb815152700 1 -- 172.21.15.79:0/3689687430 learned_addr learned my addr 172.21.15.79:0/3689687430 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:07.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb816154700 1 --2- 172.21.15.79:0/3689687430 >> v2:172.21.15.144:3300/0 conn(0x7fb81015cbd0 0x7fb81015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb815953700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb8100cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103096099 0 0) 0x7fb8100cb7c0 con 0x7fb8100cdab0 2023-10-14T18:52:07.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.381+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7fc003570 con 0x7fb8100cdab0 2023-10-14T18:52:07.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb816154700 1 -- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 msgr2=0x7fb8100cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb816154700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb8100cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb816154700 1 -- 172.21.15.79:0/3689687430 >> v1:172.21.15.79:6789/0 conn(0x7fb8100cdab0 legacy=0x7fb81015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256842019 0 0) 0x7fb7fc003570 con 0x7fb8100cdab0 2023-10-14T18:52:07.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb816154700 1 -- 172.21.15.79:0/3689687430 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81015e290 con 0x7fb81015cbd0 2023-10-14T18:52:07.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb815953700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb8100cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:52:07.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb816154700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81015cbd0 0x7fb81015d020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb8080098e0 tx=0x7fb8080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950da5d891d21e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800001470 con 0x7fb81015cbd0 2023-10-14T18:52:07.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808011420 con 0x7fb81015cbd0 2023-10-14T18:52:07.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.382+0000 7fb814951700 1 -- 172.21.15.79:0/3689687430 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8080117c0 con 0x7fb81015cbd0 2023-10-14T18:52:07.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 -- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81015cbd0 msgr2=0x7fb81015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81015cbd0 0x7fb81015d020 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb8080098e0 tx=0x7fb8080091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 -- 172.21.15.79:0/3689687430 shutdown_connections 2023-10-14T18:52:07.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81015cbd0 0x7fb81015d020 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 --2- 172.21.15.79:0/3689687430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb8100cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 -- 172.21.15.79:0/3689687430 >> 172.21.15.79:0/3689687430 conn(0x7fb810067660 msgr2=0x7fb810067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 -- 172.21.15.79:0/3689687430 shutdown_connections 2023-10-14T18:52:07.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.383+0000 7fb816955700 1 -- 172.21.15.79:0/3689687430 wait complete. 2023-10-14T18:52:07.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 Processor -- start 2023-10-14T18:52:07.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 -- start start 2023-10-14T18:52:07.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb81014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 0x7fb8100b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81015bd80 con 0x7fb81015cbd0 2023-10-14T18:52:07.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c9cf0 con 0x7fb8100cdab0 2023-10-14T18:52:07.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.384+0000 7fb816955700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100c8c30 con 0x7fb8100cd6e0 2023-10-14T18:52:07.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55482/0 (socket says 172.21.15.79:55482) 2023-10-14T18:52:07.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 -- 172.21.15.79:0/2050051883 learned_addr learned my addr 172.21.15.79:0/2050051883 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:07.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb815152700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 0x7fb8100b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb815953700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb81014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 -- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 msgr2=0x7fb81014c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb81014c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 -- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 msgr2=0x7fb8100b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 0x7fb8100b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 -- 172.21.15.79:0/2050051883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c009a20 con 0x7fb81015cbd0 2023-10-14T18:52:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb815152700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 0x7fb8100b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb815953700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb81014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816154700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb8080030c0 tx=0x7fb808016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80801ce70 con 0x7fb81015cbd0 2023-10-14T18:52:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80801a450 con 0x7fb81015cbd0 2023-10-14T18:52:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb808009420 con 0x7fb81015cbd0 2023-10-14T18:52:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80801a810 con 0x7fb81015cbd0 2023-10-14T18:52:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.385+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100c9720 con 0x7fb81015cbd0 2023-10-14T18:52:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.386+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8100c9aa0 con 0x7fb81015cbd0 2023-10-14T18:52:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.387+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb80801ac00 con 0x7fb81015cbd0 2023-10-14T18:52:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.387+0000 7fb805ffb700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 0x7fb7f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.387+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb808086150 con 0x7fb81015cbd0 2023-10-14T18:52:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.387+0000 7fb815953700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 0x7fb7f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.388+0000 7fb815953700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 0x7fb7f40693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009fd0 tx=0x7fb80c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.391+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8080533c0 con 0x7fb81015cbd0 2023-10-14T18:52:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.575+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb81015e570 con 0x7fb81015cbd0 2023-10-14T18:52:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.575+0000 7fb805ffb700 1 -- 172.21.15.79:0/2050051883 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fb8080569e0 con 0x7fb81015cbd0 2023-10-14T18:52:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:07.578 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":154,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:52:04.837255+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:52:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 msgr2=0x7fb7f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 0x7fb7f40693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009fd0 tx=0x7fb80c00b040 comp rx=0 tx=0).stop 2023-10-14T18:52:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 msgr2=0x7fb8100ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb8080030c0 tx=0x7fb808016000 comp rx=0 tx=0).stop 2023-10-14T18:52:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 shutdown_connections 2023-10-14T18:52:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb7f4066f30 0x7fb7f40693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb81015cbd0 0x7fb8100ca180 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb8100cd6e0 0x7fb81014c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 --2- 172.21.15.79:0/2050051883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8100cdab0 0x7fb8100b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.577+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 >> 172.21.15.79:0/2050051883 conn(0x7fb810067660 msgr2=0x7fb8101565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.578+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 shutdown_connections 2023-10-14T18:52:07.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.578+0000 7fb816955700 1 -- 172.21.15.79:0/2050051883 wait complete. 2023-10-14T18:52:07.591 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:52:07.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:52:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.705+0000 7f5b13411700 1 Processor -- start 2023-10-14T18:52:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.705+0000 7f5b13411700 1 -- start start 2023-10-14T18:52:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b13411700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b0c156200 0x7f5b0c0c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b13411700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5b0c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b13411700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0cab80 con 0x7f5b0c1565d0 2023-10-14T18:52:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b13411700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c2a70 con 0x7f5b0c156200 2023-10-14T18:52:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b13411700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c2d50 con 0x7f5b0c0c7850 2023-10-14T18:52:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b109ac700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b0c1565d0 0x7f5b0c0c7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52864/0 (socket says 172.21.15.79:52864) 2023-10-14T18:52:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b109ac700 1 -- 172.21.15.79:0/2176469855 learned_addr learned my addr 172.21.15.79:0/2176469855 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b119ae700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5b0c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.706+0000 7f5b111ad700 1 --2- 172.21.15.79:0/2176469855 >> v2:172.21.15.144:3300/0 conn(0x7f5b0c156200 0x7f5b0c0c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127726162 0 0) 0x7f5b0c0cab80 con 0x7f5b0c1565d0 2023-10-14T18:52:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af8003570 con 0x7f5b0c1565d0 2023-10-14T18:52:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 540372982 0 0) 0x7f5af8003570 con 0x7f5b0c1565d0 2023-10-14T18:52:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 msgr2=0x7f5b0c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5b0c0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 >> v2:172.21.15.144:3300/0 conn(0x7f5b0c156200 msgr2=0x7f5b0c0c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 --2- 172.21.15.79:0/2176469855 >> v2:172.21.15.144:3300/0 conn(0x7f5b0c156200 0x7f5b0c0c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0c3030 con 0x7f5b0c1565d0 2023-10-14T18:52:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f5afc001470 con 0x7f5b0c1565d0 2023-10-14T18:52:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 >> v1:172.21.15.79:6789/0 conn(0x7f5b0c1565d0 legacy=0x7f5b0c0c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8003a60 0x7f5af8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5af8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af8004d50 0x7f5af80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c2a70 con 0x7f5af8004d50 2023-10-14T18:52:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c2d50 con 0x7f5af8003a60 2023-10-14T18:52:07.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af800dc70 con 0x7f5b0c0c7850 2023-10-14T18:52:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af8004d50 0x7f5af80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b109ac700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5af8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b111ad700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8003a60 0x7f5af8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 -- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 msgr2=0x7f5af8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0c7850 0x7f5af8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 -- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8003a60 msgr2=0x7f5af8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8003a60 0x7f5af8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 -- 172.21.15.79:0/2176469855 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8003570 con 0x7f5af8004d50 2023-10-14T18:52:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.707+0000 7f5b119ae700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af8004d50 0x7f5af80051c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009c30 tx=0x7f5b040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e72f8d702ae375 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400e710 con 0x7f5af8004d50 2023-10-14T18:52:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400e870 con 0x7f5af8004d50 2023-10-14T18:52:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b03fff700 1 -- 172.21.15.79:0/2176469855 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400ec30 con 0x7f5af8004d50 2023-10-14T18:52:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 -- 172.21.15.79:0/2176469855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af8004d50 msgr2=0x7f5af80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 --2- 172.21.15.79:0/2176469855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5af8004d50 0x7f5af80051c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009c30 tx=0x7f5b040091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b119ae700 1 -- 172.21.15.79:0/2176469855 reap_dead start 2023-10-14T18:52:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 -- 172.21.15.79:0/2176469855 shutdown_connections 2023-10-14T18:52:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 -- 172.21.15.79:0/2176469855 >> 172.21.15.79:0/2176469855 conn(0x7f5b0c068130 msgr2=0x7f5b0c0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 -- 172.21.15.79:0/2176469855 shutdown_connections 2023-10-14T18:52:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.708+0000 7f5b13411700 1 -- 172.21.15.79:0/2176469855 wait complete. 2023-10-14T18:52:07.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.709+0000 7f5b13411700 1 Processor -- start 2023-10-14T18:52:07.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.709+0000 7f5b13411700 1 -- start start 2023-10-14T18:52:07.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 0x7f5b0c165740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 0x7f5b0c0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0b24d0 con 0x7f5b0c155590 2023-10-14T18:52:07.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c157ef0 con 0x7f5af8004d50 2023-10-14T18:52:07.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b13411700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c165d70 con 0x7f5b0c0b1b20 2023-10-14T18:52:07.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b109ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b109ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55508/0 (socket says 172.21.15.79:55508) 2023-10-14T18:52:07.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b109ac700 1 -- 172.21.15.79:0/1919163287 learned_addr learned my addr 172.21.15.79:0/1919163287 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:07.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.710+0000 7f5b111ad700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 0x7f5b0c165740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b119ae700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 0x7f5b0c0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 -- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 msgr2=0x7f5b0c0b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 0x7f5b0c0b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 -- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 msgr2=0x7f5b0c165740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 0x7f5b0c165740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 -- 172.21.15.79:0/1919163287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c166050 con 0x7f5b0c155590 2023-10-14T18:52:07.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b111ad700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 0x7f5b0c165740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:07.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b119ae700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 0x7f5b0c0b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:07.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b109ac700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007fc0 tx=0x7f5afc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0077f0 con 0x7f5b0c155590 2023-10-14T18:52:07.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc00f8d0 con 0x7f5b0c155590 2023-10-14T18:52:07.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c166330 con 0x7f5b0c155590 2023-10-14T18:52:07.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00fa80 con 0x7f5b0c155590 2023-10-14T18:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.711+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c166610 con 0x7f5b0c155590 2023-10-14T18:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.712+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c1580a0 con 0x7f5b0c155590 2023-10-14T18:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.712+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5afc01a020 con 0x7f5b0c155590 2023-10-14T18:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.713+0000 7f5b017fa700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 0x7f5af0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:07.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.713+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5afc0883b0 con 0x7f5b0c155590 2023-10-14T18:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.713+0000 7f5b111ad700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 0x7f5af0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.713+0000 7f5b111ad700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 0x7f5af0069460 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5b080094d0 tx=0x7f5b0800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:07.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.717+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b0c1580a0 con 0x7f5b0c155590 2023-10-14T18:52:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.898+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b0c158060 con 0x7f5af0066fb0 2023-10-14T18:52:07.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.907+0000 7f5b017fa700 1 -- 172.21.15.79:0/1919163287 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285730 (secure 0 0 0) 0x7f5b0c158060 con 0x7f5af0066fb0 2023-10-14T18:52:07.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 msgr2=0x7f5af0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 0x7f5af0069460 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5b080094d0 tx=0x7f5b0800b040 comp rx=0 tx=0).stop 2023-10-14T18:52:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 msgr2=0x7f5b0c146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5afc007fc0 tx=0x7f5afc001e90 comp rx=0 tx=0).stop 2023-10-14T18:52:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 shutdown_connections 2023-10-14T18:52:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5af0066fb0 0x7f5af0069460 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5b0c0b1b20 0x7f5b0c0b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5af8004d50 0x7f5b0c165740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 --2- 172.21.15.79:0/1919163287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b0c155590 0x7f5b0c146ae0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 >> 172.21.15.79:0/1919163287 conn(0x7f5b0c068130 msgr2=0x7f5b0c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 shutdown_connections 2023-10-14T18:52:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:07.910+0000 7f5b13411700 1 -- 172.21.15.79:0/1919163287 wait complete. 2023-10-14T18:52:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:52:07.923 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2023-10-14T18:52:06.434465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554754,"statfs":{"total":1600000000,"available":1592068110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605852"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853954+0000","last_change":"2023-10-14T18:52:03.853954+0000","last_active":"2023-10-14T18:52:03.853954+0000","last_peered":"2023-10-14T18:52:03.853954+0000","last_clean":"2023-10-14T18:52:03.853954+0000","last_became_active":"2023-10-14T18:52:03.853308+0000","last_became_peered":"2023-10-14T18:52:03.853308+0000","last_unstale":"2023-10-14T18:52:03.853954+0000","last_undegraded":"2023-10-14T18:52:03.853954+0000","last_fullsized":"2023-10-14T18:52:03.853954+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:12.749882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852915+0000","last_change":"2023-10-14T18:52:03.852915+0000","last_active":"2023-10-14T18:52:03.852915+0000","last_peered":"2023-10-14T18:52:03.852915+0000","last_clean":"2023-10-14T18:52:03.852915+0000","last_became_active":"2023-10-14T18:52:03.852682+0000","last_became_peered":"2023-10-14T18:52:03.852682+0000","last_unstale":"2023-10-14T18:52:03.852915+0000","last_undegraded":"2023-10-14T18:52:03.852915+0000","last_fullsized":"2023-10-14T18:52:03.852915+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:33.474556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853991+0000","last_change":"2023-10-14T18:52:03.853991+0000","last_active":"2023-10-14T18:52:03.853991+0000","last_peered":"2023-10-14T18:52:03.853991+0000","last_clean":"2023-10-14T18:52:03.853991+0000","last_became_active":"2023-10-14T18:52:03.853649+0000","last_became_peered":"2023-10-14T18:52:03.853649+0000","last_unstale":"2023-10-14T18:52:03.853991+0000","last_undegraded":"2023-10-14T18:52:03.853991+0000","last_fullsized":"2023-10-14T18:52:03.853991+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845482+0000","last_change":"2023-10-14T18:52:03.845482+0000","last_active":"2023-10-14T18:52:03.845482+0000","last_peered":"2023-10-14T18:52:03.845482+0000","last_clean":"2023-10-14T18:52:03.845482+0000","last_became_active":"2023-10-14T18:52:03.844841+0000","last_became_peered":"2023-10-14T18:52:03.844841+0000","last_unstale":"2023-10-14T18:52:03.845482+0000","last_undegraded":"2023-10-14T18:52:03.845482+0000","last_fullsized":"2023-10-14T18:52:03.845482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:43.946946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847734+0000","last_change":"2023-10-14T18:52:03.847734+0000","last_active":"2023-10-14T18:52:03.847734+0000","last_peered":"2023-10-14T18:52:03.847734+0000","last_clean":"2023-10-14T18:52:03.847734+0000","last_became_active":"2023-10-14T18:52:03.847496+0000","last_became_peered":"2023-10-14T18:52:03.847496+0000","last_unstale":"2023-10-14T18:52:03.847734+0000","last_undegraded":"2023-10-14T18:52:03.847734+0000","last_fullsized":"2023-10-14T18:52:03.847734+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856399+0000","last_change":"2023-10-14T18:52:03.856399+0000","last_active":"2023-10-14T18:52:03.856399+0000","last_peered":"2023-10-14T18:52:03.856399+0000","last_clean":"2023-10-14T18:52:03.856399+0000","last_became_active":"2023-10-14T18:52:03.855995+0000","last_became_peered":"2023-10-14T18:52:03.855995+0000","last_unstale":"2023-10-14T18:52:03.856399+0000","last_undegraded":"2023-10-14T18:52:03.856399+0000","last_fullsized":"2023-10-14T18:52:03.856399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859692+0000","last_change":"2023-10-14T18:52:03.859692+0000","last_active":"2023-10-14T18:52:03.859692+0000","last_peered":"2023-10-14T18:52:03.859692+0000","last_clean":"2023-10-14T18:52:03.859692+0000","last_became_active":"2023-10-14T18:52:03.859271+0000","last_became_peered":"2023-10-14T18:52:03.859271+0000","last_unstale":"2023-10-14T18:52:03.859692+0000","last_undegraded":"2023-10-14T18:52:03.859692+0000","last_fullsized":"2023-10-14T18:52:03.859692+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.854898+0000","last_change":"2023-10-14T18:52:03.854898+0000","last_active":"2023-10-14T18:52:03.854898+0000","last_peered":"2023-10-14T18:52:03.854898+0000","last_clean":"2023-10-14T18:52:03.854898+0000","last_became_active":"2023-10-14T18:52:03.854159+0000","last_became_peered":"2023-10-14T18:52:03.854159+0000","last_unstale":"2023-10-14T18:52:03.854898+0000","last_undegraded":"2023-10-14T18:52:03.854898+0000","last_fullsized":"2023-10-14T18:52:03.854898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852485+0000","last_change":"2023-10-14T18:52:03.852485+0000","last_active":"2023-10-14T18:52:03.852485+0000","last_peered":"2023-10-14T18:52:03.852485+0000","last_clean":"2023-10-14T18:52:03.852485+0000","last_became_active":"2023-10-14T18:52:03.850433+0000","last_became_peered":"2023-10-14T18:52:03.850433+0000","last_unstale":"2023-10-14T18:52:03.852485+0000","last_undegraded":"2023-10-14T18:52:03.852485+0000","last_fullsized":"2023-10-14T18:52:03.852485+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:13.832225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852953+0000","last_change":"2023-10-14T18:52:03.852953+0000","last_active":"2023-10-14T18:52:03.852953+0000","last_peered":"2023-10-14T18:52:03.852953+0000","last_clean":"2023-10-14T18:52:03.852953+0000","last_became_active":"2023-10-14T18:52:03.852720+0000","last_became_peered":"2023-10-14T18:52:03.852720+0000","last_unstale":"2023-10-14T18:52:03.852953+0000","last_undegraded":"2023-10-14T18:52:03.852953+0000","last_fullsized":"2023-10-14T18:52:03.852953+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:13.832225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845202+0000","last_change":"2023-10-14T18:52:03.845202+0000","last_active":"2023-10-14T18:52:03.845202+0000","last_peered":"2023-10-14T18:52:03.845202+0000","last_clean":"2023-10-14T18:52:03.845202+0000","last_became_active":"2023-10-14T18:52:03.844984+0000","last_became_peered":"2023-10-14T18:52:03.844984+0000","last_unstale":"2023-10-14T18:52:03.845202+0000","last_undegraded":"2023-10-14T18:52:03.845202+0000","last_fullsized":"2023-10-14T18:52:03.845202+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:33.160287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855759+0000","last_change":"2023-10-14T18:52:03.855759+0000","last_active":"2023-10-14T18:52:03.855759+0000","last_peered":"2023-10-14T18:52:03.855759+0000","last_clean":"2023-10-14T18:52:03.855759+0000","last_became_active":"2023-10-14T18:52:03.855371+0000","last_became_peered":"2023-10-14T18:52:03.855371+0000","last_unstale":"2023-10-14T18:52:03.855759+0000","last_undegraded":"2023-10-14T18:52:03.855759+0000","last_fullsized":"2023-10-14T18:52:03.855759+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:43:21.256035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853804+0000","last_change":"2023-10-14T18:52:03.853804+0000","last_active":"2023-10-14T18:52:03.853804+0000","last_peered":"2023-10-14T18:52:03.853804+0000","last_clean":"2023-10-14T18:52:03.853804+0000","last_became_active":"2023-10-14T18:52:03.853556+0000","last_became_peered":"2023-10-14T18:52:03.853556+0000","last_unstale":"2023-10-14T18:52:03.853804+0000","last_undegraded":"2023-10-14T18:52:03.853804+0000","last_fullsized":"2023-10-14T18:52:03.853804+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:07:13.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.843645+0000","last_change":"2023-10-14T18:52:03.843645+0000","last_active":"2023-10-14T18:52:03.843645+0000","last_peered":"2023-10-14T18:52:03.843645+0000","last_clean":"2023-10-14T18:52:03.843645+0000","last_became_active":"2023-10-14T18:52:03.843416+0000","last_became_peered":"2023-10-14T18:52:03.843416+0000","last_unstale":"2023-10-14T18:52:03.843645+0000","last_undegraded":"2023-10-14T18:52:03.843645+0000","last_fullsized":"2023-10-14T18:52:03.843645+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:06.937537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857629+0000","last_change":"2023-10-14T18:52:03.857629+0000","last_active":"2023-10-14T18:52:03.857629+0000","last_peered":"2023-10-14T18:52:03.857629+0000","last_clean":"2023-10-14T18:52:03.857629+0000","last_became_active":"2023-10-14T18:52:03.857213+0000","last_became_peered":"2023-10-14T18:52:03.857213+0000","last_unstale":"2023-10-14T18:52:03.857629+0000","last_undegraded":"2023-10-14T18:52:03.857629+0000","last_fullsized":"2023-10-14T18:52:03.857629+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:12:09.722145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848260+0000","last_change":"2023-10-14T18:52:03.848260+0000","last_active":"2023-10-14T18:52:03.848260+0000","last_peered":"2023-10-14T18:52:03.848260+0000","last_clean":"2023-10-14T18:52:03.848260+0000","last_became_active":"2023-10-14T18:52:03.847515+0000","last_became_peered":"2023-10-14T18:52:03.847515+0000","last_unstale":"2023-10-14T18:52:03.848260+0000","last_undegraded":"2023-10-14T18:52:03.848260+0000","last_fullsized":"2023-10-14T18:52:03.848260+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851504+0000","last_change":"2023-10-14T18:52:03.851504+0000","last_active":"2023-10-14T18:52:03.851504+0000","last_peered":"2023-10-14T18:52:03.851504+0000","last_clean":"2023-10-14T18:52:03.851504+0000","last_became_active":"2023-10-14T18:52:03.851114+0000","last_became_peered":"2023-10-14T18:52:03.851114+0000","last_unstale":"2023-10-14T18:52:03.851504+0000","last_undegraded":"2023-10-14T18:52:03.851504+0000","last_fullsized":"2023-10-14T18:52:03.851504+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851136+0000","last_change":"2023-10-14T18:52:03.851136+0000","last_active":"2023-10-14T18:52:03.851136+0000","last_peered":"2023-10-14T18:52:03.851136+0000","last_clean":"2023-10-14T18:52:03.851136+0000","last_became_active":"2023-10-14T18:52:03.850800+0000","last_became_peered":"2023-10-14T18:52:03.850800+0000","last_unstale":"2023-10-14T18:52:03.851136+0000","last_undegraded":"2023-10-14T18:52:03.851136+0000","last_fullsized":"2023-10-14T18:52:03.851136+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:34.553090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847643+0000","last_change":"2023-10-14T18:52:03.847643+0000","last_active":"2023-10-14T18:52:03.847643+0000","last_peered":"2023-10-14T18:52:03.847643+0000","last_clean":"2023-10-14T18:52:03.847643+0000","last_became_active":"2023-10-14T18:52:03.847162+0000","last_became_peered":"2023-10-14T18:52:03.847162+0000","last_unstale":"2023-10-14T18:52:03.847643+0000","last_undegraded":"2023-10-14T18:52:03.847643+0000","last_fullsized":"2023-10-14T18:52:03.847643+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:29.308664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844545+0000","last_change":"2023-10-14T18:52:03.844545+0000","last_active":"2023-10-14T18:52:03.844545+0000","last_peered":"2023-10-14T18:52:03.844545+0000","last_clean":"2023-10-14T18:52:03.844545+0000","last_became_active":"2023-10-14T18:52:03.844327+0000","last_became_peered":"2023-10-14T18:52:03.844327+0000","last_unstale":"2023-10-14T18:52:03.844545+0000","last_undegraded":"2023-10-14T18:52:03.844545+0000","last_fullsized":"2023-10-14T18:52:03.844545+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861051+0000","last_change":"2023-10-14T18:52:03.861051+0000","last_active":"2023-10-14T18:52:03.861051+0000","last_peered":"2023-10-14T18:52:03.861051+0000","last_clean":"2023-10-14T18:52:03.861051+0000","last_became_active":"2023-10-14T18:52:03.860791+0000","last_became_peered":"2023-10-14T18:52:03.860791+0000","last_unstale":"2023-10-14T18:52:03.861051+0000","last_undegraded":"2023-10-14T18:52:03.861051+0000","last_fullsized":"2023-10-14T18:52:03.861051+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:33.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844254+0000","last_change":"2023-10-14T18:52:03.844254+0000","last_active":"2023-10-14T18:52:03.844254+0000","last_peered":"2023-10-14T18:52:03.844254+0000","last_clean":"2023-10-14T18:52:03.844254+0000","last_became_active":"2023-10-14T18:52:03.843997+0000","last_became_peered":"2023-10-14T18:52:03.843997+0000","last_unstale":"2023-10-14T18:52:03.844254+0000","last_undegraded":"2023-10-14T18:52:03.844254+0000","last_fullsized":"2023-10-14T18:52:03.844254+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:25:36.029658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859045+0000","last_change":"2023-10-14T18:52:03.859045+0000","last_active":"2023-10-14T18:52:03.859045+0000","last_peered":"2023-10-14T18:52:03.859045+0000","last_clean":"2023-10-14T18:52:03.859045+0000","last_became_active":"2023-10-14T18:52:03.858815+0000","last_became_peered":"2023-10-14T18:52:03.858815+0000","last_unstale":"2023-10-14T18:52:03.859045+0000","last_undegraded":"2023-10-14T18:52:03.859045+0000","last_fullsized":"2023-10-14T18:52:03.859045+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847837+0000","last_change":"2023-10-14T18:52:03.847837+0000","last_active":"2023-10-14T18:52:03.847837+0000","last_peered":"2023-10-14T18:52:03.847837+0000","last_clean":"2023-10-14T18:52:03.847837+0000","last_became_active":"2023-10-14T18:52:03.847421+0000","last_became_peered":"2023-10-14T18:52:03.847421+0000","last_unstale":"2023-10-14T18:52:03.847837+0000","last_undegraded":"2023-10-14T18:52:03.847837+0000","last_fullsized":"2023-10-14T18:52:03.847837+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:03.751038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847765+0000","last_change":"2023-10-14T18:52:03.847765+0000","last_active":"2023-10-14T18:52:03.847765+0000","last_peered":"2023-10-14T18:52:03.847765+0000","last_clean":"2023-10-14T18:52:03.847765+0000","last_became_active":"2023-10-14T18:52:03.846235+0000","last_became_peered":"2023-10-14T18:52:03.846235+0000","last_unstale":"2023-10-14T18:52:03.847765+0000","last_undegraded":"2023-10-14T18:52:03.847765+0000","last_fullsized":"2023-10-14T18:52:03.847765+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848397+0000","last_change":"2023-10-14T18:52:03.848397+0000","last_active":"2023-10-14T18:52:03.848397+0000","last_peered":"2023-10-14T18:52:03.848397+0000","last_clean":"2023-10-14T18:52:03.848397+0000","last_became_active":"2023-10-14T18:52:03.848045+0000","last_became_peered":"2023-10-14T18:52:03.848045+0000","last_unstale":"2023-10-14T18:52:03.848397+0000","last_undegraded":"2023-10-14T18:52:03.848397+0000","last_fullsized":"2023-10-14T18:52:03.848397+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853654+0000","last_change":"2023-10-14T18:52:03.853654+0000","last_active":"2023-10-14T18:52:03.853654+0000","last_peered":"2023-10-14T18:52:03.853654+0000","last_clean":"2023-10-14T18:52:03.853654+0000","last_became_active":"2023-10-14T18:52:03.853387+0000","last_became_peered":"2023-10-14T18:52:03.853387+0000","last_unstale":"2023-10-14T18:52:03.853654+0000","last_undegraded":"2023-10-14T18:52:03.853654+0000","last_fullsized":"2023-10-14T18:52:03.853654+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:17.782964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857579+0000","last_change":"2023-10-14T18:52:03.857579+0000","last_active":"2023-10-14T18:52:03.857579+0000","last_peered":"2023-10-14T18:52:03.857579+0000","last_clean":"2023-10-14T18:52:03.857579+0000","last_became_active":"2023-10-14T18:52:03.857045+0000","last_became_peered":"2023-10-14T18:52:03.857045+0000","last_unstale":"2023-10-14T18:52:03.857579+0000","last_undegraded":"2023-10-14T18:52:03.857579+0000","last_fullsized":"2023-10-14T18:52:03.857579+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:29.848456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.854338+0000","last_change":"2023-10-14T18:52:03.854338+0000","last_active":"2023-10-14T18:52:03.854338+0000","last_peered":"2023-10-14T18:52:03.854338+0000","last_clean":"2023-10-14T18:52:03.854338+0000","last_became_active":"2023-10-14T18:52:03.854180+0000","last_became_peered":"2023-10-14T18:52:03.854180+0000","last_unstale":"2023-10-14T18:52:03.854338+0000","last_undegraded":"2023-10-14T18:52:03.854338+0000","last_fullsized":"2023-10-14T18:52:03.854338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:06.280183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857501+0000","last_change":"2023-10-14T18:52:03.857501+0000","last_active":"2023-10-14T18:52:03.857501+0000","last_peered":"2023-10-14T18:52:03.857501+0000","last_clean":"2023-10-14T18:52:03.857501+0000","last_became_active":"2023-10-14T18:52:03.856939+0000","last_became_peered":"2023-10-14T18:52:03.856939+0000","last_unstale":"2023-10-14T18:52:03.857501+0000","last_undegraded":"2023-10-14T18:52:03.857501+0000","last_fullsized":"2023-10-14T18:52:03.857501+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:45.005475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848711+0000","last_change":"2023-10-14T18:52:03.848711+0000","last_active":"2023-10-14T18:52:03.848711+0000","last_peered":"2023-10-14T18:52:03.848711+0000","last_clean":"2023-10-14T18:52:03.848711+0000","last_became_active":"2023-10-14T18:52:03.846659+0000","last_became_peered":"2023-10-14T18:52:03.846659+0000","last_unstale":"2023-10-14T18:52:03.848711+0000","last_undegraded":"2023-10-14T18:52:03.848711+0000","last_fullsized":"2023-10-14T18:52:03.848711+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:27.696368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859504+0000","last_change":"2023-10-14T18:52:03.859504+0000","last_active":"2023-10-14T18:52:03.859504+0000","last_peered":"2023-10-14T18:52:03.859504+0000","last_clean":"2023-10-14T18:52:03.859504+0000","last_became_active":"2023-10-14T18:52:03.858332+0000","last_became_peered":"2023-10-14T18:52:03.858332+0000","last_unstale":"2023-10-14T18:52:03.859504+0000","last_undegraded":"2023-10-14T18:52:03.859504+0000","last_fullsized":"2023-10-14T18:52:03.859504+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847720+0000","last_change":"2023-10-14T18:52:03.847720+0000","last_active":"2023-10-14T18:52:03.847720+0000","last_peered":"2023-10-14T18:52:03.847720+0000","last_clean":"2023-10-14T18:52:03.847720+0000","last_became_active":"2023-10-14T18:52:03.847443+0000","last_became_peered":"2023-10-14T18:52:03.847443+0000","last_unstale":"2023-10-14T18:52:03.847720+0000","last_undegraded":"2023-10-14T18:52:03.847720+0000","last_fullsized":"2023-10-14T18:52:03.847720+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:53:49.060610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"153'4","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853538+0000","last_change":"2023-10-14T18:52:02.845662+0000","last_active":"2023-10-14T18:52:03.853538+0000","last_peered":"2023-10-14T18:52:03.853538+0000","last_clean":"2023-10-14T18:52:03.853538+0000","last_became_active":"2023-10-14T18:52:02.845275+0000","last_became_peered":"2023-10-14T18:52:02.845275+0000","last_unstale":"2023-10-14T18:52:03.853538+0000","last_undegraded":"2023-10-14T18:52:03.853538+0000","last_fullsized":"2023-10-14T18:52:03.853538+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:03.867584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853834+0000","last_change":"2023-10-14T18:52:03.853834+0000","last_active":"2023-10-14T18:52:03.853834+0000","last_peered":"2023-10-14T18:52:03.853834+0000","last_clean":"2023-10-14T18:52:03.853834+0000","last_became_active":"2023-10-14T18:52:03.853433+0000","last_became_peered":"2023-10-14T18:52:03.853433+0000","last_unstale":"2023-10-14T18:52:03.853834+0000","last_undegraded":"2023-10-14T18:52:03.853834+0000","last_fullsized":"2023-10-14T18:52:03.853834+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846359+0000","last_change":"2023-10-14T18:52:02.847083+0000","last_active":"2023-10-14T18:52:03.846359+0000","last_peered":"2023-10-14T18:52:03.846359+0000","last_clean":"2023-10-14T18:52:03.846359+0000","last_became_active":"2023-10-14T18:52:02.846831+0000","last_became_peered":"2023-10-14T18:52:02.846831+0000","last_unstale":"2023-10-14T18:52:03.846359+0000","last_undegraded":"2023-10-14T18:52:03.846359+0000","last_fullsized":"2023-10-14T18:52:03.846359+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:55.012886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852223+0000","last_change":"2023-10-14T18:52:03.852223+0000","last_active":"2023-10-14T18:52:03.852223+0000","last_peered":"2023-10-14T18:52:03.852223+0000","last_clean":"2023-10-14T18:52:03.852223+0000","last_became_active":"2023-10-14T18:52:03.851980+0000","last_became_peered":"2023-10-14T18:52:03.851980+0000","last_unstale":"2023-10-14T18:52:03.852223+0000","last_undegraded":"2023-10-14T18:52:03.852223+0000","last_fullsized":"2023-10-14T18:52:03.852223+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:56:23.871110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858172+0000","last_change":"2023-10-14T18:52:02.841895+0000","last_active":"2023-10-14T18:52:03.858172+0000","last_peered":"2023-10-14T18:52:03.858172+0000","last_clean":"2023-10-14T18:52:03.858172+0000","last_became_active":"2023-10-14T18:52:02.841673+0000","last_became_peered":"2023-10-14T18:52:02.841673+0000","last_unstale":"2023-10-14T18:52:03.858172+0000","last_undegraded":"2023-10-14T18:52:03.858172+0000","last_fullsized":"2023-10-14T18:52:03.858172+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:46:52.906004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845053+0000","last_change":"2023-10-14T18:52:03.845053+0000","last_active":"2023-10-14T18:52:03.845053+0000","last_peered":"2023-10-14T18:52:03.845053+0000","last_clean":"2023-10-14T18:52:03.845053+0000","last_became_active":"2023-10-14T18:52:03.844729+0000","last_became_peered":"2023-10-14T18:52:03.844729+0000","last_unstale":"2023-10-14T18:52:03.845053+0000","last_undegraded":"2023-10-14T18:52:03.845053+0000","last_fullsized":"2023-10-14T18:52:03.845053+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:15.317999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853640+0000","last_change":"2023-10-14T18:52:02.842722+0000","last_active":"2023-10-14T18:52:03.853640+0000","last_peered":"2023-10-14T18:52:03.853640+0000","last_clean":"2023-10-14T18:52:03.853640+0000","last_became_active":"2023-10-14T18:52:02.842289+0000","last_became_peered":"2023-10-14T18:52:02.842289+0000","last_unstale":"2023-10-14T18:52:03.853640+0000","last_undegraded":"2023-10-14T18:52:03.853640+0000","last_fullsized":"2023-10-14T18:52:03.853640+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:04.065567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851026+0000","last_change":"2023-10-14T18:52:03.851026+0000","last_active":"2023-10-14T18:52:03.851026+0000","last_peered":"2023-10-14T18:52:03.851026+0000","last_clean":"2023-10-14T18:52:03.851026+0000","last_became_active":"2023-10-14T18:52:03.850596+0000","last_became_peered":"2023-10-14T18:52:03.850596+0000","last_unstale":"2023-10-14T18:52:03.851026+0000","last_undegraded":"2023-10-14T18:52:03.851026+0000","last_fullsized":"2023-10-14T18:52:03.851026+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:38:30.678030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.841689+0000","last_change":"2023-10-14T18:52:02.843536+0000","last_active":"2023-10-14T18:52:03.841689+0000","last_peered":"2023-10-14T18:52:03.841689+0000","last_clean":"2023-10-14T18:52:03.841689+0000","last_became_active":"2023-10-14T18:52:02.843311+0000","last_became_peered":"2023-10-14T18:52:02.843311+0000","last_unstale":"2023-10-14T18:52:03.841689+0000","last_undegraded":"2023-10-14T18:52:03.841689+0000","last_fullsized":"2023-10-14T18:52:03.841689+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:56.426523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851351+0000","last_change":"2023-10-14T18:52:03.851351+0000","last_active":"2023-10-14T18:52:03.851351+0000","last_peered":"2023-10-14T18:52:03.851351+0000","last_clean":"2023-10-14T18:52:03.851351+0000","last_became_active":"2023-10-14T18:52:03.850805+0000","last_became_peered":"2023-10-14T18:52:03.850805+0000","last_unstale":"2023-10-14T18:52:03.851351+0000","last_undegraded":"2023-10-14T18:52:03.851351+0000","last_fullsized":"2023-10-14T18:52:03.851351+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:31.479353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.839804+0000","last_change":"2023-10-14T18:52:02.844326+0000","last_active":"2023-10-14T18:52:03.839804+0000","last_peered":"2023-10-14T18:52:03.839804+0000","last_clean":"2023-10-14T18:52:03.839804+0000","last_became_active":"2023-10-14T18:52:02.844116+0000","last_became_peered":"2023-10-14T18:52:02.844116+0000","last_unstale":"2023-10-14T18:52:03.839804+0000","last_undegraded":"2023-10-14T18:52:03.839804+0000","last_fullsized":"2023-10-14T18:52:03.839804+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:23.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856898+0000","last_change":"2023-10-14T18:52:03.856898+0000","last_active":"2023-10-14T18:52:03.856898+0000","last_peered":"2023-10-14T18:52:03.856898+0000","last_clean":"2023-10-14T18:52:03.856898+0000","last_became_active":"2023-10-14T18:52:03.856400+0000","last_became_peered":"2023-10-14T18:52:03.856400+0000","last_unstale":"2023-10-14T18:52:03.856898+0000","last_undegraded":"2023-10-14T18:52:03.856898+0000","last_fullsized":"2023-10-14T18:52:03.856898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846922+0000","last_change":"2023-10-14T18:52:02.846806+0000","last_active":"2023-10-14T18:52:02.846922+0000","last_peered":"2023-10-14T18:52:02.846922+0000","last_clean":"2023-10-14T18:52:02.846922+0000","last_became_active":"2023-10-14T18:52:02.846514+0000","last_became_peered":"2023-10-14T18:52:02.846514+0000","last_unstale":"2023-10-14T18:52:02.846922+0000","last_undegraded":"2023-10-14T18:52:02.846922+0000","last_fullsized":"2023-10-14T18:52:02.846922+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:28.841922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847374+0000","last_change":"2023-10-14T18:52:03.847374+0000","last_active":"2023-10-14T18:52:03.847374+0000","last_peered":"2023-10-14T18:52:03.847374+0000","last_clean":"2023-10-14T18:52:03.847374+0000","last_became_active":"2023-10-14T18:52:03.847140+0000","last_became_peered":"2023-10-14T18:52:03.847140+0000","last_unstale":"2023-10-14T18:52:03.847374+0000","last_undegraded":"2023-10-14T18:52:03.847374+0000","last_fullsized":"2023-10-14T18:52:03.847374+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:43:21.256035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850339+0000","last_change":"2023-10-14T18:52:02.850264+0000","last_active":"2023-10-14T18:52:02.850339+0000","last_peered":"2023-10-14T18:52:02.850339+0000","last_clean":"2023-10-14T18:52:02.850339+0000","last_became_active":"2023-10-14T18:52:02.850049+0000","last_became_peered":"2023-10-14T18:52:02.850049+0000","last_unstale":"2023-10-14T18:52:02.850339+0000","last_undegraded":"2023-10-14T18:52:02.850339+0000","last_fullsized":"2023-10-14T18:52:02.850339+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:52.838975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845105+0000","last_change":"2023-10-14T18:52:03.845105+0000","last_active":"2023-10-14T18:52:03.845105+0000","last_peered":"2023-10-14T18:52:03.845105+0000","last_clean":"2023-10-14T18:52:03.845105+0000","last_became_active":"2023-10-14T18:52:03.844899+0000","last_became_peered":"2023-10-14T18:52:03.844899+0000","last_unstale":"2023-10-14T18:52:03.845105+0000","last_undegraded":"2023-10-14T18:52:03.845105+0000","last_fullsized":"2023-10-14T18:52:03.845105+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:47.726021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.845112+0000","last_change":"2023-10-14T18:52:02.844427+0000","last_active":"2023-10-14T18:52:02.845112+0000","last_peered":"2023-10-14T18:52:02.845112+0000","last_clean":"2023-10-14T18:52:02.845112+0000","last_became_active":"2023-10-14T18:52:02.843953+0000","last_became_peered":"2023-10-14T18:52:02.843953+0000","last_unstale":"2023-10-14T18:52:02.845112+0000","last_undegraded":"2023-10-14T18:52:02.845112+0000","last_fullsized":"2023-10-14T18:52:02.845112+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:56.426523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857844+0000","last_change":"2023-10-14T18:52:03.857844+0000","last_active":"2023-10-14T18:52:03.857844+0000","last_peered":"2023-10-14T18:52:03.857844+0000","last_clean":"2023-10-14T18:52:03.857844+0000","last_became_active":"2023-10-14T18:52:03.857306+0000","last_became_peered":"2023-10-14T18:52:03.857306+0000","last_unstale":"2023-10-14T18:52:03.857844+0000","last_undegraded":"2023-10-14T18:52:03.857844+0000","last_fullsized":"2023-10-14T18:52:03.857844+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.835969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850463+0000","last_change":"2023-10-14T18:52:02.850220+0000","last_active":"2023-10-14T18:52:02.850463+0000","last_peered":"2023-10-14T18:52:02.850463+0000","last_clean":"2023-10-14T18:52:02.850463+0000","last_became_active":"2023-10-14T18:52:02.849984+0000","last_became_peered":"2023-10-14T18:52:02.849984+0000","last_unstale":"2023-10-14T18:52:02.850463+0000","last_undegraded":"2023-10-14T18:52:02.850463+0000","last_fullsized":"2023-10-14T18:52:02.850463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:06.829435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845838+0000","last_change":"2023-10-14T18:52:03.845838+0000","last_active":"2023-10-14T18:52:03.845838+0000","last_peered":"2023-10-14T18:52:03.845838+0000","last_clean":"2023-10-14T18:52:03.845838+0000","last_became_active":"2023-10-14T18:52:03.845631+0000","last_became_peered":"2023-10-14T18:52:03.845631+0000","last_unstale":"2023-10-14T18:52:03.845838+0000","last_undegraded":"2023-10-14T18:52:03.845838+0000","last_fullsized":"2023-10-14T18:52:03.845838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:54.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"153'3","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861758+0000","last_change":"2023-10-14T18:52:02.848288+0000","last_active":"2023-10-14T18:52:03.861758+0000","last_peered":"2023-10-14T18:52:03.861758+0000","last_clean":"2023-10-14T18:52:03.861758+0000","last_became_active":"2023-10-14T18:52:02.847893+0000","last_became_peered":"2023-10-14T18:52:02.847893+0000","last_unstale":"2023-10-14T18:52:03.861758+0000","last_undegraded":"2023-10-14T18:52:03.861758+0000","last_fullsized":"2023-10-14T18:52:03.861758+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:15.988574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.860356+0000","last_change":"2023-10-14T18:52:03.860356+0000","last_active":"2023-10-14T18:52:03.860356+0000","last_peered":"2023-10-14T18:52:03.860356+0000","last_clean":"2023-10-14T18:52:03.860356+0000","last_became_active":"2023-10-14T18:52:03.855098+0000","last_became_peered":"2023-10-14T18:52:03.855098+0000","last_unstale":"2023-10-14T18:52:03.860356+0000","last_undegraded":"2023-10-14T18:52:03.860356+0000","last_fullsized":"2023-10-14T18:52:03.860356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.346222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"153'6","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861786+0000","last_change":"2023-10-14T18:52:02.850599+0000","last_active":"2023-10-14T18:52:03.861786+0000","last_peered":"2023-10-14T18:52:03.861786+0000","last_clean":"2023-10-14T18:52:03.861786+0000","last_became_active":"2023-10-14T18:52:02.850305+0000","last_became_peered":"2023-10-14T18:52:02.850305+0000","last_unstale":"2023-10-14T18:52:03.861786+0000","last_undegraded":"2023-10-14T18:52:03.861786+0000","last_fullsized":"2023-10-14T18:52:03.861786+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:10.434280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.849311+0000","last_change":"2023-10-14T18:52:03.849311+0000","last_active":"2023-10-14T18:52:03.849311+0000","last_peered":"2023-10-14T18:52:03.849311+0000","last_clean":"2023-10-14T18:52:03.849311+0000","last_became_active":"2023-10-14T18:52:03.848338+0000","last_became_peered":"2023-10-14T18:52:03.848338+0000","last_unstale":"2023-10-14T18:52:03.849311+0000","last_undegraded":"2023-10-14T18:52:03.849311+0000","last_fullsized":"2023-10-14T18:52:03.849311+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:46.878358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846965+0000","last_change":"2023-10-14T18:52:02.846906+0000","last_active":"2023-10-14T18:52:02.846965+0000","last_peered":"2023-10-14T18:52:02.846965+0000","last_clean":"2023-10-14T18:52:02.846965+0000","last_became_active":"2023-10-14T18:52:02.846692+0000","last_became_peered":"2023-10-14T18:52:02.846692+0000","last_unstale":"2023-10-14T18:52:02.846965+0000","last_undegraded":"2023-10-14T18:52:02.846965+0000","last_fullsized":"2023-10-14T18:52:02.846965+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:59.646993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855182+0000","last_change":"2023-10-14T18:52:03.855182+0000","last_active":"2023-10-14T18:52:03.855182+0000","last_peered":"2023-10-14T18:52:03.855182+0000","last_clean":"2023-10-14T18:52:03.855182+0000","last_became_active":"2023-10-14T18:52:03.855036+0000","last_became_peered":"2023-10-14T18:52:03.855036+0000","last_unstale":"2023-10-14T18:52:03.855182+0000","last_undegraded":"2023-10-14T18:52:03.855182+0000","last_fullsized":"2023-10-14T18:52:03.855182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:04.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851722+0000","last_change":"2023-10-14T18:52:02.851661+0000","last_active":"2023-10-14T18:52:02.851722+0000","last_peered":"2023-10-14T18:52:02.851722+0000","last_clean":"2023-10-14T18:52:02.851722+0000","last_became_active":"2023-10-14T18:52:02.851454+0000","last_became_peered":"2023-10-14T18:52:02.851454+0000","last_unstale":"2023-10-14T18:52:02.851722+0000","last_undegraded":"2023-10-14T18:52:02.851722+0000","last_fullsized":"2023-10-14T18:52:02.851722+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:27.624836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855608+0000","last_change":"2023-10-14T18:52:03.855608+0000","last_active":"2023-10-14T18:52:03.855608+0000","last_peered":"2023-10-14T18:52:03.855608+0000","last_clean":"2023-10-14T18:52:03.855608+0000","last_became_active":"2023-10-14T18:52:03.855092+0000","last_became_peered":"2023-10-14T18:52:03.855092+0000","last_unstale":"2023-10-14T18:52:03.855608+0000","last_undegraded":"2023-10-14T18:52:03.855608+0000","last_fullsized":"2023-10-14T18:52:03.855608+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:06.937537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"153'8","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859863+0000","last_change":"2023-10-14T18:52:02.850524+0000","last_active":"2023-10-14T18:52:03.859863+0000","last_peered":"2023-10-14T18:52:03.859863+0000","last_clean":"2023-10-14T18:52:03.859863+0000","last_became_active":"2023-10-14T18:52:02.850291+0000","last_became_peered":"2023-10-14T18:52:02.850291+0000","last_unstale":"2023-10-14T18:52:03.859863+0000","last_undegraded":"2023-10-14T18:52:03.859863+0000","last_fullsized":"2023-10-14T18:52:03.859863+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:58.851397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856726+0000","last_change":"2023-10-14T18:52:03.856726+0000","last_active":"2023-10-14T18:52:03.856726+0000","last_peered":"2023-10-14T18:52:03.856726+0000","last_clean":"2023-10-14T18:52:03.856726+0000","last_became_active":"2023-10-14T18:52:03.856128+0000","last_became_peered":"2023-10-14T18:52:03.856128+0000","last_unstale":"2023-10-14T18:52:03.856726+0000","last_undegraded":"2023-10-14T18:52:03.856726+0000","last_fullsized":"2023-10-14T18:52:03.856726+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:33.474556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846457+0000","last_change":"2023-10-14T18:52:02.845587+0000","last_active":"2023-10-14T18:52:03.846457+0000","last_peered":"2023-10-14T18:52:03.846457+0000","last_clean":"2023-10-14T18:52:03.846457+0000","last_became_active":"2023-10-14T18:52:02.845344+0000","last_became_peered":"2023-10-14T18:52:02.845344+0000","last_unstale":"2023-10-14T18:52:03.846457+0000","last_undegraded":"2023-10-14T18:52:03.846457+0000","last_fullsized":"2023-10-14T18:52:03.846457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:45.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.850651+0000","last_change":"2023-10-14T18:52:03.850651+0000","last_active":"2023-10-14T18:52:03.850651+0000","last_peered":"2023-10-14T18:52:03.850651+0000","last_clean":"2023-10-14T18:52:03.850651+0000","last_became_active":"2023-10-14T18:52:03.850318+0000","last_became_peered":"2023-10-14T18:52:03.850318+0000","last_unstale":"2023-10-14T18:52:03.850651+0000","last_undegraded":"2023-10-14T18:52:03.850651+0000","last_fullsized":"2023-10-14T18:52:03.850651+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:59.857931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.860784+0000","last_change":"2023-10-14T18:52:02.849687+0000","last_active":"2023-10-14T18:52:03.860784+0000","last_peered":"2023-10-14T18:52:03.860784+0000","last_clean":"2023-10-14T18:52:03.860784+0000","last_became_active":"2023-10-14T18:52:02.849456+0000","last_became_peered":"2023-10-14T18:52:02.849456+0000","last_unstale":"2023-10-14T18:52:03.860784+0000","last_undegraded":"2023-10-14T18:52:03.860784+0000","last_fullsized":"2023-10-14T18:52:03.860784+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:07.382241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846821+0000","last_change":"2023-10-14T18:52:03.846821+0000","last_active":"2023-10-14T18:52:03.846821+0000","last_peered":"2023-10-14T18:52:03.846821+0000","last_clean":"2023-10-14T18:52:03.846821+0000","last_became_active":"2023-10-14T18:52:03.846592+0000","last_became_peered":"2023-10-14T18:52:03.846592+0000","last_unstale":"2023-10-14T18:52:03.846821+0000","last_undegraded":"2023-10-14T18:52:03.846821+0000","last_fullsized":"2023-10-14T18:52:03.846821+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:10:54.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844351+0000","last_change":"2023-10-14T18:52:02.845955+0000","last_active":"2023-10-14T18:52:03.844351+0000","last_peered":"2023-10-14T18:52:03.844351+0000","last_clean":"2023-10-14T18:52:03.844351+0000","last_became_active":"2023-10-14T18:52:02.845731+0000","last_became_peered":"2023-10-14T18:52:02.845731+0000","last_unstale":"2023-10-14T18:52:03.844351+0000","last_undegraded":"2023-10-14T18:52:03.844351+0000","last_fullsized":"2023-10-14T18:52:03.844351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:06.829435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844377+0000","last_change":"2023-10-14T18:52:03.844377+0000","last_active":"2023-10-14T18:52:03.844377+0000","last_peered":"2023-10-14T18:52:03.844377+0000","last_clean":"2023-10-14T18:52:03.844377+0000","last_became_active":"2023-10-14T18:52:03.844160+0000","last_became_peered":"2023-10-14T18:52:03.844160+0000","last_unstale":"2023-10-14T18:52:03.844377+0000","last_undegraded":"2023-10-14T18:52:03.844377+0000","last_fullsized":"2023-10-14T18:52:03.844377+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:31.479353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846835+0000","last_change":"2023-10-14T18:52:02.846700+0000","last_active":"2023-10-14T18:52:02.846835+0000","last_peered":"2023-10-14T18:52:02.846835+0000","last_clean":"2023-10-14T18:52:02.846835+0000","last_became_active":"2023-10-14T18:52:02.846474+0000","last_became_peered":"2023-10-14T18:52:02.846474+0000","last_unstale":"2023-10-14T18:52:02.846835+0000","last_undegraded":"2023-10-14T18:52:02.846835+0000","last_fullsized":"2023-10-14T18:52:02.846835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:27.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853541+0000","last_change":"2023-10-14T18:52:03.853541+0000","last_active":"2023-10-14T18:52:03.853541+0000","last_peered":"2023-10-14T18:52:03.853541+0000","last_clean":"2023-10-14T18:52:03.853541+0000","last_became_active":"2023-10-14T18:52:03.853246+0000","last_became_peered":"2023-10-14T18:52:03.853246+0000","last_unstale":"2023-10-14T18:52:03.853541+0000","last_undegraded":"2023-10-14T18:52:03.853541+0000","last_fullsized":"2023-10-14T18:52:03.853541+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:33.556808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861860+0000","last_change":"2023-10-14T18:52:02.848129+0000","last_active":"2023-10-14T18:52:03.861860+0000","last_peered":"2023-10-14T18:52:03.861860+0000","last_clean":"2023-10-14T18:52:03.861860+0000","last_became_active":"2023-10-14T18:52:02.847601+0000","last_became_peered":"2023-10-14T18:52:02.847601+0000","last_unstale":"2023-10-14T18:52:03.861860+0000","last_undegraded":"2023-10-14T18:52:03.861860+0000","last_fullsized":"2023-10-14T18:52:03.861860+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:37.116540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857756+0000","last_change":"2023-10-14T18:52:03.857756+0000","last_active":"2023-10-14T18:52:03.857756+0000","last_peered":"2023-10-14T18:52:03.857756+0000","last_clean":"2023-10-14T18:52:03.857756+0000","last_became_active":"2023-10-14T18:52:03.857542+0000","last_became_peered":"2023-10-14T18:52:03.857542+0000","last_unstale":"2023-10-14T18:52:03.857756+0000","last_undegraded":"2023-10-14T18:52:03.857756+0000","last_fullsized":"2023-10-14T18:52:03.857756+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:10:54.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850575+0000","last_change":"2023-10-14T18:52:02.850473+0000","last_active":"2023-10-14T18:52:02.850575+0000","last_peered":"2023-10-14T18:52:02.850575+0000","last_clean":"2023-10-14T18:52:02.850575+0000","last_became_active":"2023-10-14T18:52:02.850198+0000","last_became_peered":"2023-10-14T18:52:02.850198+0000","last_unstale":"2023-10-14T18:52:02.850575+0000","last_undegraded":"2023-10-14T18:52:02.850575+0000","last_fullsized":"2023-10-14T18:52:02.850575+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:24.136113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846689+0000","last_change":"2023-10-14T18:52:03.846689+0000","last_active":"2023-10-14T18:52:03.846689+0000","last_peered":"2023-10-14T18:52:03.846689+0000","last_clean":"2023-10-14T18:52:03.846689+0000","last_became_active":"2023-10-14T18:52:03.846267+0000","last_became_peered":"2023-10-14T18:52:03.846267+0000","last_unstale":"2023-10-14T18:52:03.846689+0000","last_undegraded":"2023-10-14T18:52:03.846689+0000","last_fullsized":"2023-10-14T18:52:03.846689+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:22.038993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846240+0000","last_change":"2023-10-14T18:52:02.846113+0000","last_active":"2023-10-14T18:52:02.846240+0000","last_peered":"2023-10-14T18:52:02.846240+0000","last_clean":"2023-10-14T18:52:02.846240+0000","last_became_active":"2023-10-14T18:52:02.845702+0000","last_became_peered":"2023-10-14T18:52:02.845702+0000","last_unstale":"2023-10-14T18:52:02.846240+0000","last_undegraded":"2023-10-14T18:52:02.846240+0000","last_fullsized":"2023-10-14T18:52:02.846240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:28.841922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851280+0000","last_change":"2023-10-14T18:52:03.851280+0000","last_active":"2023-10-14T18:52:03.851280+0000","last_peered":"2023-10-14T18:52:03.851280+0000","last_clean":"2023-10-14T18:52:03.851280+0000","last_became_active":"2023-10-14T18:52:03.851089+0000","last_became_peered":"2023-10-14T18:52:03.851089+0000","last_unstale":"2023-10-14T18:52:03.851280+0000","last_undegraded":"2023-10-14T18:52:03.851280+0000","last_fullsized":"2023-10-14T18:52:03.851280+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:56.106483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.849308+0000","last_change":"2023-10-14T18:52:02.849260+0000","last_active":"2023-10-14T18:52:02.849308+0000","last_peered":"2023-10-14T18:52:02.849308+0000","last_clean":"2023-10-14T18:52:02.849308+0000","last_became_active":"2023-10-14T18:52:02.849078+0000","last_became_peered":"2023-10-14T18:52:02.849078+0000","last_unstale":"2023-10-14T18:52:02.849308+0000","last_undegraded":"2023-10-14T18:52:02.849308+0000","last_fullsized":"2023-10-14T18:52:02.849308+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:20.250697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858765+0000","last_change":"2023-10-14T18:52:03.858765+0000","last_active":"2023-10-14T18:52:03.858765+0000","last_peered":"2023-10-14T18:52:03.858765+0000","last_clean":"2023-10-14T18:52:03.858765+0000","last_became_active":"2023-10-14T18:52:03.858545+0000","last_became_peered":"2023-10-14T18:52:03.858545+0000","last_unstale":"2023-10-14T18:52:03.858765+0000","last_undegraded":"2023-10-14T18:52:03.858765+0000","last_fullsized":"2023-10-14T18:52:03.858765+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:04.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858063+0000","last_change":"2023-10-14T18:52:02.845605+0000","last_active":"2023-10-14T18:52:03.858063+0000","last_peered":"2023-10-14T18:52:03.858063+0000","last_clean":"2023-10-14T18:52:03.858063+0000","last_became_active":"2023-10-14T18:52:02.844328+0000","last_became_peered":"2023-10-14T18:52:02.844328+0000","last_unstale":"2023-10-14T18:52:03.858063+0000","last_undegraded":"2023-10-14T18:52:03.858063+0000","last_fullsized":"2023-10-14T18:52:03.858063+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:50.184662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856272+0000","last_change":"2023-10-14T18:52:03.856272+0000","last_active":"2023-10-14T18:52:03.856272+0000","last_peered":"2023-10-14T18:52:03.856272+0000","last_clean":"2023-10-14T18:52:03.856272+0000","last_became_active":"2023-10-14T18:52:03.856091+0000","last_became_peered":"2023-10-14T18:52:03.856091+0000","last_unstale":"2023-10-14T18:52:03.856272+0000","last_undegraded":"2023-10-14T18:52:03.856272+0000","last_fullsized":"2023-10-14T18:52:03.856272+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:59.835574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.845715+0000","last_change":"2023-10-14T18:52:02.845493+0000","last_active":"2023-10-14T18:52:02.845715+0000","last_peered":"2023-10-14T18:52:02.845715+0000","last_clean":"2023-10-14T18:52:02.845715+0000","last_became_active":"2023-10-14T18:52:02.844945+0000","last_became_peered":"2023-10-14T18:52:02.844945+0000","last_unstale":"2023-10-14T18:52:02.845715+0000","last_undegraded":"2023-10-14T18:52:02.845715+0000","last_fullsized":"2023-10-14T18:52:02.845715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:18.152860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846582+0000","last_change":"2023-10-14T18:52:03.846582+0000","last_active":"2023-10-14T18:52:03.846582+0000","last_peered":"2023-10-14T18:52:03.846582+0000","last_clean":"2023-10-14T18:52:03.846582+0000","last_became_active":"2023-10-14T18:52:03.845922+0000","last_became_peered":"2023-10-14T18:52:03.845922+0000","last_unstale":"2023-10-14T18:52:03.846582+0000","last_undegraded":"2023-10-14T18:52:03.846582+0000","last_fullsized":"2023-10-14T18:52:03.846582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850197+0000","last_change":"2023-10-14T18:52:02.850137+0000","last_active":"2023-10-14T18:52:02.850197+0000","last_peered":"2023-10-14T18:52:02.850197+0000","last_clean":"2023-10-14T18:52:02.850197+0000","last_became_active":"2023-10-14T18:52:02.849922+0000","last_became_peered":"2023-10-14T18:52:02.849922+0000","last_unstale":"2023-10-14T18:52:02.850197+0000","last_undegraded":"2023-10-14T18:52:02.850197+0000","last_fullsized":"2023-10-14T18:52:02.850197+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:15.988574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853592+0000","last_change":"2023-10-14T18:52:03.853592+0000","last_active":"2023-10-14T18:52:03.853592+0000","last_peered":"2023-10-14T18:52:03.853592+0000","last_clean":"2023-10-14T18:52:03.853592+0000","last_became_active":"2023-10-14T18:52:03.853304+0000","last_became_peered":"2023-10-14T18:52:03.853304+0000","last_unstale":"2023-10-14T18:52:03.853592+0000","last_undegraded":"2023-10-14T18:52:03.853592+0000","last_fullsized":"2023-10-14T18:52:03.853592+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.847815+0000","last_change":"2023-10-14T18:52:02.847758+0000","last_active":"2023-10-14T18:52:02.847815+0000","last_peered":"2023-10-14T18:52:02.847815+0000","last_clean":"2023-10-14T18:52:02.847815+0000","last_became_active":"2023-10-14T18:52:02.847503+0000","last_became_peered":"2023-10-14T18:52:02.847503+0000","last_unstale":"2023-10-14T18:52:02.847815+0000","last_undegraded":"2023-10-14T18:52:02.847815+0000","last_fullsized":"2023-10-14T18:52:02.847815+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:02.268920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852317+0000","last_change":"2023-10-14T18:52:03.852317+0000","last_active":"2023-10-14T18:52:03.852317+0000","last_peered":"2023-10-14T18:52:03.852317+0000","last_clean":"2023-10-14T18:52:03.852317+0000","last_became_active":"2023-10-14T18:52:03.852058+0000","last_became_peered":"2023-10-14T18:52:03.852058+0000","last_unstale":"2023-10-14T18:52:03.852317+0000","last_undegraded":"2023-10-14T18:52:03.852317+0000","last_fullsized":"2023-10-14T18:52:03.852317+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:00.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851255+0000","last_change":"2023-10-14T18:52:02.851201+0000","last_active":"2023-10-14T18:52:02.851255+0000","last_peered":"2023-10-14T18:52:02.851255+0000","last_clean":"2023-10-14T18:52:02.851255+0000","last_became_active":"2023-10-14T18:52:02.850990+0000","last_became_peered":"2023-10-14T18:52:02.850990+0000","last_unstale":"2023-10-14T18:52:02.851255+0000","last_undegraded":"2023-10-14T18:52:02.851255+0000","last_fullsized":"2023-10-14T18:52:02.851255+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:55.012886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859410+0000","last_change":"2023-10-14T18:52:03.859410+0000","last_active":"2023-10-14T18:52:03.859410+0000","last_peered":"2023-10-14T18:52:03.859410+0000","last_clean":"2023-10-14T18:52:03.859410+0000","last_became_active":"2023-10-14T18:52:03.857624+0000","last_became_peered":"2023-10-14T18:52:03.857624+0000","last_unstale":"2023-10-14T18:52:03.859410+0000","last_undegraded":"2023-10-14T18:52:03.859410+0000","last_fullsized":"2023-10-14T18:52:03.859410+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:14.017155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.848596+0000","last_change":"2023-10-14T18:52:02.848525+0000","last_active":"2023-10-14T18:52:02.848596+0000","last_peered":"2023-10-14T18:52:02.848596+0000","last_clean":"2023-10-14T18:52:02.848596+0000","last_became_active":"2023-10-14T18:52:02.848368+0000","last_became_peered":"2023-10-14T18:52:02.848368+0000","last_unstale":"2023-10-14T18:52:02.848596+0000","last_undegraded":"2023-10-14T18:52:02.848596+0000","last_fullsized":"2023-10-14T18:52:02.848596+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:14.523719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853667+0000","last_change":"2023-10-14T18:52:03.853667+0000","last_active":"2023-10-14T18:52:03.853667+0000","last_peered":"2023-10-14T18:52:03.853667+0000","last_clean":"2023-10-14T18:52:03.853667+0000","last_became_active":"2023-10-14T18:52:03.853469+0000","last_became_peered":"2023-10-14T18:52:03.853469+0000","last_unstale":"2023-10-14T18:52:03.853667+0000","last_undegraded":"2023-10-14T18:52:03.853667+0000","last_fullsized":"2023-10-14T18:52:03.853667+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:44.845681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851139+0000","last_change":"2023-10-14T18:52:02.851089+0000","last_active":"2023-10-14T18:52:02.851139+0000","last_peered":"2023-10-14T18:52:02.851139+0000","last_clean":"2023-10-14T18:52:02.851139+0000","last_became_active":"2023-10-14T18:52:02.850701+0000","last_became_peered":"2023-10-14T18:52:02.850701+0000","last_unstale":"2023-10-14T18:52:02.851139+0000","last_undegraded":"2023-10-14T18:52:02.851139+0000","last_fullsized":"2023-10-14T18:52:02.851139+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:32.007220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846850+0000","last_change":"2023-10-14T18:52:03.846850+0000","last_active":"2023-10-14T18:52:03.846850+0000","last_peered":"2023-10-14T18:52:03.846850+0000","last_clean":"2023-10-14T18:52:03.846850+0000","last_became_active":"2023-10-14T18:52:03.846608+0000","last_became_peered":"2023-10-14T18:52:03.846608+0000","last_unstale":"2023-10-14T18:52:03.846850+0000","last_undegraded":"2023-10-14T18:52:03.846850+0000","last_fullsized":"2023-10-14T18:52:03.846850+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.847502+0000","last_change":"2023-10-14T18:52:02.847332+0000","last_active":"2023-10-14T18:52:02.847502+0000","last_peered":"2023-10-14T18:52:02.847502+0000","last_clean":"2023-10-14T18:52:02.847502+0000","last_became_active":"2023-10-14T18:52:02.846985+0000","last_became_peered":"2023-10-14T18:52:02.846985+0000","last_unstale":"2023-10-14T18:52:02.847502+0000","last_undegraded":"2023-10-14T18:52:02.847502+0000","last_fullsized":"2023-10-14T18:52:02.847502+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:35.656588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848915+0000","last_change":"2023-10-14T18:52:03.848915+0000","last_active":"2023-10-14T18:52:03.848915+0000","last_peered":"2023-10-14T18:52:03.848915+0000","last_clean":"2023-10-14T18:52:03.848915+0000","last_became_active":"2023-10-14T18:52:03.847043+0000","last_became_peered":"2023-10-14T18:52:03.847043+0000","last_unstale":"2023-10-14T18:52:03.848915+0000","last_undegraded":"2023-10-14T18:52:03.848915+0000","last_fullsized":"2023-10-14T18:52:03.848915+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:01:22.095682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853704+0000","last_change":"2023-10-14T18:52:02.845991+0000","last_active":"2023-10-14T18:52:03.853704+0000","last_peered":"2023-10-14T18:52:03.853704+0000","last_clean":"2023-10-14T18:52:03.853704+0000","last_became_active":"2023-10-14T18:52:02.845530+0000","last_became_peered":"2023-10-14T18:52:02.845530+0000","last_unstale":"2023-10-14T18:52:03.853704+0000","last_undegraded":"2023-10-14T18:52:03.853704+0000","last_fullsized":"2023-10-14T18:52:03.853704+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:22.748096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.839951+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:52:02.839951+0000","last_peered":"2023-10-14T18:52:02.839951+0000","last_clean":"2023-10-14T18:52:02.839951+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:52:02.839951+0000","last_undegraded":"2023-10-14T18:52:02.839951+0000","last_fullsized":"2023-10-14T18:52:02.839951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66600000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52200000000000002,"15min":0.626},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":3.8580000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68600000000000005,"5min":0.83999999999999997,"15min":7.8129999999999997},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.377,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.83899999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.501},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"max":{"1min":0.80500000000000005,"5min":0.877,"15min":0.95699999999999996},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199150496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.67500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.76100000000000001,"15min":0.76300000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.76000000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":3.4489999999999998},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.83599999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":9.5779999999999994},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.68300000000000005,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68300000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46300000000000002,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78600000000000003},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.78500000000000003,"15min":0.89700000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.40799999999999997,"5min":0.60799999999999998,"15min":1.0900000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.56399999999999995,"15min":0.90700000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.39200000000000002,"5min":0.60299999999999998,"15min":0.89100000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35599999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.46800000000000003,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.72099999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.44400000000000001,"5min":0.66000000000000003,"15min":10.574},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.93899999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.88200000000000001,"15min":0.96499999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.66200000000000003,"5min":0.85399999999999998,"15min":0.92200000000000004},"last":0.55800000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.90800000000000003,"15min":0.94699999999999995},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193915,"statfs":{"total":200000000,"available":198569438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.34699999999999998,"15min":0.33600000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.432,"5min":0.623,"15min":0.623},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.29599999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.46000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35699999999999998,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58199999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.01},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.879,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199151444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48299999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.49199999999999999,"5min":0.61499999999999999,"15min":0.67200000000000004},"last":0.34100000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.379,"15min":0.39200000000000002},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.54400000000000004,"5min":0.70199999999999996,"15min":0.78900000000000003},"last":0.28599999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.54900000000000004,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.311}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66300000000000003,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.624}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.77800000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.44400000000000001,"5min":0.50700000000000001,"15min":0.68100000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.33300000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.222,"15min":0.222},"max":{"1min":0.47999999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.379,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.60499999999999998,"15min":0.64600000000000002},"last":0.309}]},{"osd":2,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51300000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29599999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.495,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38300000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91200000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54200000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78300000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83099999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.496},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.999,"15min":0.999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194484,"statfs":{"total":200000000,"available":199151920,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.40500000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67300000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68100000000000005,"5min":0.748,"15min":0.748},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38500000000000001},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.5,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.76200000000000001,"15min":0.92800000000000005},"last":0.32400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.746},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42799999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:52:07.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:52:08.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.075+0000 7ff3f637c700 1 Processor -- start 2023-10-14T18:52:08.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.075+0000 7ff3f637c700 1 -- start start 2023-10-14T18:52:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f637c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f637c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00cb7c0 con 0x7ff3f015cbd0 2023-10-14T18:52:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f637c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f015e290 con 0x7ff3f00cdab0 2023-10-14T18:52:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f637c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015e850 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f5b7b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff3f015cbd0 0x7ff3f015d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52880/0 (socket says 172.21.15.79:52880) 2023-10-14T18:52:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f5b7b700 1 -- 172.21.15.79:0/2873874440 learned_addr learned my addr 172.21.15.79:0/2873874440 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:08.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f537a700 1 --2- 172.21.15.79:0/2873874440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103266356 0 0) 0x7ff3f00cb7c0 con 0x7ff3f015cbd0 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3dc003570 con 0x7ff3f015cbd0 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989882905 0 0) 0x7ff3f015e290 con 0x7ff3f00cdab0 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f00cb7c0 con 0x7ff3f00cdab0 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f537a700 1 -- 172.21.15.79:0/2873874440 >> v1:172.21.15.144:6789/0 conn(0x7ff3f00cdab0 legacy=0x7ff3f015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f537a700 1 -- 172.21.15.79:0/2873874440 >> v1:172.21.15.79:6789/0 conn(0x7ff3f015cbd0 legacy=0x7ff3f015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.076+0000 7ff3f537a700 1 -- 172.21.15.79:0/2873874440 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f015e570 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f537a700 1 --2- 172.21.15.79:0/2873874440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f00cbc50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009910 tx=0x7ff3e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c467cb49e59bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011630 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8011790 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3e7fff700 1 -- 172.21.15.79:0/2873874440 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8011b10 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 -- 172.21.15.79:0/2873874440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 msgr2=0x7ff3f00cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 --2- 172.21.15.79:0/2873874440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f00cbc50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009910 tx=0x7ff3e80091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 -- 172.21.15.79:0/2873874440 shutdown_connections 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 --2- 172.21.15.79:0/2873874440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f00cbc50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 -- 172.21.15.79:0/2873874440 >> 172.21.15.79:0/2873874440 conn(0x7ff3f0067660 msgr2=0x7ff3f0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 -- 172.21.15.79:0/2873874440 shutdown_connections 2023-10-14T18:52:08.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.077+0000 7ff3f637c700 1 -- 172.21.15.79:0/2873874440 wait complete. 2023-10-14T18:52:08.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.078+0000 7ff3f637c700 1 Processor -- start 2023-10-14T18:52:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 -- start start 2023-10-14T18:52:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3f015cbd0 0x7ff3f00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b4a90 con 0x7ff3f00cdab0 2023-10-14T18:52:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0153d90 con 0x7ff3f015cbd0 2023-10-14T18:52:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f637c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00b3f10 con 0x7ff3f00cd6e0 2023-10-14T18:52:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.079+0000 7ff3f4b79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55522/0 (socket says 172.21.15.79:55522) 2023-10-14T18:52:08.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 -- 172.21.15.79:0/1825770970 learned_addr learned my addr 172.21.15.79:0/1825770970 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f537a700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f5b7b700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3f015cbd0 0x7ff3f00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 -- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 msgr2=0x7ff3f0153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f0153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 -- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3f015cbd0 msgr2=0x7ff3f00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3f015cbd0 0x7ff3f00c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 -- 172.21.15.79:0/1825770970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009420 con 0x7ff3f00cdab0 2023-10-14T18:52:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f4b79700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c7f0 tx=0x7ff3e0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0010510 con 0x7ff3f00cdab0 2023-10-14T18:52:08.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e0010670 con 0x7ff3f00cdab0 2023-10-14T18:52:08.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0010a30 con 0x7ff3f00cdab0 2023-10-14T18:52:08.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f00b41f0 con 0x7ff3f00cdab0 2023-10-14T18:52:08.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.080+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00b47b0 con 0x7ff3f00cdab0 2023-10-14T18:52:08.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.081+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f0089280 con 0x7ff3f00cdab0 2023-10-14T18:52:08.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.081+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3e001b3b0 con 0x7ff3f00cdab0 2023-10-14T18:52:08.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.082+0000 7ff3e57fa700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 0x7ff3d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.082+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3e0083c40 con 0x7ff3f00cdab0 2023-10-14T18:52:08.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.082+0000 7ff3f537a700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 0x7ff3d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.082+0000 7ff3f537a700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 0x7ff3d4069410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009860 tx=0x7ff3e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.086+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e0050eb0 con 0x7ff3f00cdab0 2023-10-14T18:52:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.262+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3f00d0030 con 0x7ff3d4066f60 2023-10-14T18:52:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.270+0000 7ff3e57fa700 1 -- 172.21.15.79:0/1825770970 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285730 (secure 0 0 0) 0x7ff3f00d0030 con 0x7ff3d4066f60 2023-10-14T18:52:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:08.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 msgr2=0x7ff3d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 0x7ff3d4069410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009860 tx=0x7ff3e8017000 comp rx=0 tx=0).stop 2023-10-14T18:52:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 msgr2=0x7ff3f00b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000c7f0 tx=0x7ff3e0007dc0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 shutdown_connections 2023-10-14T18:52:08.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff3d4066f60 0x7ff3d4069410 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3f015cbd0 0x7ff3f00c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff3f00cd6e0 0x7ff3f0153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 --2- 172.21.15.79:0/1825770970 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f00cdab0 0x7ff3f00b5260 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 >> 172.21.15.79:0/1825770970 conn(0x7ff3f0067660 msgr2=0x7ff3f0156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 shutdown_connections 2023-10-14T18:52:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.273+0000 7ff3f637c700 1 -- 172.21.15.79:0/1825770970 wait complete. 2023-10-14T18:52:08.280 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:52:08.286 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2023-10-14T18:52:06.434465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7745,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554754,"statfs":{"total":1600000000,"available":1592068110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605852"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853954+0000","last_change":"2023-10-14T18:52:03.853954+0000","last_active":"2023-10-14T18:52:03.853954+0000","last_peered":"2023-10-14T18:52:03.853954+0000","last_clean":"2023-10-14T18:52:03.853954+0000","last_became_active":"2023-10-14T18:52:03.853308+0000","last_became_peered":"2023-10-14T18:52:03.853308+0000","last_unstale":"2023-10-14T18:52:03.853954+0000","last_undegraded":"2023-10-14T18:52:03.853954+0000","last_fullsized":"2023-10-14T18:52:03.853954+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:53:12.749882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852915+0000","last_change":"2023-10-14T18:52:03.852915+0000","last_active":"2023-10-14T18:52:03.852915+0000","last_peered":"2023-10-14T18:52:03.852915+0000","last_clean":"2023-10-14T18:52:03.852915+0000","last_became_active":"2023-10-14T18:52:03.852682+0000","last_became_peered":"2023-10-14T18:52:03.852682+0000","last_unstale":"2023-10-14T18:52:03.852915+0000","last_undegraded":"2023-10-14T18:52:03.852915+0000","last_fullsized":"2023-10-14T18:52:03.852915+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:33.474556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853991+0000","last_change":"2023-10-14T18:52:03.853991+0000","last_active":"2023-10-14T18:52:03.853991+0000","last_peered":"2023-10-14T18:52:03.853991+0000","last_clean":"2023-10-14T18:52:03.853991+0000","last_became_active":"2023-10-14T18:52:03.853649+0000","last_became_peered":"2023-10-14T18:52:03.853649+0000","last_unstale":"2023-10-14T18:52:03.853991+0000","last_undegraded":"2023-10-14T18:52:03.853991+0000","last_fullsized":"2023-10-14T18:52:03.853991+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845482+0000","last_change":"2023-10-14T18:52:03.845482+0000","last_active":"2023-10-14T18:52:03.845482+0000","last_peered":"2023-10-14T18:52:03.845482+0000","last_clean":"2023-10-14T18:52:03.845482+0000","last_became_active":"2023-10-14T18:52:03.844841+0000","last_became_peered":"2023-10-14T18:52:03.844841+0000","last_unstale":"2023-10-14T18:52:03.845482+0000","last_undegraded":"2023-10-14T18:52:03.845482+0000","last_fullsized":"2023-10-14T18:52:03.845482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:43.946946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847734+0000","last_change":"2023-10-14T18:52:03.847734+0000","last_active":"2023-10-14T18:52:03.847734+0000","last_peered":"2023-10-14T18:52:03.847734+0000","last_clean":"2023-10-14T18:52:03.847734+0000","last_became_active":"2023-10-14T18:52:03.847496+0000","last_became_peered":"2023-10-14T18:52:03.847496+0000","last_unstale":"2023-10-14T18:52:03.847734+0000","last_undegraded":"2023-10-14T18:52:03.847734+0000","last_fullsized":"2023-10-14T18:52:03.847734+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:56.850111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856399+0000","last_change":"2023-10-14T18:52:03.856399+0000","last_active":"2023-10-14T18:52:03.856399+0000","last_peered":"2023-10-14T18:52:03.856399+0000","last_clean":"2023-10-14T18:52:03.856399+0000","last_became_active":"2023-10-14T18:52:03.855995+0000","last_became_peered":"2023-10-14T18:52:03.855995+0000","last_unstale":"2023-10-14T18:52:03.856399+0000","last_undegraded":"2023-10-14T18:52:03.856399+0000","last_fullsized":"2023-10-14T18:52:03.856399+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859692+0000","last_change":"2023-10-14T18:52:03.859692+0000","last_active":"2023-10-14T18:52:03.859692+0000","last_peered":"2023-10-14T18:52:03.859692+0000","last_clean":"2023-10-14T18:52:03.859692+0000","last_became_active":"2023-10-14T18:52:03.859271+0000","last_became_peered":"2023-10-14T18:52:03.859271+0000","last_unstale":"2023-10-14T18:52:03.859692+0000","last_undegraded":"2023-10-14T18:52:03.859692+0000","last_fullsized":"2023-10-14T18:52:03.859692+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.854898+0000","last_change":"2023-10-14T18:52:03.854898+0000","last_active":"2023-10-14T18:52:03.854898+0000","last_peered":"2023-10-14T18:52:03.854898+0000","last_clean":"2023-10-14T18:52:03.854898+0000","last_became_active":"2023-10-14T18:52:03.854159+0000","last_became_peered":"2023-10-14T18:52:03.854159+0000","last_unstale":"2023-10-14T18:52:03.854898+0000","last_undegraded":"2023-10-14T18:52:03.854898+0000","last_fullsized":"2023-10-14T18:52:03.854898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852485+0000","last_change":"2023-10-14T18:52:03.852485+0000","last_active":"2023-10-14T18:52:03.852485+0000","last_peered":"2023-10-14T18:52:03.852485+0000","last_clean":"2023-10-14T18:52:03.852485+0000","last_became_active":"2023-10-14T18:52:03.850433+0000","last_became_peered":"2023-10-14T18:52:03.850433+0000","last_unstale":"2023-10-14T18:52:03.852485+0000","last_undegraded":"2023-10-14T18:52:03.852485+0000","last_fullsized":"2023-10-14T18:52:03.852485+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:13.832225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852953+0000","last_change":"2023-10-14T18:52:03.852953+0000","last_active":"2023-10-14T18:52:03.852953+0000","last_peered":"2023-10-14T18:52:03.852953+0000","last_clean":"2023-10-14T18:52:03.852953+0000","last_became_active":"2023-10-14T18:52:03.852720+0000","last_became_peered":"2023-10-14T18:52:03.852720+0000","last_unstale":"2023-10-14T18:52:03.852953+0000","last_undegraded":"2023-10-14T18:52:03.852953+0000","last_fullsized":"2023-10-14T18:52:03.852953+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:13.832225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845202+0000","last_change":"2023-10-14T18:52:03.845202+0000","last_active":"2023-10-14T18:52:03.845202+0000","last_peered":"2023-10-14T18:52:03.845202+0000","last_clean":"2023-10-14T18:52:03.845202+0000","last_became_active":"2023-10-14T18:52:03.844984+0000","last_became_peered":"2023-10-14T18:52:03.844984+0000","last_unstale":"2023-10-14T18:52:03.845202+0000","last_undegraded":"2023-10-14T18:52:03.845202+0000","last_fullsized":"2023-10-14T18:52:03.845202+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:33.160287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855759+0000","last_change":"2023-10-14T18:52:03.855759+0000","last_active":"2023-10-14T18:52:03.855759+0000","last_peered":"2023-10-14T18:52:03.855759+0000","last_clean":"2023-10-14T18:52:03.855759+0000","last_became_active":"2023-10-14T18:52:03.855371+0000","last_became_peered":"2023-10-14T18:52:03.855371+0000","last_unstale":"2023-10-14T18:52:03.855759+0000","last_undegraded":"2023-10-14T18:52:03.855759+0000","last_fullsized":"2023-10-14T18:52:03.855759+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:43:21.256035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853804+0000","last_change":"2023-10-14T18:52:03.853804+0000","last_active":"2023-10-14T18:52:03.853804+0000","last_peered":"2023-10-14T18:52:03.853804+0000","last_clean":"2023-10-14T18:52:03.853804+0000","last_became_active":"2023-10-14T18:52:03.853556+0000","last_became_peered":"2023-10-14T18:52:03.853556+0000","last_unstale":"2023-10-14T18:52:03.853804+0000","last_undegraded":"2023-10-14T18:52:03.853804+0000","last_fullsized":"2023-10-14T18:52:03.853804+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:07:13.050795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.843645+0000","last_change":"2023-10-14T18:52:03.843645+0000","last_active":"2023-10-14T18:52:03.843645+0000","last_peered":"2023-10-14T18:52:03.843645+0000","last_clean":"2023-10-14T18:52:03.843645+0000","last_became_active":"2023-10-14T18:52:03.843416+0000","last_became_peered":"2023-10-14T18:52:03.843416+0000","last_unstale":"2023-10-14T18:52:03.843645+0000","last_undegraded":"2023-10-14T18:52:03.843645+0000","last_fullsized":"2023-10-14T18:52:03.843645+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:06.937537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857629+0000","last_change":"2023-10-14T18:52:03.857629+0000","last_active":"2023-10-14T18:52:03.857629+0000","last_peered":"2023-10-14T18:52:03.857629+0000","last_clean":"2023-10-14T18:52:03.857629+0000","last_became_active":"2023-10-14T18:52:03.857213+0000","last_became_peered":"2023-10-14T18:52:03.857213+0000","last_unstale":"2023-10-14T18:52:03.857629+0000","last_undegraded":"2023-10-14T18:52:03.857629+0000","last_fullsized":"2023-10-14T18:52:03.857629+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:12:09.722145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848260+0000","last_change":"2023-10-14T18:52:03.848260+0000","last_active":"2023-10-14T18:52:03.848260+0000","last_peered":"2023-10-14T18:52:03.848260+0000","last_clean":"2023-10-14T18:52:03.848260+0000","last_became_active":"2023-10-14T18:52:03.847515+0000","last_became_peered":"2023-10-14T18:52:03.847515+0000","last_unstale":"2023-10-14T18:52:03.848260+0000","last_undegraded":"2023-10-14T18:52:03.848260+0000","last_fullsized":"2023-10-14T18:52:03.848260+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851504+0000","last_change":"2023-10-14T18:52:03.851504+0000","last_active":"2023-10-14T18:52:03.851504+0000","last_peered":"2023-10-14T18:52:03.851504+0000","last_clean":"2023-10-14T18:52:03.851504+0000","last_became_active":"2023-10-14T18:52:03.851114+0000","last_became_peered":"2023-10-14T18:52:03.851114+0000","last_unstale":"2023-10-14T18:52:03.851504+0000","last_undegraded":"2023-10-14T18:52:03.851504+0000","last_fullsized":"2023-10-14T18:52:03.851504+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851136+0000","last_change":"2023-10-14T18:52:03.851136+0000","last_active":"2023-10-14T18:52:03.851136+0000","last_peered":"2023-10-14T18:52:03.851136+0000","last_clean":"2023-10-14T18:52:03.851136+0000","last_became_active":"2023-10-14T18:52:03.850800+0000","last_became_peered":"2023-10-14T18:52:03.850800+0000","last_unstale":"2023-10-14T18:52:03.851136+0000","last_undegraded":"2023-10-14T18:52:03.851136+0000","last_fullsized":"2023-10-14T18:52:03.851136+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:07:34.553090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847643+0000","last_change":"2023-10-14T18:52:03.847643+0000","last_active":"2023-10-14T18:52:03.847643+0000","last_peered":"2023-10-14T18:52:03.847643+0000","last_clean":"2023-10-14T18:52:03.847643+0000","last_became_active":"2023-10-14T18:52:03.847162+0000","last_became_peered":"2023-10-14T18:52:03.847162+0000","last_unstale":"2023-10-14T18:52:03.847643+0000","last_undegraded":"2023-10-14T18:52:03.847643+0000","last_fullsized":"2023-10-14T18:52:03.847643+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:29.308664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844545+0000","last_change":"2023-10-14T18:52:03.844545+0000","last_active":"2023-10-14T18:52:03.844545+0000","last_peered":"2023-10-14T18:52:03.844545+0000","last_clean":"2023-10-14T18:52:03.844545+0000","last_became_active":"2023-10-14T18:52:03.844327+0000","last_became_peered":"2023-10-14T18:52:03.844327+0000","last_unstale":"2023-10-14T18:52:03.844545+0000","last_undegraded":"2023-10-14T18:52:03.844545+0000","last_fullsized":"2023-10-14T18:52:03.844545+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:52:41.361148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861051+0000","last_change":"2023-10-14T18:52:03.861051+0000","last_active":"2023-10-14T18:52:03.861051+0000","last_peered":"2023-10-14T18:52:03.861051+0000","last_clean":"2023-10-14T18:52:03.861051+0000","last_became_active":"2023-10-14T18:52:03.860791+0000","last_became_peered":"2023-10-14T18:52:03.860791+0000","last_unstale":"2023-10-14T18:52:03.861051+0000","last_undegraded":"2023-10-14T18:52:03.861051+0000","last_fullsized":"2023-10-14T18:52:03.861051+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:04:33.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844254+0000","last_change":"2023-10-14T18:52:03.844254+0000","last_active":"2023-10-14T18:52:03.844254+0000","last_peered":"2023-10-14T18:52:03.844254+0000","last_clean":"2023-10-14T18:52:03.844254+0000","last_became_active":"2023-10-14T18:52:03.843997+0000","last_became_peered":"2023-10-14T18:52:03.843997+0000","last_unstale":"2023-10-14T18:52:03.844254+0000","last_undegraded":"2023-10-14T18:52:03.844254+0000","last_fullsized":"2023-10-14T18:52:03.844254+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:25:36.029658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859045+0000","last_change":"2023-10-14T18:52:03.859045+0000","last_active":"2023-10-14T18:52:03.859045+0000","last_peered":"2023-10-14T18:52:03.859045+0000","last_clean":"2023-10-14T18:52:03.859045+0000","last_became_active":"2023-10-14T18:52:03.858815+0000","last_became_peered":"2023-10-14T18:52:03.858815+0000","last_unstale":"2023-10-14T18:52:03.859045+0000","last_undegraded":"2023-10-14T18:52:03.859045+0000","last_fullsized":"2023-10-14T18:52:03.859045+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847837+0000","last_change":"2023-10-14T18:52:03.847837+0000","last_active":"2023-10-14T18:52:03.847837+0000","last_peered":"2023-10-14T18:52:03.847837+0000","last_clean":"2023-10-14T18:52:03.847837+0000","last_became_active":"2023-10-14T18:52:03.847421+0000","last_became_peered":"2023-10-14T18:52:03.847421+0000","last_unstale":"2023-10-14T18:52:03.847837+0000","last_undegraded":"2023-10-14T18:52:03.847837+0000","last_fullsized":"2023-10-14T18:52:03.847837+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:05:03.751038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847765+0000","last_change":"2023-10-14T18:52:03.847765+0000","last_active":"2023-10-14T18:52:03.847765+0000","last_peered":"2023-10-14T18:52:03.847765+0000","last_clean":"2023-10-14T18:52:03.847765+0000","last_became_active":"2023-10-14T18:52:03.846235+0000","last_became_peered":"2023-10-14T18:52:03.846235+0000","last_unstale":"2023-10-14T18:52:03.847765+0000","last_undegraded":"2023-10-14T18:52:03.847765+0000","last_fullsized":"2023-10-14T18:52:03.847765+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848397+0000","last_change":"2023-10-14T18:52:03.848397+0000","last_active":"2023-10-14T18:52:03.848397+0000","last_peered":"2023-10-14T18:52:03.848397+0000","last_clean":"2023-10-14T18:52:03.848397+0000","last_became_active":"2023-10-14T18:52:03.848045+0000","last_became_peered":"2023-10-14T18:52:03.848045+0000","last_unstale":"2023-10-14T18:52:03.848397+0000","last_undegraded":"2023-10-14T18:52:03.848397+0000","last_fullsized":"2023-10-14T18:52:03.848397+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853654+0000","last_change":"2023-10-14T18:52:03.853654+0000","last_active":"2023-10-14T18:52:03.853654+0000","last_peered":"2023-10-14T18:52:03.853654+0000","last_clean":"2023-10-14T18:52:03.853654+0000","last_became_active":"2023-10-14T18:52:03.853387+0000","last_became_peered":"2023-10-14T18:52:03.853387+0000","last_unstale":"2023-10-14T18:52:03.853654+0000","last_undegraded":"2023-10-14T18:52:03.853654+0000","last_fullsized":"2023-10-14T18:52:03.853654+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:51:17.782964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857579+0000","last_change":"2023-10-14T18:52:03.857579+0000","last_active":"2023-10-14T18:52:03.857579+0000","last_peered":"2023-10-14T18:52:03.857579+0000","last_clean":"2023-10-14T18:52:03.857579+0000","last_became_active":"2023-10-14T18:52:03.857045+0000","last_became_peered":"2023-10-14T18:52:03.857045+0000","last_unstale":"2023-10-14T18:52:03.857579+0000","last_undegraded":"2023-10-14T18:52:03.857579+0000","last_fullsized":"2023-10-14T18:52:03.857579+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:29.848456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.854338+0000","last_change":"2023-10-14T18:52:03.854338+0000","last_active":"2023-10-14T18:52:03.854338+0000","last_peered":"2023-10-14T18:52:03.854338+0000","last_clean":"2023-10-14T18:52:03.854338+0000","last_became_active":"2023-10-14T18:52:03.854180+0000","last_became_peered":"2023-10-14T18:52:03.854180+0000","last_unstale":"2023-10-14T18:52:03.854338+0000","last_undegraded":"2023-10-14T18:52:03.854338+0000","last_fullsized":"2023-10-14T18:52:03.854338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:51:06.280183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857501+0000","last_change":"2023-10-14T18:52:03.857501+0000","last_active":"2023-10-14T18:52:03.857501+0000","last_peered":"2023-10-14T18:52:03.857501+0000","last_clean":"2023-10-14T18:52:03.857501+0000","last_became_active":"2023-10-14T18:52:03.856939+0000","last_became_peered":"2023-10-14T18:52:03.856939+0000","last_unstale":"2023-10-14T18:52:03.857501+0000","last_undegraded":"2023-10-14T18:52:03.857501+0000","last_fullsized":"2023-10-14T18:52:03.857501+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:45.005475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848711+0000","last_change":"2023-10-14T18:52:03.848711+0000","last_active":"2023-10-14T18:52:03.848711+0000","last_peered":"2023-10-14T18:52:03.848711+0000","last_clean":"2023-10-14T18:52:03.848711+0000","last_became_active":"2023-10-14T18:52:03.846659+0000","last_became_peered":"2023-10-14T18:52:03.846659+0000","last_unstale":"2023-10-14T18:52:03.848711+0000","last_undegraded":"2023-10-14T18:52:03.848711+0000","last_fullsized":"2023-10-14T18:52:03.848711+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:36:27.696368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859504+0000","last_change":"2023-10-14T18:52:03.859504+0000","last_active":"2023-10-14T18:52:03.859504+0000","last_peered":"2023-10-14T18:52:03.859504+0000","last_clean":"2023-10-14T18:52:03.859504+0000","last_became_active":"2023-10-14T18:52:03.858332+0000","last_became_peered":"2023-10-14T18:52:03.858332+0000","last_unstale":"2023-10-14T18:52:03.859504+0000","last_undegraded":"2023-10-14T18:52:03.859504+0000","last_fullsized":"2023-10-14T18:52:03.859504+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:04.874118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847720+0000","last_change":"2023-10-14T18:52:03.847720+0000","last_active":"2023-10-14T18:52:03.847720+0000","last_peered":"2023-10-14T18:52:03.847720+0000","last_clean":"2023-10-14T18:52:03.847720+0000","last_became_active":"2023-10-14T18:52:03.847443+0000","last_became_peered":"2023-10-14T18:52:03.847443+0000","last_unstale":"2023-10-14T18:52:03.847720+0000","last_undegraded":"2023-10-14T18:52:03.847720+0000","last_fullsized":"2023-10-14T18:52:03.847720+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:53:49.060610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"153'4","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853538+0000","last_change":"2023-10-14T18:52:02.845662+0000","last_active":"2023-10-14T18:52:03.853538+0000","last_peered":"2023-10-14T18:52:03.853538+0000","last_clean":"2023-10-14T18:52:03.853538+0000","last_became_active":"2023-10-14T18:52:02.845275+0000","last_became_peered":"2023-10-14T18:52:02.845275+0000","last_unstale":"2023-10-14T18:52:03.853538+0000","last_undegraded":"2023-10-14T18:52:03.853538+0000","last_fullsized":"2023-10-14T18:52:03.853538+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:03.867584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853834+0000","last_change":"2023-10-14T18:52:03.853834+0000","last_active":"2023-10-14T18:52:03.853834+0000","last_peered":"2023-10-14T18:52:03.853834+0000","last_clean":"2023-10-14T18:52:03.853834+0000","last_became_active":"2023-10-14T18:52:03.853433+0000","last_became_peered":"2023-10-14T18:52:03.853433+0000","last_unstale":"2023-10-14T18:52:03.853834+0000","last_undegraded":"2023-10-14T18:52:03.853834+0000","last_fullsized":"2023-10-14T18:52:03.853834+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846359+0000","last_change":"2023-10-14T18:52:02.847083+0000","last_active":"2023-10-14T18:52:03.846359+0000","last_peered":"2023-10-14T18:52:03.846359+0000","last_clean":"2023-10-14T18:52:03.846359+0000","last_became_active":"2023-10-14T18:52:02.846831+0000","last_became_peered":"2023-10-14T18:52:02.846831+0000","last_unstale":"2023-10-14T18:52:03.846359+0000","last_undegraded":"2023-10-14T18:52:03.846359+0000","last_fullsized":"2023-10-14T18:52:03.846359+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:55.012886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852223+0000","last_change":"2023-10-14T18:52:03.852223+0000","last_active":"2023-10-14T18:52:03.852223+0000","last_peered":"2023-10-14T18:52:03.852223+0000","last_clean":"2023-10-14T18:52:03.852223+0000","last_became_active":"2023-10-14T18:52:03.851980+0000","last_became_peered":"2023-10-14T18:52:03.851980+0000","last_unstale":"2023-10-14T18:52:03.852223+0000","last_undegraded":"2023-10-14T18:52:03.852223+0000","last_fullsized":"2023-10-14T18:52:03.852223+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:56:23.871110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858172+0000","last_change":"2023-10-14T18:52:02.841895+0000","last_active":"2023-10-14T18:52:03.858172+0000","last_peered":"2023-10-14T18:52:03.858172+0000","last_clean":"2023-10-14T18:52:03.858172+0000","last_became_active":"2023-10-14T18:52:02.841673+0000","last_became_peered":"2023-10-14T18:52:02.841673+0000","last_unstale":"2023-10-14T18:52:03.858172+0000","last_undegraded":"2023-10-14T18:52:03.858172+0000","last_fullsized":"2023-10-14T18:52:03.858172+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:46:52.906004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845053+0000","last_change":"2023-10-14T18:52:03.845053+0000","last_active":"2023-10-14T18:52:03.845053+0000","last_peered":"2023-10-14T18:52:03.845053+0000","last_clean":"2023-10-14T18:52:03.845053+0000","last_became_active":"2023-10-14T18:52:03.844729+0000","last_became_peered":"2023-10-14T18:52:03.844729+0000","last_unstale":"2023-10-14T18:52:03.845053+0000","last_undegraded":"2023-10-14T18:52:03.845053+0000","last_fullsized":"2023-10-14T18:52:03.845053+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:15:15.317999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853640+0000","last_change":"2023-10-14T18:52:02.842722+0000","last_active":"2023-10-14T18:52:03.853640+0000","last_peered":"2023-10-14T18:52:03.853640+0000","last_clean":"2023-10-14T18:52:03.853640+0000","last_became_active":"2023-10-14T18:52:02.842289+0000","last_became_peered":"2023-10-14T18:52:02.842289+0000","last_unstale":"2023-10-14T18:52:03.853640+0000","last_undegraded":"2023-10-14T18:52:03.853640+0000","last_fullsized":"2023-10-14T18:52:03.853640+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:04.065567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851026+0000","last_change":"2023-10-14T18:52:03.851026+0000","last_active":"2023-10-14T18:52:03.851026+0000","last_peered":"2023-10-14T18:52:03.851026+0000","last_clean":"2023-10-14T18:52:03.851026+0000","last_became_active":"2023-10-14T18:52:03.850596+0000","last_became_peered":"2023-10-14T18:52:03.850596+0000","last_unstale":"2023-10-14T18:52:03.851026+0000","last_undegraded":"2023-10-14T18:52:03.851026+0000","last_fullsized":"2023-10-14T18:52:03.851026+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:38:30.678030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.841689+0000","last_change":"2023-10-14T18:52:02.843536+0000","last_active":"2023-10-14T18:52:03.841689+0000","last_peered":"2023-10-14T18:52:03.841689+0000","last_clean":"2023-10-14T18:52:03.841689+0000","last_became_active":"2023-10-14T18:52:02.843311+0000","last_became_peered":"2023-10-14T18:52:02.843311+0000","last_unstale":"2023-10-14T18:52:03.841689+0000","last_undegraded":"2023-10-14T18:52:03.841689+0000","last_fullsized":"2023-10-14T18:52:03.841689+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:56.426523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851351+0000","last_change":"2023-10-14T18:52:03.851351+0000","last_active":"2023-10-14T18:52:03.851351+0000","last_peered":"2023-10-14T18:52:03.851351+0000","last_clean":"2023-10-14T18:52:03.851351+0000","last_became_active":"2023-10-14T18:52:03.850805+0000","last_became_peered":"2023-10-14T18:52:03.850805+0000","last_unstale":"2023-10-14T18:52:03.851351+0000","last_undegraded":"2023-10-14T18:52:03.851351+0000","last_fullsized":"2023-10-14T18:52:03.851351+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:31.479353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.839804+0000","last_change":"2023-10-14T18:52:02.844326+0000","last_active":"2023-10-14T18:52:03.839804+0000","last_peered":"2023-10-14T18:52:03.839804+0000","last_clean":"2023-10-14T18:52:03.839804+0000","last_became_active":"2023-10-14T18:52:02.844116+0000","last_became_peered":"2023-10-14T18:52:02.844116+0000","last_unstale":"2023-10-14T18:52:03.839804+0000","last_undegraded":"2023-10-14T18:52:03.839804+0000","last_fullsized":"2023-10-14T18:52:03.839804+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:23.199916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856898+0000","last_change":"2023-10-14T18:52:03.856898+0000","last_active":"2023-10-14T18:52:03.856898+0000","last_peered":"2023-10-14T18:52:03.856898+0000","last_clean":"2023-10-14T18:52:03.856898+0000","last_became_active":"2023-10-14T18:52:03.856400+0000","last_became_peered":"2023-10-14T18:52:03.856400+0000","last_unstale":"2023-10-14T18:52:03.856898+0000","last_undegraded":"2023-10-14T18:52:03.856898+0000","last_fullsized":"2023-10-14T18:52:03.856898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:19.159393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846922+0000","last_change":"2023-10-14T18:52:02.846806+0000","last_active":"2023-10-14T18:52:02.846922+0000","last_peered":"2023-10-14T18:52:02.846922+0000","last_clean":"2023-10-14T18:52:02.846922+0000","last_became_active":"2023-10-14T18:52:02.846514+0000","last_became_peered":"2023-10-14T18:52:02.846514+0000","last_unstale":"2023-10-14T18:52:02.846922+0000","last_undegraded":"2023-10-14T18:52:02.846922+0000","last_fullsized":"2023-10-14T18:52:02.846922+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:28.841922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.847374+0000","last_change":"2023-10-14T18:52:03.847374+0000","last_active":"2023-10-14T18:52:03.847374+0000","last_peered":"2023-10-14T18:52:03.847374+0000","last_clean":"2023-10-14T18:52:03.847374+0000","last_became_active":"2023-10-14T18:52:03.847140+0000","last_became_peered":"2023-10-14T18:52:03.847140+0000","last_unstale":"2023-10-14T18:52:03.847374+0000","last_undegraded":"2023-10-14T18:52:03.847374+0000","last_fullsized":"2023-10-14T18:52:03.847374+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:43:21.256035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850339+0000","last_change":"2023-10-14T18:52:02.850264+0000","last_active":"2023-10-14T18:52:02.850339+0000","last_peered":"2023-10-14T18:52:02.850339+0000","last_clean":"2023-10-14T18:52:02.850339+0000","last_became_active":"2023-10-14T18:52:02.850049+0000","last_became_peered":"2023-10-14T18:52:02.850049+0000","last_unstale":"2023-10-14T18:52:02.850339+0000","last_undegraded":"2023-10-14T18:52:02.850339+0000","last_fullsized":"2023-10-14T18:52:02.850339+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:42:52.838975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845105+0000","last_change":"2023-10-14T18:52:03.845105+0000","last_active":"2023-10-14T18:52:03.845105+0000","last_peered":"2023-10-14T18:52:03.845105+0000","last_clean":"2023-10-14T18:52:03.845105+0000","last_became_active":"2023-10-14T18:52:03.844899+0000","last_became_peered":"2023-10-14T18:52:03.844899+0000","last_unstale":"2023-10-14T18:52:03.845105+0000","last_undegraded":"2023-10-14T18:52:03.845105+0000","last_fullsized":"2023-10-14T18:52:03.845105+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:49:47.726021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.845112+0000","last_change":"2023-10-14T18:52:02.844427+0000","last_active":"2023-10-14T18:52:02.845112+0000","last_peered":"2023-10-14T18:52:02.845112+0000","last_clean":"2023-10-14T18:52:02.845112+0000","last_became_active":"2023-10-14T18:52:02.843953+0000","last_became_peered":"2023-10-14T18:52:02.843953+0000","last_unstale":"2023-10-14T18:52:02.845112+0000","last_undegraded":"2023-10-14T18:52:02.845112+0000","last_fullsized":"2023-10-14T18:52:02.845112+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:34:56.426523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857844+0000","last_change":"2023-10-14T18:52:03.857844+0000","last_active":"2023-10-14T18:52:03.857844+0000","last_peered":"2023-10-14T18:52:03.857844+0000","last_clean":"2023-10-14T18:52:03.857844+0000","last_became_active":"2023-10-14T18:52:03.857306+0000","last_became_peered":"2023-10-14T18:52:03.857306+0000","last_unstale":"2023-10-14T18:52:03.857844+0000","last_undegraded":"2023-10-14T18:52:03.857844+0000","last_fullsized":"2023-10-14T18:52:03.857844+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:07.835969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850463+0000","last_change":"2023-10-14T18:52:02.850220+0000","last_active":"2023-10-14T18:52:02.850463+0000","last_peered":"2023-10-14T18:52:02.850463+0000","last_clean":"2023-10-14T18:52:02.850463+0000","last_became_active":"2023-10-14T18:52:02.849984+0000","last_became_peered":"2023-10-14T18:52:02.849984+0000","last_unstale":"2023-10-14T18:52:02.850463+0000","last_undegraded":"2023-10-14T18:52:02.850463+0000","last_fullsized":"2023-10-14T18:52:02.850463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:06.829435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.845838+0000","last_change":"2023-10-14T18:52:03.845838+0000","last_active":"2023-10-14T18:52:03.845838+0000","last_peered":"2023-10-14T18:52:03.845838+0000","last_clean":"2023-10-14T18:52:03.845838+0000","last_became_active":"2023-10-14T18:52:03.845631+0000","last_became_peered":"2023-10-14T18:52:03.845631+0000","last_unstale":"2023-10-14T18:52:03.845838+0000","last_undegraded":"2023-10-14T18:52:03.845838+0000","last_fullsized":"2023-10-14T18:52:03.845838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:46:54.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"153'3","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861758+0000","last_change":"2023-10-14T18:52:02.848288+0000","last_active":"2023-10-14T18:52:03.861758+0000","last_peered":"2023-10-14T18:52:03.861758+0000","last_clean":"2023-10-14T18:52:03.861758+0000","last_became_active":"2023-10-14T18:52:02.847893+0000","last_became_peered":"2023-10-14T18:52:02.847893+0000","last_unstale":"2023-10-14T18:52:03.861758+0000","last_undegraded":"2023-10-14T18:52:03.861758+0000","last_fullsized":"2023-10-14T18:52:03.861758+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:15.988574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.860356+0000","last_change":"2023-10-14T18:52:03.860356+0000","last_active":"2023-10-14T18:52:03.860356+0000","last_peered":"2023-10-14T18:52:03.860356+0000","last_clean":"2023-10-14T18:52:03.860356+0000","last_became_active":"2023-10-14T18:52:03.855098+0000","last_became_peered":"2023-10-14T18:52:03.855098+0000","last_unstale":"2023-10-14T18:52:03.860356+0000","last_undegraded":"2023-10-14T18:52:03.860356+0000","last_fullsized":"2023-10-14T18:52:03.860356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.346222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"153'6","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861786+0000","last_change":"2023-10-14T18:52:02.850599+0000","last_active":"2023-10-14T18:52:03.861786+0000","last_peered":"2023-10-14T18:52:03.861786+0000","last_clean":"2023-10-14T18:52:03.861786+0000","last_became_active":"2023-10-14T18:52:02.850305+0000","last_became_peered":"2023-10-14T18:52:02.850305+0000","last_unstale":"2023-10-14T18:52:03.861786+0000","last_undegraded":"2023-10-14T18:52:03.861786+0000","last_fullsized":"2023-10-14T18:52:03.861786+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:10.434280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.849311+0000","last_change":"2023-10-14T18:52:03.849311+0000","last_active":"2023-10-14T18:52:03.849311+0000","last_peered":"2023-10-14T18:52:03.849311+0000","last_clean":"2023-10-14T18:52:03.849311+0000","last_became_active":"2023-10-14T18:52:03.848338+0000","last_became_peered":"2023-10-14T18:52:03.848338+0000","last_unstale":"2023-10-14T18:52:03.849311+0000","last_undegraded":"2023-10-14T18:52:03.849311+0000","last_fullsized":"2023-10-14T18:52:03.849311+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:46.878358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846965+0000","last_change":"2023-10-14T18:52:02.846906+0000","last_active":"2023-10-14T18:52:02.846965+0000","last_peered":"2023-10-14T18:52:02.846965+0000","last_clean":"2023-10-14T18:52:02.846965+0000","last_became_active":"2023-10-14T18:52:02.846692+0000","last_became_peered":"2023-10-14T18:52:02.846692+0000","last_unstale":"2023-10-14T18:52:02.846965+0000","last_undegraded":"2023-10-14T18:52:02.846965+0000","last_fullsized":"2023-10-14T18:52:02.846965+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:59.646993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855182+0000","last_change":"2023-10-14T18:52:03.855182+0000","last_active":"2023-10-14T18:52:03.855182+0000","last_peered":"2023-10-14T18:52:03.855182+0000","last_clean":"2023-10-14T18:52:03.855182+0000","last_became_active":"2023-10-14T18:52:03.855036+0000","last_became_peered":"2023-10-14T18:52:03.855036+0000","last_unstale":"2023-10-14T18:52:03.855182+0000","last_undegraded":"2023-10-14T18:52:03.855182+0000","last_fullsized":"2023-10-14T18:52:03.855182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:04.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851722+0000","last_change":"2023-10-14T18:52:02.851661+0000","last_active":"2023-10-14T18:52:02.851722+0000","last_peered":"2023-10-14T18:52:02.851722+0000","last_clean":"2023-10-14T18:52:02.851722+0000","last_became_active":"2023-10-14T18:52:02.851454+0000","last_became_peered":"2023-10-14T18:52:02.851454+0000","last_unstale":"2023-10-14T18:52:02.851722+0000","last_undegraded":"2023-10-14T18:52:02.851722+0000","last_fullsized":"2023-10-14T18:52:02.851722+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:27.624836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.855608+0000","last_change":"2023-10-14T18:52:03.855608+0000","last_active":"2023-10-14T18:52:03.855608+0000","last_peered":"2023-10-14T18:52:03.855608+0000","last_clean":"2023-10-14T18:52:03.855608+0000","last_became_active":"2023-10-14T18:52:03.855092+0000","last_became_peered":"2023-10-14T18:52:03.855092+0000","last_unstale":"2023-10-14T18:52:03.855608+0000","last_undegraded":"2023-10-14T18:52:03.855608+0000","last_fullsized":"2023-10-14T18:52:03.855608+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:36:06.937537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"153'8","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859863+0000","last_change":"2023-10-14T18:52:02.850524+0000","last_active":"2023-10-14T18:52:03.859863+0000","last_peered":"2023-10-14T18:52:03.859863+0000","last_clean":"2023-10-14T18:52:03.859863+0000","last_became_active":"2023-10-14T18:52:02.850291+0000","last_became_peered":"2023-10-14T18:52:02.850291+0000","last_unstale":"2023-10-14T18:52:03.859863+0000","last_undegraded":"2023-10-14T18:52:03.859863+0000","last_fullsized":"2023-10-14T18:52:03.859863+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:58.851397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856726+0000","last_change":"2023-10-14T18:52:03.856726+0000","last_active":"2023-10-14T18:52:03.856726+0000","last_peered":"2023-10-14T18:52:03.856726+0000","last_clean":"2023-10-14T18:52:03.856726+0000","last_became_active":"2023-10-14T18:52:03.856128+0000","last_became_peered":"2023-10-14T18:52:03.856128+0000","last_unstale":"2023-10-14T18:52:03.856726+0000","last_undegraded":"2023-10-14T18:52:03.856726+0000","last_fullsized":"2023-10-14T18:52:03.856726+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:33.474556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846457+0000","last_change":"2023-10-14T18:52:02.845587+0000","last_active":"2023-10-14T18:52:03.846457+0000","last_peered":"2023-10-14T18:52:03.846457+0000","last_clean":"2023-10-14T18:52:03.846457+0000","last_became_active":"2023-10-14T18:52:02.845344+0000","last_became_peered":"2023-10-14T18:52:02.845344+0000","last_unstale":"2023-10-14T18:52:03.846457+0000","last_undegraded":"2023-10-14T18:52:03.846457+0000","last_fullsized":"2023-10-14T18:52:03.846457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:45.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.850651+0000","last_change":"2023-10-14T18:52:03.850651+0000","last_active":"2023-10-14T18:52:03.850651+0000","last_peered":"2023-10-14T18:52:03.850651+0000","last_clean":"2023-10-14T18:52:03.850651+0000","last_became_active":"2023-10-14T18:52:03.850318+0000","last_became_peered":"2023-10-14T18:52:03.850318+0000","last_unstale":"2023-10-14T18:52:03.850651+0000","last_undegraded":"2023-10-14T18:52:03.850651+0000","last_fullsized":"2023-10-14T18:52:03.850651+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:46:59.857931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.860784+0000","last_change":"2023-10-14T18:52:02.849687+0000","last_active":"2023-10-14T18:52:03.860784+0000","last_peered":"2023-10-14T18:52:03.860784+0000","last_clean":"2023-10-14T18:52:03.860784+0000","last_became_active":"2023-10-14T18:52:02.849456+0000","last_became_peered":"2023-10-14T18:52:02.849456+0000","last_unstale":"2023-10-14T18:52:03.860784+0000","last_undegraded":"2023-10-14T18:52:03.860784+0000","last_fullsized":"2023-10-14T18:52:03.860784+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:07.382241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846821+0000","last_change":"2023-10-14T18:52:03.846821+0000","last_active":"2023-10-14T18:52:03.846821+0000","last_peered":"2023-10-14T18:52:03.846821+0000","last_clean":"2023-10-14T18:52:03.846821+0000","last_became_active":"2023-10-14T18:52:03.846592+0000","last_became_peered":"2023-10-14T18:52:03.846592+0000","last_unstale":"2023-10-14T18:52:03.846821+0000","last_undegraded":"2023-10-14T18:52:03.846821+0000","last_fullsized":"2023-10-14T18:52:03.846821+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:10:54.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844351+0000","last_change":"2023-10-14T18:52:02.845955+0000","last_active":"2023-10-14T18:52:03.844351+0000","last_peered":"2023-10-14T18:52:03.844351+0000","last_clean":"2023-10-14T18:52:03.844351+0000","last_became_active":"2023-10-14T18:52:02.845731+0000","last_became_peered":"2023-10-14T18:52:02.845731+0000","last_unstale":"2023-10-14T18:52:03.844351+0000","last_undegraded":"2023-10-14T18:52:03.844351+0000","last_fullsized":"2023-10-14T18:52:03.844351+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:06.829435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.844377+0000","last_change":"2023-10-14T18:52:03.844377+0000","last_active":"2023-10-14T18:52:03.844377+0000","last_peered":"2023-10-14T18:52:03.844377+0000","last_clean":"2023-10-14T18:52:03.844377+0000","last_became_active":"2023-10-14T18:52:03.844160+0000","last_became_peered":"2023-10-14T18:52:03.844160+0000","last_unstale":"2023-10-14T18:52:03.844377+0000","last_undegraded":"2023-10-14T18:52:03.844377+0000","last_fullsized":"2023-10-14T18:52:03.844377+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:58:31.479353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846835+0000","last_change":"2023-10-14T18:52:02.846700+0000","last_active":"2023-10-14T18:52:02.846835+0000","last_peered":"2023-10-14T18:52:02.846835+0000","last_clean":"2023-10-14T18:52:02.846835+0000","last_became_active":"2023-10-14T18:52:02.846474+0000","last_became_peered":"2023-10-14T18:52:02.846474+0000","last_unstale":"2023-10-14T18:52:02.846835+0000","last_undegraded":"2023-10-14T18:52:02.846835+0000","last_fullsized":"2023-10-14T18:52:02.846835+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:27.651839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853541+0000","last_change":"2023-10-14T18:52:03.853541+0000","last_active":"2023-10-14T18:52:03.853541+0000","last_peered":"2023-10-14T18:52:03.853541+0000","last_clean":"2023-10-14T18:52:03.853541+0000","last_became_active":"2023-10-14T18:52:03.853246+0000","last_became_peered":"2023-10-14T18:52:03.853246+0000","last_unstale":"2023-10-14T18:52:03.853541+0000","last_undegraded":"2023-10-14T18:52:03.853541+0000","last_fullsized":"2023-10-14T18:52:03.853541+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:33.556808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.861860+0000","last_change":"2023-10-14T18:52:02.848129+0000","last_active":"2023-10-14T18:52:03.861860+0000","last_peered":"2023-10-14T18:52:03.861860+0000","last_clean":"2023-10-14T18:52:03.861860+0000","last_became_active":"2023-10-14T18:52:02.847601+0000","last_became_peered":"2023-10-14T18:52:02.847601+0000","last_unstale":"2023-10-14T18:52:03.861860+0000","last_undegraded":"2023-10-14T18:52:03.861860+0000","last_fullsized":"2023-10-14T18:52:03.861860+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:37.116540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.857756+0000","last_change":"2023-10-14T18:52:03.857756+0000","last_active":"2023-10-14T18:52:03.857756+0000","last_peered":"2023-10-14T18:52:03.857756+0000","last_clean":"2023-10-14T18:52:03.857756+0000","last_became_active":"2023-10-14T18:52:03.857542+0000","last_became_peered":"2023-10-14T18:52:03.857542+0000","last_unstale":"2023-10-14T18:52:03.857756+0000","last_undegraded":"2023-10-14T18:52:03.857756+0000","last_fullsized":"2023-10-14T18:52:03.857756+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:10:54.455010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850575+0000","last_change":"2023-10-14T18:52:02.850473+0000","last_active":"2023-10-14T18:52:02.850575+0000","last_peered":"2023-10-14T18:52:02.850575+0000","last_clean":"2023-10-14T18:52:02.850575+0000","last_became_active":"2023-10-14T18:52:02.850198+0000","last_became_peered":"2023-10-14T18:52:02.850198+0000","last_unstale":"2023-10-14T18:52:02.850575+0000","last_undegraded":"2023-10-14T18:52:02.850575+0000","last_fullsized":"2023-10-14T18:52:02.850575+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:16:24.136113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846689+0000","last_change":"2023-10-14T18:52:03.846689+0000","last_active":"2023-10-14T18:52:03.846689+0000","last_peered":"2023-10-14T18:52:03.846689+0000","last_clean":"2023-10-14T18:52:03.846689+0000","last_became_active":"2023-10-14T18:52:03.846267+0000","last_became_peered":"2023-10-14T18:52:03.846267+0000","last_unstale":"2023-10-14T18:52:03.846689+0000","last_undegraded":"2023-10-14T18:52:03.846689+0000","last_fullsized":"2023-10-14T18:52:03.846689+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:38:22.038993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.846240+0000","last_change":"2023-10-14T18:52:02.846113+0000","last_active":"2023-10-14T18:52:02.846240+0000","last_peered":"2023-10-14T18:52:02.846240+0000","last_clean":"2023-10-14T18:52:02.846240+0000","last_became_active":"2023-10-14T18:52:02.845702+0000","last_became_peered":"2023-10-14T18:52:02.845702+0000","last_unstale":"2023-10-14T18:52:02.846240+0000","last_undegraded":"2023-10-14T18:52:02.846240+0000","last_fullsized":"2023-10-14T18:52:02.846240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:58:28.841922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.851280+0000","last_change":"2023-10-14T18:52:03.851280+0000","last_active":"2023-10-14T18:52:03.851280+0000","last_peered":"2023-10-14T18:52:03.851280+0000","last_clean":"2023-10-14T18:52:03.851280+0000","last_became_active":"2023-10-14T18:52:03.851089+0000","last_became_peered":"2023-10-14T18:52:03.851089+0000","last_unstale":"2023-10-14T18:52:03.851280+0000","last_undegraded":"2023-10-14T18:52:03.851280+0000","last_fullsized":"2023-10-14T18:52:03.851280+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:56.106483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.849308+0000","last_change":"2023-10-14T18:52:02.849260+0000","last_active":"2023-10-14T18:52:02.849308+0000","last_peered":"2023-10-14T18:52:02.849308+0000","last_clean":"2023-10-14T18:52:02.849308+0000","last_became_active":"2023-10-14T18:52:02.849078+0000","last_became_peered":"2023-10-14T18:52:02.849078+0000","last_unstale":"2023-10-14T18:52:02.849308+0000","last_undegraded":"2023-10-14T18:52:02.849308+0000","last_fullsized":"2023-10-14T18:52:02.849308+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:20.250697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858765+0000","last_change":"2023-10-14T18:52:03.858765+0000","last_active":"2023-10-14T18:52:03.858765+0000","last_peered":"2023-10-14T18:52:03.858765+0000","last_clean":"2023-10-14T18:52:03.858765+0000","last_became_active":"2023-10-14T18:52:03.858545+0000","last_became_peered":"2023-10-14T18:52:03.858545+0000","last_unstale":"2023-10-14T18:52:03.858765+0000","last_undegraded":"2023-10-14T18:52:03.858765+0000","last_fullsized":"2023-10-14T18:52:03.858765+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:04.203907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.858063+0000","last_change":"2023-10-14T18:52:02.845605+0000","last_active":"2023-10-14T18:52:03.858063+0000","last_peered":"2023-10-14T18:52:03.858063+0000","last_clean":"2023-10-14T18:52:03.858063+0000","last_became_active":"2023-10-14T18:52:02.844328+0000","last_became_peered":"2023-10-14T18:52:02.844328+0000","last_unstale":"2023-10-14T18:52:03.858063+0000","last_undegraded":"2023-10-14T18:52:03.858063+0000","last_fullsized":"2023-10-14T18:52:03.858063+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:28:50.184662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.856272+0000","last_change":"2023-10-14T18:52:03.856272+0000","last_active":"2023-10-14T18:52:03.856272+0000","last_peered":"2023-10-14T18:52:03.856272+0000","last_clean":"2023-10-14T18:52:03.856272+0000","last_became_active":"2023-10-14T18:52:03.856091+0000","last_became_peered":"2023-10-14T18:52:03.856091+0000","last_unstale":"2023-10-14T18:52:03.856272+0000","last_undegraded":"2023-10-14T18:52:03.856272+0000","last_fullsized":"2023-10-14T18:52:03.856272+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:14:59.835574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.845715+0000","last_change":"2023-10-14T18:52:02.845493+0000","last_active":"2023-10-14T18:52:02.845715+0000","last_peered":"2023-10-14T18:52:02.845715+0000","last_clean":"2023-10-14T18:52:02.845715+0000","last_became_active":"2023-10-14T18:52:02.844945+0000","last_became_peered":"2023-10-14T18:52:02.844945+0000","last_unstale":"2023-10-14T18:52:02.845715+0000","last_undegraded":"2023-10-14T18:52:02.845715+0000","last_fullsized":"2023-10-14T18:52:02.845715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:18.152860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846582+0000","last_change":"2023-10-14T18:52:03.846582+0000","last_active":"2023-10-14T18:52:03.846582+0000","last_peered":"2023-10-14T18:52:03.846582+0000","last_clean":"2023-10-14T18:52:03.846582+0000","last_became_active":"2023-10-14T18:52:03.845922+0000","last_became_peered":"2023-10-14T18:52:03.845922+0000","last_unstale":"2023-10-14T18:52:03.846582+0000","last_undegraded":"2023-10-14T18:52:03.846582+0000","last_fullsized":"2023-10-14T18:52:03.846582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:15.530253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.850197+0000","last_change":"2023-10-14T18:52:02.850137+0000","last_active":"2023-10-14T18:52:02.850197+0000","last_peered":"2023-10-14T18:52:02.850197+0000","last_clean":"2023-10-14T18:52:02.850197+0000","last_became_active":"2023-10-14T18:52:02.849922+0000","last_became_peered":"2023-10-14T18:52:02.849922+0000","last_unstale":"2023-10-14T18:52:02.850197+0000","last_undegraded":"2023-10-14T18:52:02.850197+0000","last_fullsized":"2023-10-14T18:52:02.850197+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:15.988574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853592+0000","last_change":"2023-10-14T18:52:03.853592+0000","last_active":"2023-10-14T18:52:03.853592+0000","last_peered":"2023-10-14T18:52:03.853592+0000","last_clean":"2023-10-14T18:52:03.853592+0000","last_became_active":"2023-10-14T18:52:03.853304+0000","last_became_peered":"2023-10-14T18:52:03.853304+0000","last_unstale":"2023-10-14T18:52:03.853592+0000","last_undegraded":"2023-10-14T18:52:03.853592+0000","last_fullsized":"2023-10-14T18:52:03.853592+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.847815+0000","last_change":"2023-10-14T18:52:02.847758+0000","last_active":"2023-10-14T18:52:02.847815+0000","last_peered":"2023-10-14T18:52:02.847815+0000","last_clean":"2023-10-14T18:52:02.847815+0000","last_became_active":"2023-10-14T18:52:02.847503+0000","last_became_peered":"2023-10-14T18:52:02.847503+0000","last_unstale":"2023-10-14T18:52:02.847815+0000","last_undegraded":"2023-10-14T18:52:02.847815+0000","last_fullsized":"2023-10-14T18:52:02.847815+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:05:02.268920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.852317+0000","last_change":"2023-10-14T18:52:03.852317+0000","last_active":"2023-10-14T18:52:03.852317+0000","last_peered":"2023-10-14T18:52:03.852317+0000","last_clean":"2023-10-14T18:52:03.852317+0000","last_became_active":"2023-10-14T18:52:03.852058+0000","last_became_peered":"2023-10-14T18:52:03.852058+0000","last_unstale":"2023-10-14T18:52:03.852317+0000","last_undegraded":"2023-10-14T18:52:03.852317+0000","last_fullsized":"2023-10-14T18:52:03.852317+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:00.716690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851255+0000","last_change":"2023-10-14T18:52:02.851201+0000","last_active":"2023-10-14T18:52:02.851255+0000","last_peered":"2023-10-14T18:52:02.851255+0000","last_clean":"2023-10-14T18:52:02.851255+0000","last_became_active":"2023-10-14T18:52:02.850990+0000","last_became_peered":"2023-10-14T18:52:02.850990+0000","last_unstale":"2023-10-14T18:52:02.851255+0000","last_undegraded":"2023-10-14T18:52:02.851255+0000","last_fullsized":"2023-10-14T18:52:02.851255+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:06:55.012886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.859410+0000","last_change":"2023-10-14T18:52:03.859410+0000","last_active":"2023-10-14T18:52:03.859410+0000","last_peered":"2023-10-14T18:52:03.859410+0000","last_clean":"2023-10-14T18:52:03.859410+0000","last_became_active":"2023-10-14T18:52:03.857624+0000","last_became_peered":"2023-10-14T18:52:03.857624+0000","last_unstale":"2023-10-14T18:52:03.859410+0000","last_undegraded":"2023-10-14T18:52:03.859410+0000","last_fullsized":"2023-10-14T18:52:03.859410+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:14.017155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.848596+0000","last_change":"2023-10-14T18:52:02.848525+0000","last_active":"2023-10-14T18:52:02.848596+0000","last_peered":"2023-10-14T18:52:02.848596+0000","last_clean":"2023-10-14T18:52:02.848596+0000","last_became_active":"2023-10-14T18:52:02.848368+0000","last_became_peered":"2023-10-14T18:52:02.848368+0000","last_unstale":"2023-10-14T18:52:02.848596+0000","last_undegraded":"2023-10-14T18:52:02.848596+0000","last_fullsized":"2023-10-14T18:52:02.848596+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:02:14.523719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853667+0000","last_change":"2023-10-14T18:52:03.853667+0000","last_active":"2023-10-14T18:52:03.853667+0000","last_peered":"2023-10-14T18:52:03.853667+0000","last_clean":"2023-10-14T18:52:03.853667+0000","last_became_active":"2023-10-14T18:52:03.853469+0000","last_became_peered":"2023-10-14T18:52:03.853469+0000","last_unstale":"2023-10-14T18:52:03.853667+0000","last_undegraded":"2023-10-14T18:52:03.853667+0000","last_fullsized":"2023-10-14T18:52:03.853667+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:48:44.845681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.851139+0000","last_change":"2023-10-14T18:52:02.851089+0000","last_active":"2023-10-14T18:52:02.851139+0000","last_peered":"2023-10-14T18:52:02.851139+0000","last_clean":"2023-10-14T18:52:02.851139+0000","last_became_active":"2023-10-14T18:52:02.850701+0000","last_became_peered":"2023-10-14T18:52:02.850701+0000","last_unstale":"2023-10-14T18:52:02.851139+0000","last_undegraded":"2023-10-14T18:52:02.851139+0000","last_fullsized":"2023-10-14T18:52:02.851139+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:42:32.007220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.846850+0000","last_change":"2023-10-14T18:52:03.846850+0000","last_active":"2023-10-14T18:52:03.846850+0000","last_peered":"2023-10-14T18:52:03.846850+0000","last_clean":"2023-10-14T18:52:03.846850+0000","last_became_active":"2023-10-14T18:52:03.846608+0000","last_became_peered":"2023-10-14T18:52:03.846608+0000","last_unstale":"2023-10-14T18:52:03.846850+0000","last_undegraded":"2023-10-14T18:52:03.846850+0000","last_fullsized":"2023-10-14T18:52:03.846850+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:23.754629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.847502+0000","last_change":"2023-10-14T18:52:02.847332+0000","last_active":"2023-10-14T18:52:02.847502+0000","last_peered":"2023-10-14T18:52:02.847502+0000","last_clean":"2023-10-14T18:52:02.847502+0000","last_became_active":"2023-10-14T18:52:02.846985+0000","last_became_peered":"2023-10-14T18:52:02.846985+0000","last_unstale":"2023-10-14T18:52:02.847502+0000","last_undegraded":"2023-10-14T18:52:02.847502+0000","last_fullsized":"2023-10-14T18:52:02.847502+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:35.656588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.848915+0000","last_change":"2023-10-14T18:52:03.848915+0000","last_active":"2023-10-14T18:52:03.848915+0000","last_peered":"2023-10-14T18:52:03.848915+0000","last_clean":"2023-10-14T18:52:03.848915+0000","last_became_active":"2023-10-14T18:52:03.847043+0000","last_became_peered":"2023-10-14T18:52:03.847043+0000","last_unstale":"2023-10-14T18:52:03.848915+0000","last_undegraded":"2023-10-14T18:52:03.848915+0000","last_fullsized":"2023-10-14T18:52:03.848915+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:02.827457+0000","last_clean_scrub_stamp":"2023-10-14T18:52:02.827457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:01:22.095682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T18:52:03.853704+0000","last_change":"2023-10-14T18:52:02.845991+0000","last_active":"2023-10-14T18:52:03.853704+0000","last_peered":"2023-10-14T18:52:03.853704+0000","last_clean":"2023-10-14T18:52:03.853704+0000","last_became_active":"2023-10-14T18:52:02.845530+0000","last_became_peered":"2023-10-14T18:52:02.845530+0000","last_unstale":"2023-10-14T18:52:03.853704+0000","last_undegraded":"2023-10-14T18:52:03.853704+0000","last_fullsized":"2023-10-14T18:52:03.853704+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:52:01.820924+0000","last_clean_scrub_stamp":"2023-10-14T18:52:01.820924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:57:22.748096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T18:52:02.839951+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:52:02.839951+0000","last_peered":"2023-10-14T18:52:02.839951+0000","last_clean":"2023-10-14T18:52:02.839951+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:52:02.839951+0000","last_undegraded":"2023-10-14T18:52:02.839951+0000","last_fullsized":"2023-10-14T18:52:02.839951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568427,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.66600000000000004,"5min":0.75700000000000001,"15min":0.79000000000000004},"last":0.441},{"interface":"front","average":{"1min":0.502,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.34399999999999997},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.52200000000000002,"15min":0.626},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":3.8580000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56299999999999994}]},{"osd":2,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68600000000000005,"5min":0.83999999999999997,"15min":7.8129999999999997},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.377,"15min":0.33800000000000002},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.83899999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.46999999999999997,"15min":0.44900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.501},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73699999999999999,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.52100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83999999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.376,"15min":0.376},"max":{"1min":0.76000000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35199999999999998},"max":{"1min":0.80500000000000005,"5min":0.877,"15min":0.95699999999999996},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":829,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199150496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.67500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.628,"5min":0.76100000000000001,"15min":0.76300000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70399999999999996,"5min":0.753,"15min":0.76000000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.65400000000000003,"5min":0.75800000000000001,"15min":3.4489999999999998},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53500000000000003,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67300000000000004,"5min":0.72999999999999998,"15min":0.83599999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":9.5779999999999994},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.57699999999999996,"5min":0.68300000000000005,"15min":0.84099999999999997},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.29699999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.68300000000000005,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46300000000000002,"15min":0.47499999999999998},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.504,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78600000000000003},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.75800000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.32200000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.72299999999999998,"5min":0.78500000000000003,"15min":0.89700000000000002},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.40799999999999997,"5min":0.60799999999999998,"15min":1.0900000000000001},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.44900000000000001,"5min":0.56399999999999995,"15min":0.90700000000000003},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33600000000000002,"15min":0.34000000000000002},"min":{"1min":0.24299999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.39200000000000002,"5min":0.60299999999999998,"15min":0.89100000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35599999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.46800000000000003,"5min":0.65900000000000003,"15min":0.73099999999999998},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.39400000000000002,"15min":0.72099999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.44400000000000001,"5min":0.66000000000000003,"15min":10.574},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.377,"15min":0.377},"min":{"1min":0.28599999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":0.65700000000000003,"15min":0.93899999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.42899999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81599999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56999999999999995,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.88200000000000001,"15min":0.96499999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.60599999999999998},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":0.66200000000000003,"5min":0.85399999999999998,"15min":0.92200000000000004},"last":0.55800000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.79500000000000004,"5min":0.90800000000000003,"15min":0.94699999999999995},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80100000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193915,"statfs":{"total":200000000,"available":198569438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33800000000000002,"15min":0.32500000000000001},"min":{"1min":0.217,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.34699999999999998,"15min":0.33600000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.432,"5min":0.623,"15min":0.623},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.29599999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.46000000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54800000000000004,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.35699999999999998,"15min":0.33100000000000002},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.23200000000000001},"max":{"1min":0.47899999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.39600000000000002,"15min":0.374},"min":{"1min":0.27400000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.58199999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60799999999999998,"15min":0.58599999999999997},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60999999999999999,"15min":0.58799999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.56000000000000005},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.377,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.90200000000000002,"5min":1.01,"15min":1.01},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.56999999999999995},"min":{"1min":0.40500000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.879,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194483,"statfs":{"total":200000000,"available":199151444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35999999999999999,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48299999999999998,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.49199999999999999,"5min":0.61499999999999999,"15min":0.67200000000000004},"last":0.34100000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.47299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.379,"15min":0.39200000000000002},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.54400000000000004,"5min":0.70199999999999996,"15min":0.78900000000000003},"last":0.28599999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.54900000000000004,"5min":1.006,"15min":1.006},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.311}]},{"osd":4,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.60399999999999998,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71599999999999997,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68600000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56999999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66300000000000003,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.624}]},{"osd":6,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.62,"15min":0.629},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.74399999999999999,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.432,"15min":0.41299999999999998},"max":{"1min":0.77800000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76900000000000002,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32400000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.44400000000000001,"5min":0.50700000000000001,"15min":0.68100000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.33300000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45200000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.25600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34000000000000002,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.222,"15min":0.222},"max":{"1min":0.47999999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.379,"15min":0.375},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.22800000000000001},"max":{"1min":0.53000000000000003,"5min":0.60499999999999998,"15min":0.64600000000000002},"last":0.309}]},{"osd":2,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.376,"15min":0.374},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51300000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29599999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.495,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.40999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.873,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32800000000000001},"max":{"1min":0.748,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38300000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.442,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91200000000000003,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41199999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54200000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78300000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.61099999999999999},"min":{"1min":0.42699999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83099999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199158795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.51000000000000001},"min":{"1min":0.40699999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71099999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54500000000000004,"15min":0.52100000000000002},"min":{"1min":0.41499999999999998,"5min":0.35599999999999998,"15min":0.33000000000000002},"max":{"1min":0.746,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55900000000000005,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76500000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.496},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47599999999999998,"15min":0.47399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.999,"15min":0.999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75900000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52200000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68300000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.433},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.55800000000000005},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.748,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79700000000000004,"5min":0.872,"15min":0.872},"last":0.54900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":828,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194484,"statfs":{"total":200000000,"available":199151920,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.38200000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.50800000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.40500000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67300000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.376,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68000000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52000000000000002,"15min":0.51800000000000002},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.628,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.60099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68100000000000005,"5min":0.748,"15min":0.748},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55500000000000005,"15min":0.54500000000000004},"min":{"1min":0.443,"5min":0.38900000000000001,"15min":0.38500000000000001},"max":{"1min":0.63300000000000001,"5min":0.75,"15min":0.75},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.374},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.5,"15min":0.53500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65700000000000003,"5min":0.76200000000000001,"15min":0.92800000000000005},"last":0.32400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.313,"5min":0.308,"15min":0.308},"max":{"1min":0.66900000000000004,"5min":0.72499999999999998,"15min":0.746},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.74299999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42799999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33100000000000002},"max":{"1min":0.71399999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:52:08.292 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:52:08.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:52:08.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.447+0000 7fc444367700 1 Processor -- start 2023-10-14T18:52:08.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.447+0000 7fc444367700 1 -- start start 2023-10-14T18:52:08.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc444367700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 0x7fc43c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc444367700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc43c06acb0 0x7fc43c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc444367700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b0790 con 0x7fc43c15a290 2023-10-14T18:52:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc444367700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0ce1f0 con 0x7fc43c06acb0 2023-10-14T18:52:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc444367700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0b0b20 con 0x7fc43c159ec0 2023-10-14T18:52:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc441902700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc43c15a290 0x7fc43c06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56278/0 (socket says 172.21.15.79:56278) 2023-10-14T18:52:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc441902700 1 -- 172.21.15.79:0/198041108 learned_addr learned my addr 172.21.15.79:0/198041108 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc442103700 1 --2- 172.21.15.79:0/198041108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 0x7fc43c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc442904700 1 --2- 172.21.15.79:0/198041108 >> v2:172.21.15.144:3300/0 conn(0x7fc43c06acb0 0x7fc43c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc441101700 1 -- 172.21.15.79:0/198041108 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119211723 0 0) 0x7fc43c0b0790 con 0x7fc43c15a290 2023-10-14T18:52:08.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc441101700 1 -- 172.21.15.79:0/198041108 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc428003570 con 0x7fc43c15a290 2023-10-14T18:52:08.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.448+0000 7fc442103700 1 -- 172.21.15.79:0/198041108 >> v2:172.21.15.144:3300/0 conn(0x7fc43c06acb0 msgr2=0x7fc43c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:08.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc442103700 1 --2- 172.21.15.79:0/198041108 >> v2:172.21.15.144:3300/0 conn(0x7fc43c06acb0 0x7fc43c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc442103700 1 -- 172.21.15.79:0/198041108 >> v1:172.21.15.79:6789/0 conn(0x7fc43c15a290 legacy=0x7fc43c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc442103700 1 -- 172.21.15.79:0/198041108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b04b0 con 0x7fc43c159ec0 2023-10-14T18:52:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc442103700 1 --2- 172.21.15.79:0/198041108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 0x7fc43c0af940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc438009e60 tx=0x7fc438009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d52e566e55a6481 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc441101700 1 -- 172.21.15.79:0/198041108 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800e070 con 0x7fc43c159ec0 2023-10-14T18:52:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc441101700 1 -- 172.21.15.79:0/198041108 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800bab0 con 0x7fc43c159ec0 2023-10-14T18:52:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc441101700 1 -- 172.21.15.79:0/198041108 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800be30 con 0x7fc43c159ec0 2023-10-14T18:52:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc444367700 1 -- 172.21.15.79:0/198041108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 msgr2=0x7fc43c0af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.449+0000 7fc444367700 1 --2- 172.21.15.79:0/198041108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 0x7fc43c0af940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc438009e60 tx=0x7fc438009780 comp rx=0 tx=0).stop 2023-10-14T18:52:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 -- 172.21.15.79:0/198041108 shutdown_connections 2023-10-14T18:52:08.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 --2- 172.21.15.79:0/198041108 >> v2:172.21.15.144:3300/0 conn(0x7fc43c06acb0 0x7fc43c0afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 --2- 172.21.15.79:0/198041108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c159ec0 0x7fc43c0af940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 -- 172.21.15.79:0/198041108 >> 172.21.15.79:0/198041108 conn(0x7fc43c0d1880 msgr2=0x7fc43c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:08.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 -- 172.21.15.79:0/198041108 shutdown_connections 2023-10-14T18:52:08.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.450+0000 7fc444367700 1 -- 172.21.15.79:0/198041108 wait complete. 2023-10-14T18:52:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 Processor -- start 2023-10-14T18:52:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 -- start start 2023-10-14T18:52:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 0x7fc43c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 0x7fc43c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15a8a0 con 0x7fc43c159ec0 2023-10-14T18:52:08.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c91c0 con 0x7fc43c06acb0 2023-10-14T18:52:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc444367700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0c8890 con 0x7fc43c15a290 2023-10-14T18:52:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc441902700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc441902700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57850/0 (socket says 172.21.15.79:57850) 2023-10-14T18:52:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.451+0000 7fc441902700 1 -- 172.21.15.79:0/3665734677 learned_addr learned my addr 172.21.15.79:0/3665734677 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:08.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc442103700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 0x7fc43c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc442904700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 0x7fc43c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 -- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 msgr2=0x7fc43c0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 0x7fc43c0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 -- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 msgr2=0x7fc43c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 0x7fc43c0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 -- 172.21.15.79:0/3665734677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009a20 con 0x7fc43c159ec0 2023-10-14T18:52:08.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc442103700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 0x7fc43c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:08.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc442904700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 0x7fc43c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:08.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc441902700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c590 tx=0x7fc42c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c005b30 con 0x7fc43c159ec0 2023-10-14T18:52:08.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c005cb0 con 0x7fc43c159ec0 2023-10-14T18:52:08.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c007320 con 0x7fc43c159ec0 2023-10-14T18:52:08.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c0c8b70 con 0x7fc43c159ec0 2023-10-14T18:52:08.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.452+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c16af30 con 0x7fc43c159ec0 2023-10-14T18:52:08.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.453+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c04c3c0 con 0x7fc43c159ec0 2023-10-14T18:52:08.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.453+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc42c01b3b0 con 0x7fc43c159ec0 2023-10-14T18:52:08.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.454+0000 7fc4327fc700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 0x7fc4200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.454+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc42c083af0 con 0x7fc43c159ec0 2023-10-14T18:52:08.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.454+0000 7fc442103700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 0x7fc4200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.454+0000 7fc442103700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 0x7fc4200693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc438019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.458+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc42c050d60 con 0x7fc43c159ec0 2023-10-14T18:52:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.713+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc43c0ceab0 con 0x7fc43c159ec0 2023-10-14T18:52:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.717+0000 7fc4327fc700 1 -- 172.21.15.79:0/3665734677 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc42c017020 con 0x7fc43c159ec0 2023-10-14T18:52:08.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 msgr2=0x7fc4200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 0x7fc4200693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc438019000 comp rx=0 tx=0).stop 2023-10-14T18:52:08.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 msgr2=0x7fc43c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c590 tx=0x7fc42c007e00 comp rx=0 tx=0).stop 2023-10-14T18:52:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 shutdown_connections 2023-10-14T18:52:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc420066f30 0x7fc4200693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc43c15a290 0x7fc43c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc43c06acb0 0x7fc43c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 --2- 172.21.15.79:0/3665734677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc43c159ec0 0x7fc43c0cf590 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 >> 172.21.15.79:0/3665734677 conn(0x7fc43c0d1880 msgr2=0x7fc43c0c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 shutdown_connections 2023-10-14T18:52:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.719+0000 7fc444367700 1 -- 172.21.15.79:0/3665734677 wait complete. 2023-10-14T18:52:08.723 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:52:08.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:52:08.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.845+0000 7fc66fb2b700 1 Processor -- start 2023-10-14T18:52:08.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.845+0000 7fc66fb2b700 1 -- start start 2023-10-14T18:52:08.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66fb2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc66815a620 0x7fc66815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66fb2b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66815cbb0 con 0x7fc66815d580 2023-10-14T18:52:08.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66fb2b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66815bfa0 con 0x7fc668157870 2023-10-14T18:52:08.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66fb2b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66815bdb0 con 0x7fc66815a620 2023-10-14T18:52:08.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66d0c6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc66815a620 0x7fc66815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66e0c8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc66815d580 0x7fc668158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56288/0 (socket says 172.21.15.79:56288) 2023-10-14T18:52:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66d0c6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc66815a620 0x7fc66815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57858/0 (socket says 172.21.15.79:57858) 2023-10-14T18:52:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.846+0000 7fc66e0c8700 1 -- 172.21.15.79:0/993299073 learned_addr learned my addr 172.21.15.79:0/993299073 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:08.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66d0c6700 1 -- 172.21.15.79:0/993299073 >> v1:172.21.15.144:6789/0 conn(0x7fc668157870 legacy=0x7fc66815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66d0c6700 1 -- 172.21.15.79:0/993299073 >> v1:172.21.15.79:6789/0 conn(0x7fc66815d580 legacy=0x7fc668158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66c8c5700 1 -- 172.21.15.79:0/993299073 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670702800 0 0) 0x7fc66815cbb0 con 0x7fc66815d580 2023-10-14T18:52:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66d0c6700 1 -- 172.21.15.79:0/993299073 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66815c280 con 0x7fc66815a620 2023-10-14T18:52:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66d0c6700 1 --2- 172.21.15.79:0/993299073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815a620 0x7fc66815d040 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc6580098e0 tx=0x7fc6580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b373574de5882b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66c8c5700 1 -- 172.21.15.79:0/993299073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658009e80 con 0x7fc66815a620 2023-10-14T18:52:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66c8c5700 1 -- 172.21.15.79:0/993299073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65800b860 con 0x7fc66815a620 2023-10-14T18:52:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66c8c5700 1 -- 172.21.15.79:0/993299073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800bbe0 con 0x7fc66815a620 2023-10-14T18:52:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 -- 172.21.15.79:0/993299073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815a620 msgr2=0x7fc66815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/993299073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815a620 0x7fc66815d040 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc6580098e0 tx=0x7fc6580091a0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 -- 172.21.15.79:0/993299073 shutdown_connections 2023-10-14T18:52:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/993299073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815a620 0x7fc66815d040 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 -- 172.21.15.79:0/993299073 >> 172.21.15.79:0/993299073 conn(0x7fc668068ce0 msgr2=0x7fc6680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.847+0000 7fc66fb2b700 1 -- 172.21.15.79:0/993299073 shutdown_connections 2023-10-14T18:52:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.848+0000 7fc66fb2b700 1 -- 172.21.15.79:0/993299073 wait complete. 2023-10-14T18:52:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 Processor -- start 2023-10-14T18:52:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 -- start start 2023-10-14T18:52:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc668157870 0x7fc6680d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66815a620 0x7fc66814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66814c1a0 con 0x7fc66815d580 2023-10-14T18:52:08.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680d15e0 con 0x7fc66815a620 2023-10-14T18:52:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66fb2b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6680b29e0 con 0x7fc668157870 2023-10-14T18:52:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66e0c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66e0c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57872/0 (socket says 172.21.15.79:57872) 2023-10-14T18:52:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.849+0000 7fc66e0c8700 1 -- 172.21.15.79:0/3342689081 learned_addr learned my addr 172.21.15.79:0/3342689081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:08.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 -- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc668157870 msgr2=0x7fc6680d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66d0c6700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66815a620 0x7fc66814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66d8c7700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc668157870 0x7fc6680d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc668157870 0x7fc6680d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 -- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66815a620 msgr2=0x7fc66814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66815a620 0x7fc66814bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 -- 172.21.15.79:0/3342689081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658009420 con 0x7fc66815d580 2023-10-14T18:52:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66e0c8700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c4c0 tx=0x7fc660007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660005b30 con 0x7fc66815d580 2023-10-14T18:52:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc660005c90 con 0x7fc66815d580 2023-10-14T18:52:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6680b20b0 con 0x7fc66815d580 2023-10-14T18:52:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660007300 con 0x7fc66815d580 2023-10-14T18:52:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.850+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6680b2670 con 0x7fc66815d580 2023-10-14T18:52:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.851+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66804c3c0 con 0x7fc66815d580 2023-10-14T18:52:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.852+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc660012400 con 0x7fc66815d580 2023-10-14T18:52:08.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.852+0000 7fc65dffb700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 0x7fc64c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.852+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc660083ac0 con 0x7fc66815d580 2023-10-14T18:52:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.852+0000 7fc66d8c7700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 0x7fc64c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:08.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.853+0000 7fc66d8c7700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 0x7fc64c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc664007fd0 tx=0x7fc664009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:08.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:08.856+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc660050ca0 con 0x7fc66815d580 2023-10-14T18:52:09.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.081+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66815c560 con 0x7fc66815d580 2023-10-14T18:52:09.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.081+0000 7fc65dffb700 1 -- 172.21.15.79:0/3342689081 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fc660083e60 con 0x7fc66815d580 2023-10-14T18:52:09.083 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:09.084 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:52:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 msgr2=0x7fc64c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 0x7fc64c0693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc664007fd0 tx=0x7fc664009040 comp rx=0 tx=0).stop 2023-10-14T18:52:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 msgr2=0x7fc66814ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c4c0 tx=0x7fc660007f20 comp rx=0 tx=0).stop 2023-10-14T18:52:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 shutdown_connections 2023-10-14T18:52:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc64c066f30 0x7fc64c0693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc66815d580 0x7fc66814ac60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc668157870 0x7fc6680d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.083+0000 7fc66fb2b700 1 --2- 172.21.15.79:0/3342689081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66815a620 0x7fc66814bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.084+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 >> 172.21.15.79:0/3342689081 conn(0x7fc668068ce0 msgr2=0x7fc668159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.084+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 shutdown_connections 2023-10-14T18:52:09.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.084+0000 7fc66fb2b700 1 -- 172.21.15.79:0/3342689081 wait complete. 2023-10-14T18:52:09.088 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:52:09.139 INFO:tasks.ceph.mds.b.smithi144.stderr:2023-10-14T18:52:09.139+0000 7fa84c3a1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:52:09.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:52:03.218063+0000', 'modified': '2023-10-14T18:52:06.874460+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7494': {'gid': 7494, 'name': 'b', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/1059423837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1059423837}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1059423837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:52:09.500 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:52:09.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T18:52:09.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.616+0000 7f2d9fc54700 1 Processor -- start 2023-10-14T18:52:09.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.616+0000 7f2d9fc54700 1 -- start start 2023-10-14T18:52:09.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d98157870 0x7f2d9815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d9815a620 0x7f2d9815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d9815d580 0x7f2d98158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9815cbb0 con 0x7f2d98157870 2023-10-14T18:52:09.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9815bfa0 con 0x7f2d9815d580 2023-10-14T18:52:09.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9fc54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9815c280 con 0x7f2d9815a620 2023-10-14T18:52:09.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d98157870 0x7f2d9815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d98157870 0x7f2d9815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57876/0 (socket says 172.21.15.79:57876) 2023-10-14T18:52:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3461865863 learned_addr learned my addr 172.21.15.79:0/3461865863 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/3461865863 >> v2:172.21.15.144:3300/0 conn(0x7f2d9815d580 0x7f2d98158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d9815a620 0x7f2d9815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3461865863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d9815a620 msgr2=0x7f2d9815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d9815a620 0x7f2d9815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3461865863 >> v2:172.21.15.144:3300/0 conn(0x7f2d9815d580 msgr2=0x7f2d98158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3461865863 >> v2:172.21.15.144:3300/0 conn(0x7f2d9815d580 0x7f2d98158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3461865863 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9815c560 con 0x7f2d98157870 2023-10-14T18:52:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.617+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d98157870 0x7f2d9815b6a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2d980b03b0 tx=0x7f2d90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9216d3ab68ec5378 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9c9ee700 1 -- 172.21.15.79:0/3461865863 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000e070 con 0x7f2d98157870 2023-10-14T18:52:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9c9ee700 1 -- 172.21.15.79:0/3461865863 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000ba50 con 0x7f2d98157870 2023-10-14T18:52:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9c9ee700 1 -- 172.21.15.79:0/3461865863 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900092e0 con 0x7f2d98157870 2023-10-14T18:52:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 -- 172.21.15.79:0/3461865863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d98157870 msgr2=0x7f2d9815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d98157870 0x7f2d9815b6a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2d980b03b0 tx=0x7f2d90009840 comp rx=0 tx=0).stop 2023-10-14T18:52:09.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 -- 172.21.15.79:0/3461865863 shutdown_connections 2023-10-14T18:52:09.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/3461865863 >> v2:172.21.15.144:3300/0 conn(0x7f2d9815d580 0x7f2d98158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d98157870 0x7f2d9815b6a0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/3461865863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d9815a620 0x7f2d9815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 -- 172.21.15.79:0/3461865863 >> 172.21.15.79:0/3461865863 conn(0x7f2d98068ce0 msgr2=0x7f2d980690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 -- 172.21.15.79:0/3461865863 shutdown_connections 2023-10-14T18:52:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.618+0000 7f2d9fc54700 1 -- 172.21.15.79:0/3461865863 wait complete. 2023-10-14T18:52:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.619+0000 7f2d9fc54700 1 Processor -- start 2023-10-14T18:52:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.619+0000 7f2d9fc54700 1 -- start start 2023-10-14T18:52:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 0x7f2d98144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d9815a620 0x7f2d980b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9816b9c0 con 0x7f2d9815d580 2023-10-14T18:52:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98144fd0 con 0x7f2d9815a620 2023-10-14T18:52:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9fc54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980aebe0 con 0x7f2d98157870 2023-10-14T18:52:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57886/0 (socket says 172.21.15.79:57886) 2023-10-14T18:52:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/280239165 learned_addr learned my addr 172.21.15.79:0/280239165 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 0x7f2d98144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d9815a620 0x7f2d980b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 msgr2=0x7f2d98144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 0x7f2d98144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d9815a620 msgr2=0x7f2d980b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d9815a620 0x7f2d980b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/280239165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009ae0 con 0x7f2d9815d580 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.620+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 0x7f2d98144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:09.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400d860 tx=0x7f2d94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d8dffb700 1 -- 172.21.15.79:0/280239165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940125f0 con 0x7f2d9815d580 2023-10-14T18:52:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d8dffb700 1 -- 172.21.15.79:0/280239165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d94012750 con 0x7f2d9815d580 2023-10-14T18:52:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d980aeec0 con 0x7f2d9815d580 2023-10-14T18:52:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d8dffb700 1 -- 172.21.15.79:0/280239165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94012af0 con 0x7f2d9815d580 2023-10-14T18:52:09.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.621+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980af480 con 0x7f2d9815d580 2023-10-14T18:52:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.622+0000 7f2d8dffb700 1 -- 172.21.15.79:0/280239165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d9401e460 con 0x7f2d9815d580 2023-10-14T18:52:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.622+0000 7f2d8dffb700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.622+0000 7f2d8dffb700 1 -- 172.21.15.79:0/280239165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d94084ad0 con 0x7f2d9815d580 2023-10-14T18:52:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.623+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.623+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 0x7f2d7c0693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009880 tx=0x7f2d90018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.624+0000 7f2da8f4db80 1 Processor -- start 2023-10-14T18:52:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.624+0000 7f2da8f4db80 1 -- start start 2023-10-14T18:52:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f92d00 0x565216f71a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f71f60 0x565216f44cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216e9fa70 con 0x565216f48a50 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216e9d270 con 0x565216f92d00 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x565216e99060 con 0x565216f71f60 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2d9d9f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2d9d9f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57888/0 (socket says 172.21.15.79:57888) 2023-10-14T18:52:09.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3394058492 learned_addr learned my addr 172.21.15.79:0/3394058492 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.625+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f92d00 0x565216f71a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f71f60 0x565216f44cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f71f60 msgr2=0x565216f44cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f71f60 0x565216f44cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f92d00 msgr2=0x565216f71a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f92d00 0x565216f71a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/3394058492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565216d33270 con 0x565216f48a50 2023-10-14T18:52:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000bcc0 tx=0x7f2d90020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2f37c92f334fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d82ffd700 1 -- 172.21.15.79:0/3394058492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90007aa0 con 0x565216f48a50 2023-10-14T18:52:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d82ffd700 1 -- 172.21.15.79:0/3394058492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d90022070 con 0x565216f48a50 2023-10-14T18:52:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2d82ffd700 1 -- 172.21.15.79:0/3394058492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90007e10 con 0x565216f48a50 2023-10-14T18:52:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 -- 172.21.15.79:0/3394058492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 msgr2=0x565216f48e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000bcc0 tx=0x7f2d90020070 comp rx=0 tx=0).stop 2023-10-14T18:52:09.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 -- 172.21.15.79:0/3394058492 shutdown_connections 2023-10-14T18:52:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f71f60 0x565216f44cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f48e20 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/3394058492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f92d00 0x565216f71a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.626+0000 7f2da8f4db80 1 -- 172.21.15.79:0/3394058492 >> 172.21.15.79:0/3394058492 conn(0x565216f4a370 msgr2=0x565216f4a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.627+0000 7f2da8f4db80 1 -- 172.21.15.79:0/3394058492 shutdown_connections 2023-10-14T18:52:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.627+0000 7f2da8f4db80 1 -- 172.21.15.79:0/3394058492 wait complete. 2023-10-14T18:52:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.627+0000 7f2da8f4db80 1 -- start start 2023-10-14T18:52:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.627+0000 7f2da8f4db80 1 Processor -- start 2023-10-14T18:52:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f8b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f8cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216e44890 con 0x565216f48a50 2023-10-14T18:52:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216e5fea0 con 0x565216f71f60 2023-10-14T18:52:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x565216d1be30 con 0x565216f92d00 2023-10-14T18:52:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2da8f4db80 10 client.0 _ll_register_callbacks cb 0x565216f0c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:52:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57894/0 (socket says 172.21.15.79:57894) 2023-10-14T18:52:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/1756585998 learned_addr learned my addr 172.21.15.79:0/1756585998 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f8cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f8b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 msgr2=0x565216f8cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f8cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 msgr2=0x565216f8b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f8b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d9f0700 1 -- 172.21.15.79:0/1756585998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9815c560 con 0x565216f48a50 2023-10-14T18:52:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f8b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.628+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f8cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:09.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009ab0 tx=0x7f2d9002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1e8a50b59c837f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:52:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9001fc90 con 0x565216f48a50 2023-10-14T18:52:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d90024070 con 0x565216f48a50 2023-10-14T18:52:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565216f3db70 con 0x565216f48a50 2023-10-14T18:52:09.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d90032410 con 0x565216f48a50 2023-10-14T18:52:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 10 client.7611 fetch_fsmap learned FSMap version 72 2023-10-14T18:52:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x565216cd5fe0 con 0x565216f48a50 2023-10-14T18:52:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565216f3db70 con 0x565216f48a50 2023-10-14T18:52:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 72) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2d90032570 con 0x565216f48a50 2023-10-14T18:52:09.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 10 client.7611 fetch_fsmap finished waiting for FSMap version 72 2023-10-14T18:52:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 10 client.7611 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T18:52:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 20 client.7611 populate_metadata read hostname 'smithi079' 2023-10-14T18:52:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f784c0 0x565216f86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 4 client.7611 mds_command: new command op to 7494 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:52:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 --> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565216f1aaa0 con 0x565216f784c0 2023-10-14T18:52:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.629+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f784c0 0x565216f86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.630+0000 7f2d77fff700 10 client.7611 ms_handle_connect on v2:172.21.15.144:6835/1059423837 2023-10-14T18:52:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.630+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f784c0 0x565216f86c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36884202fd2b591a server_cookie=8df65c8e9a9609da in_seq=0 out_seq=0 2023-10-14T18:52:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2d77fff700 1 -- 172.21.15.79:0/1756585998 <== mds.0 v2:172.21.15.144:6835/1059423837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x565216f1aaa0 con 0x565216f784c0 2023-10-14T18:52:09.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2d77fff700 10 client.7611 handle_command_reply: tid=0 2023-10-14T18:52:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 client.7611 shutdown 2023-10-14T18:52:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 msgr2=0x565216f88320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009ab0 tx=0x7f2d9002b000 comp rx=0 tx=0).stop 2023-10-14T18:52:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 shutdown_connections 2023-10-14T18:52:09.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f784c0 0x565216f86c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f8cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f48a50 0x565216f88320 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1756585998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f8b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 >> 172.21.15.79:0/1756585998 conn(0x565216f4a370 msgr2=0x565216f45930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2d77fff700 0 client.7611 ms_handle_reset on v2:172.21.15.144:6835/1059423837 2023-10-14T18:52:09.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 shutdown_connections 2023-10-14T18:52:09.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1756585998 wait complete. 2023-10-14T18:52:09.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.631+0000 7f2da8f4db80 20 client.7611 trim_cache size 0 max 16384 2023-10-14T18:52:09.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.647+0000 7f2da8f4db80 1 Processor -- start 2023-10-14T18:52:09.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 -- start start 2023-10-14T18:52:09.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f48a50 0x565216f70a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f91090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216f46e00 con 0x565216f71f60 2023-10-14T18:52:09.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216f214b0 con 0x565216f48a50 2023-10-14T18:52:09.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x565216f8d150 con 0x565216f92d00 2023-10-14T18:52:09.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2d9d1ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2d9d1ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57902/0 (socket says 172.21.15.79:57902) 2023-10-14T18:52:09.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2d9d1ef700 1 -- 172.21.15.79:0/1487855569 learned_addr learned my addr 172.21.15.79:0/1487855569 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f48a50 0x565216f70a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.648+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f91090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 -- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 msgr2=0x565216f91090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f91090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 -- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f48a50 msgr2=0x565216f70a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f48a50 0x565216f70a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 -- 172.21.15.79:0/1487855569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565216f44490 con 0x565216f71f60 2023-10-14T18:52:09.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2d9815aa20 tx=0x7f2d8801c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab3b5224da684b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d837fe700 1 -- 172.21.15.79:0/1487855569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d88016bb0 con 0x565216f71f60 2023-10-14T18:52:09.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d837fe700 1 -- 172.21.15.79:0/1487855569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8801c040 con 0x565216f71f60 2023-10-14T18:52:09.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2d837fe700 1 -- 172.21.15.79:0/1487855569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8801e400 con 0x565216f71f60 2023-10-14T18:52:09.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1487855569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 msgr2=0x565216f70fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2d9815aa20 tx=0x7f2d8801c250 comp rx=0 tx=0).stop 2023-10-14T18:52:09.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1487855569 shutdown_connections 2023-10-14T18:52:09.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f92d00 0x565216f91090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f48a50 0x565216f70a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/1487855569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f71f60 0x565216f70fb0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1487855569 >> 172.21.15.79:0/1487855569 conn(0x565216f4a370 msgr2=0x565216f48e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1487855569 shutdown_connections 2023-10-14T18:52:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.649+0000 7f2da8f4db80 1 -- 172.21.15.79:0/1487855569 wait complete. 2023-10-14T18:52:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.650+0000 7f2da8f4db80 1 -- start start 2023-10-14T18:52:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.650+0000 7f2da8f4db80 1 Processor -- start 2023-10-14T18:52:09.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 0x565216f91090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216ff67f0 con 0x565216f92d00 2023-10-14T18:52:09.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565216ff5ab0 con 0x565216f71f60 2023-10-14T18:52:09.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x565216ff5fe0 con 0x565216f48a50 2023-10-14T18:52:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 10 client.0 _ll_register_callbacks cb 0x565216f0c110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:52:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57904/0 (socket says 172.21.15.79:57904) 2023-10-14T18:52:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/654300132 learned_addr learned my addr 172.21.15.79:0/654300132 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 0x565216f91090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 msgr2=0x565216f91090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 0x565216f91090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 msgr2=0x565216f915d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f915d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 -- 172.21.15.79:0/654300132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8800e040 con 0x565216f92d00 2023-10-14T18:52:09.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 0x565216f91090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:09.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9d1ef700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f915d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:09.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d9e1f1700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006fd0 tx=0x7f2d94058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef77cc678660312 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d77fff700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:52:09.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9405c900 con 0x565216f92d00 2023-10-14T18:52:09.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d9407ed50 con 0x565216f92d00 2023-10-14T18:52:09.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.651+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d90022070 con 0x565216f92d00 2023-10-14T18:52:09.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d9407ef10 con 0x565216f92d00 2023-10-14T18:52:09.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 10 client.7617 fetch_fsmap learned FSMap version 72 2023-10-14T18:52:09.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x565216e67780 con 0x565216f92d00 2023-10-14T18:52:09.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d94060070 con 0x565216f92d00 2023-10-14T18:52:09.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 72) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2d94071020 con 0x565216f92d00 2023-10-14T18:52:09.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 10 client.7617 fetch_fsmap finished waiting for FSMap version 72 2023-10-14T18:52:09.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 10 client.7617 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T18:52:09.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 20 client.7617 populate_metadata read hostname 'smithi079' 2023-10-14T18:52:09.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f86300 0x565216f88c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 4 client.7617 mds_command: new command op to 7494 tid=0[{"prefix": "status"}] 2023-10-14T18:52:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 --> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565216e3be00 con 0x565216f86300 2023-10-14T18:52:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f86300 0x565216f88c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d77fff700 10 client.7617 ms_handle_connect on v2:172.21.15.144:6835/1059423837 2023-10-14T18:52:09.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.652+0000 7f2d9d9f0700 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f86300 0x565216f88c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d32ed39e020e57 server_cookie=33a90b1aef8cbf18 in_seq=0 out_seq=0 2023-10-14T18:52:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d77fff700 1 -- 172.21.15.79:0/654300132 <== mds.0 v2:172.21.15.144:6835/1059423837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x565216e3be00 con 0x565216f86300 2023-10-14T18:52:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d77fff700 10 client.7617 handle_command_reply: tid=0 2023-10-14T18:52:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 client.7617 shutdown 2023-10-14T18:52:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 msgr2=0x565216f85dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006fd0 tx=0x7f2d94058040 comp rx=0 tx=0).stop 2023-10-14T18:52:09.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 shutdown_connections 2023-10-14T18:52:09.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:6835/1059423837,v1:172.21.15.144:6837/1059423837] conn(0x565216f86300 0x565216f88c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565216f92d00 0x565216f85dc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d77fff700 0 client.7617 ms_handle_reset on v2:172.21.15.144:6835/1059423837 2023-10-14T18:52:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x565216f48a50 0x565216f91090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 --2- 172.21.15.79:0/654300132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565216f71f60 0x565216f915d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 >> 172.21.15.79:0/654300132 conn(0x565216f4a370 msgr2=0x565216f49420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 shutdown_connections 2023-10-14T18:52:09.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 1 -- 172.21.15.79:0/654300132 wait complete. 2023-10-14T18:52:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2da8f4db80 20 client.7617 trim_cache size 0 max 16384 2023-10-14T18:52:09.684 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:52:09.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:52:09.685 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:52:09.685 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7494, 2023-10-14T18:52:09.685 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:52:09.685 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:52:09.686 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:52:09.686 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.8170109590000001, 2023-10-14T18:52:09.686 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 72, 2023-10-14T18:52:09.686 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 154, 2023-10-14T18:52:09.687 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 154, 2023-10-14T18:52:09.687 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 10.923399176 2023-10-14T18:52:09.687 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:52:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 msgr2=0x7f2d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 0x7f2d7c0693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009880 tx=0x7f2d90018000 comp rx=0 tx=0).stop 2023-10-14T18:52:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 msgr2=0x7f2d980b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.653+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400d860 tx=0x7f2d94008040 comp rx=0 tx=0).stop 2023-10-14T18:52:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 shutdown_connections 2023-10-14T18:52:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2d7c066f30 0x7f2d7c0693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d9815d580 0x7f2d980b2ca0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2d98157870 0x7f2d98144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 --2- 172.21.15.79:0/280239165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d9815a620 0x7f2d980b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 >> 172.21.15.79:0/280239165 conn(0x7f2d98068ce0 msgr2=0x7f2d981568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 shutdown_connections 2023-10-14T18:52:09.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.654+0000 7f2d9fc54700 1 -- 172.21.15.79:0/280239165 wait complete. 2023-10-14T18:52:09.692 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:52:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.804+0000 7ff9c0a3c700 1 Processor -- start 2023-10-14T18:52:09.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.804+0000 7ff9c0a3c700 1 -- start start 2023-10-14T18:52:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9c0a3c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9bc0af000 0x7ff9bc0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9c0a3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0affa0 0x7ff9bc0a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9c0a3c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0ccac0 con 0x7ff9bc0af3d0 2023-10-14T18:52:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9c0a3c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0a8050 con 0x7ff9bc0af000 2023-10-14T18:52:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9c0a3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0b1930 con 0x7ff9bc0affa0 2023-10-14T18:52:09.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9ba59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9bc0af000 0x7ff9bc0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9bad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9bc0af3d0 0x7ff9bc0a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56298/0 (socket says 172.21.15.79:56298) 2023-10-14T18:52:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9ba59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff9bc0af000 0x7ff9bc0b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57916/0 (socket says 172.21.15.79:57916) 2023-10-14T18:52:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9bad9d700 1 -- 172.21.15.79:0/2110657308 learned_addr learned my addr 172.21.15.79:0/2110657308 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:09.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.805+0000 7ff9b9d9b700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0affa0 0x7ff9bc0a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9ba59c700 1 -- 172.21.15.79:0/2110657308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0affa0 msgr2=0x7ff9bc0a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9ba59c700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0affa0 0x7ff9bc0a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9ba59c700 1 -- 172.21.15.79:0/2110657308 >> v1:172.21.15.79:6789/0 conn(0x7ff9bc0af3d0 legacy=0x7ff9bc0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9ba59c700 1 -- 172.21.15.79:0/2110657308 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0b1bd0 con 0x7ff9bc0af000 2023-10-14T18:52:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9b959a700 1 -- 172.21.15.79:0/2110657308 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813188692 0 0) 0x7ff9bc0ccac0 con 0x7ff9bc0af3d0 2023-10-14T18:52:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9ba59c700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0af000 0x7ff9bc0b13f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3bf742c2df3f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9b959a700 1 -- 172.21.15.79:0/2110657308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00e070 con 0x7ff9bc0af000 2023-10-14T18:52:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9b959a700 1 -- 172.21.15.79:0/2110657308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00bbf0 con 0x7ff9bc0af000 2023-10-14T18:52:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9b959a700 1 -- 172.21.15.79:0/2110657308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac012430 con 0x7ff9bc0af000 2023-10-14T18:52:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/2110657308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0af000 msgr2=0x7ff9bc0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.806+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0af000 0x7ff9bc0b13f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).stop 2023-10-14T18:52:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/2110657308 shutdown_connections 2023-10-14T18:52:09.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0af000 0x7ff9bc0b13f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/2110657308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0affa0 0x7ff9bc0a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/2110657308 >> 172.21.15.79:0/2110657308 conn(0x7ff9bc0cd1e0 msgr2=0x7ff9bc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/2110657308 shutdown_connections 2023-10-14T18:52:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.807+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/2110657308 wait complete. 2023-10-14T18:52:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 Processor -- start 2023-10-14T18:52:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 -- start start 2023-10-14T18:52:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9bc0af000 0x7ff9bc097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0af3d0 0x7ff9bc156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc09a510 con 0x7ff9bc0affa0 2023-10-14T18:52:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc157380 con 0x7ff9bc0af000 2023-10-14T18:52:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9c0a3c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ac2e0 con 0x7ff9bc0af3d0 2023-10-14T18:52:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9bad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.808+0000 7ff9bad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57924/0 (socket says 172.21.15.79:57924) 2023-10-14T18:52:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 -- 172.21.15.79:0/4220673449 learned_addr learned my addr 172.21.15.79:0/4220673449 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9b9d9b700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0af3d0 0x7ff9bc156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9ba59c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9bc0af000 0x7ff9bc097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 -- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0af3d0 msgr2=0x7ff9bc156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0af3d0 0x7ff9bc156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 -- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9bc0af000 msgr2=0x7ff9bc097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9bc0af000 0x7ff9bc097a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 -- 172.21.15.79:0/4220673449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009a20 con 0x7ff9bc0affa0 2023-10-14T18:52:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9bad9d700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c7e0 tx=0x7ff9b4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4005c00 con 0x7ff9bc0affa0 2023-10-14T18:52:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005d60 con 0x7ff9bc0affa0 2023-10-14T18:52:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc0ac5c0 con 0x7ff9bc0affa0 2023-10-14T18:52:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4004a80 con 0x7ff9bc0affa0 2023-10-14T18:52:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.809+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc09a1a0 con 0x7ff9bc0affa0 2023-10-14T18:52:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.810+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0a8220 con 0x7ff9bc0affa0 2023-10-14T18:52:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.810+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9b4005030 con 0x7ff9bc0affa0 2023-10-14T18:52:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.811+0000 7ff9aa7fc700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.811+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b40839a0 con 0x7ff9bc0affa0 2023-10-14T18:52:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.811+0000 7ff9ba59c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.811+0000 7ff9ba59c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0097c0 tx=0x7ff9ac019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:09.815+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9b404b5a0 con 0x7ff9bc0affa0 2023-10-14T18:52:09.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:09.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:10.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.046+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9bc04c3c0 con 0x7ff9bc0affa0 2023-10-14T18:52:10.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.046+0000 7ff9aa7fc700 1 -- 172.21.15.79:0/4220673449 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff9bc0a8220 con 0x7ff9bc0affa0 2023-10-14T18:52:10.049 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:52:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 msgr2=0x7ff99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0097c0 tx=0x7ff9ac019000 comp rx=0 tx=0).stop 2023-10-14T18:52:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 msgr2=0x7ff9bc0a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c7e0 tx=0x7ff9b4007d90 comp rx=0 tx=0).stop 2023-10-14T18:52:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 shutdown_connections 2023-10-14T18:52:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9bc0affa0 0x7ff9bc0a9e00 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9bc0af000 0x7ff9bc097a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 --2- 172.21.15.79:0/4220673449 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9bc0af3d0 0x7ff9bc156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 >> 172.21.15.79:0/4220673449 conn(0x7ff9bc0cd1e0 msgr2=0x7ff9bc06f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:10.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 shutdown_connections 2023-10-14T18:52:10.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.049+0000 7ff9c0a3c700 1 -- 172.21.15.79:0/4220673449 wait complete. 2023-10-14T18:52:10.062 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:52:10.063 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:52:10.063 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:52:10.063 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:52:10.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:52:10.064 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:52:10.064 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:52:10.065 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:52:10.065 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:52:10.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.066 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:52:10.117 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:52:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:52:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:52:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.118 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:52:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:10.119 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:52:10.119 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:52:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:10.120 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:52:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:52:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42104sec preferred_lft 42104sec 2023-10-14T18:52:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:52:10.121 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:52:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:52:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.122 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:52:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:52:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:52:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:52:10.123 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:52:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:52:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:52:10.124 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:10.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.125 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:52:10.180 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:52:10.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.182 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:52:10.237 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:52:10.237 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:52:10.238 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:52:10.238 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:52:10.238 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:52:10.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.239 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:52:10.240 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:52:10.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:52:10.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:52:10.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:52:10.241 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:52:10.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.337 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:52:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:52:10.352 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:52:10.353 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:52:10.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:52:10.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:52:10.417 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:52:10.471 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:52:10.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:52:10.472 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:52:10.525 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:52:10.526 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:52:10.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:52:10.605 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:52:10.605 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:52:10.605 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:52:10.613 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:52:10.613 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:52:10.614 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:52:10.614 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:52:10.614 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:52:10.635 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:52:10.635 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:52:10.635 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:52:10.635 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:52:10.636 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:52:10.636 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:52:10.636 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:52:10.636 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:52:10.637 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:52:10.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:10.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:52:10.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:52:10.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.856+0000 7f322e133700 1 Processor -- start 2023-10-14T18:52:10.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.856+0000 7f322e133700 1 -- start start 2023-10-14T18:52:10.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f322e133700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3228157870 0x7f322815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f322e133700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3228157c40 0x7f3228158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f322e133700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322815cbb0 con 0x7f322815a620 2023-10-14T18:52:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f322e133700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322815bfa0 con 0x7f3228157c40 2023-10-14T18:52:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f322e133700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322815c280 con 0x7f3228157870 2023-10-14T18:52:10.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3228157c40 0x7f3228158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3228157c40 0x7f3228158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57934/0 (socket says 172.21.15.79:57934) 2023-10-14T18:52:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 -- 172.21.15.79:0/1578693238 learned_addr learned my addr 172.21.15.79:0/1578693238 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f32277fe700 1 --2- 172.21.15.79:0/1578693238 >> v2:172.21.15.144:3300/0 conn(0x7f3228157870 0x7f322815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 -- 172.21.15.79:0/1578693238 >> v2:172.21.15.144:3300/0 conn(0x7f3228157870 msgr2=0x7f322815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 --2- 172.21.15.79:0/1578693238 >> v2:172.21.15.144:3300/0 conn(0x7f3228157870 0x7f322815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 -- 172.21.15.79:0/1578693238 >> v1:172.21.15.144:6789/0 conn(0x7f322815a620 legacy=0x7f322815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 -- 172.21.15.79:0/1578693238 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322815c560 con 0x7f3228157c40 2023-10-14T18:52:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.857+0000 7f3227fff700 1 --2- 172.21.15.79:0/1578693238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f3228158110 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3228069d80 tx=0x7f3220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773b27e8bc8786e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:10.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f32267fc700 1 -- 172.21.15.79:0/1578693238 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000b820 con 0x7f3228157c40 2023-10-14T18:52:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f32267fc700 1 -- 172.21.15.79:0/1578693238 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000b980 con 0x7f3228157c40 2023-10-14T18:52:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f32267fc700 1 -- 172.21.15.79:0/1578693238 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322000bd20 con 0x7f3228157c40 2023-10-14T18:52:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 -- 172.21.15.79:0/1578693238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 msgr2=0x7f3228158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 --2- 172.21.15.79:0/1578693238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f3228158110 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3228069d80 tx=0x7f3220009250 comp rx=0 tx=0).stop 2023-10-14T18:52:10.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 -- 172.21.15.79:0/1578693238 shutdown_connections 2023-10-14T18:52:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 --2- 172.21.15.79:0/1578693238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f3228158110 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 --2- 172.21.15.79:0/1578693238 >> v2:172.21.15.144:3300/0 conn(0x7f3228157870 0x7f322815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 -- 172.21.15.79:0/1578693238 >> 172.21.15.79:0/1578693238 conn(0x7f3228068ce0 msgr2=0x7f32280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 -- 172.21.15.79:0/1578693238 shutdown_connections 2023-10-14T18:52:10.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.858+0000 7f322e133700 1 -- 172.21.15.79:0/1578693238 wait complete. 2023-10-14T18:52:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.859+0000 7f322e133700 1 Processor -- start 2023-10-14T18:52:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.859+0000 7f322e133700 1 -- start start 2023-10-14T18:52:10.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 0x7f322815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f322815a620 0x7f3228155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32280c5b10 con 0x7f3228157c40 2023-10-14T18:52:10.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322815e550 con 0x7f322815a620 2023-10-14T18:52:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f322e133700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32281559d0 con 0x7f3228157870 2023-10-14T18:52:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f3226ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f3226ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57936/0 (socket says 172.21.15.79:57936) 2023-10-14T18:52:10.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f3226ffd700 1 -- 172.21.15.79:0/2127093190 learned_addr learned my addr 172.21.15.79:0/2127093190 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f32277fe700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 0x7f322815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.860+0000 7f3227fff700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f322815a620 0x7f3228155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 -- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 msgr2=0x7f322815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 0x7f322815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 -- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f322815a620 msgr2=0x7f3228155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f322815a620 0x7f3228155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 -- 172.21.15.79:0/2127093190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094f0 con 0x7f3228157c40 2023-10-14T18:52:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f32277fe700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 0x7f322815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:52:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f3226ffd700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b5e0 tx=0x7f321c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:10.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00f510 con 0x7f3228157c40 2023-10-14T18:52:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c00f6b0 con 0x7f3228157c40 2023-10-14T18:52:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c00fa70 con 0x7f3228157c40 2023-10-14T18:52:10.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322815e7b0 con 0x7f3228157c40 2023-10-14T18:52:10.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.861+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322815ed70 con 0x7f3228157c40 2023-10-14T18:52:10.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.862+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32280c5cc0 con 0x7f3228157c40 2023-10-14T18:52:10.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.862+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f321c01a400 con 0x7f3228157c40 2023-10-14T18:52:10.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.863+0000 7f320f7fe700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 0x7f32140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:10.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.863+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f321c083fb0 con 0x7f3228157c40 2023-10-14T18:52:10.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.863+0000 7f32277fe700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 0x7f32140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:10.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.863+0000 7f32277fe700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 0x7f32140693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f32180075e0 tx=0x7f32180097e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:10.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:10.867+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32280c5cc0 con 0x7f3228157c40 2023-10-14T18:52:11.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.095+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32280c5cc0 con 0x7f3228157c40 2023-10-14T18:52:11.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.096+0000 7f320f7fe700 1 -- 172.21.15.79:0/2127093190 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32280c5cc0 con 0x7f3228157c40 2023-10-14T18:52:11.098 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:52:11.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 msgr2=0x7f32140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 0x7f32140693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f32180075e0 tx=0x7f32180097e0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 msgr2=0x7f322815e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f321c00b5e0 tx=0x7f321c0090f0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 shutdown_connections 2023-10-14T18:52:11.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3214066f30 0x7f32140693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f322815a620 0x7f3228155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3228157870 0x7f322815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 --2- 172.21.15.79:0/2127093190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3228157c40 0x7f322815e010 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 >> 172.21.15.79:0/2127093190 conn(0x7f3228068ce0 msgr2=0x7f32280b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:11.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 shutdown_connections 2023-10-14T18:52:11.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.098+0000 7f322e133700 1 -- 172.21.15.79:0/2127093190 wait complete. 2023-10-14T18:52:11.111 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:52:11.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:52:11.112 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:52:11.113 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:52:11.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:52:11.114 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:52:11.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:52:11.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:52:11.115 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:52:11.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.116 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:52:11.135 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:52:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:52:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:52:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:52:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.138 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:52:11.139 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:52:11.140 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:52:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:11.141 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:52:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:52:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42095sec preferred_lft 42095sec 2023-10-14T18:52:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:52:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.144 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:52:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:52:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:52:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:52:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.146 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:52:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:52:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:52:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.147 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:52:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:52:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:52:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:52:11.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.149 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:52:11.206 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:52:11.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.207 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:52:11.264 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:52:11.264 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:52:11.264 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:52:11.265 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:52:11.265 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:52:11.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.266 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:52:11.266 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:52:11.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:52:11.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:52:11.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:52:11.268 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:52:11.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.369 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:52:11.384 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:52:11.385 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:52:11.385 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:52:11.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:52:11.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:52:11.450 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:52:11.504 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:52:11.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:52:11.505 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:52:11.558 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:52:11.559 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:52:11.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:52:11.638 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:52:11.638 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:52:11.638 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:52:11.646 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:52:11.646 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:52:11.646 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:52:11.646 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:52:11.647 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:52:11.667 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:52:11.667 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:52:11.667 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:52:11.668 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:52:11.668 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:52:11.668 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:52:11.668 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:52:11.669 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:52:11.669 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:52:11.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:52:11.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:52:11.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:52:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.854+0000 7fa0e4e98700 1 Processor -- start 2023-10-14T18:52:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.854+0000 7fa0e4e98700 1 -- start start 2023-10-14T18:52:11.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0e4e98700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0e01438f0 0x7fa0e00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:11.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0e4e98700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00d0870 con 0x7fa0e0143520 2023-10-14T18:52:11.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0e4e98700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00cdfb0 con 0x7fa0e006ab50 2023-10-14T18:52:11.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0e4e98700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00cfc60 con 0x7fa0e01438f0 2023-10-14T18:52:11.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0df7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa0e0143520 0x7fa0e006a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56310/0 (socket says 172.21.15.79:56310) 2023-10-14T18:52:11.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0df7fe700 1 -- 172.21.15.79:0/2445466213 learned_addr learned my addr 172.21.15.79:0/2445466213 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:11.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.855+0000 7fa0dffff700 1 --2- 172.21.15.79:0/2445466213 >> v2:172.21.15.144:3300/0 conn(0x7fa0e01438f0 0x7fa0e00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:11.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531390654 0 0) 0x7fa0e00d0870 con 0x7fa0e0143520 2023-10-14T18:52:11.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c8003570 con 0x7fa0e0143520 2023-10-14T18:52:11.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890175780 0 0) 0x7fa0e00cdfb0 con 0x7fa0e006ab50 2023-10-14T18:52:11.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e00d0870 con 0x7fa0e006ab50 2023-10-14T18:52:11.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0dffff700 1 -- 172.21.15.79:0/2445466213 >> v1:172.21.15.144:6789/0 conn(0x7fa0e006ab50 legacy=0x7fa0e00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0dffff700 1 -- 172.21.15.79:0/2445466213 >> v1:172.21.15.79:6789/0 conn(0x7fa0e0143520 legacy=0x7fa0e006a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0dffff700 1 -- 172.21.15.79:0/2445466213 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00cff40 con 0x7fa0e01438f0 2023-10-14T18:52:11.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0dffff700 1 --2- 172.21.15.79:0/2445466213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e01438f0 0x7fa0e00cf580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa0e015a4e0 tx=0x7fa0d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed559457e5a9af05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:11.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8016070 con 0x7fa0e01438f0 2023-10-14T18:52:11.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d800bab0 con 0x7fa0e01438f0 2023-10-14T18:52:11.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.856+0000 7fa0de7fc700 1 -- 172.21.15.79:0/2445466213 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800e070 con 0x7fa0e01438f0 2023-10-14T18:52:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 -- 172.21.15.79:0/2445466213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e01438f0 msgr2=0x7fa0e00cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/2445466213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e01438f0 0x7fa0e00cf580 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa0e015a4e0 tx=0x7fa0d8009780 comp rx=0 tx=0).stop 2023-10-14T18:52:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 -- 172.21.15.79:0/2445466213 shutdown_connections 2023-10-14T18:52:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/2445466213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e01438f0 0x7fa0e00cf580 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 -- 172.21.15.79:0/2445466213 >> 172.21.15.79:0/2445466213 conn(0x7fa0e0069750 msgr2=0x7fa0e00b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:11.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 -- 172.21.15.79:0/2445466213 shutdown_connections 2023-10-14T18:52:11.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.857+0000 7fa0e4e98700 1 -- 172.21.15.79:0/2445466213 wait complete. 2023-10-14T18:52:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.858+0000 7fa0e4e98700 1 Processor -- start 2023-10-14T18:52:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.858+0000 7fa0e4e98700 1 -- start start 2023-10-14T18:52:11.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e006ab50 0x7fa0e013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0e01438f0 0x7fa0e0143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e015bc30 con 0x7fa0e0143520 2023-10-14T18:52:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e015c890 con 0x7fa0e006ab50 2023-10-14T18:52:11.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e013f4c0 con 0x7fa0e01438f0 2023-10-14T18:52:11.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:11.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57946/0 (socket says 172.21.15.79:57946) 2023-10-14T18:52:11.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 -- 172.21.15.79:0/504399955 learned_addr learned my addr 172.21.15.79:0/504399955 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:11.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0df7fe700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e006ab50 0x7fa0e013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0dffff700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0e01438f0 0x7fa0e0143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 -- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0e01438f0 msgr2=0x7fa0e0143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0e01438f0 0x7fa0e0143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 -- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e006ab50 msgr2=0x7fa0e013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:11.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e006ab50 0x7fa0e013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:11.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 -- 172.21.15.79:0/504399955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d8009a20 con 0x7fa0e0143520 2023-10-14T18:52:11.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0deffd700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7c0 tx=0x7fa0d4007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:11.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4002ea0 con 0x7fa0e0143520 2023-10-14T18:52:11.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4010510 con 0x7fa0e0143520 2023-10-14T18:52:11.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40108b0 con 0x7fa0e0143520 2023-10-14T18:52:11.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e015cdf0 con 0x7fa0e0143520 2023-10-14T18:52:11.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.859+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e015b6f0 con 0x7fa0e0143520 2023-10-14T18:52:11.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.860+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e015ba70 con 0x7fa0e0143520 2023-10-14T18:52:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.861+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0d4010c60 con 0x7fa0e0143520 2023-10-14T18:52:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.861+0000 7fa0c77fe700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 0x7fa0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.861+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0d4083bd0 con 0x7fa0e0143520 2023-10-14T18:52:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.861+0000 7fa0df7fe700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 0x7fa0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:11.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.862+0000 7fa0df7fe700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 0x7fa0cc0693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0007fd0 tx=0x7fa0d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:11.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:11.865+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0d4050e40 con 0x7fa0e0143520 2023-10-14T18:52:12.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.091+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0e015cf80 con 0x7fa0e0143520 2023-10-14T18:52:12.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.092+0000 7fa0c77fe700 1 -- 172.21.15.79:0/504399955 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa0d4017070 con 0x7fa0e0143520 2023-10-14T18:52:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:52:12.094 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:52:12.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 msgr2=0x7fa0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 0x7fa0cc0693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0007fd0 tx=0x7fa0d0009040 comp rx=0 tx=0).stop 2023-10-14T18:52:12.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 msgr2=0x7fa0e00c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400c7c0 tx=0x7fa0d4007dc0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 shutdown_connections 2023-10-14T18:52:12.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0cc066f30 0x7fa0cc0693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0e01438f0 0x7fa0e0143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0e006ab50 0x7fa0e013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 --2- 172.21.15.79:0/504399955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0e0143520 0x7fa0e00c59a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 >> 172.21.15.79:0/504399955 conn(0x7fa0e0069750 msgr2=0x7fa0e00cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:12.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 shutdown_connections 2023-10-14T18:52:12.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.093+0000 7fa0e4e98700 1 -- 172.21.15.79:0/504399955 wait complete. 2023-10-14T18:52:12.099 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:52:12.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-14T18:52:12.243 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":7494,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3949191879999994,"mdsmap_epoch":72,"osdmap_epoch":154,"osdmap_epoch_barrier":154,"uptime":13.501310681} 2023-10-14T18:52:12.244 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 7494, "mdsmap_epoch": 72, "osdmap_epoch": 154, "osdmap_epoch_barrier": 154, "rank_uptime": 8.394919188, "state": "up:active", "uptime": 13.501310681, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:52:12.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-14T18:52:12.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.363+0000 7f595dbd9700 1 Processor -- start 2023-10-14T18:52:12.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.363+0000 7f595dbd9700 1 -- start start 2023-10-14T18:52:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f595dbd9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f595815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f595dbd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59580b46f0 0x7f59580b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f595dbd9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580b5090 con 0x7f5958159ef0 2023-10-14T18:52:12.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f595dbd9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580b17b0 con 0x7f59580b46f0 2023-10-14T18:52:12.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f595dbd9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59580b1a60 con 0x7f59580b6a10 2023-10-14T18:52:12.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f59580b46f0 0x7f59580b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59577fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5958159ef0 0x7f59580b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56324/0 (socket says 172.21.15.79:56324) 2023-10-14T18:52:12.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59577fe700 1 -- 172.21.15.79:0/4019754747 learned_addr learned my addr 172.21.15.79:0/4019754747 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:52:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 --2- 172.21.15.79:0/4019754747 >> v2:172.21.15.79:3300/0 conn(0x7f59580b46f0 0x7f59580b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57958/0 (socket says 172.21.15.79:57958) 2023-10-14T18:52:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5956ffd700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f595815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 -- 172.21.15.79:0/4019754747 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 msgr2=0x7f595815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:52:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f595815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 -- 172.21.15.79:0/4019754747 >> v1:172.21.15.79:6789/0 conn(0x7f5958159ef0 legacy=0x7f59580b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59567fc700 1 -- 172.21.15.79:0/4019754747 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563667879 0 0) 0x7f5948001290 con 0x7f5958159ef0 2023-10-14T18:52:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 -- 172.21.15.79:0/4019754747 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580b1d40 con 0x7f59580b46f0 2023-10-14T18:52:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5956ffd700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f595815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:52:12.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f5957fff700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59580b46f0 0x7f59580b4b50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f5950009e60 tx=0x7f5950009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a5b697965b379 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59567fc700 1 -- 172.21.15.79:0/4019754747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000e070 con 0x7f59580b46f0 2023-10-14T18:52:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59567fc700 1 -- 172.21.15.79:0/4019754747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000bc30 con 0x7f59580b46f0 2023-10-14T18:52:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.364+0000 7f59567fc700 1 -- 172.21.15.79:0/4019754747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950012430 con 0x7f59580b46f0 2023-10-14T18:52:12.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 -- 172.21.15.79:0/4019754747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59580b46f0 msgr2=0x7f59580b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59580b46f0 0x7f59580b4b50 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f5950009e60 tx=0x7f5950009780 comp rx=0 tx=0).stop 2023-10-14T18:52:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 -- 172.21.15.79:0/4019754747 shutdown_connections 2023-10-14T18:52:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59580b46f0 0x7f59580b4b50 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 --2- 172.21.15.79:0/4019754747 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f595815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 -- 172.21.15.79:0/4019754747 >> 172.21.15.79:0/4019754747 conn(0x7f595809a0a0 msgr2=0x7f5958067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 -- 172.21.15.79:0/4019754747 shutdown_connections 2023-10-14T18:52:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.365+0000 7f595dbd9700 1 -- 172.21.15.79:0/4019754747 wait complete. 2023-10-14T18:52:12.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.366+0000 7f595dbd9700 1 Processor -- start 2023-10-14T18:52:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.366+0000 7f595dbd9700 1 -- start start 2023-10-14T18:52:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59580b46f0 0x7f5958152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f5958150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958153e00 con 0x7f5958159ef0 2023-10-14T18:52:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581542a0 con 0x7f59580b46f0 2023-10-14T18:52:12.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f595dbd9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958153840 con 0x7f59580b6a10 2023-10-14T18:52:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57970/0 (socket says 172.21.15.79:57970) 2023-10-14T18:52:12.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 -- 172.21.15.79:0/3714133074 learned_addr learned my addr 172.21.15.79:0/3714133074 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:52:12.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5956ffd700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f5958150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f59577fe700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59580b46f0 0x7f5958152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 -- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 msgr2=0x7f5958150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f5958150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 -- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59580b46f0 msgr2=0x7f5958152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:12.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59580b46f0 0x7f5958152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:12.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.367+0000 7f5957fff700 1 -- 172.21.15.79:0/3714133074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009a20 con 0x7f5958159ef0 2023-10-14T18:52:12.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f5957fff700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5958071f80 tx=0x7f5950019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:12.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950027470 con 0x7f5958159ef0 2023-10-14T18:52:12.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500275f0 con 0x7f5958159ef0 2023-10-14T18:52:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5958153b20 con 0x7f5958159ef0 2023-10-14T18:52:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500279b0 con 0x7f5958159ef0 2023-10-14T18:52:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.368+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958154790 con 0x7f5958159ef0 2023-10-14T18:52:12.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.369+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59581549b0 con 0x7f5958159ef0 2023-10-14T18:52:12.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.369+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5950024070 con 0x7f5958159ef0 2023-10-14T18:52:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.369+0000 7f593f7fe700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:52:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.370+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5950086e70 con 0x7f5958159ef0 2023-10-14T18:52:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.370+0000 7f59577fe700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:52:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.370+0000 7f59577fe700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 0x7f59440693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5948002a70 tx=0x7f5948009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:52:12.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.374+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5950054040 con 0x7f5958159ef0 2023-10-14T18:52:12.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:12.560+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f595804c3c0 con 0x7f5958159ef0 2023-10-14T18:52:13.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.548+0000 7f593f7fe700 1 -- 172.21.15.79:0/3714133074 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5950057660 con 0x7f5958159ef0 2023-10-14T18:52:13.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 msgr2=0x7f59440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:13.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 0x7f59440693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5948002a70 tx=0x7f5948009040 comp rx=0 tx=0).stop 2023-10-14T18:52:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 msgr2=0x7f5958151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:52:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f5958071f80 tx=0x7f5950019000 comp rx=0 tx=0).stop 2023-10-14T18:52:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 shutdown_connections 2023-10-14T18:52:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5944066f30 0x7f59440693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:13.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5958159ef0 0x7f5958151250 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59580b46f0 0x7f5958152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 --2- 172.21.15.79:0/3714133074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f59580b6a10 0x7f5958150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:52:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 >> 172.21.15.79:0/3714133074 conn(0x7f595809a0a0 msgr2=0x7f595815d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:52:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 shutdown_connections 2023-10-14T18:52:13.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:52:13.550+0000 7f595dbd9700 1 -- 172.21.15.79:0/3714133074 wait complete. 2023-10-14T18:52:13.554 INFO:teuthology.orchestra.run.smithi079.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-14T18:52:13.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:52:13.696 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:52:13.697 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:52:13.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-14T18:52:13.820 INFO:teuthology.orchestra.run.smithi079.stdout:{"mon_tick_interval":"5"} 2023-10-14T18:52:13.821 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-14T18:52:13.821 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-14T18:52:13.822 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:52:13.822 DEBUG:teuthology.orchestra.run.smithi079:> import time 2023-10-14T18:52:13.823 DEBUG:teuthology.orchestra.run.smithi079:> import datetime 2023-10-14T18:52:13.823 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-14T18:52:13.823 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:52:13.824 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.824 DEBUG:teuthology.orchestra.run.smithi079:> # Write some buffered data through before going full, all should be well 2023-10-14T18:52:13.824 DEBUG:teuthology.orchestra.run.smithi079:> print("writing some data through which we expect to succeed") 2023-10-14T18:52:13.825 DEBUG:teuthology.orchestra.run.smithi079:> bytes = 0 2023-10-14T18:52:13.825 DEBUG:teuthology.orchestra.run.smithi079:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-14T18:52:13.825 DEBUG:teuthology.orchestra.run.smithi079:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-14T18:52:13.826 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-14T18:52:13.826 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:52:13.826 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-14T18:52:13.827 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.827 DEBUG:teuthology.orchestra.run.smithi079:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-14T18:52:13.828 DEBUG:teuthology.orchestra.run.smithi079:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-14T18:52:13.828 DEBUG:teuthology.orchestra.run.smithi079:> # buffered IO, the error should always only appear from fsync and not 2023-10-14T18:52:13.828 DEBUG:teuthology.orchestra.run.smithi079:> # from write 2023-10-14T18:52:13.829 DEBUG:teuthology.orchestra.run.smithi079:> full = False 2023-10-14T18:52:13.829 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.829 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(32 * 0.9)): 2023-10-14T18:52:13.830 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:52:13.830 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-14T18:52:13.830 DEBUG:teuthology.orchestra.run.smithi079:> print("done writing {0} bytes".format(bytes)) 2023-10-14T18:52:13.831 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.831 DEBUG:teuthology.orchestra.run.smithi079:> # OK, now we should sneak in under the full condition 2023-10-14T18:52:13.831 DEBUG:teuthology.orchestra.run.smithi079:> # due to the time it takes the OSDs to report to the 2023-10-14T18:52:13.832 DEBUG:teuthology.orchestra.run.smithi079:> # mons, and get a successful fsync on our full-making data 2023-10-14T18:52:13.832 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:52:13.832 DEBUG:teuthology.orchestra.run.smithi079:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-14T18:52:13.833 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.833 DEBUG:teuthology.orchestra.run.smithi079:> # buffered write, add more dirty data to the buffer 2023-10-14T18:52:13.833 DEBUG:teuthology.orchestra.run.smithi079:> print("starting buffered write") 2023-10-14T18:52:13.834 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:52:13.834 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(32 * 0.2)): 2023-10-14T18:52:13.835 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:52:13.835 DEBUG:teuthology.orchestra.run.smithi079:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-14T18:52:13.835 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(15.0) 2023-10-14T18:52:13.836 DEBUG:teuthology.orchestra.run.smithi079:> except OSError: 2023-10-14T18:52:13.836 DEBUG:teuthology.orchestra.run.smithi079:> pass; 2023-10-14T18:52:13.836 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.837 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-14T18:52:13.837 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.837 DEBUG:teuthology.orchestra.run.smithi079:> # Wait long enough for a background flush that should fail 2023-10-14T18:52:13.838 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(30) 2023-10-14T18:52:13.838 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.838 DEBUG:teuthology.orchestra.run.smithi079:> if False: 2023-10-14T18:52:13.839 DEBUG:teuthology.orchestra.run.smithi079:> # ...and check that the failed background flush is reflected in fclose 2023-10-14T18:52:13.839 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:52:13.839 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:52:13.840 DEBUG:teuthology.orchestra.run.smithi079:> except OSError: 2023-10-14T18:52:13.840 DEBUG:teuthology.orchestra.run.smithi079:> print("close() returned an error as expected") 2023-10-14T18:52:13.841 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:52:13.841 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("close() failed to raise error") 2023-10-14T18:52:13.841 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:52:13.842 DEBUG:teuthology.orchestra.run.smithi079:> # The kernel cephfs client does not raise errors on fclose 2023-10-14T18:52:13.842 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:52:13.842 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:52:13.843 DEBUG:teuthology.orchestra.run.smithi079:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-14T18:52:13.843 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:52:40.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:40.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:10.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:10.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:40.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:40.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:10.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:10.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:18.917 INFO:teuthology.orchestra.run.smithi079.stdout:writing some data through which we expect to succeed 2023-10-14T18:54:18.917 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-14T18:54:18.918 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-14T18:54:18.918 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-14T18:54:18.919 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-14T18:54:18.919 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-14T18:54:18.919 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-14T18:54:18.920 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-14T18:54:18.920 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-14T18:54:18.922 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-14T18:54:18.923 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-14T18:54:18.923 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-14T18:54:18.923 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-14T18:54:18.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-14T18:54:18.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-14T18:54:18.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-14T18:54:18.924 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-14T18:54:18.925 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-14T18:54:18.925 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-14T18:54:18.925 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-14T18:54:18.926 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-14T18:54:18.926 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-14T18:54:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-14T18:54:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-14T18:54:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-14T18:54:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-14T18:54:18.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-14T18:54:18.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-14T18:54:18.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-14T18:54:18.928 INFO:teuthology.orchestra.run.smithi079.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-14T18:54:18.928 INFO:teuthology.orchestra.run.smithi079.stdout:done writing 29884416 bytes 2023-10-14T18:54:18.929 INFO:teuthology.orchestra.run.smithi079.stdout:successfully fsync'ed prior to getting full state reported 2023-10-14T18:54:18.929 INFO:teuthology.orchestra.run.smithi079.stdout:starting buffered write 2023-10-14T18:54:18.929 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.929 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.930 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.930 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.930 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.930 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:54:18.930 INFO:teuthology.orchestra.run.smithi079.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-14T18:54:19.070 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:54:19.071 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:54:19.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:54:19.168 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:54:19.168 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:54:19.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:54:19.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:54:19.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:54:19.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:19.215 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:54:19.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:54:19.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:54:19.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:54:19.272 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:54:19.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:19.273 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:54:19.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.449+0000 7f436e8d5700 1 Processor -- start 2023-10-14T18:54:19.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.449+0000 7f436e8d5700 1 -- start start 2023-10-14T18:54:19.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f436e8d5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f436815a620 0x7f436815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f436e8d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436815d580 0x7f4368158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f436e8d5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436815cbb0 con 0x7f4368157870 2023-10-14T18:54:19.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f436e8d5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436815bdb0 con 0x7f436815a620 2023-10-14T18:54:19.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f436e8d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436815bfa0 con 0x7f436815d580 2023-10-14T18:54:19.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f43677fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f436815a620 0x7f436815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f43677fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f436815a620 0x7f436815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39918/0 (socket says 172.21.15.79:39918) 2023-10-14T18:54:19.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.450+0000 7f43677fe700 1 -- 172.21.15.79:0/1001005561 learned_addr learned my addr 172.21.15.79:0/1001005561 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:19.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f436ce72700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436815d580 0x7f4368158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f43677fe700 1 -- 172.21.15.79:0/1001005561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436815d580 msgr2=0x7f4368158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f43677fe700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436815d580 0x7f4368158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f43677fe700 1 -- 172.21.15.79:0/1001005561 >> v1:172.21.15.79:6789/0 conn(0x7f4368157870 legacy=0x7f436815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f43677fe700 1 -- 172.21.15.79:0/1001005561 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436815c280 con 0x7f436815a620 2023-10-14T18:54:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f4366ffd700 1 -- 172.21.15.79:0/1001005561 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880194609 0 0) 0x7f436815cbb0 con 0x7f4368157870 2023-10-14T18:54:19.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f43677fe700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815a620 0x7f436815d040 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f435c0099b0 tx=0x7f435c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b50a7428aeac1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f4366ffd700 1 -- 172.21.15.79:0/1001005561 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c00b860 con 0x7f436815a620 2023-10-14T18:54:19.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f4366ffd700 1 -- 172.21.15.79:0/1001005561 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c00b9c0 con 0x7f436815a620 2023-10-14T18:54:19.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f4366ffd700 1 -- 172.21.15.79:0/1001005561 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c00bd60 con 0x7f436815a620 2023-10-14T18:54:19.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.451+0000 7f436e8d5700 1 -- 172.21.15.79:0/1001005561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815a620 msgr2=0x7f436815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815a620 0x7f436815d040 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f435c0099b0 tx=0x7f435c009250 comp rx=0 tx=0).stop 2023-10-14T18:54:19.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 -- 172.21.15.79:0/1001005561 shutdown_connections 2023-10-14T18:54:19.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f436815d580 0x7f4368158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 --2- 172.21.15.79:0/1001005561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815a620 0x7f436815d040 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 -- 172.21.15.79:0/1001005561 >> 172.21.15.79:0/1001005561 conn(0x7f4368068ce0 msgr2=0x7f43680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:19.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 -- 172.21.15.79:0/1001005561 shutdown_connections 2023-10-14T18:54:19.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.452+0000 7f436e8d5700 1 -- 172.21.15.79:0/1001005561 wait complete. 2023-10-14T18:54:19.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.453+0000 7f436e8d5700 1 Processor -- start 2023-10-14T18:54:19.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.453+0000 7f436e8d5700 1 -- start start 2023-10-14T18:54:19.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.453+0000 7f436e8d5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4368157870 0x7f43680b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43680b26e0 0x7f4368154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436816a7f0 con 0x7f436815d580 2023-10-14T18:54:19.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43681539a0 con 0x7f4368157870 2023-10-14T18:54:19.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436816aa00 con 0x7f43680b26e0 2023-10-14T18:54:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39922/0 (socket says 172.21.15.79:39922) 2023-10-14T18:54:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 -- 172.21.15.79:0/3994213236 learned_addr learned my addr 172.21.15.79:0/3994213236 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f4367fff700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4368157870 0x7f43680b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436ce72700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43680b26e0 0x7f4368154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 -- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43680b26e0 msgr2=0x7f4368154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43680b26e0 0x7f4368154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 -- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4368157870 msgr2=0x7f43680b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4368157870 0x7f43680b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0094f0 con 0x7f436815d580 2023-10-14T18:54:19.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f43677fe700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f435c009fd0 tx=0x7f435c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c011d70 con 0x7f436815d580 2023-10-14T18:54:19.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c024440 con 0x7f436815d580 2023-10-14T18:54:19.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436816ace0 con 0x7f436815d580 2023-10-14T18:54:19.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0247e0 con 0x7f436815d580 2023-10-14T18:54:19.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.454+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436816b2a0 con 0x7f436815d580 2023-10-14T18:54:19.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.455+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436804c3c0 con 0x7f436815d580 2023-10-14T18:54:19.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.456+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f435c01a420 con 0x7f436815d580 2023-10-14T18:54:19.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.456+0000 7f434ffff700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.456+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f435c0865d0 con 0x7f436815d580 2023-10-14T18:54:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.456+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f435406eb10 con 0x7f436815d580 2023-10-14T18:54:19.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.456+0000 7f4367fff700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.457+0000 7f4367fff700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43681683e0 tx=0x7f4358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.460+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f435c015060 con 0x7f436815d580 2023-10-14T18:54:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.682+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f436815c560 con 0x7f436815d580 2023-10-14T18:54:19.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.683+0000 7f434ffff700 1 -- 172.21.15.79:0/3994213236 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f435c015070 con 0x7f436815d580 2023-10-14T18:54:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:19.690 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:54:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 msgr2=0x7f43540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f43681683e0 tx=0x7f4358009040 comp rx=0 tx=0).stop 2023-10-14T18:54:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 msgr2=0x7f43681545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f435c009fd0 tx=0x7f435c017000 comp rx=0 tx=0).stop 2023-10-14T18:54:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 shutdown_connections 2023-10-14T18:54:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43680b26e0 0x7f4368154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4368157870 0x7f43680b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 --2- 172.21.15.79:0/3994213236 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f436815d580 0x7f43681545f0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 >> 172.21.15.79:0/3994213236 conn(0x7f4368068ce0 msgr2=0x7f436814c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 shutdown_connections 2023-10-14T18:54:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.685+0000 7f436e8d5700 1 -- 172.21.15.79:0/3994213236 wait complete. 2023-10-14T18:54:19.696 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:54:19.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:19.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 Processor -- start 2023-10-14T18:54:19.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 -- start start 2023-10-14T18:54:19.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bec15a6e0 0x7f7bec068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bec06f630 0x7f7bec15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec067660 con 0x7f7bec15aff0 2023-10-14T18:54:19.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec15b470 con 0x7f7bec06f630 2023-10-14T18:54:19.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf2425700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec0684c0 con 0x7f7bec15a6e0 2023-10-14T18:54:19.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7beb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bec06f630 0x7f7bec15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf09c2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7bec15aff0 0x7f7bec070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56418/0 (socket says 172.21.15.79:56418) 2023-10-14T18:54:19.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7bf09c2700 1 -- 172.21.15.79:0/920524702 learned_addr learned my addr 172.21.15.79:0/920524702 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:19.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.815+0000 7f7beb7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bec06f630 0x7f7bec15aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39934/0 (socket says 172.21.15.79:39934) 2023-10-14T18:54:19.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7bebfff700 1 --2- 172.21.15.79:0/920524702 >> v2:172.21.15.144:3300/0 conn(0x7f7bec15a6e0 0x7f7bec068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beb7fe700 1 -- 172.21.15.79:0/920524702 >> v2:172.21.15.144:3300/0 conn(0x7f7bec15a6e0 msgr2=0x7f7bec068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:19.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beb7fe700 1 --2- 172.21.15.79:0/920524702 >> v2:172.21.15.144:3300/0 conn(0x7f7bec15a6e0 0x7f7bec068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beb7fe700 1 -- 172.21.15.79:0/920524702 >> v1:172.21.15.79:6789/0 conn(0x7f7bec15aff0 legacy=0x7f7bec070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beb7fe700 1 -- 172.21.15.79:0/920524702 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec0678b0 con 0x7f7bec06f630 2023-10-14T18:54:19.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beaffd700 1 -- 172.21.15.79:0/920524702 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882186972 0 0) 0x7f7bec067660 con 0x7f7bec15aff0 2023-10-14T18:54:19.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beb7fe700 1 --2- 172.21.15.79:0/920524702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec06f630 0x7f7bec15aab0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0cd7b0 tx=0x7f7be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72740dfe78e1966 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beaffd700 1 -- 172.21.15.79:0/920524702 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000b6b0 con 0x7f7bec06f630 2023-10-14T18:54:19.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beaffd700 1 -- 172.21.15.79:0/920524702 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000b810 con 0x7f7bec06f630 2023-10-14T18:54:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.816+0000 7f7beaffd700 1 -- 172.21.15.79:0/920524702 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000bbb0 con 0x7f7bec06f630 2023-10-14T18:54:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 -- 172.21.15.79:0/920524702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec06f630 msgr2=0x7f7bec15aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 --2- 172.21.15.79:0/920524702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec06f630 0x7f7bec15aab0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0cd7b0 tx=0x7f7be00091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 -- 172.21.15.79:0/920524702 shutdown_connections 2023-10-14T18:54:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 --2- 172.21.15.79:0/920524702 >> v2:172.21.15.144:3300/0 conn(0x7f7bec15a6e0 0x7f7bec068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 --2- 172.21.15.79:0/920524702 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec06f630 0x7f7bec15aab0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 -- 172.21.15.79:0/920524702 >> 172.21.15.79:0/920524702 conn(0x7f7bec06a250 msgr2=0x7f7bec06a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:19.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 -- 172.21.15.79:0/920524702 shutdown_connections 2023-10-14T18:54:19.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.817+0000 7f7bf2425700 1 -- 172.21.15.79:0/920524702 wait complete. 2023-10-14T18:54:19.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.818+0000 7f7bf2425700 1 Processor -- start 2023-10-14T18:54:19.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.818+0000 7f7bf2425700 1 -- start start 2023-10-14T18:54:19.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bec06f630 0x7f7bec0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bec15aff0 0x7f7bec0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec0b1260 con 0x7f7bec15a6e0 2023-10-14T18:54:19.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec0b09a0 con 0x7f7bec15aff0 2023-10-14T18:54:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec0ad960 con 0x7f7bec06f630 2023-10-14T18:54:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39950/0 (socket says 172.21.15.79:39950) 2023-10-14T18:54:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 -- 172.21.15.79:0/1142431887 learned_addr learned my addr 172.21.15.79:0/1142431887 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bebfff700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bec06f630 0x7f7bec0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf09c2700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bec15aff0 0x7f7bec0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 -- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bec06f630 msgr2=0x7f7bec0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bec06f630 0x7f7bec0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 -- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bec15aff0 msgr2=0x7f7bec0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bec15aff0 0x7f7bec0ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:19.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0009420 con 0x7f7bec15a6e0 2023-10-14T18:54:19.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7beb7fe700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7be000b0e0 tx=0x7f7be0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000b980 con 0x7f7bec15a6e0 2023-10-14T18:54:19.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000bb00 con 0x7f7bec15a6e0 2023-10-14T18:54:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec0b0c10 con 0x7f7bec15a6e0 2023-10-14T18:54:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0025670 con 0x7f7bec15a6e0 2023-10-14T18:54:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.819+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec0b01a0 con 0x7f7bec15a6e0 2023-10-14T18:54:19.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.820+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec04c3c0 con 0x7f7bec15a6e0 2023-10-14T18:54:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.821+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7be0023070 con 0x7f7bec15a6e0 2023-10-14T18:54:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.821+0000 7f7bd3fff700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.821+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7be0085b60 con 0x7f7bec15a6e0 2023-10-14T18:54:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.821+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f7bd806eb10 con 0x7f7bec15a6e0 2023-10-14T18:54:19.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.821+0000 7f7bebfff700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.822+0000 7f7bebfff700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 0x7f7bd80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0098e0 tx=0x7f7bdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:19.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:19.825+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be0052d90 con 0x7f7bec15a6e0 2023-10-14T18:54:20.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.016+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bec06e800 con 0x7f7bec15a6e0 2023-10-14T18:54:20.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.017+0000 7f7bd3fff700 1 -- 172.21.15.79:0/1142431887 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f7be002a020 con 0x7f7bec15a6e0 2023-10-14T18:54:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:20.019 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":158,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:53:42.562998+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.5","mappings":[{"from":2,"to":0}]},{"pgid":"19.13","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:20.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 msgr2=0x7f7bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 0x7f7bd80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0098e0 tx=0x7f7bdc008040 comp rx=0 tx=0).stop 2023-10-14T18:54:20.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 msgr2=0x7f7bec16aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7be000b0e0 tx=0x7f7be0017000 comp rx=0 tx=0).stop 2023-10-14T18:54:20.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 shutdown_connections 2023-10-14T18:54:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bd8066f30 0x7f7bd80693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bec15aff0 0x7f7bec0ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7bec06f630 0x7f7bec0afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 --2- 172.21.15.79:0/1142431887 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bec15a6e0 0x7f7bec16aaa0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 >> 172.21.15.79:0/1142431887 conn(0x7f7bec06a250 msgr2=0x7f7bec0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 shutdown_connections 2023-10-14T18:54:20.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.019+0000 7f7bf2425700 1 -- 172.21.15.79:0/1142431887 wait complete. 2023-10-14T18:54:20.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:52:01.569233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:52:02.182441+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:54:20.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:54:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.148+0000 7fd1e2d75700 1 Processor -- start 2023-10-14T18:54:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.148+0000 7fd1e2d75700 1 -- start start 2023-10-14T18:54:20.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e2d75700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1dc0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e2d75700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1dc06acb0 0x7fd1dc0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e2d75700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0b0790 con 0x7fd1dc15a290 2023-10-14T18:54:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e2d75700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0ce1f0 con 0x7fd1dc06acb0 2023-10-14T18:54:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e2d75700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b0b20 con 0x7fd1dc159ec0 2023-10-14T18:54:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1d3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd1dc15a290 0x7fd1dc06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56420/0 (socket says 172.21.15.79:56420) 2023-10-14T18:54:20.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1d3fff700 1 -- 172.21.15.79:0/2345042296 learned_addr learned my addr 172.21.15.79:0/2345042296 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.149+0000 7fd1e1312700 1 --2- 172.21.15.79:0/2345042296 >> v2:172.21.15.144:3300/0 conn(0x7fd1dc06acb0 0x7fd1dc0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1dc0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858042139 0 0) 0x7fd1dc0b0790 con 0x7fd1dc15a290 2023-10-14T18:54:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c4003570 con 0x7fd1dc15a290 2023-10-14T18:54:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273526005 0 0) 0x7fd1c4003570 con 0x7fd1dc15a290 2023-10-14T18:54:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 msgr2=0x7fd1dc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1dc0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 >> v2:172.21.15.144:3300/0 conn(0x7fd1dc06acb0 msgr2=0x7fd1dc0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 --2- 172.21.15.79:0/2345042296 >> v2:172.21.15.144:3300/0 conn(0x7fd1dc06acb0 0x7fd1dc0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0b04b0 con 0x7fd1dc15a290 2023-10-14T18:54:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd1cc001470 con 0x7fd1dc15a290 2023-10-14T18:54:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 >> v1:172.21.15.79:6789/0 conn(0x7fd1dc15a290 legacy=0x7fd1dc06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c4003a60 0x7fd1c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4004d50 0x7fd1c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0ce1f0 con 0x7fd1c4003a60 2023-10-14T18:54:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0b0b20 con 0x7fd1c4004d50 2023-10-14T18:54:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c400ba60 con 0x7fd1dc159ec0 2023-10-14T18:54:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c4003a60 0x7fd1c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1d3fff700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e1312700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4004d50 0x7fd1c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 -- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 msgr2=0x7fd1c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc159ec0 0x7fd1c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 -- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4004d50 msgr2=0x7fd1c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4004d50 0x7fd1c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.150+0000 7fd1e0b11700 1 -- 172.21.15.79:0/2345042296 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4003570 con 0x7fd1c4003a60 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c4003a60 0x7fd1c4003e70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009c00 tx=0x7fd1d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b06fe04c40414f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800e6b0 con 0x7fd1c4003a60 2023-10-14T18:54:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800e810 con 0x7fd1c4003a60 2023-10-14T18:54:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1d37fe700 1 -- 172.21.15.79:0/2345042296 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800ebd0 con 0x7fd1c4003a60 2023-10-14T18:54:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 -- 172.21.15.79:0/2345042296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c4003a60 msgr2=0x7fd1c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/2345042296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c4003a60 0x7fd1c4003e70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009c00 tx=0x7fd1d80091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e1312700 1 -- 172.21.15.79:0/2345042296 reap_dead start 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 -- 172.21.15.79:0/2345042296 shutdown_connections 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 -- 172.21.15.79:0/2345042296 >> 172.21.15.79:0/2345042296 conn(0x7fd1dc0d1880 msgr2=0x7fd1dc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 -- 172.21.15.79:0/2345042296 shutdown_connections 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.151+0000 7fd1e2d75700 1 -- 172.21.15.79:0/2345042296 wait complete. 2023-10-14T18:54:20.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.152+0000 7fd1e2d75700 1 Processor -- start 2023-10-14T18:54:20.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.152+0000 7fd1e2d75700 1 -- start start 2023-10-14T18:54:20.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 0x7fd1dc0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 0x7fd1dc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0cb8a0 con 0x7fd1dc0cb100 2023-10-14T18:54:20.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc16a1c0 con 0x7fd1c4003a60 2023-10-14T18:54:20.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e2d75700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c83a0 con 0x7fd1dc1478b0 2023-10-14T18:54:20.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39974/0 (socket says 172.21.15.79:39974) 2023-10-14T18:54:20.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1d3fff700 1 -- 172.21.15.79:0/702094090 learned_addr learned my addr 172.21.15.79:0/702094090 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:20.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 0x7fd1dc0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.153+0000 7fd1e1312700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 0x7fd1dc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 -- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 msgr2=0x7fd1dc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 0x7fd1dc0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 -- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 msgr2=0x7fd1dc0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 0x7fd1dc0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc16e700 con 0x7fd1dc0cb100 2023-10-14T18:54:20.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1e1312700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 0x7fd1dc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:20.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 0x7fd1dc0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:20.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d3fff700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc007390 tx=0x7fd1cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc018030 con 0x7fd1dc0cb100 2023-10-14T18:54:20.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00f8d0 con 0x7fd1dc0cb100 2023-10-14T18:54:20.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0cb5c0 con 0x7fd1dc0cb100 2023-10-14T18:54:20.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc007800 con 0x7fd1dc0cb100 2023-10-14T18:54:20.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.154+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc158070 con 0x7fd1dc0cb100 2023-10-14T18:54:20.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.155+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc157bf0 con 0x7fd1dc0cb100 2023-10-14T18:54:20.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.155+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1cc01b070 con 0x7fd1dc0cb100 2023-10-14T18:54:20.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.156+0000 7fd1d0ff9700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.156+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd1cc019070 con 0x7fd1dc0cb100 2023-10-14T18:54:20.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.156+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fd1c806eb10 con 0x7fd1dc0cb100 2023-10-14T18:54:20.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.156+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.156+0000 7fd1e0b11700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 0x7fd1c80693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80091e0 tx=0x7fd1d801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.160+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1dc157bf0 con 0x7fd1dc0cb100 2023-10-14T18:54:20.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.342+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd1dc16a300 con 0x7fd1dc0cb100 2023-10-14T18:54:20.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.342+0000 7fd1d0ff9700 1 -- 172.21.15.79:0/702094090 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1dc16a300 con 0x7fd1dc0cb100 2023-10-14T18:54:20.345 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:54:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 msgr2=0x7fd1c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 0x7fd1c80693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80091e0 tx=0x7fd1d801a000 comp rx=0 tx=0).stop 2023-10-14T18:54:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 msgr2=0x7fd1dc16e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc007390 tx=0x7fd1cc001e90 comp rx=0 tx=0).stop 2023-10-14T18:54:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 shutdown_connections 2023-10-14T18:54:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd1c8066f30 0x7fd1c80693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd1dc1478b0 0x7fd1dc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c4003a60 0x7fd1dc0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 --2- 172.21.15.79:0/702094090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1dc0cb100 0x7fd1dc16e1c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 >> 172.21.15.79:0/702094090 conn(0x7fd1dc0d1880 msgr2=0x7fd1dc1558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 shutdown_connections 2023-10-14T18:54:20.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.344+0000 7fd1e2d75700 1 -- 172.21.15.79:0/702094090 wait complete. 2023-10-14T18:54:20.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:54:20.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.474+0000 7f98a45e2700 1 Processor -- start 2023-10-14T18:54:20.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.474+0000 7f98a45e2700 1 -- start start 2023-10-14T18:54:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a45e2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f989c0cd300 0x7f989c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a45e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f989c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a45e2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c1513f0 con 0x7f989c0b6760 2023-10-14T18:54:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a45e2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c15e7a0 con 0x7f989c0cd300 2023-10-14T18:54:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a45e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c15db20 con 0x7f989c0d1470 2023-10-14T18:54:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a1b7d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f989c0b6760 0x7f989c0d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56424/0 (socket says 172.21.15.79:56424) 2023-10-14T18:54:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.475+0000 7f98a1b7d700 1 -- 172.21.15.79:0/771670042 learned_addr learned my addr 172.21.15.79:0/771670042 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:20.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a237e700 1 --2- 172.21.15.79:0/771670042 >> v2:172.21.15.144:3300/0 conn(0x7f989c0cd300 0x7f989c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184538901 0 0) 0x7f989c1513f0 con 0x7f989c0b6760 2023-10-14T18:54:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9884003570 con 0x7f989c0b6760 2023-10-14T18:54:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a2b7f700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f989c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412300941 0 0) 0x7f9884003570 con 0x7f989c0b6760 2023-10-14T18:54:20.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 msgr2=0x7f989c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f989c0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 >> v2:172.21.15.144:3300/0 conn(0x7f989c0cd300 msgr2=0x7f989c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 --2- 172.21.15.79:0/771670042 >> v2:172.21.15.144:3300/0 conn(0x7f989c0cd300 0x7f989c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c15de00 con 0x7f989c0b6760 2023-10-14T18:54:20.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f98900017f0 con 0x7f989c0b6760 2023-10-14T18:54:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 >> v1:172.21.15.79:6789/0 conn(0x7f989c0b6760 legacy=0x7f989c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f9884003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f9884004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9884004d50 0x7f98840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c15e7a0 con 0x7f9884003fe0 2023-10-14T18:54:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c15db20 con 0x7f9884004d50 2023-10-14T18:54:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988400ba90 con 0x7f989c0d1470 2023-10-14T18:54:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f9884004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a237e700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f9884003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a2b7f700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9884004d50 0x7f98840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 -- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 msgr2=0x7f9884003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c0d1470 0x7f9884003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 -- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9884004d50 msgr2=0x7f98840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9884004d50 0x7f98840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.476+0000 7f98a1b7d700 1 -- 172.21.15.79:0/771670042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884003570 con 0x7f9884003fe0 2023-10-14T18:54:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f9884004810 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f989000a970 tx=0x7f9890002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de095d1cf978e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012440 con 0x7f9884003fe0 2023-10-14T18:54:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900125c0 con 0x7f9884003fe0 2023-10-14T18:54:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a137c700 1 -- 172.21.15.79:0/771670042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890012980 con 0x7f9884003fe0 2023-10-14T18:54:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 -- 172.21.15.79:0/771670042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 msgr2=0x7f9884004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 --2- 172.21.15.79:0/771670042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f9884004810 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f989000a970 tx=0x7f9890002210 comp rx=0 tx=0).stop 2023-10-14T18:54:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a2b7f700 1 -- 172.21.15.79:0/771670042 reap_dead start 2023-10-14T18:54:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 -- 172.21.15.79:0/771670042 shutdown_connections 2023-10-14T18:54:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 -- 172.21.15.79:0/771670042 >> 172.21.15.79:0/771670042 conn(0x7f989c068d90 msgr2=0x7f989c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 -- 172.21.15.79:0/771670042 shutdown_connections 2023-10-14T18:54:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.477+0000 7f98a45e2700 1 -- 172.21.15.79:0/771670042 wait complete. 2023-10-14T18:54:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.478+0000 7f98a45e2700 1 Processor -- start 2023-10-14T18:54:20.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.478+0000 7f98a45e2700 1 -- start start 2023-10-14T18:54:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f989c14cee0 0x7f989c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 0x7f989c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0b0a80 con 0x7f9884003fe0 2023-10-14T18:54:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c14d920 con 0x7f989c14cee0 2023-10-14T18:54:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a45e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c14dc00 con 0x7f989c14d350 2023-10-14T18:54:20.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39984/0 (socket says 172.21.15.79:39984) 2023-10-14T18:54:20.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 -- 172.21.15.79:0/1912969060 learned_addr learned my addr 172.21.15.79:0/1912969060 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:20.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a2b7f700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 0x7f989c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f989c14cee0 0x7f989c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 -- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 msgr2=0x7f989c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 0x7f989c14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 -- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f989c14cee0 msgr2=0x7f989c14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f989c14cee0 0x7f989c14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a237e700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c14dee0 con 0x7f9884003fe0 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.479+0000 7f98a2b7f700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 0x7f989c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:20.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f98a237e700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9894011d40 tx=0x7f98940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400fac0 con 0x7f9884003fe0 2023-10-14T18:54:20.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400fc20 con 0x7f9884003fe0 2023-10-14T18:54:20.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894014440 con 0x7f9884003fe0 2023-10-14T18:54:20.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c0b0710 con 0x7f9884003fe0 2023-10-14T18:54:20.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.480+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c14a290 con 0x7f9884003fe0 2023-10-14T18:54:20.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.481+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c14a4b0 con 0x7f9884003fe0 2023-10-14T18:54:20.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.481+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9894014a80 con 0x7f9884003fe0 2023-10-14T18:54:20.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.481+0000 7f989a7fc700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 0x7f98880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.482+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9894018030 con 0x7f9884003fe0 2023-10-14T18:54:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.482+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f988806eb10 con 0x7f9884003fe0 2023-10-14T18:54:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.482+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 0x7f98880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.482+0000 7f98a1b7d700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 0x7f98880693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9890002250 tx=0x7f9890015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.486+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9894022060 con 0x7f9884003fe0 2023-10-14T18:54:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.666+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f989c04c3c0 con 0x7f9884003fe0 2023-10-14T18:54:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.666+0000 7f989a7fc700 1 -- 172.21.15.79:0/1912969060 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+11 (secure 0 0 0) 0x7f989405b030 con 0x7f9884003fe0 2023-10-14T18:54:20.668 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:54:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 msgr2=0x7f98880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 0x7f98880693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9890002250 tx=0x7f9890015000 comp rx=0 tx=0).stop 2023-10-14T18:54:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 msgr2=0x7f989c1488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9894011d40 tx=0x7f98940091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 shutdown_connections 2023-10-14T18:54:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9888066f30 0x7f98880693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f989c14d350 0x7f989c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9884003fe0 0x7f989c1488e0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 --2- 172.21.15.79:0/1912969060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f989c14cee0 0x7f989c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 >> 172.21.15.79:0/1912969060 conn(0x7f989c068d90 msgr2=0x7f989c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 shutdown_connections 2023-10-14T18:54:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.668+0000 7f98a45e2700 1 -- 172.21.15.79:0/1912969060 wait complete. 2023-10-14T18:54:20.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:54:20.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.799+0000 7f48c2454700 1 Processor -- start 2023-10-14T18:54:20.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.799+0000 7f48c2454700 1 -- start start 2023-10-14T18:54:20.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48c2454700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48c2454700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0b0790 con 0x7f48bc159ec0 2023-10-14T18:54:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48c2454700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0ce1f0 con 0x7f48bc06aae0 2023-10-14T18:54:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48c2454700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc06af60 con 0x7f48bc15a290 2023-10-14T18:54:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f48bc159ec0 0x7f48bc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56436/0 (socket says 172.21.15.79:56436) 2023-10-14T18:54:20.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bbfff700 1 -- 172.21.15.79:0/1108153045 learned_addr learned my addr 172.21.15.79:0/1108153045 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bb7fe700 1 --2- 172.21.15.79:0/1108153045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879966464 0 0) 0x7f48bc0b0790 con 0x7f48bc159ec0 2023-10-14T18:54:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4003570 con 0x7f48bc159ec0 2023-10-14T18:54:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191642931 0 0) 0x7f48bc0ce1f0 con 0x7f48bc06aae0 2023-10-14T18:54:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc0b0790 con 0x7f48bc06aae0 2023-10-14T18:54:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641720342 0 0) 0x7f48a4003570 con 0x7f48bc159ec0 2023-10-14T18:54:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bb7fe700 1 -- 172.21.15.79:0/1108153045 >> v1:172.21.15.144:6789/0 conn(0x7f48bc06aae0 legacy=0x7f48bc0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bb7fe700 1 -- 172.21.15.79:0/1108153045 >> v1:172.21.15.79:6789/0 conn(0x7f48bc159ec0 legacy=0x7f48bc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.800+0000 7f48bb7fe700 1 -- 172.21.15.79:0/1108153045 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0b0b20 con 0x7f48bc15a290 2023-10-14T18:54:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48bb7fe700 1 --2- 172.21.15.79:0/1108153045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc06a5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009910 tx=0x7f48b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace37b25e1c8c984 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac001470 con 0x7f48bc15a290 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b0011420 con 0x7f48bc15a290 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48baffd700 1 -- 172.21.15.79:0/1108153045 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b00117c0 con 0x7f48bc15a290 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 -- 172.21.15.79:0/1108153045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 msgr2=0x7f48bc06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 --2- 172.21.15.79:0/1108153045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc06a5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009910 tx=0x7f48b00091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 -- 172.21.15.79:0/1108153045 shutdown_connections 2023-10-14T18:54:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 --2- 172.21.15.79:0/1108153045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc06a5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 -- 172.21.15.79:0/1108153045 >> 172.21.15.79:0/1108153045 conn(0x7f48bc0d1880 msgr2=0x7f48bc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 -- 172.21.15.79:0/1108153045 shutdown_connections 2023-10-14T18:54:20.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.801+0000 7f48c2454700 1 -- 172.21.15.79:0/1108153045 wait complete. 2023-10-14T18:54:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.802+0000 7f48c2454700 1 Processor -- start 2023-10-14T18:54:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 -- start start 2023-10-14T18:54:20.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48bc06aae0 0x7f48bc0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc16a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0b43b0 con 0x7f48bc159ec0 2023-10-14T18:54:20.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc1422e0 con 0x7f48bc06aae0 2023-10-14T18:54:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48c2454700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0b0f30 con 0x7f48bc15a290 2023-10-14T18:54:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48bb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.803+0000 7f48bb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39998/0 (socket says 172.21.15.79:39998) 2023-10-14T18:54:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 -- 172.21.15.79:0/209211101 learned_addr learned my addr 172.21.15.79:0/209211101 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:20.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bbfff700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48bc06aae0 0x7f48bc0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48c09f1700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc16a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 -- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 msgr2=0x7f48bc16a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc16a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 -- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48bc06aae0 msgr2=0x7f48bc0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48bc06aae0 0x7f48bc0b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0009420 con 0x7f48bc159ec0 2023-10-14T18:54:20.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48bb7fe700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f48b00030c0 tx=0x7f48b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b001cc50 con 0x7f48bc159ec0 2023-10-14T18:54:20.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b001cdb0 con 0x7f48bc159ec0 2023-10-14T18:54:20.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b001a6a0 con 0x7f48bc159ec0 2023-10-14T18:54:20.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0b3b50 con 0x7f48bc159ec0 2023-10-14T18:54:20.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.804+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0b40d0 con 0x7f48bc159ec0 2023-10-14T18:54:20.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.805+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0b0d00 con 0x7f48bc159ec0 2023-10-14T18:54:20.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.806+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48b001aad0 con 0x7f48bc159ec0 2023-10-14T18:54:20.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.806+0000 7f48a3fff700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:20.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.806+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f48b0086350 con 0x7f48bc159ec0 2023-10-14T18:54:20.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.806+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f48a806eb10 con 0x7f48bc159ec0 2023-10-14T18:54:20.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.806+0000 7f48bbfff700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.807+0000 7f48bbfff700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 0x7f48a80693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007c40 tx=0x7f48ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:20.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.810+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48bc0b0d00 con 0x7f48bc159ec0 2023-10-14T18:54:20.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.991+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48bc0b0d00 con 0x7f48bc159ec0 2023-10-14T18:54:20.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.992+0000 7f48a3fff700 1 -- 172.21.15.79:0/209211101 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48bc0b0d00 con 0x7f48bc159ec0 2023-10-14T18:54:20.994 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:54:20.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 msgr2=0x7f48a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 0x7f48a80693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007c40 tx=0x7f48ac009040 comp rx=0 tx=0).stop 2023-10-14T18:54:20.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 msgr2=0x7f48bc0b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:20.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f48b00030c0 tx=0x7f48b0016000 comp rx=0 tx=0).stop 2023-10-14T18:54:20.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 shutdown_connections 2023-10-14T18:54:20.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48a8066f30 0x7f48a80693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48bc15a290 0x7f48bc16a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48bc06aae0 0x7f48bc0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 --2- 172.21.15.79:0/209211101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48bc159ec0 0x7f48bc0b64a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:20.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 >> 172.21.15.79:0/209211101 conn(0x7f48bc0d1880 msgr2=0x7f48bc0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:20.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 shutdown_connections 2023-10-14T18:54:21.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:20.994+0000 7f48c2454700 1 -- 172.21.15.79:0/209211101 wait complete. 2023-10-14T18:54:21.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.121+0000 7f3619d9e700 1 Processor -- start 2023-10-14T18:54:21.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.121+0000 7f3619d9e700 1 -- start start 2023-10-14T18:54:21.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3619d9e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3614157870 0x7f361415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3619d9e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361415cbb0 con 0x7f3614157c40 2023-10-14T18:54:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3619d9e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361415bfa0 con 0x7f361415a620 2023-10-14T18:54:21.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3619d9e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361415c280 con 0x7f3614157870 2023-10-14T18:54:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3613fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3614157c40 0x7f3614158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56442/0 (socket says 172.21.15.79:56442) 2023-10-14T18:54:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f3613fff700 1 -- 172.21.15.79:0/2687277908 learned_addr learned my addr 172.21.15.79:0/2687277908 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36137fe700 1 --2- 172.21.15.79:0/2687277908 >> v2:172.21.15.144:3300/0 conn(0x7f3614157870 0x7f361415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703256535 0 0) 0x7f361415cbb0 con 0x7f3614157c40 2023-10-14T18:54:21.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35fc003570 con 0x7f3614157c40 2023-10-14T18:54:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2212732264 0 0) 0x7f35fc003570 con 0x7f3614157c40 2023-10-14T18:54:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36137fe700 1 -- 172.21.15.79:0/2687277908 >> v1:172.21.15.144:6789/0 conn(0x7f361415a620 legacy=0x7f361415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36137fe700 1 -- 172.21.15.79:0/2687277908 >> v1:172.21.15.79:6789/0 conn(0x7f3614157c40 legacy=0x7f3614158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.122+0000 7f36137fe700 1 -- 172.21.15.79:0/2687277908 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361415c560 con 0x7f3614157870 2023-10-14T18:54:21.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f36137fe700 1 --2- 172.21.15.79:0/2687277908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f361415b6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f36040098e0 tx=0x7f36040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a95a084c066df8e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c0017f0 con 0x7f3614157870 2023-10-14T18:54:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604011420 con 0x7f3614157870 2023-10-14T18:54:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f36127fc700 1 -- 172.21.15.79:0/2687277908 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040117c0 con 0x7f3614157870 2023-10-14T18:54:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 -- 172.21.15.79:0/2687277908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 msgr2=0x7f361415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2687277908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f361415b6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f36040098e0 tx=0x7f36040091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 -- 172.21.15.79:0/2687277908 shutdown_connections 2023-10-14T18:54:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2687277908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f361415b6a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 -- 172.21.15.79:0/2687277908 >> 172.21.15.79:0/2687277908 conn(0x7f3614068ce0 msgr2=0x7f36140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:21.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 -- 172.21.15.79:0/2687277908 shutdown_connections 2023-10-14T18:54:21.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.123+0000 7f3619d9e700 1 -- 172.21.15.79:0/2687277908 wait complete. 2023-10-14T18:54:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.124+0000 7f3619d9e700 1 Processor -- start 2023-10-14T18:54:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.124+0000 7f3619d9e700 1 -- start start 2023-10-14T18:54:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f3614155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 0x7f361414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361414bb00 con 0x7f361415a620 2023-10-14T18:54:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361414a7c0 con 0x7f3614157870 2023-10-14T18:54:21.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3619d9e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361414aa60 con 0x7f3614157c40 2023-10-14T18:54:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3613fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3613fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40014/0 (socket says 172.21.15.79:40014) 2023-10-14T18:54:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.125+0000 7f3613fff700 1 -- 172.21.15.79:0/2303915999 learned_addr learned my addr 172.21.15.79:0/2303915999 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:21.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f36137fe700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f3614155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3612ffd700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 0x7f361414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 -- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 msgr2=0x7f361414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 0x7f361414a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 -- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 msgr2=0x7f3614155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f3614155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009420 con 0x7f361415a620 2023-10-14T18:54:21.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3612ffd700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 0x7f361414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3613fff700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f360c00cc10 tx=0x7f360c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c004dc0 con 0x7f361415a620 2023-10-14T18:54:21.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c00a720 con 0x7f361415a620 2023-10-14T18:54:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361414ad40 con 0x7f361415a620 2023-10-14T18:54:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00aae0 con 0x7f361415a620 2023-10-14T18:54:21.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.126+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361414b300 con 0x7f361415a620 2023-10-14T18:54:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.127+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361404c3c0 con 0x7f361415a620 2023-10-14T18:54:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.127+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f360c007150 con 0x7f361415a620 2023-10-14T18:54:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.128+0000 7f35fb7fe700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 0x7f36000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.128+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f360c084030 con 0x7f361415a620 2023-10-14T18:54:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.128+0000 7f36137fe700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 0x7f36000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.128+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f360006eb10 con 0x7f361415a620 2023-10-14T18:54:21.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.128+0000 7f36137fe700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 0x7f36000693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f36040091e0 tx=0x7f3604016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.132+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f360c018060 con 0x7f361415a620 2023-10-14T18:54:21.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.357+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f361415c840 con 0x7f361415a620 2023-10-14T18:54:21.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.358+0000 7f35fb7fe700 1 -- 172.21.15.79:0/2303915999 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f360c018030 con 0x7f361415a620 2023-10-14T18:54:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:21.360 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:54:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 msgr2=0x7f36000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 0x7f36000693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f36040091e0 tx=0x7f3604016000 comp rx=0 tx=0).stop 2023-10-14T18:54:21.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 msgr2=0x7f36141487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f360c00cc10 tx=0x7f360c001640 comp rx=0 tx=0).stop 2023-10-14T18:54:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 shutdown_connections 2023-10-14T18:54:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3600066f30 0x7f36000693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f361415a620 0x7f36141487a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3614157870 0x7f3614155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 --2- 172.21.15.79:0/2303915999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3614157c40 0x7f361414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 >> 172.21.15.79:0/2303915999 conn(0x7f3614068ce0 msgr2=0x7f36140b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 shutdown_connections 2023-10-14T18:54:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.360+0000 7f3619d9e700 1 -- 172.21.15.79:0/2303915999 wait complete. 2023-10-14T18:54:21.365 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:54:21.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.486+0000 7fcf1a381700 1 Processor -- start 2023-10-14T18:54:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.486+0000 7fcf1a381700 1 -- start start 2023-10-14T18:54:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1a381700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf140c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1a381700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf140abeb0 0x7fcf140c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1a381700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf140c9cb0 con 0x7fcf140abae0 2023-10-14T18:54:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1a381700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140c8e80 con 0x7fcf140abeb0 2023-10-14T18:54:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1a381700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140c90a0 con 0x7fcf140c75c0 2023-10-14T18:54:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf13fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcf140abae0 0x7fcf140c6eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56454/0 (socket says 172.21.15.79:56454) 2023-10-14T18:54:21.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf13fff700 1 -- 172.21.15.79:0/398280451 learned_addr learned my addr 172.21.15.79:0/398280451 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf137fe700 1 --2- 172.21.15.79:0/398280451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf140c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.487+0000 7fcf1891e700 1 --2- 172.21.15.79:0/398280451 >> v2:172.21.15.144:3300/0 conn(0x7fcf140abeb0 0x7fcf140c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf12ffd700 1 -- 172.21.15.79:0/398280451 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499873890 0 0) 0x7fcf140c9cb0 con 0x7fcf140abae0 2023-10-14T18:54:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf12ffd700 1 -- 172.21.15.79:0/398280451 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcefc003570 con 0x7fcf140abae0 2023-10-14T18:54:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf137fe700 1 -- 172.21.15.79:0/398280451 >> v2:172.21.15.144:3300/0 conn(0x7fcf140abeb0 msgr2=0x7fcf140c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf137fe700 1 --2- 172.21.15.79:0/398280451 >> v2:172.21.15.144:3300/0 conn(0x7fcf140abeb0 0x7fcf140c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf137fe700 1 -- 172.21.15.79:0/398280451 >> v1:172.21.15.79:6789/0 conn(0x7fcf140abae0 legacy=0x7fcf140c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf137fe700 1 -- 172.21.15.79:0/398280451 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140c9380 con 0x7fcf140c75c0 2023-10-14T18:54:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf137fe700 1 --2- 172.21.15.79:0/398280451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf140c8400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf080098e0 tx=0x7fcf080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e7d5b5cd6363e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf12ffd700 1 -- 172.21.15.79:0/398280451 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011630 con 0x7fcf140c75c0 2023-10-14T18:54:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf12ffd700 1 -- 172.21.15.79:0/398280451 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08011790 con 0x7fcf140c75c0 2023-10-14T18:54:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.488+0000 7fcf12ffd700 1 -- 172.21.15.79:0/398280451 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011b30 con 0x7fcf140c75c0 2023-10-14T18:54:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 -- 172.21.15.79:0/398280451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 msgr2=0x7fcf140c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 --2- 172.21.15.79:0/398280451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf140c8400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf080098e0 tx=0x7fcf080091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 -- 172.21.15.79:0/398280451 shutdown_connections 2023-10-14T18:54:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 --2- 172.21.15.79:0/398280451 >> v2:172.21.15.144:3300/0 conn(0x7fcf140abeb0 0x7fcf140c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 --2- 172.21.15.79:0/398280451 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf140c8400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 -- 172.21.15.79:0/398280451 >> 172.21.15.79:0/398280451 conn(0x7fcf14067660 msgr2=0x7fcf14067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 -- 172.21.15.79:0/398280451 shutdown_connections 2023-10-14T18:54:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.489+0000 7fcf1a381700 1 -- 172.21.15.79:0/398280451 wait complete. 2023-10-14T18:54:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.490+0000 7fcf1a381700 1 Processor -- start 2023-10-14T18:54:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.490+0000 7fcf1a381700 1 -- start start 2023-10-14T18:54:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf140abeb0 0x7fcf14153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf14147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14153860 con 0x7fcf140abae0 2023-10-14T18:54:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140b09d0 con 0x7fcf140abeb0 2023-10-14T18:54:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140afdc0 con 0x7fcf140c75c0 2023-10-14T18:54:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40016/0 (socket says 172.21.15.79:40016) 2023-10-14T18:54:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 -- 172.21.15.79:0/1506224081 learned_addr learned my addr 172.21.15.79:0/1506224081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1891e700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf14147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 -- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 msgr2=0x7fcf14147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf14147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 -- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf140abeb0 msgr2=0x7fcf14153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf140abeb0 0x7fcf14153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08009420 con 0x7fcf140abae0 2023-10-14T18:54:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf13fff700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400c7c0 tx=0x7fcf04007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04005b30 con 0x7fcf140abae0 2023-10-14T18:54:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04005c90 con 0x7fcf140abae0 2023-10-14T18:54:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf140b00a0 con 0x7fcf140abae0 2023-10-14T18:54:21.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04007340 con 0x7fcf140abae0 2023-10-14T18:54:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.491+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf140b0660 con 0x7fcf140abae0 2023-10-14T18:54:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.492+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1404c3c0 con 0x7fcf140abae0 2023-10-14T18:54:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.493+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf0401b400 con 0x7fcf140abae0 2023-10-14T18:54:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.493+0000 7fcefbfff700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 0x7fcf000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.493+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcf04084030 con 0x7fcf140abae0 2023-10-14T18:54:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.493+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fcf0006eb10 con 0x7fcf140abae0 2023-10-14T18:54:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.493+0000 7fcf137fe700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 0x7fcf000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.494+0000 7fcf137fe700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 0x7fcf000693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf1415a680 tx=0x7fcf08017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.497+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf040512e0 con 0x7fcf140abae0 2023-10-14T18:54:21.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.677+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf140b0d60 con 0x7fcf140abae0 2023-10-14T18:54:21.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.678+0000 7fcefbfff700 1 -- 172.21.15.79:0/1506224081 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+15488 (secure 0 0 0) 0x7fcf04054900 con 0x7fcf140abae0 2023-10-14T18:54:21.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:21.680 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":158,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:53:42.562998+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.5","mappings":[{"from":2,"to":0}]},{"pgid":"19.13","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:21.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 msgr2=0x7fcf000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 0x7fcf000693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf1415a680 tx=0x7fcf08017000 comp rx=0 tx=0).stop 2023-10-14T18:54:21.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 msgr2=0x7fcf140af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400c7c0 tx=0x7fcf04007e00 comp rx=0 tx=0).stop 2023-10-14T18:54:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 shutdown_connections 2023-10-14T18:54:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf00066f30 0x7fcf000693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf140c75c0 0x7fcf14147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf140abae0 0x7fcf140af6c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 --2- 172.21.15.79:0/1506224081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf140abeb0 0x7fcf14153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 >> 172.21.15.79:0/1506224081 conn(0x7fcf14067660 msgr2=0x7fcf14154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:21.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 shutdown_connections 2023-10-14T18:54:21.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.680+0000 7fcf1a381700 1 -- 172.21.15.79:0/1506224081 wait complete. 2023-10-14T18:54:21.694 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:54:21.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:21.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.809+0000 7fa6d0687700 1 Processor -- start 2023-10-14T18:54:21.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.809+0000 7fa6d0687700 1 -- start start 2023-10-14T18:54:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.809+0000 7fa6d0687700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6c815a620 0x7fa6c815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.809+0000 7fa6d0687700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 0x7fa6c8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6d0687700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c815cbb0 con 0x7fa6c8157870 2023-10-14T18:54:21.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6d0687700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c815bdb0 con 0x7fa6c815a620 2023-10-14T18:54:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6d0687700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c815bfa0 con 0x7fa6c815d580 2023-10-14T18:54:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6c815a620 0x7fa6c815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6c815a620 0x7fa6c815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40028/0 (socket says 172.21.15.79:40028) 2023-10-14T18:54:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 -- 172.21.15.79:0/1031191031 learned_addr learned my addr 172.21.15.79:0/1031191031 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:21.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6ce423700 1 --1- 172.21.15.79:0/1031191031 >> v1:172.21.15.79:6789/0 conn(0x7fa6c8157870 0x7fa6c815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56468/0 (socket says 172.21.15.79:56468) 2023-10-14T18:54:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 -- 172.21.15.79:0/1031191031 >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 msgr2=0x7fa6c8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cec24700 1 --2- 172.21.15.79:0/1031191031 >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 0x7fa6c8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 --2- 172.21.15.79:0/1031191031 >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 0x7fa6c8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cd421700 1 -- 172.21.15.79:0/1031191031 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225959 0 0) 0x7fa6c815cbb0 con 0x7fa6c8157870 2023-10-14T18:54:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 -- 172.21.15.79:0/1031191031 >> v1:172.21.15.79:6789/0 conn(0x7fa6c8157870 legacy=0x7fa6c815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 -- 172.21.15.79:0/1031191031 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c815c280 con 0x7fa6c815a620 2023-10-14T18:54:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cec24700 1 --2- 172.21.15.79:0/1031191031 >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 0x7fa6c8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cdc22700 1 --2- 172.21.15.79:0/1031191031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c815a620 0x7fa6c815d040 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806b4e0 tx=0x7fa6b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbac3f8a045d292 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cd421700 1 -- 172.21.15.79:0/1031191031 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800b860 con 0x7fa6c815a620 2023-10-14T18:54:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cd421700 1 -- 172.21.15.79:0/1031191031 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b800b9c0 con 0x7fa6c815a620 2023-10-14T18:54:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.810+0000 7fa6cd421700 1 -- 172.21.15.79:0/1031191031 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800bd60 con 0x7fa6c815a620 2023-10-14T18:54:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 -- 172.21.15.79:0/1031191031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c815a620 msgr2=0x7fa6c815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 --2- 172.21.15.79:0/1031191031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c815a620 0x7fa6c815d040 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806b4e0 tx=0x7fa6b8009250 comp rx=0 tx=0).stop 2023-10-14T18:54:21.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 -- 172.21.15.79:0/1031191031 shutdown_connections 2023-10-14T18:54:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 --2- 172.21.15.79:0/1031191031 >> v2:172.21.15.144:3300/0 conn(0x7fa6c815d580 0x7fa6c8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 --2- 172.21.15.79:0/1031191031 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c815a620 0x7fa6c815d040 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 -- 172.21.15.79:0/1031191031 >> 172.21.15.79:0/1031191031 conn(0x7fa6c8068ce0 msgr2=0x7fa6c80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:21.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 -- 172.21.15.79:0/1031191031 shutdown_connections 2023-10-14T18:54:21.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.811+0000 7fa6d0687700 1 -- 172.21.15.79:0/1031191031 wait complete. 2023-10-14T18:54:21.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.812+0000 7fa6d0687700 1 Processor -- start 2023-10-14T18:54:21.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.812+0000 7fa6d0687700 1 -- start start 2023-10-14T18:54:21.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6c815a620 0x7fa6c80d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c815d580 0x7fa6c814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8150b90 con 0x7fa6c8157870 2023-10-14T18:54:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8150e30 con 0x7fa6c815d580 2023-10-14T18:54:21.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c8151110 con 0x7fa6c815a620 2023-10-14T18:54:21.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40040/0 (socket says 172.21.15.79:40040) 2023-10-14T18:54:21.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 -- 172.21.15.79:0/3580564502 learned_addr learned my addr 172.21.15.79:0/3580564502 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:21.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6cdc22700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6c815a620 0x7fa6c80d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 -- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6c815a620 msgr2=0x7fa6c80d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6c815a620 0x7fa6c80d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6cec24700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c815d580 0x7fa6c814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 -- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c815d580 msgr2=0x7fa6c814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c815d580 0x7fa6c814b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:21.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80094f0 con 0x7fa6c8157870 2023-10-14T18:54:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6ce423700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40011e0 tx=0x7fa6c4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4007300 con 0x7fa6c8157870 2023-10-14T18:54:21.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4007460 con 0x7fa6c8157870 2023-10-14T18:54:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c81513f0 con 0x7fa6c8157870 2023-10-14T18:54:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.813+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004830 con 0x7fa6c8157870 2023-10-14T18:54:21.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.814+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c81519b0 con 0x7fa6c8157870 2023-10-14T18:54:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.814+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c804c3c0 con 0x7fa6c8157870 2023-10-14T18:54:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.815+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6c4004be0 con 0x7fa6c8157870 2023-10-14T18:54:21.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.815+0000 7fa6be7fc700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 0x7fa6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:21.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.815+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa6c4083ab0 con 0x7fa6c8157870 2023-10-14T18:54:21.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.815+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fa6ac06eb10 con 0x7fa6c8157870 2023-10-14T18:54:21.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.815+0000 7fa6cdc22700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 0x7fa6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:21.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.816+0000 7fa6cdc22700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 0x7fa6ac0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806b4e0 tx=0x7fa6b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:21.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:21.819+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6c4018020 con 0x7fa6c8157870 2023-10-14T18:54:22.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.042+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6c815c560 con 0x7fa6c8157870 2023-10-14T18:54:22.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.043+0000 7fa6be7fc700 1 -- 172.21.15.79:0/3580564502 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa6c4050d60 con 0x7fa6c8157870 2023-10-14T18:54:22.045 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:22.045 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:54:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 msgr2=0x7fa6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 0x7fa6ac0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa6c806b4e0 tx=0x7fa6b8017000 comp rx=0 tx=0).stop 2023-10-14T18:54:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 msgr2=0x7fa6c80b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40011e0 tx=0x7fa6c4007e10 comp rx=0 tx=0).stop 2023-10-14T18:54:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 shutdown_connections 2023-10-14T18:54:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6ac066f30 0x7fa6ac0693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6c815d580 0x7fa6c814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6c8157870 0x7fa6c80b2d70 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 --2- 172.21.15.79:0/3580564502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6c815a620 0x7fa6c80d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 >> 172.21.15.79:0/3580564502 conn(0x7fa6c8068ce0 msgr2=0x7fa6c8153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 shutdown_connections 2023-10-14T18:54:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.045+0000 7fa6d0687700 1 -- 172.21.15.79:0/3580564502 wait complete. 2023-10-14T18:54:22.050 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:54:22.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.171+0000 7f87ebd48700 1 Processor -- start 2023-10-14T18:54:22.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 -- start start 2023-10-14T18:54:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87e4157c40 0x7f87e4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e415cbb0 con 0x7f87e415a620 2023-10-14T18:54:22.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e415bfa0 con 0x7f87e4157c40 2023-10-14T18:54:22.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.172+0000 7f87ebd48700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e415c280 con 0x7f87e4157870 2023-10-14T18:54:22.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87e4157c40 0x7f87e4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87e4157c40 0x7f87e4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40052/0 (socket says 172.21.15.79:40052) 2023-10-14T18:54:22.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 -- 172.21.15.79:0/3145672460 learned_addr learned my addr 172.21.15.79:0/3145672460 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:22.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87e9ae4700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 -- 172.21.15.79:0/3145672460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 msgr2=0x7f87e415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 -- 172.21.15.79:0/3145672460 >> v1:172.21.15.144:6789/0 conn(0x7f87e415a620 legacy=0x7f87e415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 -- 172.21.15.79:0/3145672460 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e415c560 con 0x7f87e4157c40 2023-10-14T18:54:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87e9ae4700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87ea2e5700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4158110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009f20 tx=0x7f87dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4556f065888456 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87e8ae2700 1 -- 172.21.15.79:0/3145672460 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00e070 con 0x7f87e4157c40 2023-10-14T18:54:22.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87e8ae2700 1 -- 172.21.15.79:0/3145672460 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00ba40 con 0x7f87e4157c40 2023-10-14T18:54:22.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.173+0000 7f87e8ae2700 1 -- 172.21.15.79:0/3145672460 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0092e0 con 0x7f87e4157c40 2023-10-14T18:54:22.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 -- 172.21.15.79:0/3145672460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 msgr2=0x7f87e4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4158110 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009f20 tx=0x7f87dc009840 comp rx=0 tx=0).stop 2023-10-14T18:54:22.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 -- 172.21.15.79:0/3145672460 shutdown_connections 2023-10-14T18:54:22.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4158110 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 --2- 172.21.15.79:0/3145672460 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 -- 172.21.15.79:0/3145672460 >> 172.21.15.79:0/3145672460 conn(0x7f87e4068ce0 msgr2=0x7f87e40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 -- 172.21.15.79:0/3145672460 shutdown_connections 2023-10-14T18:54:22.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.174+0000 7f87ebd48700 1 -- 172.21.15.79:0/3145672460 wait complete. 2023-10-14T18:54:22.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.175+0000 7f87ebd48700 1 Processor -- start 2023-10-14T18:54:22.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.175+0000 7f87ebd48700 1 -- start start 2023-10-14T18:54:22.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e413eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e415a620 0x7f87e41515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4151ae0 con 0x7f87e4157c40 2023-10-14T18:54:22.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e412a4b0 con 0x7f87e415a620 2023-10-14T18:54:22.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40b30b0 con 0x7f87e4157870 2023-10-14T18:54:22.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40054/0 (socket says 172.21.15.79:40054) 2023-10-14T18:54:22.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 -- 172.21.15.79:0/2318999433 learned_addr learned my addr 172.21.15.79:0/2318999433 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:22.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e9ae4700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e413eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ea2e5700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e415a620 0x7f87e41515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 -- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 msgr2=0x7f87e413eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e413eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 -- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e415a620 msgr2=0x7f87e41515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e415a620 0x7f87e41515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc009ae0 con 0x7f87e4157c40 2023-10-14T18:54:22.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87e92e3700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b610 tx=0x7f87d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400f510 con 0x7f87e4157c40 2023-10-14T18:54:22.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400f670 con 0x7f87e4157c40 2023-10-14T18:54:22.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e40b2dd0 con 0x7f87e4157c40 2023-10-14T18:54:22.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.176+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400fa30 con 0x7f87e4157c40 2023-10-14T18:54:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.177+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e412a140 con 0x7f87e4157c40 2023-10-14T18:54:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e412a660 con 0x7f87e4157c40 2023-10-14T18:54:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87d401a400 con 0x7f87e4157c40 2023-10-14T18:54:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87d9ffb700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 0x7f87c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f87d4083ff0 con 0x7f87e4157c40 2023-10-14T18:54:22.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f87c806eb10 con 0x7f87e4157c40 2023-10-14T18:54:22.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.178+0000 7f87e9ae4700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 0x7f87c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.179+0000 7f87e9ae4700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 0x7f87c80693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e000adc0 tx=0x7f87e0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.182+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87e412a660 con 0x7f87e4157c40 2023-10-14T18:54:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.406+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87e412a660 con 0x7f87e4157c40 2023-10-14T18:54:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.407+0000 7f87d9ffb700 1 -- 172.21.15.79:0/2318999433 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f87e412a660 con 0x7f87e4157c40 2023-10-14T18:54:22.409 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:22.409 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":72,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:52:03.218063+0000","modified":"2023-10-14T18:52:06.874460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7494":{"gid":7494,"name":"b","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1059423837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1059423837},{"type":"v1","addr":"172.21.15.144:6837","nonce":1059423837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-14T18:54:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 msgr2=0x7f87c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 0x7f87c80693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e000adc0 tx=0x7f87e0006f90 comp rx=0 tx=0).stop 2023-10-14T18:54:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 msgr2=0x7f87e4151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b610 tx=0x7f87d4009120 comp rx=0 tx=0).stop 2023-10-14T18:54:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 shutdown_connections 2023-10-14T18:54:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c8066f30 0x7f87c80693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87e415a620 0x7f87e41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87e4157870 0x7f87e413eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 --2- 172.21.15.79:0/2318999433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87e4157c40 0x7f87e4151060 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 >> 172.21.15.79:0/2318999433 conn(0x7f87e4068ce0 msgr2=0x7f87e40b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 shutdown_connections 2023-10-14T18:54:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.409+0000 7f87ebd48700 1 -- 172.21.15.79:0/2318999433 wait complete. 2023-10-14T18:54:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 72 2023-10-14T18:54:22.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.535+0000 7f04cee6d700 1 Processor -- start 2023-10-14T18:54:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.535+0000 7f04cee6d700 1 -- start start 2023-10-14T18:54:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cee6d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04c8156940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cee6d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c8157c30 con 0x7f04c806da90 2023-10-14T18:54:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cee6d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c81584f0 con 0x7f04c8156570 2023-10-14T18:54:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cee6d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8157670 con 0x7f04c815a330 2023-10-14T18:54:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cd40a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f04c806da90 0x7f04c8156e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56474/0 (socket says 172.21.15.79:56474) 2023-10-14T18:54:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04cd40a700 1 -- 172.21.15.79:0/1745193132 learned_addr learned my addr 172.21.15.79:0/1745193132 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04c8156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199888574 0 0) 0x7f04c8157c30 con 0x7f04c806da90 2023-10-14T18:54:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b0004680 con 0x7f04c806da90 2023-10-14T18:54:22.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647527129 0 0) 0x7f04b0004680 con 0x7f04c806da90 2023-10-14T18:54:22.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 msgr2=0x7f04c8156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04c8156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 >> v1:172.21.15.144:6789/0 conn(0x7f04c8156570 legacy=0x7f04c806d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8157950 con 0x7f04c806da90 2023-10-14T18:54:22.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f04c0001470 con 0x7f04c806da90 2023-10-14T18:54:22.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04c8156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:22.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 >> v1:172.21.15.79:6789/0 conn(0x7f04c806da90 legacy=0x7f04c8156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04b0004ba0 0x7f04b0004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04b0005920 0x7f04b0005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04b000cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8157670 con 0x7f04b0005920 2023-10-14T18:54:22.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0006610 con 0x7f04b0004ba0 2023-10-14T18:54:22.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00067d0 con 0x7f04c815a330 2023-10-14T18:54:22.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.536+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04b0005920 0x7f04b0005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04ccc09700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04b0004ba0 0x7f04b0004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04cd40a700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04b000cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 -- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 msgr2=0x7f04b000cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04c815a330 0x7f04b000cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 -- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04b0004ba0 msgr2=0x7f04b0004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04b0004ba0 0x7f04b0004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 -- 172.21.15.79:0/1745193132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0004680 con 0x7f04b0005920 2023-10-14T18:54:22.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bffff700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04b0005920 0x7f04b0005d90 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f04c815a700 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25645929a8a2ac26 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b800c070 con 0x7f04b0005920 2023-10-14T18:54:22.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b800e5e0 con 0x7f04b0005920 2023-10-14T18:54:22.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04bf7fe700 1 -- 172.21.15.79:0/1745193132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8009510 con 0x7f04b0005920 2023-10-14T18:54:22.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04cee6d700 1 -- 172.21.15.79:0/1745193132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04b0005920 msgr2=0x7f04b0005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1745193132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04b0005920 0x7f04b0005d90 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f04c815a700 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2023-10-14T18:54:22.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.537+0000 7f04cd40a700 1 -- 172.21.15.79:0/1745193132 reap_dead start 2023-10-14T18:54:22.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.538+0000 7f04cee6d700 1 -- 172.21.15.79:0/1745193132 shutdown_connections 2023-10-14T18:54:22.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.538+0000 7f04cee6d700 1 -- 172.21.15.79:0/1745193132 >> 172.21.15.79:0/1745193132 conn(0x7f04c8067660 msgr2=0x7f04c8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.538+0000 7f04cee6d700 1 -- 172.21.15.79:0/1745193132 shutdown_connections 2023-10-14T18:54:22.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.538+0000 7f04cee6d700 1 -- 172.21.15.79:0/1745193132 wait complete. 2023-10-14T18:54:22.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.539+0000 7f04cee6d700 1 Processor -- start 2023-10-14T18:54:22.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.539+0000 7f04cee6d700 1 -- start start 2023-10-14T18:54:22.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.539+0000 7f04cee6d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04b0005920 0x7f04c8167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.539+0000 7f04cee6d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 0x7f04c80b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.539+0000 7f04cee6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cee6d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c81683a0 con 0x7f04c80c2f50 2023-10-14T18:54:22.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cee6d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80c1590 con 0x7f04c80c2ae0 2023-10-14T18:54:22.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cee6d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80c1870 con 0x7f04b0005920 2023-10-14T18:54:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40068/0 (socket says 172.21.15.79:40068) 2023-10-14T18:54:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 -- 172.21.15.79:0/1043162972 learned_addr learned my addr 172.21.15.79:0/1043162972 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04ccc09700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04b0005920 0x7f04c8167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04bffff700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 0x7f04c80b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 -- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04b0005920 msgr2=0x7f04c8167930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04b0005920 0x7f04c8167930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 -- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 msgr2=0x7f04c80b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 0x7f04c80b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80c1b50 con 0x7f04c80c2f50 2023-10-14T18:54:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04bffff700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 0x7f04c80b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cd40a700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000c00 tx=0x7f04c0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0018030 con 0x7f04c80c2f50 2023-10-14T18:54:22.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c000f690 con 0x7f04c80c2f50 2023-10-14T18:54:22.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c80c1e30 con 0x7f04c80c2f50 2023-10-14T18:54:22.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000fa50 con 0x7f04c80c2f50 2023-10-14T18:54:22.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.540+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c8167e70 con 0x7f04c80c2f50 2023-10-14T18:54:22.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.541+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c8168090 con 0x7f04c80c2f50 2023-10-14T18:54:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.542+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c001b070 con 0x7f04c80c2f50 2023-10-14T18:54:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.542+0000 7f04bcff9700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.542+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f04c0019070 con 0x7f04c80c2f50 2023-10-14T18:54:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.542+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f04b406eb10 con 0x7f04c80c2f50 2023-10-14T18:54:22.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.542+0000 7f04ccc09700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.543+0000 7f04ccc09700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04c4002f20 tx=0x7f04c4001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.546+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04c0051740 con 0x7f04c80c2f50 2023-10-14T18:54:22.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.729+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04c804c3c0 con 0x7f04c80c2f50 2023-10-14T18:54:22.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.730+0000 7f04bcff9700 1 -- 172.21.15.79:0/1043162972 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f04c0054d60 con 0x7f04c80c2f50 2023-10-14T18:54:22.732 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:22.732 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":158,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:53:42.562998+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:52:01.569233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-14T18:52:02.182441+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.5","mappings":[{"from":2,"to":0}]},{"pgid":"19.13","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:22.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 msgr2=0x7f04b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 0x7f04b40693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04c4002f20 tx=0x7f04c4001640 comp rx=0 tx=0).stop 2023-10-14T18:54:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 msgr2=0x7f04c80b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f04c0000c00 tx=0x7f04c0001e50 comp rx=0 tx=0).stop 2023-10-14T18:54:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 shutdown_connections 2023-10-14T18:54:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f04b4066f30 0x7f04b40693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f04c80c2f50 0x7f04c80b1e40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f04b0005920 0x7f04c8167930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 --2- 172.21.15.79:0/1043162972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c80c2ae0 0x7f04c80b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 >> 172.21.15.79:0/1043162972 conn(0x7f04c8067660 msgr2=0x7f04c806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 shutdown_connections 2023-10-14T18:54:22.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.732+0000 7f04cee6d700 1 -- 172.21.15.79:0/1043162972 wait complete. 2023-10-14T18:54:22.746 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:54:22.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.863+0000 7fb7866fc700 1 Processor -- start 2023-10-14T18:54:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.863+0000 7fb7866fc700 1 -- start start 2023-10-14T18:54:22.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.863+0000 7fb7866fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb78015a620 0x7fb78015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb7866fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 0x7fb780158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb7866fc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78015cbb0 con 0x7fb780157870 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb7866fc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78015bdb0 con 0x7fb78015a620 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb7866fc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78015bfa0 con 0x7fb78015d580 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb78015a620 0x7fb78015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb78015a620 0x7fb78015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40084/0 (socket says 172.21.15.79:40084) 2023-10-14T18:54:22.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 -- 172.21.15.79:0/2552266257 learned_addr learned my addr 172.21.15.79:0/2552266257 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 -- 172.21.15.79:0/2552266257 >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 msgr2=0x7fb780158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb784c99700 1 --2- 172.21.15.79:0/2552266257 >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 0x7fb780158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 --2- 172.21.15.79:0/2552266257 >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 0x7fb780158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 -- 172.21.15.79:0/2552266257 >> v1:172.21.15.144:6789/0 conn(0x7fb780157870 legacy=0x7fb78015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 -- 172.21.15.79:0/2552266257 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78015c280 con 0x7fb78015a620 2023-10-14T18:54:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb784c99700 1 --2- 172.21.15.79:0/2552266257 >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 0x7fb780158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77f7fe700 1 --2- 172.21.15.79:0/2552266257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb78015d040 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb78006b4e0 tx=0x7fb770009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8517f17fb9acf31 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77effd700 1 -- 172.21.15.79:0/2552266257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000b820 con 0x7fb78015a620 2023-10-14T18:54:22.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77effd700 1 -- 172.21.15.79:0/2552266257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77000b980 con 0x7fb78015a620 2023-10-14T18:54:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.864+0000 7fb77effd700 1 -- 172.21.15.79:0/2552266257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000bd20 con 0x7fb78015a620 2023-10-14T18:54:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 -- 172.21.15.79:0/2552266257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 msgr2=0x7fb78015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 --2- 172.21.15.79:0/2552266257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb78015d040 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb78006b4e0 tx=0x7fb770009250 comp rx=0 tx=0).stop 2023-10-14T18:54:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 -- 172.21.15.79:0/2552266257 shutdown_connections 2023-10-14T18:54:22.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 --2- 172.21.15.79:0/2552266257 >> v2:172.21.15.144:3300/0 conn(0x7fb78015d580 0x7fb780158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 --2- 172.21.15.79:0/2552266257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb78015d040 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 -- 172.21.15.79:0/2552266257 >> 172.21.15.79:0/2552266257 conn(0x7fb780068ce0 msgr2=0x7fb7800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 -- 172.21.15.79:0/2552266257 shutdown_connections 2023-10-14T18:54:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.865+0000 7fb7866fc700 1 -- 172.21.15.79:0/2552266257 wait complete. 2023-10-14T18:54:22.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.866+0000 7fb7866fc700 1 Processor -- start 2023-10-14T18:54:22.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.866+0000 7fb7866fc700 1 -- start start 2023-10-14T18:54:22.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb780157870 0x7fb78016b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 0x7fb7800695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78016b860 con 0x7fb78015a620 2023-10-14T18:54:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b2050 con 0x7fb78015d580 2023-10-14T18:54:22.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb7866fc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b2330 con 0x7fb780157870 2023-10-14T18:54:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40098/0 (socket says 172.21.15.79:40098) 2023-10-14T18:54:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 -- 172.21.15.79:0/609640095 learned_addr learned my addr 172.21.15.79:0/609640095 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77ffff700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb780157870 0x7fb78016b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb784c99700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 0x7fb7800695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 -- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb780157870 msgr2=0x7fb78016b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb780157870 0x7fb78016b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 -- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 msgr2=0x7fb7800695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:22.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 0x7fb7800695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb77f7fe700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094f0 con 0x7fb78015a620 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.867+0000 7fb784c99700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 0x7fb7800695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb77f7fe700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb7700030c0 tx=0x7fb770016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770011db0 con 0x7fb78015a620 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb770020070 con 0x7fb78015a620 2023-10-14T18:54:22.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7800b2610 con 0x7fb78015a620 2023-10-14T18:54:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77001b6a0 con 0x7fb78015a620 2023-10-14T18:54:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.868+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7800b2bd0 con 0x7fb78015a620 2023-10-14T18:54:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.869+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7800b2dc0 con 0x7fb78015a620 2023-10-14T18:54:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.869+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb770022030 con 0x7fb78015a620 2023-10-14T18:54:22.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.869+0000 7fb767fff700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:22.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.870+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb770086e40 con 0x7fb78015a620 2023-10-14T18:54:22.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.870+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7fb76c06eb10 con 0x7fb78015a620 2023-10-14T18:54:22.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.870+0000 7fb77ffff700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:22.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.870+0000 7fb77ffff700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 0x7fb76c0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb774003a30 tx=0x7fb774007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:22.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:22.874+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb770053660 con 0x7fb78015a620 2023-10-14T18:54:23.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.099+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb7800b2dc0 con 0x7fb78015a620 2023-10-14T18:54:23.101 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:54:23.100+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:54:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.106+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(159..159 src has 1..159) v4 ==== 366+0+0 (secure 0 0 0) 0x7fb770057320 con 0x7fb78015a620 2023-10-14T18:54:23.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.106+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fb76c06f2f0 con 0x7fb78015a620 2023-10-14T18:54:23.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.108+0000 7fb767fff700 1 -- 172.21.15.79:0/609640095 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb770056c80 con 0x7fb78015a620 2023-10-14T18:54:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 msgr2=0x7fb76c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 0x7fb76c0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb774003a30 tx=0x7fb774007ea0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 msgr2=0x7fb7800690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb7700030c0 tx=0x7fb770016000 comp rx=0 tx=0).stop 2023-10-14T18:54:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 shutdown_connections 2023-10-14T18:54:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78015d580 0x7fb7800695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb780157870 0x7fb78016b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 --2- 172.21.15.79:0/609640095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78015a620 0x7fb7800690b0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 >> 172.21.15.79:0/609640095 conn(0x7fb780068ce0 msgr2=0x7fb78015fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 shutdown_connections 2023-10-14T18:54:23.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.110+0000 7fb7866fc700 1 -- 172.21.15.79:0/609640095 wait complete. 2023-10-14T18:54:23.115 INFO:tasks.ceph.mds.b.smithi144.stderr: -9071> 2023-10-14T18:52:09.139+0000 7fa84c3a1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:54:23.115 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:54:23.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:54:23.141 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:54:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.239+0000 7f02ce73f700 1 Processor -- start 2023-10-14T18:54:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.239+0000 7f02ce73f700 1 -- start start 2023-10-14T18:54:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02ce73f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 0x7f02c80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02ce73f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 0x7f02c80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02ce73f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c80b0790 con 0x7f02c815a290 2023-10-14T18:54:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02ce73f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c80ce1f0 con 0x7f02c806acb0 2023-10-14T18:54:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02ce73f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80b0b20 con 0x7f02c8159ec0 2023-10-14T18:54:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02c77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f02c815a290 0x7f02c806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56480/0 (socket says 172.21.15.79:56480) 2023-10-14T18:54:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02c77fe700 1 -- 172.21.15.79:0/2764221413 learned_addr learned my addr 172.21.15.79:0/2764221413 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2764221413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 0x7f02c80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02cccdc700 1 --2- 172.21.15.79:0/2764221413 >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 0x7f02c80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02c6ffd700 1 -- 172.21.15.79:0/2764221413 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952857585 0 0) 0x7f02c80b0790 con 0x7f02c815a290 2023-10-14T18:54:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.240+0000 7f02c6ffd700 1 -- 172.21.15.79:0/2764221413 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b0003570 con 0x7f02c815a290 2023-10-14T18:54:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c7fff700 1 -- 172.21.15.79:0/2764221413 >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 msgr2=0x7f02c80afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2764221413 >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 0x7f02c80afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c7fff700 1 -- 172.21.15.79:0/2764221413 >> v1:172.21.15.79:6789/0 conn(0x7f02c815a290 legacy=0x7f02c806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c7fff700 1 -- 172.21.15.79:0/2764221413 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80b04b0 con 0x7f02c8159ec0 2023-10-14T18:54:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02cccdc700 1 --2- 172.21.15.79:0/2764221413 >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 0x7f02c80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2764221413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 0x7f02c80af940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098e0 tx=0x7f02b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80a4d54388c97f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c6ffd700 1 -- 172.21.15.79:0/2764221413 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011630 con 0x7f02c8159ec0 2023-10-14T18:54:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c6ffd700 1 -- 172.21.15.79:0/2764221413 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8011790 con 0x7f02c8159ec0 2023-10-14T18:54:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02c6ffd700 1 -- 172.21.15.79:0/2764221413 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8011b30 con 0x7f02c8159ec0 2023-10-14T18:54:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02ce73f700 1 -- 172.21.15.79:0/2764221413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 msgr2=0x7f02c80af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2764221413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 0x7f02c80af940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098e0 tx=0x7f02b80091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.241+0000 7f02ce73f700 1 -- 172.21.15.79:0/2764221413 shutdown_connections 2023-10-14T18:54:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.242+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2764221413 >> v2:172.21.15.144:3300/0 conn(0x7f02c806acb0 0x7f02c80afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.242+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2764221413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c8159ec0 0x7f02c80af940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.242+0000 7f02ce73f700 1 -- 172.21.15.79:0/2764221413 >> 172.21.15.79:0/2764221413 conn(0x7f02c80d1880 msgr2=0x7f02c80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.242+0000 7f02ce73f700 1 -- 172.21.15.79:0/2764221413 shutdown_connections 2023-10-14T18:54:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.242+0000 7f02ce73f700 1 -- 172.21.15.79:0/2764221413 wait complete. 2023-10-14T18:54:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.243+0000 7f02ce73f700 1 Processor -- start 2023-10-14T18:54:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.243+0000 7f02ce73f700 1 -- start start 2023-10-14T18:54:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.243+0000 7f02ce73f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 0x7f02c816d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02c8159ec0 0x7f02c816b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c816b590 con 0x7f02c815a290 2023-10-14T18:54:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c816dc00 con 0x7f02c8159ec0 2023-10-14T18:54:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c816ea60 con 0x7f02c806acb0 2023-10-14T18:54:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40110/0 (socket says 172.21.15.79:40110) 2023-10-14T18:54:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 -- 172.21.15.79:0/2884999181 learned_addr learned my addr 172.21.15.79:0/2884999181 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 0x7f02c816d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02c77fe700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02c8159ec0 0x7f02c816b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 -- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 msgr2=0x7f02c816d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 0x7f02c816d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 -- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02c8159ec0 msgr2=0x7f02c816b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02c8159ec0 0x7f02c816b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009a20 con 0x7f02c815a290 2023-10-14T18:54:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 0x7f02c816d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02cccdc700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009f60 tx=0x7f02c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c000ccd0 con 0x7f02c815a290 2023-10-14T18:54:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8009420 con 0x7f02c815a290 2023-10-14T18:54:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000f040 con 0x7f02c815a290 2023-10-14T18:54:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c00146d0 con 0x7f02c815a290 2023-10-14T18:54:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.244+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c816e130 con 0x7f02c815a290 2023-10-14T18:54:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.245+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c804c3c0 con 0x7f02c815a290 2023-10-14T18:54:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.246+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02c0014a40 con 0x7f02c815a290 2023-10-14T18:54:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.246+0000 7f02affff700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.246+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f02c0085540 con 0x7f02c815a290 2023-10-14T18:54:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.246+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f02b406ebb0 con 0x7f02c815a290 2023-10-14T18:54:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.246+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.247+0000 7f02c7fff700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 0x7f02b40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02c815f6a0 tx=0x7f02b8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.250+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02c0018060 con 0x7f02c815a290 2023-10-14T18:54:23.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:23.475+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02c80ceab0 con 0x7f02c815a290 2023-10-14T18:54:24.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.108+0000 7f02affff700 1 -- 172.21.15.79:0/2884999181 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f02c00561b0 con 0x7f02c815a290 2023-10-14T18:54:24.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 msgr2=0x7f02b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 0x7f02b40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02c815f6a0 tx=0x7f02b8017000 comp rx=0 tx=0).stop 2023-10-14T18:54:24.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 msgr2=0x7f02c80cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009f60 tx=0x7f02c000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:24.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 shutdown_connections 2023-10-14T18:54:24.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f02b4066f30 0x7f02b40693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02c815a290 0x7f02c80cf590 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02c806acb0 0x7f02c816d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 --2- 172.21.15.79:0/2884999181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02c8159ec0 0x7f02c816b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 >> 172.21.15.79:0/2884999181 conn(0x7f02c80d1880 msgr2=0x7f02c80b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 shutdown_connections 2023-10-14T18:54:24.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.110+0000 7f02ce73f700 1 -- 172.21.15.79:0/2884999181 wait complete. 2023-10-14T18:54:24.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:54:24.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.248+0000 7fda0d645700 1 Processor -- start 2023-10-14T18:54:24.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.248+0000 7fda0d645700 1 -- start start 2023-10-14T18:54:24.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda0d645700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda0d645700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b6a10 0x7fda080b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda0d645700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda080b1a60 con 0x7fda080b15e0 2023-10-14T18:54:24.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda0d645700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda080b1d40 con 0x7fda080b6a10 2023-10-14T18:54:24.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda0d645700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080b2020 con 0x7fda08159ef0 2023-10-14T18:54:24.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b6a10 0x7fda080b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda06ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda080b6a10 0x7fda080b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:39648/0 (socket says 172.21.15.79:39648) 2023-10-14T18:54:24.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda06ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:40302/0 (socket says 172.21.15.79:40302) 2023-10-14T18:54:24.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 -- 172.21.15.79:0/745077781 learned_addr learned my addr 172.21.15.79:0/745077781 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:24.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda077fe700 1 --1- 172.21.15.79:0/745077781 >> v1:172.21.15.144:6789/0 conn(0x7fda080b15e0 0x7fda080b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:40824/0 (socket says 172.21.15.79:40824) 2023-10-14T18:54:24.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 -- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 msgr2=0x7fda0815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:24.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 -- 172.21.15.79:0/745077781 >> v1:172.21.15.144:6789/0 conn(0x7fda080b15e0 legacy=0x7fda080b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 -- 172.21.15.79:0/745077781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080b2300 con 0x7fda080b6a10 2023-10-14T18:54:24.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda05ffb700 1 -- 172.21.15.79:0/745077781 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362194354 0 0) 0x7fda080b1a60 con 0x7fda080b15e0 2023-10-14T18:54:24.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda06ffd700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:24.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.249+0000 7fda067fc700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b6a10 0x7fda080b10a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0099b0 tx=0x7fd9fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7de16a1cc07c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:24.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda05ffb700 1 -- 172.21.15.79:0/745077781 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc009ea0 con 0x7fda080b6a10 2023-10-14T18:54:24.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda05ffb700 1 -- 172.21.15.79:0/745077781 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc00b860 con 0x7fda080b6a10 2023-10-14T18:54:24.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda05ffb700 1 -- 172.21.15.79:0/745077781 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc00bc00 con 0x7fda080b6a10 2023-10-14T18:54:24.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 -- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b6a10 msgr2=0x7fda080b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b6a10 0x7fda080b10a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0099b0 tx=0x7fd9fc009250 comp rx=0 tx=0).stop 2023-10-14T18:54:24.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 -- 172.21.15.79:0/745077781 shutdown_connections 2023-10-14T18:54:24.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda08159ef0 0x7fda0815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 --2- 172.21.15.79:0/745077781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda080b6a10 0x7fda080b10a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 -- 172.21.15.79:0/745077781 >> 172.21.15.79:0/745077781 conn(0x7fda0809a0a0 msgr2=0x7fda08067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:24.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 -- 172.21.15.79:0/745077781 shutdown_connections 2023-10-14T18:54:24.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.250+0000 7fda0d645700 1 -- 172.21.15.79:0/745077781 wait complete. 2023-10-14T18:54:24.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 Processor -- start 2023-10-14T18:54:24.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 -- start start 2023-10-14T18:54:24.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 0x7fda08152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 0x7fda081573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0814e100 con 0x7fda081555c0 2023-10-14T18:54:24.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0813bfb0 con 0x7fda08159ef0 2023-10-14T18:54:24.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda0d645700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda08155b40 con 0x7fda080b6a10 2023-10-14T18:54:24.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40116/0 (socket says 172.21.15.79:40116) 2023-10-14T18:54:24.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.252+0000 7fda077fe700 1 -- 172.21.15.79:0/561899328 learned_addr learned my addr 172.21.15.79:0/561899328 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:24.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda06ffd700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 0x7fda08152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda067fc700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 0x7fda081573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 -- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 msgr2=0x7fda08152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 0x7fda08152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 -- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 msgr2=0x7fda081573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 0x7fda081573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00009a20 con 0x7fda081555c0 2023-10-14T18:54:24.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda06ffd700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 0x7fda08152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:24.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda067fc700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 0x7fda081573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:24.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda077fe700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c5e0 tx=0x7fd9f8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:24.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8005a70 con 0x7fda081555c0 2023-10-14T18:54:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f8005bd0 con 0x7fda081555c0 2023-10-14T18:54:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0094f0 con 0x7fda081555c0 2023-10-14T18:54:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80070d0 con 0x7fda081555c0 2023-10-14T18:54:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.253+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda08156100 con 0x7fda081555c0 2023-10-14T18:54:24.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.254+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0804c3c0 con 0x7fda081555c0 2023-10-14T18:54:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.254+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9f80074c0 con 0x7fda081555c0 2023-10-14T18:54:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.255+0000 7fd9eeffd700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 0x7fd9f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.255+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fd9f8083b30 con 0x7fda081555c0 2023-10-14T18:54:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.255+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7fd9f406ebb0 con 0x7fda081555c0 2023-10-14T18:54:24.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.255+0000 7fda06ffd700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 0x7fd9f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:24.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.255+0000 7fda06ffd700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 0x7fd9f40693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fda000099f0 tx=0x7fda0000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:24.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.259+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9f8017020 con 0x7fda081555c0 2023-10-14T18:54:24.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:24.443+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda0813c0f0 con 0x7fda081555c0 2023-10-14T18:54:25.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.116+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(160..160 src has 1..160) v4 ==== 288+0+0 (secure 0 0 0) 0x7fd9f80550d0 con 0x7fda081555c0 2023-10-14T18:54:25.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.116+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7fd9f406cfe0 con 0x7fda081555c0 2023-10-14T18:54:25.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.118+0000 7fd9eeffd700 1 -- 172.21.15.79:0/561899328 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v160) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd9f8050d10 con 0x7fda081555c0 2023-10-14T18:54:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 msgr2=0x7fd9f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 0x7fd9f40693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fda000099f0 tx=0x7fda0000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 msgr2=0x7fda08157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c5e0 tx=0x7fd9f8007d30 comp rx=0 tx=0).stop 2023-10-14T18:54:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 shutdown_connections 2023-10-14T18:54:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9f4066f30 0x7fd9f40693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda081555c0 0x7fda08157910 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda080b6a10 0x7fda08152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 --2- 172.21.15.79:0/561899328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda08159ef0 0x7fda081573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 >> 172.21.15.79:0/561899328 conn(0x7fda0809a0a0 msgr2=0x7fda0814ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 shutdown_connections 2023-10-14T18:54:25.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.123+0000 7fda0d645700 1 -- 172.21.15.79:0/561899328 wait complete. 2023-10-14T18:54:25.128 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:54:25.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:54:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.256+0000 7f01e14c2700 1 Processor -- start 2023-10-14T18:54:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.256+0000 7f01e14c2700 1 -- start start 2023-10-14T18:54:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01e14c2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01dc0af940 0x7f01dc0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01e14c2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0b1ea0 con 0x7f01dc0b36c0 2023-10-14T18:54:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01e14c2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0b2180 con 0x7f01dc0b1950 2023-10-14T18:54:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01e14c2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc0cb5f0 con 0x7f01dc0af940 2023-10-14T18:54:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01daffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f01dc0b36c0 0x7f01dc151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56486/0 (socket says 172.21.15.79:56486) 2023-10-14T18:54:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.257+0000 7f01daffd700 1 -- 172.21.15.79:0/1522725840 learned_addr learned my addr 172.21.15.79:0/1522725840 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01db7fe700 1 --2- 172.21.15.79:0/1522725840 >> v2:172.21.15.144:3300/0 conn(0x7f01dc0af940 0x7f01dc0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949065621 0 0) 0x7f01dc0b1ea0 con 0x7f01dc0b36c0 2023-10-14T18:54:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c8003570 con 0x7f01dc0b36c0 2023-10-14T18:54:25.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3595056211 0 0) 0x7f01c8003570 con 0x7f01dc0b36c0 2023-10-14T18:54:25.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 >> v2:172.21.15.144:3300/0 conn(0x7f01dc0af940 msgr2=0x7f01dc0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:25.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 --2- 172.21.15.79:0/1522725840 >> v2:172.21.15.144:3300/0 conn(0x7f01dc0af940 0x7f01dc0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 >> v1:172.21.15.144:6789/0 conn(0x7f01dc0b1950 legacy=0x7f01dc0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0b2460 con 0x7f01dc0b36c0 2023-10-14T18:54:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f01cc001470 con 0x7f01dc0b36c0 2023-10-14T18:54:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 >> v1:172.21.15.79:6789/0 conn(0x7f01dc0b36c0 legacy=0x7f01dc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c8003a60 0x7f01c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 0x7f01c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c80051c0 0x7f01c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0cb5f0 con 0x7f01c8004810 2023-10-14T18:54:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c800c0d0 con 0x7f01c8003a60 2023-10-14T18:54:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c800c290 con 0x7f01c80051c0 2023-10-14T18:54:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 0x7f01c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01daffd700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c8003a60 0x7f01c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01db7fe700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c80051c0 0x7f01c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 -- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c80051c0 msgr2=0x7f01c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c80051c0 0x7f01c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 -- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c8003a60 msgr2=0x7f01c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:25.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c8003a60 0x7f01c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01db7fe700 1 -- 172.21.15.79:0/1522725840 reap_dead start 2023-10-14T18:54:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.258+0000 7f01d27fc700 1 -- 172.21.15.79:0/1522725840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8003570 con 0x7f01c8004810 2023-10-14T18:54:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01d27fc700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 0x7f01c8004c80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f01c4001880 tx=0x7f01c4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e023399cd0c1f8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:25.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4012420 con 0x7f01c8004810 2023-10-14T18:54:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c40125a0 con 0x7f01c8004810 2023-10-14T18:54:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01da7fc700 1 -- 172.21.15.79:0/1522725840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4012960 con 0x7f01c8004810 2023-10-14T18:54:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 -- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 msgr2=0x7f01c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 0x7f01c8004c80 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f01c4001880 tx=0x7f01c4007d30 comp rx=0 tx=0).stop 2023-10-14T18:54:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 -- 172.21.15.79:0/1522725840 shutdown_connections 2023-10-14T18:54:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 --2- 172.21.15.79:0/1522725840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01c8004810 0x7f01c8004c80 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 -- 172.21.15.79:0/1522725840 >> 172.21.15.79:0/1522725840 conn(0x7f01dc069870 msgr2=0x7f01dc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:25.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 -- 172.21.15.79:0/1522725840 shutdown_connections 2023-10-14T18:54:25.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.259+0000 7f01e14c2700 1 -- 172.21.15.79:0/1522725840 wait complete. 2023-10-14T18:54:25.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.260+0000 7f01e14c2700 1 Processor -- start 2023-10-14T18:54:25.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 -- start start 2023-10-14T18:54:25.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c8004810 0x7f01dc16b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01dc159430 0x7f01dc0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0c92f0 con 0x7f01dc0c8910 2023-10-14T18:54:25.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc16bb00 con 0x7f01dc159430 2023-10-14T18:54:25.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01e14c2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc159d50 con 0x7f01c8004810 2023-10-14T18:54:25.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40142/0 (socket says 172.21.15.79:40142) 2023-10-14T18:54:25.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.261+0000 7f01db7fe700 1 -- 172.21.15.79:0/2548957256 learned_addr learned my addr 172.21.15.79:0/2548957256 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:25.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01daffd700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c8004810 0x7f01dc16b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 -- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c8004810 msgr2=0x7f01dc16b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c8004810 0x7f01dc16b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01d27fc700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01dc159430 0x7f01dc0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 -- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01dc159430 msgr2=0x7f01dc0acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:25.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01dc159430 0x7f01dc0acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:25.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc15abb0 con 0x7f01dc0c8910 2023-10-14T18:54:25.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01db7fe700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0b16b0 tx=0x7f01d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:25.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400e040 con 0x7f01dc0c8910 2023-10-14T18:54:25.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d400f040 con 0x7f01dc0c8910 2023-10-14T18:54:25.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc0ad2b0 con 0x7f01dc0c8910 2023-10-14T18:54:25.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400fe20 con 0x7f01dc0c8910 2023-10-14T18:54:25.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.262+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc15a280 con 0x7f01dc0c8910 2023-10-14T18:54:25.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.263+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc06b900 con 0x7f01dc0c8910 2023-10-14T18:54:25.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.263+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01d4015640 con 0x7f01dc0c8910 2023-10-14T18:54:25.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.264+0000 7f01d37fe700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 0x7f01bc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:25.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.264+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f01d4084df0 con 0x7f01dc0c8910 2023-10-14T18:54:25.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.264+0000 7f01daffd700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 0x7f01bc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:25.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.264+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f01bc06dde0 con 0x7f01dc0c8910 2023-10-14T18:54:25.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.264+0000 7f01daffd700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 0x7f01bc069410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01cc000e10 tx=0x7f01cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:25.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.268+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01d40520e0 con 0x7f01dc0c8910 2023-10-14T18:54:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:25.452+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f01dc15ad40 con 0x7f01dc0c8910 2023-10-14T18:54:26.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.121+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(161..161 src has 1..161) v4 ==== 322+0+0 (secure 0 0 0) 0x7f01d4055da0 con 0x7f01dc0c8910 2023-10-14T18:54:26.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.121+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=162}) v3 -- 0x7f01bc06cb70 con 0x7f01dc0c8910 2023-10-14T18:54:26.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.126+0000 7f01d37fe700 1 -- 172.21.15.79:0/2548957256 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v161) v1 ==== 169+0+0 (secure 0 0 0) 0x7f01d4055700 con 0x7f01dc0c8910 2023-10-14T18:54:26.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.129+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 msgr2=0x7f01bc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.129+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 0x7f01bc069410 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f01cc000e10 tx=0x7f01cc009040 comp rx=0 tx=0).stop 2023-10-14T18:54:26.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.129+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 msgr2=0x7f01dc0c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.129+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0b16b0 tx=0x7f01d400b040 comp rx=0 tx=0).stop 2023-10-14T18:54:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 shutdown_connections 2023-10-14T18:54:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f01bc066f60 0x7f01bc069410 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01dc0c8910 0x7f01dc0c8db0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01c8004810 0x7f01dc16b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 --2- 172.21.15.79:0/2548957256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01dc159430 0x7f01dc0acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.130+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 >> 172.21.15.79:0/2548957256 conn(0x7f01dc069870 msgr2=0x7f01dc157060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.131+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 shutdown_connections 2023-10-14T18:54:26.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.132+0000 7f01e14c2700 1 -- 172.21.15.79:0/2548957256 wait complete. 2023-10-14T18:54:26.134 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:54:26.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:54:26.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.264+0000 7f5c1e293700 1 Processor -- start 2023-10-14T18:54:26.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.264+0000 7f5c1e293700 1 -- start start 2023-10-14T18:54:26.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1e293700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c18159ec0 0x7f5c180af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1e293700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c1806acb0 0x7f5c180afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1e293700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c180b0790 con 0x7f5c1815a290 2023-10-14T18:54:26.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1e293700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c180ce1f0 con 0x7f5c18159ec0 2023-10-14T18:54:26.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1e293700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c180b0b20 con 0x7f5c1806acb0 2023-10-14T18:54:26.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c17fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c18159ec0 0x7f5c180af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c177fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5c1815a290 0x7f5c1806a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56492/0 (socket says 172.21.15.79:56492) 2023-10-14T18:54:26.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c177fe700 1 -- 172.21.15.79:0/349231495 learned_addr learned my addr 172.21.15.79:0/349231495 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:26.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c1c830700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c1806acb0 0x7f5c180afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c17fff700 1 -- 172.21.15.79:0/349231495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c1806acb0 msgr2=0x7f5c180afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:26.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c17fff700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c1806acb0 0x7f5c180afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c17fff700 1 -- 172.21.15.79:0/349231495 >> v1:172.21.15.79:6789/0 conn(0x7f5c1815a290 legacy=0x7f5c1806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c17fff700 1 -- 172.21.15.79:0/349231495 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180b04b0 con 0x7f5c18159ec0 2023-10-14T18:54:26.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.265+0000 7f5c16ffd700 1 -- 172.21.15.79:0/349231495 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825675828 0 0) 0x7f5c180b0790 con 0x7f5c1815a290 2023-10-14T18:54:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c17fff700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c18159ec0 0x7f5c180af940 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098e0 tx=0x7f5c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466848813740471b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c16ffd700 1 -- 172.21.15.79:0/349231495 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08009e80 con 0x7f5c18159ec0 2023-10-14T18:54:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c16ffd700 1 -- 172.21.15.79:0/349231495 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0800b860 con 0x7f5c18159ec0 2023-10-14T18:54:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c16ffd700 1 -- 172.21.15.79:0/349231495 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800bbe0 con 0x7f5c18159ec0 2023-10-14T18:54:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 -- 172.21.15.79:0/349231495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c18159ec0 msgr2=0x7f5c180af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c18159ec0 0x7f5c180af940 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098e0 tx=0x7f5c080091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 -- 172.21.15.79:0/349231495 shutdown_connections 2023-10-14T18:54:26.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c1806acb0 0x7f5c180afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 --2- 172.21.15.79:0/349231495 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c18159ec0 0x7f5c180af940 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 -- 172.21.15.79:0/349231495 >> 172.21.15.79:0/349231495 conn(0x7f5c180d1880 msgr2=0x7f5c180cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:26.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 -- 172.21.15.79:0/349231495 shutdown_connections 2023-10-14T18:54:26.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.266+0000 7f5c1e293700 1 -- 172.21.15.79:0/349231495 wait complete. 2023-10-14T18:54:26.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.267+0000 7f5c1e293700 1 Processor -- start 2023-10-14T18:54:26.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 -- start start 2023-10-14T18:54:26.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 0x7f5c1815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c18159ec0 0x7f5c18155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1815d8c0 con 0x7f5c1815a290 2023-10-14T18:54:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1815d340 con 0x7f5c1806acb0 2023-10-14T18:54:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1e293700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1815d5e0 con 0x7f5c18159ec0 2023-10-14T18:54:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1c830700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1c830700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40152/0 (socket says 172.21.15.79:40152) 2023-10-14T18:54:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.268+0000 7f5c1c830700 1 -- 172.21.15.79:0/3461460963 learned_addr learned my addr 172.21.15.79:0/3461460963 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c177fe700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c18159ec0 0x7f5c18155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c17fff700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 0x7f5c1815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 -- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c18159ec0 msgr2=0x7f5c18155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c18159ec0 0x7f5c18155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 -- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 msgr2=0x7f5c1815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 0x7f5c1815a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 -- 172.21.15.79:0/3461460963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009420 con 0x7f5c1815a290 2023-10-14T18:54:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c17fff700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 0x7f5c1815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:26.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1c830700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5c10007ed0 tx=0x7f5c10009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000eca0 con 0x7f5c1815a290 2023-10-14T18:54:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000ee20 con 0x7f5c1815a290 2023-10-14T18:54:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18169fc0 con 0x7f5c1815a290 2023-10-14T18:54:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10014670 con 0x7f5c1815a290 2023-10-14T18:54:26.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.269+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1816a580 con 0x7f5c1815a290 2023-10-14T18:54:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.270+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1804c3c0 con 0x7f5c1815a290 2023-10-14T18:54:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.270+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c10014aa0 con 0x7f5c1815a290 2023-10-14T18:54:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.271+0000 7f5bfffff700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 0x7f5c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.271+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5c10084990 con 0x7f5c1815a290 2023-10-14T18:54:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.271+0000 7f5c17fff700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 0x7f5c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.271+0000 7f5c17fff700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 0x7f5c040693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5c08003080 tx=0x7f5c08017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.275+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c10051f00 con 0x7f5c1815a290 2023-10-14T18:54:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.460+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5c180ceab0 con 0x7f5c1815a290 2023-10-14T18:54:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.463+0000 7f5bfffff700 1 -- 172.21.15.79:0/3461460963 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5c10055520 con 0x7f5c1815a290 2023-10-14T18:54:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 msgr2=0x7f5c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 0x7f5c040693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5c08003080 tx=0x7f5c08017000 comp rx=0 tx=0).stop 2023-10-14T18:54:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 msgr2=0x7f5c1815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5c10007ed0 tx=0x7f5c10009880 comp rx=0 tx=0).stop 2023-10-14T18:54:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 shutdown_connections 2023-10-14T18:54:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c04066f30 0x7f5c040693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c1815a290 0x7f5c1815ce00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c1806acb0 0x7f5c1815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 --2- 172.21.15.79:0/3461460963 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c18159ec0 0x7f5c18155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 >> 172.21.15.79:0/3461460963 conn(0x7f5c180d1880 msgr2=0x7f5c180c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 shutdown_connections 2023-10-14T18:54:26.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.466+0000 7f5c1e293700 1 -- 172.21.15.79:0/3461460963 wait complete. 2023-10-14T18:54:26.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-14T18:54:26.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.592+0000 7fb74d392700 1 Processor -- start 2023-10-14T18:54:26.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.592+0000 7fb74d392700 1 -- start start 2023-10-14T18:54:26.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb74d392700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7480ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb74d392700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480afbc0 con 0x7fb7480aeaa0 2023-10-14T18:54:26.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb74d392700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480ac9b0 con 0x7fb74806f150 2023-10-14T18:54:26.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb74d392700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480af600 con 0x7fb7481579d0 2023-10-14T18:54:26.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb7467fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb7480aeaa0 0x7fb74806ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56500/0 (socket says 172.21.15.79:56500) 2023-10-14T18:54:26.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.593+0000 7fb7467fc700 1 -- 172.21.15.79:0/2151003130 learned_addr learned my addr 172.21.15.79:0/2151003130 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb746ffd700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7480ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676091579 0 0) 0x7fb730001110 con 0x7fb7480aeaa0 2023-10-14T18:54:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb734003570 con 0x7fb7480aeaa0 2023-10-14T18:54:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1848784533 0 0) 0x7fb734003570 con 0x7fb7480aeaa0 2023-10-14T18:54:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 msgr2=0x7fb7480ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7480ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 >> v1:172.21.15.144:6789/0 conn(0x7fb74806f150 legacy=0x7fb7480a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480af8e0 con 0x7fb7480aeaa0 2023-10-14T18:54:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fb730001600 con 0x7fb7480aeaa0 2023-10-14T18:54:26.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 >> v1:172.21.15.79:6789/0 conn(0x7fb7480aeaa0 legacy=0x7fb74806ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734003a90 0x7fb734003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734004810 0x7fb734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7340051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480af600 con 0x7fb734004810 2023-10-14T18:54:26.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400bb60 con 0x7fb734003a90 2023-10-14T18:54:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73400bd20 con 0x7fb7481579d0 2023-10-14T18:54:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734004810 0x7fb734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb746ffd700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734003a90 0x7fb734003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7477fe700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7340051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 -- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 msgr2=0x7fb7340051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7481579d0 0x7fb7340051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 -- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734003a90 msgr2=0x7fb734003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734003a90 0x7fb734003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.594+0000 7fb7467fc700 1 -- 172.21.15.79:0/2151003130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734003570 con 0x7fb734004810 2023-10-14T18:54:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb7467fc700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734004810 0x7fb734004c80 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c5c0 tx=0x7fb730007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d010944ea0d27f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000cdc0 con 0x7fb734004810 2023-10-14T18:54:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb730005920 con 0x7fb734004810 2023-10-14T18:54:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb745ffb700 1 -- 172.21.15.79:0/2151003130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730005ce0 con 0x7fb734004810 2023-10-14T18:54:26.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 -- 172.21.15.79:0/2151003130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734004810 msgr2=0x7fb734004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 --2- 172.21.15.79:0/2151003130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb734004810 0x7fb734004c80 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c5c0 tx=0x7fb730007a50 comp rx=0 tx=0).stop 2023-10-14T18:54:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb7477fe700 1 -- 172.21.15.79:0/2151003130 reap_dead start 2023-10-14T18:54:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 -- 172.21.15.79:0/2151003130 shutdown_connections 2023-10-14T18:54:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 -- 172.21.15.79:0/2151003130 >> 172.21.15.79:0/2151003130 conn(0x7fb7480cd270 msgr2=0x7fb7480cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:26.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 -- 172.21.15.79:0/2151003130 shutdown_connections 2023-10-14T18:54:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.595+0000 7fb74d392700 1 -- 172.21.15.79:0/2151003130 wait complete. 2023-10-14T18:54:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.596+0000 7fb74d392700 1 Processor -- start 2023-10-14T18:54:26.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 -- start start 2023-10-14T18:54:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734004810 0x7fb7481560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7480ab750 0x7fb7480abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480ac100 con 0x7fb748099c70 2023-10-14T18:54:26.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c7cf0 con 0x7fb734004810 2023-10-14T18:54:26.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb74d392700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c73c0 con 0x7fb7480ab750 2023-10-14T18:54:26.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40172/0 (socket says 172.21.15.79:40172) 2023-10-14T18:54:26.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.597+0000 7fb7477fe700 1 -- 172.21.15.79:0/3514845298 learned_addr learned my addr 172.21.15.79:0/3514845298 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:26.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 -- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7480ab750 msgr2=0x7fb7480abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7480ab750 0x7fb7480abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 -- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734004810 msgr2=0x7fb7481560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:26.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734004810 0x7fb7481560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:26.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 -- 172.21.15.79:0/3514845298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480c76a0 con 0x7fb748099c70 2023-10-14T18:54:26.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb7477fe700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb7480ce2e0 tx=0x7fb740009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000ee60 con 0x7fb748099c70 2023-10-14T18:54:26.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb740012590 con 0x7fb748099c70 2023-10-14T18:54:26.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480c7980 con 0x7fb748099c70 2023-10-14T18:54:26.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740012950 con 0x7fb748099c70 2023-10-14T18:54:26.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.598+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480c6fe0 con 0x7fb748099c70 2023-10-14T18:54:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.599+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb748156610 con 0x7fb748099c70 2023-10-14T18:54:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.599+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb740012d00 con 0x7fb748099c70 2023-10-14T18:54:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.600+0000 7fb73effd700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:26.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.600+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb740084140 con 0x7fb748099c70 2023-10-14T18:54:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.600+0000 7fb746ffd700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.600+0000 7fb746ffd700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fd0 tx=0x7fb73800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:26.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.604+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb740051610 con 0x7fb748099c70 2023-10-14T18:54:26.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:26.860+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fb7480ac640 con 0x7fb748099c70 2023-10-14T18:54:27.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.763+0000 7fb73effd700 1 -- 172.21.15.79:0/3514845298 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v448) v1 ==== 132+0+0 (secure 0 0 0) 0x7fb740054c30 con 0x7fb748099c70 2023-10-14T18:54:27.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 msgr2=0x7fb7280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 0x7fb7280693e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fd0 tx=0x7fb73800b040 comp rx=0 tx=0).stop 2023-10-14T18:54:27.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 msgr2=0x7fb74809a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb7480ce2e0 tx=0x7fb740009040 comp rx=0 tx=0).stop 2023-10-14T18:54:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 shutdown_connections 2023-10-14T18:54:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb728066f30 0x7fb7280693e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb748099c70 0x7fb74809a0e0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb734004810 0x7fb7481560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 --2- 172.21.15.79:0/3514845298 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb7480ab750 0x7fb7480abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 >> 172.21.15.79:0/3514845298 conn(0x7fb7480cd270 msgr2=0x7fb74815a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 shutdown_connections 2023-10-14T18:54:27.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.765+0000 7fb74d392700 1 -- 172.21.15.79:0/3514845298 wait complete. 2023-10-14T18:54:27.780 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-14T18:54:27.780 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-14T18:54:27.780 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-14T18:54:27.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-14T18:54:27.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.898+0000 7fad069e5700 1 Processor -- start 2023-10-14T18:54:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.898+0000 7fad069e5700 1 -- start start 2023-10-14T18:54:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.899+0000 7fad069e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad00152010 0x7fad0015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.899+0000 7fad069e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.899+0000 7fad069e5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0006c010 con 0x7fad001523e0 2023-10-14T18:54:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.899+0000 7fad069e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0006bd10 con 0x7fad00152010 2023-10-14T18:54:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.899+0000 7fad069e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0015c060 con 0x7fad00158e50 2023-10-14T18:54:27.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7fad04f82700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad00152010 0x7fad0015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad00152010 0x7fad0015b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:39716/0 (socket says 172.21.15.79:39716) 2023-10-14T18:54:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7fad04f82700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:40380/0 (socket says 172.21.15.79:40380) 2023-10-14T18:54:27.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 -- 172.21.15.79:0/3501471188 learned_addr learned my addr 172.21.15.79:0/3501471188 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:27.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facff7fe700 1 --1- 172.21.15.79:0/3501471188 >> v1:172.21.15.144:6789/0 conn(0x7fad001523e0 0x7fad0006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:40866/0 (socket says 172.21.15.79:40866) 2023-10-14T18:54:27.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 -- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 msgr2=0x7fad000cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:27.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 -- 172.21.15.79:0/3501471188 >> v1:172.21.15.144:6789/0 conn(0x7fad001523e0 legacy=0x7fad0006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 -- 172.21.15.79:0/3501471188 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0015c340 con 0x7fad00152010 2023-10-14T18:54:27.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfeffd700 1 -- 172.21.15.79:0/3501471188 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251539300 0 0) 0x7fad0006c010 con 0x7fad001523e0 2023-10-14T18:54:27.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7fad04f82700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.900+0000 7facfffff700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad00152010 0x7fad0015b810 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7facf00099b0 tx=0x7facf0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9bfc3351255fc2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7facfeffd700 1 -- 172.21.15.79:0/3501471188 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0009ea0 con 0x7fad00152010 2023-10-14T18:54:27.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7facfeffd700 1 -- 172.21.15.79:0/3501471188 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000b860 con 0x7fad00152010 2023-10-14T18:54:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7facfeffd700 1 -- 172.21.15.79:0/3501471188 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000bc00 con 0x7fad00152010 2023-10-14T18:54:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 -- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad00152010 msgr2=0x7fad0015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad00152010 0x7fad0015b810 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7facf00099b0 tx=0x7facf0009250 comp rx=0 tx=0).stop 2023-10-14T18:54:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 -- 172.21.15.79:0/3501471188 shutdown_connections 2023-10-14T18:54:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 --2- 172.21.15.79:0/3501471188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad00152010 0x7fad0015b810 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 -- 172.21.15.79:0/3501471188 >> 172.21.15.79:0/3501471188 conn(0x7fad00069870 msgr2=0x7fad00069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:27.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 -- 172.21.15.79:0/3501471188 shutdown_connections 2023-10-14T18:54:27.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.901+0000 7fad069e5700 1 -- 172.21.15.79:0/3501471188 wait complete. 2023-10-14T18:54:27.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.902+0000 7fad069e5700 1 Processor -- start 2023-10-14T18:54:27.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.902+0000 7fad069e5700 1 -- start start 2023-10-14T18:54:27.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 0x7fad000b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00150dd0 con 0x7fad00152010 2023-10-14T18:54:27.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000b29d0 con 0x7fad001523e0 2023-10-14T18:54:27.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad069e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000b33a0 con 0x7fad00158e50 2023-10-14T18:54:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40182/0 (socket says 172.21.15.79:40182) 2023-10-14T18:54:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 -- 172.21.15.79:0/4077104653 learned_addr learned my addr 172.21.15.79:0/4077104653 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facff7fe700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 0x7fad000b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad04f82700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 -- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 msgr2=0x7fad000c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 -- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 msgr2=0x7fad000b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 0x7fad000b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facfffff700 1 -- 172.21.15.79:0/4077104653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009a20 con 0x7fad00152010 2023-10-14T18:54:27.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7fad04f82700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.903+0000 7facff7fe700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 0x7fad000b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:27.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7facfffff700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fad000c59e0 tx=0x7facf0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000bbe0 con 0x7fad00152010 2023-10-14T18:54:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0011420 con 0x7fad00152010 2023-10-14T18:54:27.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00117e0 con 0x7fad00152010 2023-10-14T18:54:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf00094f0 con 0x7fad00152010 2023-10-14T18:54:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.904+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000b20a0 con 0x7fad00152010 2023-10-14T18:54:27.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.905+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad000b2cb0 con 0x7fad00152010 2023-10-14T18:54:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.905+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf0011b50 con 0x7fad00152010 2023-10-14T18:54:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.906+0000 7face7fff700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:27.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.906+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7facf00858b0 con 0x7fad00152010 2023-10-14T18:54:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.906+0000 7facff7fe700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.906+0000 7facff7fe700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 0x7facec0693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7facf40018d0 tx=0x7facf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:27.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:27.910+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf0052e80 con 0x7fad00152010 2023-10-14T18:54:28.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.165+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fad0004c3c0 con 0x7fad00152010 2023-10-14T18:54:28.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.767+0000 7face7fff700 1 -- 172.21.15.79:0/4077104653 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v449) v1 ==== 134+0+0 (secure 0 0 0) 0x7facf0056420 con 0x7fad00152010 2023-10-14T18:54:28.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 msgr2=0x7facec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 0x7facec0693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7facf40018d0 tx=0x7facf4009040 comp rx=0 tx=0).stop 2023-10-14T18:54:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 msgr2=0x7fad00150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fad000c59e0 tx=0x7facf0017000 comp rx=0 tx=0).stop 2023-10-14T18:54:28.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 shutdown_connections 2023-10-14T18:54:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7facec066f30 0x7facec0693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad00158e50 0x7fad000c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad00152010 0x7fad00150890 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 --2- 172.21.15.79:0/4077104653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad001523e0 0x7fad000b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 >> 172.21.15.79:0/4077104653 conn(0x7fad00069870 msgr2=0x7fad001515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 shutdown_connections 2023-10-14T18:54:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.769+0000 7fad069e5700 1 -- 172.21.15.79:0/4077104653 wait complete. 2023-10-14T18:54:28.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:54:28.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.899+0000 7f0070c5f700 1 Processor -- start 2023-10-14T18:54:28.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 -- start start 2023-10-14T18:54:28.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 0x7f006c0af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f006c15a290 0x7f006c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c0b0790 con 0x7f006c06a5a0 2023-10-14T18:54:28.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c0ce1f0 con 0x7f006c15a290 2023-10-14T18:54:28.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0070c5f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0b0b20 con 0x7f006c159ec0 2023-10-14T18:54:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0061d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f006c15a290 0x7f006c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f0061d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f006c15a290 0x7f006c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33530/0 (socket says 172.21.15.79:33530) 2023-10-14T18:54:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.900+0000 7f006ad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f006c06a5a0 0x7f006c15db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36756/0 (socket says 172.21.15.79:36756) 2023-10-14T18:54:28.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 -- 172.21.15.79:0/778254959 learned_addr learned my addr 172.21.15.79:0/778254959 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:28.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f006a59c700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 0x7f006c0af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:28.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 -- 172.21.15.79:0/778254959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 msgr2=0x7f006c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:28.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 0x7f006c0af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 -- 172.21.15.79:0/778254959 >> v1:172.21.15.79:6789/0 conn(0x7f006c06a5a0 legacy=0x7f006c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 -- 172.21.15.79:0/778254959 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0b04b0 con 0x7f006c15a290 2023-10-14T18:54:28.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0069d9b700 1 -- 172.21.15.79:0/778254959 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716531545 0 0) 0x7f006c0b0790 con 0x7f006c06a5a0 2023-10-14T18:54:28.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f006a59c700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 0x7f006c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0061d9b700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c15a290 0x7f006c0afe80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f00540099b0 tx=0x7f0054009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651c5ea23ea1f0c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0069d9b700 1 -- 172.21.15.79:0/778254959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400b860 con 0x7f006c15a290 2023-10-14T18:54:28.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0069d9b700 1 -- 172.21.15.79:0/778254959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005400b9c0 con 0x7f006c15a290 2023-10-14T18:54:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.901+0000 7f0069d9b700 1 -- 172.21.15.79:0/778254959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400bd60 con 0x7f006c15a290 2023-10-14T18:54:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 -- 172.21.15.79:0/778254959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c15a290 msgr2=0x7f006c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c15a290 0x7f006c0afe80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f00540099b0 tx=0x7f0054009250 comp rx=0 tx=0).stop 2023-10-14T18:54:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 -- 172.21.15.79:0/778254959 shutdown_connections 2023-10-14T18:54:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c159ec0 0x7f006c0af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 --2- 172.21.15.79:0/778254959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c15a290 0x7f006c0afe80 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 -- 172.21.15.79:0/778254959 >> 172.21.15.79:0/778254959 conn(0x7f006c0d1880 msgr2=0x7f006c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 -- 172.21.15.79:0/778254959 shutdown_connections 2023-10-14T18:54:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.902+0000 7f0070c5f700 1 -- 172.21.15.79:0/778254959 wait complete. 2023-10-14T18:54:28.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.903+0000 7f0070c5f700 1 Processor -- start 2023-10-14T18:54:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.903+0000 7f0070c5f700 1 -- start start 2023-10-14T18:54:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f006c06a5a0 0x7f006c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c15a290 0x7f006c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c155210 con 0x7f006c159ec0 2023-10-14T18:54:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c1406a0 con 0x7f006c06a5a0 2023-10-14T18:54:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c140090 con 0x7f006c15a290 2023-10-14T18:54:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:28.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33542/0 (socket says 172.21.15.79:33542) 2023-10-14T18:54:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 -- 172.21.15.79:0/3770637952 learned_addr learned my addr 172.21.15.79:0/3770637952 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 -- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c15a290 msgr2=0x7f006c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c15a290 0x7f006c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 -- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f006c06a5a0 msgr2=0x7f006c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f006c06a5a0 0x7f006c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 -- 172.21.15.79:0/3770637952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540094f0 con 0x7f006c159ec0 2023-10-14T18:54:28.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0061d9b700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f00540090b0 tx=0x7f0054017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:28.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005401a450 con 0x7f006c159ec0 2023-10-14T18:54:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005401a5d0 con 0x7f006c159ec0 2023-10-14T18:54:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c0ca420 con 0x7f006c159ec0 2023-10-14T18:54:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005401a990 con 0x7f006c159ec0 2023-10-14T18:54:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.904+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c14eea0 con 0x7f006c159ec0 2023-10-14T18:54:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.905+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c04c3c0 con 0x7f006c159ec0 2023-10-14T18:54:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.906+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f005401b430 con 0x7f006c159ec0 2023-10-14T18:54:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.906+0000 7f0062ffd700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 0x7f004c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.906+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0054085930 con 0x7f006c159ec0 2023-10-14T18:54:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.906+0000 7f006a59c700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 0x7f004c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.907+0000 7f006a59c700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 0x7f004c0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f005c006fd0 tx=0x7f005c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:28.910+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0054052ea0 con 0x7f006c159ec0 2023-10-14T18:54:29.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.092+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f006c0ceab0 con 0x7f006c159ec0 2023-10-14T18:54:29.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.095+0000 7f0062ffd700 1 -- 172.21.15.79:0/3770637952 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00540200c0 con 0x7f006c159ec0 2023-10-14T18:54:29.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 msgr2=0x7f004c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 0x7f004c0693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f005c006fd0 tx=0x7f005c008040 comp rx=0 tx=0).stop 2023-10-14T18:54:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 msgr2=0x7f006c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f00540090b0 tx=0x7f0054017000 comp rx=0 tx=0).stop 2023-10-14T18:54:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 shutdown_connections 2023-10-14T18:54:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f004c066f30 0x7f004c0693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f006c15a290 0x7f006c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f006c06a5a0 0x7f006c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 --2- 172.21.15.79:0/3770637952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c159ec0 0x7f006c0c9d80 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 >> 172.21.15.79:0/3770637952 conn(0x7f006c0d1880 msgr2=0x7f006c0cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:29.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 shutdown_connections 2023-10-14T18:54:29.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.097+0000 7f0070c5f700 1 -- 172.21.15.79:0/3770637952 wait complete. 2023-10-14T18:54:29.110 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:54:29.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:54:29.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:54:29.200 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:54:29.200 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:54:29.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:29.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 Processor -- start 2023-10-14T18:54:29.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 -- start start 2023-10-14T18:54:29.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0d01510f0 0x7fa0d006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d00ca0b0 con 0x7fa0d00c9af0 2023-10-14T18:54:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d0068a10 con 0x7fa0d0070700 2023-10-14T18:54:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.315+0000 7fa0d6427700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d0068cf0 con 0x7fa0d01510f0 2023-10-14T18:54:29.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0d01510f0 0x7fa0d006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa0d01510f0 0x7fa0d006ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33558/0 (socket says 172.21.15.79:33558) 2023-10-14T18:54:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cf7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa0d00c9af0 0x7fa0d015dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36764/0 (socket says 172.21.15.79:36764) 2023-10-14T18:54:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 -- 172.21.15.79:0/2598295774 learned_addr learned my addr 172.21.15.79:0/2598295774 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 -- 172.21.15.79:0/2598295774 >> v1:172.21.15.144:6789/0 conn(0x7fa0d0070700 legacy=0x7fa0d0070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:29.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 -- 172.21.15.79:0/2598295774 >> v1:172.21.15.79:6789/0 conn(0x7fa0d00c9af0 legacy=0x7fa0d015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 -- 172.21.15.79:0/2598295774 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00cb230 con 0x7fa0d01510f0 2023-10-14T18:54:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0ceffd700 1 -- 172.21.15.79:0/2598295774 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219541305 0 0) 0x7fa0d00ca0b0 con 0x7fa0d00c9af0 2023-10-14T18:54:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0cffff700 1 --2- 172.21.15.79:0/2598295774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d01510f0 0x7fa0d006ecc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00099b0 tx=0x7fa0c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f4e2cfbedc1267 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0ceffd700 1 -- 172.21.15.79:0/2598295774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000b820 con 0x7fa0d01510f0 2023-10-14T18:54:29.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0ceffd700 1 -- 172.21.15.79:0/2598295774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000b980 con 0x7fa0d01510f0 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.316+0000 7fa0ceffd700 1 -- 172.21.15.79:0/2598295774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000bd20 con 0x7fa0d01510f0 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 -- 172.21.15.79:0/2598295774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d01510f0 msgr2=0x7fa0d006ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 --2- 172.21.15.79:0/2598295774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d01510f0 0x7fa0d006ecc0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00099b0 tx=0x7fa0c0009250 comp rx=0 tx=0).stop 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 -- 172.21.15.79:0/2598295774 shutdown_connections 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 --2- 172.21.15.79:0/2598295774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d01510f0 0x7fa0d006ecc0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 -- 172.21.15.79:0/2598295774 >> 172.21.15.79:0/2598295774 conn(0x7fa0d00ca4f0 msgr2=0x7fa0d00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:29.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 -- 172.21.15.79:0/2598295774 shutdown_connections 2023-10-14T18:54:29.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.317+0000 7fa0d6427700 1 -- 172.21.15.79:0/2598295774 wait complete. 2023-10-14T18:54:29.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.318+0000 7fa0d6427700 1 Processor -- start 2023-10-14T18:54:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.318+0000 7fa0d6427700 1 -- start start 2023-10-14T18:54:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d0070700 0x7fa0d00b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d01510f0 0x7fa0d0150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00b1a20 con 0x7fa0d00c9af0 2023-10-14T18:54:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01557c0 con 0x7fa0d0070700 2023-10-14T18:54:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00b36b0 con 0x7fa0d01510f0 2023-10-14T18:54:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33570/0 (socket says 172.21.15.79:33570) 2023-10-14T18:54:29.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/1641371846 learned_addr learned my addr 172.21.15.79:0/1641371846 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cffff700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d0070700 0x7fa0d00b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d49c4700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d01510f0 0x7fa0d0150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d01510f0 msgr2=0x7fa0d0150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d01510f0 0x7fa0d0150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d0070700 msgr2=0x7fa0d00b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d0070700 0x7fa0d00b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/1641371846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00094f0 con 0x7fa0d00c9af0 2023-10-14T18:54:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0cf7fe700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40011e0 tx=0x7fa0c4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4007300 con 0x7fa0d00c9af0 2023-10-14T18:54:29.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4007460 con 0x7fa0d00c9af0 2023-10-14T18:54:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d0154e90 con 0x7fa0d00c9af0 2023-10-14T18:54:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.319+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4004830 con 0x7fa0d00c9af0 2023-10-14T18:54:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.320+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d0155220 con 0x7fa0d00c9af0 2023-10-14T18:54:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.320+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d0155970 con 0x7fa0d00c9af0 2023-10-14T18:54:29.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.321+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0c4004be0 con 0x7fa0d00c9af0 2023-10-14T18:54:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.321+0000 7fa0b7fff700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 0x7fa0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.321+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa0c4083740 con 0x7fa0d00c9af0 2023-10-14T18:54:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.321+0000 7fa0cffff700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 0x7fa0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.322+0000 7fa0cffff700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 0x7fa0bc0693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00099b0 tx=0x7fa0c0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.325+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0d0155970 con 0x7fa0d00c9af0 2023-10-14T18:54:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.548+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0d0155930 con 0x7fa0d00c9af0 2023-10-14T18:54:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.549+0000 7fa0b7fff700 1 -- 172.21.15.79:0/1641371846 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fa0c4018020 con 0x7fa0d00c9af0 2023-10-14T18:54:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:29.550 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/944247322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944247322},{"type":"v1","addr":"172.21.15.144:6836","nonce":944247322}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":6991,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3104845918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3104845918},{"type":"v1","addr":"172.21.15.144:6837","nonce":3104845918}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":7479,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/2518032751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2518032751},{"type":"v1","addr":"172.21.15.79:6833","nonce":2518032751}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/4113168367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":4113168367},{"type":"v1","addr":"172.21.15.79:6835","nonce":4113168367}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[]} 2023-10-14T18:54:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 msgr2=0x7fa0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 0x7fa0bc0693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00099b0 tx=0x7fa0c0016000 comp rx=0 tx=0).stop 2023-10-14T18:54:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 msgr2=0x7fa0d00b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40011e0 tx=0x7fa0c4007e10 comp rx=0 tx=0).stop 2023-10-14T18:54:29.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 shutdown_connections 2023-10-14T18:54:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0bc066f30 0x7fa0bc0693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0d01510f0 0x7fa0d0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0d0070700 0x7fa0d00b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 --2- 172.21.15.79:0/1641371846 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d00c9af0 0x7fa0d00b2df0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 >> 172.21.15.79:0/1641371846 conn(0x7fa0d00ca4f0 msgr2=0x7fa0d00cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 shutdown_connections 2023-10-14T18:54:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.551+0000 7fa0d6427700 1 -- 172.21.15.79:0/1641371846 wait complete. 2023-10-14T18:54:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 74 2023-10-14T18:54:29.564 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:54:29.564 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:54:29.564 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:54:29.565 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:54:29.565 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:54:29.565 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:54:29.566 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:54:29.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:54:29.566 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:54:29.566 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:54:29.567 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:54:29.567 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:54:29.567 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:54:29.568 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:54:29.568 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:54:29.568 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:54:29.573 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:54:29.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:54:29.575 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:54:29.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:54:29.580 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:54:29.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:54:29.582 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:54:29.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:54:29.617 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:54:29.618 DEBUG:teuthology.parallel:result is None 2023-10-14T18:54:29.619 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:54:29.619 DEBUG:teuthology.parallel:result is None 2023-10-14T18:54:29.623 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:54:29.623 DEBUG:teuthology.parallel:result is None 2023-10-14T18:54:29.624 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:54:29.624 DEBUG:teuthology.parallel:result is None 2023-10-14T18:54:29.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:54:29.690 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:54:29.691 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:54:29.707 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:54:29.707 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:54:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.745+0000 7f13fdadb700 1 Processor -- start 2023-10-14T18:54:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.745+0000 7f13fdadb700 1 -- start start 2023-10-14T18:54:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fdadb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13f80cdfa0 0x7f13f80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fdadb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f8159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fdadb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f815db30 con 0x7f13f8069380 2023-10-14T18:54:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fdadb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f815ddd0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fdadb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f815e0b0 con 0x7f13f8068f10 2023-10-14T18:54:29.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fcad9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13f80cdfa0 0x7f13f80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13f7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f8159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fd2da700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f13f8069380 0x7f13f8159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:41670/0 (socket says 172.21.15.79:41670) 2023-10-14T18:54:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.746+0000 7f13fd2da700 1 -- 172.21.15.79:0/2093768987 learned_addr learned my addr 172.21.15.79:0/2093768987 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fcad9700 1 -- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 msgr2=0x7f13f8159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:29.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fcad9700 1 --2- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f8159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fcad9700 1 -- 172.21.15.79:0/2093768987 >> v1:172.21.15.144:6789/0 conn(0x7f13f8069380 legacy=0x7f13f8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fcad9700 1 -- 172.21.15.79:0/2093768987 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f815e390 con 0x7f13f80cdfa0 2023-10-14T18:54:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13f77fe700 1 -- 172.21.15.79:0/2093768987 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965043432 0 0) 0x7f13f815db30 con 0x7f13f8069380 2023-10-14T18:54:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fcad9700 1 --2- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f80cdfa0 0x7f13f80ce370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f13e80098e0 tx=0x7f13e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d83ddccc2dc93f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13f77fe700 1 -- 172.21.15.79:0/2093768987 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800b640 con 0x7f13f80cdfa0 2023-10-14T18:54:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13f77fe700 1 -- 172.21.15.79:0/2093768987 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e800b7a0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13f77fe700 1 -- 172.21.15.79:0/2093768987 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800bb40 con 0x7f13f80cdfa0 2023-10-14T18:54:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fdadb700 1 -- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f80cdfa0 msgr2=0x7f13f80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.747+0000 7f13fdadb700 1 --2- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f80cdfa0 0x7f13f80ce370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f13e80098e0 tx=0x7f13e80091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 -- 172.21.15.79:0/2093768987 shutdown_connections 2023-10-14T18:54:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 --2- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f80cdfa0 0x7f13f80ce370 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 --2- 172.21.15.79:0/2093768987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f8159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 -- 172.21.15.79:0/2093768987 >> 172.21.15.79:0/2093768987 conn(0x7f13f806c700 msgr2=0x7f13f8069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 -- 172.21.15.79:0/2093768987 shutdown_connections 2023-10-14T18:54:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.748+0000 7f13fdadb700 1 -- 172.21.15.79:0/2093768987 wait complete. 2023-10-14T18:54:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.749+0000 7f13fdadb700 1 Processor -- start 2023-10-14T18:54:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.749+0000 7f13fdadb700 1 -- start start 2023-10-14T18:54:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.749+0000 7f13fdadb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f80b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.749+0000 7f13fdadb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f8069380 0x7f13f80b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b2ee0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b1e40 con 0x7f13f8069380 2023-10-14T18:54:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b2120 con 0x7f13f8068f10 2023-10-14T18:54:29.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33602/0 (socket says 172.21.15.79:33602) 2023-10-14T18:54:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 -- 172.21.15.79:0/3200762971 learned_addr learned my addr 172.21.15.79:0/3200762971 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fcad9700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f80b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13f7fff700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f8069380 0x7f13f80b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 -- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 msgr2=0x7f13f80b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f80b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 -- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f8069380 msgr2=0x7f13f80b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f8069380 0x7f13f80b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 -- 172.21.15.79:0/3200762971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8009420 con 0x7f13f80cdfa0 2023-10-14T18:54:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fcad9700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f80b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fd2da700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f13f000cbf0 tx=0x7f13f00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000a910 con 0x7f13f80cdfa0 2023-10-14T18:54:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f000aa70 con 0x7f13f80cdfa0 2023-10-14T18:54:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80b2400 con 0x7f13f80cdfa0 2023-10-14T18:54:29.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000ae30 con 0x7f13f80cdfa0 2023-10-14T18:54:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.750+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f80b29c0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.751+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f80b2be0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.752+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f0007300 con 0x7f13f80cdfa0 2023-10-14T18:54:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.752+0000 7f13f4ff9700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:29.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.752+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f13f00845a0 con 0x7f13f80cdfa0 2023-10-14T18:54:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.752+0000 7f13fcad9700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.752+0000 7f13fcad9700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f13e80093f0 tx=0x7f13e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.756+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f0051b90 con 0x7f13f80cdfa0 2023-10-14T18:54:29.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:29.956+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13f806b8b0 con 0x7f13f80cdfa0 2023-10-14T18:54:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.789+0000 7f13f4ff9700 1 -- 172.21.15.79:0/3200762971 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v166) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13f00551b0 con 0x7f13f80cdfa0 2023-10-14T18:54:30.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.791+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 msgr2=0x7f13e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:30.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.791+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f13e80093f0 tx=0x7f13e8017000 comp rx=0 tx=0).stop 2023-10-14T18:54:30.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 msgr2=0x7f13f80b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:30.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f13f000cbf0 tx=0x7f13f00019b0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 shutdown_connections 2023-10-14T18:54:30.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13f80cdfa0 0x7f13f80b3e50 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f13f8068f10 0x7f13f80b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 --2- 172.21.15.79:0/3200762971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13f8069380 0x7f13f80b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 >> 172.21.15.79:0/3200762971 conn(0x7f13f806c700 msgr2=0x7f13f8157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:30.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 shutdown_connections 2023-10-14T18:54:30.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.792+0000 7f13fdadb700 1 -- 172.21.15.79:0/3200762971 wait complete. 2023-10-14T18:54:30.796 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:54:30.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:54:30.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.923+0000 7f7b2290f700 1 Processor -- start 2023-10-14T18:54:30.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.923+0000 7f7b2290f700 1 -- start start 2023-10-14T18:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.923+0000 7f7b2290f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b1c0a79f0 0x7f7b1c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b2290f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b2290f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a7dc0 0x7f7b1c15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b2290f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b26d0 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b2290f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0aeab0 con 0x7f7b1c0a79f0 2023-10-14T18:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b2290f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b2b60 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33616/0 (socket says 172.21.15.79:33616) 2023-10-14T18:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/3547938014 learned_addr learned my addr 172.21.15.79:0/3547938014 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/3547938014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a7dc0 msgr2=0x7f7b1c15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/3547938014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a7dc0 0x7f7b1c15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/3547938014 >> v2:172.21.15.144:3300/0 conn(0x7f7b1c0a79f0 msgr2=0x7f7b1c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/3547938014 >> v2:172.21.15.144:3300/0 conn(0x7f7b1c0a79f0 0x7f7b1c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/3547938014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0b1ac0 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/3547938014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c06c5e0 tx=0x7f7b0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81674fa945dc01c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1affd700 1 -- 172.21.15.79:0/3547938014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00b860 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1affd700 1 -- 172.21.15.79:0/3547938014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c00b9c0 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.924+0000 7f7b1affd700 1 -- 172.21.15.79:0/3547938014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00bd60 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 -- 172.21.15.79:0/3547938014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0b15e0 msgr2=0x7f7b1c06eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 --2- 172.21.15.79:0/3547938014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c06c5e0 tx=0x7f7b0c009250 comp rx=0 tx=0).stop 2023-10-14T18:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 -- 172.21.15.79:0/3547938014 shutdown_connections 2023-10-14T18:54:30.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 --2- 172.21.15.79:0/3547938014 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a7dc0 0x7f7b1c15dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 --2- 172.21.15.79:0/3547938014 >> v2:172.21.15.144:3300/0 conn(0x7f7b1c0a79f0 0x7f7b1c06eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 --2- 172.21.15.79:0/3547938014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c06eff0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 -- 172.21.15.79:0/3547938014 >> 172.21.15.79:0/3547938014 conn(0x7f7b1c0cd1e0 msgr2=0x7f7b1c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 -- 172.21.15.79:0/3547938014 shutdown_connections 2023-10-14T18:54:30.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.925+0000 7f7b2290f700 1 -- 172.21.15.79:0/3547938014 wait complete. 2023-10-14T18:54:30.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.926+0000 7f7b2290f700 1 Processor -- start 2023-10-14T18:54:30.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.926+0000 7f7b2290f700 1 -- start start 2023-10-14T18:54:30.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 0x7f7b1c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c14c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c2010 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c16b1b0 con 0x7f7b1c0b15e0 2023-10-14T18:54:30.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c14cbb0 con 0x7f7b1c0a79f0 2023-10-14T18:54:30.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:30.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33632/0 (socket says 172.21.15.79:33632) 2023-10-14T18:54:30.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/229332261 learned_addr learned my addr 172.21.15.79:0/229332261 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:30.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b20eac700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c14c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:30.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1bfff700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 0x7f7b1c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:30.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 msgr2=0x7f7b1c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:30.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 0x7f7b1c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 msgr2=0x7f7b1c14c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:30.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c14c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:30.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 -- 172.21.15.79:0/229332261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0094f0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1bfff700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 0x7f7b1c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:30.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b20eac700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:30.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b1b7fe700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0090b0 tx=0x7f7b0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:30.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c026480 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c01f070 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c15ac20 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.927+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c026830 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.928+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c15b1e0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.928+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0c21c0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.929+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b0c01a430 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.929+0000 7f7b03fff700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 0x7f7b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.929+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7b0c021070 con 0x7f7b1c0a7dc0 2023-10-14T18:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.929+0000 7f7b1bfff700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 0x7f7b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:30.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.930+0000 7f7b1bfff700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 0x7f7b080693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:30.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:30.933+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b1c0c21c0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:31.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.188+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7b1c0c21c0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:31.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.189+0000 7f7b03fff700 1 -- 172.21.15.79:0/229332261 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7b1c0c21c0 con 0x7f7b1c0a7dc0 2023-10-14T18:54:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:31.190 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:54:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:54:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:54:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:54:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:54:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:54:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:54:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:54:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:54:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:54:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.195 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:54:31.196 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:54:31.196 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.196 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.196 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:54:31.197 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:54:31.197 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:54:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:54:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.198 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:54:31.199 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:54:31.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.200 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:54:31.200 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:54:31.200 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.200 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.200 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.201 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.202 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:54:31.202 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:54:31.203 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.203 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.203 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.203 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.204 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:54:31.205 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:54:31.205 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.205 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.205 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.206 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.206 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:54:31.207 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:54:31.207 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.207 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.207 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.208 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.208 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:54:31.209 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:54:31.209 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.210 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.210 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.211 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.211 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:54:31.212 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:54:31.212 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.212 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.212 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.213 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.214 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:54:31.214 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:54:31.214 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.215 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.215 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.216 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.217 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:54:31.218 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:54:31.218 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.219 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:54:31.219 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:54:31.220 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.222 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:54:31.222 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:54:31.222 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.223 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.223 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:54:31.224 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:54:31.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.225 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:54:31.226 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:54:31.226 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.226 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.226 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:54:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:54:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:54:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:54:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:54:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.228 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:54:31.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:54:31.229 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:54:31.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.230 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:54:31.230 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:54:31.230 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.230 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:54:31.230 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:54:31.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:54:31.231 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:54:31.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:54:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:54:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.232 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:54:31.233 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:54:31.233 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:54:31.233 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.234 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:54:31.234 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:54:31.234 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.234 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:54:31.235 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:54:31.235 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:54:31.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:31.236 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:54:31.236 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:54:31.236 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:54:31.236 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:54:31.237 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:54:31.237 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:54:31.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:31.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:54:31.238 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:54:31.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 msgr2=0x7f7b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 0x7f7b080693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006fd0 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2023-10-14T18:54:31.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 msgr2=0x7f7b1c16ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0090b0 tx=0x7f7b0c017000 comp rx=0 tx=0).stop 2023-10-14T18:54:31.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 shutdown_connections 2023-10-14T18:54:31.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7b08066f30 0x7f7b080693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b1c0b15e0 0x7f7b1c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b1c0a79f0 0x7f7b1c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.190+0000 7f7b2290f700 1 --2- 172.21.15.79:0/229332261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b1c0a7dc0 0x7f7b1c16ac70 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.191+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 >> 172.21.15.79:0/229332261 conn(0x7f7b1c0cd1e0 msgr2=0x7f7b1c0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.191+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 shutdown_connections 2023-10-14T18:54:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.191+0000 7f7b2290f700 1 -- 172.21.15.79:0/229332261 wait complete. 2023-10-14T18:54:31.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:31.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.357+0000 7f0b0a221700 1 Processor -- start 2023-10-14T18:54:31.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.357+0000 7f0b0a221700 1 -- start start 2023-10-14T18:54:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b0a221700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b0415a620 0x7f0b0415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b0a221700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0b04158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b0a221700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0415cbb0 con 0x7f0b04157870 2023-10-14T18:54:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b0a221700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0415bdb0 con 0x7f0b0415a620 2023-10-14T18:54:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b0a221700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0415bfa0 con 0x7f0b0415d580 2023-10-14T18:54:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b037fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0b04157870 0x7f0b0415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36780/0 (socket says 172.21.15.79:36780) 2023-10-14T18:54:31.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b037fe700 1 -- 172.21.15.79:0/731397254 learned_addr learned my addr 172.21.15.79:0/731397254 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/731397254 >> v2:172.21.15.144:3300/0 conn(0x7f0b0415a620 0x7f0b0415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b03fff700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0b04158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568428217 0 0) 0x7f0b0415cbb0 con 0x7f0b04157870 2023-10-14T18:54:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aec003570 con 0x7f0b04157870 2023-10-14T18:54:31.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516206845 0 0) 0x7f0aec003570 con 0x7f0b04157870 2023-10-14T18:54:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 msgr2=0x7f0b04158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0b04158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 >> v2:172.21.15.144:3300/0 conn(0x7f0b0415a620 msgr2=0x7f0b0415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:31.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.358+0000 7f0b027fc700 1 --2- 172.21.15.79:0/731397254 >> v2:172.21.15.144:3300/0 conn(0x7f0b0415a620 0x7f0b0415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0415c280 con 0x7f0b04157870 2023-10-14T18:54:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f0af40017f0 con 0x7f0b04157870 2023-10-14T18:54:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 >> v1:172.21.15.79:6789/0 conn(0x7f0b04157870 legacy=0x7f0b0415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec003a60 0x7f0aec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec004810 0x7f0aec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0aec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0415bfa0 con 0x7f0aec004810 2023-10-14T18:54:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec00ba60 con 0x7f0aec003a60 2023-10-14T18:54:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec00bba0 con 0x7f0b0415d580 2023-10-14T18:54:31.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec004810 0x7f0aec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b037fe700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec003a60 0x7f0aec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b03fff700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0aec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 -- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 msgr2=0x7f0aec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b0415d580 0x7f0aec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 -- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec003a60 msgr2=0x7f0aec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec003a60 0x7f0aec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 -- 172.21.15.79:0/731397254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec003570 con 0x7f0aec004810 2023-10-14T18:54:31.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec004810 0x7f0aec004c80 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009c00 tx=0x7f0af80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac345b1091f18a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800e710 con 0x7f0aec004810 2023-10-14T18:54:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af800e870 con 0x7f0aec004810 2023-10-14T18:54:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.359+0000 7f0b027fc700 1 -- 172.21.15.79:0/731397254 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af800ec30 con 0x7f0aec004810 2023-10-14T18:54:31.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 -- 172.21.15.79:0/731397254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec004810 msgr2=0x7f0aec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 --2- 172.21.15.79:0/731397254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aec004810 0x7f0aec004c80 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009c00 tx=0x7f0af80091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b03fff700 1 -- 172.21.15.79:0/731397254 reap_dead start 2023-10-14T18:54:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 -- 172.21.15.79:0/731397254 shutdown_connections 2023-10-14T18:54:31.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 -- 172.21.15.79:0/731397254 >> 172.21.15.79:0/731397254 conn(0x7f0b04068ce0 msgr2=0x7f0b040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 -- 172.21.15.79:0/731397254 shutdown_connections 2023-10-14T18:54:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.360+0000 7f0b0a221700 1 -- 172.21.15.79:0/731397254 wait complete. 2023-10-14T18:54:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.361+0000 7f0b0a221700 1 Processor -- start 2023-10-14T18:54:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.361+0000 7f0b0a221700 1 -- start start 2023-10-14T18:54:31.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 0x7f0b0414f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 0x7f0b04159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b04159960 con 0x7f0b04153380 2023-10-14T18:54:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b040b0610 con 0x7f0aec004810 2023-10-14T18:54:31.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b04154070 con 0x7f0b04158fb0 2023-10-14T18:54:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33652/0 (socket says 172.21.15.79:33652) 2023-10-14T18:54:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 -- 172.21.15.79:0/440619275 learned_addr learned my addr 172.21.15.79:0/440619275 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b037fe700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 0x7f0b0414f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 0x7f0b04159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 -- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 msgr2=0x7f0b04159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 0x7f0b04159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 -- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 msgr2=0x7f0b0414f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 0x7f0b0414f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 -- 172.21.15.79:0/440619275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04154350 con 0x7f0b04153380 2023-10-14T18:54:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b037fe700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 0x7f0b0414f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b02ffd700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 0x7f0b04159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:31.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b03fff700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f0afc006f00 tx=0x7f0afc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00f910 con 0x7f0b04153380 2023-10-14T18:54:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0afc00fa70 con 0x7f0b04153380 2023-10-14T18:54:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b040b0860 con 0x7f0b04153380 2023-10-14T18:54:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.362+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00fe10 con 0x7f0b04153380 2023-10-14T18:54:31.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.363+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b04153d60 con 0x7f0b04153380 2023-10-14T18:54:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.363+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0404c3c0 con 0x7f0b04153380 2023-10-14T18:54:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.364+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0afc014650 con 0x7f0b04153380 2023-10-14T18:54:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.364+0000 7f0aeb7fe700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.364+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0afc084770 con 0x7f0b04153380 2023-10-14T18:54:31.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.364+0000 7f0b037fe700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.365+0000 7f0b037fe700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 0x7f0af00693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0af40020a0 tx=0x7f0af4006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.368+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0afc051db0 con 0x7f0b04153380 2023-10-14T18:54:31.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.551+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b0415c560 con 0x7f0b04153380 2023-10-14T18:54:31.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.552+0000 7f0aeb7fe700 1 -- 172.21.15.79:0/440619275 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f0afc0553d0 con 0x7f0b04153380 2023-10-14T18:54:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:31.553 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":166,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:54:30.784572+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 msgr2=0x7f0af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 0x7f0af00693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0af40020a0 tx=0x7f0af4006040 comp rx=0 tx=0).stop 2023-10-14T18:54:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 msgr2=0x7f0b04153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f0afc006f00 tx=0x7f0afc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 shutdown_connections 2023-10-14T18:54:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0af0066f30 0x7f0af00693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b04153380 0x7f0b04153820 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aec004810 0x7f0b0414f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 --2- 172.21.15.79:0/440619275 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b04158fb0 0x7f0b04159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 >> 172.21.15.79:0/440619275 conn(0x7f0b04068ce0 msgr2=0x7f0b04155510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 shutdown_connections 2023-10-14T18:54:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.554+0000 7f0b0a221700 1 -- 172.21.15.79:0/440619275 wait complete. 2023-10-14T18:54:31.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:54:31.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:54:31.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.684+0000 7fb78cc64700 1 Processor -- start 2023-10-14T18:54:31.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.684+0000 7fb78cc64700 1 -- start start 2023-10-14T18:54:31.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb78cc64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb78cc64700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb78806e3d0 0x7fb78806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb78cc64700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78806f4c0 con 0x7fb78806c8c0 2023-10-14T18:54:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb78cc64700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880cc4d0 con 0x7fb78806e3d0 2023-10-14T18:54:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb78cc64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78806cd40 con 0x7fb788156ad0 2023-10-14T18:54:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:48290/0 (socket says 172.21.15.79:48290) 2023-10-14T18:54:31.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 -- 172.21.15.79:0/1002195958 learned_addr learned my addr 172.21.15.79:0/1002195958 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:31.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb786ffd700 1 --2- 172.21.15.79:0/1002195958 >> v2:172.21.15.144:3300/0 conn(0x7fb78806e3d0 0x7fb78806c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 -- 172.21.15.79:0/1002195958 >> v2:172.21.15.144:3300/0 conn(0x7fb78806e3d0 msgr2=0x7fb78806c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:31.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 --2- 172.21.15.79:0/1002195958 >> v2:172.21.15.144:3300/0 conn(0x7fb78806e3d0 0x7fb78806c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 -- 172.21.15.79:0/1002195958 >> v1:172.21.15.144:6789/0 conn(0x7fb78806c8c0 legacy=0x7fb78815a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.685+0000 7fb7877fe700 1 -- 172.21.15.79:0/1002195958 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78806e8b0 con 0x7fb788156ad0 2023-10-14T18:54:31.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb7877fe700 1 --2- 172.21.15.79:0/1002195958 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb778009f20 tx=0x7fb778009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01d61965171af61 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb7867fc700 1 -- 172.21.15.79:0/1002195958 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800e070 con 0x7fb788156ad0 2023-10-14T18:54:31.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb7867fc700 1 -- 172.21.15.79:0/1002195958 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800b9d0 con 0x7fb788156ad0 2023-10-14T18:54:31.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb7867fc700 1 -- 172.21.15.79:0/1002195958 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780092e0 con 0x7fb788156ad0 2023-10-14T18:54:31.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 -- 172.21.15.79:0/1002195958 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 msgr2=0x7fb788157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1002195958 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb778009f20 tx=0x7fb778009840 comp rx=0 tx=0).stop 2023-10-14T18:54:31.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 -- 172.21.15.79:0/1002195958 shutdown_connections 2023-10-14T18:54:31.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1002195958 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb788157bd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1002195958 >> v2:172.21.15.144:3300/0 conn(0x7fb78806e3d0 0x7fb78806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 -- 172.21.15.79:0/1002195958 >> 172.21.15.79:0/1002195958 conn(0x7fb7880cb0a0 msgr2=0x7fb78806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:31.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 -- 172.21.15.79:0/1002195958 shutdown_connections 2023-10-14T18:54:31.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.686+0000 7fb78cc64700 1 -- 172.21.15.79:0/1002195958 wait complete. 2023-10-14T18:54:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 Processor -- start 2023-10-14T18:54:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 -- start start 2023-10-14T18:54:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78806c8c0 0x7fb7881426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb7880c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c71f0 con 0x7fb78806e3d0 2023-10-14T18:54:31.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c65e0 con 0x7fb78806c8c0 2023-10-14T18:54:31.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.688+0000 7fb78cc64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c68c0 con 0x7fb788156ad0 2023-10-14T18:54:31.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33658/0 (socket says 172.21.15.79:33658) 2023-10-14T18:54:31.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 -- 172.21.15.79:0/1206091241 learned_addr learned my addr 172.21.15.79:0/1206091241 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:31.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb7877fe700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78806c8c0 0x7fb7881426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb787fff700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb7880c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 -- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 msgr2=0x7fb7880c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb7880c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 -- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78806c8c0 msgr2=0x7fb7881426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78806c8c0 0x7fb7881426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 -- 172.21.15.79:0/1206091241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778009ae0 con 0x7fb78806e3d0 2023-10-14T18:54:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb786ffd700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00beb0 tx=0x7fb77c00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00eb70 con 0x7fb78806e3d0 2023-10-14T18:54:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c011040 con 0x7fb78806e3d0 2023-10-14T18:54:31.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880c6ba0 con 0x7fb78806e3d0 2023-10-14T18:54:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c016480 con 0x7fb78806e3d0 2023-10-14T18:54:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.689+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7880c9e70 con 0x7fb78806e3d0 2023-10-14T18:54:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.690+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7880c73a0 con 0x7fb78806e3d0 2023-10-14T18:54:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.690+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb77c0167f0 con 0x7fb78806e3d0 2023-10-14T18:54:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.691+0000 7fb76f7fe700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 0x7fb7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.691+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb77c086ed0 con 0x7fb78806e3d0 2023-10-14T18:54:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.691+0000 7fb7877fe700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 0x7fb7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.691+0000 7fb7877fe700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 0x7fb7740693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb778009880 tx=0x7fb778018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:31.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.695+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7880c73a0 con 0x7fb78806e3d0 2023-10-14T18:54:31.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.875+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7880ca3a0 con 0x7fb78806e3d0 2023-10-14T18:54:31.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.875+0000 7fb76f7fe700 1 -- 172.21.15.79:0/1206091241 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v166) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb77c054540 con 0x7fb78806e3d0 2023-10-14T18:54:31.877 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:54:31.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 msgr2=0x7fb7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 0x7fb7740693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb778009880 tx=0x7fb778018000 comp rx=0 tx=0).stop 2023-10-14T18:54:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 msgr2=0x7fb7881586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00beb0 tx=0x7fb77c00d040 comp rx=0 tx=0).stop 2023-10-14T18:54:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 shutdown_connections 2023-10-14T18:54:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fb774066f30 0x7fb7740693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb788156ad0 0x7fb7880c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78806c8c0 0x7fb7881426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 --2- 172.21.15.79:0/1206091241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78806e3d0 0x7fb7881586b0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 >> 172.21.15.79:0/1206091241 conn(0x7fb7880cb0a0 msgr2=0x7fb788152600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 shutdown_connections 2023-10-14T18:54:31.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:31.877+0000 7fb78cc64700 1 -- 172.21.15.79:0/1206091241 wait complete. 2023-10-14T18:54:31.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:54:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.004+0000 7f82267da700 1 Processor -- start 2023-10-14T18:54:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.004+0000 7f82267da700 1 -- start start 2023-10-14T18:54:32.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f82267da700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82200cdab0 0x7f822015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f82267da700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f822015dda0 0x7f822015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f82267da700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200cb7c0 con 0x7f82200cd6e0 2023-10-14T18:54:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f82267da700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822015e850 con 0x7f822015dda0 2023-10-14T18:54:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f82267da700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200cc360 con 0x7f82200cdab0 2023-10-14T18:54:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f8225fd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f822015dda0 0x7f822015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f8225fd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f822015dda0 0x7f822015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33672/0 (socket says 172.21.15.79:33672) 2023-10-14T18:54:32.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f8225fd9700 1 -- 172.21.15.79:0/3073233813 learned_addr learned my addr 172.21.15.79:0/3073233813 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.005+0000 7f8224fd7700 1 --2- 172.21.15.79:0/3073233813 >> v2:172.21.15.144:3300/0 conn(0x7f82200cdab0 0x7f822015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8225fd9700 1 -- 172.21.15.79:0/3073233813 >> v2:172.21.15.144:3300/0 conn(0x7f82200cdab0 msgr2=0x7f822015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8225fd9700 1 --2- 172.21.15.79:0/3073233813 >> v2:172.21.15.144:3300/0 conn(0x7f82200cdab0 0x7f822015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8225fd9700 1 -- 172.21.15.79:0/3073233813 >> v1:172.21.15.144:6789/0 conn(0x7f82200cd6e0 legacy=0x7f82200cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8225fd9700 1 -- 172.21.15.79:0/3073233813 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822015e290 con 0x7f822015dda0 2023-10-14T18:54:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8225fd9700 1 --2- 172.21.15.79:0/3073233813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f822015dda0 0x7f822015cbd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f82200b6c70 tx=0x7f8218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fc2450597b2910 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8217fff700 1 -- 172.21.15.79:0/3073233813 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800b860 con 0x7f822015dda0 2023-10-14T18:54:32.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8217fff700 1 -- 172.21.15.79:0/3073233813 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800b9c0 con 0x7f822015dda0 2023-10-14T18:54:32.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f8217fff700 1 -- 172.21.15.79:0/3073233813 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800bd60 con 0x7f822015dda0 2023-10-14T18:54:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 -- 172.21.15.79:0/3073233813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f822015dda0 msgr2=0x7f822015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 --2- 172.21.15.79:0/3073233813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f822015dda0 0x7f822015cbd0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f82200b6c70 tx=0x7f8218009250 comp rx=0 tx=0).stop 2023-10-14T18:54:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 -- 172.21.15.79:0/3073233813 shutdown_connections 2023-10-14T18:54:32.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 --2- 172.21.15.79:0/3073233813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f822015dda0 0x7f822015cbd0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 --2- 172.21.15.79:0/3073233813 >> v2:172.21.15.144:3300/0 conn(0x7f82200cdab0 0x7f822015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 -- 172.21.15.79:0/3073233813 >> 172.21.15.79:0/3073233813 conn(0x7f8220067660 msgr2=0x7f8220067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.006+0000 7f82267da700 1 -- 172.21.15.79:0/3073233813 shutdown_connections 2023-10-14T18:54:32.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.007+0000 7f82267da700 1 -- 172.21.15.79:0/3073233813 wait complete. 2023-10-14T18:54:32.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 Processor -- start 2023-10-14T18:54:32.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 -- start start 2023-10-14T18:54:32.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82200cd6e0 0x7f822014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 0x7f82200c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c7d20 con 0x7f82200cdab0 2023-10-14T18:54:32.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c8b10 con 0x7f82200cd6e0 2023-10-14T18:54:32.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f82267da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c7f00 con 0x7f822015dda0 2023-10-14T18:54:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.008+0000 7f8224fd7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33688/0 (socket says 172.21.15.79:33688) 2023-10-14T18:54:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 -- 172.21.15.79:0/398829659 learned_addr learned my addr 172.21.15.79:0/398829659 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82257d8700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82200cd6e0 0x7f822014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8225fd9700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 0x7f82200c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 -- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 msgr2=0x7f82200c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 0x7f82200c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 -- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82200cd6e0 msgr2=0x7f822014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82200cd6e0 0x7f822014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 -- 172.21.15.79:0/398829659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180094f0 con 0x7f82200cdab0 2023-10-14T18:54:32.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8225fd9700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 0x7f82200c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:32.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f8224fd7700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f821000d890 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100125f0 con 0x7f82200cdab0 2023-10-14T18:54:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210012750 con 0x7f82200cdab0 2023-10-14T18:54:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210012ad0 con 0x7f82200cdab0 2023-10-14T18:54:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82200c81e0 con 0x7f82200cdab0 2023-10-14T18:54:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.009+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200c8820 con 0x7f82200cdab0 2023-10-14T18:54:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.010+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82200c8c80 con 0x7f82200cdab0 2023-10-14T18:54:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.010+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f821001e460 con 0x7f82200cdab0 2023-10-14T18:54:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.011+0000 7f82157fa700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 0x7f82040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.011+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8210084800 con 0x7f82200cdab0 2023-10-14T18:54:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.011+0000 7f82257d8700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 0x7f82040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.011+0000 7f82257d8700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 0x7f82040693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f821c007fd0 tx=0x7f821c0016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.015+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8210051dc0 con 0x7f82200cdab0 2023-10-14T18:54:32.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.198+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f822004bb80 con 0x7f82200cdab0 2023-10-14T18:54:32.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.199+0000 7f82157fa700 1 -- 172.21.15.79:0/398829659 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v166) v1 ==== 84+0+65 (secure 0 0 0) 0x7f82100553e0 con 0x7f82200cdab0 2023-10-14T18:54:32.200 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:32.200 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:54:32.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:54:32.202 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:54:32.202 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:54:32.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:54:32.202 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:54:32.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 msgr2=0x7f82040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 0x7f82040693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f821c007fd0 tx=0x7f821c0016f0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 msgr2=0x7f82200b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f821000d890 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-10-14T18:54:32.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 shutdown_connections 2023-10-14T18:54:32.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8204066f30 0x7f82040693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f822015dda0 0x7f82200c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82200cd6e0 0x7f822014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 --2- 172.21.15.79:0/398829659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82200cdab0 0x7f82200b61a0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 >> 172.21.15.79:0/398829659 conn(0x7f8220067660 msgr2=0x7f82200c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 shutdown_connections 2023-10-14T18:54:32.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.201+0000 7f82267da700 1 -- 172.21.15.79:0/398829659 wait complete. 2023-10-14T18:54:32.214 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:54:32.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:54:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.332+0000 7f4419cd5700 1 Processor -- start 2023-10-14T18:54:32.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.332+0000 7f4419cd5700 1 -- start start 2023-10-14T18:54:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4414159ef0 0x7f441415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f44140b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44140b15e0 0x7f44140b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44140b1a60 con 0x7f44140b15e0 2023-10-14T18:54:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44140b1d40 con 0x7f4414159ef0 2023-10-14T18:54:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4419cd5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44140b2020 con 0x7f44140b6a10 2023-10-14T18:54:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4413fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44140b15e0 0x7f44140b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4413fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44140b15e0 0x7f44140b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33702/0 (socket says 172.21.15.79:33702) 2023-10-14T18:54:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.333+0000 7f4413fff700 1 -- 172.21.15.79:0/2085136380 learned_addr learned my addr 172.21.15.79:0/2085136380 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4412ffd700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f44140b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f44137fe700 1 --2- 172.21.15.79:0/2085136380 >> v2:172.21.15.144:3300/0 conn(0x7f4414159ef0 0x7f441415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 -- 172.21.15.79:0/2085136380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 msgr2=0x7f44140b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f44140b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 -- 172.21.15.79:0/2085136380 >> v2:172.21.15.144:3300/0 conn(0x7f4414159ef0 msgr2=0x7f441415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 --2- 172.21.15.79:0/2085136380 >> v2:172.21.15.144:3300/0 conn(0x7f4414159ef0 0x7f441415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 -- 172.21.15.79:0/2085136380 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44140b2300 con 0x7f44140b15e0 2023-10-14T18:54:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4413fff700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44140b15e0 0x7f44140b46f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f441408a710 tx=0x7f440c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35304d3517a64c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f44127fc700 1 -- 172.21.15.79:0/2085136380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00b860 con 0x7f44140b15e0 2023-10-14T18:54:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f44127fc700 1 -- 172.21.15.79:0/2085136380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00b9c0 con 0x7f44140b15e0 2023-10-14T18:54:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f44127fc700 1 -- 172.21.15.79:0/2085136380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00bd60 con 0x7f44140b15e0 2023-10-14T18:54:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 -- 172.21.15.79:0/2085136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44140b15e0 msgr2=0x7f44140b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44140b15e0 0x7f44140b46f0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f441408a710 tx=0x7f440c009250 comp rx=0 tx=0).stop 2023-10-14T18:54:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 -- 172.21.15.79:0/2085136380 shutdown_connections 2023-10-14T18:54:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44140b15e0 0x7f44140b46f0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 --2- 172.21.15.79:0/2085136380 >> v2:172.21.15.144:3300/0 conn(0x7f4414159ef0 0x7f441415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 --2- 172.21.15.79:0/2085136380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f44140b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 -- 172.21.15.79:0/2085136380 >> 172.21.15.79:0/2085136380 conn(0x7f441409a0a0 msgr2=0x7f4414067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 -- 172.21.15.79:0/2085136380 shutdown_connections 2023-10-14T18:54:32.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.334+0000 7f4419cd5700 1 -- 172.21.15.79:0/2085136380 wait complete. 2023-10-14T18:54:32.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 Processor -- start 2023-10-14T18:54:32.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 -- start start 2023-10-14T18:54:32.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f441414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441416d430 0x7f44141510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441414f520 con 0x7f4414159ef0 2023-10-14T18:54:32.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441416d890 con 0x7f441416d430 2023-10-14T18:54:32.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4419cd5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4414152a20 con 0x7f44140b6a10 2023-10-14T18:54:32.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.336+0000 7f4412ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33708/0 (socket says 172.21.15.79:33708) 2023-10-14T18:54:32.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 -- 172.21.15.79:0/1973165309 learned_addr learned my addr 172.21.15.79:0/1973165309 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:32.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4413fff700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441416d430 0x7f44141510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f44137fe700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f441414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 -- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 msgr2=0x7f441414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f441414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 -- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441416d430 msgr2=0x7f44141510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441416d430 0x7f44141510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 -- 172.21.15.79:0/1973165309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0094f0 con 0x7f4414159ef0 2023-10-14T18:54:32.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f44137fe700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f441414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:32.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4412ffd700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f440800d890 tx=0x7f4408008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080125f0 con 0x7f4414159ef0 2023-10-14T18:54:32.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408012750 con 0x7f4414159ef0 2023-10-14T18:54:32.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4414151e10 con 0x7f4414159ef0 2023-10-14T18:54:32.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408012ad0 con 0x7f4414159ef0 2023-10-14T18:54:32.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.337+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4414152450 con 0x7f4414159ef0 2023-10-14T18:54:32.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.338+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4414152c40 con 0x7f4414159ef0 2023-10-14T18:54:32.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.338+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f440801e460 con 0x7f4414159ef0 2023-10-14T18:54:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.339+0000 7f43fb7fe700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.339+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4408084780 con 0x7f4414159ef0 2023-10-14T18:54:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.339+0000 7f44137fe700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.339+0000 7f44137fe700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 0x7f44000693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4404007580 tx=0x7f4404009790 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.343+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4414152c40 con 0x7f4414159ef0 2023-10-14T18:54:32.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.526+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4414152c40 con 0x7f4414159ef0 2023-10-14T18:54:32.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.799+0000 7f43fb7fe700 1 -- 172.21.15.79:0/1973165309 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v167) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4414152c40 con 0x7f4414159ef0 2023-10-14T18:54:32.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 msgr2=0x7f44000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 0x7f44000693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4404007580 tx=0x7f4404009790 comp rx=0 tx=0).stop 2023-10-14T18:54:32.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 msgr2=0x7f441416cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f440800d890 tx=0x7f4408008040 comp rx=0 tx=0).stop 2023-10-14T18:54:32.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 shutdown_connections 2023-10-14T18:54:32.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441416d430 0x7f44141510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44140b6a10 0x7f441414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 --2- 172.21.15.79:0/1973165309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4414159ef0 0x7f441416cef0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 >> 172.21.15.79:0/1973165309 conn(0x7f441409a0a0 msgr2=0x7f441415bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:32.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 shutdown_connections 2023-10-14T18:54:32.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.802+0000 7f4419cd5700 1 -- 172.21.15.79:0/1973165309 wait complete. 2023-10-14T18:54:32.806 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:54:32.816 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:54:32.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.937+0000 7f1484923700 1 Processor -- start 2023-10-14T18:54:32.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.937+0000 7f1484923700 1 -- start start 2023-10-14T18:54:32.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f1484923700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14800678b0 0x7f148015db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f1484923700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14800cbf10 0x7f148015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f1484923700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14800cae70 con 0x7f14800c9390 2023-10-14T18:54:32.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f1484923700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800cb150 con 0x7f14800cbf10 2023-10-14T18:54:32.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f1484923700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800cb430 con 0x7f14800678b0 2023-10-14T18:54:32.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f147ed9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f14800c9390 0x7f148006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36784/0 (socket says 172.21.15.79:36784) 2023-10-14T18:54:32.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.938+0000 7f147dd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f14800cbf10 0x7f148015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147ed9d700 1 -- 172.21.15.79:0/3001534511 learned_addr learned my addr 172.21.15.79:0/3001534511 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:32.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147e59c700 1 --2- 172.21.15.79:0/3001534511 >> v2:172.21.15.144:3300/0 conn(0x7f14800678b0 0x7f148015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147dd9b700 1 -- 172.21.15.79:0/3001534511 >> v2:172.21.15.144:3300/0 conn(0x7f14800678b0 msgr2=0x7f148015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:32.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147dd9b700 1 --2- 172.21.15.79:0/3001534511 >> v2:172.21.15.144:3300/0 conn(0x7f14800678b0 0x7f148015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147dd9b700 1 -- 172.21.15.79:0/3001534511 >> v1:172.21.15.79:6789/0 conn(0x7f14800c9390 legacy=0x7f148006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147dd9b700 1 -- 172.21.15.79:0/3001534511 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800cb710 con 0x7f14800cbf10 2023-10-14T18:54:32.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147dd9b700 1 --2- 172.21.15.79:0/3001534511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f148015e0c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f14800c5b10 tx=0x7f14740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c087e6ef32786410 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147d59a700 1 -- 172.21.15.79:0/3001534511 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011630 con 0x7f14800cbf10 2023-10-14T18:54:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147d59a700 1 -- 172.21.15.79:0/3001534511 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474011790 con 0x7f14800cbf10 2023-10-14T18:54:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.939+0000 7f147d59a700 1 -- 172.21.15.79:0/3001534511 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474011b30 con 0x7f14800cbf10 2023-10-14T18:54:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 -- 172.21.15.79:0/3001534511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 msgr2=0x7f148015e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 --2- 172.21.15.79:0/3001534511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f148015e0c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f14800c5b10 tx=0x7f14740091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 -- 172.21.15.79:0/3001534511 shutdown_connections 2023-10-14T18:54:32.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 --2- 172.21.15.79:0/3001534511 >> v2:172.21.15.144:3300/0 conn(0x7f14800678b0 0x7f148015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 --2- 172.21.15.79:0/3001534511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f148015e0c0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 -- 172.21.15.79:0/3001534511 >> 172.21.15.79:0/3001534511 conn(0x7f1480069870 msgr2=0x7f1480069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:32.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 -- 172.21.15.79:0/3001534511 shutdown_connections 2023-10-14T18:54:32.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.940+0000 7f1484923700 1 -- 172.21.15.79:0/3001534511 wait complete. 2023-10-14T18:54:32.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.941+0000 7f1484923700 1 Processor -- start 2023-10-14T18:54:32.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.941+0000 7f1484923700 1 -- start start 2023-10-14T18:54:32.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14800678b0 0x7f1480160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 0x7f14800b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148015a670 con 0x7f14800cbf10 2023-10-14T18:54:32.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148015a950 con 0x7f14800c9390 2023-10-14T18:54:32.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148015ac30 con 0x7f14800678b0 2023-10-14T18:54:32.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33724/0 (socket says 172.21.15.79:33724) 2023-10-14T18:54:32.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 -- 172.21.15.79:0/3552118617 learned_addr learned my addr 172.21.15.79:0/3552118617 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:32.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147dd9b700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 0x7f14800b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147e59c700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14800678b0 0x7f1480160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 -- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14800678b0 msgr2=0x7f1480160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14800678b0 0x7f1480160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 -- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 msgr2=0x7f14800b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:32.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 0x7f14800b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 -- 172.21.15.79:0/3552118617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009420 con 0x7f14800cbf10 2023-10-14T18:54:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147dd9b700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 0x7f14800b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f147ed9d700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f147800c7e0 tx=0x7f1478007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478005b30 con 0x7f14800cbf10 2023-10-14T18:54:32.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478005c90 con 0x7f14800cbf10 2023-10-14T18:54:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148015af10 con 0x7f14800cbf10 2023-10-14T18:54:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478007340 con 0x7f14800cbf10 2023-10-14T18:54:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.942+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1480160760 con 0x7f14800cbf10 2023-10-14T18:54:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.943+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148015b430 con 0x7f14800cbf10 2023-10-14T18:54:32.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.944+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f147801b400 con 0x7f14800cbf10 2023-10-14T18:54:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.944+0000 7f146e7fc700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.944+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1478083f80 con 0x7f14800cbf10 2023-10-14T18:54:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.944+0000 7f147e59c700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.945+0000 7f147e59c700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1470007600 tx=0x7f147000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:32.949+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f148015b430 con 0x7f14800cbf10 2023-10-14T18:54:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.130+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f148015b430 con 0x7f14800cbf10 2023-10-14T18:54:33.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.804+0000 7f146e7fc700 1 -- 172.21.15.79:0/3552118617 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v168) v1 ==== 170+0+0 (secure 0 0 0) 0x7f148015b430 con 0x7f14800cbf10 2023-10-14T18:54:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.812+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 msgr2=0x7f14600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:33.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.812+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1470007600 tx=0x7f147000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.812+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 msgr2=0x7f14800b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.812+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f147800c7e0 tx=0x7f1478007ea0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 shutdown_connections 2023-10-14T18:54:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14800cbf10 0x7f14800b1a50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14800678b0 0x7f1480160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 --2- 172.21.15.79:0/3552118617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14800c9390 0x7f14800b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.813+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 >> 172.21.15.79:0/3552118617 conn(0x7f1480069870 msgr2=0x7f14801588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.815+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 shutdown_connections 2023-10-14T18:54:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.816+0000 7f1484923700 1 -- 172.21.15.79:0/3552118617 wait complete. 2023-10-14T18:54:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:54:33.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:54:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.947+0000 7f0cf1fc9700 1 Processor -- start 2023-10-14T18:54:33.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.947+0000 7f0cf1fc9700 1 -- start start 2023-10-14T18:54:33.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf1fc9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0cec0cce30 0x7f0cec15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf1fc9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cec0b6580 0x7f0cec06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf1fc9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec06ac90 con 0x7f0cec06a830 2023-10-14T18:54:33.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf1fc9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0b4d70 con 0x7f0cec0b6580 2023-10-14T18:54:33.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf1fc9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0cd8d0 con 0x7f0cec0cce30 2023-10-14T18:54:33.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cec0b6580 0x7f0cec06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0cec0b6580 0x7f0cec06a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33728/0 (socket says 172.21.15.79:33728) 2023-10-14T18:54:33.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 -- 172.21.15.79:0/732311056 learned_addr learned my addr 172.21.15.79:0/732311056 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:33.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0cf0fc7700 1 --2- 172.21.15.79:0/732311056 >> v2:172.21.15.144:3300/0 conn(0x7f0cec0cce30 0x7f0cec15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 -- 172.21.15.79:0/732311056 >> v2:172.21.15.144:3300/0 conn(0x7f0cec0cce30 msgr2=0x7f0cec15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:33.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 --2- 172.21.15.79:0/732311056 >> v2:172.21.15.144:3300/0 conn(0x7f0cec0cce30 0x7f0cec15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 -- 172.21.15.79:0/732311056 >> v1:172.21.15.144:6789/0 conn(0x7f0cec06a830 legacy=0x7f0cec15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.948+0000 7f0ce3fff700 1 -- 172.21.15.79:0/732311056 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0b4440 con 0x7f0cec0b6580 2023-10-14T18:54:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0ce3fff700 1 --2- 172.21.15.79:0/732311056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec06a2f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0b3770 tx=0x7f0cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0674f43bb702c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0ce37fe700 1 -- 172.21.15.79:0/732311056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00b820 con 0x7f0cec0b6580 2023-10-14T18:54:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0ce37fe700 1 -- 172.21.15.79:0/732311056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00b980 con 0x7f0cec0b6580 2023-10-14T18:54:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0ce37fe700 1 -- 172.21.15.79:0/732311056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bd20 con 0x7f0cec0b6580 2023-10-14T18:54:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/732311056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 msgr2=0x7f0cec06a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/732311056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec06a2f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0b3770 tx=0x7f0cdc009250 comp rx=0 tx=0).stop 2023-10-14T18:54:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/732311056 shutdown_connections 2023-10-14T18:54:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/732311056 >> v2:172.21.15.144:3300/0 conn(0x7f0cec0cce30 0x7f0cec15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/732311056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec06a2f0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/732311056 >> 172.21.15.79:0/732311056 conn(0x7f0cec068cb0 msgr2=0x7f0cec0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/732311056 shutdown_connections 2023-10-14T18:54:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.949+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/732311056 wait complete. 2023-10-14T18:54:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.950+0000 7f0cf1fc9700 1 Processor -- start 2023-10-14T18:54:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 -- start start 2023-10-14T18:54:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cec06a830 0x7f0cec15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cec0cce30 0x7f0cec140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1556f0 con 0x7f0cec0b6580 2023-10-14T18:54:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec15bd40 con 0x7f0cec0cce30 2023-10-14T18:54:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0cf1fc9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1559b0 con 0x7f0cec06a830 2023-10-14T18:54:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33736/0 (socket says 172.21.15.79:33736) 2023-10-14T18:54:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.951+0000 7f0ce3fff700 1 -- 172.21.15.79:0/3469081858 learned_addr learned my addr 172.21.15.79:0/3469081858 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0cf17c8700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cec0cce30 0x7f0cec140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0cf0fc7700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cec06a830 0x7f0cec15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 -- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cec06a830 msgr2=0x7f0cec15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cec06a830 0x7f0cec15c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 -- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cec0cce30 msgr2=0x7f0cec140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cec0cce30 0x7f0cec140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 -- 172.21.15.79:0/3469081858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0094f0 con 0x7f0cec0b6580 2023-10-14T18:54:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce3fff700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0cec06b300 tx=0x7f0cdc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc011e20 con 0x7f0cec0b6580 2023-10-14T18:54:33.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc020070 con 0x7f0cec0b6580 2023-10-14T18:54:33.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec15b4a0 con 0x7f0cec0b6580 2023-10-14T18:54:33.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc01b6a0 con 0x7f0cec0b6580 2023-10-14T18:54:33.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.952+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec15ba60 con 0x7f0cec0b6580 2023-10-14T18:54:33.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.953+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec155b40 con 0x7f0cec0b6580 2023-10-14T18:54:33.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.954+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cdc022030 con 0x7f0cec0b6580 2023-10-14T18:54:33.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.954+0000 7f0ce0ff9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 0x7f0cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:33.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.954+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0cdc086340 con 0x7f0cec0b6580 2023-10-14T18:54:33.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.954+0000 7f0cf0fc7700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 0x7f0cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:33.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.955+0000 7f0cf0fc7700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 0x7f0cd80693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8007f60 tx=0x7f0ce8007470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:33.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:33.958+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cdc053610 con 0x7f0cec0b6580 2023-10-14T18:54:34.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.181+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0cec06ac90 con 0x7f0cec0b6580 2023-10-14T18:54:34.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.821+0000 7f0ce0ff9700 1 -- 172.21.15.79:0/3469081858 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v76) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0cec06ac90 con 0x7f0cec0b6580 2023-10-14T18:54:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.826+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 msgr2=0x7f0cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.826+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 0x7f0cd80693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8007f60 tx=0x7f0ce8007470 comp rx=0 tx=0).stop 2023-10-14T18:54:34.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 msgr2=0x7f0cec15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:34.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f0cec06b300 tx=0x7f0cdc016000 comp rx=0 tx=0).stop 2023-10-14T18:54:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 shutdown_connections 2023-10-14T18:54:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0cd8066f30 0x7f0cd80693e0 secure :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8007f60 tx=0x7f0ce8007470 comp rx=0 tx=0).stop 2023-10-14T18:54:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cec0cce30 0x7f0cec140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cec06a830 0x7f0cec15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 --2- 172.21.15.79:0/3469081858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0cec0b6580 0x7f0cec15ac60 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 >> 172.21.15.79:0/3469081858 conn(0x7f0cec068cb0 msgr2=0x7f0cec150590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 shutdown_connections 2023-10-14T18:54:34.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.827+0000 7f0cf1fc9700 1 -- 172.21.15.79:0/3469081858 wait complete. 2023-10-14T18:54:34.831 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 20 and data pool 21 2023-10-14T18:54:34.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:34.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.957+0000 7fd529ca4700 1 Processor -- start 2023-10-14T18:54:34.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.957+0000 7fd529ca4700 1 -- start start 2023-10-14T18:54:34.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd529ca4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd524157780 0x7fd524158c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd529ca4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd524070e10 0x7fd524157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd529ca4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52415b8a0 con 0x7fd52406f2d0 2023-10-14T18:54:34.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd529ca4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524159150 con 0x7fd524157780 2023-10-14T18:54:34.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd529ca4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524158090 con 0x7fd524070e10 2023-10-14T18:54:34.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd524157780 0x7fd524158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:34.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd524157780 0x7fd524158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33746/0 (socket says 172.21.15.79:33746) 2023-10-14T18:54:34.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 -- 172.21.15.79:0/1751882259 learned_addr learned my addr 172.21.15.79:0/1751882259 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:34.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 -- 172.21.15.79:0/1751882259 >> v2:172.21.15.144:3300/0 conn(0x7fd524070e10 msgr2=0x7fd524157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:34.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 --2- 172.21.15.79:0/1751882259 >> v2:172.21.15.144:3300/0 conn(0x7fd524070e10 0x7fd524157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.958+0000 7fd528ca2700 1 -- 172.21.15.79:0/1751882259 >> v1:172.21.15.144:6789/0 conn(0x7fd52406f2d0 legacy=0x7fd524070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:34.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd528ca2700 1 -- 172.21.15.79:0/1751882259 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52415bb80 con 0x7fd524157780 2023-10-14T18:54:34.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd528ca2700 1 --2- 172.21.15.79:0/1751882259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524157780 0x7fd524158c10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd52406eba0 tx=0x7fd520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a77c58010cbb64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:34.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd51b7fe700 1 -- 172.21.15.79:0/1751882259 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000b820 con 0x7fd524157780 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd51b7fe700 1 -- 172.21.15.79:0/1751882259 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52000b980 con 0x7fd524157780 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd51b7fe700 1 -- 172.21.15.79:0/1751882259 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000bd20 con 0x7fd524157780 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 -- 172.21.15.79:0/1751882259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524157780 msgr2=0x7fd524158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 --2- 172.21.15.79:0/1751882259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524157780 0x7fd524158c10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd52406eba0 tx=0x7fd520009250 comp rx=0 tx=0).stop 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 -- 172.21.15.79:0/1751882259 shutdown_connections 2023-10-14T18:54:34.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 --2- 172.21.15.79:0/1751882259 >> v2:172.21.15.144:3300/0 conn(0x7fd524070e10 0x7fd524157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 --2- 172.21.15.79:0/1751882259 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524157780 0x7fd524158c10 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 -- 172.21.15.79:0/1751882259 >> 172.21.15.79:0/1751882259 conn(0x7fd5240cd8f0 msgr2=0x7fd5240cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 -- 172.21.15.79:0/1751882259 shutdown_connections 2023-10-14T18:54:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.959+0000 7fd529ca4700 1 -- 172.21.15.79:0/1751882259 wait complete. 2023-10-14T18:54:34.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.960+0000 7fd529ca4700 1 Processor -- start 2023-10-14T18:54:34.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 -- start start 2023-10-14T18:54:34.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52406f2d0 0x7fd5240c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 0x7fd5240c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c1810 con 0x7fd524070e10 2023-10-14T18:54:34.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c6b70 con 0x7fd52406f2d0 2023-10-14T18:54:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd529ca4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c5f60 con 0x7fd524157780 2023-10-14T18:54:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd51bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd51bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33752/0 (socket says 172.21.15.79:33752) 2023-10-14T18:54:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.961+0000 7fd51bfff700 1 -- 172.21.15.79:0/931004506 learned_addr learned my addr 172.21.15.79:0/931004506 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd528ca2700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52406f2d0 0x7fd5240c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd5294a3700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 0x7fd5240c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 -- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 msgr2=0x7fd5240c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 0x7fd5240c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 -- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52406f2d0 msgr2=0x7fd5240c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52406f2d0 0x7fd5240c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 -- 172.21.15.79:0/931004506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200094f0 con 0x7fd524070e10 2023-10-14T18:54:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd5294a3700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 0x7fd5240c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd51bfff700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd51400b600 tx=0x7fd5140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400f510 con 0x7fd524070e10 2023-10-14T18:54:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400f670 con 0x7fd524070e10 2023-10-14T18:54:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240c6240 con 0x7fd524070e10 2023-10-14T18:54:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400fa30 con 0x7fd524070e10 2023-10-14T18:54:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.962+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240c6800 con 0x7fd524070e10 2023-10-14T18:54:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.963+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240c6d00 con 0x7fd524070e10 2023-10-14T18:54:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.963+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd51401a400 con 0x7fd524070e10 2023-10-14T18:54:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.964+0000 7fd518ff9700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.964+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd514083fa0 con 0x7fd524070e10 2023-10-14T18:54:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.964+0000 7fd528ca2700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.964+0000 7fd528ca2700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 0x7fd5100693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd52406eba0 tx=0x7fd520016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:34.968+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd514051290 con 0x7fd524070e10 2023-10-14T18:54:35.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.154+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd52415be60 con 0x7fd524070e10 2023-10-14T18:54:35.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.155+0000 7fd518ff9700 1 -- 172.21.15.79:0/931004506 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fd5140548b0 con 0x7fd524070e10 2023-10-14T18:54:35.156 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:35.156 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":169,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:54:34.182946+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:35.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 msgr2=0x7fd5100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 0x7fd5100693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd52406eba0 tx=0x7fd520016000 comp rx=0 tx=0).stop 2023-10-14T18:54:35.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 msgr2=0x7fd524145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd51400b600 tx=0x7fd5140091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 shutdown_connections 2023-10-14T18:54:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd510066f30 0x7fd5100693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd524157780 0x7fd5240c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52406f2d0 0x7fd5240c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 --2- 172.21.15.79:0/931004506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd524070e10 0x7fd524145b70 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 >> 172.21.15.79:0/931004506 conn(0x7fd5240cd8f0 msgr2=0x7fd5241556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 shutdown_connections 2023-10-14T18:54:35.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.157+0000 7fd529ca4700 1 -- 172.21.15.79:0/931004506 wait complete. 2023-10-14T18:54:35.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.283+0000 7f408f8c6700 1 Processor -- start 2023-10-14T18:54:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 -- start start 2023-10-14T18:54:35.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4088161e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40880b15e0 0x7f4088164360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40880b26d0 con 0x7f40880a79f0 2023-10-14T18:54:35.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40880aeab0 con 0x7f40880b15e0 2023-10-14T18:54:35.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.284+0000 7f408f8c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40880b2b60 con 0x7f408806f1c0 2023-10-14T18:54:35.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408d662700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f40880a79f0 0x7f408806eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36798/0 (socket says 172.21.15.79:36798) 2023-10-14T18:54:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408d662700 1 -- 172.21.15.79:0/3745027367 learned_addr learned my addr 172.21.15.79:0/3745027367 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300415344 0 0) 0x7f40880b26d0 con 0x7f40880a79f0 2023-10-14T18:54:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 --2- 172.21.15.79:0/3745027367 >> v2:172.21.15.144:3300/0 conn(0x7f40880b15e0 0x7f4088164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4074003570 con 0x7f40880a79f0 2023-10-14T18:54:35.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408ce61700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4088161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342599153 0 0) 0x7f4074003570 con 0x7f40880a79f0 2023-10-14T18:54:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 msgr2=0x7f4088161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4088161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 >> v2:172.21.15.144:3300/0 conn(0x7f40880b15e0 msgr2=0x7f4088164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 --2- 172.21.15.79:0/3745027367 >> v2:172.21.15.144:3300/0 conn(0x7f40880b15e0 0x7f4088164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880b1ac0 con 0x7f40880a79f0 2023-10-14T18:54:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4084001470 con 0x7f40880a79f0 2023-10-14T18:54:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 >> v1:172.21.15.79:6789/0 conn(0x7f40880a79f0 legacy=0x7f408806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4074003a60 0x7f4074003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4074004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f40740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880aeab0 con 0x7f4074004d50 2023-10-14T18:54:35.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880b2b60 con 0x7f4074003a60 2023-10-14T18:54:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407400bae0 con 0x7f408806f1c0 2023-10-14T18:54:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f40740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408d662700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4074003a60 0x7f4074003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408ce61700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4074004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 -- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 msgr2=0x7f4074004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4074004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 -- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4074003a60 msgr2=0x7f4074003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.285+0000 7f408de63700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4074003a60 0x7f4074003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408de63700 1 -- 172.21.15.79:0/3745027367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074003570 con 0x7f4074004d50 2023-10-14T18:54:35.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408ce61700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f408806f1c0 0x7f4074004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408de63700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f40740051c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f408000e210 tx=0x7f408000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17667ed636eed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000eac0 con 0x7f4074004d50 2023-10-14T18:54:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000f040 con 0x7f4074004d50 2023-10-14T18:54:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f407ffff700 1 -- 172.21.15.79:0/3745027367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000ee70 con 0x7f4074004d50 2023-10-14T18:54:35.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 -- 172.21.15.79:0/3745027367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 msgr2=0x7f40740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 --2- 172.21.15.79:0/3745027367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f40740051c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f408000e210 tx=0x7f408000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:35.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408de63700 1 -- 172.21.15.79:0/3745027367 reap_dead start 2023-10-14T18:54:35.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 -- 172.21.15.79:0/3745027367 shutdown_connections 2023-10-14T18:54:35.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 -- 172.21.15.79:0/3745027367 >> 172.21.15.79:0/3745027367 conn(0x7f40880cd1e0 msgr2=0x7f40880cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:35.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 -- 172.21.15.79:0/3745027367 shutdown_connections 2023-10-14T18:54:35.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.286+0000 7f408f8c6700 1 -- 172.21.15.79:0/3745027367 wait complete. 2023-10-14T18:54:35.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 Processor -- start 2023-10-14T18:54:35.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 -- start start 2023-10-14T18:54:35.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40880c2c10 0x7f408815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 0x7f4088159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408809ae80 con 0x7f4074004d50 2023-10-14T18:54:35.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4088159d70 con 0x7f40881593c0 2023-10-14T18:54:35.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.288+0000 7f408f8c6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408809a270 con 0x7f40880c2c10 2023-10-14T18:54:35.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33774/0 (socket says 172.21.15.79:33774) 2023-10-14T18:54:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 -- 172.21.15.79:0/1584026932 learned_addr learned my addr 172.21.15.79:0/1584026932 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408de63700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 0x7f4088159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408ce61700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40880c2c10 0x7f408815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 -- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40880c2c10 msgr2=0x7f408815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40880c2c10 0x7f408815c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 -- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 msgr2=0x7f4088159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 0x7f4088159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 -- 172.21.15.79:0/1584026932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408809a550 con 0x7f4074004d50 2023-10-14T18:54:35.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408de63700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 0x7f4088159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:35.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408d662700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4084000e10 tx=0x7f4084001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084018030 con 0x7f4074004d50 2023-10-14T18:54:35.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408400f8d0 con 0x7f4074004d50 2023-10-14T18:54:35.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408809a830 con 0x7f4074004d50 2023-10-14T18:54:35.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408400fc90 con 0x7f4074004d50 2023-10-14T18:54:35.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.289+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40880c3080 con 0x7f4074004d50 2023-10-14T18:54:35.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.290+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408804c3c0 con 0x7f4074004d50 2023-10-14T18:54:35.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.291+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f408401b070 con 0x7f4074004d50 2023-10-14T18:54:35.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.291+0000 7f407d7fa700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.291+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4084019070 con 0x7f4074004d50 2023-10-14T18:54:35.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.291+0000 7f408ce61700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.292+0000 7f408ce61700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 0x7f406c0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f40880b2f70 tx=0x7f4078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.295+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4084051790 con 0x7f4074004d50 2023-10-14T18:54:35.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.476+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40880b1da0 con 0x7f4074004d50 2023-10-14T18:54:35.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.477+0000 7f407d7fa700 1 -- 172.21.15.79:0/1584026932 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f4084054db0 con 0x7f4074004d50 2023-10-14T18:54:35.478 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:35.478 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":169,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:54:34.182946+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:35.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 msgr2=0x7f406c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 0x7f406c0693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f40880b2f70 tx=0x7f4078008040 comp rx=0 tx=0).stop 2023-10-14T18:54:35.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 msgr2=0x7f4088099c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4084000e10 tx=0x7f4084001e90 comp rx=0 tx=0).stop 2023-10-14T18:54:35.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 shutdown_connections 2023-10-14T18:54:35.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40881593c0 0x7f4088159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4074004d50 0x7f4088099c20 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 --2- 172.21.15.79:0/1584026932 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40880c2c10 0x7f408815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 >> 172.21.15.79:0/1584026932 conn(0x7f40880cd1e0 msgr2=0x7f4088069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:35.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 shutdown_connections 2023-10-14T18:54:35.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.479+0000 7f408f8c6700 1 -- 172.21.15.79:0/1584026932 wait complete. 2023-10-14T18:54:35.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:54:35.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.608+0000 7f06c5fba700 1 Processor -- start 2023-10-14T18:54:35.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.608+0000 7f06c5fba700 1 -- start start 2023-10-14T18:54:35.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06c5fba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06c006a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06c5fba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00b0790 con 0x7f06c006aae0 2023-10-14T18:54:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06c5fba700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00ce1f0 con 0x7f06c0159ec0 2023-10-14T18:54:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06c5fba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c006af60 con 0x7f06c015a290 2023-10-14T18:54:35.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06bffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f06c006aae0 0x7f06c00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36810/0 (socket says 172.21.15.79:36810) 2023-10-14T18:54:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.609+0000 7f06bffff700 1 -- 172.21.15.79:0/1377862143 learned_addr learned my addr 172.21.15.79:0/1377862143 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06beffd700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06c006a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683723977 0 0) 0x7f06c00b0790 con 0x7f06c006aae0 2023-10-14T18:54:35.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003570 con 0x7f06c006aae0 2023-10-14T18:54:35.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776913605 0 0) 0x7f06c00ce1f0 con 0x7f06c0159ec0 2023-10-14T18:54:35.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c00b0790 con 0x7f06c0159ec0 2023-10-14T18:54:35.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917725425 0 0) 0x7f06a8003570 con 0x7f06c006aae0 2023-10-14T18:54:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 msgr2=0x7f06c006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06c006a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 >> v1:172.21.15.144:6789/0 conn(0x7f06c0159ec0 legacy=0x7f06c00af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00b0b20 con 0x7f06c006aae0 2023-10-14T18:54:35.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f06b8001470 con 0x7f06c006aae0 2023-10-14T18:54:35.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 >> v1:172.21.15.79:6789/0 conn(0x7f06c006aae0 legacy=0x7f06c00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06a8004810 0x7f06a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c006af60 con 0x7f06a8003c20 2023-10-14T18:54:35.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a800bb40 con 0x7f06a8004810 2023-10-14T18:54:35.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a800bd00 con 0x7f06c015a290 2023-10-14T18:54:35.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06beffd700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06a8004810 0x7f06a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bffff700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 -- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 msgr2=0x7f06a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c015a290 0x7f06a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 -- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06a8004810 msgr2=0x7f06a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06a8004810 0x7f06a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.610+0000 7f06bf7fe700 1 -- 172.21.15.79:0/1377862143 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8003570 con 0x7f06a8003c20 2023-10-14T18:54:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06a8004010 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f06b0002120 tx=0x7f06b00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1648c21c2c5d0a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0001ab0 con 0x7f06a8003c20 2023-10-14T18:54:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000c980 con 0x7f06a8003c20 2023-10-14T18:54:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06be7fc700 1 -- 172.21.15.79:0/1377862143 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000cd20 con 0x7f06a8003c20 2023-10-14T18:54:35.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 -- 172.21.15.79:0/1377862143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 msgr2=0x7f06a8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 --2- 172.21.15.79:0/1377862143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06a8004010 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f06b0002120 tx=0x7f06b00017a0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06bffff700 1 -- 172.21.15.79:0/1377862143 reap_dead start 2023-10-14T18:54:35.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 -- 172.21.15.79:0/1377862143 shutdown_connections 2023-10-14T18:54:35.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 -- 172.21.15.79:0/1377862143 >> 172.21.15.79:0/1377862143 conn(0x7f06c00d1880 msgr2=0x7f06c00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 -- 172.21.15.79:0/1377862143 shutdown_connections 2023-10-14T18:54:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.611+0000 7f06c5fba700 1 -- 172.21.15.79:0/1377862143 wait complete. 2023-10-14T18:54:35.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.612+0000 7f06c5fba700 1 Processor -- start 2023-10-14T18:54:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 -- start start 2023-10-14T18:54:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06c01564d0 0x7f06c0144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c00b1160 0x7f06c00b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00c87f0 con 0x7f06a8003c20 2023-10-14T18:54:35.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00b1af0 con 0x7f06c01564d0 2023-10-14T18:54:35.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06c5fba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0159070 con 0x7f06c00b1160 2023-10-14T18:54:35.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33788/0 (socket says 172.21.15.79:33788) 2023-10-14T18:54:35.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06bf7fe700 1 -- 172.21.15.79:0/4274873954 learned_addr learned my addr 172.21.15.79:0/4274873954 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06beffd700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06c01564d0 0x7f06c0144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.613+0000 7f06bffff700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c00b1160 0x7f06c00b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 -- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c00b1160 msgr2=0x7f06c00b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c00b1160 0x7f06c00b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 -- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06c01564d0 msgr2=0x7f06c0144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:35.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06c01564d0 0x7f06c0144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:35.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 -- 172.21.15.79:0/4274873954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0159350 con 0x7f06a8003c20 2023-10-14T18:54:35.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06bf7fe700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c6a0 tx=0x7f06b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0001ab0 con 0x7f06a8003c20 2023-10-14T18:54:35.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000c6d0 con 0x7f06a8003c20 2023-10-14T18:54:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0159630 con 0x7f06a8003c20 2023-10-14T18:54:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b001e460 con 0x7f06a8003c20 2023-10-14T18:54:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.614+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c0145150 con 0x7f06a8003c20 2023-10-14T18:54:35.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.615+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c004c3c0 con 0x7f06a8003c20 2023-10-14T18:54:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.615+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06b0003030 con 0x7f06a8003c20 2023-10-14T18:54:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.616+0000 7f06a77fe700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 0x7f06ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.616+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06b0086a70 con 0x7f06a8003c20 2023-10-14T18:54:35.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.616+0000 7f06beffd700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 0x7f06ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.616+0000 7f06beffd700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 0x7f06ac0693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f06c016d440 tx=0x7f06b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:35.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.620+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06b0053ce0 con 0x7f06a8003c20 2023-10-14T18:54:35.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:35.846+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f06c00b04b0 con 0x7f06a8003c20 2023-10-14T18:54:36.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.838+0000 7f06a77fe700 1 -- 172.21.15.79:0/4274873954 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) v1 ==== 118+0+0 (secure 0 0 0) 0x7f06b0057300 con 0x7f06a8003c20 2023-10-14T18:54:36.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.840+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 msgr2=0x7f06ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.840+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 0x7f06ac0693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f06c016d440 tx=0x7f06b4008040 comp rx=0 tx=0).stop 2023-10-14T18:54:36.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 msgr2=0x7f06c0158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c6a0 tx=0x7f06b0016000 comp rx=0 tx=0).stop 2023-10-14T18:54:36.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 shutdown_connections 2023-10-14T18:54:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f06ac066f30 0x7f06ac0693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f06c00b1160 0x7f06c00b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06a8003c20 0x7f06c0158a20 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 --2- 172.21.15.79:0/4274873954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06c01564d0 0x7f06c0144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 >> 172.21.15.79:0/4274873954 conn(0x7f06c00d1880 msgr2=0x7f06c00c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:36.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 shutdown_connections 2023-10-14T18:54:36.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.841+0000 7f06c5fba700 1 -- 172.21.15.79:0/4274873954 wait complete. 2023-10-14T18:54:36.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:54:36.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.972+0000 7f40ec0af700 1 Processor -- start 2023-10-14T18:54:36.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.972+0000 7f40ec0af700 1 -- start start 2023-10-14T18:54:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ec0af700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40e406d370 0x7f40e406d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ec0af700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e415c8d0 con 0x7f40e4152300 2023-10-14T18:54:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ec0af700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40c9370 con 0x7f40e415b9a0 2023-10-14T18:54:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ec0af700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40b1400 con 0x7f40e406d370 2023-10-14T18:54:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ea64c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40e406d370 0x7f40e406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40e9e4b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f40e4152300 0x7f40e4158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:36820/0 (socket says 172.21.15.79:36820) 2023-10-14T18:54:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40e9e4b700 1 -- 172.21.15.79:0/2662531999 learned_addr learned my addr 172.21.15.79:0/2662531999 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ea64c700 1 -- 172.21.15.79:0/2662531999 >> v1:172.21.15.144:6789/0 conn(0x7f40e415b9a0 legacy=0x7f40e40caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ea64c700 1 -- 172.21.15.79:0/2662531999 >> v1:172.21.15.79:6789/0 conn(0x7f40e4152300 legacy=0x7f40e4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ea64c700 1 -- 172.21.15.79:0/2662531999 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e415c030 con 0x7f40e406d370 2023-10-14T18:54:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40e8e49700 1 -- 172.21.15.79:0/2662531999 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743229059 0 0) 0x7f40e415c8d0 con 0x7f40e4152300 2023-10-14T18:54:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40ea64c700 1 --2- 172.21.15.79:0/2662531999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e406d370 0x7f40e406d790 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f40d40098e0 tx=0x7f40d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac29c9a72650352 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:36.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.973+0000 7f40e8e49700 1 -- 172.21.15.79:0/2662531999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4009e80 con 0x7f40e406d370 2023-10-14T18:54:36.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40e8e49700 1 -- 172.21.15.79:0/2662531999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400b860 con 0x7f40e406d370 2023-10-14T18:54:36.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40e8e49700 1 -- 172.21.15.79:0/2662531999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400bbe0 con 0x7f40e406d370 2023-10-14T18:54:36.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 -- 172.21.15.79:0/2662531999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e406d370 msgr2=0x7f40e406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 --2- 172.21.15.79:0/2662531999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e406d370 0x7f40e406d790 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f40d40098e0 tx=0x7f40d40091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 -- 172.21.15.79:0/2662531999 shutdown_connections 2023-10-14T18:54:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 --2- 172.21.15.79:0/2662531999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e406d370 0x7f40e406d790 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 -- 172.21.15.79:0/2662531999 >> 172.21.15.79:0/2662531999 conn(0x7f40e4069870 msgr2=0x7f40e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:36.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 -- 172.21.15.79:0/2662531999 shutdown_connections 2023-10-14T18:54:36.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.974+0000 7f40ec0af700 1 -- 172.21.15.79:0/2662531999 wait complete. 2023-10-14T18:54:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.975+0000 7f40ec0af700 1 Processor -- start 2023-10-14T18:54:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.975+0000 7f40ec0af700 1 -- start start 2023-10-14T18:54:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40e406d370 0x7f40e40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e4152300 0x7f40e415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e415e0d0 con 0x7f40e415b9a0 2023-10-14T18:54:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4167a40 con 0x7f40e4152300 2023-10-14T18:54:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ec0af700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e415d4c0 con 0x7f40e406d370 2023-10-14T18:54:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33802/0 (socket says 172.21.15.79:33802) 2023-10-14T18:54:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 -- 172.21.15.79:0/1486412849 learned_addr learned my addr 172.21.15.79:0/1486412849 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40e964a700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e4152300 0x7f40e415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40e9e4b700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40e406d370 0x7f40e40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 -- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40e406d370 msgr2=0x7f40e40b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40e406d370 0x7f40e40b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 -- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e4152300 msgr2=0x7f40e415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e4152300 0x7f40e415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 -- 172.21.15.79:0/1486412849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4009420 con 0x7f40e415b9a0 2023-10-14T18:54:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.976+0000 7f40ea64c700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b3c0 tx=0x7f40d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.977+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d401f070 con 0x7f40e415b9a0 2023-10-14T18:54:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.977+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400b9d0 con 0x7f40e415b9a0 2023-10-14T18:54:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.977+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e415d7a0 con 0x7f40e415b9a0 2023-10-14T18:54:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.977+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4025650 con 0x7f40e415b9a0 2023-10-14T18:54:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.977+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e415dd60 con 0x7f40e415b9a0 2023-10-14T18:54:36.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.978+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e415e280 con 0x7f40e415b9a0 2023-10-14T18:54:36.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.978+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40d4023070 con 0x7f40e415b9a0 2023-10-14T18:54:36.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.979+0000 7f40e1ffb700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 0x7f40d0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:36.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.979+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40d4085ca0 con 0x7f40e415b9a0 2023-10-14T18:54:36.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.979+0000 7f40e9e4b700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 0x7f40d0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:36.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.979+0000 7f40e9e4b700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 0x7f40d0069460 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001560 tx=0x7f40dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:36.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:36.983+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40e415e280 con 0x7f40e415b9a0 2023-10-14T18:54:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.210+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f40e415e280 con 0x7f40e415b9a0 2023-10-14T18:54:37.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.841+0000 7f40e1ffb700 1 -- 172.21.15.79:0/1486412849 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v80) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40e415e280 con 0x7f40e415b9a0 2023-10-14T18:54:37.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.843+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 msgr2=0x7f40d0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:37.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 0x7f40d0069460 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001560 tx=0x7f40dc009040 comp rx=0 tx=0).stop 2023-10-14T18:54:37.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 msgr2=0x7f40e4167500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:37.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b3c0 tx=0x7f40d4017000 comp rx=0 tx=0).stop 2023-10-14T18:54:37.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 shutdown_connections 2023-10-14T18:54:37.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f40d0066fb0 0x7f40d0069460 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e415b9a0 0x7f40e4167500 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40e406d370 0x7f40e40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 --2- 172.21.15.79:0/1486412849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40e4152300 0x7f40e415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 >> 172.21.15.79:0/1486412849 conn(0x7f40e4069870 msgr2=0x7f40e40ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:37.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 shutdown_connections 2023-10-14T18:54:37.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.844+0000 7f40ec0af700 1 -- 172.21.15.79:0/1486412849 wait complete. 2023-10-14T18:54:37.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:37.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.971+0000 7f54db59e700 1 Processor -- start 2023-10-14T18:54:37.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.971+0000 7f54db59e700 1 -- start start 2023-10-14T18:54:37.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54db59e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f54dc0cd6e0 0x7f54dc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54db59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54dc15cbd0 0x7f54dc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54db59e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc0cb7c0 con 0x7f54dc0cdab0 2023-10-14T18:54:37.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54db59e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc15e850 con 0x7f54dc15cbd0 2023-10-14T18:54:37.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54db59e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0cd030 con 0x7f54dc0cd6e0 2023-10-14T18:54:37.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54dc15cbd0 0x7f54dc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54dc15cbd0 0x7f54dc15d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33810/0 (socket says 172.21.15.79:33810) 2023-10-14T18:54:37.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 -- 172.21.15.79:0/176543401 learned_addr learned my addr 172.21.15.79:0/176543401 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:37.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54da59c700 1 --2- 172.21.15.79:0/176543401 >> v2:172.21.15.144:3300/0 conn(0x7f54dc0cd6e0 0x7f54dc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 -- 172.21.15.79:0/176543401 >> v2:172.21.15.144:3300/0 conn(0x7f54dc0cd6e0 msgr2=0x7f54dc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:37.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 --2- 172.21.15.79:0/176543401 >> v2:172.21.15.144:3300/0 conn(0x7f54dc0cd6e0 0x7f54dc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 -- 172.21.15.79:0/176543401 >> v1:172.21.15.144:6789/0 conn(0x7f54dc0cdab0 legacy=0x7f54dc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 -- 172.21.15.79:0/176543401 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc15e290 con 0x7f54dc15cbd0 2023-10-14T18:54:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54dad9d700 1 --2- 172.21.15.79:0/176543401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc15d050 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06b730 tx=0x7f54d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd745c57ceeeff6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.972+0000 7f54d9d9b700 1 -- 172.21.15.79:0/176543401 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d400e070 con 0x7f54dc15cbd0 2023-10-14T18:54:37.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54d9d9b700 1 -- 172.21.15.79:0/176543401 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d400ba10 con 0x7f54dc15cbd0 2023-10-14T18:54:37.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54d9d9b700 1 -- 172.21.15.79:0/176543401 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40092e0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 -- 172.21.15.79:0/176543401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 msgr2=0x7f54dc15d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:37.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 --2- 172.21.15.79:0/176543401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc15d050 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f54dc06b730 tx=0x7f54d4009840 comp rx=0 tx=0).stop 2023-10-14T18:54:37.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 -- 172.21.15.79:0/176543401 shutdown_connections 2023-10-14T18:54:37.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 --2- 172.21.15.79:0/176543401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc15d050 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 --2- 172.21.15.79:0/176543401 >> v2:172.21.15.144:3300/0 conn(0x7f54dc0cd6e0 0x7f54dc0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 -- 172.21.15.79:0/176543401 >> 172.21.15.79:0/176543401 conn(0x7f54dc067660 msgr2=0x7f54dc067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:37.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 -- 172.21.15.79:0/176543401 shutdown_connections 2023-10-14T18:54:37.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.973+0000 7f54db59e700 1 -- 172.21.15.79:0/176543401 wait complete. 2023-10-14T18:54:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.974+0000 7f54db59e700 1 Processor -- start 2023-10-14T18:54:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.974+0000 7f54db59e700 1 -- start start 2023-10-14T18:54:37.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54dc0cd6e0 0x7f54dc0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 0x7f54dc14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0c5da0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc14cb20 con 0x7f54dc0cdab0 2023-10-14T18:54:37.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54db59e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc155b90 con 0x7f54dc0cd6e0 2023-10-14T18:54:37.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54dad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54dad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33812/0 (socket says 172.21.15.79:33812) 2023-10-14T18:54:37.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54dad9d700 1 -- 172.21.15.79:0/3422152751 learned_addr learned my addr 172.21.15.79:0/3422152751 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.975+0000 7f54d1d9b700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 0x7f54dc14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 -- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54dc0cd6e0 msgr2=0x7f54dc0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54da59c700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54dc0cd6e0 0x7f54dc0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54dc0cd6e0 0x7f54dc0b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 -- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 msgr2=0x7f54dc14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 0x7f54dc14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 -- 172.21.15.79:0/3422152751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4009ae0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54d1d9b700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 0x7f54dc14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54dad9d700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c7b10 tx=0x7f54d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40032f0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4012e60 con 0x7f54dc15cbd0 2023-10-14T18:54:37.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc155e70 con 0x7f54dc15cbd0 2023-10-14T18:54:37.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d401d670 con 0x7f54dc15cbd0 2023-10-14T18:54:37.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.976+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc0c60a0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.977+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc0c6510 con 0x7f54dc15cbd0 2023-10-14T18:54:37.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.977+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54d401da20 con 0x7f54dc15cbd0 2023-10-14T18:54:37.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.978+0000 7f54d2ffd700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:37.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.978+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54d40862d0 con 0x7f54dc15cbd0 2023-10-14T18:54:37.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.978+0000 7f54da59c700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:37.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.978+0000 7f54da59c700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 0x7f54bc0693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006fd0 tx=0x7f54cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:37.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:37.982+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54dc0c6510 con 0x7f54dc15cbd0 2023-10-14T18:54:38.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.208+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54dc0c6510 con 0x7f54dc15cbd0 2023-10-14T18:54:38.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.208+0000 7f54d2ffd700 1 -- 172.21.15.79:0/3422152751 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f54dc0c6510 con 0x7f54dc15cbd0 2023-10-14T18:54:38.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:38.209 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:54:38.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 msgr2=0x7f54bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 0x7f54bc0693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006fd0 tx=0x7f54cc008040 comp rx=0 tx=0).stop 2023-10-14T18:54:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 msgr2=0x7f54dc14c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c7b10 tx=0x7f54d4017000 comp rx=0 tx=0).stop 2023-10-14T18:54:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 shutdown_connections 2023-10-14T18:54:38.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f54bc066f30 0x7f54bc0693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54dc15cbd0 0x7f54dc14c5e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f54dc0cd6e0 0x7f54dc0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 --2- 172.21.15.79:0/3422152751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54dc0cdab0 0x7f54dc14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 >> 172.21.15.79:0/3422152751 conn(0x7f54dc067660 msgr2=0x7f54dc156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 shutdown_connections 2023-10-14T18:54:38.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.210+0000 7f54db59e700 1 -- 172.21.15.79:0/3422152751 wait complete. 2023-10-14T18:54:38.215 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:54:38.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:54:38.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.337+0000 7fd41ba2d700 1 Processor -- start 2023-10-14T18:54:38.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.337+0000 7fd41ba2d700 1 -- start start 2023-10-14T18:54:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41415cbb0 con 0x7fd41415d580 2023-10-14T18:54:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41415bfa0 con 0x7fd41415a620 2023-10-14T18:54:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd41ba2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41415c280 con 0x7fd414157870 2023-10-14T18:54:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45030/0 (socket says 172.21.15.79:45030) 2023-10-14T18:54:38.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 -- 172.21.15.79:0/2510717959 learned_addr learned my addr 172.21.15.79:0/2510717959 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd418fc8700 1 --2- 172.21.15.79:0/2510717959 >> v2:172.21.15.144:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd4197c9700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 -- 172.21.15.79:0/2510717959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd414157870 msgr2=0x7fd41415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 -- 172.21.15.79:0/2510717959 >> v2:172.21.15.144:3300/0 conn(0x7fd41415a620 msgr2=0x7fd41415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 --2- 172.21.15.79:0/2510717959 >> v2:172.21.15.144:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 -- 172.21.15.79:0/2510717959 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41415c560 con 0x7fd41415d580 2023-10-14T18:54:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd419fca700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415d580 0x7fd414158110 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd4140897d0 tx=0x7fd40c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe22881921bb4f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd40bfff700 1 -- 172.21.15.79:0/2510717959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00e070 con 0x7fd41415d580 2023-10-14T18:54:38.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd40bfff700 1 -- 172.21.15.79:0/2510717959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00ba20 con 0x7fd41415d580 2023-10-14T18:54:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.338+0000 7fd40bfff700 1 -- 172.21.15.79:0/2510717959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0092e0 con 0x7fd41415d580 2023-10-14T18:54:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 -- 172.21.15.79:0/2510717959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415d580 msgr2=0x7fd414158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415d580 0x7fd414158110 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd4140897d0 tx=0x7fd40c009840 comp rx=0 tx=0).stop 2023-10-14T18:54:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 -- 172.21.15.79:0/2510717959 shutdown_connections 2023-10-14T18:54:38.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/2510717959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/2510717959 >> v2:172.21.15.144:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 -- 172.21.15.79:0/2510717959 >> 172.21.15.79:0/2510717959 conn(0x7fd414068ce0 msgr2=0x7fd4140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 -- 172.21.15.79:0/2510717959 shutdown_connections 2023-10-14T18:54:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.339+0000 7fd41ba2d700 1 -- 172.21.15.79:0/2510717959 wait complete. 2023-10-14T18:54:38.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.340+0000 7fd41ba2d700 1 Processor -- start 2023-10-14T18:54:38.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.340+0000 7fd41ba2d700 1 -- start start 2023-10-14T18:54:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd41416a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41416a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b06c0 con 0x7fd414157870 2023-10-14T18:54:38.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41414ab60 con 0x7fd41415d580 2023-10-14T18:54:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd41ba2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b0960 con 0x7fd41415a620 2023-10-14T18:54:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45034/0 (socket says 172.21.15.79:45034) 2023-10-14T18:54:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 -- 172.21.15.79:0/36445786 learned_addr learned my addr 172.21.15.79:0/36445786 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:38.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd419fca700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41416a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd418fc8700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd41416a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 -- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 msgr2=0x7fd41416a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd41416a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 -- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 msgr2=0x7fd41416a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41416a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.341+0000 7fd4197c9700 1 -- 172.21.15.79:0/36445786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009ae0 con 0x7fd414157870 2023-10-14T18:54:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd418fc8700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd41416a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd4197c9700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d8c0 tx=0x7fd410008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100125f0 con 0x7fd414157870 2023-10-14T18:54:38.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410012750 con 0x7fd414157870 2023-10-14T18:54:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410012af0 con 0x7fd414157870 2023-10-14T18:54:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4140d0c10 con 0x7fd414157870 2023-10-14T18:54:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.342+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140d11d0 con 0x7fd414157870 2023-10-14T18:54:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.343+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4140b0c40 con 0x7fd414157870 2023-10-14T18:54:38.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.343+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd41001e460 con 0x7fd414157870 2023-10-14T18:54:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.343+0000 7fd4097fa700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.343+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd410084ac0 con 0x7fd414157870 2023-10-14T18:54:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.344+0000 7fd418fc8700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.344+0000 7fd418fc8700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd414153900 tx=0x7fd404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.348+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd410051d30 con 0x7fd414157870 2023-10-14T18:54:38.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.531+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd41404c3c0 con 0x7fd414157870 2023-10-14T18:54:38.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.532+0000 7fd4097fa700 1 -- 172.21.15.79:0/36445786 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fd410084e60 con 0x7fd414157870 2023-10-14T18:54:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":170,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:54:35.804484+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:54:38.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 msgr2=0x7fd3f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd414153900 tx=0x7fd404008040 comp rx=0 tx=0).stop 2023-10-14T18:54:38.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 msgr2=0x7fd4140d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d8c0 tx=0x7fd410008040 comp rx=0 tx=0).stop 2023-10-14T18:54:38.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 shutdown_connections 2023-10-14T18:54:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41416a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd4140d02e0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 --2- 172.21.15.79:0/36445786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd41416a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 >> 172.21.15.79:0/36445786 conn(0x7fd414068ce0 msgr2=0x7fd4140b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:38.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 shutdown_connections 2023-10-14T18:54:38.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.534+0000 7fd41ba2d700 1 -- 172.21.15.79:0/36445786 wait complete. 2023-10-14T18:54:38.547 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:54:38.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:54:38.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.661+0000 7f234bf14700 1 Processor -- start 2023-10-14T18:54:38.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 -- start start 2023-10-14T18:54:38.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440b0e50 0x7f23440c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23440cb4f0 0x7f23440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234415de60 con 0x7f23440b1220 2023-10-14T18:54:38.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440cbeb0 con 0x7f23440b0e50 2023-10-14T18:54:38.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.662+0000 7f234bf14700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234415e140 con 0x7f23440cb4f0 2023-10-14T18:54:38.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440b0e50 0x7f23440c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23440b0e50 0x7f23440c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45042/0 (socket says 172.21.15.79:45042) 2023-10-14T18:54:38.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 -- 172.21.15.79:0/3823509725 learned_addr learned my addr 172.21.15.79:0/3823509725 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:38.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f234a4b1700 1 --2- 172.21.15.79:0/3823509725 >> v2:172.21.15.144:3300/0 conn(0x7f23440cb4f0 0x7f23440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 -- 172.21.15.79:0/3823509725 >> v2:172.21.15.144:3300/0 conn(0x7f23440cb4f0 msgr2=0x7f23440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 --2- 172.21.15.79:0/3823509725 >> v2:172.21.15.144:3300/0 conn(0x7f23440cb4f0 0x7f23440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 -- 172.21.15.79:0/3823509725 >> v1:172.21.15.144:6789/0 conn(0x7f23440b1220 legacy=0x7f234406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 -- 172.21.15.79:0/3823509725 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234415e420 con 0x7f23440b0e50 2023-10-14T18:54:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2349cb0700 1 --2- 172.21.15.79:0/3823509725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f23440c9180 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f234415e9e0 tx=0x7f2340009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e718097e1da1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2348cae700 1 -- 172.21.15.79:0/3823509725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000e070 con 0x7f23440b0e50 2023-10-14T18:54:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2348cae700 1 -- 172.21.15.79:0/3823509725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234000ba20 con 0x7f23440b0e50 2023-10-14T18:54:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.663+0000 7f2348cae700 1 -- 172.21.15.79:0/3823509725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400092e0 con 0x7f23440b0e50 2023-10-14T18:54:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 -- 172.21.15.79:0/3823509725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 msgr2=0x7f23440c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 --2- 172.21.15.79:0/3823509725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f23440c9180 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f234415e9e0 tx=0x7f2340009840 comp rx=0 tx=0).stop 2023-10-14T18:54:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 -- 172.21.15.79:0/3823509725 shutdown_connections 2023-10-14T18:54:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 --2- 172.21.15.79:0/3823509725 >> v2:172.21.15.144:3300/0 conn(0x7f23440cb4f0 0x7f23440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 --2- 172.21.15.79:0/3823509725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f23440c9180 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 -- 172.21.15.79:0/3823509725 >> 172.21.15.79:0/3823509725 conn(0x7f2344069870 msgr2=0x7f2344069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 -- 172.21.15.79:0/3823509725 shutdown_connections 2023-10-14T18:54:38.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.664+0000 7f234bf14700 1 -- 172.21.15.79:0/3823509725 wait complete. 2023-10-14T18:54:38.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.665+0000 7f234bf14700 1 Processor -- start 2023-10-14T18:54:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.665+0000 7f234bf14700 1 -- start start 2023-10-14T18:54:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.665+0000 7f234bf14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.665+0000 7f234bf14700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b1220 0x7f23440c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440cb4f0 0x7f23440b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c5390 con 0x7f23440b0e50 2023-10-14T18:54:38.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c6c00 con 0x7f23440cb4f0 2023-10-14T18:54:38.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23441556c0 con 0x7f23440b1220 2023-10-14T18:54:38.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45052/0 (socket says 172.21.15.79:45052) 2023-10-14T18:54:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 -- 172.21.15.79:0/875425847 learned_addr learned my addr 172.21.15.79:0/875425847 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234a4b1700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440cb4f0 0x7f23440b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f23494af700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b1220 0x7f23440c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 -- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b1220 msgr2=0x7f23440c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b1220 0x7f23440c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 -- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440cb4f0 msgr2=0x7f23440b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440cb4f0 0x7f23440b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 -- 172.21.15.79:0/875425847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340009ae0 con 0x7f23440b0e50 2023-10-14T18:54:38.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2349cb0700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f23440c59e0 tx=0x7f2340018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400078a0 con 0x7f23440b0e50 2023-10-14T18:54:38.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340007a20 con 0x7f23440b0e50 2023-10-14T18:54:38.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c4dd0 con 0x7f23440b0e50 2023-10-14T18:54:38.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340007de0 con 0x7f23440b0e50 2023-10-14T18:54:38.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.666+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440c6890 con 0x7f23440b0e50 2023-10-14T18:54:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.667+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440c66f0 con 0x7f23440b0e50 2023-10-14T18:54:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.668+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f234001d420 con 0x7f23440b0e50 2023-10-14T18:54:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.668+0000 7f2339ffb700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.668+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2340086210 con 0x7f23440b0e50 2023-10-14T18:54:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.668+0000 7f23494af700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:38.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.669+0000 7f23494af700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f23440c8400 tx=0x7f2334009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:38.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.672+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23440c66f0 con 0x7f23440b0e50 2023-10-14T18:54:38.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.849+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23440c6d40 con 0x7f2328066f30 2023-10-14T18:54:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.859+0000 7f2339ffb700 1 -- 172.21.15.79:0/875425847 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283066 (secure 0 0 0) 0x7f2334013420 con 0x7f2328066f30 2023-10-14T18:54:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:38.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 msgr2=0x7f23280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f23440c8400 tx=0x7f2334009040 comp rx=0 tx=0).stop 2023-10-14T18:54:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 msgr2=0x7f2344155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f23440c59e0 tx=0x7f2340018000 comp rx=0 tx=0).stop 2023-10-14T18:54:38.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 shutdown_connections 2023-10-14T18:54:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2328066f30 0x7f23280693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23440cb4f0 0x7f23440b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23440b0e50 0x7f2344155180 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 --2- 172.21.15.79:0/875425847 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23440b1220 0x7f23440c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 >> 172.21.15.79:0/875425847 conn(0x7f2344069870 msgr2=0x7f2344156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 shutdown_connections 2023-10-14T18:54:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:38.862+0000 7f234bf14700 1 -- 172.21.15.79:0/875425847 wait complete. 2023-10-14T18:54:38.868 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:54:38.875 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-14T18:54:38.472221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554072,"statfs":{"total":1600000000,"available":1591370575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672544"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809445+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808607+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809876+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811396+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808807+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:17.855758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809201+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809244+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808005+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:11.581850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808831+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807426+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:24:08.832890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810373+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:57.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811043+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807606+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:21.187441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808071+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:22.982244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806567+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:57.194498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809493+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809914+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807348+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:53.272239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807693+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:16.558714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811740+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809269+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808927+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:33.804334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806950+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:25.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808504+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807769+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:32.075044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807775+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:33.535803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809652+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.814870+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810408+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807423+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.010859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808571+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:11.467377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815018+0000","last_change":"2023-10-14T18:54:33.815018+0000","last_active":"2023-10-14T18:54:33.815018+0000","last_peered":"2023-10-14T18:54:33.815018+0000","last_clean":"2023-10-14T18:54:33.815018+0000","last_became_active":"2023-10-14T18:54:33.814372+0000","last_became_peered":"2023-10-14T18:54:33.814372+0000","last_unstale":"2023-10-14T18:54:33.815018+0000","last_undegraded":"2023-10-14T18:54:33.815018+0000","last_fullsized":"2023-10-14T18:54:33.815018+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:47.736952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809334+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816693+0000","last_change":"2023-10-14T18:54:33.816693+0000","last_active":"2023-10-14T18:54:33.816693+0000","last_peered":"2023-10-14T18:54:33.816693+0000","last_clean":"2023-10-14T18:54:33.816693+0000","last_became_active":"2023-10-14T18:54:33.816478+0000","last_became_peered":"2023-10-14T18:54:33.816478+0000","last_unstale":"2023-10-14T18:54:33.816693+0000","last_undegraded":"2023-10-14T18:54:33.816693+0000","last_fullsized":"2023-10-14T18:54:33.816693+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:35.539138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806908+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818725+0000","last_change":"2023-10-14T18:54:33.818725+0000","last_active":"2023-10-14T18:54:33.818725+0000","last_peered":"2023-10-14T18:54:33.818725+0000","last_clean":"2023-10-14T18:54:33.818725+0000","last_became_active":"2023-10-14T18:54:33.818408+0000","last_became_peered":"2023-10-14T18:54:33.818408+0000","last_unstale":"2023-10-14T18:54:33.818725+0000","last_undegraded":"2023-10-14T18:54:33.818725+0000","last_fullsized":"2023-10-14T18:54:33.818725+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806413+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:41.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818960+0000","last_change":"2023-10-14T18:54:33.818960+0000","last_active":"2023-10-14T18:54:33.818960+0000","last_peered":"2023-10-14T18:54:33.818960+0000","last_clean":"2023-10-14T18:54:33.818960+0000","last_became_active":"2023-10-14T18:54:33.815975+0000","last_became_peered":"2023-10-14T18:54:33.815975+0000","last_unstale":"2023-10-14T18:54:33.818960+0000","last_undegraded":"2023-10-14T18:54:33.818960+0000","last_fullsized":"2023-10-14T18:54:33.818960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809010+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811124+0000","last_change":"2023-10-14T18:54:33.811124+0000","last_active":"2023-10-14T18:54:33.811124+0000","last_peered":"2023-10-14T18:54:33.811124+0000","last_clean":"2023-10-14T18:54:33.811124+0000","last_became_active":"2023-10-14T18:54:33.810900+0000","last_became_peered":"2023-10-14T18:54:33.810900+0000","last_unstale":"2023-10-14T18:54:33.811124+0000","last_undegraded":"2023-10-14T18:54:33.811124+0000","last_fullsized":"2023-10-14T18:54:33.811124+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:06.386916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809248+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813164+0000","last_change":"2023-10-14T18:54:33.813164+0000","last_active":"2023-10-14T18:54:33.813164+0000","last_peered":"2023-10-14T18:54:33.813164+0000","last_clean":"2023-10-14T18:54:33.813164+0000","last_became_active":"2023-10-14T18:54:33.812945+0000","last_became_peered":"2023-10-14T18:54:33.812945+0000","last_unstale":"2023-10-14T18:54:33.813164+0000","last_undegraded":"2023-10-14T18:54:33.813164+0000","last_fullsized":"2023-10-14T18:54:33.813164+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:35.760324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812541+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813316+0000","last_change":"2023-10-14T18:54:33.813316+0000","last_active":"2023-10-14T18:54:33.813316+0000","last_peered":"2023-10-14T18:54:33.813316+0000","last_clean":"2023-10-14T18:54:33.813316+0000","last_became_active":"2023-10-14T18:54:33.813103+0000","last_became_peered":"2023-10-14T18:54:33.813103+0000","last_unstale":"2023-10-14T18:54:33.813316+0000","last_undegraded":"2023-10-14T18:54:33.813316+0000","last_fullsized":"2023-10-14T18:54:33.813316+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:00.825491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809573+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:17.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818566+0000","last_change":"2023-10-14T18:54:33.818566+0000","last_active":"2023-10-14T18:54:33.818566+0000","last_peered":"2023-10-14T18:54:33.818566+0000","last_clean":"2023-10-14T18:54:33.818566+0000","last_became_active":"2023-10-14T18:54:33.817872+0000","last_became_peered":"2023-10-14T18:54:33.817872+0000","last_unstale":"2023-10-14T18:54:33.818566+0000","last_undegraded":"2023-10-14T18:54:33.818566+0000","last_fullsized":"2023-10-14T18:54:33.818566+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:56.783121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808699+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815623+0000","last_change":"2023-10-14T18:54:33.815623+0000","last_active":"2023-10-14T18:54:33.815623+0000","last_peered":"2023-10-14T18:54:33.815623+0000","last_clean":"2023-10-14T18:54:33.815623+0000","last_became_active":"2023-10-14T18:54:33.814905+0000","last_became_peered":"2023-10-14T18:54:33.814905+0000","last_unstale":"2023-10-14T18:54:33.815623+0000","last_undegraded":"2023-10-14T18:54:33.815623+0000","last_fullsized":"2023-10-14T18:54:33.815623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:27.698820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806465+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:55.267477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813724+0000","last_change":"2023-10-14T18:54:33.813724+0000","last_active":"2023-10-14T18:54:33.813724+0000","last_peered":"2023-10-14T18:54:33.813724+0000","last_clean":"2023-10-14T18:54:33.813724+0000","last_became_active":"2023-10-14T18:54:33.813499+0000","last_became_peered":"2023-10-14T18:54:33.813499+0000","last_unstale":"2023-10-14T18:54:33.813724+0000","last_undegraded":"2023-10-14T18:54:33.813724+0000","last_fullsized":"2023-10-14T18:54:33.813724+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:50.648829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808200+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:31:42.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811859+0000","last_change":"2023-10-14T18:54:33.811859+0000","last_active":"2023-10-14T18:54:33.811859+0000","last_peered":"2023-10-14T18:54:33.811859+0000","last_clean":"2023-10-14T18:54:33.811859+0000","last_became_active":"2023-10-14T18:54:33.811644+0000","last_became_peered":"2023-10-14T18:54:33.811644+0000","last_unstale":"2023-10-14T18:54:33.811859+0000","last_undegraded":"2023-10-14T18:54:33.811859+0000","last_fullsized":"2023-10-14T18:54:33.811859+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:05.856792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.813161+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815687+0000","last_change":"2023-10-14T18:54:33.815687+0000","last_active":"2023-10-14T18:54:33.815687+0000","last_peered":"2023-10-14T18:54:33.815687+0000","last_clean":"2023-10-14T18:54:33.815687+0000","last_became_active":"2023-10-14T18:54:33.815462+0000","last_became_peered":"2023-10-14T18:54:33.815462+0000","last_unstale":"2023-10-14T18:54:33.815687+0000","last_undegraded":"2023-10-14T18:54:33.815687+0000","last_fullsized":"2023-10-14T18:54:33.815687+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812191+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813862+0000","last_change":"2023-10-14T18:54:33.813862+0000","last_active":"2023-10-14T18:54:33.813862+0000","last_peered":"2023-10-14T18:54:33.813862+0000","last_clean":"2023-10-14T18:54:33.813862+0000","last_became_active":"2023-10-14T18:54:33.813581+0000","last_became_peered":"2023-10-14T18:54:33.813581+0000","last_unstale":"2023-10-14T18:54:33.813862+0000","last_undegraded":"2023-10-14T18:54:33.813862+0000","last_fullsized":"2023-10-14T18:54:33.813862+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:21.164749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810027+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:31.514560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.808956+0000","last_change":"2023-10-14T18:54:33.808956+0000","last_active":"2023-10-14T18:54:33.808956+0000","last_peered":"2023-10-14T18:54:33.808956+0000","last_clean":"2023-10-14T18:54:33.808956+0000","last_became_active":"2023-10-14T18:54:33.808721+0000","last_became_peered":"2023-10-14T18:54:33.808721+0000","last_unstale":"2023-10-14T18:54:33.808956+0000","last_undegraded":"2023-10-14T18:54:33.808956+0000","last_fullsized":"2023-10-14T18:54:33.808956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809659+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.812573+0000","last_change":"2023-10-14T18:54:33.812573+0000","last_active":"2023-10-14T18:54:33.812573+0000","last_peered":"2023-10-14T18:54:33.812573+0000","last_clean":"2023-10-14T18:54:33.812573+0000","last_became_active":"2023-10-14T18:54:33.812353+0000","last_became_peered":"2023-10-14T18:54:33.812353+0000","last_unstale":"2023-10-14T18:54:33.812573+0000","last_undegraded":"2023-10-14T18:54:33.812573+0000","last_fullsized":"2023-10-14T18:54:33.812573+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:08.408570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.805949+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:08.819947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813960+0000","last_change":"2023-10-14T18:54:33.813960+0000","last_active":"2023-10-14T18:54:33.813960+0000","last_peered":"2023-10-14T18:54:33.813960+0000","last_clean":"2023-10-14T18:54:33.813960+0000","last_became_active":"2023-10-14T18:54:33.813642+0000","last_became_peered":"2023-10-14T18:54:33.813642+0000","last_unstale":"2023-10-14T18:54:33.813960+0000","last_undegraded":"2023-10-14T18:54:33.813960+0000","last_fullsized":"2023-10-14T18:54:33.813960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:44.476782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807931+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:31.619631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817888+0000","last_change":"2023-10-14T18:54:33.817888+0000","last_active":"2023-10-14T18:54:33.817888+0000","last_peered":"2023-10-14T18:54:33.817888+0000","last_clean":"2023-10-14T18:54:33.817888+0000","last_became_active":"2023-10-14T18:54:33.817743+0000","last_became_peered":"2023-10-14T18:54:33.817743+0000","last_unstale":"2023-10-14T18:54:33.817888+0000","last_undegraded":"2023-10-14T18:54:33.817888+0000","last_fullsized":"2023-10-14T18:54:33.817888+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:55.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809259+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811109+0000","last_change":"2023-10-14T18:54:33.811109+0000","last_active":"2023-10-14T18:54:33.811109+0000","last_peered":"2023-10-14T18:54:33.811109+0000","last_clean":"2023-10-14T18:54:33.811109+0000","last_became_active":"2023-10-14T18:54:33.810880+0000","last_became_peered":"2023-10-14T18:54:33.810880+0000","last_unstale":"2023-10-14T18:54:33.811109+0000","last_undegraded":"2023-10-14T18:54:33.811109+0000","last_fullsized":"2023-10-14T18:54:33.811109+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:08:32.791772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813126+0000","last_change":"2023-10-14T18:54:33.813126+0000","last_active":"2023-10-14T18:54:33.813126+0000","last_peered":"2023-10-14T18:54:33.813126+0000","last_clean":"2023-10-14T18:54:33.813126+0000","last_became_active":"2023-10-14T18:54:33.812885+0000","last_became_peered":"2023-10-14T18:54:33.812885+0000","last_unstale":"2023-10-14T18:54:33.813126+0000","last_undegraded":"2023-10-14T18:54:33.813126+0000","last_fullsized":"2023-10-14T18:54:33.813126+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:48.469403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809789+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815576+0000","last_change":"2023-10-14T18:54:33.815576+0000","last_active":"2023-10-14T18:54:33.815576+0000","last_peered":"2023-10-14T18:54:33.815576+0000","last_clean":"2023-10-14T18:54:33.815576+0000","last_became_active":"2023-10-14T18:54:33.815121+0000","last_became_peered":"2023-10-14T18:54:33.815121+0000","last_unstale":"2023-10-14T18:54:33.815576+0000","last_undegraded":"2023-10-14T18:54:33.815576+0000","last_fullsized":"2023-10-14T18:54:33.815576+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:01.266764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807520+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:37.534567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814620+0000","last_change":"2023-10-14T18:54:33.814620+0000","last_active":"2023-10-14T18:54:33.814620+0000","last_peered":"2023-10-14T18:54:33.814620+0000","last_clean":"2023-10-14T18:54:33.814620+0000","last_became_active":"2023-10-14T18:54:33.813789+0000","last_became_peered":"2023-10-14T18:54:33.813789+0000","last_unstale":"2023-10-14T18:54:33.814620+0000","last_undegraded":"2023-10-14T18:54:33.814620+0000","last_fullsized":"2023-10-14T18:54:33.814620+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:49.662749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815898+0000","last_change":"2023-10-14T18:54:33.815898+0000","last_active":"2023-10-14T18:54:33.815898+0000","last_peered":"2023-10-14T18:54:33.815898+0000","last_clean":"2023-10-14T18:54:33.815898+0000","last_became_active":"2023-10-14T18:54:33.815474+0000","last_became_peered":"2023-10-14T18:54:33.815474+0000","last_unstale":"2023-10-14T18:54:33.815898+0000","last_undegraded":"2023-10-14T18:54:33.815898+0000","last_fullsized":"2023-10-14T18:54:33.815898+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:47.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806833+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817866+0000","last_change":"2023-10-14T18:54:33.817866+0000","last_active":"2023-10-14T18:54:33.817866+0000","last_peered":"2023-10-14T18:54:33.817866+0000","last_clean":"2023-10-14T18:54:33.817866+0000","last_became_active":"2023-10-14T18:54:33.817633+0000","last_became_peered":"2023-10-14T18:54:33.817633+0000","last_unstale":"2023-10-14T18:54:33.817866+0000","last_undegraded":"2023-10-14T18:54:33.817866+0000","last_fullsized":"2023-10-14T18:54:33.817866+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809712+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:34.743138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817044+0000","last_change":"2023-10-14T18:54:33.817044+0000","last_active":"2023-10-14T18:54:33.817044+0000","last_peered":"2023-10-14T18:54:33.817044+0000","last_clean":"2023-10-14T18:54:33.817044+0000","last_became_active":"2023-10-14T18:54:33.816432+0000","last_became_peered":"2023-10-14T18:54:33.816432+0000","last_unstale":"2023-10-14T18:54:33.817044+0000","last_undegraded":"2023-10-14T18:54:33.817044+0000","last_fullsized":"2023-10-14T18:54:33.817044+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:50.021088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813491+0000","last_change":"2023-10-14T18:54:33.813491+0000","last_active":"2023-10-14T18:54:33.813491+0000","last_peered":"2023-10-14T18:54:33.813491+0000","last_clean":"2023-10-14T18:54:33.813491+0000","last_became_active":"2023-10-14T18:54:33.813100+0000","last_became_peered":"2023-10-14T18:54:33.813100+0000","last_unstale":"2023-10-14T18:54:33.813491+0000","last_undegraded":"2023-10-14T18:54:33.813491+0000","last_fullsized":"2023-10-14T18:54:33.813491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:56.431653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811815+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813458+0000","last_change":"2023-10-14T18:54:33.813458+0000","last_active":"2023-10-14T18:54:33.813458+0000","last_peered":"2023-10-14T18:54:33.813458+0000","last_clean":"2023-10-14T18:54:33.813458+0000","last_became_active":"2023-10-14T18:54:33.812995+0000","last_became_peered":"2023-10-14T18:54:33.812995+0000","last_unstale":"2023-10-14T18:54:33.813458+0000","last_undegraded":"2023-10-14T18:54:33.813458+0000","last_fullsized":"2023-10-14T18:54:33.813458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813988+0000","last_change":"2023-10-14T18:54:33.813988+0000","last_active":"2023-10-14T18:54:33.813988+0000","last_peered":"2023-10-14T18:54:33.813988+0000","last_clean":"2023-10-14T18:54:33.813988+0000","last_became_active":"2023-10-14T18:54:33.813755+0000","last_became_peered":"2023-10-14T18:54:33.813755+0000","last_unstale":"2023-10-14T18:54:33.813988+0000","last_undegraded":"2023-10-14T18:54:33.813988+0000","last_fullsized":"2023-10-14T18:54:33.813988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806988+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:45.480991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.819035+0000","last_change":"2023-10-14T18:54:33.819035+0000","last_active":"2023-10-14T18:54:33.819035+0000","last_peered":"2023-10-14T18:54:33.819035+0000","last_clean":"2023-10-14T18:54:33.819035+0000","last_became_active":"2023-10-14T18:54:33.818860+0000","last_became_peered":"2023-10-14T18:54:33.818860+0000","last_unstale":"2023-10-14T18:54:33.819035+0000","last_undegraded":"2023-10-14T18:54:33.819035+0000","last_fullsized":"2023-10-14T18:54:33.819035+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:42.839183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809614+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:34.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817232+0000","last_change":"2023-10-14T18:54:33.817232+0000","last_active":"2023-10-14T18:54:33.817232+0000","last_peered":"2023-10-14T18:54:33.817232+0000","last_clean":"2023-10-14T18:54:33.817232+0000","last_became_active":"2023-10-14T18:54:33.816803+0000","last_became_peered":"2023-10-14T18:54:33.816803+0000","last_unstale":"2023-10-14T18:54:33.817232+0000","last_undegraded":"2023-10-14T18:54:33.817232+0000","last_fullsized":"2023-10-14T18:54:33.817232+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:46.527749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808222+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:36.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814813+0000","last_change":"2023-10-14T18:54:33.814813+0000","last_active":"2023-10-14T18:54:33.814813+0000","last_peered":"2023-10-14T18:54:33.814813+0000","last_clean":"2023-10-14T18:54:33.814813+0000","last_became_active":"2023-10-14T18:54:33.814615+0000","last_became_peered":"2023-10-14T18:54:33.814615+0000","last_unstale":"2023-10-14T18:54:33.814813+0000","last_undegraded":"2023-10-14T18:54:33.814813+0000","last_fullsized":"2023-10-14T18:54:33.814813+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809355+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:22.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816604+0000","last_change":"2023-10-14T18:54:33.816604+0000","last_active":"2023-10-14T18:54:33.816604+0000","last_peered":"2023-10-14T18:54:33.816604+0000","last_clean":"2023-10-14T18:54:33.816604+0000","last_became_active":"2023-10-14T18:54:33.816322+0000","last_became_peered":"2023-10-14T18:54:33.816322+0000","last_unstale":"2023-10-14T18:54:33.816604+0000","last_undegraded":"2023-10-14T18:54:33.816604+0000","last_fullsized":"2023-10-14T18:54:33.816604+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807605+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:55.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814399+0000","last_change":"2023-10-14T18:54:33.814399+0000","last_active":"2023-10-14T18:54:33.814399+0000","last_peered":"2023-10-14T18:54:33.814399+0000","last_clean":"2023-10-14T18:54:33.814399+0000","last_became_active":"2023-10-14T18:54:33.814128+0000","last_became_peered":"2023-10-14T18:54:33.814128+0000","last_unstale":"2023-10-14T18:54:33.814399+0000","last_undegraded":"2023-10-14T18:54:33.814399+0000","last_fullsized":"2023-10-14T18:54:33.814399+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":311,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T18:54:32.802514+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:54:32.802514+0000","last_peered":"2023-10-14T18:54:32.802514+0000","last_clean":"2023-10-14T18:54:32.802514+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:54:32.802514+0000","last_undegraded":"2023-10-14T18:54:32.802514+0000","last_fullsized":"2023-10-14T18:54:32.802514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.73699999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.45300000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60799999999999998,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.95699999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.73899999999999999,"5min":0.746,"15min":0.78800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.20899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.76300000000000001},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.439,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":3.4489999999999998},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.83599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.751},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.76800000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.626},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39200000000000002,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.89700000000000002},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":3.992,"15min":3.992},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26400000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53900000000000003,"5min":1.252,"15min":1.252},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.373}]},{"osd":3,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41799999999999998,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":1.3340000000000001,"15min":10.574},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.48899999999999999,"15min":0.41399999999999998},"min":{"1min":0.29199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":10.792,"15min":10.792},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64200000000000002,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.77000000000000002,"5min":3.536,"15min":3.536},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.504,"15min":1.504},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66100000000000003,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":1.288,"15min":1.288},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.64100000000000001},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":3.577,"15min":3.577},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198476299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.191,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.47499999999999998,"5min":0.55700000000000005,"15min":0.59599999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.25800000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.623},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.36199999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.64200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":1.0369999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.871,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36299999999999999,"15min":0.33600000000000002},"min":{"1min":0.26100000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.56799999999999995,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.315,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.34300000000000003,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.33100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60399999999999998,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.78200000000000003,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.52800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.79900000000000004,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.96699999999999997,"15min":0.96999999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.91300000000000003,"15min":1.0429999999999999},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.26800000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.34300000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.89300000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.375,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.34300000000000003},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80900000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.60599999999999998,"5min":0.70199999999999996,"15min":0.999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58499999999999996,"5min":0.75900000000000001,"15min":0.94999999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57599999999999996,"5min":0.747,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.77400000000000002,"15min":0.89300000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.67900000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.872},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.502}]},{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.433,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59499999999999997,"5min":0.74199999999999999,"15min":0.746},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.80500000000000005,"15min":0.81899999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44400000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:54:38.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:54:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.028+0000 7f0fbbf0d700 1 Processor -- start 2023-10-14T18:54:39.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.028+0000 7f0fbbf0d700 1 -- start start 2023-10-14T18:54:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fbbf0d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0fb4157870 0x7f0fb415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fbbf0d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157c40 0x7f0fb4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fbbf0d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb415cbb0 con 0x7f0fb415a620 2023-10-14T18:54:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fbbf0d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb415bfa0 con 0x7f0fb4157870 2023-10-14T18:54:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fbbf0d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb415c280 con 0x7f0fb4157c40 2023-10-14T18:54:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fb9ca9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0fb4157870 0x7f0fb415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fb94a8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0fb415a620 0x7f0fb415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52984/0 (socket says 172.21.15.79:52984) 2023-10-14T18:54:39.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.029+0000 7f0fb94a8700 1 -- 172.21.15.79:0/738137219 learned_addr learned my addr 172.21.15.79:0/738137219 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fba4aa700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157c40 0x7f0fb4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb9ca9700 1 -- 172.21.15.79:0/738137219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157c40 msgr2=0x7f0fb4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157c40 0x7f0fb4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb9ca9700 1 -- 172.21.15.79:0/738137219 >> v1:172.21.15.79:6789/0 conn(0x7f0fb415a620 legacy=0x7f0fb415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb9ca9700 1 -- 172.21.15.79:0/738137219 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb415c560 con 0x7f0fb4157870 2023-10-14T18:54:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb8ca7700 1 -- 172.21.15.79:0/738137219 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865788162 0 0) 0x7f0fb415cbb0 con 0x7f0fb415a620 2023-10-14T18:54:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb4157870 0x7f0fb415b6a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e60 tx=0x7f0fb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2690166a611f637e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb8ca7700 1 -- 172.21.15.79:0/738137219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000e070 con 0x7f0fb4157870 2023-10-14T18:54:39.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb8ca7700 1 -- 172.21.15.79:0/738137219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000bc30 con 0x7f0fb4157870 2023-10-14T18:54:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fb8ca7700 1 -- 172.21.15.79:0/738137219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0012430 con 0x7f0fb4157870 2023-10-14T18:54:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/738137219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb4157870 msgr2=0x7f0fb415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb4157870 0x7f0fb415b6a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e60 tx=0x7f0fb0009780 comp rx=0 tx=0).stop 2023-10-14T18:54:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.030+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/738137219 shutdown_connections 2023-10-14T18:54:39.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.031+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157c40 0x7f0fb4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.031+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/738137219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb4157870 0x7f0fb415b6a0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.031+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/738137219 >> 172.21.15.79:0/738137219 conn(0x7f0fb4068ce0 msgr2=0x7f0fb40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.031+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/738137219 shutdown_connections 2023-10-14T18:54:39.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.031+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/738137219 wait complete. 2023-10-14T18:54:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 Processor -- start 2023-10-14T18:54:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 -- start start 2023-10-14T18:54:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 0x7f0fb4152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fb4157c40 0x7f0fb414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb414d630 con 0x7f0fb415a620 2023-10-14T18:54:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb41526c0 con 0x7f0fb4157c40 2023-10-14T18:54:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.032+0000 7f0fbbf0d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb41534e0 con 0x7f0fb4157870 2023-10-14T18:54:39.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45078/0 (socket says 172.21.15.79:45078) 2023-10-14T18:54:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 -- 172.21.15.79:0/1879010093 learned_addr learned my addr 172.21.15.79:0/1879010093 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fb94a8700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fb4157c40 0x7f0fb414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 0x7f0fb4152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 -- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 msgr2=0x7f0fb4152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 0x7f0fb4152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 -- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fb4157c40 msgr2=0x7f0fb414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fb4157c40 0x7f0fb414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 -- 172.21.15.79:0/1879010093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009a20 con 0x7f0fb415a620 2023-10-14T18:54:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 0x7f0fb4152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fba4aa700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d890 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0125f0 con 0x7f0fb415a620 2023-10-14T18:54:39.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac012770 con 0x7f0fb415a620 2023-10-14T18:54:39.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb41528d0 con 0x7f0fb415a620 2023-10-14T18:54:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac012b30 con 0x7f0fb415a620 2023-10-14T18:54:39.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.033+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb4152c60 con 0x7f0fb415a620 2023-10-14T18:54:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.034+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb404c3c0 con 0x7f0fb415a620 2023-10-14T18:54:39.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.035+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fac01e460 con 0x7f0fb415a620 2023-10-14T18:54:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.035+0000 7f0fa9ffb700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.035+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fac084b00 con 0x7f0fb415a620 2023-10-14T18:54:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.035+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.036+0000 7f0fb9ca9700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 0x7f0f980693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e60 tx=0x7f0fb0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.039+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fac055800 con 0x7f0fb415a620 2023-10-14T18:54:39.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.216+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fb4153620 con 0x7f0f98066f30 2023-10-14T18:54:39.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.224+0000 7f0fa9ffb700 1 -- 172.21.15.79:0/1879010093 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283066 (secure 0 0 0) 0x7f0fb4153620 con 0x7f0f98066f30 2023-10-14T18:54:39.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:39.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 msgr2=0x7f0f980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 0x7f0f980693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009e60 tx=0x7f0fb0019000 comp rx=0 tx=0).stop 2023-10-14T18:54:39.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 msgr2=0x7f0fb4150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d890 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2023-10-14T18:54:39.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 shutdown_connections 2023-10-14T18:54:39.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0f98066f30 0x7f0f980693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0fb415a620 0x7f0fb4150050 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0fb4157870 0x7f0fb4152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 --2- 172.21.15.79:0/1879010093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fb4157c40 0x7f0fb414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 >> 172.21.15.79:0/1879010093 conn(0x7f0fb4068ce0 msgr2=0x7f0fb40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:39.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 shutdown_connections 2023-10-14T18:54:39.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.227+0000 7f0fbbf0d700 1 -- 172.21.15.79:0/1879010093 wait complete. 2023-10-14T18:54:39.234 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:54:39.240 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-14T18:54:38.472221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554072,"statfs":{"total":1600000000,"available":1591370575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672544"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809445+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808607+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809876+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811396+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808807+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:17.855758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809201+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809244+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808005+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:11.581850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808831+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807426+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:24:08.832890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810373+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:57.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811043+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807606+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:21.187441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808071+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:22.982244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806567+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:57.194498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809493+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809914+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807348+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:53.272239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807693+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:16.558714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811740+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809269+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808927+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:33.804334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806950+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:25.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808504+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807769+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:32.075044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807775+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:33.535803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809652+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.814870+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810408+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807423+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.010859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808571+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:11.467377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815018+0000","last_change":"2023-10-14T18:54:33.815018+0000","last_active":"2023-10-14T18:54:33.815018+0000","last_peered":"2023-10-14T18:54:33.815018+0000","last_clean":"2023-10-14T18:54:33.815018+0000","last_became_active":"2023-10-14T18:54:33.814372+0000","last_became_peered":"2023-10-14T18:54:33.814372+0000","last_unstale":"2023-10-14T18:54:33.815018+0000","last_undegraded":"2023-10-14T18:54:33.815018+0000","last_fullsized":"2023-10-14T18:54:33.815018+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:47.736952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809334+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816693+0000","last_change":"2023-10-14T18:54:33.816693+0000","last_active":"2023-10-14T18:54:33.816693+0000","last_peered":"2023-10-14T18:54:33.816693+0000","last_clean":"2023-10-14T18:54:33.816693+0000","last_became_active":"2023-10-14T18:54:33.816478+0000","last_became_peered":"2023-10-14T18:54:33.816478+0000","last_unstale":"2023-10-14T18:54:33.816693+0000","last_undegraded":"2023-10-14T18:54:33.816693+0000","last_fullsized":"2023-10-14T18:54:33.816693+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:35.539138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806908+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818725+0000","last_change":"2023-10-14T18:54:33.818725+0000","last_active":"2023-10-14T18:54:33.818725+0000","last_peered":"2023-10-14T18:54:33.818725+0000","last_clean":"2023-10-14T18:54:33.818725+0000","last_became_active":"2023-10-14T18:54:33.818408+0000","last_became_peered":"2023-10-14T18:54:33.818408+0000","last_unstale":"2023-10-14T18:54:33.818725+0000","last_undegraded":"2023-10-14T18:54:33.818725+0000","last_fullsized":"2023-10-14T18:54:33.818725+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806413+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:41.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818960+0000","last_change":"2023-10-14T18:54:33.818960+0000","last_active":"2023-10-14T18:54:33.818960+0000","last_peered":"2023-10-14T18:54:33.818960+0000","last_clean":"2023-10-14T18:54:33.818960+0000","last_became_active":"2023-10-14T18:54:33.815975+0000","last_became_peered":"2023-10-14T18:54:33.815975+0000","last_unstale":"2023-10-14T18:54:33.818960+0000","last_undegraded":"2023-10-14T18:54:33.818960+0000","last_fullsized":"2023-10-14T18:54:33.818960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809010+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811124+0000","last_change":"2023-10-14T18:54:33.811124+0000","last_active":"2023-10-14T18:54:33.811124+0000","last_peered":"2023-10-14T18:54:33.811124+0000","last_clean":"2023-10-14T18:54:33.811124+0000","last_became_active":"2023-10-14T18:54:33.810900+0000","last_became_peered":"2023-10-14T18:54:33.810900+0000","last_unstale":"2023-10-14T18:54:33.811124+0000","last_undegraded":"2023-10-14T18:54:33.811124+0000","last_fullsized":"2023-10-14T18:54:33.811124+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:06.386916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809248+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813164+0000","last_change":"2023-10-14T18:54:33.813164+0000","last_active":"2023-10-14T18:54:33.813164+0000","last_peered":"2023-10-14T18:54:33.813164+0000","last_clean":"2023-10-14T18:54:33.813164+0000","last_became_active":"2023-10-14T18:54:33.812945+0000","last_became_peered":"2023-10-14T18:54:33.812945+0000","last_unstale":"2023-10-14T18:54:33.813164+0000","last_undegraded":"2023-10-14T18:54:33.813164+0000","last_fullsized":"2023-10-14T18:54:33.813164+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:35.760324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812541+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813316+0000","last_change":"2023-10-14T18:54:33.813316+0000","last_active":"2023-10-14T18:54:33.813316+0000","last_peered":"2023-10-14T18:54:33.813316+0000","last_clean":"2023-10-14T18:54:33.813316+0000","last_became_active":"2023-10-14T18:54:33.813103+0000","last_became_peered":"2023-10-14T18:54:33.813103+0000","last_unstale":"2023-10-14T18:54:33.813316+0000","last_undegraded":"2023-10-14T18:54:33.813316+0000","last_fullsized":"2023-10-14T18:54:33.813316+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:00.825491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809573+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:17.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818566+0000","last_change":"2023-10-14T18:54:33.818566+0000","last_active":"2023-10-14T18:54:33.818566+0000","last_peered":"2023-10-14T18:54:33.818566+0000","last_clean":"2023-10-14T18:54:33.818566+0000","last_became_active":"2023-10-14T18:54:33.817872+0000","last_became_peered":"2023-10-14T18:54:33.817872+0000","last_unstale":"2023-10-14T18:54:33.818566+0000","last_undegraded":"2023-10-14T18:54:33.818566+0000","last_fullsized":"2023-10-14T18:54:33.818566+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:56.783121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808699+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815623+0000","last_change":"2023-10-14T18:54:33.815623+0000","last_active":"2023-10-14T18:54:33.815623+0000","last_peered":"2023-10-14T18:54:33.815623+0000","last_clean":"2023-10-14T18:54:33.815623+0000","last_became_active":"2023-10-14T18:54:33.814905+0000","last_became_peered":"2023-10-14T18:54:33.814905+0000","last_unstale":"2023-10-14T18:54:33.815623+0000","last_undegraded":"2023-10-14T18:54:33.815623+0000","last_fullsized":"2023-10-14T18:54:33.815623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:27.698820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806465+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:55.267477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813724+0000","last_change":"2023-10-14T18:54:33.813724+0000","last_active":"2023-10-14T18:54:33.813724+0000","last_peered":"2023-10-14T18:54:33.813724+0000","last_clean":"2023-10-14T18:54:33.813724+0000","last_became_active":"2023-10-14T18:54:33.813499+0000","last_became_peered":"2023-10-14T18:54:33.813499+0000","last_unstale":"2023-10-14T18:54:33.813724+0000","last_undegraded":"2023-10-14T18:54:33.813724+0000","last_fullsized":"2023-10-14T18:54:33.813724+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:50.648829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808200+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:31:42.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811859+0000","last_change":"2023-10-14T18:54:33.811859+0000","last_active":"2023-10-14T18:54:33.811859+0000","last_peered":"2023-10-14T18:54:33.811859+0000","last_clean":"2023-10-14T18:54:33.811859+0000","last_became_active":"2023-10-14T18:54:33.811644+0000","last_became_peered":"2023-10-14T18:54:33.811644+0000","last_unstale":"2023-10-14T18:54:33.811859+0000","last_undegraded":"2023-10-14T18:54:33.811859+0000","last_fullsized":"2023-10-14T18:54:33.811859+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:05.856792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.813161+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815687+0000","last_change":"2023-10-14T18:54:33.815687+0000","last_active":"2023-10-14T18:54:33.815687+0000","last_peered":"2023-10-14T18:54:33.815687+0000","last_clean":"2023-10-14T18:54:33.815687+0000","last_became_active":"2023-10-14T18:54:33.815462+0000","last_became_peered":"2023-10-14T18:54:33.815462+0000","last_unstale":"2023-10-14T18:54:33.815687+0000","last_undegraded":"2023-10-14T18:54:33.815687+0000","last_fullsized":"2023-10-14T18:54:33.815687+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812191+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813862+0000","last_change":"2023-10-14T18:54:33.813862+0000","last_active":"2023-10-14T18:54:33.813862+0000","last_peered":"2023-10-14T18:54:33.813862+0000","last_clean":"2023-10-14T18:54:33.813862+0000","last_became_active":"2023-10-14T18:54:33.813581+0000","last_became_peered":"2023-10-14T18:54:33.813581+0000","last_unstale":"2023-10-14T18:54:33.813862+0000","last_undegraded":"2023-10-14T18:54:33.813862+0000","last_fullsized":"2023-10-14T18:54:33.813862+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:21.164749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810027+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:31.514560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.808956+0000","last_change":"2023-10-14T18:54:33.808956+0000","last_active":"2023-10-14T18:54:33.808956+0000","last_peered":"2023-10-14T18:54:33.808956+0000","last_clean":"2023-10-14T18:54:33.808956+0000","last_became_active":"2023-10-14T18:54:33.808721+0000","last_became_peered":"2023-10-14T18:54:33.808721+0000","last_unstale":"2023-10-14T18:54:33.808956+0000","last_undegraded":"2023-10-14T18:54:33.808956+0000","last_fullsized":"2023-10-14T18:54:33.808956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809659+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.812573+0000","last_change":"2023-10-14T18:54:33.812573+0000","last_active":"2023-10-14T18:54:33.812573+0000","last_peered":"2023-10-14T18:54:33.812573+0000","last_clean":"2023-10-14T18:54:33.812573+0000","last_became_active":"2023-10-14T18:54:33.812353+0000","last_became_peered":"2023-10-14T18:54:33.812353+0000","last_unstale":"2023-10-14T18:54:33.812573+0000","last_undegraded":"2023-10-14T18:54:33.812573+0000","last_fullsized":"2023-10-14T18:54:33.812573+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:08.408570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.805949+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:08.819947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813960+0000","last_change":"2023-10-14T18:54:33.813960+0000","last_active":"2023-10-14T18:54:33.813960+0000","last_peered":"2023-10-14T18:54:33.813960+0000","last_clean":"2023-10-14T18:54:33.813960+0000","last_became_active":"2023-10-14T18:54:33.813642+0000","last_became_peered":"2023-10-14T18:54:33.813642+0000","last_unstale":"2023-10-14T18:54:33.813960+0000","last_undegraded":"2023-10-14T18:54:33.813960+0000","last_fullsized":"2023-10-14T18:54:33.813960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:44.476782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807931+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:31.619631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817888+0000","last_change":"2023-10-14T18:54:33.817888+0000","last_active":"2023-10-14T18:54:33.817888+0000","last_peered":"2023-10-14T18:54:33.817888+0000","last_clean":"2023-10-14T18:54:33.817888+0000","last_became_active":"2023-10-14T18:54:33.817743+0000","last_became_peered":"2023-10-14T18:54:33.817743+0000","last_unstale":"2023-10-14T18:54:33.817888+0000","last_undegraded":"2023-10-14T18:54:33.817888+0000","last_fullsized":"2023-10-14T18:54:33.817888+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:55.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809259+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811109+0000","last_change":"2023-10-14T18:54:33.811109+0000","last_active":"2023-10-14T18:54:33.811109+0000","last_peered":"2023-10-14T18:54:33.811109+0000","last_clean":"2023-10-14T18:54:33.811109+0000","last_became_active":"2023-10-14T18:54:33.810880+0000","last_became_peered":"2023-10-14T18:54:33.810880+0000","last_unstale":"2023-10-14T18:54:33.811109+0000","last_undegraded":"2023-10-14T18:54:33.811109+0000","last_fullsized":"2023-10-14T18:54:33.811109+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:08:32.791772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813126+0000","last_change":"2023-10-14T18:54:33.813126+0000","last_active":"2023-10-14T18:54:33.813126+0000","last_peered":"2023-10-14T18:54:33.813126+0000","last_clean":"2023-10-14T18:54:33.813126+0000","last_became_active":"2023-10-14T18:54:33.812885+0000","last_became_peered":"2023-10-14T18:54:33.812885+0000","last_unstale":"2023-10-14T18:54:33.813126+0000","last_undegraded":"2023-10-14T18:54:33.813126+0000","last_fullsized":"2023-10-14T18:54:33.813126+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:48.469403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809789+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815576+0000","last_change":"2023-10-14T18:54:33.815576+0000","last_active":"2023-10-14T18:54:33.815576+0000","last_peered":"2023-10-14T18:54:33.815576+0000","last_clean":"2023-10-14T18:54:33.815576+0000","last_became_active":"2023-10-14T18:54:33.815121+0000","last_became_peered":"2023-10-14T18:54:33.815121+0000","last_unstale":"2023-10-14T18:54:33.815576+0000","last_undegraded":"2023-10-14T18:54:33.815576+0000","last_fullsized":"2023-10-14T18:54:33.815576+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:01.266764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807520+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:37.534567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814620+0000","last_change":"2023-10-14T18:54:33.814620+0000","last_active":"2023-10-14T18:54:33.814620+0000","last_peered":"2023-10-14T18:54:33.814620+0000","last_clean":"2023-10-14T18:54:33.814620+0000","last_became_active":"2023-10-14T18:54:33.813789+0000","last_became_peered":"2023-10-14T18:54:33.813789+0000","last_unstale":"2023-10-14T18:54:33.814620+0000","last_undegraded":"2023-10-14T18:54:33.814620+0000","last_fullsized":"2023-10-14T18:54:33.814620+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:49.662749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815898+0000","last_change":"2023-10-14T18:54:33.815898+0000","last_active":"2023-10-14T18:54:33.815898+0000","last_peered":"2023-10-14T18:54:33.815898+0000","last_clean":"2023-10-14T18:54:33.815898+0000","last_became_active":"2023-10-14T18:54:33.815474+0000","last_became_peered":"2023-10-14T18:54:33.815474+0000","last_unstale":"2023-10-14T18:54:33.815898+0000","last_undegraded":"2023-10-14T18:54:33.815898+0000","last_fullsized":"2023-10-14T18:54:33.815898+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:47.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806833+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817866+0000","last_change":"2023-10-14T18:54:33.817866+0000","last_active":"2023-10-14T18:54:33.817866+0000","last_peered":"2023-10-14T18:54:33.817866+0000","last_clean":"2023-10-14T18:54:33.817866+0000","last_became_active":"2023-10-14T18:54:33.817633+0000","last_became_peered":"2023-10-14T18:54:33.817633+0000","last_unstale":"2023-10-14T18:54:33.817866+0000","last_undegraded":"2023-10-14T18:54:33.817866+0000","last_fullsized":"2023-10-14T18:54:33.817866+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809712+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:34.743138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817044+0000","last_change":"2023-10-14T18:54:33.817044+0000","last_active":"2023-10-14T18:54:33.817044+0000","last_peered":"2023-10-14T18:54:33.817044+0000","last_clean":"2023-10-14T18:54:33.817044+0000","last_became_active":"2023-10-14T18:54:33.816432+0000","last_became_peered":"2023-10-14T18:54:33.816432+0000","last_unstale":"2023-10-14T18:54:33.817044+0000","last_undegraded":"2023-10-14T18:54:33.817044+0000","last_fullsized":"2023-10-14T18:54:33.817044+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:50.021088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813491+0000","last_change":"2023-10-14T18:54:33.813491+0000","last_active":"2023-10-14T18:54:33.813491+0000","last_peered":"2023-10-14T18:54:33.813491+0000","last_clean":"2023-10-14T18:54:33.813491+0000","last_became_active":"2023-10-14T18:54:33.813100+0000","last_became_peered":"2023-10-14T18:54:33.813100+0000","last_unstale":"2023-10-14T18:54:33.813491+0000","last_undegraded":"2023-10-14T18:54:33.813491+0000","last_fullsized":"2023-10-14T18:54:33.813491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:56.431653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811815+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813458+0000","last_change":"2023-10-14T18:54:33.813458+0000","last_active":"2023-10-14T18:54:33.813458+0000","last_peered":"2023-10-14T18:54:33.813458+0000","last_clean":"2023-10-14T18:54:33.813458+0000","last_became_active":"2023-10-14T18:54:33.812995+0000","last_became_peered":"2023-10-14T18:54:33.812995+0000","last_unstale":"2023-10-14T18:54:33.813458+0000","last_undegraded":"2023-10-14T18:54:33.813458+0000","last_fullsized":"2023-10-14T18:54:33.813458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813988+0000","last_change":"2023-10-14T18:54:33.813988+0000","last_active":"2023-10-14T18:54:33.813988+0000","last_peered":"2023-10-14T18:54:33.813988+0000","last_clean":"2023-10-14T18:54:33.813988+0000","last_became_active":"2023-10-14T18:54:33.813755+0000","last_became_peered":"2023-10-14T18:54:33.813755+0000","last_unstale":"2023-10-14T18:54:33.813988+0000","last_undegraded":"2023-10-14T18:54:33.813988+0000","last_fullsized":"2023-10-14T18:54:33.813988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806988+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:45.480991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.819035+0000","last_change":"2023-10-14T18:54:33.819035+0000","last_active":"2023-10-14T18:54:33.819035+0000","last_peered":"2023-10-14T18:54:33.819035+0000","last_clean":"2023-10-14T18:54:33.819035+0000","last_became_active":"2023-10-14T18:54:33.818860+0000","last_became_peered":"2023-10-14T18:54:33.818860+0000","last_unstale":"2023-10-14T18:54:33.819035+0000","last_undegraded":"2023-10-14T18:54:33.819035+0000","last_fullsized":"2023-10-14T18:54:33.819035+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:42.839183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809614+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:34.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817232+0000","last_change":"2023-10-14T18:54:33.817232+0000","last_active":"2023-10-14T18:54:33.817232+0000","last_peered":"2023-10-14T18:54:33.817232+0000","last_clean":"2023-10-14T18:54:33.817232+0000","last_became_active":"2023-10-14T18:54:33.816803+0000","last_became_peered":"2023-10-14T18:54:33.816803+0000","last_unstale":"2023-10-14T18:54:33.817232+0000","last_undegraded":"2023-10-14T18:54:33.817232+0000","last_fullsized":"2023-10-14T18:54:33.817232+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:46.527749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808222+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:36.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814813+0000","last_change":"2023-10-14T18:54:33.814813+0000","last_active":"2023-10-14T18:54:33.814813+0000","last_peered":"2023-10-14T18:54:33.814813+0000","last_clean":"2023-10-14T18:54:33.814813+0000","last_became_active":"2023-10-14T18:54:33.814615+0000","last_became_peered":"2023-10-14T18:54:33.814615+0000","last_unstale":"2023-10-14T18:54:33.814813+0000","last_undegraded":"2023-10-14T18:54:33.814813+0000","last_fullsized":"2023-10-14T18:54:33.814813+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809355+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:22.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816604+0000","last_change":"2023-10-14T18:54:33.816604+0000","last_active":"2023-10-14T18:54:33.816604+0000","last_peered":"2023-10-14T18:54:33.816604+0000","last_clean":"2023-10-14T18:54:33.816604+0000","last_became_active":"2023-10-14T18:54:33.816322+0000","last_became_peered":"2023-10-14T18:54:33.816322+0000","last_unstale":"2023-10-14T18:54:33.816604+0000","last_undegraded":"2023-10-14T18:54:33.816604+0000","last_fullsized":"2023-10-14T18:54:33.816604+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807605+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:55.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814399+0000","last_change":"2023-10-14T18:54:33.814399+0000","last_active":"2023-10-14T18:54:33.814399+0000","last_peered":"2023-10-14T18:54:33.814399+0000","last_clean":"2023-10-14T18:54:33.814399+0000","last_became_active":"2023-10-14T18:54:33.814128+0000","last_became_peered":"2023-10-14T18:54:33.814128+0000","last_unstale":"2023-10-14T18:54:33.814399+0000","last_undegraded":"2023-10-14T18:54:33.814399+0000","last_fullsized":"2023-10-14T18:54:33.814399+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":311,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T18:54:32.802514+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:54:32.802514+0000","last_peered":"2023-10-14T18:54:32.802514+0000","last_clean":"2023-10-14T18:54:32.802514+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:54:32.802514+0000","last_undegraded":"2023-10-14T18:54:32.802514+0000","last_fullsized":"2023-10-14T18:54:32.802514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.73699999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.45300000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60799999999999998,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.95699999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.73899999999999999,"5min":0.746,"15min":0.78800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.20899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.76300000000000001},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.439,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":3.4489999999999998},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.83599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.751},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.76800000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.626},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39200000000000002,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.89700000000000002},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":3.992,"15min":3.992},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26400000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53900000000000003,"5min":1.252,"15min":1.252},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.373}]},{"osd":3,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41799999999999998,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":1.3340000000000001,"15min":10.574},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.48899999999999999,"15min":0.41399999999999998},"min":{"1min":0.29199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":10.792,"15min":10.792},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64200000000000002,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.77000000000000002,"5min":3.536,"15min":3.536},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.504,"15min":1.504},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66100000000000003,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":1.288,"15min":1.288},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.64100000000000001},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":3.577,"15min":3.577},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198476299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.191,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.47499999999999998,"5min":0.55700000000000005,"15min":0.59599999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.25800000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.623},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.36199999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.64200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":1.0369999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.871,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36299999999999999,"15min":0.33600000000000002},"min":{"1min":0.26100000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.56799999999999995,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.315,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.34300000000000003,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.33100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60399999999999998,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.78200000000000003,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.52800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.79900000000000004,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.96699999999999997,"15min":0.96999999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.91300000000000003,"15min":1.0429999999999999},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.26800000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.34300000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.89300000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.375,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.34300000000000003},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80900000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.60599999999999998,"5min":0.70199999999999996,"15min":0.999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58499999999999996,"5min":0.75900000000000001,"15min":0.94999999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57599999999999996,"5min":0.747,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.77400000000000002,"15min":0.89300000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.67900000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.872},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.502}]},{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.433,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59499999999999997,"5min":0.74199999999999999,"15min":0.746},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.80500000000000005,"15min":0.81899999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44400000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:54:39.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:54:39.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.394+0000 7f6782fe8700 1 Processor -- start 2023-10-14T18:54:39.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.394+0000 7f6782fe8700 1 -- start start 2023-10-14T18:54:39.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6782fe8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f677c15a620 0x7f677c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6782fe8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 0x7f677c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6782fe8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c15cbb0 con 0x7f677c157870 2023-10-14T18:54:39.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6782fe8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c15bdb0 con 0x7f677c15a620 2023-10-14T18:54:39.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6782fe8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c15bfa0 con 0x7f677c15d580 2023-10-14T18:54:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6781585700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 0x7f677c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6773fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f677c15a620 0x7f677c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6780d84700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f677c157870 0x7f677c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:35500/0 (socket says 172.21.15.79:35500) 2023-10-14T18:54:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.395+0000 7f6780d84700 1 -- 172.21.15.79:0/2661695223 learned_addr learned my addr 172.21.15.79:0/2661695223 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:39.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6773fff700 1 -- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 msgr2=0x7f677c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6773fff700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 0x7f677c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6773fff700 1 -- 172.21.15.79:0/2661695223 >> v1:172.21.15.144:6789/0 conn(0x7f677c157870 legacy=0x7f677c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6773fff700 1 -- 172.21.15.79:0/2661695223 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c15c280 con 0x7f677c15a620 2023-10-14T18:54:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6781585700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 0x7f677c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f6773fff700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c15d040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f676c0098e0 tx=0x7f676c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1425ab11196d7c3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f67737fe700 1 -- 172.21.15.79:0/2661695223 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00b640 con 0x7f677c15a620 2023-10-14T18:54:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f67737fe700 1 -- 172.21.15.79:0/2661695223 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00b7a0 con 0x7f677c15a620 2023-10-14T18:54:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.396+0000 7f67737fe700 1 -- 172.21.15.79:0/2661695223 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bb40 con 0x7f677c15a620 2023-10-14T18:54:39.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 -- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 msgr2=0x7f677c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c15d040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f676c0098e0 tx=0x7f676c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 -- 172.21.15.79:0/2661695223 shutdown_connections 2023-10-14T18:54:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c15d580 0x7f677c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2661695223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c15d040 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 -- 172.21.15.79:0/2661695223 >> 172.21.15.79:0/2661695223 conn(0x7f677c068ce0 msgr2=0x7f677c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 -- 172.21.15.79:0/2661695223 shutdown_connections 2023-10-14T18:54:39.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.397+0000 7f6782fe8700 1 -- 172.21.15.79:0/2661695223 wait complete. 2023-10-14T18:54:39.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.398+0000 7f6782fe8700 1 Processor -- start 2023-10-14T18:54:39.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.398+0000 7f6782fe8700 1 -- start start 2023-10-14T18:54:39.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c157870 0x7f677c16bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c16d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c16eb50 con 0x7f677c15d580 2023-10-14T18:54:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c16ee30 con 0x7f677c15a620 2023-10-14T18:54:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6782fe8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c1525a0 con 0x7f677c157870 2023-10-14T18:54:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45084/0 (socket says 172.21.15.79:45084) 2023-10-14T18:54:39.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 -- 172.21.15.79:0/2107586205 learned_addr learned my addr 172.21.15.79:0/2107586205 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:39.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6780d84700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c157870 0x7f677c16bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6773fff700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c16d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 -- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c157870 msgr2=0x7f677c16bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c157870 0x7f677c16bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 -- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 msgr2=0x7f677c16d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c16d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 -- 172.21.15.79:0/2107586205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774009a20 con 0x7f677c15d580 2023-10-14T18:54:39.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6781585700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6774009f50 tx=0x7f677400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400caf0 con 0x7f677c15d580 2023-10-14T18:54:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.399+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400f040 con 0x7f677c15d580 2023-10-14T18:54:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.400+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400ce80 con 0x7f677c15d580 2023-10-14T18:54:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.400+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c009420 con 0x7f677c15d580 2023-10-14T18:54:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.400+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c1522b0 con 0x7f677c15d580 2023-10-14T18:54:39.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.400+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c04c3c0 con 0x7f677c15d580 2023-10-14T18:54:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.401+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6774014690 con 0x7f677c15d580 2023-10-14T18:54:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.401+0000 7f6770ff9700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 0x7f67680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.401+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6774085160 con 0x7f677c15d580 2023-10-14T18:54:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.401+0000 7f6780d84700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 0x7f67680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.402+0000 7f6780d84700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 0x7f67680693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f6778009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.405+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67740523d0 con 0x7f677c15d580 2023-10-14T18:54:39.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.582+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f677c15c560 con 0x7f6768066f30 2023-10-14T18:54:39.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.590+0000 7f6770ff9700 1 -- 172.21.15.79:0/2107586205 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283066 (secure 0 0 0) 0x7f677c15c560 con 0x7f6768066f30 2023-10-14T18:54:39.594 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 msgr2=0x7f67680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 0x7f67680693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6778000c00 tx=0x7f6778009040 comp rx=0 tx=0).stop 2023-10-14T18:54:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 msgr2=0x7f677c16e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6774009f50 tx=0x7f677400b040 comp rx=0 tx=0).stop 2023-10-14T18:54:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 shutdown_connections 2023-10-14T18:54:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6768066f30 0x7f67680693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c15d580 0x7f677c16e100 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f677c157870 0x7f677c16bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 --2- 172.21.15.79:0/2107586205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f677c15a620 0x7f677c16d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 >> 172.21.15.79:0/2107586205 conn(0x7f677c068ce0 msgr2=0x7f677c0b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 shutdown_connections 2023-10-14T18:54:39.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.593+0000 7f6782fe8700 1 -- 172.21.15.79:0/2107586205 wait complete. 2023-10-14T18:54:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:54:39.606 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-14T18:54:38.472221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554072,"statfs":{"total":1600000000,"available":1591370575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672544"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809445+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808607+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809876+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811396+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808807+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:17.855758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809201+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809244+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808005+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:11.581850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808831+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807426+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:24:08.832890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810373+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:57.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811043+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807606+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:21.187441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808071+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:22.982244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806567+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:57.194498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809493+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809914+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807348+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:53.272239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807693+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:16.558714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811740+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809269+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808927+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:33.804334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806950+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:25.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808504+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807769+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:32.075044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807775+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:33.535803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809652+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.814870+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810408+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807423+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.010859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808571+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:11.467377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815018+0000","last_change":"2023-10-14T18:54:33.815018+0000","last_active":"2023-10-14T18:54:33.815018+0000","last_peered":"2023-10-14T18:54:33.815018+0000","last_clean":"2023-10-14T18:54:33.815018+0000","last_became_active":"2023-10-14T18:54:33.814372+0000","last_became_peered":"2023-10-14T18:54:33.814372+0000","last_unstale":"2023-10-14T18:54:33.815018+0000","last_undegraded":"2023-10-14T18:54:33.815018+0000","last_fullsized":"2023-10-14T18:54:33.815018+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:47.736952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809334+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816693+0000","last_change":"2023-10-14T18:54:33.816693+0000","last_active":"2023-10-14T18:54:33.816693+0000","last_peered":"2023-10-14T18:54:33.816693+0000","last_clean":"2023-10-14T18:54:33.816693+0000","last_became_active":"2023-10-14T18:54:33.816478+0000","last_became_peered":"2023-10-14T18:54:33.816478+0000","last_unstale":"2023-10-14T18:54:33.816693+0000","last_undegraded":"2023-10-14T18:54:33.816693+0000","last_fullsized":"2023-10-14T18:54:33.816693+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:35.539138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806908+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818725+0000","last_change":"2023-10-14T18:54:33.818725+0000","last_active":"2023-10-14T18:54:33.818725+0000","last_peered":"2023-10-14T18:54:33.818725+0000","last_clean":"2023-10-14T18:54:33.818725+0000","last_became_active":"2023-10-14T18:54:33.818408+0000","last_became_peered":"2023-10-14T18:54:33.818408+0000","last_unstale":"2023-10-14T18:54:33.818725+0000","last_undegraded":"2023-10-14T18:54:33.818725+0000","last_fullsized":"2023-10-14T18:54:33.818725+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806413+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:41.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818960+0000","last_change":"2023-10-14T18:54:33.818960+0000","last_active":"2023-10-14T18:54:33.818960+0000","last_peered":"2023-10-14T18:54:33.818960+0000","last_clean":"2023-10-14T18:54:33.818960+0000","last_became_active":"2023-10-14T18:54:33.815975+0000","last_became_peered":"2023-10-14T18:54:33.815975+0000","last_unstale":"2023-10-14T18:54:33.818960+0000","last_undegraded":"2023-10-14T18:54:33.818960+0000","last_fullsized":"2023-10-14T18:54:33.818960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809010+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811124+0000","last_change":"2023-10-14T18:54:33.811124+0000","last_active":"2023-10-14T18:54:33.811124+0000","last_peered":"2023-10-14T18:54:33.811124+0000","last_clean":"2023-10-14T18:54:33.811124+0000","last_became_active":"2023-10-14T18:54:33.810900+0000","last_became_peered":"2023-10-14T18:54:33.810900+0000","last_unstale":"2023-10-14T18:54:33.811124+0000","last_undegraded":"2023-10-14T18:54:33.811124+0000","last_fullsized":"2023-10-14T18:54:33.811124+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:06.386916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809248+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813164+0000","last_change":"2023-10-14T18:54:33.813164+0000","last_active":"2023-10-14T18:54:33.813164+0000","last_peered":"2023-10-14T18:54:33.813164+0000","last_clean":"2023-10-14T18:54:33.813164+0000","last_became_active":"2023-10-14T18:54:33.812945+0000","last_became_peered":"2023-10-14T18:54:33.812945+0000","last_unstale":"2023-10-14T18:54:33.813164+0000","last_undegraded":"2023-10-14T18:54:33.813164+0000","last_fullsized":"2023-10-14T18:54:33.813164+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:35.760324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812541+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813316+0000","last_change":"2023-10-14T18:54:33.813316+0000","last_active":"2023-10-14T18:54:33.813316+0000","last_peered":"2023-10-14T18:54:33.813316+0000","last_clean":"2023-10-14T18:54:33.813316+0000","last_became_active":"2023-10-14T18:54:33.813103+0000","last_became_peered":"2023-10-14T18:54:33.813103+0000","last_unstale":"2023-10-14T18:54:33.813316+0000","last_undegraded":"2023-10-14T18:54:33.813316+0000","last_fullsized":"2023-10-14T18:54:33.813316+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:00.825491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809573+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:17.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818566+0000","last_change":"2023-10-14T18:54:33.818566+0000","last_active":"2023-10-14T18:54:33.818566+0000","last_peered":"2023-10-14T18:54:33.818566+0000","last_clean":"2023-10-14T18:54:33.818566+0000","last_became_active":"2023-10-14T18:54:33.817872+0000","last_became_peered":"2023-10-14T18:54:33.817872+0000","last_unstale":"2023-10-14T18:54:33.818566+0000","last_undegraded":"2023-10-14T18:54:33.818566+0000","last_fullsized":"2023-10-14T18:54:33.818566+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:56.783121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808699+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815623+0000","last_change":"2023-10-14T18:54:33.815623+0000","last_active":"2023-10-14T18:54:33.815623+0000","last_peered":"2023-10-14T18:54:33.815623+0000","last_clean":"2023-10-14T18:54:33.815623+0000","last_became_active":"2023-10-14T18:54:33.814905+0000","last_became_peered":"2023-10-14T18:54:33.814905+0000","last_unstale":"2023-10-14T18:54:33.815623+0000","last_undegraded":"2023-10-14T18:54:33.815623+0000","last_fullsized":"2023-10-14T18:54:33.815623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:27.698820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806465+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:55.267477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813724+0000","last_change":"2023-10-14T18:54:33.813724+0000","last_active":"2023-10-14T18:54:33.813724+0000","last_peered":"2023-10-14T18:54:33.813724+0000","last_clean":"2023-10-14T18:54:33.813724+0000","last_became_active":"2023-10-14T18:54:33.813499+0000","last_became_peered":"2023-10-14T18:54:33.813499+0000","last_unstale":"2023-10-14T18:54:33.813724+0000","last_undegraded":"2023-10-14T18:54:33.813724+0000","last_fullsized":"2023-10-14T18:54:33.813724+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:50.648829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808200+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:31:42.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811859+0000","last_change":"2023-10-14T18:54:33.811859+0000","last_active":"2023-10-14T18:54:33.811859+0000","last_peered":"2023-10-14T18:54:33.811859+0000","last_clean":"2023-10-14T18:54:33.811859+0000","last_became_active":"2023-10-14T18:54:33.811644+0000","last_became_peered":"2023-10-14T18:54:33.811644+0000","last_unstale":"2023-10-14T18:54:33.811859+0000","last_undegraded":"2023-10-14T18:54:33.811859+0000","last_fullsized":"2023-10-14T18:54:33.811859+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:05.856792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.813161+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815687+0000","last_change":"2023-10-14T18:54:33.815687+0000","last_active":"2023-10-14T18:54:33.815687+0000","last_peered":"2023-10-14T18:54:33.815687+0000","last_clean":"2023-10-14T18:54:33.815687+0000","last_became_active":"2023-10-14T18:54:33.815462+0000","last_became_peered":"2023-10-14T18:54:33.815462+0000","last_unstale":"2023-10-14T18:54:33.815687+0000","last_undegraded":"2023-10-14T18:54:33.815687+0000","last_fullsized":"2023-10-14T18:54:33.815687+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812191+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813862+0000","last_change":"2023-10-14T18:54:33.813862+0000","last_active":"2023-10-14T18:54:33.813862+0000","last_peered":"2023-10-14T18:54:33.813862+0000","last_clean":"2023-10-14T18:54:33.813862+0000","last_became_active":"2023-10-14T18:54:33.813581+0000","last_became_peered":"2023-10-14T18:54:33.813581+0000","last_unstale":"2023-10-14T18:54:33.813862+0000","last_undegraded":"2023-10-14T18:54:33.813862+0000","last_fullsized":"2023-10-14T18:54:33.813862+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:21.164749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810027+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:31.514560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.808956+0000","last_change":"2023-10-14T18:54:33.808956+0000","last_active":"2023-10-14T18:54:33.808956+0000","last_peered":"2023-10-14T18:54:33.808956+0000","last_clean":"2023-10-14T18:54:33.808956+0000","last_became_active":"2023-10-14T18:54:33.808721+0000","last_became_peered":"2023-10-14T18:54:33.808721+0000","last_unstale":"2023-10-14T18:54:33.808956+0000","last_undegraded":"2023-10-14T18:54:33.808956+0000","last_fullsized":"2023-10-14T18:54:33.808956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809659+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.812573+0000","last_change":"2023-10-14T18:54:33.812573+0000","last_active":"2023-10-14T18:54:33.812573+0000","last_peered":"2023-10-14T18:54:33.812573+0000","last_clean":"2023-10-14T18:54:33.812573+0000","last_became_active":"2023-10-14T18:54:33.812353+0000","last_became_peered":"2023-10-14T18:54:33.812353+0000","last_unstale":"2023-10-14T18:54:33.812573+0000","last_undegraded":"2023-10-14T18:54:33.812573+0000","last_fullsized":"2023-10-14T18:54:33.812573+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:08.408570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.805949+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:08.819947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813960+0000","last_change":"2023-10-14T18:54:33.813960+0000","last_active":"2023-10-14T18:54:33.813960+0000","last_peered":"2023-10-14T18:54:33.813960+0000","last_clean":"2023-10-14T18:54:33.813960+0000","last_became_active":"2023-10-14T18:54:33.813642+0000","last_became_peered":"2023-10-14T18:54:33.813642+0000","last_unstale":"2023-10-14T18:54:33.813960+0000","last_undegraded":"2023-10-14T18:54:33.813960+0000","last_fullsized":"2023-10-14T18:54:33.813960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:44.476782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807931+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:31.619631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817888+0000","last_change":"2023-10-14T18:54:33.817888+0000","last_active":"2023-10-14T18:54:33.817888+0000","last_peered":"2023-10-14T18:54:33.817888+0000","last_clean":"2023-10-14T18:54:33.817888+0000","last_became_active":"2023-10-14T18:54:33.817743+0000","last_became_peered":"2023-10-14T18:54:33.817743+0000","last_unstale":"2023-10-14T18:54:33.817888+0000","last_undegraded":"2023-10-14T18:54:33.817888+0000","last_fullsized":"2023-10-14T18:54:33.817888+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:55.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809259+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811109+0000","last_change":"2023-10-14T18:54:33.811109+0000","last_active":"2023-10-14T18:54:33.811109+0000","last_peered":"2023-10-14T18:54:33.811109+0000","last_clean":"2023-10-14T18:54:33.811109+0000","last_became_active":"2023-10-14T18:54:33.810880+0000","last_became_peered":"2023-10-14T18:54:33.810880+0000","last_unstale":"2023-10-14T18:54:33.811109+0000","last_undegraded":"2023-10-14T18:54:33.811109+0000","last_fullsized":"2023-10-14T18:54:33.811109+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:08:32.791772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813126+0000","last_change":"2023-10-14T18:54:33.813126+0000","last_active":"2023-10-14T18:54:33.813126+0000","last_peered":"2023-10-14T18:54:33.813126+0000","last_clean":"2023-10-14T18:54:33.813126+0000","last_became_active":"2023-10-14T18:54:33.812885+0000","last_became_peered":"2023-10-14T18:54:33.812885+0000","last_unstale":"2023-10-14T18:54:33.813126+0000","last_undegraded":"2023-10-14T18:54:33.813126+0000","last_fullsized":"2023-10-14T18:54:33.813126+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:48.469403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809789+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815576+0000","last_change":"2023-10-14T18:54:33.815576+0000","last_active":"2023-10-14T18:54:33.815576+0000","last_peered":"2023-10-14T18:54:33.815576+0000","last_clean":"2023-10-14T18:54:33.815576+0000","last_became_active":"2023-10-14T18:54:33.815121+0000","last_became_peered":"2023-10-14T18:54:33.815121+0000","last_unstale":"2023-10-14T18:54:33.815576+0000","last_undegraded":"2023-10-14T18:54:33.815576+0000","last_fullsized":"2023-10-14T18:54:33.815576+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:01.266764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807520+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:37.534567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814620+0000","last_change":"2023-10-14T18:54:33.814620+0000","last_active":"2023-10-14T18:54:33.814620+0000","last_peered":"2023-10-14T18:54:33.814620+0000","last_clean":"2023-10-14T18:54:33.814620+0000","last_became_active":"2023-10-14T18:54:33.813789+0000","last_became_peered":"2023-10-14T18:54:33.813789+0000","last_unstale":"2023-10-14T18:54:33.814620+0000","last_undegraded":"2023-10-14T18:54:33.814620+0000","last_fullsized":"2023-10-14T18:54:33.814620+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:49.662749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815898+0000","last_change":"2023-10-14T18:54:33.815898+0000","last_active":"2023-10-14T18:54:33.815898+0000","last_peered":"2023-10-14T18:54:33.815898+0000","last_clean":"2023-10-14T18:54:33.815898+0000","last_became_active":"2023-10-14T18:54:33.815474+0000","last_became_peered":"2023-10-14T18:54:33.815474+0000","last_unstale":"2023-10-14T18:54:33.815898+0000","last_undegraded":"2023-10-14T18:54:33.815898+0000","last_fullsized":"2023-10-14T18:54:33.815898+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:47.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806833+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817866+0000","last_change":"2023-10-14T18:54:33.817866+0000","last_active":"2023-10-14T18:54:33.817866+0000","last_peered":"2023-10-14T18:54:33.817866+0000","last_clean":"2023-10-14T18:54:33.817866+0000","last_became_active":"2023-10-14T18:54:33.817633+0000","last_became_peered":"2023-10-14T18:54:33.817633+0000","last_unstale":"2023-10-14T18:54:33.817866+0000","last_undegraded":"2023-10-14T18:54:33.817866+0000","last_fullsized":"2023-10-14T18:54:33.817866+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809712+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:34.743138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817044+0000","last_change":"2023-10-14T18:54:33.817044+0000","last_active":"2023-10-14T18:54:33.817044+0000","last_peered":"2023-10-14T18:54:33.817044+0000","last_clean":"2023-10-14T18:54:33.817044+0000","last_became_active":"2023-10-14T18:54:33.816432+0000","last_became_peered":"2023-10-14T18:54:33.816432+0000","last_unstale":"2023-10-14T18:54:33.817044+0000","last_undegraded":"2023-10-14T18:54:33.817044+0000","last_fullsized":"2023-10-14T18:54:33.817044+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:50.021088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813491+0000","last_change":"2023-10-14T18:54:33.813491+0000","last_active":"2023-10-14T18:54:33.813491+0000","last_peered":"2023-10-14T18:54:33.813491+0000","last_clean":"2023-10-14T18:54:33.813491+0000","last_became_active":"2023-10-14T18:54:33.813100+0000","last_became_peered":"2023-10-14T18:54:33.813100+0000","last_unstale":"2023-10-14T18:54:33.813491+0000","last_undegraded":"2023-10-14T18:54:33.813491+0000","last_fullsized":"2023-10-14T18:54:33.813491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:56.431653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811815+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813458+0000","last_change":"2023-10-14T18:54:33.813458+0000","last_active":"2023-10-14T18:54:33.813458+0000","last_peered":"2023-10-14T18:54:33.813458+0000","last_clean":"2023-10-14T18:54:33.813458+0000","last_became_active":"2023-10-14T18:54:33.812995+0000","last_became_peered":"2023-10-14T18:54:33.812995+0000","last_unstale":"2023-10-14T18:54:33.813458+0000","last_undegraded":"2023-10-14T18:54:33.813458+0000","last_fullsized":"2023-10-14T18:54:33.813458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813988+0000","last_change":"2023-10-14T18:54:33.813988+0000","last_active":"2023-10-14T18:54:33.813988+0000","last_peered":"2023-10-14T18:54:33.813988+0000","last_clean":"2023-10-14T18:54:33.813988+0000","last_became_active":"2023-10-14T18:54:33.813755+0000","last_became_peered":"2023-10-14T18:54:33.813755+0000","last_unstale":"2023-10-14T18:54:33.813988+0000","last_undegraded":"2023-10-14T18:54:33.813988+0000","last_fullsized":"2023-10-14T18:54:33.813988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806988+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:45.480991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.819035+0000","last_change":"2023-10-14T18:54:33.819035+0000","last_active":"2023-10-14T18:54:33.819035+0000","last_peered":"2023-10-14T18:54:33.819035+0000","last_clean":"2023-10-14T18:54:33.819035+0000","last_became_active":"2023-10-14T18:54:33.818860+0000","last_became_peered":"2023-10-14T18:54:33.818860+0000","last_unstale":"2023-10-14T18:54:33.819035+0000","last_undegraded":"2023-10-14T18:54:33.819035+0000","last_fullsized":"2023-10-14T18:54:33.819035+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:42.839183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809614+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:34.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817232+0000","last_change":"2023-10-14T18:54:33.817232+0000","last_active":"2023-10-14T18:54:33.817232+0000","last_peered":"2023-10-14T18:54:33.817232+0000","last_clean":"2023-10-14T18:54:33.817232+0000","last_became_active":"2023-10-14T18:54:33.816803+0000","last_became_peered":"2023-10-14T18:54:33.816803+0000","last_unstale":"2023-10-14T18:54:33.817232+0000","last_undegraded":"2023-10-14T18:54:33.817232+0000","last_fullsized":"2023-10-14T18:54:33.817232+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:46.527749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808222+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:36.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814813+0000","last_change":"2023-10-14T18:54:33.814813+0000","last_active":"2023-10-14T18:54:33.814813+0000","last_peered":"2023-10-14T18:54:33.814813+0000","last_clean":"2023-10-14T18:54:33.814813+0000","last_became_active":"2023-10-14T18:54:33.814615+0000","last_became_peered":"2023-10-14T18:54:33.814615+0000","last_unstale":"2023-10-14T18:54:33.814813+0000","last_undegraded":"2023-10-14T18:54:33.814813+0000","last_fullsized":"2023-10-14T18:54:33.814813+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809355+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:22.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816604+0000","last_change":"2023-10-14T18:54:33.816604+0000","last_active":"2023-10-14T18:54:33.816604+0000","last_peered":"2023-10-14T18:54:33.816604+0000","last_clean":"2023-10-14T18:54:33.816604+0000","last_became_active":"2023-10-14T18:54:33.816322+0000","last_became_peered":"2023-10-14T18:54:33.816322+0000","last_unstale":"2023-10-14T18:54:33.816604+0000","last_undegraded":"2023-10-14T18:54:33.816604+0000","last_fullsized":"2023-10-14T18:54:33.816604+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807605+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:55.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814399+0000","last_change":"2023-10-14T18:54:33.814399+0000","last_active":"2023-10-14T18:54:33.814399+0000","last_peered":"2023-10-14T18:54:33.814399+0000","last_clean":"2023-10-14T18:54:33.814399+0000","last_became_active":"2023-10-14T18:54:33.814128+0000","last_became_peered":"2023-10-14T18:54:33.814128+0000","last_unstale":"2023-10-14T18:54:33.814399+0000","last_undegraded":"2023-10-14T18:54:33.814399+0000","last_fullsized":"2023-10-14T18:54:33.814399+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":311,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T18:54:32.802514+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:54:32.802514+0000","last_peered":"2023-10-14T18:54:32.802514+0000","last_clean":"2023-10-14T18:54:32.802514+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:54:32.802514+0000","last_undegraded":"2023-10-14T18:54:32.802514+0000","last_fullsized":"2023-10-14T18:54:32.802514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.73699999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.45300000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60799999999999998,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.95699999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.73899999999999999,"5min":0.746,"15min":0.78800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.20899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.76300000000000001},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.439,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":3.4489999999999998},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.83599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.751},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.76800000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.626},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39200000000000002,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.89700000000000002},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":3.992,"15min":3.992},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26400000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53900000000000003,"5min":1.252,"15min":1.252},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.373}]},{"osd":3,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41799999999999998,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":1.3340000000000001,"15min":10.574},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.48899999999999999,"15min":0.41399999999999998},"min":{"1min":0.29199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":10.792,"15min":10.792},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64200000000000002,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.77000000000000002,"5min":3.536,"15min":3.536},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.504,"15min":1.504},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66100000000000003,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":1.288,"15min":1.288},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.64100000000000001},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":3.577,"15min":3.577},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198476299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.191,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.47499999999999998,"5min":0.55700000000000005,"15min":0.59599999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.25800000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.623},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.36199999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.64200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":1.0369999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.871,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36299999999999999,"15min":0.33600000000000002},"min":{"1min":0.26100000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.56799999999999995,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.315,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.34300000000000003,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.33100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60399999999999998,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.78200000000000003,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.52800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.79900000000000004,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.96699999999999997,"15min":0.96999999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.91300000000000003,"15min":1.0429999999999999},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.26800000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.34300000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.89300000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.375,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.34300000000000003},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80900000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.60599999999999998,"5min":0.70199999999999996,"15min":0.999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58499999999999996,"5min":0.75900000000000001,"15min":0.94999999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57599999999999996,"5min":0.747,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.77400000000000002,"15min":0.89300000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.67900000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.872},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.502}]},{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.433,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59499999999999997,"5min":0.74199999999999999,"15min":0.746},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.80500000000000005,"15min":0.81899999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44400000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:54:39.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-10-14T18:54:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809445+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-10-14T18:54:39.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808607+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-10-14T18:54:39.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809876+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-10-14T18:54:39.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.811396+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-10-14T18:54:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808807+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:44:17.855758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-10-14T18:54:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809201+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-10-14T18:54:39.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806983+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:54:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-10-14T18:54:39.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809244+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-10-14T18:54:39.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809983+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-10-14T18:54:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808005+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:09:11.581850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-10-14T18:54:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808831+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-10-14T18:54:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807426+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:24:08.832890+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-10-14T18:54:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.810373+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:41:57.440172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-10-14T18:54:39.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.811043+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-10-14T18:54:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807606+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:42:21.187441+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-10-14T18:54:39.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808071+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:54:22.982244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-10-14T18:54:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806567+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:25:57.194498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-10-14T18:54:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809493+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-10-14T18:54:39.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809914+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-10-14T18:54:39.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807348+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:28:53.272239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-10-14T18:54:39.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807693+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:02:16.558714+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-10-14T18:54:39.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.811740+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-10-14T18:54:39.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809269+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-10-14T18:54:39.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808927+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:28:33.804334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-10-14T18:54:39.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806950+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:10:25.484978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-10-14T18:54:39.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808504+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-10-14T18:54:39.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807769+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:51:32.075044+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-10-14T18:54:39.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807775+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:11:33.535803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:54:39.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-10-14T18:54:39.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809652+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-10-14T18:54:39.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.814870+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-10-14T18:54:39.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.810408+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-10-14T18:54:39.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807423+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:17:09.010859+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-10-14T18:54:39.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808571+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:01:11.467377+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-10-14T18:54:39.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809334+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-10-14T18:54:39.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806908+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-10-14T18:54:39.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806413+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:10:41.038131+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-10-14T18:54:39.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809010+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-14T18:54:39.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809248+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-10-14T18:54:39.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.812541+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-10-14T18:54:39.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809573+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:02:17.993050+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-10-14T18:54:39.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808699+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-10-14T18:54:39.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806465+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T23:38:55.267477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-10-14T18:54:39.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808200+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:31:42.826669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-14T18:54:39.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.813161+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-10-14T18:54:39.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.812191+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-10-14T18:54:39.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.810027+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:14:31.514560+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-14T18:54:39.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809659+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-10-14T18:54:39.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.805949+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:31:08.819947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-10-14T18:54:39.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807931+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:56:31.619631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-14T18:54:39.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809259+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-10-14T18:54:39.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806531+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-14T18:54:39.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809789+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-10-14T18:54:39.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807520+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:56:37.534567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:54:39.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-14T18:54:39.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809617+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:54:39.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-10-14T18:54:39.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806833+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:54:39.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-10-14T18:54:39.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809712+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:50:34.743138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-14T18:54:39.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808617+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:54:39.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-10-14T18:54:39.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.811815+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:54:39.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-10-14T18:54:39.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806531+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:54:39.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-10-14T18:54:39.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.806988+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:41:45.480991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:54:39.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-10-14T18:54:39.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809614+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:48:34.784756+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-10-14T18:54:39.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.808222+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:14:36.866667+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:54:39.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-10-14T18:54:39.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.809355+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:40:22.050122+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:54:39.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-10-14T18:54:39.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:54:33.798696+0000', 'last_change': '2023-10-14T18:54:33.807605+0000', 'last_active': '2023-10-14T18:54:33.798696+0000', 'last_peered': '2023-10-14T18:54:33.798696+0000', 'last_clean': '2023-10-14T18:54:33.798696+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:54:33.798696+0000', 'last_undegraded': '2023-10-14T18:54:33.798696+0000', 'last_fullsized': '2023-10-14T18:54:33.798696+0000', 'mapping_epoch': 168, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 168, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'last_clean_scrub_stamp': '2023-10-14T18:54:33.798696+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:13:55.425954+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:54:39.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T18:54:39.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.785+0000 7fee2d7a5700 1 Processor -- start 2023-10-14T18:54:39.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.785+0000 7fee2d7a5700 1 -- start start 2023-10-14T18:54:39.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee2d7a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee28158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee2d7a5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2815cbb0 con 0x7fee2815a620 2023-10-14T18:54:39.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee2d7a5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2815bfa0 con 0x7fee28157870 2023-10-14T18:54:39.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee2d7a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2815bdb0 con 0x7fee28157c40 2023-10-14T18:54:39.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee1ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fee2815a620 0x7fee2815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:52986/0 (socket says 172.21.15.79:52986) 2023-10-14T18:54:39.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee1ffff700 1 -- 172.21.15.79:0/2938136289 learned_addr learned my addr 172.21.15.79:0/2938136289 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:39.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947953038 0 0) 0x7fee2815cbb0 con 0x7fee2815a620 2023-10-14T18:54:39.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee14003570 con 0x7fee2815a620 2023-10-14T18:54:39.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee277fe700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee28158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310066483 0 0) 0x7fee14003570 con 0x7fee2815a620 2023-10-14T18:54:39.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 msgr2=0x7fee28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:39.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee28158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 >> v1:172.21.15.144:6789/0 conn(0x7fee28157870 legacy=0x7fee2815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2815c280 con 0x7fee2815a620 2023-10-14T18:54:39.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fee10001470 con 0x7fee2815a620 2023-10-14T18:54:39.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 >> v1:172.21.15.79:6789/0 conn(0x7fee2815a620 legacy=0x7fee2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee14003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee14003fd0 0x7fee14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14004d50 0x7fee140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1400bb10 con 0x7fee14004d50 2023-10-14T18:54:39.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1400bc80 con 0x7fee14003fd0 2023-10-14T18:54:39.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.786+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1400be40 con 0x7fee28157c40 2023-10-14T18:54:39.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14004d50 0x7fee140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee1ffff700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee14003fd0 0x7fee14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee26ffd700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee14003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 -- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 msgr2=0x7fee14003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:39.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee28157c40 0x7fee14003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 -- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee14003fd0 msgr2=0x7fee14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:39.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee14003fd0 0x7fee14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 -- 172.21.15.79:0/2938136289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee14003570 con 0x7fee14004d50 2023-10-14T18:54:39.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee277fe700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14004d50 0x7fee140051c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fee281580c0 tx=0x7fee2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ef04b79e82f03e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000ea90 con 0x7fee14004d50 2023-10-14T18:54:39.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000f040 con 0x7fee14004d50 2023-10-14T18:54:39.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.787+0000 7fee267fc700 1 -- 172.21.15.79:0/2938136289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000ee40 con 0x7fee14004d50 2023-10-14T18:54:39.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2938136289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14004d50 msgr2=0x7fee140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2938136289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee14004d50 0x7fee140051c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fee281580c0 tx=0x7fee2000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:39.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee277fe700 1 -- 172.21.15.79:0/2938136289 reap_dead start 2023-10-14T18:54:39.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2938136289 shutdown_connections 2023-10-14T18:54:39.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2938136289 >> 172.21.15.79:0/2938136289 conn(0x7fee28068ce0 msgr2=0x7fee280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:39.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2938136289 shutdown_connections 2023-10-14T18:54:39.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.788+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2938136289 wait complete. 2023-10-14T18:54:39.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 Processor -- start 2023-10-14T18:54:39.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 -- start start 2023-10-14T18:54:39.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee14004d50 0x7fee28146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee280c8c10 0x7fee280c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c73a0 con 0x7fee280c6220 2023-10-14T18:54:39.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280c95d0 con 0x7fee280c8c10 2023-10-14T18:54:39.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.789+0000 7fee2d7a5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280cac30 con 0x7fee14004d50 2023-10-14T18:54:39.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45106/0 (socket says 172.21.15.79:45106) 2023-10-14T18:54:39.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 -- 172.21.15.79:0/2653216907 learned_addr learned my addr 172.21.15.79:0/2653216907 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:39.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee26ffd700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee14004d50 0x7fee28146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee277fe700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee280c8c10 0x7fee280c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 -- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee14004d50 msgr2=0x7fee28146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee14004d50 0x7fee28146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 -- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee280c8c10 msgr2=0x7fee280c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:39.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee280c8c10 0x7fee280c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:39.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 -- 172.21.15.79:0/2653216907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280c6790 con 0x7fee280c6220 2023-10-14T18:54:39.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1ffff700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fee100073c0 tx=0x7fee10001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10007850 con 0x7fee280c6220 2023-10-14T18:54:39.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000f870 con 0x7fee280c6220 2023-10-14T18:54:39.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000fc30 con 0x7fee280c6220 2023-10-14T18:54:39.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee280c6a70 con 0x7fee280c6220 2023-10-14T18:54:39.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.790+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280c7030 con 0x7fee280c6220 2023-10-14T18:54:39.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.791+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee280c7550 con 0x7fee280c6220 2023-10-14T18:54:39.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.792+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee1000fd90 con 0x7fee280c6220 2023-10-14T18:54:39.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.792+0000 7fee1effd700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:39.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.792+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee10083e40 con 0x7fee280c6220 2023-10-14T18:54:39.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.792+0000 7fee26ffd700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:39.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.793+0000 7fee26ffd700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee18007e20 tx=0x7fee18007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:39.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:39.796+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee280c7550 con 0x7fee280c6220 2023-10-14T18:54:40.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.056+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fee280c7550 con 0x7fee280c6220 2023-10-14T18:54:40.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.057+0000 7fee1effd700 1 -- 172.21.15.79:0/2653216907 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1032 (secure 0 0 0) 0x7fee280c7550 con 0x7fee280c6220 2023-10-14T18:54:40.058 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:40.058 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":170,"num_osds":8,"num_up_osds":8,"osd_up_since":1697309098,"num_in_osds":8,"osd_in_since":1697309095,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":8629425,"bytes_avail":1591370575,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":80,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":7791}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-14T18:53:10.450755+0000","services":{}},"progress_events":{}} 2023-10-14T18:54:40.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 msgr2=0x7fee080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee18007e20 tx=0x7fee18007d10 comp rx=0 tx=0).stop 2023-10-14T18:54:40.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 msgr2=0x7fee280b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fee100073c0 tx=0x7fee10001e70 comp rx=0 tx=0).stop 2023-10-14T18:54:40.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 shutdown_connections 2023-10-14T18:54:40.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fee08066f30 0x7fee080693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee280c8c10 0x7fee280c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee14004d50 0x7fee28146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 --2- 172.21.15.79:0/2653216907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee280c6220 0x7fee280b2500 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 >> 172.21.15.79:0/2653216907 conn(0x7fee28068ce0 msgr2=0x7fee280cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 shutdown_connections 2023-10-14T18:54:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.059+0000 7fee2d7a5700 1 -- 172.21.15.79:0/2653216907 wait complete. 2023-10-14T18:54:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T18:54:40.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:54:40.101 INFO:tasks.ceph.mds.c.smithi079.stderr:2023-10-14T18:54:40.100+0000 7f2670200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:54:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.196+0000 7fc7ec4b5700 1 Processor -- start 2023-10-14T18:54:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.196+0000 7fc7ec4b5700 1 -- start start 2023-10-14T18:54:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ec4b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7e40cbc00 0x7fc7e40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ec4b5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e415de60 con 0x7fc7e40b0e50 2023-10-14T18:54:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ec4b5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e415e140 con 0x7fc7e40b1220 2023-10-14T18:54:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ec4b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e415e420 con 0x7fc7e40cbc00 2023-10-14T18:54:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7eaa52700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7e40cbc00 0x7fc7e40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ea251700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc7e40b0e50 0x7fc7e406d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53000/0 (socket says 172.21.15.79:53000) 2023-10-14T18:54:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.197+0000 7fc7ea251700 1 -- 172.21.15.79:0/3778670602 learned_addr learned my addr 172.21.15.79:0/3778670602 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7eaa52700 1 -- 172.21.15.79:0/3778670602 >> v1:172.21.15.144:6789/0 conn(0x7fc7e40b1220 legacy=0x7fc7e40cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7eaa52700 1 -- 172.21.15.79:0/3778670602 >> v1:172.21.15.79:6789/0 conn(0x7fc7e40b0e50 legacy=0x7fc7e406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7eaa52700 1 -- 172.21.15.79:0/3778670602 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e415e700 con 0x7fc7e40cbc00 2023-10-14T18:54:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7eaa52700 1 --2- 172.21.15.79:0/3778670602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40cbc00 0x7fc7e40c9180 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098e0 tx=0x7fc7dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b4a95030df942f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7e924f700 1 -- 172.21.15.79:0/3778670602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009e80 con 0x7fc7e40cbc00 2023-10-14T18:54:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7e924f700 1 -- 172.21.15.79:0/3778670602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00b860 con 0x7fc7e40cbc00 2023-10-14T18:54:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7e924f700 1 -- 172.21.15.79:0/3778670602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00bbe0 con 0x7fc7e40cbc00 2023-10-14T18:54:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3778670602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40cbc00 msgr2=0x7fc7e40c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.198+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3778670602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40cbc00 0x7fc7e40c9180 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0098e0 tx=0x7fc7dc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.199+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3778670602 shutdown_connections 2023-10-14T18:54:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.199+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3778670602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40cbc00 0x7fc7e40c9180 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.199+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3778670602 >> 172.21.15.79:0/3778670602 conn(0x7fc7e4069870 msgr2=0x7fc7e4069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.199+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3778670602 shutdown_connections 2023-10-14T18:54:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.199+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3778670602 wait complete. 2023-10-14T18:54:40.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 Processor -- start 2023-10-14T18:54:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 -- start start 2023-10-14T18:54:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 0x7fc7e40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7e40cbc00 0x7fc7e4155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:40.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41560c0 con 0x7fc7e40b0e50 2023-10-14T18:54:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e415c2c0 con 0x7fc7e40b1220 2023-10-14T18:54:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.200+0000 7fc7ec4b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e415c5a0 con 0x7fc7e40cbc00 2023-10-14T18:54:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45118/0 (socket says 172.21.15.79:45118) 2023-10-14T18:54:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 -- 172.21.15.79:0/3014794128 learned_addr learned my addr 172.21.15.79:0/3014794128 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 -- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7e40cbc00 msgr2=0x7fc7e4155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7e40cbc00 0x7fc7e4155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 -- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 msgr2=0x7fc7e40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7e9a50700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 0x7fc7e40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 0x7fc7e40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 -- 172.21.15.79:0/3014794128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009420 con 0x7fc7e40b0e50 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7e9a50700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 0x7fc7e40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ea251700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400cd30 tx=0x7fc7d4001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4004bb0 con 0x7fc7e40b0e50 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d4004d10 con 0x7fc7e40b0e50 2023-10-14T18:54:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e415c880 con 0x7fc7e40b0e50 2023-10-14T18:54:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400adc0 con 0x7fc7e40b0e50 2023-10-14T18:54:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.201+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e415ce40 con 0x7fc7e40b0e50 2023-10-14T18:54:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.202+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e404c3c0 con 0x7fc7e40b0e50 2023-10-14T18:54:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.202+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7d4007300 con 0x7fc7e40b0e50 2023-10-14T18:54:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.203+0000 7fc7e27fc700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 0x7fc7d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.203+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7d40842a0 con 0x7fc7e40b0e50 2023-10-14T18:54:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.203+0000 7fc7e9a50700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 0x7fc7d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.203+0000 7fc7e9a50700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 0x7fc7d00693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40cb1a0 tx=0x7fc7d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.207+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7d4051590 con 0x7fc7e40b0e50 2023-10-14T18:54:40.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:40.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:40.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.386+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7e4068ba0 con 0x7fc7d0066f30 2023-10-14T18:54:40.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.394+0000 7fc7e27fc700 1 -- 172.21.15.79:0/3014794128 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283066 (secure 0 0 0) 0x7fc7e4068ba0 con 0x7fc7d0066f30 2023-10-14T18:54:40.398 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:40.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.397+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 msgr2=0x7fc7d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 0x7fc7d00693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40cb1a0 tx=0x7fc7d8009040 comp rx=0 tx=0).stop 2023-10-14T18:54:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 msgr2=0x7fc7e40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400cd30 tx=0x7fc7d4001ad0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 shutdown_connections 2023-10-14T18:54:40.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc7d0066f30 0x7fc7d00693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc7e40cbc00 0x7fc7e4155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e40b0e50 0x7fc7e40ca6b0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 --2- 172.21.15.79:0/3014794128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7e40b1220 0x7fc7e40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 >> 172.21.15.79:0/3014794128 conn(0x7fc7e4069870 msgr2=0x7fc7e40cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:40.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 shutdown_connections 2023-10-14T18:54:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:40.398+0000 7fc7ec4b5700 1 -- 172.21.15.79:0/3014794128 wait complete. 2023-10-14T18:54:40.403 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:54:40.410 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2023-10-14T18:54:38.472221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554072,"statfs":{"total":1600000000,"available":1591370575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672544"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809445+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808607+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809876+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811396+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808807+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:44:17.855758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809201+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809244+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809983+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808005+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:09:11.581850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808831+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807426+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:24:08.832890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810373+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:57.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811043+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807606+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:42:21.187441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808071+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:22.982244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806567+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:25:57.194498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809493+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:36.547657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809914+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807348+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:53.272239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807693+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:02:16.558714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811740+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809269+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:28.707339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808927+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:33.804334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806950+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:25.484978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808504+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807769+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:32.075044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807775+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:11:33.535803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809652+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.814870+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810408+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807423+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:09.010859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808571+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:11.467377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815018+0000","last_change":"2023-10-14T18:54:33.815018+0000","last_active":"2023-10-14T18:54:33.815018+0000","last_peered":"2023-10-14T18:54:33.815018+0000","last_clean":"2023-10-14T18:54:33.815018+0000","last_became_active":"2023-10-14T18:54:33.814372+0000","last_became_peered":"2023-10-14T18:54:33.814372+0000","last_unstale":"2023-10-14T18:54:33.815018+0000","last_undegraded":"2023-10-14T18:54:33.815018+0000","last_fullsized":"2023-10-14T18:54:33.815018+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:47.736952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809334+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816693+0000","last_change":"2023-10-14T18:54:33.816693+0000","last_active":"2023-10-14T18:54:33.816693+0000","last_peered":"2023-10-14T18:54:33.816693+0000","last_clean":"2023-10-14T18:54:33.816693+0000","last_became_active":"2023-10-14T18:54:33.816478+0000","last_became_peered":"2023-10-14T18:54:33.816478+0000","last_unstale":"2023-10-14T18:54:33.816693+0000","last_undegraded":"2023-10-14T18:54:33.816693+0000","last_fullsized":"2023-10-14T18:54:33.816693+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:35.539138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806908+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818725+0000","last_change":"2023-10-14T18:54:33.818725+0000","last_active":"2023-10-14T18:54:33.818725+0000","last_peered":"2023-10-14T18:54:33.818725+0000","last_clean":"2023-10-14T18:54:33.818725+0000","last_became_active":"2023-10-14T18:54:33.818408+0000","last_became_peered":"2023-10-14T18:54:33.818408+0000","last_unstale":"2023-10-14T18:54:33.818725+0000","last_undegraded":"2023-10-14T18:54:33.818725+0000","last_fullsized":"2023-10-14T18:54:33.818725+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806413+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:41.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818960+0000","last_change":"2023-10-14T18:54:33.818960+0000","last_active":"2023-10-14T18:54:33.818960+0000","last_peered":"2023-10-14T18:54:33.818960+0000","last_clean":"2023-10-14T18:54:33.818960+0000","last_became_active":"2023-10-14T18:54:33.815975+0000","last_became_peered":"2023-10-14T18:54:33.815975+0000","last_unstale":"2023-10-14T18:54:33.818960+0000","last_undegraded":"2023-10-14T18:54:33.818960+0000","last_fullsized":"2023-10-14T18:54:33.818960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809010+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811124+0000","last_change":"2023-10-14T18:54:33.811124+0000","last_active":"2023-10-14T18:54:33.811124+0000","last_peered":"2023-10-14T18:54:33.811124+0000","last_clean":"2023-10-14T18:54:33.811124+0000","last_became_active":"2023-10-14T18:54:33.810900+0000","last_became_peered":"2023-10-14T18:54:33.810900+0000","last_unstale":"2023-10-14T18:54:33.811124+0000","last_undegraded":"2023-10-14T18:54:33.811124+0000","last_fullsized":"2023-10-14T18:54:33.811124+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:06.386916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809248+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813164+0000","last_change":"2023-10-14T18:54:33.813164+0000","last_active":"2023-10-14T18:54:33.813164+0000","last_peered":"2023-10-14T18:54:33.813164+0000","last_clean":"2023-10-14T18:54:33.813164+0000","last_became_active":"2023-10-14T18:54:33.812945+0000","last_became_peered":"2023-10-14T18:54:33.812945+0000","last_unstale":"2023-10-14T18:54:33.813164+0000","last_undegraded":"2023-10-14T18:54:33.813164+0000","last_fullsized":"2023-10-14T18:54:33.813164+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:35.760324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812541+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813316+0000","last_change":"2023-10-14T18:54:33.813316+0000","last_active":"2023-10-14T18:54:33.813316+0000","last_peered":"2023-10-14T18:54:33.813316+0000","last_clean":"2023-10-14T18:54:33.813316+0000","last_became_active":"2023-10-14T18:54:33.813103+0000","last_became_peered":"2023-10-14T18:54:33.813103+0000","last_unstale":"2023-10-14T18:54:33.813316+0000","last_undegraded":"2023-10-14T18:54:33.813316+0000","last_fullsized":"2023-10-14T18:54:33.813316+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:00.825491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809573+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:02:17.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.818566+0000","last_change":"2023-10-14T18:54:33.818566+0000","last_active":"2023-10-14T18:54:33.818566+0000","last_peered":"2023-10-14T18:54:33.818566+0000","last_clean":"2023-10-14T18:54:33.818566+0000","last_became_active":"2023-10-14T18:54:33.817872+0000","last_became_peered":"2023-10-14T18:54:33.817872+0000","last_unstale":"2023-10-14T18:54:33.818566+0000","last_undegraded":"2023-10-14T18:54:33.818566+0000","last_fullsized":"2023-10-14T18:54:33.818566+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:56.783121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808699+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815623+0000","last_change":"2023-10-14T18:54:33.815623+0000","last_active":"2023-10-14T18:54:33.815623+0000","last_peered":"2023-10-14T18:54:33.815623+0000","last_clean":"2023-10-14T18:54:33.815623+0000","last_became_active":"2023-10-14T18:54:33.814905+0000","last_became_peered":"2023-10-14T18:54:33.814905+0000","last_unstale":"2023-10-14T18:54:33.815623+0000","last_undegraded":"2023-10-14T18:54:33.815623+0000","last_fullsized":"2023-10-14T18:54:33.815623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:27.698820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806465+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:38:55.267477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813724+0000","last_change":"2023-10-14T18:54:33.813724+0000","last_active":"2023-10-14T18:54:33.813724+0000","last_peered":"2023-10-14T18:54:33.813724+0000","last_clean":"2023-10-14T18:54:33.813724+0000","last_became_active":"2023-10-14T18:54:33.813499+0000","last_became_peered":"2023-10-14T18:54:33.813499+0000","last_unstale":"2023-10-14T18:54:33.813724+0000","last_undegraded":"2023-10-14T18:54:33.813724+0000","last_fullsized":"2023-10-14T18:54:33.813724+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:50.648829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808200+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:31:42.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811859+0000","last_change":"2023-10-14T18:54:33.811859+0000","last_active":"2023-10-14T18:54:33.811859+0000","last_peered":"2023-10-14T18:54:33.811859+0000","last_clean":"2023-10-14T18:54:33.811859+0000","last_became_active":"2023-10-14T18:54:33.811644+0000","last_became_peered":"2023-10-14T18:54:33.811644+0000","last_unstale":"2023-10-14T18:54:33.811859+0000","last_undegraded":"2023-10-14T18:54:33.811859+0000","last_fullsized":"2023-10-14T18:54:33.811859+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:05.856792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.813161+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815687+0000","last_change":"2023-10-14T18:54:33.815687+0000","last_active":"2023-10-14T18:54:33.815687+0000","last_peered":"2023-10-14T18:54:33.815687+0000","last_clean":"2023-10-14T18:54:33.815687+0000","last_became_active":"2023-10-14T18:54:33.815462+0000","last_became_peered":"2023-10-14T18:54:33.815462+0000","last_unstale":"2023-10-14T18:54:33.815687+0000","last_undegraded":"2023-10-14T18:54:33.815687+0000","last_fullsized":"2023-10-14T18:54:33.815687+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.812191+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813862+0000","last_change":"2023-10-14T18:54:33.813862+0000","last_active":"2023-10-14T18:54:33.813862+0000","last_peered":"2023-10-14T18:54:33.813862+0000","last_clean":"2023-10-14T18:54:33.813862+0000","last_became_active":"2023-10-14T18:54:33.813581+0000","last_became_peered":"2023-10-14T18:54:33.813581+0000","last_unstale":"2023-10-14T18:54:33.813862+0000","last_undegraded":"2023-10-14T18:54:33.813862+0000","last_fullsized":"2023-10-14T18:54:33.813862+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:21.164749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.810027+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:31.514560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.808956+0000","last_change":"2023-10-14T18:54:33.808956+0000","last_active":"2023-10-14T18:54:33.808956+0000","last_peered":"2023-10-14T18:54:33.808956+0000","last_clean":"2023-10-14T18:54:33.808956+0000","last_became_active":"2023-10-14T18:54:33.808721+0000","last_became_peered":"2023-10-14T18:54:33.808721+0000","last_unstale":"2023-10-14T18:54:33.808956+0000","last_undegraded":"2023-10-14T18:54:33.808956+0000","last_fullsized":"2023-10-14T18:54:33.808956+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809659+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:49.477922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.812573+0000","last_change":"2023-10-14T18:54:33.812573+0000","last_active":"2023-10-14T18:54:33.812573+0000","last_peered":"2023-10-14T18:54:33.812573+0000","last_clean":"2023-10-14T18:54:33.812573+0000","last_became_active":"2023-10-14T18:54:33.812353+0000","last_became_peered":"2023-10-14T18:54:33.812353+0000","last_unstale":"2023-10-14T18:54:33.812573+0000","last_undegraded":"2023-10-14T18:54:33.812573+0000","last_fullsized":"2023-10-14T18:54:33.812573+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:08.408570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.805949+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:31:08.819947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813960+0000","last_change":"2023-10-14T18:54:33.813960+0000","last_active":"2023-10-14T18:54:33.813960+0000","last_peered":"2023-10-14T18:54:33.813960+0000","last_clean":"2023-10-14T18:54:33.813960+0000","last_became_active":"2023-10-14T18:54:33.813642+0000","last_became_peered":"2023-10-14T18:54:33.813642+0000","last_unstale":"2023-10-14T18:54:33.813960+0000","last_undegraded":"2023-10-14T18:54:33.813960+0000","last_fullsized":"2023-10-14T18:54:33.813960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:44.476782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807931+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:31.619631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817888+0000","last_change":"2023-10-14T18:54:33.817888+0000","last_active":"2023-10-14T18:54:33.817888+0000","last_peered":"2023-10-14T18:54:33.817888+0000","last_clean":"2023-10-14T18:54:33.817888+0000","last_became_active":"2023-10-14T18:54:33.817743+0000","last_became_peered":"2023-10-14T18:54:33.817743+0000","last_unstale":"2023-10-14T18:54:33.817888+0000","last_undegraded":"2023-10-14T18:54:33.817888+0000","last_fullsized":"2023-10-14T18:54:33.817888+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:55.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809259+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.811109+0000","last_change":"2023-10-14T18:54:33.811109+0000","last_active":"2023-10-14T18:54:33.811109+0000","last_peered":"2023-10-14T18:54:33.811109+0000","last_clean":"2023-10-14T18:54:33.811109+0000","last_became_active":"2023-10-14T18:54:33.810880+0000","last_became_peered":"2023-10-14T18:54:33.810880+0000","last_unstale":"2023-10-14T18:54:33.811109+0000","last_undegraded":"2023-10-14T18:54:33.811109+0000","last_fullsized":"2023-10-14T18:54:33.811109+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:08:32.791772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813126+0000","last_change":"2023-10-14T18:54:33.813126+0000","last_active":"2023-10-14T18:54:33.813126+0000","last_peered":"2023-10-14T18:54:33.813126+0000","last_clean":"2023-10-14T18:54:33.813126+0000","last_became_active":"2023-10-14T18:54:33.812885+0000","last_became_peered":"2023-10-14T18:54:33.812885+0000","last_unstale":"2023-10-14T18:54:33.813126+0000","last_undegraded":"2023-10-14T18:54:33.813126+0000","last_fullsized":"2023-10-14T18:54:33.813126+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:48.469403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809789+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815576+0000","last_change":"2023-10-14T18:54:33.815576+0000","last_active":"2023-10-14T18:54:33.815576+0000","last_peered":"2023-10-14T18:54:33.815576+0000","last_clean":"2023-10-14T18:54:33.815576+0000","last_became_active":"2023-10-14T18:54:33.815121+0000","last_became_peered":"2023-10-14T18:54:33.815121+0000","last_unstale":"2023-10-14T18:54:33.815576+0000","last_undegraded":"2023-10-14T18:54:33.815576+0000","last_fullsized":"2023-10-14T18:54:33.815576+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:01.266764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807520+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:37.534567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814620+0000","last_change":"2023-10-14T18:54:33.814620+0000","last_active":"2023-10-14T18:54:33.814620+0000","last_peered":"2023-10-14T18:54:33.814620+0000","last_clean":"2023-10-14T18:54:33.814620+0000","last_became_active":"2023-10-14T18:54:33.813789+0000","last_became_peered":"2023-10-14T18:54:33.813789+0000","last_unstale":"2023-10-14T18:54:33.814620+0000","last_undegraded":"2023-10-14T18:54:33.814620+0000","last_fullsized":"2023-10-14T18:54:33.814620+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:49.662749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:56.021180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.815898+0000","last_change":"2023-10-14T18:54:33.815898+0000","last_active":"2023-10-14T18:54:33.815898+0000","last_peered":"2023-10-14T18:54:33.815898+0000","last_clean":"2023-10-14T18:54:33.815898+0000","last_became_active":"2023-10-14T18:54:33.815474+0000","last_became_peered":"2023-10-14T18:54:33.815474+0000","last_unstale":"2023-10-14T18:54:33.815898+0000","last_undegraded":"2023-10-14T18:54:33.815898+0000","last_fullsized":"2023-10-14T18:54:33.815898+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:47.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806833+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817866+0000","last_change":"2023-10-14T18:54:33.817866+0000","last_active":"2023-10-14T18:54:33.817866+0000","last_peered":"2023-10-14T18:54:33.817866+0000","last_clean":"2023-10-14T18:54:33.817866+0000","last_became_active":"2023-10-14T18:54:33.817633+0000","last_became_peered":"2023-10-14T18:54:33.817633+0000","last_unstale":"2023-10-14T18:54:33.817866+0000","last_undegraded":"2023-10-14T18:54:33.817866+0000","last_fullsized":"2023-10-14T18:54:33.817866+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809712+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:50:34.743138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817044+0000","last_change":"2023-10-14T18:54:33.817044+0000","last_active":"2023-10-14T18:54:33.817044+0000","last_peered":"2023-10-14T18:54:33.817044+0000","last_clean":"2023-10-14T18:54:33.817044+0000","last_became_active":"2023-10-14T18:54:33.816432+0000","last_became_peered":"2023-10-14T18:54:33.816432+0000","last_unstale":"2023-10-14T18:54:33.817044+0000","last_undegraded":"2023-10-14T18:54:33.817044+0000","last_fullsized":"2023-10-14T18:54:33.817044+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:50.021088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808617+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813491+0000","last_change":"2023-10-14T18:54:33.813491+0000","last_active":"2023-10-14T18:54:33.813491+0000","last_peered":"2023-10-14T18:54:33.813491+0000","last_clean":"2023-10-14T18:54:33.813491+0000","last_became_active":"2023-10-14T18:54:33.813100+0000","last_became_peered":"2023-10-14T18:54:33.813100+0000","last_unstale":"2023-10-14T18:54:33.813491+0000","last_undegraded":"2023-10-14T18:54:33.813491+0000","last_fullsized":"2023-10-14T18:54:33.813491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:56.431653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.811815+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813458+0000","last_change":"2023-10-14T18:54:33.813458+0000","last_active":"2023-10-14T18:54:33.813458+0000","last_peered":"2023-10-14T18:54:33.813458+0000","last_clean":"2023-10-14T18:54:33.813458+0000","last_became_active":"2023-10-14T18:54:33.812995+0000","last_became_peered":"2023-10-14T18:54:33.812995+0000","last_unstale":"2023-10-14T18:54:33.813458+0000","last_undegraded":"2023-10-14T18:54:33.813458+0000","last_fullsized":"2023-10-14T18:54:33.813458+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806531+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.813988+0000","last_change":"2023-10-14T18:54:33.813988+0000","last_active":"2023-10-14T18:54:33.813988+0000","last_peered":"2023-10-14T18:54:33.813988+0000","last_clean":"2023-10-14T18:54:33.813988+0000","last_became_active":"2023-10-14T18:54:33.813755+0000","last_became_peered":"2023-10-14T18:54:33.813755+0000","last_unstale":"2023-10-14T18:54:33.813988+0000","last_undegraded":"2023-10-14T18:54:33.813988+0000","last_fullsized":"2023-10-14T18:54:33.813988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.806988+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:41:45.480991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.819035+0000","last_change":"2023-10-14T18:54:33.819035+0000","last_active":"2023-10-14T18:54:33.819035+0000","last_peered":"2023-10-14T18:54:33.819035+0000","last_clean":"2023-10-14T18:54:33.819035+0000","last_became_active":"2023-10-14T18:54:33.818860+0000","last_became_peered":"2023-10-14T18:54:33.818860+0000","last_unstale":"2023-10-14T18:54:33.819035+0000","last_undegraded":"2023-10-14T18:54:33.819035+0000","last_fullsized":"2023-10-14T18:54:33.819035+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:42.839183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809614+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:34.784756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.817232+0000","last_change":"2023-10-14T18:54:33.817232+0000","last_active":"2023-10-14T18:54:33.817232+0000","last_peered":"2023-10-14T18:54:33.817232+0000","last_clean":"2023-10-14T18:54:33.817232+0000","last_became_active":"2023-10-14T18:54:33.816803+0000","last_became_peered":"2023-10-14T18:54:33.816803+0000","last_unstale":"2023-10-14T18:54:33.817232+0000","last_undegraded":"2023-10-14T18:54:33.817232+0000","last_fullsized":"2023-10-14T18:54:33.817232+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:46.527749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.808222+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:14:36.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814813+0000","last_change":"2023-10-14T18:54:33.814813+0000","last_active":"2023-10-14T18:54:33.814813+0000","last_peered":"2023-10-14T18:54:33.814813+0000","last_clean":"2023-10-14T18:54:33.814813+0000","last_became_active":"2023-10-14T18:54:33.814615+0000","last_became_peered":"2023-10-14T18:54:33.814615+0000","last_unstale":"2023-10-14T18:54:33.814813+0000","last_undegraded":"2023-10-14T18:54:33.814813+0000","last_fullsized":"2023-10-14T18:54:33.814813+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.809355+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:40:22.050122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.816604+0000","last_change":"2023-10-14T18:54:33.816604+0000","last_active":"2023-10-14T18:54:33.816604+0000","last_peered":"2023-10-14T18:54:33.816604+0000","last_clean":"2023-10-14T18:54:33.816604+0000","last_became_active":"2023-10-14T18:54:33.816322+0000","last_became_peered":"2023-10-14T18:54:33.816322+0000","last_unstale":"2023-10-14T18:54:33.816604+0000","last_undegraded":"2023-10-14T18:54:33.816604+0000","last_fullsized":"2023-10-14T18:54:33.816604+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:54:33.798696+0000","last_change":"2023-10-14T18:54:33.807605+0000","last_active":"2023-10-14T18:54:33.798696+0000","last_peered":"2023-10-14T18:54:33.798696+0000","last_clean":"2023-10-14T18:54:33.798696+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:54:33.798696+0000","last_undegraded":"2023-10-14T18:54:33.798696+0000","last_fullsized":"2023-10-14T18:54:33.798696+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:55.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":8,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T18:54:33.814399+0000","last_change":"2023-10-14T18:54:33.814399+0000","last_active":"2023-10-14T18:54:33.814399+0000","last_peered":"2023-10-14T18:54:33.814399+0000","last_clean":"2023-10-14T18:54:33.814399+0000","last_became_active":"2023-10-14T18:54:33.814128+0000","last_became_peered":"2023-10-14T18:54:33.814128+0000","last_unstale":"2023-10-14T18:54:33.814399+0000","last_undegraded":"2023-10-14T18:54:33.814399+0000","last_fullsized":"2023-10-14T18:54:33.814399+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":311,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T18:54:32.802514+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:54:32.802514+0000","last_peered":"2023-10-14T18:54:32.802514+0000","last_clean":"2023-10-14T18:54:32.802514+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:54:32.802514+0000","last_undegraded":"2023-10-14T18:54:32.802514+0000","last_fullsized":"2023-10-14T18:54:32.802514+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574965,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1482,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193829,"statfs":{"total":200000000,"available":198481551,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.437}]},{"osd":1,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.73699999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.44900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.45300000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60799999999999998,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.95699999999999996},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.73899999999999999,"5min":0.746,"15min":0.78800000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.20899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.76300000000000001},"last":0.54200000000000004}]},{"osd":1,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.439,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":3.4489999999999998},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.83599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48399999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.751},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.66400000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.76800000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.626},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39200000000000002,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.89700000000000002},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.312},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":3.992,"15min":3.992},"last":0.33300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26400000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53900000000000003,"5min":1.252,"15min":1.252},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.373}]},{"osd":3,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41799999999999998,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":1.3340000000000001,"15min":10.574},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.48899999999999999,"15min":0.41399999999999998},"min":{"1min":0.29199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":10.792,"15min":10.792},"last":0.38600000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64200000000000002,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.77000000000000002,"5min":3.536,"15min":3.536},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.52400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.504,"15min":1.504},"last":0.54800000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66100000000000003,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":1.288,"15min":1.288},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.64100000000000001},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":3.577,"15min":3.577},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193824,"statfs":{"total":200000000,"available":198476299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.191,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.47499999999999998,"5min":0.55700000000000005,"15min":0.59599999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.25800000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.623},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.36199999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.64200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.40500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":1.0369999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.52800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.871,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.64000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36299999999999999,"15min":0.33600000000000002},"min":{"1min":0.26100000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.56799999999999995,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.438},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67200000000000004},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.315,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.371}]},{"osd":3,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.34300000000000003,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.33100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60399999999999998,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.78200000000000003,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.52800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.79900000000000004,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.96699999999999997,"15min":0.96999999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.91300000000000003,"15min":1.0429999999999999},"last":0.64400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.26800000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.34300000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.89300000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.375,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.34300000000000003},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.754}]},{"osd":7,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.65900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":906,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194406,"statfs":{"total":200000000,"available":199071919,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80900000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.60599999999999998,"5min":0.70199999999999996,"15min":0.999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58499999999999996,"5min":0.75900000000000001,"15min":0.94999999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57599999999999996,"5min":0.747,"15min":0.80800000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.77400000000000002,"15min":0.89300000000000002},"last":0.82999999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.67900000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.872},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.502}]},{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.433,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.46100000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59499999999999997,"5min":0.74199999999999999,"15min":0.746},"last":0.38},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.80500000000000005,"15min":0.81899999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.44400000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:54:43.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:54:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.580+0000 7ff6a0ec1700 1 Processor -- start 2023-10-14T18:54:43.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 -- start start 2023-10-14T18:54:43.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff69c0b0890 0x7ff69c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 0x7ff69c067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0cb370 con 0x7ff69c06c630 2023-10-14T18:54:43.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0b0c60 con 0x7ff69c0b0890 2023-10-14T18:54:43.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.581+0000 7ff6a0ec1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c06a1e0 con 0x7ff69c0cbd40 2023-10-14T18:54:43.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff69c0b0890 0x7ff69c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff69c0b0890 0x7ff69c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45128/0 (socket says 172.21.15.79:45128) 2023-10-14T18:54:43.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69ad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff69c06c630 0x7ff69c15dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53016/0 (socket says 172.21.15.79:53016) 2023-10-14T18:54:43.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 -- 172.21.15.79:0/3255420354 learned_addr learned my addr 172.21.15.79:0/3255420354 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:43.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff699d9b700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 0x7ff69c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 -- 172.21.15.79:0/3255420354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 msgr2=0x7ff69c067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:43.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 0x7ff69c067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 -- 172.21.15.79:0/3255420354 >> v1:172.21.15.79:6789/0 conn(0x7ff69c06c630 legacy=0x7ff69c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 -- 172.21.15.79:0/3255420354 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c06cb80 con 0x7ff69c0b0890 2023-10-14T18:54:43.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69959a700 1 -- 172.21.15.79:0/3255420354 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603774323 0 0) 0x7ff69c0cb370 con 0x7ff69c06c630 2023-10-14T18:54:43.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff699d9b700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 0x7ff69c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:43.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69a59c700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0cb800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009f20 tx=0x7ff68c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb00a2e00192c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69959a700 1 -- 172.21.15.79:0/3255420354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00e070 con 0x7ff69c0b0890 2023-10-14T18:54:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69959a700 1 -- 172.21.15.79:0/3255420354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c00ba80 con 0x7ff69c0b0890 2023-10-14T18:54:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.582+0000 7ff69959a700 1 -- 172.21.15.79:0/3255420354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0092e0 con 0x7ff69c0b0890 2023-10-14T18:54:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/3255420354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 msgr2=0x7ff69c0cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0cb800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009f20 tx=0x7ff68c009840 comp rx=0 tx=0).stop 2023-10-14T18:54:43.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/3255420354 shutdown_connections 2023-10-14T18:54:43.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0cb800 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/3255420354 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c0cbd40 0x7ff69c067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/3255420354 >> 172.21.15.79:0/3255420354 conn(0x7ff69c06fe50 msgr2=0x7ff69c069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/3255420354 shutdown_connections 2023-10-14T18:54:43.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.583+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/3255420354 wait complete. 2023-10-14T18:54:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.584+0000 7ff6a0ec1700 1 Processor -- start 2023-10-14T18:54:43.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.584+0000 7ff6a0ec1700 1 -- start start 2023-10-14T18:54:43.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 0x7ff69c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 0x7ff69c068630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b3050 con 0x7ff69c0b0890 2023-10-14T18:54:43.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b2440 con 0x7ff69c0cbd40 2023-10-14T18:54:43.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0b2720 con 0x7ff69c06c630 2023-10-14T18:54:43.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45134/0 (socket says 172.21.15.79:45134) 2023-10-14T18:54:43.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 -- 172.21.15.79:0/1622394602 learned_addr learned my addr 172.21.15.79:0/1622394602 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:43.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff69a59c700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 0x7ff69c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff69ad9d700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 0x7ff69c068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 -- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 msgr2=0x7ff69c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 0x7ff69c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 -- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 msgr2=0x7ff69c068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 0x7ff69c068630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 -- 172.21.15.79:0/1622394602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009ae0 con 0x7ff69c0b0890 2023-10-14T18:54:43.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff69a59c700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 0x7ff69c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:43.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff69ad9d700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 0x7ff69c068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:43.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff699d9b700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e8a0 tx=0x7ff690008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000c430 con 0x7ff69c0b0890 2023-10-14T18:54:43.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69000c590 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0b2a00 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.585+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000c950 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.586+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c0c7720 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.586+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c04c3c0 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.587+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff69000cd00 con 0x7ff69c0b0890 2023-10-14T18:54:43.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.587+0000 7ff68a7fc700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 0x7ff67c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.587+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff690084360 con 0x7ff69c0b0890 2023-10-14T18:54:43.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.587+0000 7ff69a59c700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 0x7ff67c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.588+0000 7ff69a59c700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 0x7ff67c0693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009880 tx=0x7ff68c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.591+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6900515d0 con 0x7ff69c0b0890 2023-10-14T18:54:43.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.769+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff69c06cdc0 con 0x7ff67c066f30 2023-10-14T18:54:43.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.777+0000 7ff68a7fc700 1 -- 172.21.15.79:0/1622394602 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286021 (secure 0 0 0) 0x7ff69c06cdc0 con 0x7ff67c066f30 2023-10-14T18:54:43.781 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:43.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 msgr2=0x7ff67c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 0x7ff67c0693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009880 tx=0x7ff68c018000 comp rx=0 tx=0).stop 2023-10-14T18:54:43.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 msgr2=0x7ff69c0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e8a0 tx=0x7ff690008040 comp rx=0 tx=0).stop 2023-10-14T18:54:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 shutdown_connections 2023-10-14T18:54:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff67c066f30 0x7ff67c0693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff69c0cbd40 0x7ff69c068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff69c06c630 0x7ff69c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 --2- 172.21.15.79:0/1622394602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff69c0b0890 0x7ff69c0b1e10 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 >> 172.21.15.79:0/1622394602 conn(0x7ff69c06fe50 msgr2=0x7ff69c15bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 shutdown_connections 2023-10-14T18:54:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.781+0000 7ff6a0ec1700 1 -- 172.21.15.79:0/1622394602 wait complete. 2023-10-14T18:54:43.786 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:54:43.793 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2023-10-14T18:54:42.473112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8558,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553941,"statfs":{"total":1600000000,"available":1591236503,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002051"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.816175+0000","last_change":"2023-10-14T18:54:34.815911+0000","last_active":"2023-10-14T18:54:34.816175+0000","last_peered":"2023-10-14T18:54:34.816175+0000","last_clean":"2023-10-14T18:54:34.816175+0000","last_became_active":"2023-10-14T18:54:34.814997+0000","last_became_peered":"2023-10-14T18:54:34.814997+0000","last_unstale":"2023-10-14T18:54:34.816175+0000","last_undegraded":"2023-10-14T18:54:34.816175+0000","last_fullsized":"2023-10-14T18:54:34.816175+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.816168+0000","last_change":"2023-10-14T18:54:34.815788+0000","last_active":"2023-10-14T18:54:34.816168+0000","last_peered":"2023-10-14T18:54:34.816168+0000","last_clean":"2023-10-14T18:54:34.816168+0000","last_became_active":"2023-10-14T18:54:34.815569+0000","last_became_peered":"2023-10-14T18:54:34.815569+0000","last_unstale":"2023-10-14T18:54:34.816168+0000","last_undegraded":"2023-10-14T18:54:34.816168+0000","last_fullsized":"2023-10-14T18:54:34.816168+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:53.912812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821751+0000","last_change":"2023-10-14T18:54:34.820040+0000","last_active":"2023-10-14T18:54:34.821751+0000","last_peered":"2023-10-14T18:54:34.821751+0000","last_clean":"2023-10-14T18:54:34.821751+0000","last_became_active":"2023-10-14T18:54:34.819319+0000","last_became_peered":"2023-10-14T18:54:34.819319+0000","last_unstale":"2023-10-14T18:54:34.821751+0000","last_undegraded":"2023-10-14T18:54:34.821751+0000","last_fullsized":"2023-10-14T18:54:34.821751+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:26.983687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821245+0000","last_change":"2023-10-14T18:54:34.819411+0000","last_active":"2023-10-14T18:54:34.821245+0000","last_peered":"2023-10-14T18:54:34.821245+0000","last_clean":"2023-10-14T18:54:34.821245+0000","last_became_active":"2023-10-14T18:54:34.819175+0000","last_became_peered":"2023-10-14T18:54:34.819175+0000","last_unstale":"2023-10-14T18:54:34.821245+0000","last_undegraded":"2023-10-14T18:54:34.821245+0000","last_fullsized":"2023-10-14T18:54:34.821245+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811756+0000","last_change":"2023-10-14T18:54:34.811689+0000","last_active":"2023-10-14T18:54:34.811756+0000","last_peered":"2023-10-14T18:54:34.811756+0000","last_clean":"2023-10-14T18:54:34.811756+0000","last_became_active":"2023-10-14T18:54:34.811263+0000","last_became_peered":"2023-10-14T18:54:34.811263+0000","last_unstale":"2023-10-14T18:54:34.811756+0000","last_undegraded":"2023-10-14T18:54:34.811756+0000","last_fullsized":"2023-10-14T18:54:34.811756+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:13.767371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.816930+0000","last_change":"2023-10-14T18:54:34.816731+0000","last_active":"2023-10-14T18:54:34.816930+0000","last_peered":"2023-10-14T18:54:34.816930+0000","last_clean":"2023-10-14T18:54:34.816930+0000","last_became_active":"2023-10-14T18:54:34.816501+0000","last_became_peered":"2023-10-14T18:54:34.816501+0000","last_unstale":"2023-10-14T18:54:34.816930+0000","last_undegraded":"2023-10-14T18:54:34.816930+0000","last_fullsized":"2023-10-14T18:54:34.816930+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.820093+0000","last_change":"2023-10-14T18:54:34.820031+0000","last_active":"2023-10-14T18:54:34.820093+0000","last_peered":"2023-10-14T18:54:34.820093+0000","last_clean":"2023-10-14T18:54:34.820093+0000","last_became_active":"2023-10-14T18:54:34.819809+0000","last_became_peered":"2023-10-14T18:54:34.819809+0000","last_unstale":"2023-10-14T18:54:34.820093+0000","last_undegraded":"2023-10-14T18:54:34.820093+0000","last_fullsized":"2023-10-14T18:54:34.820093+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:12.656865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.813538+0000","last_change":"2023-10-14T18:54:34.813475+0000","last_active":"2023-10-14T18:54:34.813538+0000","last_peered":"2023-10-14T18:54:34.813538+0000","last_clean":"2023-10-14T18:54:34.813538+0000","last_became_active":"2023-10-14T18:54:34.813268+0000","last_became_peered":"2023-10-14T18:54:34.813268+0000","last_unstale":"2023-10-14T18:54:34.813538+0000","last_undegraded":"2023-10-14T18:54:34.813538+0000","last_fullsized":"2023-10-14T18:54:34.813538+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:38.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817602+0000","last_change":"2023-10-14T18:54:34.817531+0000","last_active":"2023-10-14T18:54:34.817602+0000","last_peered":"2023-10-14T18:54:34.817602+0000","last_clean":"2023-10-14T18:54:34.817602+0000","last_became_active":"2023-10-14T18:54:34.817288+0000","last_became_peered":"2023-10-14T18:54:34.817288+0000","last_unstale":"2023-10-14T18:54:34.817602+0000","last_undegraded":"2023-10-14T18:54:34.817602+0000","last_fullsized":"2023-10-14T18:54:34.817602+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:06.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.822307+0000","last_change":"2023-10-14T18:54:34.822236+0000","last_active":"2023-10-14T18:54:34.822307+0000","last_peered":"2023-10-14T18:54:34.822307+0000","last_clean":"2023-10-14T18:54:34.822307+0000","last_became_active":"2023-10-14T18:54:34.821998+0000","last_became_peered":"2023-10-14T18:54:34.821998+0000","last_unstale":"2023-10-14T18:54:34.822307+0000","last_undegraded":"2023-10-14T18:54:34.822307+0000","last_fullsized":"2023-10-14T18:54:34.822307+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:16.663211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818949+0000","last_change":"2023-10-14T18:54:34.818888+0000","last_active":"2023-10-14T18:54:34.818949+0000","last_peered":"2023-10-14T18:54:34.818949+0000","last_clean":"2023-10-14T18:54:34.818949+0000","last_became_active":"2023-10-14T18:54:34.818504+0000","last_became_peered":"2023-10-14T18:54:34.818504+0000","last_unstale":"2023-10-14T18:54:34.818949+0000","last_undegraded":"2023-10-14T18:54:34.818949+0000","last_fullsized":"2023-10-14T18:54:34.818949+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:06.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.814683+0000","last_change":"2023-10-14T18:54:34.813556+0000","last_active":"2023-10-14T18:54:34.814683+0000","last_peered":"2023-10-14T18:54:34.814683+0000","last_clean":"2023-10-14T18:54:34.814683+0000","last_became_active":"2023-10-14T18:54:34.813312+0000","last_became_peered":"2023-10-14T18:54:34.813312+0000","last_unstale":"2023-10-14T18:54:34.814683+0000","last_undegraded":"2023-10-14T18:54:34.814683+0000","last_fullsized":"2023-10-14T18:54:34.814683+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:43.847702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.812259+0000","last_change":"2023-10-14T18:54:34.811955+0000","last_active":"2023-10-14T18:54:34.812259+0000","last_peered":"2023-10-14T18:54:34.812259+0000","last_clean":"2023-10-14T18:54:34.812259+0000","last_became_active":"2023-10-14T18:54:34.811124+0000","last_became_peered":"2023-10-14T18:54:34.811124+0000","last_unstale":"2023-10-14T18:54:34.812259+0000","last_undegraded":"2023-10-14T18:54:34.812259+0000","last_fullsized":"2023-10-14T18:54:34.812259+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:57.791639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818280+0000","last_change":"2023-10-14T18:54:34.817540+0000","last_active":"2023-10-14T18:54:34.818280+0000","last_peered":"2023-10-14T18:54:34.818280+0000","last_clean":"2023-10-14T18:54:34.818280+0000","last_became_active":"2023-10-14T18:54:34.817175+0000","last_became_peered":"2023-10-14T18:54:34.817175+0000","last_unstale":"2023-10-14T18:54:34.818280+0000","last_undegraded":"2023-10-14T18:54:34.818280+0000","last_fullsized":"2023-10-14T18:54:34.818280+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:53.912812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821133+0000","last_change":"2023-10-14T18:54:34.821004+0000","last_active":"2023-10-14T18:54:34.821133+0000","last_peered":"2023-10-14T18:54:34.821133+0000","last_clean":"2023-10-14T18:54:34.821133+0000","last_became_active":"2023-10-14T18:54:34.820775+0000","last_became_peered":"2023-10-14T18:54:34.820775+0000","last_unstale":"2023-10-14T18:54:34.821133+0000","last_undegraded":"2023-10-14T18:54:34.821133+0000","last_fullsized":"2023-10-14T18:54:34.821133+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:04.652347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817875+0000","last_change":"2023-10-14T18:54:34.817811+0000","last_active":"2023-10-14T18:54:34.817875+0000","last_peered":"2023-10-14T18:54:34.817875+0000","last_clean":"2023-10-14T18:54:34.817875+0000","last_became_active":"2023-10-14T18:54:34.817524+0000","last_became_peered":"2023-10-14T18:54:34.817524+0000","last_unstale":"2023-10-14T18:54:34.817875+0000","last_undegraded":"2023-10-14T18:54:34.817875+0000","last_fullsized":"2023-10-14T18:54:34.817875+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:36:54.101751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.810405+0000","last_change":"2023-10-14T18:54:34.810025+0000","last_active":"2023-10-14T18:54:34.810405+0000","last_peered":"2023-10-14T18:54:34.810405+0000","last_clean":"2023-10-14T18:54:34.810405+0000","last_became_active":"2023-10-14T18:54:34.809788+0000","last_became_peered":"2023-10-14T18:54:34.809788+0000","last_unstale":"2023-10-14T18:54:34.810405+0000","last_undegraded":"2023-10-14T18:54:34.810405+0000","last_fullsized":"2023-10-14T18:54:34.810405+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:49:53.847772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.815236+0000","last_change":"2023-10-14T18:54:34.814091+0000","last_active":"2023-10-14T18:54:34.815236+0000","last_peered":"2023-10-14T18:54:34.815236+0000","last_clean":"2023-10-14T18:54:34.815236+0000","last_became_active":"2023-10-14T18:54:34.813908+0000","last_became_peered":"2023-10-14T18:54:34.813908+0000","last_unstale":"2023-10-14T18:54:34.815236+0000","last_undegraded":"2023-10-14T18:54:34.815236+0000","last_fullsized":"2023-10-14T18:54:34.815236+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:49:24.690085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818302+0000","last_change":"2023-10-14T18:54:34.818108+0000","last_active":"2023-10-14T18:54:34.818302+0000","last_peered":"2023-10-14T18:54:34.818302+0000","last_clean":"2023-10-14T18:54:34.818302+0000","last_became_active":"2023-10-14T18:54:34.817227+0000","last_became_peered":"2023-10-14T18:54:34.817227+0000","last_unstale":"2023-10-14T18:54:34.818302+0000","last_undegraded":"2023-10-14T18:54:34.818302+0000","last_fullsized":"2023-10-14T18:54:34.818302+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:31.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821495+0000","last_change":"2023-10-14T18:54:34.821003+0000","last_active":"2023-10-14T18:54:34.821495+0000","last_peered":"2023-10-14T18:54:34.821495+0000","last_clean":"2023-10-14T18:54:34.821495+0000","last_became_active":"2023-10-14T18:54:34.820759+0000","last_became_peered":"2023-10-14T18:54:34.820759+0000","last_unstale":"2023-10-14T18:54:34.821495+0000","last_undegraded":"2023-10-14T18:54:34.821495+0000","last_fullsized":"2023-10-14T18:54:34.821495+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:26:09.240284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818615+0000","last_change":"2023-10-14T18:54:34.818471+0000","last_active":"2023-10-14T18:54:34.818615+0000","last_peered":"2023-10-14T18:54:34.818615+0000","last_clean":"2023-10-14T18:54:34.818615+0000","last_became_active":"2023-10-14T18:54:34.818252+0000","last_became_peered":"2023-10-14T18:54:34.818252+0000","last_unstale":"2023-10-14T18:54:34.818615+0000","last_undegraded":"2023-10-14T18:54:34.818615+0000","last_fullsized":"2023-10-14T18:54:34.818615+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:02.275282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819018+0000","last_change":"2023-10-14T18:54:34.818201+0000","last_active":"2023-10-14T18:54:34.819018+0000","last_peered":"2023-10-14T18:54:34.819018+0000","last_clean":"2023-10-14T18:54:34.819018+0000","last_became_active":"2023-10-14T18:54:34.817814+0000","last_became_peered":"2023-10-14T18:54:34.817814+0000","last_unstale":"2023-10-14T18:54:34.819018+0000","last_undegraded":"2023-10-14T18:54:34.819018+0000","last_fullsized":"2023-10-14T18:54:34.819018+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:31.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821297+0000","last_change":"2023-10-14T18:54:34.820091+0000","last_active":"2023-10-14T18:54:34.821297+0000","last_peered":"2023-10-14T18:54:34.821297+0000","last_clean":"2023-10-14T18:54:34.821297+0000","last_became_active":"2023-10-14T18:54:34.819859+0000","last_became_peered":"2023-10-14T18:54:34.819859+0000","last_unstale":"2023-10-14T18:54:34.821297+0000","last_undegraded":"2023-10-14T18:54:34.821297+0000","last_fullsized":"2023-10-14T18:54:34.821297+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:06.614225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819526+0000","last_change":"2023-10-14T18:54:34.819275+0000","last_active":"2023-10-14T18:54:34.819526+0000","last_peered":"2023-10-14T18:54:34.819526+0000","last_clean":"2023-10-14T18:54:34.819526+0000","last_became_active":"2023-10-14T18:54:34.818921+0000","last_became_peered":"2023-10-14T18:54:34.818921+0000","last_unstale":"2023-10-14T18:54:34.819526+0000","last_undegraded":"2023-10-14T18:54:34.819526+0000","last_fullsized":"2023-10-14T18:54:34.819526+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:51:22.389398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817550+0000","last_change":"2023-10-14T18:54:34.817195+0000","last_active":"2023-10-14T18:54:34.817550+0000","last_peered":"2023-10-14T18:54:34.817550+0000","last_clean":"2023-10-14T18:54:34.817550+0000","last_became_active":"2023-10-14T18:54:34.816968+0000","last_became_peered":"2023-10-14T18:54:34.816968+0000","last_unstale":"2023-10-14T18:54:34.817550+0000","last_undegraded":"2023-10-14T18:54:34.817550+0000","last_fullsized":"2023-10-14T18:54:34.817550+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:51:01.623033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.816192+0000","last_change":"2023-10-14T18:54:34.816044+0000","last_active":"2023-10-14T18:54:34.816192+0000","last_peered":"2023-10-14T18:54:34.816192+0000","last_clean":"2023-10-14T18:54:34.816192+0000","last_became_active":"2023-10-14T18:54:34.815686+0000","last_became_peered":"2023-10-14T18:54:34.815686+0000","last_unstale":"2023-10-14T18:54:34.816192+0000","last_undegraded":"2023-10-14T18:54:34.816192+0000","last_fullsized":"2023-10-14T18:54:34.816192+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:27:53.912812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.822541+0000","last_change":"2023-10-14T18:54:34.822469+0000","last_active":"2023-10-14T18:54:34.822541+0000","last_peered":"2023-10-14T18:54:34.822541+0000","last_clean":"2023-10-14T18:54:34.822541+0000","last_became_active":"2023-10-14T18:54:34.822236+0000","last_became_peered":"2023-10-14T18:54:34.822236+0000","last_unstale":"2023-10-14T18:54:34.822541+0000","last_undegraded":"2023-10-14T18:54:34.822541+0000","last_fullsized":"2023-10-14T18:54:34.822541+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:01:22.182789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817594+0000","last_change":"2023-10-14T18:54:34.817302+0000","last_active":"2023-10-14T18:54:34.817594+0000","last_peered":"2023-10-14T18:54:34.817594+0000","last_clean":"2023-10-14T18:54:34.817594+0000","last_became_active":"2023-10-14T18:54:34.815725+0000","last_became_peered":"2023-10-14T18:54:34.815725+0000","last_unstale":"2023-10-14T18:54:34.817594+0000","last_undegraded":"2023-10-14T18:54:34.817594+0000","last_fullsized":"2023-10-14T18:54:34.817594+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:32:51.394454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818392+0000","last_change":"2023-10-14T18:54:34.818348+0000","last_active":"2023-10-14T18:54:34.818392+0000","last_peered":"2023-10-14T18:54:34.818392+0000","last_clean":"2023-10-14T18:54:34.818392+0000","last_became_active":"2023-10-14T18:54:34.817565+0000","last_became_peered":"2023-10-14T18:54:34.817565+0000","last_unstale":"2023-10-14T18:54:34.818392+0000","last_undegraded":"2023-10-14T18:54:34.818392+0000","last_fullsized":"2023-10-14T18:54:34.818392+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821515+0000","last_change":"2023-10-14T18:54:34.820836+0000","last_active":"2023-10-14T18:54:34.821515+0000","last_peered":"2023-10-14T18:54:34.821515+0000","last_clean":"2023-10-14T18:54:34.821515+0000","last_became_active":"2023-10-14T18:54:34.820602+0000","last_became_peered":"2023-10-14T18:54:34.820602+0000","last_unstale":"2023-10-14T18:54:34.821515+0000","last_undegraded":"2023-10-14T18:54:34.821515+0000","last_fullsized":"2023-10-14T18:54:34.821515+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.813558+0000","last_change":"2023-10-14T18:54:34.813497+0000","last_active":"2023-10-14T18:54:34.813558+0000","last_peered":"2023-10-14T18:54:34.813558+0000","last_clean":"2023-10-14T18:54:34.813558+0000","last_became_active":"2023-10-14T18:54:34.813273+0000","last_became_peered":"2023-10-14T18:54:34.813273+0000","last_unstale":"2023-10-14T18:54:34.813558+0000","last_undegraded":"2023-10-14T18:54:34.813558+0000","last_fullsized":"2023-10-14T18:54:34.813558+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:47.536268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818733+0000","last_change":"2023-10-14T18:54:34.818389+0000","last_active":"2023-10-14T18:54:34.818733+0000","last_peered":"2023-10-14T18:54:34.818733+0000","last_clean":"2023-10-14T18:54:34.818733+0000","last_became_active":"2023-10-14T18:54:34.817973+0000","last_became_peered":"2023-10-14T18:54:34.817973+0000","last_unstale":"2023-10-14T18:54:34.818733+0000","last_undegraded":"2023-10-14T18:54:34.818733+0000","last_fullsized":"2023-10-14T18:54:34.818733+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:36.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.810444+0000","last_change":"2023-10-14T18:54:34.810232+0000","last_active":"2023-10-14T18:54:34.810444+0000","last_peered":"2023-10-14T18:54:34.810444+0000","last_clean":"2023-10-14T18:54:34.810444+0000","last_became_active":"2023-10-14T18:54:34.809961+0000","last_became_peered":"2023-10-14T18:54:34.809961+0000","last_unstale":"2023-10-14T18:54:34.810444+0000","last_undegraded":"2023-10-14T18:54:34.810444+0000","last_fullsized":"2023-10-14T18:54:34.810444+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:22:12.048421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"169'4","reported_seq":14,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827812+0000","last_change":"2023-10-14T18:54:33.815018+0000","last_active":"2023-10-14T18:54:34.827812+0000","last_peered":"2023-10-14T18:54:34.827812+0000","last_clean":"2023-10-14T18:54:34.827812+0000","last_became_active":"2023-10-14T18:54:33.814372+0000","last_became_peered":"2023-10-14T18:54:33.814372+0000","last_unstale":"2023-10-14T18:54:34.827812+0000","last_undegraded":"2023-10-14T18:54:34.827812+0000","last_fullsized":"2023-10-14T18:54:34.827812+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:44:47.736952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.820301+0000","last_change":"2023-10-14T18:54:34.820217+0000","last_active":"2023-10-14T18:54:34.820301+0000","last_peered":"2023-10-14T18:54:34.820301+0000","last_clean":"2023-10-14T18:54:34.820301+0000","last_became_active":"2023-10-14T18:54:34.819796+0000","last_became_peered":"2023-10-14T18:54:34.819796+0000","last_unstale":"2023-10-14T18:54:34.820301+0000","last_undegraded":"2023-10-14T18:54:34.820301+0000","last_fullsized":"2023-10-14T18:54:34.820301+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:00:31.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"169'1","reported_seq":11,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827357+0000","last_change":"2023-10-14T18:54:33.816693+0000","last_active":"2023-10-14T18:54:34.827357+0000","last_peered":"2023-10-14T18:54:34.827357+0000","last_clean":"2023-10-14T18:54:34.827357+0000","last_became_active":"2023-10-14T18:54:33.816478+0000","last_became_peered":"2023-10-14T18:54:33.816478+0000","last_unstale":"2023-10-14T18:54:34.827357+0000","last_undegraded":"2023-10-14T18:54:34.827357+0000","last_fullsized":"2023-10-14T18:54:34.827357+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:39:35.539138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818322+0000","last_change":"2023-10-14T18:54:34.818239+0000","last_active":"2023-10-14T18:54:34.818322+0000","last_peered":"2023-10-14T18:54:34.818322+0000","last_clean":"2023-10-14T18:54:34.818322+0000","last_became_active":"2023-10-14T18:54:34.817938+0000","last_became_peered":"2023-10-14T18:54:34.817938+0000","last_unstale":"2023-10-14T18:54:34.818322+0000","last_undegraded":"2023-10-14T18:54:34.818322+0000","last_fullsized":"2023-10-14T18:54:34.818322+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827729+0000","last_change":"2023-10-14T18:54:33.818725+0000","last_active":"2023-10-14T18:54:34.827729+0000","last_peered":"2023-10-14T18:54:34.827729+0000","last_clean":"2023-10-14T18:54:34.827729+0000","last_became_active":"2023-10-14T18:54:33.818408+0000","last_became_peered":"2023-10-14T18:54:33.818408+0000","last_unstale":"2023-10-14T18:54:34.827729+0000","last_undegraded":"2023-10-14T18:54:34.827729+0000","last_fullsized":"2023-10-14T18:54:34.827729+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.810585+0000","last_change":"2023-10-14T18:54:34.810442+0000","last_active":"2023-10-14T18:54:34.810585+0000","last_peered":"2023-10-14T18:54:34.810585+0000","last_clean":"2023-10-14T18:54:34.810585+0000","last_became_active":"2023-10-14T18:54:34.810202+0000","last_became_peered":"2023-10-14T18:54:34.810202+0000","last_unstale":"2023-10-14T18:54:34.810585+0000","last_undegraded":"2023-10-14T18:54:34.810585+0000","last_fullsized":"2023-10-14T18:54:34.810585+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:00:46.473740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827080+0000","last_change":"2023-10-14T18:54:33.818960+0000","last_active":"2023-10-14T18:54:34.827080+0000","last_peered":"2023-10-14T18:54:34.827080+0000","last_clean":"2023-10-14T18:54:34.827080+0000","last_became_active":"2023-10-14T18:54:33.815975+0000","last_became_peered":"2023-10-14T18:54:33.815975+0000","last_unstale":"2023-10-14T18:54:34.827080+0000","last_undegraded":"2023-10-14T18:54:34.827080+0000","last_fullsized":"2023-10-14T18:54:34.827080+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821093+0000","last_change":"2023-10-14T18:54:34.820834+0000","last_active":"2023-10-14T18:54:34.821093+0000","last_peered":"2023-10-14T18:54:34.821093+0000","last_clean":"2023-10-14T18:54:34.821093+0000","last_became_active":"2023-10-14T18:54:34.820511+0000","last_became_peered":"2023-10-14T18:54:34.820511+0000","last_unstale":"2023-10-14T18:54:34.821093+0000","last_undegraded":"2023-10-14T18:54:34.821093+0000","last_fullsized":"2023-10-14T18:54:34.821093+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:50.671268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"169'1","reported_seq":11,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.828609+0000","last_change":"2023-10-14T18:54:33.811124+0000","last_active":"2023-10-14T18:54:34.828609+0000","last_peered":"2023-10-14T18:54:34.828609+0000","last_clean":"2023-10-14T18:54:34.828609+0000","last_became_active":"2023-10-14T18:54:33.810900+0000","last_became_peered":"2023-10-14T18:54:33.810900+0000","last_unstale":"2023-10-14T18:54:34.828609+0000","last_undegraded":"2023-10-14T18:54:34.828609+0000","last_fullsized":"2023-10-14T18:54:34.828609+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:06.386916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821279+0000","last_change":"2023-10-14T18:54:34.820084+0000","last_active":"2023-10-14T18:54:34.821279+0000","last_peered":"2023-10-14T18:54:34.821279+0000","last_clean":"2023-10-14T18:54:34.821279+0000","last_became_active":"2023-10-14T18:54:34.819776+0000","last_became_peered":"2023-10-14T18:54:34.819776+0000","last_unstale":"2023-10-14T18:54:34.821279+0000","last_undegraded":"2023-10-14T18:54:34.821279+0000","last_fullsized":"2023-10-14T18:54:34.821279+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:06.835252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"169'1","reported_seq":11,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827401+0000","last_change":"2023-10-14T18:54:33.813164+0000","last_active":"2023-10-14T18:54:34.827401+0000","last_peered":"2023-10-14T18:54:34.827401+0000","last_clean":"2023-10-14T18:54:34.827401+0000","last_became_active":"2023-10-14T18:54:33.812945+0000","last_became_peered":"2023-10-14T18:54:33.812945+0000","last_unstale":"2023-10-14T18:54:34.827401+0000","last_undegraded":"2023-10-14T18:54:34.827401+0000","last_fullsized":"2023-10-14T18:54:34.827401+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:13:35.760324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819808+0000","last_change":"2023-10-14T18:54:34.818593+0000","last_active":"2023-10-14T18:54:34.819808+0000","last_peered":"2023-10-14T18:54:34.819808+0000","last_clean":"2023-10-14T18:54:34.819808+0000","last_became_active":"2023-10-14T18:54:34.818381+0000","last_became_peered":"2023-10-14T18:54:34.818381+0000","last_unstale":"2023-10-14T18:54:34.819808+0000","last_undegraded":"2023-10-14T18:54:34.819808+0000","last_fullsized":"2023-10-14T18:54:34.819808+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:51.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.813831+0000","last_change":"2023-10-14T18:54:33.813316+0000","last_active":"2023-10-14T18:54:34.813831+0000","last_peered":"2023-10-14T18:54:34.813831+0000","last_clean":"2023-10-14T18:54:34.813831+0000","last_became_active":"2023-10-14T18:54:33.813103+0000","last_became_peered":"2023-10-14T18:54:33.813103+0000","last_unstale":"2023-10-14T18:54:34.813831+0000","last_undegraded":"2023-10-14T18:54:34.813831+0000","last_fullsized":"2023-10-14T18:54:34.813831+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:00.825491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.815517+0000","last_change":"2023-10-14T18:54:34.815367+0000","last_active":"2023-10-14T18:54:34.815517+0000","last_peered":"2023-10-14T18:54:34.815517+0000","last_clean":"2023-10-14T18:54:34.815517+0000","last_became_active":"2023-10-14T18:54:34.815117+0000","last_became_peered":"2023-10-14T18:54:34.815117+0000","last_unstale":"2023-10-14T18:54:34.815517+0000","last_undegraded":"2023-10-14T18:54:34.815517+0000","last_fullsized":"2023-10-14T18:54:34.815517+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:17.025064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.820345+0000","last_change":"2023-10-14T18:54:33.818566+0000","last_active":"2023-10-14T18:54:34.820345+0000","last_peered":"2023-10-14T18:54:34.820345+0000","last_clean":"2023-10-14T18:54:34.820345+0000","last_became_active":"2023-10-14T18:54:33.817872+0000","last_became_peered":"2023-10-14T18:54:33.817872+0000","last_unstale":"2023-10-14T18:54:34.820345+0000","last_undegraded":"2023-10-14T18:54:34.820345+0000","last_fullsized":"2023-10-14T18:54:34.820345+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:10:56.783121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817432+0000","last_change":"2023-10-14T18:54:34.817178+0000","last_active":"2023-10-14T18:54:34.817432+0000","last_peered":"2023-10-14T18:54:34.817432+0000","last_clean":"2023-10-14T18:54:34.817432+0000","last_became_active":"2023-10-14T18:54:34.816936+0000","last_became_peered":"2023-10-14T18:54:34.816936+0000","last_unstale":"2023-10-14T18:54:34.817432+0000","last_undegraded":"2023-10-14T18:54:34.817432+0000","last_fullsized":"2023-10-14T18:54:34.817432+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:54.137954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811114+0000","last_change":"2023-10-14T18:54:33.815623+0000","last_active":"2023-10-14T18:54:34.811114+0000","last_peered":"2023-10-14T18:54:34.811114+0000","last_clean":"2023-10-14T18:54:34.811114+0000","last_became_active":"2023-10-14T18:54:33.814905+0000","last_became_peered":"2023-10-14T18:54:33.814905+0000","last_unstale":"2023-10-14T18:54:34.811114+0000","last_undegraded":"2023-10-14T18:54:34.811114+0000","last_fullsized":"2023-10-14T18:54:34.811114+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:53:27.698820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.810423+0000","last_change":"2023-10-14T18:54:34.810142+0000","last_active":"2023-10-14T18:54:34.810423+0000","last_peered":"2023-10-14T18:54:34.810423+0000","last_clean":"2023-10-14T18:54:34.810423+0000","last_became_active":"2023-10-14T18:54:34.809544+0000","last_became_peered":"2023-10-14T18:54:34.809544+0000","last_unstale":"2023-10-14T18:54:34.810423+0000","last_undegraded":"2023-10-14T18:54:34.810423+0000","last_fullsized":"2023-10-14T18:54:34.810423+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:09:27.758035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.808946+0000","last_change":"2023-10-14T18:54:33.813724+0000","last_active":"2023-10-14T18:54:34.808946+0000","last_peered":"2023-10-14T18:54:34.808946+0000","last_clean":"2023-10-14T18:54:34.808946+0000","last_became_active":"2023-10-14T18:54:33.813499+0000","last_became_peered":"2023-10-14T18:54:33.813499+0000","last_unstale":"2023-10-14T18:54:34.808946+0000","last_undegraded":"2023-10-14T18:54:34.808946+0000","last_fullsized":"2023-10-14T18:54:34.808946+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:15:50.648829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818749+0000","last_change":"2023-10-14T18:54:34.818678+0000","last_active":"2023-10-14T18:54:34.818749+0000","last_peered":"2023-10-14T18:54:34.818749+0000","last_clean":"2023-10-14T18:54:34.818749+0000","last_became_active":"2023-10-14T18:54:34.818468+0000","last_became_peered":"2023-10-14T18:54:34.818468+0000","last_unstale":"2023-10-14T18:54:34.818749+0000","last_undegraded":"2023-10-14T18:54:34.818749+0000","last_fullsized":"2023-10-14T18:54:34.818749+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:45.485301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"169'6","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.830415+0000","last_change":"2023-10-14T18:54:33.811859+0000","last_active":"2023-10-14T18:54:34.830415+0000","last_peered":"2023-10-14T18:54:34.830415+0000","last_clean":"2023-10-14T18:54:34.830415+0000","last_became_active":"2023-10-14T18:54:33.811644+0000","last_became_peered":"2023-10-14T18:54:33.811644+0000","last_unstale":"2023-10-14T18:54:34.830415+0000","last_undegraded":"2023-10-14T18:54:34.830415+0000","last_fullsized":"2023-10-14T18:54:34.830415+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:05.856792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819431+0000","last_change":"2023-10-14T18:54:34.819229+0000","last_active":"2023-10-14T18:54:34.819431+0000","last_peered":"2023-10-14T18:54:34.819431+0000","last_clean":"2023-10-14T18:54:34.819431+0000","last_became_active":"2023-10-14T18:54:34.818972+0000","last_became_peered":"2023-10-14T18:54:34.818972+0000","last_unstale":"2023-10-14T18:54:34.819431+0000","last_undegraded":"2023-10-14T18:54:34.819431+0000","last_fullsized":"2023-10-14T18:54:34.819431+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:22:42.226227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827674+0000","last_change":"2023-10-14T18:54:33.815687+0000","last_active":"2023-10-14T18:54:34.827674+0000","last_peered":"2023-10-14T18:54:34.827674+0000","last_clean":"2023-10-14T18:54:34.827674+0000","last_became_active":"2023-10-14T18:54:33.815462+0000","last_became_peered":"2023-10-14T18:54:33.815462+0000","last_unstale":"2023-10-14T18:54:34.827674+0000","last_undegraded":"2023-10-14T18:54:34.827674+0000","last_fullsized":"2023-10-14T18:54:34.827674+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.813540+0000","last_change":"2023-10-14T18:54:34.813256+0000","last_active":"2023-10-14T18:54:34.813540+0000","last_peered":"2023-10-14T18:54:34.813540+0000","last_clean":"2023-10-14T18:54:34.813540+0000","last_became_active":"2023-10-14T18:54:34.813002+0000","last_became_peered":"2023-10-14T18:54:34.813002+0000","last_unstale":"2023-10-14T18:54:34.813540+0000","last_undegraded":"2023-10-14T18:54:34.813540+0000","last_fullsized":"2023-10-14T18:54:34.813540+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:51.029607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811775+0000","last_change":"2023-10-14T18:54:33.813862+0000","last_active":"2023-10-14T18:54:34.811775+0000","last_peered":"2023-10-14T18:54:34.811775+0000","last_clean":"2023-10-14T18:54:34.811775+0000","last_became_active":"2023-10-14T18:54:33.813581+0000","last_became_peered":"2023-10-14T18:54:33.813581+0000","last_unstale":"2023-10-14T18:54:34.811775+0000","last_undegraded":"2023-10-14T18:54:34.811775+0000","last_fullsized":"2023-10-14T18:54:34.811775+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:21.164749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.812279+0000","last_change":"2023-10-14T18:54:34.812103+0000","last_active":"2023-10-14T18:54:34.812279+0000","last_peered":"2023-10-14T18:54:34.812279+0000","last_clean":"2023-10-14T18:54:34.812279+0000","last_became_active":"2023-10-14T18:54:34.811442+0000","last_became_peered":"2023-10-14T18:54:34.811442+0000","last_unstale":"2023-10-14T18:54:34.812279+0000","last_undegraded":"2023-10-14T18:54:34.812279+0000","last_fullsized":"2023-10-14T18:54:34.812279+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:26.092932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811303+0000","last_change":"2023-10-14T18:54:33.808956+0000","last_active":"2023-10-14T18:54:34.811303+0000","last_peered":"2023-10-14T18:54:34.811303+0000","last_clean":"2023-10-14T18:54:34.811303+0000","last_became_active":"2023-10-14T18:54:33.808721+0000","last_became_peered":"2023-10-14T18:54:33.808721+0000","last_unstale":"2023-10-14T18:54:34.811303+0000","last_undegraded":"2023-10-14T18:54:34.811303+0000","last_fullsized":"2023-10-14T18:54:34.811303+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.820919+0000","last_change":"2023-10-14T18:54:34.820829+0000","last_active":"2023-10-14T18:54:34.820919+0000","last_peered":"2023-10-14T18:54:34.820919+0000","last_clean":"2023-10-14T18:54:34.820919+0000","last_became_active":"2023-10-14T18:54:34.820602+0000","last_became_peered":"2023-10-14T18:54:34.820602+0000","last_unstale":"2023-10-14T18:54:34.820919+0000","last_undegraded":"2023-10-14T18:54:34.820919+0000","last_fullsized":"2023-10-14T18:54:34.820919+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"169'8","reported_seq":18,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.829293+0000","last_change":"2023-10-14T18:54:33.812573+0000","last_active":"2023-10-14T18:54:34.829293+0000","last_peered":"2023-10-14T18:54:34.829293+0000","last_clean":"2023-10-14T18:54:34.829293+0000","last_became_active":"2023-10-14T18:54:33.812353+0000","last_became_peered":"2023-10-14T18:54:33.812353+0000","last_unstale":"2023-10-14T18:54:34.829293+0000","last_undegraded":"2023-10-14T18:54:34.829293+0000","last_fullsized":"2023-10-14T18:54:34.829293+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:16:08.408570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.812809+0000","last_change":"2023-10-14T18:54:34.812737+0000","last_active":"2023-10-14T18:54:34.812809+0000","last_peered":"2023-10-14T18:54:34.812809+0000","last_clean":"2023-10-14T18:54:34.812809+0000","last_became_active":"2023-10-14T18:54:34.812411+0000","last_became_peered":"2023-10-14T18:54:34.812411+0000","last_unstale":"2023-10-14T18:54:34.812809+0000","last_undegraded":"2023-10-14T18:54:34.812809+0000","last_fullsized":"2023-10-14T18:54:34.812809+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:50:33.332366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"169'1","reported_seq":11,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827891+0000","last_change":"2023-10-14T18:54:33.813960+0000","last_active":"2023-10-14T18:54:34.827891+0000","last_peered":"2023-10-14T18:54:34.827891+0000","last_clean":"2023-10-14T18:54:34.827891+0000","last_became_active":"2023-10-14T18:54:33.813642+0000","last_became_peered":"2023-10-14T18:54:33.813642+0000","last_unstale":"2023-10-14T18:54:34.827891+0000","last_undegraded":"2023-10-14T18:54:34.827891+0000","last_fullsized":"2023-10-14T18:54:34.827891+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:59:44.476782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819503+0000","last_change":"2023-10-14T18:54:34.819446+0000","last_active":"2023-10-14T18:54:34.819503+0000","last_peered":"2023-10-14T18:54:34.819503+0000","last_clean":"2023-10-14T18:54:34.819503+0000","last_became_active":"2023-10-14T18:54:34.819231+0000","last_became_peered":"2023-10-14T18:54:34.819231+0000","last_unstale":"2023-10-14T18:54:34.819503+0000","last_undegraded":"2023-10-14T18:54:34.819503+0000","last_fullsized":"2023-10-14T18:54:34.819503+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:09:12.456933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827468+0000","last_change":"2023-10-14T18:54:33.817888+0000","last_active":"2023-10-14T18:54:34.827468+0000","last_peered":"2023-10-14T18:54:34.827468+0000","last_clean":"2023-10-14T18:54:34.827468+0000","last_became_active":"2023-10-14T18:54:33.817743+0000","last_became_peered":"2023-10-14T18:54:33.817743+0000","last_unstale":"2023-10-14T18:54:34.827468+0000","last_undegraded":"2023-10-14T18:54:34.827468+0000","last_fullsized":"2023-10-14T18:54:34.827468+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:13:55.012661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.820902+0000","last_change":"2023-10-14T18:54:34.820366+0000","last_active":"2023-10-14T18:54:34.820902+0000","last_peered":"2023-10-14T18:54:34.820902+0000","last_clean":"2023-10-14T18:54:34.820902+0000","last_became_active":"2023-10-14T18:54:34.819193+0000","last_became_peered":"2023-10-14T18:54:34.819193+0000","last_unstale":"2023-10-14T18:54:34.820902+0000","last_undegraded":"2023-10-14T18:54:34.820902+0000","last_fullsized":"2023-10-14T18:54:34.820902+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"169'1","reported_seq":11,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.828567+0000","last_change":"2023-10-14T18:54:33.811109+0000","last_active":"2023-10-14T18:54:34.828567+0000","last_peered":"2023-10-14T18:54:34.828567+0000","last_clean":"2023-10-14T18:54:34.828567+0000","last_became_active":"2023-10-14T18:54:33.810880+0000","last_became_peered":"2023-10-14T18:54:33.810880+0000","last_unstale":"2023-10-14T18:54:34.828567+0000","last_undegraded":"2023-10-14T18:54:34.828567+0000","last_fullsized":"2023-10-14T18:54:34.828567+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:08:32.791772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.814152+0000","last_change":"2023-10-14T18:54:34.814113+0000","last_active":"2023-10-14T18:54:34.814152+0000","last_peered":"2023-10-14T18:54:34.814152+0000","last_clean":"2023-10-14T18:54:34.814152+0000","last_became_active":"2023-10-14T18:54:34.813911+0000","last_became_peered":"2023-10-14T18:54:34.813911+0000","last_unstale":"2023-10-14T18:54:34.814152+0000","last_undegraded":"2023-10-14T18:54:34.814152+0000","last_fullsized":"2023-10-14T18:54:34.814152+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:28:59.284862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.810789+0000","last_change":"2023-10-14T18:54:33.813126+0000","last_active":"2023-10-14T18:54:34.810789+0000","last_peered":"2023-10-14T18:54:34.810789+0000","last_clean":"2023-10-14T18:54:34.810789+0000","last_became_active":"2023-10-14T18:54:33.812885+0000","last_became_peered":"2023-10-14T18:54:33.812885+0000","last_unstale":"2023-10-14T18:54:34.810789+0000","last_undegraded":"2023-10-14T18:54:34.810789+0000","last_fullsized":"2023-10-14T18:54:34.810789+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:48.469403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821217+0000","last_change":"2023-10-14T18:54:34.818808+0000","last_active":"2023-10-14T18:54:34.821217+0000","last_peered":"2023-10-14T18:54:34.821217+0000","last_clean":"2023-10-14T18:54:34.821217+0000","last_became_active":"2023-10-14T18:54:34.817920+0000","last_became_peered":"2023-10-14T18:54:34.817920+0000","last_unstale":"2023-10-14T18:54:34.821217+0000","last_undegraded":"2023-10-14T18:54:34.821217+0000","last_fullsized":"2023-10-14T18:54:34.821217+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:27:36.011660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.827633+0000","last_change":"2023-10-14T18:54:33.815576+0000","last_active":"2023-10-14T18:54:34.827633+0000","last_peered":"2023-10-14T18:54:34.827633+0000","last_clean":"2023-10-14T18:54:34.827633+0000","last_became_active":"2023-10-14T18:54:33.815121+0000","last_became_peered":"2023-10-14T18:54:33.815121+0000","last_unstale":"2023-10-14T18:54:34.827633+0000","last_undegraded":"2023-10-14T18:54:34.827633+0000","last_fullsized":"2023-10-14T18:54:34.827633+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:01.266764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817611+0000","last_change":"2023-10-14T18:54:34.817444+0000","last_active":"2023-10-14T18:54:34.817611+0000","last_peered":"2023-10-14T18:54:34.817611+0000","last_clean":"2023-10-14T18:54:34.817611+0000","last_became_active":"2023-10-14T18:54:34.816723+0000","last_became_peered":"2023-10-14T18:54:34.816723+0000","last_unstale":"2023-10-14T18:54:34.817611+0000","last_undegraded":"2023-10-14T18:54:34.817611+0000","last_fullsized":"2023-10-14T18:54:34.817611+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:33:05.954132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.807214+0000","last_change":"2023-10-14T18:54:33.814620+0000","last_active":"2023-10-14T18:54:34.807214+0000","last_peered":"2023-10-14T18:54:34.807214+0000","last_clean":"2023-10-14T18:54:34.807214+0000","last_became_active":"2023-10-14T18:54:33.813789+0000","last_became_peered":"2023-10-14T18:54:33.813789+0000","last_unstale":"2023-10-14T18:54:34.807214+0000","last_undegraded":"2023-10-14T18:54:34.807214+0000","last_fullsized":"2023-10-14T18:54:34.807214+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:49.662749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819035+0000","last_change":"2023-10-14T18:54:34.818410+0000","last_active":"2023-10-14T18:54:34.819035+0000","last_peered":"2023-10-14T18:54:34.819035+0000","last_clean":"2023-10-14T18:54:34.819035+0000","last_became_active":"2023-10-14T18:54:34.818190+0000","last_became_peered":"2023-10-14T18:54:34.818190+0000","last_unstale":"2023-10-14T18:54:34.819035+0000","last_undegraded":"2023-10-14T18:54:34.819035+0000","last_fullsized":"2023-10-14T18:54:34.819035+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:21:50.671268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.809018+0000","last_change":"2023-10-14T18:54:33.815898+0000","last_active":"2023-10-14T18:54:34.809018+0000","last_peered":"2023-10-14T18:54:34.809018+0000","last_clean":"2023-10-14T18:54:34.809018+0000","last_became_active":"2023-10-14T18:54:33.815474+0000","last_became_peered":"2023-10-14T18:54:33.815474+0000","last_unstale":"2023-10-14T18:54:34.809018+0000","last_undegraded":"2023-10-14T18:54:34.809018+0000","last_fullsized":"2023-10-14T18:54:34.809018+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:47.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.822079+0000","last_change":"2023-10-14T18:54:34.821951+0000","last_active":"2023-10-14T18:54:34.822079+0000","last_peered":"2023-10-14T18:54:34.822079+0000","last_clean":"2023-10-14T18:54:34.822079+0000","last_became_active":"2023-10-14T18:54:34.821738+0000","last_became_peered":"2023-10-14T18:54:34.821738+0000","last_unstale":"2023-10-14T18:54:34.822079+0000","last_undegraded":"2023-10-14T18:54:34.822079+0000","last_fullsized":"2023-10-14T18:54:34.822079+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:34:27.603639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811870+0000","last_change":"2023-10-14T18:54:33.817866+0000","last_active":"2023-10-14T18:54:34.811870+0000","last_peered":"2023-10-14T18:54:34.811870+0000","last_clean":"2023-10-14T18:54:34.811870+0000","last_became_active":"2023-10-14T18:54:33.817633+0000","last_became_peered":"2023-10-14T18:54:33.817633+0000","last_unstale":"2023-10-14T18:54:34.811870+0000","last_undegraded":"2023-10-14T18:54:34.811870+0000","last_fullsized":"2023-10-14T18:54:34.811870+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:30:12.758852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.812296+0000","last_change":"2023-10-14T18:54:34.812245+0000","last_active":"2023-10-14T18:54:34.812296+0000","last_peered":"2023-10-14T18:54:34.812296+0000","last_clean":"2023-10-14T18:54:34.812296+0000","last_became_active":"2023-10-14T18:54:34.811735+0000","last_became_peered":"2023-10-14T18:54:34.811735+0000","last_unstale":"2023-10-14T18:54:34.812296+0000","last_undegraded":"2023-10-14T18:54:34.812296+0000","last_fullsized":"2023-10-14T18:54:34.812296+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:49:22.173267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"169'2","reported_seq":12,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.828091+0000","last_change":"2023-10-14T18:54:33.817044+0000","last_active":"2023-10-14T18:54:34.828091+0000","last_peered":"2023-10-14T18:54:34.828091+0000","last_clean":"2023-10-14T18:54:34.828091+0000","last_became_active":"2023-10-14T18:54:33.816432+0000","last_became_peered":"2023-10-14T18:54:33.816432+0000","last_unstale":"2023-10-14T18:54:34.828091+0000","last_undegraded":"2023-10-14T18:54:34.828091+0000","last_fullsized":"2023-10-14T18:54:34.828091+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:24:50.021088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819839+0000","last_change":"2023-10-14T18:54:34.819425+0000","last_active":"2023-10-14T18:54:34.819839+0000","last_peered":"2023-10-14T18:54:34.819839+0000","last_clean":"2023-10-14T18:54:34.819839+0000","last_became_active":"2023-10-14T18:54:34.818867+0000","last_became_peered":"2023-10-14T18:54:34.818867+0000","last_unstale":"2023-10-14T18:54:34.819839+0000","last_undegraded":"2023-10-14T18:54:34.819839+0000","last_fullsized":"2023-10-14T18:54:34.819839+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:15:53.842134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811450+0000","last_change":"2023-10-14T18:54:33.813491+0000","last_active":"2023-10-14T18:54:34.811450+0000","last_peered":"2023-10-14T18:54:34.811450+0000","last_clean":"2023-10-14T18:54:34.811450+0000","last_became_active":"2023-10-14T18:54:33.813100+0000","last_became_peered":"2023-10-14T18:54:33.813100+0000","last_unstale":"2023-10-14T18:54:34.811450+0000","last_undegraded":"2023-10-14T18:54:34.811450+0000","last_fullsized":"2023-10-14T18:54:34.811450+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:41:56.431653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.822328+0000","last_change":"2023-10-14T18:54:34.822274+0000","last_active":"2023-10-14T18:54:34.822328+0000","last_peered":"2023-10-14T18:54:34.822328+0000","last_clean":"2023-10-14T18:54:34.822328+0000","last_became_active":"2023-10-14T18:54:34.822074+0000","last_became_peered":"2023-10-14T18:54:34.822074+0000","last_unstale":"2023-10-14T18:54:34.822328+0000","last_undegraded":"2023-10-14T18:54:34.822328+0000","last_fullsized":"2023-10-14T18:54:34.822328+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:10:48.480689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.814524+0000","last_change":"2023-10-14T18:54:33.813458+0000","last_active":"2023-10-14T18:54:34.814524+0000","last_peered":"2023-10-14T18:54:34.814524+0000","last_clean":"2023-10-14T18:54:34.814524+0000","last_became_active":"2023-10-14T18:54:33.812995+0000","last_became_peered":"2023-10-14T18:54:33.812995+0000","last_unstale":"2023-10-14T18:54:34.814524+0000","last_undegraded":"2023-10-14T18:54:34.814524+0000","last_fullsized":"2023-10-14T18:54:34.814524+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:14:53.129435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.818571+0000","last_change":"2023-10-14T18:54:34.818509+0000","last_active":"2023-10-14T18:54:34.818571+0000","last_peered":"2023-10-14T18:54:34.818571+0000","last_clean":"2023-10-14T18:54:34.818571+0000","last_became_active":"2023-10-14T18:54:34.817868+0000","last_became_peered":"2023-10-14T18:54:34.817868+0000","last_unstale":"2023-10-14T18:54:34.818571+0000","last_undegraded":"2023-10-14T18:54:34.818571+0000","last_fullsized":"2023-10-14T18:54:34.818571+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:45:52.514422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811546+0000","last_change":"2023-10-14T18:54:33.813988+0000","last_active":"2023-10-14T18:54:34.811546+0000","last_peered":"2023-10-14T18:54:34.811546+0000","last_clean":"2023-10-14T18:54:34.811546+0000","last_became_active":"2023-10-14T18:54:33.813755+0000","last_became_peered":"2023-10-14T18:54:33.813755+0000","last_unstale":"2023-10-14T18:54:34.811546+0000","last_undegraded":"2023-10-14T18:54:34.811546+0000","last_fullsized":"2023-10-14T18:54:34.811546+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821474+0000","last_change":"2023-10-14T18:54:34.820525+0000","last_active":"2023-10-14T18:54:34.821474+0000","last_peered":"2023-10-14T18:54:34.821474+0000","last_clean":"2023-10-14T18:54:34.821474+0000","last_became_active":"2023-10-14T18:54:34.820322+0000","last_became_peered":"2023-10-14T18:54:34.820322+0000","last_unstale":"2023-10-14T18:54:34.821474+0000","last_undegraded":"2023-10-14T18:54:34.821474+0000","last_fullsized":"2023-10-14T18:54:34.821474+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:43:46.721157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.808220+0000","last_change":"2023-10-14T18:54:33.819035+0000","last_active":"2023-10-14T18:54:34.808220+0000","last_peered":"2023-10-14T18:54:34.808220+0000","last_clean":"2023-10-14T18:54:34.808220+0000","last_became_active":"2023-10-14T18:54:33.818860+0000","last_became_peered":"2023-10-14T18:54:33.818860+0000","last_unstale":"2023-10-14T18:54:34.808220+0000","last_undegraded":"2023-10-14T18:54:34.808220+0000","last_fullsized":"2023-10-14T18:54:34.808220+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:06:42.839183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.814630+0000","last_change":"2023-10-14T18:54:34.813989+0000","last_active":"2023-10-14T18:54:34.814630+0000","last_peered":"2023-10-14T18:54:34.814630+0000","last_clean":"2023-10-14T18:54:34.814630+0000","last_became_active":"2023-10-14T18:54:34.813742+0000","last_became_peered":"2023-10-14T18:54:34.813742+0000","last_unstale":"2023-10-14T18:54:34.814630+0000","last_undegraded":"2023-10-14T18:54:34.814630+0000","last_fullsized":"2023-10-14T18:54:34.814630+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:39:47.364109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.809135+0000","last_change":"2023-10-14T18:54:33.817232+0000","last_active":"2023-10-14T18:54:34.809135+0000","last_peered":"2023-10-14T18:54:34.809135+0000","last_clean":"2023-10-14T18:54:34.809135+0000","last_became_active":"2023-10-14T18:54:33.816803+0000","last_became_peered":"2023-10-14T18:54:33.816803+0000","last_unstale":"2023-10-14T18:54:34.809135+0000","last_undegraded":"2023-10-14T18:54:34.809135+0000","last_fullsized":"2023-10-14T18:54:34.809135+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:14:46.527749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.821215+0000","last_change":"2023-10-14T18:54:34.821145+0000","last_active":"2023-10-14T18:54:34.821215+0000","last_peered":"2023-10-14T18:54:34.821215+0000","last_clean":"2023-10-14T18:54:34.821215+0000","last_became_active":"2023-10-14T18:54:34.820730+0000","last_became_peered":"2023-10-14T18:54:34.820730+0000","last_unstale":"2023-10-14T18:54:34.821215+0000","last_undegraded":"2023-10-14T18:54:34.821215+0000","last_fullsized":"2023-10-14T18:54:34.821215+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:30:06.865311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.812510+0000","last_change":"2023-10-14T18:54:33.814813+0000","last_active":"2023-10-14T18:54:34.812510+0000","last_peered":"2023-10-14T18:54:34.812510+0000","last_clean":"2023-10-14T18:54:34.812510+0000","last_became_active":"2023-10-14T18:54:33.814615+0000","last_became_peered":"2023-10-14T18:54:33.814615+0000","last_unstale":"2023-10-14T18:54:34.812510+0000","last_undegraded":"2023-10-14T18:54:34.812510+0000","last_fullsized":"2023-10-14T18:54:34.812510+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:25.082838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.817450+0000","last_change":"2023-10-14T18:54:34.817230+0000","last_active":"2023-10-14T18:54:34.817450+0000","last_peered":"2023-10-14T18:54:34.817450+0000","last_clean":"2023-10-14T18:54:34.817450+0000","last_became_active":"2023-10-14T18:54:34.816990+0000","last_became_peered":"2023-10-14T18:54:34.816990+0000","last_unstale":"2023-10-14T18:54:34.817450+0000","last_undegraded":"2023-10-14T18:54:34.817450+0000","last_fullsized":"2023-10-14T18:54:34.817450+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:20:26.091357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.811630+0000","last_change":"2023-10-14T18:54:33.816604+0000","last_active":"2023-10-14T18:54:34.811630+0000","last_peered":"2023-10-14T18:54:34.811630+0000","last_clean":"2023-10-14T18:54:34.811630+0000","last_became_active":"2023-10-14T18:54:33.816322+0000","last_became_peered":"2023-10-14T18:54:33.816322+0000","last_unstale":"2023-10-14T18:54:34.811630+0000","last_undegraded":"2023-10-14T18:54:34.811630+0000","last_fullsized":"2023-10-14T18:54:34.811630+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:16.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.819447+0000","last_change":"2023-10-14T18:54:34.819354+0000","last_active":"2023-10-14T18:54:34.819447+0000","last_peered":"2023-10-14T18:54:34.819447+0000","last_clean":"2023-10-14T18:54:34.819447+0000","last_became_active":"2023-10-14T18:54:34.819151+0000","last_became_peered":"2023-10-14T18:54:34.819151+0000","last_unstale":"2023-10-14T18:54:34.819447+0000","last_undegraded":"2023-10-14T18:54:34.819447+0000","last_fullsized":"2023-10-14T18:54:34.819447+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:33.798696+0000","last_clean_scrub_stamp":"2023-10-14T18:54:33.798696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:51.272119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"169'3","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.828252+0000","last_change":"2023-10-14T18:54:33.814399+0000","last_active":"2023-10-14T18:54:34.828252+0000","last_peered":"2023-10-14T18:54:34.828252+0000","last_clean":"2023-10-14T18:54:34.828252+0000","last_became_active":"2023-10-14T18:54:33.814128+0000","last_became_peered":"2023-10-14T18:54:33.814128+0000","last_unstale":"2023-10-14T18:54:34.828252+0000","last_undegraded":"2023-10-14T18:54:34.828252+0000","last_fullsized":"2023-10-14T18:54:34.828252+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:54:32.790177+0000","last_clean_scrub_stamp":"2023-10-14T18:54:32.790177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:34:25.084413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":313,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T18:54:34.807306+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:54:34.807306+0000","last_peered":"2023-10-14T18:54:34.807306+0000","last_clean":"2023-10-14T18:54:34.807306+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:54:34.807306+0000","last_undegraded":"2023-10-14T18:54:34.807306+0000","last_fullsized":"2023-10-14T18:54:34.807306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193810,"statfs":{"total":200000000,"available":198461613,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.60299999999999998},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.499},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.73699999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.69399999999999995,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.437},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.51400000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71199999999999997,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.45300000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60799999999999998,"5min":0.82599999999999996,"15min":0.84299999999999997},"last":0.39200000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52300000000000002,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71399999999999997,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73199999999999998,"5min":0.84299999999999997,"15min":0.92300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.877,"15min":0.95699999999999996},"last":0.46600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194387,"statfs":{"total":200000000,"available":199052459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.73899999999999999,"5min":0.746,"15min":0.78800000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.20899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.76300000000000001},"last":0.58899999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72799999999999998,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.60999999999999999},"min":{"1min":0.439,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.63800000000000001,"5min":0.69899999999999995,"15min":3.4489999999999998},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.83599999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.32100000000000001},"max":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.751},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.61599999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.44800000000000001},"min":{"1min":0.32500000000000001,"5min":0.25800000000000001,"15min":0.23300000000000001},"max":{"1min":0.61799999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46999999999999997,"15min":0.48299999999999998},"min":{"1min":0.34200000000000003,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.68600000000000005,"5min":0.73399999999999999,"15min":0.76800000000000002},"last":0.45600000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.67100000000000004,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.47399999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39200000000000002,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.495},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54400000000000004,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.89700000000000002},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194386,"statfs":{"total":200000000,"available":199052051,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.33300000000000002},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.188,"15min":0.188},"max":{"1min":0.50600000000000001,"5min":3.992,"15min":3.992},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35799999999999998,"15min":0.34699999999999998},"min":{"1min":0.26400000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53900000000000003,"5min":1.252,"15min":1.252},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41799999999999998,"15min":0.63200000000000001},"min":{"1min":0.32500000000000001,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.58499999999999996,"5min":1.3340000000000001,"15min":10.574},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.48899999999999999,"15min":0.41399999999999998},"min":{"1min":0.29199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.57099999999999995,"5min":10.792,"15min":10.792},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.64200000000000002,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.27200000000000002},"max":{"1min":0.77000000000000002,"5min":3.536,"15min":3.536},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89400000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.63200000000000001,"15min":0.59999999999999998},"min":{"1min":0.44900000000000001,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.77200000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61099999999999999,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.38600000000000001,"15min":0.374},"max":{"1min":0.85199999999999998,"5min":1.504,"15min":1.504},"last":0.75600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66100000000000003,"15min":0.61499999999999999},"min":{"1min":0.47899999999999998,"5min":0.39400000000000002,"15min":0.39000000000000001},"max":{"1min":0.81799999999999995,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":1.288,"15min":1.288},"last":0.69399999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66000000000000003,"15min":0.63800000000000001},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.68799999999999994,"15min":0.64100000000000001},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":3.577,"15min":3.577},"last":0.77800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193810,"statfs":{"total":200000000,"available":198461678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34000000000000002,"15min":0.32800000000000001},"min":{"1min":0.191,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.47499999999999998,"5min":0.55700000000000005,"15min":0.59599999999999997},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.25800000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.623},"last":0.23799999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35599999999999998},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.60799999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38100000000000001,"15min":0.36199999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.61899999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34100000000000003},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.52700000000000002,"5min":0.54700000000000004,"15min":0.64200000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.307,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.60399999999999998,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.29899999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.41599999999999998,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59499999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.34000000000000002},"max":{"1min":0.84799999999999998,"5min":0.85599999999999998,"15min":1.0369999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59699999999999998,"15min":0.56699999999999995},"min":{"1min":0.44800000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.01},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61399999999999999,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.58199999999999996},"min":{"1min":0.438,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60699999999999998,"15min":0.58799999999999997},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.871,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.624,"15min":0.58399999999999996},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.378},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":926,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194385,"statfs":{"total":200000000,"available":199050999,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36299999999999999,"15min":0.33600000000000002},"min":{"1min":0.26100000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.56799999999999995,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.252,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.67200000000000004},"last":0.28100000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34499999999999997,"15min":0.33400000000000002},"min":{"1min":0.26400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.379,"15min":0.38800000000000001},"min":{"1min":0.315,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.53500000000000003,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.32200000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40000000000000002,"15min":0.38200000000000001},"min":{"1min":0.34300000000000003,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":1.006},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42699999999999999,"15min":0.39600000000000002},"min":{"1min":0.33100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60399999999999998,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.371,"15min":0.371},"max":{"1min":0.78200000000000003,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.75800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.46500000000000002,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.63800000000000001},"min":{"1min":0.52800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.58899999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.50700000000000001,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.79900000000000004,"5min":0.86299999999999999,"15min":0.96899999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.82099999999999995,"5min":0.96699999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":7,"last update":"Sat Oct 14 18:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60299999999999998,"15min":0.61499999999999999},"min":{"1min":0.442,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.85499999999999998,"5min":0.91300000000000003,"15min":1.0429999999999999},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194387,"statfs":{"total":200000000,"available":199052515,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.25700000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.33900000000000002},"min":{"1min":0.26100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.255}]},{"osd":1,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34999999999999998,"15min":0.34200000000000003},"min":{"1min":0.26800000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.312},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.34300000000000003,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42399999999999999,"15min":0.41299999999999998},"min":{"1min":0.31900000000000001,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.89300000000000002,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.36799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.41699999999999998,"5min":0.375,"15min":0.36299999999999999},"max":{"1min":0.82699999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.91200000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.434}]},{"osd":6,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.42199999999999999,"5min":0.38400000000000001,"15min":0.34300000000000003},"max":{"1min":0.871,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.81299999999999994,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53500000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.86399999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.378,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.45500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194387,"statfs":{"total":200000000,"available":199052605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53500000000000003,"15min":0.51600000000000001},"min":{"1min":0.42199999999999999,"5min":0.35299999999999998,"15min":0.29699999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.52700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.65000000000000002,"5min":0.77400000000000002,"15min":0.83399999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.78700000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80900000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.747}]},{"osd":3,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.55900000000000005},"min":{"1min":0.47199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68899999999999995,"5min":0.80800000000000005,"15min":0.81000000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.436,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.76300000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46899999999999997},"min":{"1min":0.32100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.60599999999999998,"5min":0.70199999999999996,"15min":0.999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46100000000000002,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58499999999999996,"5min":0.75900000000000001,"15min":0.94999999999999996},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57599999999999996,"5min":0.747,"15min":0.80800000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.41399999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72899999999999998,"5min":0.77400000000000002,"15min":0.89300000000000002},"last":0.83099999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.67900000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.43099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.75800000000000001,"5min":0.79700000000000004,"15min":0.872},"last":0.84499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":925,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194387,"statfs":{"total":200000000,"available":199052583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.53900000000000003},"min":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.30299999999999999},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.311},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64600000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55200000000000005,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.433,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.75,"15min":0.75},"last":0.623}]},{"osd":4,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46700000000000003,"15min":0.48099999999999998},"min":{"1min":0.34300000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.74099999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.35299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59499999999999997,"5min":0.74199999999999999,"15min":0.746},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54700000000000004,"15min":0.56200000000000006},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71299999999999997,"5min":0.80500000000000005,"15min":0.81899999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.73999999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.72499999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:54:43.800 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:54:43.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:54:43.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.954+0000 7febbc81b700 1 Processor -- start 2023-10-14T18:54:43.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.954+0000 7febbc81b700 1 -- start start 2023-10-14T18:54:43.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febbc81b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7febb8159ec0 0x7febb80af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febbc81b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7febb815a290 0x7febb80afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febbc81b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb80b0790 con 0x7febb806a5a0 2023-10-14T18:54:43.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febbc81b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80ce1f0 con 0x7febb815a290 2023-10-14T18:54:43.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febbc81b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80b0b20 con 0x7febb8159ec0 2023-10-14T18:54:43.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7febb815a290 0x7febb80afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb6d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7febb806a5a0 0x7febb815db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53028/0 (socket says 172.21.15.79:53028) 2023-10-14T18:54:43.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7febb815a290 0x7febb80afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45144/0 (socket says 172.21.15.79:45144) 2023-10-14T18:54:43.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb6d9d700 1 -- 172.21.15.79:0/115566968 learned_addr learned my addr 172.21.15.79:0/115566968 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb659c700 1 --2- 172.21.15.79:0/115566968 >> v2:172.21.15.144:3300/0 conn(0x7febb8159ec0 0x7febb80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 -- 172.21.15.79:0/115566968 >> v2:172.21.15.144:3300/0 conn(0x7febb8159ec0 msgr2=0x7febb80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 --2- 172.21.15.79:0/115566968 >> v2:172.21.15.144:3300/0 conn(0x7febb8159ec0 0x7febb80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 -- 172.21.15.79:0/115566968 >> v1:172.21.15.79:6789/0 conn(0x7febb806a5a0 legacy=0x7febb815db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb559a700 1 -- 172.21.15.79:0/115566968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246129926 0 0) 0x7febb80b0790 con 0x7febb806a5a0 2023-10-14T18:54:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 -- 172.21.15.79:0/115566968 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80b04b0 con 0x7febb815a290 2023-10-14T18:54:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.955+0000 7febb5d9b700 1 --2- 172.21.15.79:0/115566968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb815a290 0x7febb80afe80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7febb80898e0 tx=0x7febac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662456a71eda324a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febb559a700 1 -- 172.21.15.79:0/115566968 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00e070 con 0x7febb815a290 2023-10-14T18:54:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febb559a700 1 -- 172.21.15.79:0/115566968 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00bc30 con 0x7febb815a290 2023-10-14T18:54:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febb559a700 1 -- 172.21.15.79:0/115566968 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac012430 con 0x7febb815a290 2023-10-14T18:54:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 -- 172.21.15.79:0/115566968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb815a290 msgr2=0x7febb80afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 --2- 172.21.15.79:0/115566968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb815a290 0x7febb80afe80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7febb80898e0 tx=0x7febac009780 comp rx=0 tx=0).stop 2023-10-14T18:54:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 -- 172.21.15.79:0/115566968 shutdown_connections 2023-10-14T18:54:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 --2- 172.21.15.79:0/115566968 >> v2:172.21.15.144:3300/0 conn(0x7febb8159ec0 0x7febb80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 --2- 172.21.15.79:0/115566968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb815a290 0x7febb80afe80 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 -- 172.21.15.79:0/115566968 >> 172.21.15.79:0/115566968 conn(0x7febb80d1880 msgr2=0x7febb80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:43.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 -- 172.21.15.79:0/115566968 shutdown_connections 2023-10-14T18:54:43.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.956+0000 7febbc81b700 1 -- 172.21.15.79:0/115566968 wait complete. 2023-10-14T18:54:43.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.957+0000 7febbc81b700 1 Processor -- start 2023-10-14T18:54:43.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.957+0000 7febbc81b700 1 -- start start 2023-10-14T18:54:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febb8159ec0 0x7febb80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febb815a290 0x7febb815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb815abb0 con 0x7febb806a5a0 2023-10-14T18:54:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb815ae90 con 0x7febb8159ec0 2023-10-14T18:54:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febbc81b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815b170 con 0x7febb815a290 2023-10-14T18:54:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45148/0 (socket says 172.21.15.79:45148) 2023-10-14T18:54:43.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 -- 172.21.15.79:0/1100088410 learned_addr learned my addr 172.21.15.79:0/1100088410 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 -- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febb815a290 msgr2=0x7febb815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febb815a290 0x7febb815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 -- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febb8159ec0 msgr2=0x7febb80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febb8159ec0 0x7febb80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:43.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 -- 172.21.15.79:0/1100088410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac009a20 con 0x7febb806a5a0 2023-10-14T18:54:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.958+0000 7febb659c700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7febb000d890 tx=0x7febb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.959+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000b600 con 0x7febb806a5a0 2023-10-14T18:54:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.959+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000b760 con 0x7febb806a5a0 2023-10-14T18:54:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.959+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb815b450 con 0x7febb806a5a0 2023-10-14T18:54:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.959+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb000bae0 con 0x7febb806a5a0 2023-10-14T18:54:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.959+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb816d100 con 0x7febb806a5a0 2023-10-14T18:54:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.960+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb815b8f0 con 0x7febb806a5a0 2023-10-14T18:54:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.960+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febb001e460 con 0x7febb806a5a0 2023-10-14T18:54:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.960+0000 7feba67fc700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:43.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.960+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febb0084be0 con 0x7febb806a5a0 2023-10-14T18:54:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.961+0000 7febb5d9b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.961+0000 7febb5d9b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7febb80898e0 tx=0x7febac019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:43.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:43.965+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb0051e50 con 0x7febb806a5a0 2023-10-14T18:54:44.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.221+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7febb804c3c0 con 0x7febb806a5a0 2023-10-14T18:54:44.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.225+0000 7feba67fc700 1 -- 172.21.15.79:0/1100088410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7febb0055470 con 0x7febb806a5a0 2023-10-14T18:54:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 msgr2=0x7feb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 0x7feb980693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7febb80898e0 tx=0x7febac019000 comp rx=0 tx=0).stop 2023-10-14T18:54:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 msgr2=0x7febb816cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7febb000d890 tx=0x7febb0008040 comp rx=0 tx=0).stop 2023-10-14T18:54:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 shutdown_connections 2023-10-14T18:54:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7feb98066f30 0x7feb980693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febb815a290 0x7febb815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febb806a5a0 0x7febb816cbc0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 --2- 172.21.15.79:0/1100088410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febb8159ec0 0x7febb80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 >> 172.21.15.79:0/1100088410 conn(0x7febb80d1880 msgr2=0x7febb806abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:44.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 shutdown_connections 2023-10-14T18:54:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.227+0000 7febbc81b700 1 -- 172.21.15.79:0/1100088410 wait complete. 2023-10-14T18:54:44.231 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:54:44.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.357+0000 7f246b67f700 1 Processor -- start 2023-10-14T18:54:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.357+0000 7f246b67f700 1 -- start start 2023-10-14T18:54:44.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.358+0000 7f246b67f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f2464067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.358+0000 7f246b67f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2464068880 0x7f2464067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.358+0000 7f246b67f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640ad060 con 0x7f24640680e0 2023-10-14T18:54:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.358+0000 7f246b67f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246406f030 con 0x7f2464068880 2023-10-14T18:54:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.358+0000 7f246b67f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246406f310 con 0x7f2464156b80 2023-10-14T18:54:44.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2464068880 0x7f2464067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f246941b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f2464067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2464068880 0x7f2464067ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:47876/0 (socket says 172.21.15.79:47876) 2023-10-14T18:54:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2469c1c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f24640680e0 0x7f246415a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:35518/0 (socket says 172.21.15.79:35518) 2023-10-14T18:54:44.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 -- 172.21.15.79:0/4050061438 learned_addr learned my addr 172.21.15.79:0/4050061438 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 -- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 msgr2=0x7f2464067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f2464067660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 -- 172.21.15.79:0/4050061438 >> v1:172.21.15.144:6789/0 conn(0x7f24640680e0 legacy=0x7f246415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 -- 172.21.15.79:0/4050061438 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246406f5f0 con 0x7f2464068880 2023-10-14T18:54:44.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f245bfff700 1 -- 172.21.15.79:0/4050061438 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157094751 0 0) 0x7f24640ad060 con 0x7f24640680e0 2023-10-14T18:54:44.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f246941b700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f2464067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:44.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.359+0000 7f2468c1a700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2464068880 0x7f2464067ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f245400bc30 tx=0x7f245400b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939ce841f6374c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:44.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f245bfff700 1 -- 172.21.15.79:0/4050061438 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454005c10 con 0x7f2464068880 2023-10-14T18:54:44.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f245bfff700 1 -- 172.21.15.79:0/4050061438 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454005d70 con 0x7f2464068880 2023-10-14T18:54:44.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f245bfff700 1 -- 172.21.15.79:0/4050061438 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400dbc0 con 0x7f2464068880 2023-10-14T18:54:44.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 -- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2464068880 msgr2=0x7f2464067ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2464068880 0x7f2464067ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f245400bc30 tx=0x7f245400b4c0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 -- 172.21.15.79:0/4050061438 shutdown_connections 2023-10-14T18:54:44.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f2464067660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 --2- 172.21.15.79:0/4050061438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2464068880 0x7f2464067ba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 -- 172.21.15.79:0/4050061438 >> 172.21.15.79:0/4050061438 conn(0x7f246406ad40 msgr2=0x7f24640cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:44.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 -- 172.21.15.79:0/4050061438 shutdown_connections 2023-10-14T18:54:44.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.360+0000 7f246b67f700 1 -- 172.21.15.79:0/4050061438 wait complete. 2023-10-14T18:54:44.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.361+0000 7f246b67f700 1 Processor -- start 2023-10-14T18:54:44.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.361+0000 7f246b67f700 1 -- start start 2023-10-14T18:54:44.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24640680e0 0x7f24641519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f24640ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b10f0 con 0x7f2464068880 2023-10-14T18:54:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246415b440 con 0x7f24640680e0 2023-10-14T18:54:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246b67f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246415b160 con 0x7f2464156b80 2023-10-14T18:54:44.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f2468c1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f2468c1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45164/0 (socket says 172.21.15.79:45164) 2023-10-14T18:54:44.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f2468c1a700 1 -- 172.21.15.79:0/3073616900 learned_addr learned my addr 172.21.15.79:0/3073616900 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:44.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f246941b700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24640680e0 0x7f24641519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.362+0000 7f2469c1c700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f24640ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 -- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 msgr2=0x7f24640ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f24640ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 -- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24640680e0 msgr2=0x7f24641519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24640680e0 0x7f24641519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 -- 172.21.15.79:0/3073616900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009a20 con 0x7f2464068880 2023-10-14T18:54:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f2468c1a700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f246406dfa0 tx=0x7f245401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454019430 con 0x7f2464068880 2023-10-14T18:54:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245401d070 con 0x7f2464068880 2023-10-14T18:54:44.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245400b720 con 0x7f2464068880 2023-10-14T18:54:44.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24540197e0 con 0x7f2464068880 2023-10-14T18:54:44.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.363+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24640b0d80 con 0x7f2464068880 2023-10-14T18:54:44.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.364+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24640b0900 con 0x7f2464068880 2023-10-14T18:54:44.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.364+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2454019bd0 con 0x7f2464068880 2023-10-14T18:54:44.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.364+0000 7f24597fa700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 0x7f24480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:44.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.365+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2454014030 con 0x7f2464068880 2023-10-14T18:54:44.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.365+0000 7f246941b700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 0x7f24480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:44.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.365+0000 7f246941b700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 0x7f24480693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f24600099f0 tx=0x7f246000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:44.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.369+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24640b0900 con 0x7f2464068880 2023-10-14T18:54:44.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.592+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24640b0900 con 0x7f2464068880 2023-10-14T18:54:44.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.592+0000 7f24597fa700 1 -- 172.21.15.79:0/3073616900 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f24640b0900 con 0x7f2464068880 2023-10-14T18:54:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:44.594 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:54:44.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 msgr2=0x7f24480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 0x7f24480693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f24600099f0 tx=0x7f246000b040 comp rx=0 tx=0).stop 2023-10-14T18:54:44.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 msgr2=0x7f24640abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:44.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f246406dfa0 tx=0x7f245401a000 comp rx=0 tx=0).stop 2023-10-14T18:54:44.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 shutdown_connections 2023-10-14T18:54:44.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2448066f30 0x7f24480693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2464156b80 0x7f24640ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24640680e0 0x7f24641519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 --2- 172.21.15.79:0/3073616900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2464068880 0x7f24640abd20 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:44.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 >> 172.21.15.79:0/3073616900 conn(0x7f246406ad40 msgr2=0x7f24640cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:44.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 shutdown_connections 2023-10-14T18:54:44.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:44.595+0000 7f246b67f700 1 -- 172.21.15.79:0/3073616900 wait complete. 2023-10-14T18:54:44.598 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:54:45.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:54:34.183258+0000', 'modified': '2023-10-14T18:54:37.838078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7791}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7791': {'gid': 7791, 'name': 'c', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/1267085487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 1267085487}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1267085487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:54:45.011 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:54:45.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T18:54:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.127+0000 7fa6d5ae5700 1 Processor -- start 2023-10-14T18:54:45.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.127+0000 7fa6d5ae5700 1 -- start start 2023-10-14T18:54:45.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6d0159da0 0x7fa6d00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d015a170 0x7fa6d0068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6d0069040 0x7fa6d00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d00694e0 con 0x7fa6d0069040 2023-10-14T18:54:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d015ea70 con 0x7fa6d0159da0 2023-10-14T18:54:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d5ae5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00b3990 con 0x7fa6d015a170 2023-10-14T18:54:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6d0069040 0x7fa6d00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6d0069040 0x7fa6d00af4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45166/0 (socket says 172.21.15.79:45166) 2023-10-14T18:54:45.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 -- 172.21.15.79:0/1165296514 learned_addr learned my addr 172.21.15.79:0/1165296514 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6cffff700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d015a170 0x7fa6d0068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/1165296514 >> v2:172.21.15.144:3300/0 conn(0x7fa6d0159da0 0x7fa6d00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 -- 172.21.15.79:0/1165296514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d015a170 msgr2=0x7fa6d0068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d015a170 0x7fa6d0068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 -- 172.21.15.79:0/1165296514 >> v2:172.21.15.144:3300/0 conn(0x7fa6d0159da0 msgr2=0x7fa6d00b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/1165296514 >> v2:172.21.15.144:3300/0 conn(0x7fa6d0159da0 0x7fa6d00b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 -- 172.21.15.79:0/1165296514 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00b0b70 con 0x7fa6d0069040 2023-10-14T18:54:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.128+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0069040 0x7fa6d00af4a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa6d006b290 tx=0x7fa6c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a887f5b64a85f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6cf7fe700 1 -- 172.21.15.79:0/1165296514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800e070 con 0x7fa6d0069040 2023-10-14T18:54:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6cf7fe700 1 -- 172.21.15.79:0/1165296514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c800ba50 con 0x7fa6d0069040 2023-10-14T18:54:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6cf7fe700 1 -- 172.21.15.79:0/1165296514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80092e0 con 0x7fa6d0069040 2023-10-14T18:54:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/1165296514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0069040 msgr2=0x7fa6d00af4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0069040 0x7fa6d00af4a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa6d006b290 tx=0x7fa6c8009840 comp rx=0 tx=0).stop 2023-10-14T18:54:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/1165296514 shutdown_connections 2023-10-14T18:54:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d0069040 0x7fa6d00af4a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/1165296514 >> v2:172.21.15.144:3300/0 conn(0x7fa6d0159da0 0x7fa6d00b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/1165296514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d015a170 0x7fa6d0068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/1165296514 >> 172.21.15.79:0/1165296514 conn(0x7fa6d00d0bc0 msgr2=0x7fa6d00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/1165296514 shutdown_connections 2023-10-14T18:54:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.129+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/1165296514 wait complete. 2023-10-14T18:54:45.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.130+0000 7fa6d5ae5700 1 Processor -- start 2023-10-14T18:54:45.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.130+0000 7fa6d5ae5700 1 -- start start 2023-10-14T18:54:45.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d0069040 0x7fa6d00c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d0159da0 0x7fa6d014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00c6380 con 0x7fa6d015a170 2023-10-14T18:54:45.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d014f680 con 0x7fa6d0159da0 2023-10-14T18:54:45.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d5ae5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d016be80 con 0x7fa6d0069040 2023-10-14T18:54:45.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d52e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d52e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45176/0 (socket says 172.21.15.79:45176) 2023-10-14T18:54:45.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6d52e4700 1 -- 172.21.15.79:0/2342582237 learned_addr learned my addr 172.21.15.79:0/2342582237 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.131+0000 7fa6cffff700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d0159da0 0x7fa6d014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 -- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d0069040 msgr2=0x7fa6d00c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d0069040 0x7fa6d00c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 -- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d0159da0 msgr2=0x7fa6d014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d0159da0 0x7fa6d014f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 -- 172.21.15.79:0/2342582237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8009ae0 con 0x7fa6d015a170 2023-10-14T18:54:45.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009fd0 tx=0x7fa6c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6ccff9700 1 -- 172.21.15.79:0/2342582237 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8007ea0 con 0x7fa6d015a170 2023-10-14T18:54:45.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6ccff9700 1 -- 172.21.15.79:0/2342582237 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c801d420 con 0x7fa6d015a170 2023-10-14T18:54:45.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d00c60a0 con 0x7fa6d015a170 2023-10-14T18:54:45.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6ccff9700 1 -- 172.21.15.79:0/2342582237 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801d800 con 0x7fa6d015a170 2023-10-14T18:54:45.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.132+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d016bb10 con 0x7fa6d015a170 2023-10-14T18:54:45.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.133+0000 7fa6ccff9700 1 -- 172.21.15.79:0/2342582237 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6c8003050 con 0x7fa6d015a170 2023-10-14T18:54:45.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.134+0000 7fa6ccff9700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.134+0000 7fa6ccff9700 1 -- 172.21.15.79:0/2342582237 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6c8086410 con 0x7fa6d015a170 2023-10-14T18:54:45.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.134+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.134+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 0x7fa6b40693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4007970 tx=0x7fa6c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.135+0000 7fa6e0040b80 1 Processor -- start 2023-10-14T18:54:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.135+0000 7fa6e0040b80 1 -- start start 2023-10-14T18:54:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7aa77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7a7dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f79d4a70 con 0x5612f7a7b5f0 2023-10-14T18:54:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f79d2270 con 0x5612f7a7db80 2023-10-14T18:54:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612f79ce060 con 0x5612f7ac8480 2023-10-14T18:54:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45192/0 (socket says 172.21.15.79:45192) 2023-10-14T18:54:45.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6cffff700 1 -- 172.21.15.79:0/2805280116 learned_addr learned my addr 172.21.15.79:0/2805280116 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7a7dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7aa77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.136+0000 7fa6cffff700 1 -- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 msgr2=0x5612f7aa77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6cffff700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7aa77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6cffff700 1 -- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 msgr2=0x5612f7a7dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6cffff700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7a7dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6cffff700 1 -- 172.21.15.79:0/2805280116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612f7868270 con 0x5612f7a7b5f0 2023-10-14T18:54:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7a7dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:45.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7aa77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:45.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6cffff700 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b920 tx=0x7fa6bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee97492c6265039 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6b9ffb700 1 -- 172.21.15.79:0/2805280116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00b330 con 0x5612f7a7b5f0 2023-10-14T18:54:45.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6b9ffb700 1 -- 172.21.15.79:0/2805280116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc00c040 con 0x5612f7a7b5f0 2023-10-14T18:54:45.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6b9ffb700 1 -- 172.21.15.79:0/2805280116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00dad0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 -- 172.21.15.79:0/2805280116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 msgr2=0x5612f7ac8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b920 tx=0x7fa6bc008040 comp rx=0 tx=0).stop 2023-10-14T18:54:45.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 -- 172.21.15.79:0/2805280116 shutdown_connections 2023-10-14T18:54:45.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7a7dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7aa77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/2805280116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac8850 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 -- 172.21.15.79:0/2805280116 >> 172.21.15.79:0/2805280116 conn(0x5612f7a7f0c0 msgr2=0x5612f7a7f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 -- 172.21.15.79:0/2805280116 shutdown_connections 2023-10-14T18:54:45.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.137+0000 7fa6e0040b80 1 -- 172.21.15.79:0/2805280116 wait complete. 2023-10-14T18:54:45.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.138+0000 7fa6e0040b80 1 -- start start 2023-10-14T18:54:45.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.138+0000 7fa6e0040b80 1 Processor -- start 2023-10-14T18:54:45.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7aa1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7ad7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7979890 con 0x5612f7a7b5f0 2023-10-14T18:54:45.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7994ea0 con 0x5612f7a7db80 2023-10-14T18:54:45.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612f7850e30 con 0x5612f7ac8480 2023-10-14T18:54:45.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6e0040b80 10 client.0 _ll_register_callbacks cb 0x5612f7a412c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:54:45.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45204/0 (socket says 172.21.15.79:45204) 2023-10-14T18:54:45.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/1258085360 learned_addr learned my addr 172.21.15.79:0/1258085360 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6cffff700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7aa1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7ad7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 msgr2=0x5612f7ad7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7ad7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 msgr2=0x5612f7aa1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7aa1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/1258085360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc00b520 con 0x5612f7a7b5f0 2023-10-14T18:54:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.139+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7ad7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400cfd0 tx=0x7fa6c4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbebe9290a842ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:54:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4013e50 con 0x5612f7a7b5f0 2023-10-14T18:54:45.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6c401e410 con 0x5612f7a7b5f0 2023-10-14T18:54:45.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612f7a72cd0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c401e7e0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 10 client.7959 fetch_fsmap learned FSMap version 80 2023-10-14T18:54:45.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x5612f780afe0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612f7a72cd0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa6c401e940 con 0x5612f7a7b5f0 2023-10-14T18:54:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 10 client.7959 fetch_fsmap finished waiting for FSMap version 80 2023-10-14T18:54:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 10 client.7959 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:54:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 20 client.7959 populate_metadata read hostname 'smithi079' 2023-10-14T18:54:45.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7aa9be0 0x5612f7aa9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 4 client.7959 mds_command: new command op to 7791 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:54:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 --> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612f7a4faa0 con 0x5612f7aa9be0 2023-10-14T18:54:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.140+0000 7fa6cffff700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7aa9be0 0x5612f7aa9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6cffff700 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7aa9be0 0x5612f7aa9fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8aacd8768a8813 server_cookie=6d1dcd48caab28a0 in_seq=0 out_seq=0 2023-10-14T18:54:45.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6aeffd700 10 client.7959 ms_handle_connect on v2:172.21.15.79:6833/1267085487 2023-10-14T18:54:45.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6aeffd700 1 -- 172.21.15.79:0/1258085360 <== mds.0 v2:172.21.15.79:6833/1267085487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5612f7a4faa0 con 0x5612f7aa9be0 2023-10-14T18:54:45.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6aeffd700 10 client.7959 handle_command_reply: tid=0 2023-10-14T18:54:45.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 client.7959 shutdown 2023-10-14T18:54:45.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 msgr2=0x5612f7ac4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400cfd0 tx=0x7fa6c4015040 comp rx=0 tx=0).stop 2023-10-14T18:54:45.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 shutdown_connections 2023-10-14T18:54:45.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7aa9be0 0x5612f7aa9fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7ac8480 0x5612f7ad7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6aeffd700 0 client.7959 ms_handle_reset on v2:172.21.15.79:6833/1267085487 2023-10-14T18:54:45.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7ac4980 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/1258085360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7db80 0x5612f7aa1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 >> 172.21.15.79:0/1258085360 conn(0x5612f7a7f0c0 msgr2=0x5612f7a79e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 shutdown_connections 2023-10-14T18:54:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.141+0000 7fa6e0040b80 1 -- 172.21.15.79:0/1258085360 wait complete. 2023-10-14T18:54:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.142+0000 7fa6e0040b80 20 client.7959 trim_cache size 0 max 16384 2023-10-14T18:54:45.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.158+0000 7fa6e0040b80 1 Processor -- start 2023-10-14T18:54:45.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.158+0000 7fa6e0040b80 1 -- start start 2023-10-14T18:54:45.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7aa3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7ac6be0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7a7d5d0 con 0x5612f7ac8480 2023-10-14T18:54:45.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612f7ac92d0 con 0x5612f7a7db80 2023-10-14T18:54:45.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45218/0 (socket says 172.21.15.79:45218) 2023-10-14T18:54:45.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/457800267 learned_addr learned my addr 172.21.15.79:0/457800267 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6cffff700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7aa3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 msgr2=0x5612f7aa3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7aa3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 msgr2=0x5612f7aa8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 -- 172.21.15.79:0/457800267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612f7ad78f0 con 0x5612f7a7b5f0 2023-10-14T18:54:45.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6cffff700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7aa3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4007250 tx=0x7fa6c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112286c19ef35f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6ba7fc700 1 -- 172.21.15.79:0/457800267 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c401e410 con 0x5612f7a7b5f0 2023-10-14T18:54:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6ba7fc700 1 -- 172.21.15.79:0/457800267 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4033070 con 0x5612f7a7b5f0 2023-10-14T18:54:45.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.159+0000 7fa6ba7fc700 1 -- 172.21.15.79:0/457800267 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4007670 con 0x5612f7a7b5f0 2023-10-14T18:54:45.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- 172.21.15.79:0/457800267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 msgr2=0x5612f7a79e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4007250 tx=0x7fa6c4017000 comp rx=0 tx=0).stop 2023-10-14T18:54:45.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- 172.21.15.79:0/457800267 shutdown_connections 2023-10-14T18:54:45.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7a7b5f0 0x5612f7a79e60 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/457800267 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7aa3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- 172.21.15.79:0/457800267 >> 172.21.15.79:0/457800267 conn(0x5612f7a7f0c0 msgr2=0x5612f7a7bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- 172.21.15.79:0/457800267 shutdown_connections 2023-10-14T18:54:45.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- 172.21.15.79:0/457800267 wait complete. 2023-10-14T18:54:45.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.160+0000 7fa6e0040b80 1 -- start start 2023-10-14T18:54:45.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 Processor -- start 2023-10-14T18:54:45.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7b5f0 0x5612f7aa29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7b295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7b29ef0 con 0x5612f7ac8480 2023-10-14T18:54:45.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612f7a81a30 con 0x5612f7a7b5f0 2023-10-14T18:54:45.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5612f7a7a6e0 con 0x5612f7a7db80 2023-10-14T18:54:45.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.161+0000 7fa6e0040b80 10 client.0 _ll_register_callbacks cb 0x5612f7a412c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45234/0 (socket says 172.21.15.79:45234) 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 -- 172.21.15.79:0/3632369853 learned_addr learned my addr 172.21.15.79:0/3632369853 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7b5f0 0x5612f7aa29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6cffff700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7b295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 -- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 msgr2=0x5612f7b295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7b295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 -- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7b5f0 msgr2=0x5612f7aa29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7b5f0 0x5612f7aa29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 -- 172.21.15.79:0/3632369853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612f780afe0 con 0x5612f7ac8480 2023-10-14T18:54:45.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6cffff700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7b295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:54:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6d52e4700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80572d0 tx=0x7fa6c8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba663ffab44ebbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:54:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800e040 con 0x5612f7ac8480 2023-10-14T18:54:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6c805e2e0 con 0x5612f7ac8480 2023-10-14T18:54:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6bc00c040 con 0x5612f7ac8480 2023-10-14T18:54:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6c802de30 con 0x5612f7ac8480 2023-10-14T18:54:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 10 client.7965 fetch_fsmap learned FSMap version 80 2023-10-14T18:54:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) v3 -- 0x5612f799c780 con 0x5612f7ac8480 2023-10-14T18:54:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8083080 con 0x5612f7ac8480 2023-10-14T18:54:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 80) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa6c8019030 con 0x5612f7ac8480 2023-10-14T18:54:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 10 client.7965 fetch_fsmap finished waiting for FSMap version 80 2023-10-14T18:54:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 10 client.7965 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T18:54:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 20 client.7965 populate_metadata read hostname 'smithi079' 2023-10-14T18:54:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7ac2950 0x5612f7ac2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 4 client.7965 mds_command: new command op to 7791 tid=0[{"prefix": "status"}] 2023-10-14T18:54:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.162+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 --> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5612f7970e00 con 0x5612f7ac2950 2023-10-14T18:54:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7ac2950 0x5612f7ac2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6aeffd700 10 client.7965 ms_handle_connect on v2:172.21.15.79:6833/1267085487 2023-10-14T18:54:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6d4ae3700 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7ac2950 0x5612f7ac2d20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d63014728475b8f server_cookie=7741567ce826b9b4 in_seq=0 out_seq=0 2023-10-14T18:54:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6aeffd700 1 -- 172.21.15.79:0/3632369853 <== mds.0 v2:172.21.15.79:6833/1267085487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5612f7970e00 con 0x5612f7ac2950 2023-10-14T18:54:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6aeffd700 10 client.7965 handle_command_reply: tid=0 2023-10-14T18:54:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 client.7965 shutdown 2023-10-14T18:54:45.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 msgr2=0x5612f7aa8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80572d0 tx=0x7fa6c8086040 comp rx=0 tx=0).stop 2023-10-14T18:54:45.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 shutdown_connections 2023-10-14T18:54:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:6833/1267085487,v1:172.21.15.79:6835/1267085487] conn(0x5612f7ac2950 0x5612f7ac2d20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5612f7ac8480 0x5612f7aa8dc0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6aeffd700 0 client.7965 ms_handle_reset on v2:172.21.15.79:6833/1267085487 2023-10-14T18:54:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5612f7a7b5f0 0x5612f7aa29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 --2- 172.21.15.79:0/3632369853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5612f7a7db80 0x5612f7b295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 >> 172.21.15.79:0/3632369853 conn(0x5612f7a7f0c0 msgr2=0x5612f7aa3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 shutdown_connections 2023-10-14T18:54:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 1 -- 172.21.15.79:0/3632369853 wait complete. 2023-10-14T18:54:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.163+0000 7fa6e0040b80 20 client.7965 trim_cache size 0 max 16384 2023-10-14T18:54:45.197 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:54:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:54:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:54:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 7791, 2023-10-14T18:54:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:54:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:54:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:54:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 10.344840147999999, 2023-10-14T18:54:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 80, 2023-10-14T18:54:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 170, 2023-10-14T18:54:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 170, 2023-10-14T18:54:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 15.471921498 2023-10-14T18:54:45.199 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:54:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 msgr2=0x7fa6b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 0x7fa6b40693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4007970 tx=0x7fa6c4008040 comp rx=0 tx=0).stop 2023-10-14T18:54:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 msgr2=0x7fa6d00c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009fd0 tx=0x7fa6c8018000 comp rx=0 tx=0).stop 2023-10-14T18:54:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 shutdown_connections 2023-10-14T18:54:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa6b4066f30 0x7fa6b40693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6d015a170 0x7fa6d00c5850 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6d0069040 0x7fa6d00c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 --2- 172.21.15.79:0/2342582237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d0159da0 0x7fa6d014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 >> 172.21.15.79:0/2342582237 conn(0x7fa6d00d0bc0 msgr2=0x7fa6d00b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 shutdown_connections 2023-10-14T18:54:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.164+0000 7fa6d5ae5700 1 -- 172.21.15.79:0/2342582237 wait complete. 2023-10-14T18:54:45.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:54:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.317+0000 7f780c4e4700 1 Processor -- start 2023-10-14T18:54:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.317+0000 7f780c4e4700 1 -- start start 2023-10-14T18:54:45.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780c4e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780c4e4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f780415d580 0x7f7804158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780c4e4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780415cbb0 con 0x7f7804157870 2023-10-14T18:54:45.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780c4e4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415bdb0 con 0x7f780415d580 2023-10-14T18:54:45.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780c4e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780415bfa0 con 0x7f780415a620 2023-10-14T18:54:45.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780a280700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7804157870 0x7f780415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:53032/0 (socket says 172.21.15.79:53032) 2023-10-14T18:54:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780a280700 1 -- 172.21.15.79:0/2443040867 learned_addr learned my addr 172.21.15.79:0/2443040867 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f780aa81700 1 --2- 172.21.15.79:0/2443040867 >> v2:172.21.15.144:3300/0 conn(0x7f780415d580 0x7f7804158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.318+0000 7f7809a7f700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251575057 0 0) 0x7f780415cbb0 con 0x7f7804157870 2023-10-14T18:54:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ec003570 con 0x7f7804157870 2023-10-14T18:54:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780aa81700 1 -- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 msgr2=0x7f780415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284037454 0 0) 0x7f77ec003570 con 0x7f7804157870 2023-10-14T18:54:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780aa81700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780aa81700 1 -- 172.21.15.79:0/2443040867 >> v1:172.21.15.79:6789/0 conn(0x7f7804157870 legacy=0x7f780415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780aa81700 1 -- 172.21.15.79:0/2443040867 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780415c280 con 0x7f780415d580 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f7809a7f700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780aa81700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780415d580 0x7f7804158110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b72a55fb9c56290 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0017f0 con 0x7f780415d580 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4011420 con 0x7f780415d580 2023-10-14T18:54:45.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.319+0000 7f780927e700 1 -- 172.21.15.79:0/2443040867 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40117c0 con 0x7f780415d580 2023-10-14T18:54:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 -- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780415d580 msgr2=0x7f7804158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780415d580 0x7f7804158110 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 -- 172.21.15.79:0/2443040867 shutdown_connections 2023-10-14T18:54:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780415d580 0x7f7804158110 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2443040867 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 -- 172.21.15.79:0/2443040867 >> 172.21.15.79:0/2443040867 conn(0x7f7804068ce0 msgr2=0x7f78040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 -- 172.21.15.79:0/2443040867 shutdown_connections 2023-10-14T18:54:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.320+0000 7f780c4e4700 1 -- 172.21.15.79:0/2443040867 wait complete. 2023-10-14T18:54:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.321+0000 7f780c4e4700 1 Processor -- start 2023-10-14T18:54:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.321+0000 7f780c4e4700 1 -- start start 2023-10-14T18:54:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7804157870 0x7f780416b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780414bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804150200 con 0x7f780415d580 2023-10-14T18:54:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780416b9b0 con 0x7f7804157870 2023-10-14T18:54:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780414fd70 con 0x7f780415a620 2023-10-14T18:54:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45236/0 (socket says 172.21.15.79:45236) 2023-10-14T18:54:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 -- 172.21.15.79:0/2386044368 learned_addr learned my addr 172.21.15.79:0/2386044368 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780a280700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7804157870 0x7f780416b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f7809a7f700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780414bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 -- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 msgr2=0x7f780414bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780414bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 -- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7804157870 msgr2=0x7f780416b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7804157870 0x7f780416b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 -- 172.21.15.79:0/2386044368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8009420 con 0x7f780415d580 2023-10-14T18:54:45.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780aa81700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f77f40093f0 tx=0x7f77f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f401cc90 con 0x7f780415d580 2023-10-14T18:54:45.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f401cdf0 con 0x7f780415d580 2023-10-14T18:54:45.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f4009420 con 0x7f780415d580 2023-10-14T18:54:45.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f401a680 con 0x7f780415d580 2023-10-14T18:54:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.322+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780414eec0 con 0x7f780415d580 2023-10-14T18:54:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.323+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780404c3c0 con 0x7f780415d580 2023-10-14T18:54:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.324+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77f401aa70 con 0x7f780415d580 2023-10-14T18:54:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.324+0000 7f78027fc700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.324+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77f4085ea0 con 0x7f780415d580 2023-10-14T18:54:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.324+0000 7f780a280700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.325+0000 7f780a280700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 0x7f77f00693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f77fc001560 tx=0x7f77fc001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.328+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77f4053110 con 0x7f780415d580 2023-10-14T18:54:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.554+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f780415c560 con 0x7f780415d580 2023-10-14T18:54:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.555+0000 7f78027fc700 1 -- 172.21.15.79:0/2386044368 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77f4056730 con 0x7f780415d580 2023-10-14T18:54:45.556 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:54:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 msgr2=0x7f77f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 0x7f77f00693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f77fc001560 tx=0x7f77fc001640 comp rx=0 tx=0).stop 2023-10-14T18:54:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 msgr2=0x7f780414e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f77f40093f0 tx=0x7f77f4016000 comp rx=0 tx=0).stop 2023-10-14T18:54:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 shutdown_connections 2023-10-14T18:54:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f780415d580 0x7f780414e980 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7804157870 0x7f780416b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 --2- 172.21.15.79:0/2386044368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f780415a620 0x7f780414bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 >> 172.21.15.79:0/2386044368 conn(0x7f7804068ce0 msgr2=0x7f78040b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 shutdown_connections 2023-10-14T18:54:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:45.557+0000 7f780c4e4700 1 -- 172.21.15.79:0/2386044368 wait complete. 2023-10-14T18:54:45.569 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:54:45.570 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:54:45.570 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:54:45.570 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:54:45.571 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:54:45.571 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:54:45.571 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:54:45.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:54:45.572 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:54:45.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.573 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:54:45.588 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:54:45.589 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:54:45.589 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:54:45.589 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.590 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:54:45.590 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.590 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:45.590 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:45.590 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:54:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:45.591 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:45.591 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:54:45.591 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:45.592 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:54:45.592 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:45.592 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:54:45.592 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 41948sec preferred_lft 41948sec 2023-10-14T18:54:45.593 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:54:45.593 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.593 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:54:45.593 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:45.593 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:54:45.594 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.594 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:54:45.594 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.594 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:54:45.595 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:54:45.595 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:54:45.595 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.595 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:54:45.595 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:54:45.596 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:54:45.596 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:45.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.597 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:54:45.651 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:54:45.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.653 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:54:45.709 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:54:45.710 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:54:45.710 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:54:45.710 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:54:45.710 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:54:45.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.715 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:54:45.716 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:54:45.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:54:45.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:54:45.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:54:45.717 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:54:45.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.809 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:54:45.824 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:54:45.824 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:54:45.824 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:54:45.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:45.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:54:45.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:54:45.889 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:54:45.943 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:54:45.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:54:45.944 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:54:45.997 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:54:45.998 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:54:45.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:54:46.077 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:54:46.077 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:54:46.077 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:54:46.085 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:54:46.085 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:54:46.085 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:54:46.086 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:54:46.086 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:54:46.106 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:54:46.107 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:54:46.107 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:54:46.107 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:54:46.107 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:54:46.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:54:46.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:54:46.108 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:54:46.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:54:46.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:54:46.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:54:46.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.328+0000 7f10918c5700 1 Processor -- start 2023-10-14T18:54:46.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.328+0000 7f10918c5700 1 -- start start 2023-10-14T18:54:46.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10918c5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f108c0b1220 0x7f108c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10918c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 0x7f108c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10918c5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c15de60 con 0x7f108c0b0e50 2023-10-14T18:54:46.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10918c5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0cbed0 con 0x7f108c0b1220 2023-10-14T18:54:46.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10918c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c15e140 con 0x7f108c0cb4f0 2023-10-14T18:54:46.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 0x7f108c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f10827fc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f108c0b1220 0x7f108c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f108affd700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f108c0b0e50 0x7f108c06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:35526/0 (socket says 172.21.15.79:35526) 2023-10-14T18:54:46.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.329+0000 7f108affd700 1 -- 172.21.15.79:0/1740657600 learned_addr learned my addr 172.21.15.79:0/1740657600 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:54:46.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f10827fc700 1 -- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 msgr2=0x7f108c0cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:46.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f10827fc700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 0x7f108c0cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f10827fc700 1 -- 172.21.15.79:0/1740657600 >> v1:172.21.15.144:6789/0 conn(0x7f108c0b0e50 legacy=0x7f108c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f10827fc700 1 -- 172.21.15.79:0/1740657600 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c15e420 con 0x7f108c0b1220 2023-10-14T18:54:46.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f108b7fe700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 0x7f108c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:54:46.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f10827fc700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c0c9180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f10740098e0 tx=0x7f10740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3d1be9eef6420a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:46.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f108a7fc700 1 -- 172.21.15.79:0/1740657600 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400b640 con 0x7f108c0b1220 2023-10-14T18:54:46.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f108a7fc700 1 -- 172.21.15.79:0/1740657600 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107400b7a0 con 0x7f108c0b1220 2023-10-14T18:54:46.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.330+0000 7f108a7fc700 1 -- 172.21.15.79:0/1740657600 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400bb40 con 0x7f108c0b1220 2023-10-14T18:54:46.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 -- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 msgr2=0x7f108c0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c0c9180 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f10740098e0 tx=0x7f10740091a0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 -- 172.21.15.79:0/1740657600 shutdown_connections 2023-10-14T18:54:46.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0cb4f0 0x7f108c0cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 --2- 172.21.15.79:0/1740657600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c0c9180 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 -- 172.21.15.79:0/1740657600 >> 172.21.15.79:0/1740657600 conn(0x7f108c069870 msgr2=0x7f108c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 -- 172.21.15.79:0/1740657600 shutdown_connections 2023-10-14T18:54:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.331+0000 7f10918c5700 1 -- 172.21.15.79:0/1740657600 wait complete. 2023-10-14T18:54:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.332+0000 7f10918c5700 1 Processor -- start 2023-10-14T18:54:46.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.332+0000 7f10918c5700 1 -- start start 2023-10-14T18:54:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0b0e50 0x7f108c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c153e30 con 0x7f108c0cb4f0 2023-10-14T18:54:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1518b0 con 0x7f108c0b1220 2023-10-14T18:54:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10918c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c152f40 con 0x7f108c0b0e50 2023-10-14T18:54:46.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45248/0 (socket says 172.21.15.79:45248) 2023-10-14T18:54:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 -- 172.21.15.79:0/2936844366 learned_addr learned my addr 172.21.15.79:0/2936844366 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108affd700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0b0e50 0x7f108c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f10827fc700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 -- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0b0e50 msgr2=0x7f108c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0b0e50 0x7f108c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 -- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 msgr2=0x7f108c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 -- 172.21.15.79:0/2936844366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009a20 con 0x7f108c0cb4f0 2023-10-14T18:54:46.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.333+0000 7f108b7fe700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f108400c0f0 tx=0x7f108400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:46.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.334+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108400cc30 con 0x7f108c0cb4f0 2023-10-14T18:54:46.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.334+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108400f040 con 0x7f108c0cb4f0 2023-10-14T18:54:46.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.334+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074009420 con 0x7f108c0cb4f0 2023-10-14T18:54:46.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.334+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084014480 con 0x7f108c0cb4f0 2023-10-14T18:54:46.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.334+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c1537e0 con 0x7f108c0cb4f0 2023-10-14T18:54:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.335+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c153fa0 con 0x7f108c0cb4f0 2023-10-14T18:54:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.335+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1084003020 con 0x7f108c0cb4f0 2023-10-14T18:54:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.335+0000 7f10837fe700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.336+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1084084f30 con 0x7f108c0cb4f0 2023-10-14T18:54:46.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.336+0000 7f108affd700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.336+0000 7f108affd700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 0x7f106c0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f107c0018c0 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:46.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.340+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1084052100 con 0x7f108c0cb4f0 2023-10-14T18:54:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.566+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f108c04c3c0 con 0x7f108c0cb4f0 2023-10-14T18:54:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.566+0000 7f10837fe700 1 -- 172.21.15.79:0/2936844366 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1084055720 con 0x7f108c0cb4f0 2023-10-14T18:54:46.567 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:54:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 msgr2=0x7f106c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 0x7f106c0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f107c0018c0 tx=0x7f107c009040 comp rx=0 tx=0).stop 2023-10-14T18:54:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 msgr2=0x7f108c0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f108400c0f0 tx=0x7f108400b040 comp rx=0 tx=0).stop 2023-10-14T18:54:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 shutdown_connections 2023-10-14T18:54:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f106c066f30 0x7f106c0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f108c0cb4f0 0x7f108c0b3f70 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f108c0b0e50 0x7f108c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 --2- 172.21.15.79:0/2936844366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f108c0b1220 0x7f108c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 >> 172.21.15.79:0/2936844366 conn(0x7f108c069870 msgr2=0x7f108c159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 shutdown_connections 2023-10-14T18:54:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:46.568+0000 7f10918c5700 1 -- 172.21.15.79:0/2936844366 wait complete. 2023-10-14T18:54:46.581 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:54:46.581 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:54:46.582 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:54:46.582 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:54:46.582 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:54:46.583 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:54:46.583 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:54:46.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:54:46.584 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:54:46.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.585 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:54:46.604 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:54:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:54:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:54:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:54:46.605 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.606 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:46.606 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:54:46.606 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:54:46.607 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:54:46.607 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:46.607 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:54:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:54:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41940sec preferred_lft 41940sec 2023-10-14T18:54:46.608 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:54:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.609 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:54:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:54:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:54:46.609 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:54:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.610 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:54:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:54:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:54:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.611 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:54:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:54:46.611 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:54:46.612 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:54:46.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.613 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:54:46.673 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:54:46.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.675 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:54:46.733 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:54:46.733 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:54:46.734 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:54:46.734 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:54:46.734 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:54:46.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.735 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:54:46.735 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:54:46.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:54:46.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:54:46.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:54:46.737 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:54:46.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.841 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:54:46.856 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:54:46.857 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:54:46.857 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:54:46.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:46.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:54:46.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:54:46.922 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:54:46.976 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:54:46.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:54:46.977 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:54:47.031 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:54:47.031 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:54:47.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:54:47.111 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:54:47.112 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:54:47.112 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:54:47.120 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:54:47.120 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:54:47.121 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:54:47.121 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:54:47.121 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:54:47.142 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:54:47.142 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:54:47.142 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:54:47.142 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:54:47.143 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:54:47.143 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:54:47.143 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:54:47.145 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:54:47.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:54:47.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:54:47.147 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:54:47.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:54:47.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.326+0000 7f60407cc700 1 Processor -- start 2023-10-14T18:54:47.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.326+0000 7f60407cc700 1 -- start start 2023-10-14T18:54:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f60407cc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60380cf1c0 0x7f603815e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f60407cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f603815a0c0 0x7f6038068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f60407cc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380cca20 con 0x7f6038159cf0 2023-10-14T18:54:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f60407cc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603815ea40 con 0x7f60380cf1c0 2023-10-14T18:54:47.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f60407cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6038067660 con 0x7f603815a0c0 2023-10-14T18:54:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60380cf1c0 0x7f603815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60380cf1c0 0x7f603815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45250/0 (socket says 172.21.15.79:45250) 2023-10-14T18:54:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 -- 172.21.15.79:0/3253410892 learned_addr learned my addr 172.21.15.79:0/3253410892 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:47.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603ed69700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f603815a0c0 0x7f6038068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 -- 172.21.15.79:0/3253410892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f603815a0c0 msgr2=0x7f6038068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f603815a0c0 0x7f6038068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 -- 172.21.15.79:0/3253410892 >> v1:172.21.15.144:6789/0 conn(0x7f6038159cf0 legacy=0x7f60380ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 -- 172.21.15.79:0/3253410892 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038067f00 con 0x7f60380cf1c0 2023-10-14T18:54:47.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603dd67700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60380cf1c0 0x7f603815e500 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f60280099b0 tx=0x7f6028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66554729384cf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603d566700 1 -- 172.21.15.79:0/3253410892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028009ea0 con 0x7f60380cf1c0 2023-10-14T18:54:47.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603d566700 1 -- 172.21.15.79:0/3253410892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800b860 con 0x7f60380cf1c0 2023-10-14T18:54:47.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.327+0000 7f603d566700 1 -- 172.21.15.79:0/3253410892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800bc00 con 0x7f60380cf1c0 2023-10-14T18:54:47.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 -- 172.21.15.79:0/3253410892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60380cf1c0 msgr2=0x7f603815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60380cf1c0 0x7f603815e500 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f60280099b0 tx=0x7f6028009250 comp rx=0 tx=0).stop 2023-10-14T18:54:47.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 -- 172.21.15.79:0/3253410892 shutdown_connections 2023-10-14T18:54:47.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f603815a0c0 0x7f6038068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 --2- 172.21.15.79:0/3253410892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60380cf1c0 0x7f603815e500 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 -- 172.21.15.79:0/3253410892 >> 172.21.15.79:0/3253410892 conn(0x7f603806c6e0 msgr2=0x7f6038069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:47.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 -- 172.21.15.79:0/3253410892 shutdown_connections 2023-10-14T18:54:47.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.328+0000 7f60407cc700 1 -- 172.21.15.79:0/3253410892 wait complete. 2023-10-14T18:54:47.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.329+0000 7f60407cc700 1 Processor -- start 2023-10-14T18:54:47.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.329+0000 7f60407cc700 1 -- start start 2023-10-14T18:54:47.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60380cf1c0 0x7f60380ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f603815a0c0 0x7f6038157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380ad790 con 0x7f6038159cf0 2023-10-14T18:54:47.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b22d0 con 0x7f603815a0c0 2023-10-14T18:54:47.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f60407cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b2460 con 0x7f60380cf1c0 2023-10-14T18:54:47.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45252/0 (socket says 172.21.15.79:45252) 2023-10-14T18:54:47.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 -- 172.21.15.79:0/3800678546 learned_addr learned my addr 172.21.15.79:0/3800678546 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:47.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603e568700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60380cf1c0 0x7f60380ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603ed69700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f603815a0c0 0x7f6038157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 -- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60380cf1c0 msgr2=0x7f60380ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60380cf1c0 0x7f60380ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 -- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f603815a0c0 msgr2=0x7f6038157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f603815a0c0 0x7f6038157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 -- 172.21.15.79:0/3800678546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280094f0 con 0x7f6038159cf0 2023-10-14T18:54:47.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.330+0000 7f603dd67700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6028006fd0 tx=0x7f6028017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.331+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800bbe0 con 0x7f6038159cf0 2023-10-14T18:54:47.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.331+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6028000c90 con 0x7f6038159cf0 2023-10-14T18:54:47.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.331+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028011650 con 0x7f6038159cf0 2023-10-14T18:54:47.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.331+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60380ab770 con 0x7f6038159cf0 2023-10-14T18:54:47.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.331+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60380abfb0 con 0x7f6038159cf0 2023-10-14T18:54:47.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.332+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380abb00 con 0x7f6038159cf0 2023-10-14T18:54:47.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.332+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6028011a40 con 0x7f6038159cf0 2023-10-14T18:54:47.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.332+0000 7f602e7fc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.332+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6028085950 con 0x7f6038159cf0 2023-10-14T18:54:47.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.333+0000 7f603e568700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.333+0000 7f603e568700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 0x7f601c0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6034007fd0 tx=0x7f60340016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.337+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6028052c40 con 0x7f6038159cf0 2023-10-14T18:54:47.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.557+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60380b25a0 con 0x7f6038159cf0 2023-10-14T18:54:47.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.558+0000 7f602e7fc700 1 -- 172.21.15.79:0/3800678546 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f6028015090 con 0x7f6038159cf0 2023-10-14T18:54:47.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:54:47.560 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:54:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.559+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 msgr2=0x7f601c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 0x7f601c0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6034007fd0 tx=0x7f60340016f0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 msgr2=0x7f6038154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6028006fd0 tx=0x7f6028017000 comp rx=0 tx=0).stop 2023-10-14T18:54:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 shutdown_connections 2023-10-14T18:54:47.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f601c066f30 0x7f601c0693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f603815a0c0 0x7f6038157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f60380cf1c0 0x7f60380ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 --2- 172.21.15.79:0/3800678546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6038159cf0 0x7f6038154530 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 >> 172.21.15.79:0/3800678546 conn(0x7f603806c6e0 msgr2=0x7f60380696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:47.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 shutdown_connections 2023-10-14T18:54:47.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.560+0000 7f60407cc700 1 -- 172.21.15.79:0/3800678546 wait complete. 2023-10-14T18:54:47.564 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:54:47.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-14T18:54:47.705 INFO:teuthology.orchestra.run.smithi079.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":7791,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.876530094,"mdsmap_epoch":80,"osdmap_epoch":170,"osdmap_epoch_barrier":170,"uptime":18.003613786999999} 2023-10-14T18:54:47.706 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 7791, "mdsmap_epoch": 80, "osdmap_epoch": 170, "osdmap_epoch_barrier": 170, "rank_uptime": 12.876530094, "state": "up:active", "uptime": 18.003613787, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:54:47.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-14T18:54:47.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.824+0000 7fa6b57cf700 1 Processor -- start 2023-10-14T18:54:47.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.824+0000 7fa6b57cf700 1 -- start start 2023-10-14T18:54:47.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6b57cf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6b0159ef0 0x7fa6b015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6b57cf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6b57cf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00b17b0 con 0x7fa6b00b6a10 2023-10-14T18:54:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6b57cf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00b5020 con 0x7fa6b00b46f0 2023-10-14T18:54:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6b57cf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00b1a60 con 0x7fa6b0159ef0 2023-10-14T18:54:47.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6af7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6af7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45258/0 (socket says 172.21.15.79:45258) 2023-10-14T18:54:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6af7fe700 1 -- 172.21.15.79:0/542923222 learned_addr learned my addr 172.21.15.79:0/542923222 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:47.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6aeffd700 1 --2- 172.21.15.79:0/542923222 >> v2:172.21.15.144:3300/0 conn(0x7fa6b0159ef0 0x7fa6b015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6af7fe700 1 -- 172.21.15.79:0/542923222 >> v2:172.21.15.144:3300/0 conn(0x7fa6b0159ef0 msgr2=0x7fa6b015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.825+0000 7fa6af7fe700 1 --2- 172.21.15.79:0/542923222 >> v2:172.21.15.144:3300/0 conn(0x7fa6b0159ef0 0x7fa6b015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6af7fe700 1 -- 172.21.15.79:0/542923222 >> v1:172.21.15.144:6789/0 conn(0x7fa6b00b6a10 legacy=0x7fa6b00b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:54:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6af7fe700 1 -- 172.21.15.79:0/542923222 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b00b1d40 con 0x7fa6b00b46f0 2023-10-14T18:54:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6af7fe700 1 --2- 172.21.15.79:0/542923222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa6b008a710 tx=0x7fa6a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c46fb3a5f14e340 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6ae7fc700 1 -- 172.21.15.79:0/542923222 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800e070 con 0x7fa6b00b46f0 2023-10-14T18:54:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6ae7fc700 1 -- 172.21.15.79:0/542923222 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a800ba10 con 0x7fa6b00b46f0 2023-10-14T18:54:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6ae7fc700 1 -- 172.21.15.79:0/542923222 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80092e0 con 0x7fa6b00b46f0 2023-10-14T18:54:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 -- 172.21.15.79:0/542923222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b46f0 msgr2=0x7fa6b00b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/542923222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa6b008a710 tx=0x7fa6a8009840 comp rx=0 tx=0).stop 2023-10-14T18:54:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 -- 172.21.15.79:0/542923222 shutdown_connections 2023-10-14T18:54:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/542923222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b46f0 0x7fa6b00b4ae0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/542923222 >> v2:172.21.15.144:3300/0 conn(0x7fa6b0159ef0 0x7fa6b015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 -- 172.21.15.79:0/542923222 >> 172.21.15.79:0/542923222 conn(0x7fa6b009a0a0 msgr2=0x7fa6b0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 -- 172.21.15.79:0/542923222 shutdown_connections 2023-10-14T18:54:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.826+0000 7fa6b57cf700 1 -- 172.21.15.79:0/542923222 wait complete. 2023-10-14T18:54:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 Processor -- start 2023-10-14T18:54:47.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 -- start start 2023-10-14T18:54:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 0x7fa6b0169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 0x7fa6b006a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016d460 con 0x7fa6b00b6a10 2023-10-14T18:54:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016a660 con 0x7fa6b00b46f0 2023-10-14T18:54:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6b57cf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016a940 con 0x7fa6b0159ef0 2023-10-14T18:54:47.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.828+0000 7fa6a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45264/0 (socket says 172.21.15.79:45264) 2023-10-14T18:54:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 -- 172.21.15.79:0/710538410 learned_addr learned my addr 172.21.15.79:0/710538410 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:54:47.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6aeffd700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 0x7fa6b0169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6af7fe700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 0x7fa6b006a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 -- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 msgr2=0x7fa6b006a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 0x7fa6b006a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 -- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 msgr2=0x7fa6b0169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 0x7fa6b0169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 -- 172.21.15.79:0/710538410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009ae0 con 0x7fa6b00b6a10 2023-10-14T18:54:47.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6aeffd700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 0x7fa6b0169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6af7fe700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 0x7fa6b006a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:54:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a67fc700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c590 tx=0x7fa698007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698011590 con 0x7fa6b00b6a10 2023-10-14T18:54:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa698011730 con 0x7fa6b00b6a10 2023-10-14T18:54:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b016d6d0 con 0x7fa6b00b6a10 2023-10-14T18:54:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698011af0 con 0x7fa6b00b6a10 2023-10-14T18:54:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.829+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b016ac20 con 0x7fa6b00b6a10 2023-10-14T18:54:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.830+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b016d910 con 0x7fa6b00b6a10 2023-10-14T18:54:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.831+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa69801c460 con 0x7fa6b00b6a10 2023-10-14T18:54:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.831+0000 7fa6a77fe700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:54:47.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.831+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6980842e0 con 0x7fa6b00b6a10 2023-10-14T18:54:47.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.831+0000 7fa6aeffd700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:54:47.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.832+0000 7fa6aeffd700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 0x7fa6900693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00089d0 tx=0x7fa6a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:54:47.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:47.835+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6b016d910 con 0x7fa6b00b6a10 2023-10-14T18:54:48.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.021+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fa6b016d910 con 0x7fa6b00b6a10 2023-10-14T18:54:48.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.579+0000 7fa6a77fe700 1 -- 172.21.15.79:0/710538410 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v171) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa6b016d910 con 0x7fa6b00b6a10 2023-10-14T18:54:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 msgr2=0x7fa6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 0x7fa6900693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00089d0 tx=0x7fa6a0008040 comp rx=0 tx=0).stop 2023-10-14T18:54:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 msgr2=0x7fa6b00afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:54:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c590 tx=0x7fa698007f30 comp rx=0 tx=0).stop 2023-10-14T18:54:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 shutdown_connections 2023-10-14T18:54:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa690066f30 0x7fa6900693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6b0159ef0 0x7fa6b006a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6b00b46f0 0x7fa6b0169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 --2- 172.21.15.79:0/710538410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6b00b6a10 0x7fa6b00afa70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:54:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 >> 172.21.15.79:0/710538410 conn(0x7fa6b009a0a0 msgr2=0x7fa6b00b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:54:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 shutdown_connections 2023-10-14T18:54:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:54:48.581+0000 7fa6b57cf700 1 -- 172.21.15.79:0/710538410 wait complete. 2023-10-14T18:54:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-14T18:54:48.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:54:48.724 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:54:48.725 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:54:48.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-14T18:54:48.848 INFO:teuthology.orchestra.run.smithi079.stdout:{"mon_tick_interval":"5"} 2023-10-14T18:54:48.849 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-14T18:54:48.849 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-14T18:54:48.850 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-14T18:54:48.850 DEBUG:teuthology.orchestra.run.smithi079:> import time 2023-10-14T18:54:48.850 DEBUG:teuthology.orchestra.run.smithi079:> import datetime 2023-10-14T18:54:48.851 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-14T18:54:48.851 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-14T18:54:48.851 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.852 DEBUG:teuthology.orchestra.run.smithi079:> # Write some buffered data through before going full, all should be well 2023-10-14T18:54:48.852 DEBUG:teuthology.orchestra.run.smithi079:> print("writing some data through which we expect to succeed") 2023-10-14T18:54:48.853 DEBUG:teuthology.orchestra.run.smithi079:> bytes = 0 2023-10-14T18:54:48.853 DEBUG:teuthology.orchestra.run.smithi079:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-14T18:54:48.853 DEBUG:teuthology.orchestra.run.smithi079:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-14T18:54:48.854 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-14T18:54:48.854 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:54:48.854 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-14T18:54:48.855 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.855 DEBUG:teuthology.orchestra.run.smithi079:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-14T18:54:48.856 DEBUG:teuthology.orchestra.run.smithi079:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-14T18:54:48.856 DEBUG:teuthology.orchestra.run.smithi079:> # buffered IO, the error should always only appear from fsync and not 2023-10-14T18:54:48.856 DEBUG:teuthology.orchestra.run.smithi079:> # from write 2023-10-14T18:54:48.857 DEBUG:teuthology.orchestra.run.smithi079:> full = False 2023-10-14T18:54:48.857 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.858 DEBUG:teuthology.orchestra.run.smithi079:> for n in range(0, int(32 * 1.1)): 2023-10-14T18:54:48.858 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:54:48.858 DEBUG:teuthology.orchestra.run.smithi079:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-14T18:54:48.859 DEBUG:teuthology.orchestra.run.smithi079:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-14T18:54:48.859 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2023-10-14T18:54:48.860 DEBUG:teuthology.orchestra.run.smithi079:> if False: 2023-10-14T18:54:48.860 DEBUG:teuthology.orchestra.run.smithi079:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-14T18:54:48.860 DEBUG:teuthology.orchestra.run.smithi079:> raise 2023-10-14T18:54:48.861 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:54:48.861 DEBUG:teuthology.orchestra.run.smithi079:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:54:48.861 DEBUG:teuthology.orchestra.run.smithi079:> full = True 2023-10-14T18:54:48.862 DEBUG:teuthology.orchestra.run.smithi079:> break 2023-10-14T18:54:48.862 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.863 DEBUG:teuthology.orchestra.run.smithi079:> try: 2023-10-14T18:54:48.863 DEBUG:teuthology.orchestra.run.smithi079:> os.fsync(f) 2023-10-14T18:54:48.863 DEBUG:teuthology.orchestra.run.smithi079:> print("fsync'"'"'ed successfully") 2023-10-14T18:54:48.864 DEBUG:teuthology.orchestra.run.smithi079:> except OSError as e: 2023-10-14T18:54:48.864 DEBUG:teuthology.orchestra.run.smithi079:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:54:48.864 DEBUG:teuthology.orchestra.run.smithi079:> full = True 2023-10-14T18:54:48.865 DEBUG:teuthology.orchestra.run.smithi079:> break 2023-10-14T18:54:48.865 DEBUG:teuthology.orchestra.run.smithi079:> else: 2023-10-14T18:54:48.866 DEBUG:teuthology.orchestra.run.smithi079:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-14T18:54:48.866 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.866 DEBUG:teuthology.orchestra.run.smithi079:> if n > 32 * 0.9: 2023-10-14T18:54:48.867 DEBUG:teuthology.orchestra.run.smithi079:> # Be cautious in the last region where we expect to hit 2023-10-14T18:54:48.867 DEBUG:teuthology.orchestra.run.smithi079:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-14T18:54:48.867 DEBUG:teuthology.orchestra.run.smithi079:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-14T18:54:48.868 DEBUG:teuthology.orchestra.run.smithi079:> time.sleep(15.0) 2023-10-14T18:54:48.868 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.868 DEBUG:teuthology.orchestra.run.smithi079:> if not full: 2023-10-14T18:54:48.869 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-14T18:54:48.869 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.869 DEBUG:teuthology.orchestra.run.smithi079:> # close() should not raise an error because we already caught it in 2023-10-14T18:54:48.870 DEBUG:teuthology.orchestra.run.smithi079:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-14T18:54:48.870 DEBUG:teuthology.orchestra.run.smithi079:> # since then because all IOs got cancelled on the full flag. 2023-10-14T18:54:48.871 DEBUG:teuthology.orchestra.run.smithi079:> print("calling close") 2023-10-14T18:54:48.871 DEBUG:teuthology.orchestra.run.smithi079:> os.close(f) 2023-10-14T18:54:48.871 DEBUG:teuthology.orchestra.run.smithi079:> print("close() did not raise error") 2023-10-14T18:54:48.872 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-14T18:54:48.872 DEBUG:teuthology.orchestra.run.smithi079:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-14T18:54:48.872 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-14T18:55:10.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:10.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:40.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:40.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:49.838 INFO:teuthology.orchestra.run.smithi079.stdout:writing some data through which we expect to succeed 2023-10-14T18:55:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-14T18:55:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 1.00 MB 2023-10-14T18:55:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.840 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.840 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 2.00 MB 2023-10-14T18:55:49.840 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.840 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 3.00 MB 2023-10-14T18:55:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 4.00 MB 2023-10-14T18:55:49.841 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.842 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.842 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 5.00 MB 2023-10-14T18:55:49.842 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.842 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.842 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 6.00 MB 2023-10-14T18:55:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 7.00 MB 2023-10-14T18:55:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.844 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 8.00 MB 2023-10-14T18:55:49.844 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.844 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.844 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 9.00 MB 2023-10-14T18:55:49.844 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 10.00 MB 2023-10-14T18:55:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.846 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 11.00 MB 2023-10-14T18:55:49.846 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.846 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.846 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 12.00 MB 2023-10-14T18:55:49.846 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 13.00 MB 2023-10-14T18:55:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 14.00 MB 2023-10-14T18:55:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 15.00 MB 2023-10-14T18:55:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.849 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 16.00 MB 2023-10-14T18:55:49.849 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.849 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.849 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 17.00 MB 2023-10-14T18:55:49.849 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 18.00 MB 2023-10-14T18:55:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 19.00 MB 2023-10-14T18:55:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 20.00 MB 2023-10-14T18:55:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 21.00 MB 2023-10-14T18:55:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 22.00 MB 2023-10-14T18:55:49.852 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 23.00 MB 2023-10-14T18:55:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.853 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 24.00 MB 2023-10-14T18:55:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 25.00 MB 2023-10-14T18:55:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 26.00 MB 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 27.00 MB 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.855 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.856 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 28.00 MB 2023-10-14T18:55:49.861 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.862 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.862 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 29.00 MB 2023-10-14T18:55:49.862 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.863 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.863 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 30.00 MB 2023-10-14T18:55:49.863 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:55:49.863 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.864 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.864 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 31.00 MB 2023-10-14T18:55:49.864 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:55:49.864 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 32.00 MB 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:fsync'ed successfully 2023-10-14T18:55:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:Not full yet after 33.00 MB 2023-10-14T18:55:49.866 INFO:teuthology.orchestra.run.smithi079.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-14T18:55:49.866 INFO:teuthology.orchestra.run.smithi079.stdout:Reached fullness after 33.00 MB 2023-10-14T18:55:49.866 INFO:teuthology.orchestra.run.smithi079.stdout:calling close 2023-10-14T18:55:49.866 INFO:teuthology.orchestra.run.smithi079.stdout:close() did not raise error 2023-10-14T18:55:50.012 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:55:50.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:55:50.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:55:50.106 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:55:50.107 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:55:50.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:55:50.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:55:50.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:55:50.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:55:50.153 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:55:50.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:55:50.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:55:50.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:55:50.251 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:55:50.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:55:50.252 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:55:50.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:55:50.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.427+0000 7f915e759700 1 Processor -- start 2023-10-14T18:55:50.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.427+0000 7f915e759700 1 -- start start 2023-10-14T18:55:50.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915e759700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f915815a620 0x7f915815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915e759700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915815cbb0 con 0x7f915815d580 2023-10-14T18:55:50.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915e759700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915815bfa0 con 0x7f9158157870 2023-10-14T18:55:50.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915e759700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915815bdb0 con 0x7f915815a620 2023-10-14T18:55:50.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f91577fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f915815a620 0x7f915815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915ccf6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f915815d580 0x7f9158158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49276/0 (socket says 172.21.15.79:49276) 2023-10-14T18:55:50.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f91577fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f915815a620 0x7f915815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50060/0 (socket says 172.21.15.79:50060) 2023-10-14T18:55:50.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.428+0000 7f915ccf6700 1 -- 172.21.15.79:0/18962775 learned_addr learned my addr 172.21.15.79:0/18962775 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:50.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f91577fe700 1 -- 172.21.15.79:0/18962775 >> v1:172.21.15.144:6789/0 conn(0x7f9158157870 legacy=0x7f915815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:50.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f91577fe700 1 -- 172.21.15.79:0/18962775 >> v1:172.21.15.79:6789/0 conn(0x7f915815d580 legacy=0x7f9158158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f91577fe700 1 -- 172.21.15.79:0/18962775 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915815c280 con 0x7f915815a620 2023-10-14T18:55:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f9156ffd700 1 -- 172.21.15.79:0/18962775 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980908755 0 0) 0x7f915815cbb0 con 0x7f915815d580 2023-10-14T18:55:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f91577fe700 1 --2- 172.21.15.79:0/18962775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815a620 0x7f915815d040 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6948972294540bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f9156ffd700 1 -- 172.21.15.79:0/18962775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c009e80 con 0x7f915815a620 2023-10-14T18:55:50.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f9156ffd700 1 -- 172.21.15.79:0/18962775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00b820 con 0x7f915815a620 2023-10-14T18:55:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f9156ffd700 1 -- 172.21.15.79:0/18962775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00bba0 con 0x7f915815a620 2023-10-14T18:55:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 -- 172.21.15.79:0/18962775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815a620 msgr2=0x7f915815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 --2- 172.21.15.79:0/18962775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815a620 0x7f915815d040 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 -- 172.21.15.79:0/18962775 shutdown_connections 2023-10-14T18:55:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 --2- 172.21.15.79:0/18962775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815a620 0x7f915815d040 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 -- 172.21.15.79:0/18962775 >> 172.21.15.79:0/18962775 conn(0x7f9158068ce0 msgr2=0x7f91580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 -- 172.21.15.79:0/18962775 shutdown_connections 2023-10-14T18:55:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.429+0000 7f915e759700 1 -- 172.21.15.79:0/18962775 wait complete. 2023-10-14T18:55:50.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 Processor -- start 2023-10-14T18:55:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 -- start start 2023-10-14T18:55:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9158157870 0x7f915814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f915815a620 0x7f9158154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580b1d40 con 0x7f915815d580 2023-10-14T18:55:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91581556b0 con 0x7f915815a620 2023-10-14T18:55:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.431+0000 7f915e759700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158155990 con 0x7f9158157870 2023-10-14T18:55:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50068/0 (socket says 172.21.15.79:50068) 2023-10-14T18:55:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 -- 172.21.15.79:0/4108434778 learned_addr learned my addr 172.21.15.79:0/4108434778 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 -- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9158157870 msgr2=0x7f915814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9158157870 0x7f915814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 -- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f915815a620 msgr2=0x7f9158154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f915815a620 0x7f9158154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009420 con 0x7f915815d580 2023-10-14T18:55:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915ccf6700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f915000cbc0 tx=0x7f9150001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000a940 con 0x7f915815d580 2023-10-14T18:55:50.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000aaa0 con 0x7f915815d580 2023-10-14T18:55:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000ae60 con 0x7f915815d580 2023-10-14T18:55:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9158155c70 con 0x7f915815d580 2023-10-14T18:55:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.432+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9158155270 con 0x7f915815d580 2023-10-14T18:55:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.433+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915804c3c0 con 0x7f915815d580 2023-10-14T18:55:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.433+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9150007300 con 0x7f915815d580 2023-10-14T18:55:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.434+0000 7f913ffff700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.434+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f9150084960 con 0x7f915815d580 2023-10-14T18:55:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.434+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f914406eab0 con 0x7f915815d580 2023-10-14T18:55:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.434+0000 7f9157fff700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.435+0000 7f9157fff700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 0x7f91440693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9148007fd0 tx=0x7f9148007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.438+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9150051c30 con 0x7f915815d580 2023-10-14T18:55:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.662+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91580b1b10 con 0x7f915815d580 2023-10-14T18:55:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.662+0000 7f913ffff700 1 -- 172.21.15.79:0/4108434778 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f9150055250 con 0x7f915815d580 2023-10-14T18:55:50.664 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:50.665 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:55:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 msgr2=0x7f91440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 0x7f91440693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9148007fd0 tx=0x7f9148007b20 comp rx=0 tx=0).stop 2023-10-14T18:55:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 msgr2=0x7f915814b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f915000cbc0 tx=0x7f9150001980 comp rx=0 tx=0).stop 2023-10-14T18:55:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 shutdown_connections 2023-10-14T18:55:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9144066f30 0x7f91440693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f915815d580 0x7f915814b640 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9158157870 0x7f915814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 --2- 172.21.15.79:0/4108434778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f915815a620 0x7f9158154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 >> 172.21.15.79:0/4108434778 conn(0x7f9158068ce0 msgr2=0x7f915814c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 shutdown_connections 2023-10-14T18:55:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.664+0000 7f915e759700 1 -- 172.21.15.79:0/4108434778 wait complete. 2023-10-14T18:55:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:55:50.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:55:50.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.793+0000 7fda1966f700 1 Processor -- start 2023-10-14T18:55:50.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.793+0000 7fda1966f700 1 -- start start 2023-10-14T18:55:50.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda1966f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fda1415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda1966f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda1415dda0 0x7fda1415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda1966f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda140cb7c0 con 0x7fda140cd6e0 2023-10-14T18:55:50.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda1966f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1415e850 con 0x7fda1415dda0 2023-10-14T18:55:50.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda1966f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cc360 con 0x7fda140cdab0 2023-10-14T18:55:50.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda13fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda140cd6e0 0x7fda140cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49280/0 (socket says 172.21.15.79:49280) 2023-10-14T18:55:50.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda13fff700 1 -- 172.21.15.79:0/941302645 learned_addr learned my addr 172.21.15.79:0/941302645 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:50.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466320599 0 0) 0x7fda140cb7c0 con 0x7fda140cd6e0 2023-10-14T18:55:50.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9fc003570 con 0x7fda140cd6e0 2023-10-14T18:55:50.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda18e6e700 1 --2- 172.21.15.79:0/941302645 >> v2:172.21.15.144:3300/0 conn(0x7fda1415dda0 0x7fda1415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.794+0000 7fda137fe700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fda1415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640850599 0 0) 0x7fd9fc003570 con 0x7fda140cd6e0 2023-10-14T18:55:50.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 msgr2=0x7fda1415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:50.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fda1415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 >> v2:172.21.15.144:3300/0 conn(0x7fda1415dda0 msgr2=0x7fda1415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:50.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 --2- 172.21.15.79:0/941302645 >> v2:172.21.15.144:3300/0 conn(0x7fda1415dda0 0x7fda1415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1415e290 con 0x7fda140cd6e0 2023-10-14T18:55:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fda04001470 con 0x7fda140cd6e0 2023-10-14T18:55:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 >> v1:172.21.15.79:6789/0 conn(0x7fda140cd6e0 legacy=0x7fda140cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fd9fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fd9fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9fc004d50 0x7fd9fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415e850 con 0x7fd9fc003a60 2023-10-14T18:55:50.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cc360 con 0x7fd9fc004d50 2023-10-14T18:55:50.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc00bb10 con 0x7fda140cdab0 2023-10-14T18:55:50.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fd9fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda137fe700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fd9fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda18e6e700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9fc004d50 0x7fd9fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 -- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 msgr2=0x7fd9fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fd9fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 -- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9fc004d50 msgr2=0x7fd9fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9fc004d50 0x7fd9fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 -- 172.21.15.79:0/941302645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc003570 con 0x7fd9fc003a60 2023-10-14T18:55:50.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda137fe700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140cdab0 0x7fd9fc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:50.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda18e6e700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9fc004d50 0x7fd9fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:50.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda13fff700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fd9fc003e70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c3c0 tx=0x7fda140ccaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecf3ce8d4142dca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400cc90 con 0x7fd9fc003a60 2023-10-14T18:55:50.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400cdf0 con 0x7fd9fc003a60 2023-10-14T18:55:50.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.795+0000 7fda12ffd700 1 -- 172.21.15.79:0/941302645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04005b70 con 0x7fd9fc003a60 2023-10-14T18:55:50.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 -- 172.21.15.79:0/941302645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 msgr2=0x7fd9fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 --2- 172.21.15.79:0/941302645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fd9fc003e70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda0400c3c0 tx=0x7fda140ccaf0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda18e6e700 1 -- 172.21.15.79:0/941302645 reap_dead start 2023-10-14T18:55:50.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 -- 172.21.15.79:0/941302645 shutdown_connections 2023-10-14T18:55:50.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 -- 172.21.15.79:0/941302645 >> 172.21.15.79:0/941302645 conn(0x7fda14067660 msgr2=0x7fda14067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:50.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 -- 172.21.15.79:0/941302645 shutdown_connections 2023-10-14T18:55:50.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.796+0000 7fda1966f700 1 -- 172.21.15.79:0/941302645 wait complete. 2023-10-14T18:55:50.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.797+0000 7fda1966f700 1 Processor -- start 2023-10-14T18:55:50.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.797+0000 7fda1966f700 1 -- start start 2023-10-14T18:55:50.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140afe00 0x7fda1416de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda140b5d10 0x7fda140b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda141591b0 con 0x7fd9fc003a60 2023-10-14T18:55:50.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140b5880 con 0x7fda140b5d10 2023-10-14T18:55:50.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda1966f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140b5550 con 0x7fda140afe00 2023-10-14T18:55:50.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50084/0 (socket says 172.21.15.79:50084) 2023-10-14T18:55:50.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 -- 172.21.15.79:0/3918363208 learned_addr learned my addr 172.21.15.79:0/3918363208 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:50.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda18e6e700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda140b5d10 0x7fda140b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda137fe700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140afe00 0x7fda1416de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 -- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140afe00 msgr2=0x7fda1416de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140afe00 0x7fda1416de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 -- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda140b5d10 msgr2=0x7fda140b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:50.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda140b5d10 0x7fda140b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:50.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14159400 con 0x7fd9fc003a60 2023-10-14T18:55:50.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.798+0000 7fda13fff700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00ba60 tx=0x7fda04015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400cc90 con 0x7fd9fc003a60 2023-10-14T18:55:50.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda040072e0 con 0x7fd9fc003a60 2023-10-14T18:55:50.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04001cd0 con 0x7fd9fc003a60 2023-10-14T18:55:50.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda141596e0 con 0x7fd9fc003a60 2023-10-14T18:55:50.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1416e340 con 0x7fd9fc003a60 2023-10-14T18:55:50.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.799+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1416e560 con 0x7fd9fc003a60 2023-10-14T18:55:50.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.800+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda04019030 con 0x7fd9fc003a60 2023-10-14T18:55:50.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.800+0000 7fd9fbfff700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:50.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.800+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fda040856b0 con 0x7fd9fc003a60 2023-10-14T18:55:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.800+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7fda0006eab0 con 0x7fd9fc003a60 2023-10-14T18:55:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.800+0000 7fda137fe700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.801+0000 7fda137fe700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 0x7fda000693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda14157920 tx=0x7fda08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:50.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.804+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda04052900 con 0x7fd9fc003a60 2023-10-14T18:55:50.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.997+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda140b5b60 con 0x7fd9fc003a60 2023-10-14T18:55:50.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.997+0000 7fd9fbfff700 1 -- 172.21.15.79:0/3918363208 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+15441 (secure 0 0 0) 0x7fda0402b090 con 0x7fd9fc003a60 2023-10-14T18:55:51.000 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:51.000 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":174,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:55:27.582036+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:55:51.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 msgr2=0x7fda000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 0x7fda000693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fda14157920 tx=0x7fda08008040 comp rx=0 tx=0).stop 2023-10-14T18:55:51.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 msgr2=0x7fda141588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00ba60 tx=0x7fda04015000 comp rx=0 tx=0).stop 2023-10-14T18:55:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 shutdown_connections 2023-10-14T18:55:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fda00066f30 0x7fda000693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda140b5d10 0x7fda140b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9fc003a60 0x7fda141588c0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 --2- 172.21.15.79:0/3918363208 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fda140afe00 0x7fda1416de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 >> 172.21.15.79:0/3918363208 conn(0x7fda14067660 msgr2=0x7fda14157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 shutdown_connections 2023-10-14T18:55:51.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:50.999+0000 7fda1966f700 1 -- 172.21.15.79:0/3918363208 wait complete. 2023-10-14T18:55:51.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:54:32.544388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:54:33.148982+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:55:51.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:55:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.129+0000 7f3b8bfff700 1 Processor -- start 2023-10-14T18:55:51.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.129+0000 7f3b8bfff700 1 -- start start 2023-10-14T18:55:51.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b8c0cce30 0x7f3b8c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b8c0b6580 0x7f3b8c06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c15d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c06ac90 con 0x7f3b8c0cce30 2023-10-14T18:55:51.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c0b4d70 con 0x7f3b8c0b6580 2023-10-14T18:55:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0cd8d0 con 0x7f3b8c06a830 2023-10-14T18:55:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b8c0cce30 0x7f3b8c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3b8c0cce30 0x7f3b8c15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50098/0 (socket says 172.21.15.79:50098) 2023-10-14T18:55:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 -- 172.21.15.79:0/3226752143 learned_addr learned my addr 172.21.15.79:0/3226752143 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b827fc700 1 --2- 172.21.15.79:0/3226752143 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c0b6580 0x7f3b8c06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8b7fe700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 -- 172.21.15.79:0/3226752143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 msgr2=0x7f3b8c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 -- 172.21.15.79:0/3226752143 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c0b6580 msgr2=0x7f3b8c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:51.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 --2- 172.21.15.79:0/3226752143 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c0b6580 0x7f3b8c06a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.130+0000 7f3b8affd700 1 -- 172.21.15.79:0/3226752143 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c0b4440 con 0x7f3b8c0cce30 2023-10-14T18:55:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8affd700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c15aca0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c089bc0 tx=0x7f3b7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d5710a608c6713 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8a7fc700 1 -- 172.21.15.79:0/3226752143 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00b860 con 0x7f3b8c0cce30 2023-10-14T18:55:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8a7fc700 1 -- 172.21.15.79:0/3226752143 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00b9c0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8a7fc700 1 -- 172.21.15.79:0/3226752143 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00bd60 con 0x7f3b8c0cce30 2023-10-14T18:55:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 -- 172.21.15.79:0/3226752143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 msgr2=0x7f3b8c15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c15aca0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c089bc0 tx=0x7f3b7c009250 comp rx=0 tx=0).stop 2023-10-14T18:55:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 -- 172.21.15.79:0/3226752143 shutdown_connections 2023-10-14T18:55:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/3226752143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c15aca0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/3226752143 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c0b6580 0x7f3b8c06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 -- 172.21.15.79:0/3226752143 >> 172.21.15.79:0/3226752143 conn(0x7f3b8c068cb0 msgr2=0x7f3b8c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 -- 172.21.15.79:0/3226752143 shutdown_connections 2023-10-14T18:55:51.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.131+0000 7f3b8bfff700 1 -- 172.21.15.79:0/3226752143 wait complete. 2023-10-14T18:55:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.132+0000 7f3b8bfff700 1 Processor -- start 2023-10-14T18:55:51.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.132+0000 7f3b8bfff700 1 -- start start 2023-10-14T18:55:51.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0b6580 0x7f3b8c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c0ccaf0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c16a1e0 con 0x7f3b8c0b6580 2023-10-14T18:55:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8bfff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c169ef0 con 0x7f3b8c06a830 2023-10-14T18:55:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50102/0 (socket says 172.21.15.79:50102) 2023-10-14T18:55:51.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8b7fe700 1 -- 172.21.15.79:0/1310365216 learned_addr learned my addr 172.21.15.79:0/1310365216 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b827fc700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0b6580 0x7f3b8c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.133+0000 7f3b8affd700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 -- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 msgr2=0x7f3b8c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 -- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0b6580 msgr2=0x7f3b8c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0b6580 0x7f3b8c14f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0094f0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8b7fe700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009fa0 tx=0x7f3b84009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400ebc0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400ed20 con 0x7f3b8c0cce30 2023-10-14T18:55:51.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c0c7d10 con 0x7f3b8c0cce30 2023-10-14T18:55:51.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84014670 con 0x7f3b8c0cce30 2023-10-14T18:55:51.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.134+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c14fed0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.135+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c0c81d0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.135+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b840149e0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.136+0000 7f3b837fe700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 0x7f3b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.136+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f3b84084b40 con 0x7f3b8c0cce30 2023-10-14T18:55:51.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.136+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f3b6c06eab0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.136+0000 7f3b8affd700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 0x7f3b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.136+0000 7f3b8affd700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 0x7f3b6c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c089bc0 tx=0x7f3b7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.140+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b84051d90 con 0x7f3b8c0cce30 2023-10-14T18:55:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.321+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b8c16a320 con 0x7f3b8c0cce30 2023-10-14T18:55:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.322+0000 7f3b837fe700 1 -- 172.21.15.79:0/1310365216 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b840553b0 con 0x7f3b8c0cce30 2023-10-14T18:55:51.324 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:55:51.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 msgr2=0x7f3b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 0x7f3b6c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c089bc0 tx=0x7f3b7c017000 comp rx=0 tx=0).stop 2023-10-14T18:55:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 msgr2=0x7f3b8c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009fa0 tx=0x7f3b84009900 comp rx=0 tx=0).stop 2023-10-14T18:55:51.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 shutdown_connections 2023-10-14T18:55:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3b6c066f30 0x7f3b6c0693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3b8c0cce30 0x7f3b8c0c8ec0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c06a830 0x7f3b8c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 --2- 172.21.15.79:0/1310365216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0b6580 0x7f3b8c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 >> 172.21.15.79:0/1310365216 conn(0x7f3b8c068cb0 msgr2=0x7f3b8c15bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 shutdown_connections 2023-10-14T18:55:51.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.324+0000 7f3b8bfff700 1 -- 172.21.15.79:0/1310365216 wait complete. 2023-10-14T18:55:51.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:55:51.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.454+0000 7f4a5e223700 1 Processor -- start 2023-10-14T18:55:51.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.454+0000 7f4a5e223700 1 -- start start 2023-10-14T18:55:51.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a5e223700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a58159ec0 0x7f4a580af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a5e223700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806acb0 0x7f4a580afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a5e223700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580b0790 con 0x7f4a5815a290 2023-10-14T18:55:51.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a5e223700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580ce1f0 con 0x7f4a58159ec0 2023-10-14T18:55:51.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a5e223700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580b0b20 con 0x7f4a5806acb0 2023-10-14T18:55:51.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a58159ec0 0x7f4a580af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4a58159ec0 0x7f4a580af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50114/0 (socket says 172.21.15.79:50114) 2023-10-14T18:55:51.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 -- 172.21.15.79:0/1393176220 learned_addr learned my addr 172.21.15.79:0/1393176220 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a57fff700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806acb0 0x7f4a580afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 -- 172.21.15.79:0/1393176220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806acb0 msgr2=0x7f4a580afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806acb0 0x7f4a580afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 -- 172.21.15.79:0/1393176220 >> v1:172.21.15.144:6789/0 conn(0x7f4a5815a290 legacy=0x7f4a5806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.455+0000 7f4a577fe700 1 -- 172.21.15.79:0/1393176220 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580b04b0 con 0x7f4a58159ec0 2023-10-14T18:55:51.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a577fe700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58159ec0 0x7f4a580af940 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009f20 tx=0x7f4a48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9bafc0a5f4444 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a567fc700 1 -- 172.21.15.79:0/1393176220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800e070 con 0x7f4a58159ec0 2023-10-14T18:55:51.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a567fc700 1 -- 172.21.15.79:0/1393176220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800ba80 con 0x7f4a58159ec0 2023-10-14T18:55:51.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a567fc700 1 -- 172.21.15.79:0/1393176220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480092e0 con 0x7f4a58159ec0 2023-10-14T18:55:51.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 -- 172.21.15.79:0/1393176220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58159ec0 msgr2=0x7f4a580af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58159ec0 0x7f4a580af940 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009f20 tx=0x7f4a48009840 comp rx=0 tx=0).stop 2023-10-14T18:55:51.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 -- 172.21.15.79:0/1393176220 shutdown_connections 2023-10-14T18:55:51.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5806acb0 0x7f4a580afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 --2- 172.21.15.79:0/1393176220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a58159ec0 0x7f4a580af940 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 -- 172.21.15.79:0/1393176220 >> 172.21.15.79:0/1393176220 conn(0x7f4a580d1880 msgr2=0x7f4a580cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 -- 172.21.15.79:0/1393176220 shutdown_connections 2023-10-14T18:55:51.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.456+0000 7f4a5e223700 1 -- 172.21.15.79:0/1393176220 wait complete. 2023-10-14T18:55:51.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 Processor -- start 2023-10-14T18:55:51.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 -- start start 2023-10-14T18:55:51.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58159ec0 0x7f4a580c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 0x7f4a580c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581561d0 con 0x7f4a5806acb0 2023-10-14T18:55:51.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58156790 con 0x7f4a58159ec0 2023-10-14T18:55:51.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a5e223700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580ca4b0 con 0x7f4a5815a290 2023-10-14T18:55:51.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50120/0 (socket says 172.21.15.79:50120) 2023-10-14T18:55:51.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.458+0000 7f4a577fe700 1 -- 172.21.15.79:0/688789347 learned_addr learned my addr 172.21.15.79:0/688789347 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a57fff700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 0x7f4a580c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a56ffd700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58159ec0 0x7f4a580c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 -- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 msgr2=0x7f4a580c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 0x7f4a580c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 -- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58159ec0 msgr2=0x7f4a580c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58159ec0 0x7f4a580c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48009ae0 con 0x7f4a5806acb0 2023-10-14T18:55:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a57fff700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 0x7f4a580c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a577fe700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009430 tx=0x7f4a48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48008aa0 con 0x7f4a5806acb0 2023-10-14T18:55:51.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48008c20 con 0x7f4a5806acb0 2023-10-14T18:55:51.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580ca790 con 0x7f4a5806acb0 2023-10-14T18:55:51.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48026460 con 0x7f4a5806acb0 2023-10-14T18:55:51.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.459+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a58155a80 con 0x7f4a5806acb0 2023-10-14T18:55:51.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.460+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5804c3c0 con 0x7f4a5806acb0 2023-10-14T18:55:51.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.460+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a48003040 con 0x7f4a5806acb0 2023-10-14T18:55:51.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.461+0000 7f4a3f7fe700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.461+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f4a480863f0 con 0x7f4a5806acb0 2023-10-14T18:55:51.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.461+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f4a4406eab0 con 0x7f4a5806acb0 2023-10-14T18:55:51.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.461+0000 7f4a56ffd700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.461+0000 7f4a56ffd700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0037c0 tx=0x7f4a4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.465+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a48021060 con 0x7f4a5806acb0 2023-10-14T18:55:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.648+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a580ceab0 con 0x7f4a5806acb0 2023-10-14T18:55:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.649+0000 7f4a3f7fe700 1 -- 172.21.15.79:0/688789347 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a480536f0 con 0x7f4a5806acb0 2023-10-14T18:55:51.651 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:55:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 msgr2=0x7f4a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0037c0 tx=0x7f4a4c009040 comp rx=0 tx=0).stop 2023-10-14T18:55:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 msgr2=0x7f4a580afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009430 tx=0x7f4a48018000 comp rx=0 tx=0).stop 2023-10-14T18:55:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 shutdown_connections 2023-10-14T18:55:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4a5815a290 0x7f4a580c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a5806acb0 0x7f4a580afd70 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 --2- 172.21.15.79:0/688789347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a58159ec0 0x7f4a580c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 >> 172.21.15.79:0/688789347 conn(0x7f4a580d1880 msgr2=0x7f4a580b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 shutdown_connections 2023-10-14T18:55:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.651+0000 7f4a5e223700 1 -- 172.21.15.79:0/688789347 wait complete. 2023-10-14T18:55:51.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:55:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.781+0000 7f8505fb1700 1 Processor -- start 2023-10-14T18:55:51.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.781+0000 7f8505fb1700 1 -- start start 2023-10-14T18:55:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f8505fb1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8500159ec0 0x7f85000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f8505fb1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f8505fb1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85000b0790 con 0x7f850006a5a0 2023-10-14T18:55:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f8505fb1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85000ce1f0 con 0x7f8500159ec0 2023-10-14T18:55:51.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f8505fb1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85000b0b20 con 0x7f850015a290 2023-10-14T18:55:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84f6ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84ff7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8500159ec0 0x7f85000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84f6ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46224/0 (socket says 172.21.15.79:46224) 2023-10-14T18:55:51.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84f6ffd700 1 -- 172.21.15.79:0/562965813 learned_addr learned my addr 172.21.15.79:0/562965813 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84ff7fe700 1 -- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 msgr2=0x7f85000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84ff7fe700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84ff7fe700 1 -- 172.21.15.79:0/562965813 >> v1:172.21.15.144:6789/0 conn(0x7f850006a5a0 legacy=0x7f850015db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84ff7fe700 1 -- 172.21.15.79:0/562965813 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000b04b0 con 0x7f8500159ec0 2023-10-14T18:55:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.782+0000 7f84f6ffd700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:55:51.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f84ff7fe700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8500159ec0 0x7f85000af940 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098e0 tx=0x7f84f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0bf0e661bbf25a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f84feffd700 1 -- 172.21.15.79:0/562965813 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000b640 con 0x7f8500159ec0 2023-10-14T18:55:51.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f84feffd700 1 -- 172.21.15.79:0/562965813 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f000b7a0 con 0x7f8500159ec0 2023-10-14T18:55:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f84feffd700 1 -- 172.21.15.79:0/562965813 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f000bb40 con 0x7f8500159ec0 2023-10-14T18:55:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 -- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8500159ec0 msgr2=0x7f85000af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8500159ec0 0x7f85000af940 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f84f00098e0 tx=0x7f84f00091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 -- 172.21.15.79:0/562965813 shutdown_connections 2023-10-14T18:55:51.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8500159ec0 0x7f85000af940 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 --2- 172.21.15.79:0/562965813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f850015a290 0x7f85000afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 -- 172.21.15.79:0/562965813 >> 172.21.15.79:0/562965813 conn(0x7f85000d1880 msgr2=0x7f85000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 -- 172.21.15.79:0/562965813 shutdown_connections 2023-10-14T18:55:51.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.783+0000 7f8505fb1700 1 -- 172.21.15.79:0/562965813 wait complete. 2023-10-14T18:55:51.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.784+0000 7f8505fb1700 1 Processor -- start 2023-10-14T18:55:51.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 -- start start 2023-10-14T18:55:51.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8500159ec0 0x7f8500156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 0x7f8500155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015d150 con 0x7f850006a5a0 2023-10-14T18:55:51.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850015d430 con 0x7f850015a290 2023-10-14T18:55:51.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.785+0000 7f8505fb1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850015d710 con 0x7f8500159ec0 2023-10-14T18:55:51.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50122/0 (socket says 172.21.15.79:50122) 2023-10-14T18:55:51.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 -- 172.21.15.79:0/3042423042 learned_addr learned my addr 172.21.15.79:0/3042423042 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:51.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84f6ffd700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8500159ec0 0x7f8500156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84fffff700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 0x7f8500155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 -- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8500159ec0 msgr2=0x7f8500156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8500159ec0 0x7f8500156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 -- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 msgr2=0x7f8500155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 0x7f8500155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80094f0 con 0x7f850006a5a0 2023-10-14T18:55:51.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84fffff700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 0x7f8500155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:55:51.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84ff7fe700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f84f000a010 tx=0x7f84f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f001bde0 con 0x7f850006a5a0 2023-10-14T18:55:51.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0011420 con 0x7f850006a5a0 2023-10-14T18:55:51.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f0009420 con 0x7f850006a5a0 2023-10-14T18:55:51.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0011820 con 0x7f850006a5a0 2023-10-14T18:55:51.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.786+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850015aba0 con 0x7f850006a5a0 2023-10-14T18:55:51.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.787+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850015d930 con 0x7f850006a5a0 2023-10-14T18:55:51.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.788+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84f0011c50 con 0x7f850006a5a0 2023-10-14T18:55:51.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.788+0000 7f84f7fff700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:51.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.788+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f84f0085a50 con 0x7f850006a5a0 2023-10-14T18:55:51.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.788+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f84e006eab0 con 0x7f850006a5a0 2023-10-14T18:55:51.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.788+0000 7f84f6ffd700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:51.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.789+0000 7f84f6ffd700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 0x7f84e00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f84e8006d40 tx=0x7f84e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:51.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.792+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84f0052d20 con 0x7f850006a5a0 2023-10-14T18:55:51.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.973+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850004c3c0 con 0x7f850006a5a0 2023-10-14T18:55:51.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.974+0000 7f84f7fff700 1 -- 172.21.15.79:0/3042423042 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84f0028070 con 0x7f850006a5a0 2023-10-14T18:55:51.976 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:55:51.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 msgr2=0x7f84e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 0x7f84e00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f84e8006d40 tx=0x7f84e8008040 comp rx=0 tx=0).stop 2023-10-14T18:55:51.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 msgr2=0x7f850015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:51.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f84f000a010 tx=0x7f84f0017000 comp rx=0 tx=0).stop 2023-10-14T18:55:51.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 shutdown_connections 2023-10-14T18:55:51.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f84e0066f30 0x7f84e00693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850015a290 0x7f8500155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f850006a5a0 0x7f850015a660 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 --2- 172.21.15.79:0/3042423042 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8500159ec0 0x7f8500156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:51.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 >> 172.21.15.79:0/3042423042 conn(0x7f85000d1880 msgr2=0x7f85000b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:51.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 shutdown_connections 2023-10-14T18:55:51.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:51.976+0000 7f8505fb1700 1 -- 172.21.15.79:0/3042423042 wait complete. 2023-10-14T18:55:51.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:55:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.102+0000 7f934ffff700 1 Processor -- start 2023-10-14T18:55:52.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.102+0000 7f934ffff700 1 -- start start 2023-10-14T18:55:52.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f935015b540 0x7f935015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9350153e50 0x7f93501542f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934ffff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500cf0c0 con 0x7f93500d0970 2023-10-14T18:55:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934ffff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935015b3e0 con 0x7f935015b540 2023-10-14T18:55:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935015e8f0 con 0x7f9350153e50 2023-10-14T18:55:52.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f93467fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f935015b540 0x7f935015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f93500d0970 0x7f93500d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49286/0 (socket says 172.21.15.79:49286) 2023-10-14T18:55:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934effd700 1 -- 172.21.15.79:0/879358692 learned_addr learned my addr 172.21.15.79:0/879358692 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934f7fe700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9350153e50 0x7f93501542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f93467fc700 1 -- 172.21.15.79:0/879358692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9350153e50 msgr2=0x7f93501542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f93467fc700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9350153e50 0x7f93501542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f93467fc700 1 -- 172.21.15.79:0/879358692 >> v1:172.21.15.79:6789/0 conn(0x7f93500d0970 legacy=0x7f93500d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f93467fc700 1 -- 172.21.15.79:0/879358692 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350154830 con 0x7f935015b540 2023-10-14T18:55:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.103+0000 7f934e7fc700 1 -- 172.21.15.79:0/879358692 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642756717 0 0) 0x7f93500cf0c0 con 0x7f93500d0970 2023-10-14T18:55:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f93467fc700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935015b540 0x7f935015aea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f93380098e0 tx=0x7f93380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f32c9c861f1454b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934e7fc700 1 -- 172.21.15.79:0/879358692 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338009e80 con 0x7f935015b540 2023-10-14T18:55:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934e7fc700 1 -- 172.21.15.79:0/879358692 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800b860 con 0x7f935015b540 2023-10-14T18:55:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934e7fc700 1 -- 172.21.15.79:0/879358692 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800bbe0 con 0x7f935015b540 2023-10-14T18:55:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 -- 172.21.15.79:0/879358692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935015b540 msgr2=0x7f935015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935015b540 0x7f935015aea0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f93380098e0 tx=0x7f93380091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 -- 172.21.15.79:0/879358692 shutdown_connections 2023-10-14T18:55:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9350153e50 0x7f93501542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 --2- 172.21.15.79:0/879358692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f935015b540 0x7f935015aea0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 -- 172.21.15.79:0/879358692 >> 172.21.15.79:0/879358692 conn(0x7f9350068c00 msgr2=0x7f9350069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:52.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 -- 172.21.15.79:0/879358692 shutdown_connections 2023-10-14T18:55:52.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.104+0000 7f934ffff700 1 -- 172.21.15.79:0/879358692 wait complete. 2023-10-14T18:55:52.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 Processor -- start 2023-10-14T18:55:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 -- start start 2023-10-14T18:55:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9350153e50 0x7f93501599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f935015b540 0x7f935016d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350157a30 con 0x7f93500d0970 2023-10-14T18:55:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350156e20 con 0x7f9350153e50 2023-10-14T18:55:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934ffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9350157100 con 0x7f935015b540 2023-10-14T18:55:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50132/0 (socket says 172.21.15.79:50132) 2023-10-14T18:55:52.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.106+0000 7f934effd700 1 -- 172.21.15.79:0/462113749 learned_addr learned my addr 172.21.15.79:0/462113749 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f93467fc700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9350153e50 0x7f93501599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934f7fe700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f935015b540 0x7f935016d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 -- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f935015b540 msgr2=0x7f935016d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f935015b540 0x7f935016d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 -- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9350153e50 msgr2=0x7f93501599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9350153e50 0x7f93501599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338009420 con 0x7f93500d0970 2023-10-14T18:55:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934effd700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f934000c7e0 tx=0x7f9340007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340005b30 con 0x7f93500d0970 2023-10-14T18:55:52.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340005c90 con 0x7f93500d0970 2023-10-14T18:55:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93501573e0 con 0x7f93500d0970 2023-10-14T18:55:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340007300 con 0x7f93500d0970 2023-10-14T18:55:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.107+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350156a80 con 0x7f93500d0970 2023-10-14T18:55:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.108+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350089290 con 0x7f93500d0970 2023-10-14T18:55:52.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.108+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f934001b400 con 0x7f93500d0970 2023-10-14T18:55:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.109+0000 7f93477fe700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 0x7f93300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.109+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f9340084060 con 0x7f93500d0970 2023-10-14T18:55:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.109+0000 7f93467fc700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 0x7f93300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.109+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f933006eab0 con 0x7f93500d0970 2023-10-14T18:55:52.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.109+0000 7f93467fc700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 0x7f93300693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f935015c0c0 tx=0x7f9338017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.113+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9340051330 con 0x7f93500d0970 2023-10-14T18:55:52.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.339+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f935015e050 con 0x7f93500d0970 2023-10-14T18:55:52.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.340+0000 7f93477fe700 1 -- 172.21.15.79:0/462113749 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f9340054950 con 0x7f93500d0970 2023-10-14T18:55:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:52.342 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:55:52.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 msgr2=0x7f93300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 0x7f93300693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f935015c0c0 tx=0x7f9338017000 comp rx=0 tx=0).stop 2023-10-14T18:55:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 msgr2=0x7f9350159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f934000c7e0 tx=0x7f9340007df0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 shutdown_connections 2023-10-14T18:55:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9330066f30 0x7f93300693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f935015b540 0x7f935016d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93500d0970 0x7f9350159470 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 --2- 172.21.15.79:0/462113749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9350153e50 0x7f93501599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 >> 172.21.15.79:0/462113749 conn(0x7f9350068c00 msgr2=0x7f93500b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 shutdown_connections 2023-10-14T18:55:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.342+0000 7f934ffff700 1 -- 172.21.15.79:0/462113749 wait complete. 2023-10-14T18:55:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:55:52.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:55:52.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.468+0000 7fcf78d16700 1 Processor -- start 2023-10-14T18:55:52.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.468+0000 7fcf78d16700 1 -- start start 2023-10-14T18:55:52.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf78d16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf7415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf78d16700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7415cbb0 con 0x7fcf74157c40 2023-10-14T18:55:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf78d16700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7415bfa0 con 0x7fcf7415a620 2023-10-14T18:55:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf78d16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415c280 con 0x7fcf74157870 2023-10-14T18:55:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf72d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcf74157c40 0x7fcf74158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49288/0 (socket says 172.21.15.79:49288) 2023-10-14T18:55:52.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.469+0000 7fcf72d9d700 1 -- 172.21.15.79:0/1419449914 learned_addr learned my addr 172.21.15.79:0/1419449914 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:52.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf7259c700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf7415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195061392 0 0) 0x7fcf7415cbb0 con 0x7fcf74157c40 2023-10-14T18:55:52.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf60003570 con 0x7fcf74157c40 2023-10-14T18:55:52.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158611912 0 0) 0x7fcf7415bfa0 con 0x7fcf7415a620 2023-10-14T18:55:52.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7415cbb0 con 0x7fcf7415a620 2023-10-14T18:55:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 101074453 0 0) 0x7fcf60003570 con 0x7fcf74157c40 2023-10-14T18:55:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 msgr2=0x7fcf7415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf7415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 >> v1:172.21.15.144:6789/0 conn(0x7fcf7415a620 legacy=0x7fcf7415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7415c560 con 0x7fcf74157c40 2023-10-14T18:55:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fcf6c0017f0 con 0x7fcf74157c40 2023-10-14T18:55:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 >> v1:172.21.15.79:6789/0 conn(0x7fcf74157c40 legacy=0x7fcf74158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf60003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf60004180 0x7fcf60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf60004d50 0x7fcf600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415c280 con 0x7fcf60004d50 2023-10-14T18:55:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6000bba0 con 0x7fcf60004180 2023-10-14T18:55:52.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6000bd60 con 0x7fcf74157870 2023-10-14T18:55:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf60004d50 0x7fcf600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf7259c700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf60003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf69d9b700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf60004180 0x7fcf60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 -- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 msgr2=0x7fcf60003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74157870 0x7fcf60003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 -- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf60004180 msgr2=0x7fcf60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf60004180 0x7fcf60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 -- 172.21.15.79:0/1419449914 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60003570 con 0x7fcf60004d50 2023-10-14T18:55:52.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.470+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf60004d50 0x7fcf600051c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00a8d0 tx=0x7fcf6c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246eec82cb17cde4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0070d0 con 0x7fcf60004d50 2023-10-14T18:55:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c007230 con 0x7fcf60004d50 2023-10-14T18:55:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf71d9b700 1 -- 172.21.15.79:0/1419449914 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0075f0 con 0x7fcf60004d50 2023-10-14T18:55:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 -- 172.21.15.79:0/1419449914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf60004d50 msgr2=0x7fcf600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 --2- 172.21.15.79:0/1419449914 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf60004d50 0x7fcf600051c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00a8d0 tx=0x7fcf6c002190 comp rx=0 tx=0).stop 2023-10-14T18:55:52.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf72d9d700 1 -- 172.21.15.79:0/1419449914 reap_dead start 2023-10-14T18:55:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 -- 172.21.15.79:0/1419449914 shutdown_connections 2023-10-14T18:55:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 -- 172.21.15.79:0/1419449914 >> 172.21.15.79:0/1419449914 conn(0x7fcf74068ce0 msgr2=0x7fcf740690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:52.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 -- 172.21.15.79:0/1419449914 shutdown_connections 2023-10-14T18:55:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.471+0000 7fcf78d16700 1 -- 172.21.15.79:0/1419449914 wait complete. 2023-10-14T18:55:52.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.472+0000 7fcf78d16700 1 Processor -- start 2023-10-14T18:55:52.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.472+0000 7fcf78d16700 1 -- start start 2023-10-14T18:55:52.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf74144b00 0x7fcf7414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 0x7fcf740d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74144ed0 con 0x7fcf7414f190 2023-10-14T18:55:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7414dc40 con 0x7fcf74144b00 2023-10-14T18:55:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf78d16700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7414e7c0 con 0x7fcf74151710 2023-10-14T18:55:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50142/0 (socket says 172.21.15.79:50142) 2023-10-14T18:55:52.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 -- 172.21.15.79:0/2258356056 learned_addr learned my addr 172.21.15.79:0/2258356056 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:52.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf7259c700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf74144b00 0x7fcf7414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 0x7fcf740d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 -- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 msgr2=0x7fcf740d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 0x7fcf740d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 -- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf74144b00 msgr2=0x7fcf7414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf74144b00 0x7fcf7414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf69d9b700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7414de90 con 0x7fcf7414f190 2023-10-14T18:55:52.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.473+0000 7fcf72d9d700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 0x7fcf740d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:52.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf69d9b700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c002c00 tx=0x7fcf5c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00fa00 con 0x7fcf7414f190 2023-10-14T18:55:52.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00fb80 con 0x7fcf7414f190 2023-10-14T18:55:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7414e170 con 0x7fcf7414f190 2023-10-14T18:55:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0133f0 con 0x7fcf7414f190 2023-10-14T18:55:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.474+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf740d0700 con 0x7fcf7414f190 2023-10-14T18:55:52.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.475+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7404c3c0 con 0x7fcf7414f190 2023-10-14T18:55:52.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.475+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf5c013760 con 0x7fcf7414f190 2023-10-14T18:55:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.475+0000 7fcf6affd700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 0x7fcf540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.475+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fcf5c084690 con 0x7fcf7414f190 2023-10-14T18:55:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.476+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7fcf5406eab0 con 0x7fcf7414f190 2023-10-14T18:55:52.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.476+0000 7fcf7259c700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 0x7fcf540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.476+0000 7fcf7259c700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 0x7fcf540693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcf64006f00 tx=0x7fcf640091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.480+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf5c0518e0 con 0x7fcf7414f190 2023-10-14T18:55:52.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.663+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf7414e900 con 0x7fcf7414f190 2023-10-14T18:55:52.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.664+0000 7fcf6affd700 1 -- 172.21.15.79:0/2258356056 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+15441 (secure 0 0 0) 0x7fcf5c017070 con 0x7fcf7414f190 2023-10-14T18:55:52.666 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:52.667 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":174,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:55:27.582036+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:55:52.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 msgr2=0x7fcf540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 0x7fcf540693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fcf64006f00 tx=0x7fcf640091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 msgr2=0x7fcf741511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c002c00 tx=0x7fcf5c007d30 comp rx=0 tx=0).stop 2023-10-14T18:55:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 shutdown_connections 2023-10-14T18:55:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcf54066f30 0x7fcf540693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcf74151710 0x7fcf740d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf74144b00 0x7fcf7414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 --2- 172.21.15.79:0/2258356056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf7414f190 0x7fcf741511d0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 >> 172.21.15.79:0/2258356056 conn(0x7fcf74068ce0 msgr2=0x7fcf740b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 shutdown_connections 2023-10-14T18:55:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.666+0000 7fcf78d16700 1 -- 172.21.15.79:0/2258356056 wait complete. 2023-10-14T18:55:52.680 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:55:52.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:55:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.792+0000 7fd41c0ac700 1 Processor -- start 2023-10-14T18:55:52.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.792+0000 7fd41c0ac700 1 -- start start 2023-10-14T18:55:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41415cbb0 con 0x7fd41415a620 2023-10-14T18:55:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41415bfa0 con 0x7fd414157870 2023-10-14T18:55:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41c0ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41415c280 con 0x7fd41415d580 2023-10-14T18:55:52.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd419647700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd419647700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50150/0 (socket says 172.21.15.79:50150) 2023-10-14T18:55:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd419647700 1 -- 172.21.15.79:0/254903942 learned_addr learned my addr 172.21.15.79:0/254903942 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd419e48700 1 --2- 172.21.15.79:0/254903942 >> v2:172.21.15.144:3300/0 conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.793+0000 7fd41a649700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 -- 172.21.15.79:0/254903942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415d580 msgr2=0x7fd414158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 -- 172.21.15.79:0/254903942 >> v2:172.21.15.144:3300/0 conn(0x7fd414157870 msgr2=0x7fd41415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:52.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 --2- 172.21.15.79:0/254903942 >> v2:172.21.15.144:3300/0 conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 -- 172.21.15.79:0/254903942 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41415c560 con 0x7fd41415a620 2023-10-14T18:55:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd419647700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415a620 0x7fd41415d040 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd414069d80 tx=0x7fd404009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a331f023ba6a158 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd418e46700 1 -- 172.21.15.79:0/254903942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400b640 con 0x7fd41415a620 2023-10-14T18:55:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd418e46700 1 -- 172.21.15.79:0/254903942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400b7a0 con 0x7fd41415a620 2023-10-14T18:55:52.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd418e46700 1 -- 172.21.15.79:0/254903942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400bb60 con 0x7fd41415a620 2023-10-14T18:55:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 -- 172.21.15.79:0/254903942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415a620 msgr2=0x7fd41415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415a620 0x7fd41415d040 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd414069d80 tx=0x7fd404009250 comp rx=0 tx=0).stop 2023-10-14T18:55:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 -- 172.21.15.79:0/254903942 shutdown_connections 2023-10-14T18:55:52.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415d580 0x7fd414158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/254903942 >> v2:172.21.15.144:3300/0 conn(0x7fd414157870 0x7fd41415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/254903942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd41415a620 0x7fd41415d040 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.794+0000 7fd41c0ac700 1 -- 172.21.15.79:0/254903942 >> 172.21.15.79:0/254903942 conn(0x7fd414068ce0 msgr2=0x7fd4140690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:52.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.795+0000 7fd41c0ac700 1 -- 172.21.15.79:0/254903942 shutdown_connections 2023-10-14T18:55:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.795+0000 7fd41c0ac700 1 -- 172.21.15.79:0/254903942 wait complete. 2023-10-14T18:55:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 Processor -- start 2023-10-14T18:55:52.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 -- start start 2023-10-14T18:55:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd4140b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b2290 con 0x7fd414157870 2023-10-14T18:55:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b2570 con 0x7fd41415d580 2023-10-14T18:55:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41c0ac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4140b2850 con 0x7fd41415a620 2023-10-14T18:55:52.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd419e48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd419e48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50156/0 (socket says 172.21.15.79:50156) 2023-10-14T18:55:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd419e48700 1 -- 172.21.15.79:0/860764871 learned_addr learned my addr 172.21.15.79:0/860764871 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.796+0000 7fd41a649700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419647700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd4140b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 -- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 msgr2=0x7fd4140b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd4140b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 -- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 msgr2=0x7fd41414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:52.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040094f0 con 0x7fd414157870 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419647700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd4140b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd419e48700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd410009ef0 tx=0x7fd41000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41000cc20 con 0x7fd414157870 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41000f040 con 0x7fd414157870 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4140b2b30 con 0x7fd414157870 2023-10-14T18:55:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410014480 con 0x7fd414157870 2023-10-14T18:55:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.797+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4140b1df0 con 0x7fd414157870 2023-10-14T18:55:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.798+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41415e020 con 0x7fd414157870 2023-10-14T18:55:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.798+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4100147f0 con 0x7fd414157870 2023-10-14T18:55:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.799+0000 7fd409ffb700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:52.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.799+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fd410084f40 con 0x7fd414157870 2023-10-14T18:55:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.799+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7fd3f806eab0 con 0x7fd414157870 2023-10-14T18:55:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.799+0000 7fd419647700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.799+0000 7fd419647700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd414069d80 tx=0x7fd404017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:52.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:52.803+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd410052190 con 0x7fd414157870 2023-10-14T18:55:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.025+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd41404c3c0 con 0x7fd414157870 2023-10-14T18:55:53.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.026+0000 7fd409ffb700 1 -- 172.21.15.79:0/860764871 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fd410056e60 con 0x7fd414157870 2023-10-14T18:55:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:53.028 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:55:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 msgr2=0x7fd3f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd414069d80 tx=0x7fd404017000 comp rx=0 tx=0).stop 2023-10-14T18:55:53.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 msgr2=0x7fd414149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd410009ef0 tx=0x7fd41000b040 comp rx=0 tx=0).stop 2023-10-14T18:55:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 shutdown_connections 2023-10-14T18:55:53.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd3f8066f30 0x7fd3f80693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd41415d580 0x7fd41414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd414157870 0x7fd414149560 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 --2- 172.21.15.79:0/860764871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd41415a620 0x7fd4140b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 >> 172.21.15.79:0/860764871 conn(0x7fd414068ce0 msgr2=0x7fd41415a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 shutdown_connections 2023-10-14T18:55:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.028+0000 7fd41c0ac700 1 -- 172.21.15.79:0/860764871 wait complete. 2023-10-14T18:55:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:55:53.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:55:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.154+0000 7f1ecc191700 1 Processor -- start 2023-10-14T18:55:53.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.154+0000 7f1ecc191700 1 -- start start 2023-10-14T18:55:53.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1ecc191700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 0x7f1ec415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1ecc191700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1ecc191700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec415cbb0 con 0x7f1ec415a620 2023-10-14T18:55:53.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1ecc191700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec415bfa0 con 0x7f1ec4157870 2023-10-14T18:55:53.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1ecc191700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec415c280 con 0x7f1ec4157c40 2023-10-14T18:55:53.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.155+0000 7f1eca72e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1ec9f2d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 0x7f1ec415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:46328/0 (socket says 172.21.15.79:46328) 2023-10-14T18:55:53.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 -- 172.21.15.79:0/640656667 learned_addr learned my addr 172.21.15.79:0/640656667 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:53.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 -- 172.21.15.79:0/640656667 >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 msgr2=0x7f1ec415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:53.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 --2- 172.21.15.79:0/640656667 >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 0x7f1ec415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 -- 172.21.15.79:0/640656667 >> v1:172.21.15.144:6789/0 conn(0x7f1ec415a620 legacy=0x7f1ec415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 -- 172.21.15.79:0/640656667 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec415c560 con 0x7f1ec4157c40 2023-10-14T18:55:53.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1ec9f2d700 1 --2- 172.21.15.79:0/640656667 >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 0x7f1ec415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:55:53.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1eca72e700 1 --2- 172.21.15.79:0/640656667 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0099b0 tx=0x7f1ebc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b63640a26ed5cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1ec8f2b700 1 -- 172.21.15.79:0/640656667 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc009ea0 con 0x7f1ec4157c40 2023-10-14T18:55:53.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1ec8f2b700 1 -- 172.21.15.79:0/640656667 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00b860 con 0x7f1ec4157c40 2023-10-14T18:55:53.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.156+0000 7f1ec8f2b700 1 -- 172.21.15.79:0/640656667 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00bc00 con 0x7f1ec4157c40 2023-10-14T18:55:53.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 -- 172.21.15.79:0/640656667 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 msgr2=0x7f1ec4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 --2- 172.21.15.79:0/640656667 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0099b0 tx=0x7f1ebc009250 comp rx=0 tx=0).stop 2023-10-14T18:55:53.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 -- 172.21.15.79:0/640656667 shutdown_connections 2023-10-14T18:55:53.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 --2- 172.21.15.79:0/640656667 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157c40 0x7f1ec4158110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 --2- 172.21.15.79:0/640656667 >> v2:172.21.15.144:3300/0 conn(0x7f1ec4157870 0x7f1ec415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 -- 172.21.15.79:0/640656667 >> 172.21.15.79:0/640656667 conn(0x7f1ec4068ce0 msgr2=0x7f1ec40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 -- 172.21.15.79:0/640656667 shutdown_connections 2023-10-14T18:55:53.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.157+0000 7f1ecc191700 1 -- 172.21.15.79:0/640656667 wait complete. 2023-10-14T18:55:53.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.158+0000 7f1ecc191700 1 Processor -- start 2023-10-14T18:55:53.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.158+0000 7f1ecc191700 1 -- start start 2023-10-14T18:55:53.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 0x7f1ec4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 0x7f1ec414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec414d670 con 0x7f1ec4157c40 2023-10-14T18:55:53.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec412a160 con 0x7f1ec415a620 2023-10-14T18:55:53.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ecc191700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41505f0 con 0x7f1ec4157870 2023-10-14T18:55:53.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50162/0 (socket says 172.21.15.79:50162) 2023-10-14T18:55:53.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 -- 172.21.15.79:0/1613402706 learned_addr learned my addr 172.21.15.79:0/1613402706 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:53.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec9f2d700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 0x7f1ec4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1eca72e700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 0x7f1ec414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 -- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 msgr2=0x7f1ec4153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 0x7f1ec4153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 -- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 msgr2=0x7f1ec414f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 0x7f1ec414f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec0009a20 con 0x7f1ec4157c40 2023-10-14T18:55:53.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec9f2d700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 0x7f1ec4153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:55:53.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1eca72e700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 0x7f1ec414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:55:53.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1ec972c700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c590 tx=0x7f1eb4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.159+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011590 con 0x7f1ec4157c40 2023-10-14T18:55:53.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.160+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4011710 con 0x7f1ec4157c40 2023-10-14T18:55:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.160+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ebc0094f0 con 0x7f1ec4157c40 2023-10-14T18:55:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.160+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011ad0 con 0x7f1ec4157c40 2023-10-14T18:55:53.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.160+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec4150bb0 con 0x7f1ec4157c40 2023-10-14T18:55:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.161+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec404c3c0 con 0x7f1ec4157c40 2023-10-14T18:55:53.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.161+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1eb401a360 con 0x7f1ec4157c40 2023-10-14T18:55:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.161+0000 7f1eb9ffb700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.161+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1eb4083440 con 0x7f1ec4157c40 2023-10-14T18:55:53.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.161+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f1ea806eab0 con 0x7f1ec4157c40 2023-10-14T18:55:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.162+0000 7f1ec9f2d700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.162+0000 7f1ec9f2d700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 0x7f1ea80693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000eae0 tx=0x7f1ec000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.166+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb4050690 con 0x7f1ec4157c40 2023-10-14T18:55:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.386+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ec415c840 con 0x7f1ec4157c40 2023-10-14T18:55:53.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.387+0000 7f1eb9ffb700 1 -- 172.21.15.79:0/1613402706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f1eb4017070 con 0x7f1ec4157c40 2023-10-14T18:55:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:53.389 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":80,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:54:34.183258+0000","modified":"2023-10-14T18:54:37.838078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"c","rank":0,"incarnation":76,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/1267085487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1267085487},{"type":"v1","addr":"172.21.15.79:6835","nonce":1267085487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-14T18:55:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.388+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 msgr2=0x7f1ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.388+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 0x7f1ea80693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000eae0 tx=0x7f1ec000b040 comp rx=0 tx=0).stop 2023-10-14T18:55:53.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.388+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 msgr2=0x7f1ec40b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.388+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c590 tx=0x7f1eb4007f50 comp rx=0 tx=0).stop 2023-10-14T18:55:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 shutdown_connections 2023-10-14T18:55:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1ea8066f30 0x7f1ea80693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec415a620 0x7f1ec414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1ec4157870 0x7f1ec4153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 --2- 172.21.15.79:0/1613402706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ec4157c40 0x7f1ec40b2780 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 >> 172.21.15.79:0/1613402706 conn(0x7f1ec4068ce0 msgr2=0x7f1ec40b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 shutdown_connections 2023-10-14T18:55:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.389+0000 7f1ecc191700 1 -- 172.21.15.79:0/1613402706 wait complete. 2023-10-14T18:55:53.393 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 80 2023-10-14T18:55:53.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:55:53.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.515+0000 7f348fafa700 1 Processor -- start 2023-10-14T18:55:53.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.515+0000 7f348fafa700 1 -- start start 2023-10-14T18:55:53.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348fafa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f3488164e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348fafa700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348815db80 con 0x7f348815a1e0 2023-10-14T18:55:53.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348fafa700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348815de60 con 0x7f3488159e10 2023-10-14T18:55:53.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348fafa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348815e800 con 0x7f34880b3430 2023-10-14T18:55:53.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348d095700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f348815a1e0 0x7f34880cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49294/0 (socket says 172.21.15.79:49294) 2023-10-14T18:55:53.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348d095700 1 -- 172.21.15.79:0/1832039183 learned_addr learned my addr 172.21.15.79:0/1832039183 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:53.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.516+0000 7f348e097700 1 --2- 172.21.15.79:0/1832039183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f3488164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064275881 0 0) 0x7f348815db80 con 0x7f348815a1e0 2023-10-14T18:55:53.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3474003570 con 0x7f348815a1e0 2023-10-14T18:55:53.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639643502 0 0) 0x7f348815de60 con 0x7f3488159e10 2023-10-14T18:55:53.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348815db80 con 0x7f3488159e10 2023-10-14T18:55:53.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348e097700 1 -- 172.21.15.79:0/1832039183 >> v1:172.21.15.144:6789/0 conn(0x7f3488159e10 legacy=0x7f34880b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348e097700 1 -- 172.21.15.79:0/1832039183 >> v1:172.21.15.79:6789/0 conn(0x7f348815a1e0 legacy=0x7f34880cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348e097700 1 -- 172.21.15.79:0/1832039183 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348815e140 con 0x7f34880b3430 2023-10-14T18:55:53.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348e097700 1 --2- 172.21.15.79:0/1832039183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f3488164e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e90 tx=0x7f3480009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403631df4b30cfec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000e070 con 0x7f34880b3430 2023-10-14T18:55:53.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000bb80 con 0x7f34880b3430 2023-10-14T18:55:53.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.517+0000 7f348c894700 1 -- 172.21.15.79:0/1832039183 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480012430 con 0x7f34880b3430 2023-10-14T18:55:53.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 -- 172.21.15.79:0/1832039183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 msgr2=0x7f3488164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 --2- 172.21.15.79:0/1832039183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f3488164e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3480009e90 tx=0x7f3480009780 comp rx=0 tx=0).stop 2023-10-14T18:55:53.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 -- 172.21.15.79:0/1832039183 shutdown_connections 2023-10-14T18:55:53.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 --2- 172.21.15.79:0/1832039183 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f3488164e20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 -- 172.21.15.79:0/1832039183 >> 172.21.15.79:0/1832039183 conn(0x7f3488067660 msgr2=0x7f3488067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 -- 172.21.15.79:0/1832039183 shutdown_connections 2023-10-14T18:55:53.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.518+0000 7f348fafa700 1 -- 172.21.15.79:0/1832039183 wait complete. 2023-10-14T18:55:53.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.519+0000 7f348fafa700 1 Processor -- start 2023-10-14T18:55:53.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.519+0000 7f348fafa700 1 -- start start 2023-10-14T18:55:53.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.519+0000 7f348fafa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f34880c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.519+0000 7f348fafa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f348815a1e0 0x7f34880c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c7600 con 0x7f3488159e10 2023-10-14T18:55:53.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348816c1e0 con 0x7f348815a1e0 2023-10-14T18:55:53.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348816c4c0 con 0x7f34880b3430 2023-10-14T18:55:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50176/0 (socket says 172.21.15.79:50176) 2023-10-14T18:55:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 -- 172.21.15.79:0/1740665658 learned_addr learned my addr 172.21.15.79:0/1740665658 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d896700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f34880c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348e097700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f348815a1e0 0x7f34880c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 -- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 msgr2=0x7f34880c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f34880c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 -- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f348815a1e0 msgr2=0x7f34880c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f348815a1e0 0x7f34880c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480009a20 con 0x7f3488159e10 2023-10-14T18:55:53.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348d095700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f34780058d0 tx=0x7f3478007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478005b30 con 0x7f3488159e10 2023-10-14T18:55:53.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478005c90 con 0x7f3488159e10 2023-10-14T18:55:53.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478007300 con 0x7f3488159e10 2023-10-14T18:55:53.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348816c7a0 con 0x7f3488159e10 2023-10-14T18:55:53.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.520+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348816cd60 con 0x7f3488159e10 2023-10-14T18:55:53.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34880caf90 con 0x7f3488159e10 2023-10-14T18:55:53.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f347801b3b0 con 0x7f3488159e10 2023-10-14T18:55:53.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f347dffb700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f3478083960 con 0x7f3488159e10 2023-10-14T18:55:53.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f348d896700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.522+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f346c06eab0 con 0x7f3488159e10 2023-10-14T18:55:53.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.523+0000 7f348d896700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 0x7f346c0693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.527+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3478017020 con 0x7f3488159e10 2023-10-14T18:55:53.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.709+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f348816cf80 con 0x7f3488159e10 2023-10-14T18:55:53.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.709+0000 7f347dffb700 1 -- 172.21.15.79:0/1740665658 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+15441 (secure 0 0 0) 0x7f3478050bb0 con 0x7f3488159e10 2023-10-14T18:55:53.711 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:53.712 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":174,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:55:27.582036+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:54:32.544388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-14T18:54:33.148982+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:55:53.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 msgr2=0x7f346c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 0x7f346c0693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484007d50 comp rx=0 tx=0).stop 2023-10-14T18:55:53.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 msgr2=0x7f34880c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f34780058d0 tx=0x7f3478007e10 comp rx=0 tx=0).stop 2023-10-14T18:55:53.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 shutdown_connections 2023-10-14T18:55:53.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f346c066f30 0x7f346c0693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f348815a1e0 0x7f34880c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f34880b3430 0x7f34880c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 --2- 172.21.15.79:0/1740665658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3488159e10 0x7f34880c8660 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 >> 172.21.15.79:0/1740665658 conn(0x7f3488067660 msgr2=0x7f3488159020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 shutdown_connections 2023-10-14T18:55:53.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.712+0000 7f348fafa700 1 -- 172.21.15.79:0/1740665658 wait complete. 2023-10-14T18:55:53.728 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:55:53.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.844+0000 7f1e6d7b5700 1 Processor -- start 2023-10-14T18:55:53.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.844+0000 7f1e6d7b5700 1 -- start start 2023-10-14T18:55:53.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e6d7b5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e6815a1e0 0x7f1e680cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e6d7b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1e680b3430 0x7f1e680cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e6d7b5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6815db80 con 0x7f1e68159e10 2023-10-14T18:55:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e6d7b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6815e800 con 0x7f1e680b3430 2023-10-14T18:55:53.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e6d7b5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6815de60 con 0x7f1e6815a1e0 2023-10-14T18:55:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e66ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1e68159e10 0x7f1e680b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49298/0 (socket says 172.21.15.79:49298) 2023-10-14T18:55:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e66ffd700 1 -- 172.21.15.79:0/2935081921 learned_addr learned my addr 172.21.15.79:0/2935081921 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2935081921 >> v2:172.21.15.79:3300/0 conn(0x7f1e680b3430 0x7f1e680cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e667fc700 1 -- 172.21.15.79:0/2935081921 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045895487 0 0) 0x7f1e6815db80 con 0x7f1e68159e10 2023-10-14T18:55:53.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.845+0000 7f1e667fc700 1 -- 172.21.15.79:0/2935081921 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e54003570 con 0x7f1e68159e10 2023-10-14T18:55:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e5e7fc700 1 --2- 172.21.15.79:0/2935081921 >> v2:172.21.15.144:3300/0 conn(0x7f1e6815a1e0 0x7f1e680cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e677fe700 1 -- 172.21.15.79:0/2935081921 >> v2:172.21.15.144:3300/0 conn(0x7f1e6815a1e0 msgr2=0x7f1e680cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2935081921 >> v2:172.21.15.144:3300/0 conn(0x7f1e6815a1e0 0x7f1e680cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e677fe700 1 -- 172.21.15.79:0/2935081921 >> v1:172.21.15.79:6789/0 conn(0x7f1e68159e10 legacy=0x7f1e680b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e677fe700 1 -- 172.21.15.79:0/2935081921 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6815e140 con 0x7f1e680b3430 2023-10-14T18:55:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2935081921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e680b3430 0x7f1e680cdc80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1e68068580 tx=0x7f1e60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbeac10172c9992 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e667fc700 1 -- 172.21.15.79:0/2935081921 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000e070 con 0x7f1e680b3430 2023-10-14T18:55:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e667fc700 1 -- 172.21.15.79:0/2935081921 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000bb60 con 0x7f1e680b3430 2023-10-14T18:55:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e667fc700 1 -- 172.21.15.79:0/2935081921 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60012430 con 0x7f1e680b3430 2023-10-14T18:55:53.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2935081921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e680b3430 msgr2=0x7f1e680cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2935081921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e680b3430 0x7f1e680cdc80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1e68068580 tx=0x7f1e60009780 comp rx=0 tx=0).stop 2023-10-14T18:55:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2935081921 shutdown_connections 2023-10-14T18:55:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2935081921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e680b3430 0x7f1e680cdc80 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2935081921 >> v2:172.21.15.144:3300/0 conn(0x7f1e6815a1e0 0x7f1e680cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2935081921 >> 172.21.15.79:0/2935081921 conn(0x7f1e68067660 msgr2=0x7f1e68067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:53.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2935081921 shutdown_connections 2023-10-14T18:55:53.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.846+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2935081921 wait complete. 2023-10-14T18:55:53.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 Processor -- start 2023-10-14T18:55:53.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 -- start start 2023-10-14T18:55:53.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 0x7f1e680ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e68159e10 0x7f1e68169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6816a3b0 con 0x7f1e6815a1e0 2023-10-14T18:55:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6816a680 con 0x7f1e680b3430 2023-10-14T18:55:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.848+0000 7f1e6d7b5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6816a960 con 0x7f1e68159e10 2023-10-14T18:55:53.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50198/0 (socket says 172.21.15.79:50198) 2023-10-14T18:55:53.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 -- 172.21.15.79:0/2214637599 learned_addr learned my addr 172.21.15.79:0/2214637599 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:53.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e66ffd700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 0x7f1e680ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e5e7fc700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e68159e10 0x7f1e68169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 -- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e68159e10 msgr2=0x7f1e68169e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e68159e10 0x7f1e68169e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 -- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 msgr2=0x7f1e680ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 0x7f1e680ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:53.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60009a20 con 0x7f1e6815a1e0 2023-10-14T18:55:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e66ffd700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 0x7f1e680ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e677fe700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009fd0 tx=0x7f1e60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60027470 con 0x7f1e6815a1e0 2023-10-14T18:55:53.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e600275f0 con 0x7f1e6815a1e0 2023-10-14T18:55:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6816ac40 con 0x7f1e6815a1e0 2023-10-14T18:55:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600279b0 con 0x7f1e6815a1e0 2023-10-14T18:55:53.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.849+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6814d520 con 0x7f1e6815a1e0 2023-10-14T18:55:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.850+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e680cfac0 con 0x7f1e6815a1e0 2023-10-14T18:55:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.851+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e60024070 con 0x7f1e6815a1e0 2023-10-14T18:55:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.851+0000 7f1e5f7fe700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 0x7f1e480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.851+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1e60086f60 con 0x7f1e6815a1e0 2023-10-14T18:55:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.851+0000 7f1e66ffd700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 0x7f1e480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.851+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f1e4806eab0 con 0x7f1e6815a1e0 2023-10-14T18:55:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.852+0000 7f1e66ffd700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 0x7f1e480693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1e6815e110 tx=0x7f1e58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:53.856+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e680cfac0 con 0x7f1e6815a1e0 2023-10-14T18:55:54.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.080+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1e680cfac0 con 0x7f1e6815a1e0 2023-10-14T18:55:54.081 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:55:54.081+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:55:54.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.085+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(175..175 src has 1..175) v4 ==== 366+0+0 (secure 0 0 0) 0x7f1e60057dd0 con 0x7f1e6815a1e0 2023-10-14T18:55:54.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.085+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f1e4806f400 con 0x7f1e6815a1e0 2023-10-14T18:55:54.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.087+0000 7f1e5f7fe700 1 -- 172.21.15.79:0/2214637599 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1e680cfac0 con 0x7f1e6815a1e0 2023-10-14T18:55:54.088 INFO:tasks.ceph.mds.c.smithi079.stderr: -8474> 2023-10-14T18:54:40.100+0000 7f2670200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:55:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 msgr2=0x7f1e480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 0x7f1e480693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1e6815e110 tx=0x7f1e58009040 comp rx=0 tx=0).stop 2023-10-14T18:55:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 msgr2=0x7f1e6814cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009fd0 tx=0x7f1e60019000 comp rx=0 tx=0).stop 2023-10-14T18:55:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 shutdown_connections 2023-10-14T18:55:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1e48066f30 0x7f1e480693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1e6815a1e0 0x7f1e6814cfe0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e680b3430 0x7f1e680ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 --2- 172.21.15.79:0/2214637599 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1e68159e10 0x7f1e68169e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 >> 172.21.15.79:0/2214637599 conn(0x7f1e68067660 msgr2=0x7f1e6815ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 shutdown_connections 2023-10-14T18:55:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.089+0000 7f1e6d7b5700 1 -- 172.21.15.79:0/2214637599 wait complete. 2023-10-14T18:55:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:55:54.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:55:54.118 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:55:54.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.221+0000 7fbf5ba11700 1 Processor -- start 2023-10-14T18:55:54.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.221+0000 7fbf5ba11700 1 -- start start 2023-10-14T18:55:54.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf5ba11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf540caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf5ba11700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf5415a730 0x7fbf540c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf5ba11700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5415abc0 con 0x7fbf540abce0 2023-10-14T18:55:54.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf5ba11700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540c9100 con 0x7fbf5415a730 2023-10-14T18:55:54.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf5ba11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54158050 con 0x7fbf540ab910 2023-10-14T18:55:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf5415a730 0x7fbf540c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf59fae700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbf540abce0 0x7fbf540cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49308/0 (socket says 172.21.15.79:49308) 2023-10-14T18:55:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf59fae700 1 -- 172.21.15.79:0/113066266 learned_addr learned my addr 172.21.15.79:0/113066266 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 -- 172.21.15.79:0/113066266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 msgr2=0x7fbf540caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 --2- 172.21.15.79:0/113066266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf540caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 -- 172.21.15.79:0/113066266 >> v1:172.21.15.79:6789/0 conn(0x7fbf540abce0 legacy=0x7fbf540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 -- 172.21.15.79:0/113066266 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5415aea0 con 0x7fbf5415a730 2023-10-14T18:55:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf4bfff700 1 -- 172.21.15.79:0/113066266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360428823 0 0) 0x7fbf5415abc0 con 0x7fbf540abce0 2023-10-14T18:55:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.222+0000 7fbf58fac700 1 --2- 172.21.15.79:0/113066266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c2d20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009910 tx=0x7fbf440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53b3d9eb3abfaa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf4bfff700 1 -- 172.21.15.79:0/113066266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400b820 con 0x7fbf5415a730 2023-10-14T18:55:54.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf4bfff700 1 -- 172.21.15.79:0/113066266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4400b980 con 0x7fbf5415a730 2023-10-14T18:55:54.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf4bfff700 1 -- 172.21.15.79:0/113066266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400bd20 con 0x7fbf5415a730 2023-10-14T18:55:54.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 -- 172.21.15.79:0/113066266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 msgr2=0x7fbf540c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/113066266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c2d20 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009910 tx=0x7fbf440091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 -- 172.21.15.79:0/113066266 shutdown_connections 2023-10-14T18:55:54.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/113066266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf540caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/113066266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c2d20 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.223+0000 7fbf5ba11700 1 -- 172.21.15.79:0/113066266 >> 172.21.15.79:0/113066266 conn(0x7fbf54067660 msgr2=0x7fbf54067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:54.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.224+0000 7fbf5ba11700 1 -- 172.21.15.79:0/113066266 shutdown_connections 2023-10-14T18:55:54.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.224+0000 7fbf5ba11700 1 -- 172.21.15.79:0/113066266 wait complete. 2023-10-14T18:55:54.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.225+0000 7fbf5ba11700 1 Processor -- start 2023-10-14T18:55:54.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.225+0000 7fbf5ba11700 1 -- start start 2023-10-14T18:55:54.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf5414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 0x7fbf54152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54152ab0 con 0x7fbf5415a730 2023-10-14T18:55:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54152d90 con 0x7fbf540abce0 2023-10-14T18:55:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54153070 con 0x7fbf540ab910 2023-10-14T18:55:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50226/0 (socket says 172.21.15.79:50226) 2023-10-14T18:55:54.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 -- 172.21.15.79:0/1132690568 learned_addr learned my addr 172.21.15.79:0/1132690568 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf58fac700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 0x7fbf54152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 -- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 msgr2=0x7fbf5414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf5414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 -- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 msgr2=0x7fbf54152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:54.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 0x7fbf54152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:54.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf44009420 con 0x7fbf5415a730 2023-10-14T18:55:54.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf58fac700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 0x7fbf54152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:54.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf59fae700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00cc90 tx=0x7fbf4c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:54.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00cea0 con 0x7fbf5415a730 2023-10-14T18:55:54.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00ab30 con 0x7fbf5415a730 2023-10-14T18:55:54.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf54153350 con 0x7fbf5415a730 2023-10-14T18:55:54.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0070f0 con 0x7fbf5415a730 2023-10-14T18:55:54.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.226+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf541527a0 con 0x7fbf5415a730 2023-10-14T18:55:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.227+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5404c3c0 con 0x7fbf5415a730 2023-10-14T18:55:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.228+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf4c0074a0 con 0x7fbf5415a730 2023-10-14T18:55:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.228+0000 7fbf497fa700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.228+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fbf4c0849d0 con 0x7fbf5415a730 2023-10-14T18:55:54.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.228+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fbf3806eb50 con 0x7fbf5415a730 2023-10-14T18:55:54.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.228+0000 7fbf597ad700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:54.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.229+0000 7fbf597ad700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbf500097e0 tx=0x7fbf50006d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:54.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.232+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf4c051c50 con 0x7fbf5415a730 2023-10-14T18:55:54.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:54.458+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf540cad30 con 0x7fbf5415a730 2023-10-14T18:55:55.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.092+0000 7fbf497fa700 1 -- 172.21.15.79:0/1132690568 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf4c055270 con 0x7fbf5415a730 2023-10-14T18:55:55.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 msgr2=0x7fbf380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbf500097e0 tx=0x7fbf50006d10 comp rx=0 tx=0).stop 2023-10-14T18:55:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 msgr2=0x7fbf540c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00cc90 tx=0x7fbf4c001a20 comp rx=0 tx=0).stop 2023-10-14T18:55:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 shutdown_connections 2023-10-14T18:55:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf5415a730 0x7fbf540c1a40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbf540ab910 0x7fbf5414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 --2- 172.21.15.79:0/1132690568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf540abce0 0x7fbf54152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 >> 172.21.15.79:0/1132690568 conn(0x7fbf54067660 msgr2=0x7fbf5415d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 shutdown_connections 2023-10-14T18:55:55.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.095+0000 7fbf5ba11700 1 -- 172.21.15.79:0/1132690568 wait complete. 2023-10-14T18:55:55.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:55:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.270+0000 7fd9d499b700 1 Processor -- start 2023-10-14T18:55:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.270+0000 7fd9d499b700 1 -- start start 2023-10-14T18:55:55.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9d499b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd9d00cc940 0x7fd9d00ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9d499b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00cbb80 con 0x7fd9d00ce810 2023-10-14T18:55:55.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9d499b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00cbe60 con 0x7fd9d015d240 2023-10-14T18:55:55.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9d499b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d00cc140 con 0x7fd9d00cc940 2023-10-14T18:55:55.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9cf59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd9d00ce810 0x7fd9d00cec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49320/0 (socket says 172.21.15.79:49320) 2023-10-14T18:55:55.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9cf59e700 1 -- 172.21.15.79:0/2096501174 learned_addr learned my addr 172.21.15.79:0/2096501174 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:55.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886559896 0 0) 0x7fd9d00cbb80 con 0x7fd9d00ce810 2023-10-14T18:55:55.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9ce59c700 1 --2- 172.21.15.79:0/2096501174 >> v2:172.21.15.144:3300/0 conn(0x7fd9d00cc940 0x7fd9d00ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.271+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b8003570 con 0x7fd9d00ce810 2023-10-14T18:55:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141211216 0 0) 0x7fd9b8003570 con 0x7fd9d00ce810 2023-10-14T18:55:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 >> v2:172.21.15.144:3300/0 conn(0x7fd9d00cc940 msgr2=0x7fd9d00ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 --2- 172.21.15.79:0/2096501174 >> v2:172.21.15.144:3300/0 conn(0x7fd9d00cc940 0x7fd9d00ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 >> v1:172.21.15.144:6789/0 conn(0x7fd9d015d240 legacy=0x7fd9d00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00cc420 con 0x7fd9d00ce810 2023-10-14T18:55:55.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd9c8001470 con 0x7fd9d00ce810 2023-10-14T18:55:55.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 >> v1:172.21.15.79:6789/0 conn(0x7fd9d00ce810 legacy=0x7fd9d00cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8003a60 0x7fd9b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 0x7fd9b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b80052e0 0x7fd9b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cc140 con 0x7fd9b8004810 2023-10-14T18:55:55.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b800c230 con 0x7fd9b80052e0 2023-10-14T18:55:55.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b800c3f0 con 0x7fd9b8003a60 2023-10-14T18:55:55.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 0x7fd9b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ced9d700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8003a60 0x7fd9b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cf59e700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b80052e0 0x7fd9b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 -- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8003a60 msgr2=0x7fd9b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8003a60 0x7fd9b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 -- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b80052e0 msgr2=0x7fd9b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9b80052e0 0x7fd9b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cf59e700 1 -- 172.21.15.79:0/2096501174 reap_dead start 2023-10-14T18:55:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 -- 172.21.15.79:0/2096501174 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8003570 con 0x7fd9b8004810 2023-10-14T18:55:55.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ced9d700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8003a60 0x7fd9b8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9ce59c700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 0x7fd9b8004c80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400bb90 tx=0x7fd9c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d54de074e171 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400d5d0 con 0x7fd9b8004810 2023-10-14T18:55:55.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c400d730 con 0x7fd9b8004810 2023-10-14T18:55:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.272+0000 7fd9cdd9b700 1 -- 172.21.15.79:0/2096501174 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400daf0 con 0x7fd9b8004810 2023-10-14T18:55:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 -- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 msgr2=0x7fd9b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 0x7fd9b8004c80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400bb90 tx=0x7fd9c4008040 comp rx=0 tx=0).stop 2023-10-14T18:55:55.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 -- 172.21.15.79:0/2096501174 shutdown_connections 2023-10-14T18:55:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 --2- 172.21.15.79:0/2096501174 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9b8004810 0x7fd9b8004c80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 -- 172.21.15.79:0/2096501174 >> 172.21.15.79:0/2096501174 conn(0x7fd9d0067e40 msgr2=0x7fd9d00d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 -- 172.21.15.79:0/2096501174 shutdown_connections 2023-10-14T18:55:55.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.273+0000 7fd9d499b700 1 -- 172.21.15.79:0/2096501174 wait complete. 2023-10-14T18:55:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.274+0000 7fd9d499b700 1 Processor -- start 2023-10-14T18:55:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.274+0000 7fd9d499b700 1 -- start start 2023-10-14T18:55:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8004810 0x7fd9d0147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d009b930 0x7fd9d00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d009a8b0 con 0x7fd9d009bda0 2023-10-14T18:55:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d009ab90 con 0x7fd9d009b930 2023-10-14T18:55:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d009ae70 con 0x7fd9b8004810 2023-10-14T18:55:55.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50242/0 (socket says 172.21.15.79:50242) 2023-10-14T18:55:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 -- 172.21.15.79:0/3711830114 learned_addr learned my addr 172.21.15.79:0/3711830114 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 -- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8004810 msgr2=0x7fd9d0147800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T18:55:55.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8004810 0x7fd9d0147800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 -- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d009b930 msgr2=0x7fd9d00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d009b930 0x7fd9d00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d009b150 con 0x7fd9d009bda0 2023-10-14T18:55:55.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9cf59e700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0089160 tx=0x7fd9c8000fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:55.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8010520 con 0x7fd9d009bda0 2023-10-14T18:55:55.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8010680 con 0x7fd9d009bda0 2023-10-14T18:55:55.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d009b430 con 0x7fd9d009bda0 2023-10-14T18:55:55.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.275+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8010a40 con 0x7fd9d009bda0 2023-10-14T18:55:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.276+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00c7eb0 con 0x7fd9d009bda0 2023-10-14T18:55:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.277+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d006ac60 con 0x7fd9d009bda0 2023-10-14T18:55:55.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.277+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9c80133e0 con 0x7fd9d009bda0 2023-10-14T18:55:55.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.277+0000 7fd9b6ffd700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.277+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fd9c8083ed0 con 0x7fd9d009bda0 2023-10-14T18:55:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.277+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7fd9bc06eb50 con 0x7fd9d009bda0 2023-10-14T18:55:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.278+0000 7fd9ced9d700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:55.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.278+0000 7fd9ced9d700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 0x7fd9bc0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00017c0 tx=0x7fd9c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:55.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.281+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9c8019020 con 0x7fd9d009bda0 2023-10-14T18:55:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:55.464+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9d00cfdd0 con 0x7fd9d009bda0 2023-10-14T18:55:56.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.094+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(176..176 src has 1..176) v4 ==== 288+0+0 (secure 0 0 0) 0x7fd9c8055490 con 0x7fd9d009bda0 2023-10-14T18:55:56.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.094+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7fd9bc06cf80 con 0x7fd9d009bda0 2023-10-14T18:55:56.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.100+0000 7fd9b6ffd700 1 -- 172.21.15.79:0/3711830114 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v176) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd9c8054b60 con 0x7fd9d009bda0 2023-10-14T18:55:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 msgr2=0x7fd9bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 0x7fd9bc0693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00017c0 tx=0x7fd9c0009040 comp rx=0 tx=0).stop 2023-10-14T18:55:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 msgr2=0x7fd9d00ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0089160 tx=0x7fd9c8000fd0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 shutdown_connections 2023-10-14T18:55:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd9bc066f30 0x7fd9bc0693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd9d009bda0 0x7fd9d00ca700 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd9b8004810 0x7fd9d0147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 --2- 172.21.15.79:0/3711830114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d009b930 0x7fd9d00ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 >> 172.21.15.79:0/3711830114 conn(0x7fd9d0067e40 msgr2=0x7fd9d015c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:56.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 shutdown_connections 2023-10-14T18:55:56.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.104+0000 7fd9d499b700 1 -- 172.21.15.79:0/3711830114 wait complete. 2023-10-14T18:55:56.107 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:55:56.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:55:56.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.236+0000 7f97ac534700 1 Processor -- start 2023-10-14T18:55:56.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.236+0000 7f97ac534700 1 -- start start 2023-10-14T18:55:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97ac534700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f97a40af8f0 0x7f97a40cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97ac534700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40c6f20 con 0x7f97a4156210 2023-10-14T18:55:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97ac534700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40c7200 con 0x7f97a406dad0 2023-10-14T18:55:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97ac534700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40c74e0 con 0x7f97a40af8f0 2023-10-14T18:55:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97aa2d0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f97a4156210 0x7f97a406d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49326/0 (socket says 172.21.15.79:49326) 2023-10-14T18:55:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.237+0000 7f97aa2d0700 1 -- 172.21.15.79:0/131663152 learned_addr learned my addr 172.21.15.79:0/131663152 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:56.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527535667 0 0) 0x7f97a40c6f20 con 0x7f97a4156210 2023-10-14T18:55:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9790003570 con 0x7f97a4156210 2023-10-14T18:55:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a9acf700 1 --2- 172.21.15.79:0/131663152 >> v2:172.21.15.144:3300/0 conn(0x7f97a40af8f0 0x7f97a40cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600845476 0 0) 0x7f9790003570 con 0x7f97a4156210 2023-10-14T18:55:56.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 >> v2:172.21.15.144:3300/0 conn(0x7f97a40af8f0 msgr2=0x7f97a40cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 --2- 172.21.15.79:0/131663152 >> v2:172.21.15.144:3300/0 conn(0x7f97a40af8f0 0x7f97a40cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 >> v1:172.21.15.144:6789/0 conn(0x7f97a406dad0 legacy=0x7f97a40cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a40c77c0 con 0x7f97a4156210 2023-10-14T18:55:56.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f97a00017f0 con 0x7f97a4156210 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 >> v1:172.21.15.79:6789/0 conn(0x7f97a4156210 legacy=0x7f97a406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9790003b30 0x7f9790003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9790004810 0x7f9790004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f979000cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a40c74e0 con 0x7f97900053c0 2023-10-14T18:55:56.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979000d490 con 0x7f9790003b30 2023-10-14T18:55:56.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979000d650 con 0x7f9790004810 2023-10-14T18:55:56.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f979000cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aa2d0700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9790003b30 0x7f9790003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97a9acf700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9790004810 0x7f9790004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 -- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9790004810 msgr2=0x7f9790004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:56.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9790004810 0x7f9790004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 -- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9790003b30 msgr2=0x7f9790003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:56.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9790003b30 0x7f9790003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.238+0000 7f97aaad1700 1 -- 172.21.15.79:0/131663152 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790003570 con 0x7f97900053c0 2023-10-14T18:55:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97aaad1700 1 -- 172.21.15.79:0/131663152 reap_dead start 2023-10-14T18:55:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97aaad1700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f979000cbb0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f979c001880 tx=0x7f979c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0ff02a3a82f243 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c012420 con 0x7f97900053c0 2023-10-14T18:55:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c0125a0 con 0x7f97900053c0 2023-10-14T18:55:56.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97a92ce700 1 -- 172.21.15.79:0/131663152 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c012960 con 0x7f97900053c0 2023-10-14T18:55:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 -- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 msgr2=0x7f979000cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f979000cbb0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f979c001880 tx=0x7f979c007d30 comp rx=0 tx=0).stop 2023-10-14T18:55:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 -- 172.21.15.79:0/131663152 shutdown_connections 2023-10-14T18:55:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 --2- 172.21.15.79:0/131663152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f979000cbb0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 -- 172.21.15.79:0/131663152 >> 172.21.15.79:0/131663152 conn(0x7f97a40cd450 msgr2=0x7f97a40c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 -- 172.21.15.79:0/131663152 shutdown_connections 2023-10-14T18:55:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.239+0000 7f97ac534700 1 -- 172.21.15.79:0/131663152 wait complete. 2023-10-14T18:55:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.240+0000 7f97ac534700 1 Processor -- start 2023-10-14T18:55:56.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.240+0000 7f97ac534700 1 -- start start 2023-10-14T18:55:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a414a620 0x7f97a4166700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 0x7f97a414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4166c40 con 0x7f97900053c0 2023-10-14T18:55:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a414aa90 con 0x7f97a414a620 2023-10-14T18:55:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97ac534700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a414e580 con 0x7f97a414d270 2023-10-14T18:55:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50262/0 (socket says 172.21.15.79:50262) 2023-10-14T18:55:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 -- 172.21.15.79:0/3457764408 learned_addr learned my addr 172.21.15.79:0/3457764408 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97a9acf700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a414a620 0x7f97a4166700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aaad1700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 0x7f97a414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 -- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 msgr2=0x7f97a414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 0x7f97a414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 -- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a414a620 msgr2=0x7f97a4166700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:56.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a414a620 0x7f97a4166700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.241+0000 7f97aa2d0700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a414d710 con 0x7f97900053c0 2023-10-14T18:55:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f97aaad1700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 0x7f97a414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:55:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f97aa2d0700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97a00021d0 tx=0x7f97a00020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000acc0 con 0x7f97900053c0 2023-10-14T18:55:56.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000ae40 con 0x7f97900053c0 2023-10-14T18:55:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a41597d0 con 0x7f97900053c0 2023-10-14T18:55:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0013640 con 0x7f97900053c0 2023-10-14T18:55:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.242+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a41501d0 con 0x7f97900053c0 2023-10-14T18:55:56.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.243+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a404c3c0 con 0x7f97900053c0 2023-10-14T18:55:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.243+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97a00139b0 con 0x7f97900053c0 2023-10-14T18:55:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.243+0000 7f979a7fc700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 0x7f97880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.244+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f97a0085030 con 0x7f97900053c0 2023-10-14T18:55:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.244+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=177}) v3 -- 0x7f978806dd50 con 0x7f97900053c0 2023-10-14T18:55:56.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.244+0000 7f97a9acf700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 0x7f97880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.244+0000 7f97a9acf700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 0x7f97880693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f979400b2e0 tx=0x7f979400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:56.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.248+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a0017070 con 0x7f97900053c0 2023-10-14T18:55:56.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:56.431+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97a4159c70 con 0x7f97900053c0 2023-10-14T18:55:57.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.102+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 7 ==== osd_map(177..177 src has 1..177) v4 ==== 305+0+0 (secure 0 0 0) 0x7f97a00560a0 con 0x7f97900053c0 2023-10-14T18:55:57.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.102+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=178}) v3 -- 0x7f978806cae0 con 0x7f97900053c0 2023-10-14T18:55:57.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.110+0000 7f979a7fc700 1 -- 172.21.15.79:0/3457764408 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v177) v1 ==== 169+0+0 (secure 0 0 0) 0x7f97a0055be0 con 0x7f97900053c0 2023-10-14T18:55:57.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 msgr2=0x7f97880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 0x7f97880693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f979400b2e0 tx=0x7f979400b040 comp rx=0 tx=0).stop 2023-10-14T18:55:57.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 msgr2=0x7f97a414ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97a00021d0 tx=0x7f97a00020c0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 shutdown_connections 2023-10-14T18:55:57.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9788066f30 0x7f97880693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a414d270 0x7f97a414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97900053c0 0x7f97a414ade0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 --2- 172.21.15.79:0/3457764408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a414a620 0x7f97a4166700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 >> 172.21.15.79:0/3457764408 conn(0x7f97a40cd450 msgr2=0x7f97a40cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:57.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 shutdown_connections 2023-10-14T18:55:57.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.113+0000 7f97ac534700 1 -- 172.21.15.79:0/3457764408 wait complete. 2023-10-14T18:55:57.117 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:55:57.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:55:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.244+0000 7f55224a7700 1 Processor -- start 2023-10-14T18:55:57.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.244+0000 7f55224a7700 1 -- start start 2023-10-14T18:55:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f55224a7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f551c15a290 0x7f551c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f55224a7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f55224a7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c0b0790 con 0x7f551c159ec0 2023-10-14T18:55:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f55224a7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c06af60 con 0x7f551c15a290 2023-10-14T18:55:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f55224a7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0ce1f0 con 0x7f551c06aae0 2023-10-14T18:55:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f551bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f551c159ec0 0x7f551c0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49328/0 (socket says 172.21.15.79:49328) 2023-10-14T18:55:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f551bfff700 1 -- 172.21.15.79:0/1893091925 learned_addr learned my addr 172.21.15.79:0/1893091925 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1893091925 >> v2:172.21.15.79:3300/0 conn(0x7f551c15a290 0x7f551c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.245+0000 7f5520a44700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551b7fe700 1 -- 172.21.15.79:0/1893091925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 msgr2=0x7f551c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551b7fe700 1 -- 172.21.15.79:0/1893091925 >> v1:172.21.15.79:6789/0 conn(0x7f551c159ec0 legacy=0x7f551c0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551b7fe700 1 -- 172.21.15.79:0/1893091925 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0b0b20 con 0x7f551c15a290 2023-10-14T18:55:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551affd700 1 -- 172.21.15.79:0/1893091925 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121175100 0 0) 0x7f551c0b0790 con 0x7f551c159ec0 2023-10-14T18:55:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f5520a44700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:55:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c15a290 0x7f551c06a5a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f55100098e0 tx=0x7f55100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb03c7391e0d2235 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551affd700 1 -- 172.21.15.79:0/1893091925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510009e80 con 0x7f551c15a290 2023-10-14T18:55:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551affd700 1 -- 172.21.15.79:0/1893091925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551000b860 con 0x7f551c15a290 2023-10-14T18:55:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f551affd700 1 -- 172.21.15.79:0/1893091925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000bbe0 con 0x7f551c15a290 2023-10-14T18:55:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 -- 172.21.15.79:0/1893091925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c15a290 msgr2=0x7f551c06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c15a290 0x7f551c06a5a0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f55100098e0 tx=0x7f55100091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 -- 172.21.15.79:0/1893091925 shutdown_connections 2023-10-14T18:55:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 --2- 172.21.15.79:0/1893091925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c15a290 0x7f551c06a5a0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 -- 172.21.15.79:0/1893091925 >> 172.21.15.79:0/1893091925 conn(0x7f551c0d1880 msgr2=0x7f551c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 -- 172.21.15.79:0/1893091925 shutdown_connections 2023-10-14T18:55:57.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.246+0000 7f55224a7700 1 -- 172.21.15.79:0/1893091925 wait complete. 2023-10-14T18:55:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.247+0000 7f55224a7700 1 Processor -- start 2023-10-14T18:55:57.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 -- start start 2023-10-14T18:55:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551c15a290 0x7f551c1426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0c7000 con 0x7f551c159ec0 2023-10-14T18:55:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0c7230 con 0x7f551c15a290 2023-10-14T18:55:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f55224a7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c16d5f0 con 0x7f551c06aae0 2023-10-14T18:55:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.248+0000 7f551b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50278/0 (socket says 172.21.15.79:50278) 2023-10-14T18:55:57.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 -- 172.21.15.79:0/1268720722 learned_addr learned my addr 172.21.15.79:0/1268720722 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f5520a44700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551c15a290 0x7f551c1426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 -- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 msgr2=0x7f551c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 -- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551c15a290 msgr2=0x7f551c1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551c15a290 0x7f551c1426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 -- 172.21.15.79:0/1268720722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510009420 con 0x7f551c159ec0 2023-10-14T18:55:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f551b7fe700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f551c071eb0 tx=0x7f5510017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000bad0 con 0x7f551c159ec0 2023-10-14T18:55:57.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5510025420 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c16d8d0 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55100257e0 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.249+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c16de90 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.250+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c16e0b0 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.250+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5510023070 con 0x7f551c159ec0 2023-10-14T18:55:57.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.251+0000 7f5503fff700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 0x7f55080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.251+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5510085900 con 0x7f551c159ec0 2023-10-14T18:55:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.251+0000 7f551bfff700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 0x7f55080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.251+0000 7f551bfff700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 0x7f55080693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f550c0011e0 tx=0x7f550c0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.255+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5510052e70 con 0x7f551c159ec0 2023-10-14T18:55:57.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.438+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f551c04c3c0 con 0x7f551c159ec0 2023-10-14T18:55:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.443+0000 7f5503fff700 1 -- 172.21.15.79:0/1268720722 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5510056490 con 0x7f551c159ec0 2023-10-14T18:55:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 msgr2=0x7f55080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 0x7f55080693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f550c0011e0 tx=0x7f550c0079d0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 msgr2=0x7f551c0c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f551c071eb0 tx=0x7f5510017000 comp rx=0 tx=0).stop 2023-10-14T18:55:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 shutdown_connections 2023-10-14T18:55:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5508066f30 0x7f55080693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f551c15a290 0x7f551c1426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f551c06aae0 0x7f551c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 --2- 172.21.15.79:0/1268720722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f551c159ec0 0x7f551c0c6ac0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 >> 172.21.15.79:0/1268720722 conn(0x7f551c0d1880 msgr2=0x7f551c0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 shutdown_connections 2023-10-14T18:55:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.446+0000 7f55224a7700 1 -- 172.21.15.79:0/1268720722 wait complete. 2023-10-14T18:55:57.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-14T18:55:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.573+0000 7f266c991700 1 Processor -- start 2023-10-14T18:55:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.573+0000 7f266c991700 1 -- start start 2023-10-14T18:55:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266c991700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f266815a620 0x7f266815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266c991700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 0x7f2668158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266c991700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266815cbb0 con 0x7f2668157870 2023-10-14T18:55:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266c991700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266815bdb0 con 0x7f266815a620 2023-10-14T18:55:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266c991700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266815bfa0 con 0x7f266815d580 2023-10-14T18:55:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f266815a620 0x7f266815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2668157870 0x7f266815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49340/0 (socket says 172.21.15.79:49340) 2023-10-14T18:55:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f266659c700 1 -- 172.21.15.79:0/1132311922 learned_addr learned my addr 172.21.15.79:0/1132311922 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:55:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f2666d9d700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 0x7f2668158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 -- 172.21.15.79:0/1132311922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 msgr2=0x7f2668158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:57.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 0x7f2668158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 -- 172.21.15.79:0/1132311922 >> v1:172.21.15.79:6789/0 conn(0x7f2668157870 legacy=0x7f266815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 -- 172.21.15.79:0/1132311922 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266815c280 con 0x7f266815a620 2023-10-14T18:55:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f2665d9b700 1 -- 172.21.15.79:0/1132311922 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863052142 0 0) 0x7f266815cbb0 con 0x7f2668157870 2023-10-14T18:55:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f2666d9d700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 0x7f2668158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.574+0000 7f265ffff700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266815d040 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f26500098e0 tx=0x7f26500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ab5b90bb651de7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f2665d9b700 1 -- 172.21.15.79:0/1132311922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650009e80 con 0x7f266815a620 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f2665d9b700 1 -- 172.21.15.79:0/1132311922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265000b860 con 0x7f266815a620 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f2665d9b700 1 -- 172.21.15.79:0/1132311922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000bbe0 con 0x7f266815a620 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 -- 172.21.15.79:0/1132311922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 msgr2=0x7f266815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266815d040 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f26500098e0 tx=0x7f26500091a0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 -- 172.21.15.79:0/1132311922 shutdown_connections 2023-10-14T18:55:57.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f266815d580 0x7f2668158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 --2- 172.21.15.79:0/1132311922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266815d040 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 -- 172.21.15.79:0/1132311922 >> 172.21.15.79:0/1132311922 conn(0x7f2668068ce0 msgr2=0x7f26680690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:57.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 -- 172.21.15.79:0/1132311922 shutdown_connections 2023-10-14T18:55:57.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.575+0000 7f266c991700 1 -- 172.21.15.79:0/1132311922 wait complete. 2023-10-14T18:55:57.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.576+0000 7f266c991700 1 Processor -- start 2023-10-14T18:55:57.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.576+0000 7f266c991700 1 -- start start 2023-10-14T18:55:57.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2668157870 0x7f26680b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 0x7f266816a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b6680 con 0x7f266815a620 2023-10-14T18:55:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b26d0 con 0x7f266815d580 2023-10-14T18:55:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266c991700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b1820 con 0x7f2668157870 2023-10-14T18:55:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50294/0 (socket says 172.21.15.79:50294) 2023-10-14T18:55:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 -- 172.21.15.79:0/245791099 learned_addr learned my addr 172.21.15.79:0/245791099 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f266659c700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2668157870 0x7f26680b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f2666d9d700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 0x7f266816a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 -- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2668157870 msgr2=0x7f26680b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2668157870 0x7f26680b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 -- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 msgr2=0x7f266816a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 0x7f266816a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 -- 172.21.15.79:0/245791099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650009420 con 0x7f266815a620 2023-10-14T18:55:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f2666d9d700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 0x7f266816a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.577+0000 7f265ffff700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f2650013000 tx=0x7f2650017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000bbe0 con 0x7f266815a620 2023-10-14T18:55:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650011420 con 0x7f266815a620 2023-10-14T18:55:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26680b1ac0 con 0x7f266815a620 2023-10-14T18:55:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26500117c0 con 0x7f266815a620 2023-10-14T18:55:57.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26680b2080 con 0x7f266815a620 2023-10-14T18:55:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.578+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26680b2840 con 0x7f266815a620 2023-10-14T18:55:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.579+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2650011bf0 con 0x7f266815a620 2023-10-14T18:55:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.579+0000 7f265e7fc700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.579+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2650085c10 con 0x7f266815a620 2023-10-14T18:55:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.579+0000 7f266659c700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.580+0000 7f266659c700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 0x7f26480693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f26580011e0 tx=0x7f2658009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.583+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2650053180 con 0x7f266815a620 2023-10-14T18:55:57.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:57.844+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f266804c430 con 0x7f266815a620 2023-10-14T18:55:58.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.106+0000 7f265e7fc700 1 -- 172.21.15.79:0/245791099 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v508) v1 ==== 131+0+0 (secure 0 0 0) 0x7f266804c430 con 0x7f266815a620 2023-10-14T18:55:58.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 msgr2=0x7f26480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 0x7f26480693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f26580011e0 tx=0x7f2658009040 comp rx=0 tx=0).stop 2023-10-14T18:55:58.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 msgr2=0x7f266814c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f2650013000 tx=0x7f2650017000 comp rx=0 tx=0).stop 2023-10-14T18:55:58.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 shutdown_connections 2023-10-14T18:55:58.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2648066f30 0x7f26480693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f266815d580 0x7f266816a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2668157870 0x7f26680b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 --2- 172.21.15.79:0/245791099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f266815a620 0x7f266814c830 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 >> 172.21.15.79:0/245791099 conn(0x7f2668068ce0 msgr2=0x7f266815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:58.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 shutdown_connections 2023-10-14T18:55:58.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.109+0000 7f266c991700 1 -- 172.21.15.79:0/245791099 wait complete. 2023-10-14T18:55:58.122 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-14T18:55:58.122 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-14T18:55:58.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-14T18:55:58.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.237+0000 7ff58359e700 1 Processor -- start 2023-10-14T18:55:58.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.237+0000 7ff58359e700 1 -- start start 2023-10-14T18:55:58.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58359e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5840cdab0 0x7ff58415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff58415dda0 0x7ff58415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58359e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5840cb7c0 con 0x7ff5840cd6e0 2023-10-14T18:55:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58359e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58415e850 con 0x7ff5840cdab0 2023-10-14T18:55:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5840cc360 con 0x7ff58415dda0 2023-10-14T18:55:58.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff581d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5840cdab0 0x7ff58415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff581d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5840cdab0 0x7ff58415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50304/0 (socket says 172.21.15.79:50304) 2023-10-14T18:55:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff581d9b700 1 -- 172.21.15.79:0/2551194502 learned_addr learned my addr 172.21.15.79:0/2551194502 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.238+0000 7ff58259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff5840cd6e0 0x7ff5840cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49354/0 (socket says 172.21.15.79:49354) 2023-10-14T18:55:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff581d9b700 1 -- 172.21.15.79:0/2551194502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff58415dda0 msgr2=0x7ff58415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff581d9b700 1 --2- 172.21.15.79:0/2551194502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff58415dda0 0x7ff58415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff581d9b700 1 -- 172.21.15.79:0/2551194502 >> v1:172.21.15.79:6789/0 conn(0x7ff5840cd6e0 legacy=0x7ff5840cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff581d9b700 1 -- 172.21.15.79:0/2551194502 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58415e290 con 0x7ff5840cdab0 2023-10-14T18:55:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58159a700 1 -- 172.21.15.79:0/2551194502 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751767346 0 0) 0x7ff5840cb7c0 con 0x7ff5840cd6e0 2023-10-14T18:55:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff581d9b700 1 --2- 172.21.15.79:0/2551194502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5840cdab0 0x7ff58415d860 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff5780099b0 tx=0x7ff578009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3543d3fc9b16366c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:58.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58159a700 1 -- 172.21.15.79:0/2551194502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800b860 con 0x7ff5840cdab0 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58159a700 1 -- 172.21.15.79:0/2551194502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57800b9c0 con 0x7ff5840cdab0 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58159a700 1 -- 172.21.15.79:0/2551194502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57800bd60 con 0x7ff5840cdab0 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 -- 172.21.15.79:0/2551194502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5840cdab0 msgr2=0x7ff58415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 --2- 172.21.15.79:0/2551194502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5840cdab0 0x7ff58415d860 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff5780099b0 tx=0x7ff578009250 comp rx=0 tx=0).stop 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 -- 172.21.15.79:0/2551194502 shutdown_connections 2023-10-14T18:55:58.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 --2- 172.21.15.79:0/2551194502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff58415dda0 0x7ff58415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 --2- 172.21.15.79:0/2551194502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5840cdab0 0x7ff58415d860 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 -- 172.21.15.79:0/2551194502 >> 172.21.15.79:0/2551194502 conn(0x7ff584067660 msgr2=0x7ff584067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 -- 172.21.15.79:0/2551194502 shutdown_connections 2023-10-14T18:55:58.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.239+0000 7ff58359e700 1 -- 172.21.15.79:0/2551194502 wait complete. 2023-10-14T18:55:58.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.240+0000 7ff58359e700 1 Processor -- start 2023-10-14T18:55:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 -- start start 2023-10-14T18:55:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5840cd6e0 0x7ff58414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 0x7ff58414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58414dd10 con 0x7ff58415dda0 2023-10-14T18:55:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58414f6a0 con 0x7ff5840cdab0 2023-10-14T18:55:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58414ea90 con 0x7ff5840cd6e0 2023-10-14T18:55:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:58.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50310/0 (socket says 172.21.15.79:50310) 2023-10-14T18:55:58.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff582d9d700 1 -- 172.21.15.79:0/3725994521 learned_addr learned my addr 172.21.15.79:0/3725994521 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:58.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.241+0000 7ff58259c700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5840cd6e0 0x7ff58414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:58.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff581d9b700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 0x7ff58414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:58.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 -- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5840cd6e0 msgr2=0x7ff58414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5840cd6e0 0x7ff58414d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 -- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 msgr2=0x7ff58414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 0x7ff58414dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 -- 172.21.15.79:0/3725994521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780094f0 con 0x7ff58415dda0 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff581d9b700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 0x7ff58414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff582d9d700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b810 tx=0x7ff57c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:58.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00f570 con 0x7ff58415dda0 2023-10-14T18:55:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c00f6f0 con 0x7ff58415dda0 2023-10-14T18:55:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58414ed70 con 0x7ff58415dda0 2023-10-14T18:55:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00fab0 con 0x7ff58415dda0 2023-10-14T18:55:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.242+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58414f330 con 0x7ff58415dda0 2023-10-14T18:55:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.243+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58414f830 con 0x7ff58415dda0 2023-10-14T18:55:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.243+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff57c01a460 con 0x7ff58415dda0 2023-10-14T18:55:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.244+0000 7ff5727fc700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 0x7ff5640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.244+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff57c083f60 con 0x7ff58415dda0 2023-10-14T18:55:58.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.244+0000 7ff58259c700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 0x7ff5640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.244+0000 7ff58259c700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 0x7ff5640693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff574001f50 tx=0x7ff574005cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:58.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.248+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff57c051550 con 0x7ff58415dda0 2023-10-14T18:55:58.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:58.507+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7ff58404bb80 con 0x7ff58415dda0 2023-10-14T18:55:59.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.111+0000 7ff5727fc700 1 -- 172.21.15.79:0/3725994521 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v509) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff57c054b70 con 0x7ff58415dda0 2023-10-14T18:55:59.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 msgr2=0x7ff5640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 0x7ff5640693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff574001f50 tx=0x7ff574005cf0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 msgr2=0x7ff5840b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b810 tx=0x7ff57c0091d0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 shutdown_connections 2023-10-14T18:55:59.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff564066f30 0x7ff5640693e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff58415dda0 0x7ff5840b22f0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5840cd6e0 0x7ff58414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 --2- 172.21.15.79:0/3725994521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5840cdab0 0x7ff58414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 >> 172.21.15.79:0/3725994521 conn(0x7ff584067660 msgr2=0x7ff5840c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:59.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 shutdown_connections 2023-10-14T18:55:59.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.113+0000 7ff58359e700 1 -- 172.21.15.79:0/3725994521 wait complete. 2023-10-14T18:55:59.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T18:55:59.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.244+0000 7fde36d75700 1 Processor -- start 2023-10-14T18:55:59.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.244+0000 7fde36d75700 1 -- start start 2023-10-14T18:55:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde36d75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde300cce30 0x7fde3015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde36d75700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300b4d70 con 0x7fde3006aa00 2023-10-14T18:55:59.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde36d75700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300cd8d0 con 0x7fde300b6580 2023-10-14T18:55:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde36d75700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300b4440 con 0x7fde300cce30 2023-10-14T18:55:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde300cce30 0x7fde3015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde300cce30 0x7fde3015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52972/0 (socket says 172.21.15.79:52972) 2023-10-14T18:55:59.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde36574700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fde3006aa00 0x7fde300b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40618/0 (socket says 172.21.15.79:40618) 2023-10-14T18:55:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 -- 172.21.15.79:0/2431952516 learned_addr learned my addr 172.21.15.79:0/2431952516 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:59.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 -- 172.21.15.79:0/2431952516 >> v1:172.21.15.144:6789/0 conn(0x7fde300b6580 legacy=0x7fde3006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 -- 172.21.15.79:0/2431952516 >> v1:172.21.15.79:6789/0 conn(0x7fde3006aa00 legacy=0x7fde300b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 -- 172.21.15.79:0/2431952516 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300b4720 con 0x7fde300cce30 2023-10-14T18:55:59.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde34d71700 1 -- 172.21.15.79:0/2431952516 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356767353 0 0) 0x7fde300b4d70 con 0x7fde3006aa00 2023-10-14T18:55:59.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde35d73700 1 --2- 172.21.15.79:0/2431952516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde3015aca0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0099b0 tx=0x7fde2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c30564c423a80c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde34d71700 1 -- 172.21.15.79:0/2431952516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00b860 con 0x7fde300cce30 2023-10-14T18:55:59.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde34d71700 1 -- 172.21.15.79:0/2431952516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c00b9c0 con 0x7fde300cce30 2023-10-14T18:55:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.245+0000 7fde34d71700 1 -- 172.21.15.79:0/2431952516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00bd60 con 0x7fde300cce30 2023-10-14T18:55:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 -- 172.21.15.79:0/2431952516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 msgr2=0x7fde3015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 --2- 172.21.15.79:0/2431952516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde3015aca0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0099b0 tx=0x7fde2c009250 comp rx=0 tx=0).stop 2023-10-14T18:55:59.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 -- 172.21.15.79:0/2431952516 shutdown_connections 2023-10-14T18:55:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 --2- 172.21.15.79:0/2431952516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde3015aca0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 -- 172.21.15.79:0/2431952516 >> 172.21.15.79:0/2431952516 conn(0x7fde30068cb0 msgr2=0x7fde300690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 -- 172.21.15.79:0/2431952516 shutdown_connections 2023-10-14T18:55:59.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.246+0000 7fde36d75700 1 -- 172.21.15.79:0/2431952516 wait complete. 2023-10-14T18:55:59.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.247+0000 7fde36d75700 1 Processor -- start 2023-10-14T18:55:59.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.247+0000 7fde36d75700 1 -- start start 2023-10-14T18:55:59.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3006aa00 0x7fde301512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 0x7fde300b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde301528d0 con 0x7fde300cce30 2023-10-14T18:55:59.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30151cc0 con 0x7fde3006aa00 2023-10-14T18:55:59.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde30151fa0 con 0x7fde300b6580 2023-10-14T18:55:59.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52974/0 (socket says 172.21.15.79:52974) 2023-10-14T18:55:59.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 -- 172.21.15.79:0/2321691531 learned_addr learned my addr 172.21.15.79:0/2321691531 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:59.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde35d73700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3006aa00 0x7fde301512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde35572700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 0x7fde300b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 -- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 msgr2=0x7fde300b1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 0x7fde300b1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 -- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3006aa00 msgr2=0x7fde301512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3006aa00 0x7fde301512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 -- 172.21.15.79:0/2321691531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0094f0 con 0x7fde300cce30 2023-10-14T18:55:59.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde35572700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 0x7fde300b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:55:59.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36574700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fde2800cd70 tx=0x7fde28001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28005df0 con 0x7fde300cce30 2023-10-14T18:55:59.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800a960 con 0x7fde300cce30 2023-10-14T18:55:59.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.248+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30152280 con 0x7fde300cce30 2023-10-14T18:55:59.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.249+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800ad00 con 0x7fde300cce30 2023-10-14T18:55:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.249+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3014edb0 con 0x7fde300cce30 2023-10-14T18:55:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.250+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde30089550 con 0x7fde300cce30 2023-10-14T18:55:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.250+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde28007300 con 0x7fde300cce30 2023-10-14T18:55:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.250+0000 7fde25ffb700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.250+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fde28084450 con 0x7fde300cce30 2023-10-14T18:55:59.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.250+0000 7fde35d73700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.251+0000 7fde35d73700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 0x7fde140693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0099b0 tx=0x7fde2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.254+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde28051a40 con 0x7fde300cce30 2023-10-14T18:55:59.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.436+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde300b4a00 con 0x7fde300cce30 2023-10-14T18:55:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.440+0000 7fde25ffb700 1 -- 172.21.15.79:0/2321691531 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde2800ae60 con 0x7fde300cce30 2023-10-14T18:55:59.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 msgr2=0x7fde140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 0x7fde140693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0099b0 tx=0x7fde2c017000 comp rx=0 tx=0).stop 2023-10-14T18:55:59.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 msgr2=0x7fde300b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fde2800cd70 tx=0x7fde28001aa0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 shutdown_connections 2023-10-14T18:55:59.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde300cce30 0x7fde300b1990 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3006aa00 0x7fde301512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 --2- 172.21.15.79:0/2321691531 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde300b6580 0x7fde300b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 >> 172.21.15.79:0/2321691531 conn(0x7fde30068cb0 msgr2=0x7fde301507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:59.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 shutdown_connections 2023-10-14T18:55:59.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.442+0000 7fde36d75700 1 -- 172.21.15.79:0/2321691531 wait complete. 2023-10-14T18:55:59.455 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:55:59.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:55:59.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:55:59.536 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:55:59.537 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T18:55:59.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:55:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.650+0000 7f7c1a492700 1 Processor -- start 2023-10-14T18:55:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.650+0000 7f7c1a492700 1 -- start start 2023-10-14T18:55:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c140cd6e0 0x7f7c140cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c1415dda0 0x7f7c1415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1415e850 con 0x7f7c140cd6e0 2023-10-14T18:55:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140cd030 con 0x7f7c1415dda0 2023-10-14T18:55:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c1a492700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140cb7c0 con 0x7f7c140cdab0 2023-10-14T18:55:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c140cd6e0 0x7f7c140cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7c140cd6e0 0x7f7c140cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52984/0 (socket says 172.21.15.79:52984) 2023-10-14T18:55:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 -- 172.21.15.79:0/3460083189 learned_addr learned my addr 172.21.15.79:0/3460083189 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19c91700 1 --2- 172.21.15.79:0/3460083189 >> v2:172.21.15.144:3300/0 conn(0x7f7c1415dda0 0x7f7c1415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c18c8f700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 -- 172.21.15.79:0/3460083189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 msgr2=0x7f7c1415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 -- 172.21.15.79:0/3460083189 >> v2:172.21.15.144:3300/0 conn(0x7f7c1415dda0 msgr2=0x7f7c1415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:55:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 --2- 172.21.15.79:0/3460083189 >> v2:172.21.15.144:3300/0 conn(0x7f7c1415dda0 0x7f7c1415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.651+0000 7f7c19490700 1 -- 172.21.15.79:0/3460083189 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1415e290 con 0x7f7c140cd6e0 2023-10-14T18:55:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c19490700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c140cd6e0 0x7f7c140cbc50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7c14089ac0 tx=0x7f7c0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30152108b606f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c0bfff700 1 -- 172.21.15.79:0/3460083189 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00e070 con 0x7f7c140cd6e0 2023-10-14T18:55:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c0bfff700 1 -- 172.21.15.79:0/3460083189 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00ba50 con 0x7f7c140cd6e0 2023-10-14T18:55:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c0bfff700 1 -- 172.21.15.79:0/3460083189 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0092e0 con 0x7f7c140cd6e0 2023-10-14T18:55:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 -- 172.21.15.79:0/3460083189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c140cd6e0 msgr2=0x7f7c140cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c140cd6e0 0x7f7c140cbc50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7c14089ac0 tx=0x7f7c0c009840 comp rx=0 tx=0).stop 2023-10-14T18:55:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 -- 172.21.15.79:0/3460083189 shutdown_connections 2023-10-14T18:55:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 --2- 172.21.15.79:0/3460083189 >> v2:172.21.15.144:3300/0 conn(0x7f7c1415dda0 0x7f7c1415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c140cd6e0 0x7f7c140cbc50 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 --2- 172.21.15.79:0/3460083189 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 -- 172.21.15.79:0/3460083189 >> 172.21.15.79:0/3460083189 conn(0x7f7c14067660 msgr2=0x7f7c14067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 -- 172.21.15.79:0/3460083189 shutdown_connections 2023-10-14T18:55:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.652+0000 7f7c1a492700 1 -- 172.21.15.79:0/3460083189 wait complete. 2023-10-14T18:55:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.653+0000 7f7c1a492700 1 Processor -- start 2023-10-14T18:55:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.653+0000 7f7c1a492700 1 -- start start 2023-10-14T18:55:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c140cd6e0 0x7f7c1416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1415c610 con 0x7f7c1415dda0 2023-10-14T18:55:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1415ba90 con 0x7f7c140cd6e0 2023-10-14T18:55:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c1a492700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1415bd70 con 0x7f7c140cdab0 2023-10-14T18:55:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c19c91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c19c91700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52990/0 (socket says 172.21.15.79:52990) 2023-10-14T18:55:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c19c91700 1 -- 172.21.15.79:0/574427266 learned_addr learned my addr 172.21.15.79:0/574427266 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:55:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c19490700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c140cd6e0 0x7f7c1416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.654+0000 7f7c18c8f700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 -- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 msgr2=0x7f7c1415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 -- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c140cd6e0 msgr2=0x7f7c1416a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c140cd6e0 0x7f7c1416a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 -- 172.21.15.79:0/574427266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009ae0 con 0x7f7c1415dda0 2023-10-14T18:55:59.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c19c91700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c880 tx=0x7f7c10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10011660 con 0x7f7c1415dda0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c100117c0 con 0x7f7c1415dda0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1415c050 con 0x7f7c1415dda0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10011b60 con 0x7f7c1415dda0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.655+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1416ae60 con 0x7f7c1415dda0 2023-10-14T18:55:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.656+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14089280 con 0x7f7c1415dda0 2023-10-14T18:55:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.656+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c100193f0 con 0x7f7c1415dda0 2023-10-14T18:55:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.657+0000 7f7c097fa700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:55:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.657+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7c10084430 con 0x7f7c1415dda0 2023-10-14T18:55:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.657+0000 7f7c19490700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:55:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.657+0000 7f7c19490700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 0x7f7bf80693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009880 tx=0x7f7c0c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:55:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.661+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c10055430 con 0x7f7c1415dda0 2023-10-14T18:55:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.884+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c1415e5f0 con 0x7f7c1415dda0 2023-10-14T18:55:59.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.885+0000 7f7c097fa700 1 -- 172.21.15.79:0/574427266 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7c1415e5f0 con 0x7f7c1415dda0 2023-10-14T18:55:59.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:55:59.887 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":82,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/2336370321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":2336370321},{"type":"v1","addr":"172.21.15.79:6834","nonce":2336370321}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":6296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1870462914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1870462914},{"type":"v1","addr":"172.21.15.144:6836","nonce":1870462914}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":7045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/813844270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":813844270},{"type":"v1","addr":"172.21.15.144:6837","nonce":813844270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1023791426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1023791426},{"type":"v1","addr":"172.21.15.79:6835","nonce":1023791426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-10-14T18:55:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 msgr2=0x7f7bf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 0x7f7bf80693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009880 tx=0x7f7c0c018000 comp rx=0 tx=0).stop 2023-10-14T18:55:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 msgr2=0x7f7c1415b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:55:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c880 tx=0x7f7c10008040 comp rx=0 tx=0).stop 2023-10-14T18:55:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 shutdown_connections 2023-10-14T18:55:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7bf8066f30 0x7f7bf80693e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c1415dda0 0x7f7c1415b450 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c140cd6e0 0x7f7c1416a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 --2- 172.21.15.79:0/574427266 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c140cdab0 0x7f7c1415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:55:59.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 >> 172.21.15.79:0/574427266 conn(0x7f7c14067660 msgr2=0x7f7c140b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:55:59.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 shutdown_connections 2023-10-14T18:55:59.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:55:59.887+0000 7f7c1a492700 1 -- 172.21.15.79:0/574427266 wait complete. 2023-10-14T18:55:59.895 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 82 2023-10-14T18:55:59.901 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T18:55:59.901 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T18:55:59.902 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:55:59.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:55:59.903 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T18:55:59.903 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T18:55:59.904 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:55:59.904 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:55:59.905 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T18:55:59.905 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T18:55:59.905 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:55:59.906 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:55:59.906 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T18:55:59.907 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T18:55:59.907 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:55:59.907 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:55:59.910 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:55:59.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T18:55:59.912 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:55:59.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T18:55:59.917 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:55:59.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T18:55:59.919 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:55:59.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T18:55:59.954 INFO:tasks.ceph.mds.a:Started 2023-10-14T18:55:59.955 DEBUG:teuthology.parallel:result is None 2023-10-14T18:55:59.956 INFO:tasks.ceph.mds.c:Started 2023-10-14T18:55:59.956 DEBUG:teuthology.parallel:result is None 2023-10-14T18:55:59.961 INFO:tasks.ceph.mds.b:Started 2023-10-14T18:55:59.962 DEBUG:teuthology.parallel:result is None 2023-10-14T18:55:59.963 INFO:tasks.ceph.mds.d:Started 2023-10-14T18:55:59.963 DEBUG:teuthology.parallel:result is None 2023-10-14T18:55:59.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T18:56:00.027 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-14T18:56:00.028 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-14T18:56:00.041 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-10-14T18:56:00.042 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:56:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.084+0000 7f6ad8ab4700 1 Processor -- start 2023-10-14T18:56:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.084+0000 7f6ad8ab4700 1 -- start start 2023-10-14T18:56:00.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ad4070950 0x7f6ad4067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ad415c510 0x7f6ad4067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad4070d20 0x7f6ad41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad4068590 con 0x7f6ad4070950 2023-10-14T18:56:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad40682b0 con 0x7f6ad415c510 2023-10-14T18:56:00.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad8ab4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad415ba30 con 0x7f6ad4070d20 2023-10-14T18:56:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ad4070950 0x7f6ad4067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ad4070950 0x7f6ad4067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53016/0 (socket says 172.21.15.79:53016) 2023-10-14T18:56:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad259c700 1 -- 172.21.15.79:0/3067548291 learned_addr learned my addr 172.21.15.79:0/3067548291 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ac9d9b700 1 --2- 172.21.15.79:0/3067548291 >> v2:172.21.15.144:3300/0 conn(0x7f6ad415c510 0x7f6ad4067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.085+0000 7f6ad2d9d700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad4070d20 0x7f6ad41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 -- 172.21.15.79:0/3067548291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad4070d20 msgr2=0x7f6ad41576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad4070d20 0x7f6ad41576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 -- 172.21.15.79:0/3067548291 >> v2:172.21.15.144:3300/0 conn(0x7f6ad415c510 msgr2=0x7f6ad4067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 --2- 172.21.15.79:0/3067548291 >> v2:172.21.15.144:3300/0 conn(0x7f6ad415c510 0x7f6ad4067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 -- 172.21.15.79:0/3067548291 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad415bd10 con 0x7f6ad4070950 2023-10-14T18:56:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad259c700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070950 0x7f6ad4067660 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415b7c0 tx=0x7f6ac4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bdcd82cb092ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad1d9b700 1 -- 172.21.15.79:0/3067548291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400b640 con 0x7f6ad4070950 2023-10-14T18:56:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad1d9b700 1 -- 172.21.15.79:0/3067548291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400b7a0 con 0x7f6ad4070950 2023-10-14T18:56:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad1d9b700 1 -- 172.21.15.79:0/3067548291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400bb60 con 0x7f6ad4070950 2023-10-14T18:56:00.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/3067548291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070950 msgr2=0x7f6ad4067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:00.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070950 0x7f6ad4067660 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415b7c0 tx=0x7f6ac4009250 comp rx=0 tx=0).stop 2023-10-14T18:56:00.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/3067548291 shutdown_connections 2023-10-14T18:56:00.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad4070d20 0x7f6ad41576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/3067548291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070950 0x7f6ad4067660 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/3067548291 >> v2:172.21.15.144:3300/0 conn(0x7f6ad415c510 0x7f6ad4067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.086+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/3067548291 >> 172.21.15.79:0/3067548291 conn(0x7f6ad406a250 msgr2=0x7f6ad406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.087+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/3067548291 shutdown_connections 2023-10-14T18:56:00.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.087+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/3067548291 wait complete. 2023-10-14T18:56:00.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 Processor -- start 2023-10-14T18:56:00.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 -- start start 2023-10-14T18:56:00.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ad4070950 0x7f6ad41558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad415c510 0x7f6ad4152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4155e30 con 0x7f6ad4070d20 2023-10-14T18:56:00.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40c4b20 con 0x7f6ad4070950 2023-10-14T18:56:00.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.088+0000 7f6ad8ab4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad40c50e0 con 0x7f6ad415c510 2023-10-14T18:56:00.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53024/0 (socket says 172.21.15.79:53024) 2023-10-14T18:56:00.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 -- 172.21.15.79:0/2606670045 learned_addr learned my addr 172.21.15.79:0/2606670045 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:00.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ad259c700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ad4070950 0x7f6ad41558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ad2d9d700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad415c510 0x7f6ad4152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 -- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad415c510 msgr2=0x7f6ad4152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad415c510 0x7f6ad4152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 -- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ad4070950 msgr2=0x7f6ad41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ad4070950 0x7f6ad41558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 -- 172.21.15.79:0/2606670045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40094f0 con 0x7f6ad4070d20 2023-10-14T18:56:00.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ac9d9b700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00e900 tx=0x7f6abc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc013680 con 0x7f6ad4070d20 2023-10-14T18:56:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc0137e0 con 0x7f6ad4070d20 2023-10-14T18:56:00.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad40c7ab0 con 0x7f6ad4070d20 2023-10-14T18:56:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc013ba0 con 0x7f6ad4070d20 2023-10-14T18:56:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.089+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad41560d0 con 0x7f6ad4070d20 2023-10-14T18:56:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.090+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad40c5290 con 0x7f6ad4070d20 2023-10-14T18:56:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.091+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6abc0123d0 con 0x7f6ad4070d20 2023-10-14T18:56:00.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.091+0000 7f6acaffd700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 0x7f6ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:00.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.091+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6abc0842b0 con 0x7f6ad4070d20 2023-10-14T18:56:00.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.091+0000 7f6ad259c700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 0x7f6ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:00.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.092+0000 7f6ad259c700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 0x7f6ab40693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415b7c0 tx=0x7f6ac4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:00.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.095+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ad40c5290 con 0x7f6ad4070d20 2023-10-14T18:56:00.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:00.296+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6ad40c5250 con 0x7f6ad4070d20 2023-10-14T18:56:01.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.137+0000 7f6acaffd700 1 -- 172.21.15.79:0/2606670045 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v182) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6abc051820 con 0x7f6ad4070d20 2023-10-14T18:56:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 msgr2=0x7f6ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 0x7f6ab40693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6ad415b7c0 tx=0x7f6ac4017000 comp rx=0 tx=0).stop 2023-10-14T18:56:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 msgr2=0x7f6ad40c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00e900 tx=0x7f6abc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 shutdown_connections 2023-10-14T18:56:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6ab4066f30 0x7f6ab40693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6ad415c510 0x7f6ad4152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ad4070950 0x7f6ad41558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 --2- 172.21.15.79:0/2606670045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ad4070d20 0x7f6ad40c7570 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 >> 172.21.15.79:0/2606670045 conn(0x7f6ad406a250 msgr2=0x7f6ad40cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 shutdown_connections 2023-10-14T18:56:01.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.140+0000 7f6ad8ab4700 1 -- 172.21.15.79:0/2606670045 wait complete. 2023-10-14T18:56:01.144 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-14T18:56:01.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T18:56:01.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.272+0000 7f28e1e8c700 1 Processor -- start 2023-10-14T18:56:01.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.272+0000 7f28e1e8c700 1 -- start start 2023-10-14T18:56:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.273+0000 7f28e1e8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.273+0000 7f28e1e8c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 0x7f28dc06a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.273+0000 7f28e1e8c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc15c360 con 0x7f28dc15b0d0 2023-10-14T18:56:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.273+0000 7f28e1e8c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc15b790 con 0x7f28dc157ba0 2023-10-14T18:56:01.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.273+0000 7f28e1e8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15d800 con 0x7f28dc1577d0 2023-10-14T18:56:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28daffd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 0x7f28dc06a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28dbfff700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f28dc15b0d0 0x7f28dc15da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:36440/0 (socket says 172.21.15.79:36440) 2023-10-14T18:56:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28dbfff700 1 -- 172.21.15.79:0/3541773635 learned_addr learned my addr 172.21.15.79:0/3541773635 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:01.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 -- 172.21.15.79:0/3541773635 >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 msgr2=0x7f28dc06a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:01.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 --2- 172.21.15.79:0/3541773635 >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 0x7f28dc06a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 -- 172.21.15.79:0/3541773635 >> v1:172.21.15.144:6789/0 conn(0x7f28dc15b0d0 legacy=0x7f28dc15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 -- 172.21.15.79:0/3541773635 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc15ba30 con 0x7f28dc1577d0 2023-10-14T18:56:01.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28daffd700 1 --2- 172.21.15.79:0/3541773635 >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 0x7f28dc06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28db7fe700 1 --2- 172.21.15.79:0/3541773635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0cd770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098e0 tx=0x7f28cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5b679d4474aa70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28da7fc700 1 -- 172.21.15.79:0/3541773635 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00b640 con 0x7f28dc1577d0 2023-10-14T18:56:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28da7fc700 1 -- 172.21.15.79:0/3541773635 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00b7a0 con 0x7f28dc1577d0 2023-10-14T18:56:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.274+0000 7f28da7fc700 1 -- 172.21.15.79:0/3541773635 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00bb40 con 0x7f28dc1577d0 2023-10-14T18:56:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 -- 172.21.15.79:0/3541773635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 msgr2=0x7f28dc0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/3541773635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0cd770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0098e0 tx=0x7f28cc0091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 -- 172.21.15.79:0/3541773635 shutdown_connections 2023-10-14T18:56:01.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/3541773635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0cd770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/3541773635 >> v2:172.21.15.144:3300/0 conn(0x7f28dc157ba0 0x7f28dc06a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 -- 172.21.15.79:0/3541773635 >> 172.21.15.79:0/3541773635 conn(0x7f28dc068ce0 msgr2=0x7f28dc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:01.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 -- 172.21.15.79:0/3541773635 shutdown_connections 2023-10-14T18:56:01.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.275+0000 7f28e1e8c700 1 -- 172.21.15.79:0/3541773635 wait complete. 2023-10-14T18:56:01.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.276+0000 7f28e1e8c700 1 Processor -- start 2023-10-14T18:56:01.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.276+0000 7f28e1e8c700 1 -- start start 2023-10-14T18:56:01.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 0x7f28dc144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0cab10 con 0x7f28dc157ba0 2023-10-14T18:56:01.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc16b660 con 0x7f28dc15b0d0 2023-10-14T18:56:01.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28e1e8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc16b940 con 0x7f28dc1577d0 2023-10-14T18:56:01.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28daffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28daffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53040/0 (socket says 172.21.15.79:53040) 2023-10-14T18:56:01.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28daffd700 1 -- 172.21.15.79:0/2372622341 learned_addr learned my addr 172.21.15.79:0/2372622341 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:01.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28db7fe700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.277+0000 7f28dbfff700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 0x7f28dc144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 -- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 msgr2=0x7f28dc0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 -- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 msgr2=0x7f28dc144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 0x7f28dc144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 -- 172.21.15.79:0/2372622341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d0009420 con 0x7f28dc157ba0 2023-10-14T18:56:01.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28db7fe700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:01.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28dbfff700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 0x7f28dc144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:01.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28daffd700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f28d000ec80 tx=0x7f28d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000c9d0 con 0x7f28dc157ba0 2023-10-14T18:56:01.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d000cb30 con 0x7f28dc157ba0 2023-10-14T18:56:01.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc009420 con 0x7f28dc157ba0 2023-10-14T18:56:01.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000ceb0 con 0x7f28dc157ba0 2023-10-14T18:56:01.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.278+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc16bcd0 con 0x7f28dc157ba0 2023-10-14T18:56:01.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.279+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc04c3c0 con 0x7f28dc157ba0 2023-10-14T18:56:01.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.279+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d0013680 con 0x7f28dc157ba0 2023-10-14T18:56:01.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.280+0000 7f28c37fe700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.280+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f28d0084640 con 0x7f28dc157ba0 2023-10-14T18:56:01.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.280+0000 7f28db7fe700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.280+0000 7f28db7fe700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0093f0 tx=0x7f28cc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.284+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d0051c00 con 0x7f28dc157ba0 2023-10-14T18:56:01.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.540+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f28dc15bd10 con 0x7f28dc157ba0 2023-10-14T18:56:01.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.540+0000 7f28c37fe700 1 -- 172.21.15.79:0/2372622341 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f28d0055220 con 0x7f28dc157ba0 2023-10-14T18:56:01.542 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:01.543 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-14T18:56:01.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-14T18:56:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spli+0VFxAA3YeHHQ/JfZleKH3lQ899DQ==", 2023-10-14T18:56:01.544 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:56:01.545 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:56:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-14T18:56:01.547 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMhRWIhAAcqnG2kiEIFnE3ym38Nr24w==", 2023-10-14T18:56:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.548 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:56:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:56:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-14T18:56:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplRCndHRAAcrOf47plf7OsmeIb6Mc7GA==", 2023-10-14T18:56:01.550 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:56:01.551 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:56:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.552 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-14T18:56:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplPngeKRAAkhnZqQC5yKqtvov1Q97O/g==", 2023-10-14T18:56:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:56:01.553 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:56:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-14T18:56:01.555 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplUAGZBBAA0TWRDMMb0PMY88M0oMnhYw==", 2023-10-14T18:56:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.556 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.558 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-14T18:56:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplicxqCxAA/ONeYSuRrNJ7sdfMwKbx5Q==", 2023-10-14T18:56:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.559 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.560 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-14T18:56:01.562 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplvyF6FBAAKnkcCJ6y7geavbTRw7Sk1Q==", 2023-10-14T18:56:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.563 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-14T18:56:01.564 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCd4SplzF3CHRAAKHt5PpSn8wC8cGZc7dIN3A==", 2023-10-14T18:56:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.565 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.566 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-14T18:56:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4Spl1WdCKBAAxseiKd4/bqaBTo7d5P3PUw==", 2023-10-14T18:56:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.567 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-14T18:56:01.568 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplqvM9LxAAG6TfIOo+EcbPBrVi+K/Dcw==", 2023-10-14T18:56:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.569 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.570 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-14T18:56:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCg4SplcCM4OBAAlgMT1UrX2On0ruRbZ3bnyA==", 2023-10-14T18:56:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-14T18:56:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCh4SplGMrDBRAAkKYGEpcvlsBWkLxBTm62Kw==", 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-14T18:56:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplP8QCLRAA3s+oNwsay0Po/f/aUR/BOg==", 2023-10-14T18:56:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.574 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow r", 2023-10-14T18:56:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-14T18:56:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-14T18:56:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplZT9gNRAA3XW7ZsahjH7lNmMdxwBLjg==", 2023-10-14T18:56:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.576 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:56:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:56:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:56:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-14T18:56:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4Spl4Z1hMhAAC4UVYZCw7aFWMrVDwKdWEQ==", 2023-10-14T18:56:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.578 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:56:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:56:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:56:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-14T18:56:01.580 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplDZzGOhAAr0pYK22hUcGeuxpoR2UATw==", 2023-10-14T18:56:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-14T18:56:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-14T18:56:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-14T18:56:01.581 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-14T18:56:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-14T18:56:01.582 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCY4SplC9gfOBAAd13yp1g0IxLveQlVrn2muQ==", 2023-10-14T18:56:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:56:01.583 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-14T18:56:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-14T18:56:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-14T18:56:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplMy4aFBAArakj+5OnA8AK+k9ofOETnQ==", 2023-10-14T18:56:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:56:01.585 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:56:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:01.586 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-14T18:56:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCZ4SplAFy6EBAAWlATonFFaaTfFX2OPz+eJw==", 2023-10-14T18:56:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-14T18:56:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-14T18:56:01.587 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-14T18:56:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-14T18:56:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:01.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:01.588 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 msgr2=0x7f28c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 0x7f28c80693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0093f0 tx=0x7f28cc017000 comp rx=0 tx=0).stop 2023-10-14T18:56:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 msgr2=0x7f28dc16ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f28d000ec80 tx=0x7f28d00091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 shutdown_connections 2023-10-14T18:56:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28c8066f30 0x7f28c80693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28dc15b0d0 0x7f28dc144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28dc1577d0 0x7f28dc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 --2- 172.21.15.79:0/2372622341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28dc157ba0 0x7f28dc16ab60 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 >> 172.21.15.79:0/2372622341 conn(0x7f28dc068ce0 msgr2=0x7f28dc0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:01.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 shutdown_connections 2023-10-14T18:56:01.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.542+0000 7f28e1e8c700 1 -- 172.21.15.79:0/2372622341 wait complete. 2023-10-14T18:56:01.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.709+0000 7f53c9c78700 1 Processor -- start 2023-10-14T18:56:01.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.709+0000 7f53c9c78700 1 -- start start 2023-10-14T18:56:01.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c9c78700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53c415a620 0x7f53c415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c9c78700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53c415d580 0x7f53c4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c9c78700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c415cbb0 con 0x7f53c4157870 2023-10-14T18:56:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c9c78700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c415bdb0 con 0x7f53c415d580 2023-10-14T18:56:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c9c78700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c415bfa0 con 0x7f53c415a620 2023-10-14T18:56:01.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53c415d580 0x7f53c4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53c4157870 0x7f53c415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40650/0 (socket says 172.21.15.79:40650) 2023-10-14T18:56:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c37fe700 1 -- 172.21.15.79:0/2318167712 learned_addr learned my addr 172.21.15.79:0/2318167712 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c2ffd700 1 --2- 172.21.15.79:0/2318167712 >> v2:172.21.15.144:3300/0 conn(0x7f53c415a620 0x7f53c415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 -- 172.21.15.79:0/2318167712 >> v2:172.21.15.144:3300/0 conn(0x7f53c415a620 msgr2=0x7f53c415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 --2- 172.21.15.79:0/2318167712 >> v2:172.21.15.144:3300/0 conn(0x7f53c415a620 0x7f53c415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 -- 172.21.15.79:0/2318167712 >> v1:172.21.15.79:6789/0 conn(0x7f53c4157870 legacy=0x7f53c415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 -- 172.21.15.79:0/2318167712 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c415c280 con 0x7f53c415d580 2023-10-14T18:56:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c27fc700 1 -- 172.21.15.79:0/2318167712 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390700449 0 0) 0x7f53c415cbb0 con 0x7f53c4157870 2023-10-14T18:56:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c3fff700 1 --2- 172.21.15.79:0/2318167712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c4158110 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f53c415cb20 tx=0x7f53bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde21348b33b1021 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.710+0000 7f53c27fc700 1 -- 172.21.15.79:0/2318167712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00e070 con 0x7f53c415d580 2023-10-14T18:56:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c27fc700 1 -- 172.21.15.79:0/2318167712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00bb60 con 0x7f53c415d580 2023-10-14T18:56:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c27fc700 1 -- 172.21.15.79:0/2318167712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc012430 con 0x7f53c415d580 2023-10-14T18:56:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 -- 172.21.15.79:0/2318167712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 msgr2=0x7f53c4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2318167712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c4158110 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f53c415cb20 tx=0x7f53bc009780 comp rx=0 tx=0).stop 2023-10-14T18:56:01.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 -- 172.21.15.79:0/2318167712 shutdown_connections 2023-10-14T18:56:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2318167712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c4158110 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2318167712 >> v2:172.21.15.144:3300/0 conn(0x7f53c415a620 0x7f53c415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 -- 172.21.15.79:0/2318167712 >> 172.21.15.79:0/2318167712 conn(0x7f53c4068ce0 msgr2=0x7f53c40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 -- 172.21.15.79:0/2318167712 shutdown_connections 2023-10-14T18:56:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.711+0000 7f53c9c78700 1 -- 172.21.15.79:0/2318167712 wait complete. 2023-10-14T18:56:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.712+0000 7f53c9c78700 1 Processor -- start 2023-10-14T18:56:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.712+0000 7f53c9c78700 1 -- start start 2023-10-14T18:56:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53c4157870 0x7f53c413e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53c415a620 0x7f53c4150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40d0330 con 0x7f53c415d580 2023-10-14T18:56:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40cf790 con 0x7f53c415a620 2023-10-14T18:56:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c9c78700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c413ed20 con 0x7f53c4157870 2023-10-14T18:56:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53058/0 (socket says 172.21.15.79:53058) 2023-10-14T18:56:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 -- 172.21.15.79:0/2945982004 learned_addr learned my addr 172.21.15.79:0/2945982004 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c2ffd700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53c415a620 0x7f53c4150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c37fe700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53c4157870 0x7f53c413e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 -- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53c4157870 msgr2=0x7f53c413e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53c4157870 0x7f53c413e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 -- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53c415a620 msgr2=0x7f53c4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53c415a620 0x7f53c4150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.713+0000 7f53c3fff700 1 -- 172.21.15.79:0/2945982004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc009a20 con 0x7f53c415d580 2023-10-14T18:56:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53c3fff700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f53c406b530 tx=0x7f53bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc027470 con 0x7f53c415d580 2023-10-14T18:56:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc0275d0 con 0x7f53c415d580 2023-10-14T18:56:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40cfa00 con 0x7f53c415d580 2023-10-14T18:56:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc027990 con 0x7f53c415d580 2023-10-14T18:56:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.714+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c40cffc0 con 0x7f53c415d580 2023-10-14T18:56:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.715+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c404c3c0 con 0x7f53c415d580 2023-10-14T18:56:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.715+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53bc024070 con 0x7f53c415d580 2023-10-14T18:56:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.715+0000 7f53ab7fe700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 0x7f53b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.715+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f53bc086b80 con 0x7f53c415d580 2023-10-14T18:56:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.716+0000 7f53c37fe700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 0x7f53b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.716+0000 7f53c37fe700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 0x7f53b00693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f53b4007fd0 tx=0x7f53b4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:01.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.720+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53bc054140 con 0x7f53c415d580 2023-10-14T18:56:01.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.901+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53c415c560 con 0x7f53c415d580 2023-10-14T18:56:01.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.902+0000 7f53ab7fe700 1 -- 172.21.15.79:0/2945982004 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f53bc057760 con 0x7f53c415d580 2023-10-14T18:56:01.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:01.903 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":182,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:01.134640+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:01.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 msgr2=0x7f53b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 0x7f53b00693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f53b4007fd0 tx=0x7f53b4007d30 comp rx=0 tx=0).stop 2023-10-14T18:56:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 msgr2=0x7f53c40b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f53c406b530 tx=0x7f53bc019000 comp rx=0 tx=0).stop 2023-10-14T18:56:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 shutdown_connections 2023-10-14T18:56:01.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53b0066f30 0x7f53b00693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53c415d580 0x7f53c40b1830 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53c4157870 0x7f53c413e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 --2- 172.21.15.79:0/2945982004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53c415a620 0x7f53c4150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.904+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 >> 172.21.15.79:0/2945982004 conn(0x7f53c4068ce0 msgr2=0x7f53c414c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.905+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 shutdown_connections 2023-10-14T18:56:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:01.905+0000 7f53c9c78700 1 -- 172.21.15.79:0/2945982004 wait complete. 2023-10-14T18:56:01.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-14T18:56:01.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:56:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.036+0000 7f90081f2700 1 Processor -- start 2023-10-14T18:56:02.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.036+0000 7f90081f2700 1 -- start start 2023-10-14T18:56:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f90081f2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9000159ec0 0x7f90000af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f90081f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900006acb0 0x7f90000afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f90081f2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90000b0790 con 0x7f900015a290 2023-10-14T18:56:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f90081f2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90000ce1f0 con 0x7f9000159ec0 2023-10-14T18:56:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f90081f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000b0b20 con 0x7f900006acb0 2023-10-14T18:56:02.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f9005f8e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9000159ec0 0x7f90000af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f9005f8e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9000159ec0 0x7f90000af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53064/0 (socket says 172.21.15.79:53064) 2023-10-14T18:56:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.037+0000 7f9005f8e700 1 -- 172.21.15.79:0/3182061615 learned_addr learned my addr 172.21.15.79:0/3182061615 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f900678f700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900006acb0 0x7f90000afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9005f8e700 1 -- 172.21.15.79:0/3182061615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900006acb0 msgr2=0x7f90000afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9005f8e700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900006acb0 0x7f90000afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9005f8e700 1 -- 172.21.15.79:0/3182061615 >> v1:172.21.15.144:6789/0 conn(0x7f900015a290 legacy=0x7f900006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9005f8e700 1 -- 172.21.15.79:0/3182061615 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000b04b0 con 0x7f9000159ec0 2023-10-14T18:56:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9005f8e700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000af940 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009f20 tx=0x7f8ffc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb65ca69e257bc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9004f8c700 1 -- 172.21.15.79:0/3182061615 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00e070 con 0x7f9000159ec0 2023-10-14T18:56:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9004f8c700 1 -- 172.21.15.79:0/3182061615 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00ba40 con 0x7f9000159ec0 2023-10-14T18:56:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f9004f8c700 1 -- 172.21.15.79:0/3182061615 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0092e0 con 0x7f9000159ec0 2023-10-14T18:56:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f90081f2700 1 -- 172.21.15.79:0/3182061615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 msgr2=0x7f90000af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.038+0000 7f90081f2700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000af940 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009f20 tx=0x7f8ffc009840 comp rx=0 tx=0).stop 2023-10-14T18:56:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 -- 172.21.15.79:0/3182061615 shutdown_connections 2023-10-14T18:56:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900006acb0 0x7f90000afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 --2- 172.21.15.79:0/3182061615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000af940 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 -- 172.21.15.79:0/3182061615 >> 172.21.15.79:0/3182061615 conn(0x7f90000d1880 msgr2=0x7f90000cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 -- 172.21.15.79:0/3182061615 shutdown_connections 2023-10-14T18:56:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.039+0000 7f90081f2700 1 -- 172.21.15.79:0/3182061615 wait complete. 2023-10-14T18:56:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 Processor -- start 2023-10-14T18:56:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 -- start start 2023-10-14T18:56:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f900006acb0 0x7f90001496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900015a290 0x7f90000b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900016da90 con 0x7f9000159ec0 2023-10-14T18:56:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900016e610 con 0x7f900006acb0 2023-10-14T18:56:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f90081f2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900016dce0 con 0x7f900015a290 2023-10-14T18:56:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.040+0000 7f900578d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53076/0 (socket says 172.21.15.79:53076) 2023-10-14T18:56:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 -- 172.21.15.79:0/3247946494 learned_addr learned my addr 172.21.15.79:0/3247946494 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f9005f8e700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f900006acb0 0x7f90001496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900678f700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900015a290 0x7f90000b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 -- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900015a290 msgr2=0x7f90000b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900015a290 0x7f90000b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 -- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f900006acb0 msgr2=0x7f90001496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f900006acb0 0x7f90001496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 -- 172.21.15.79:0/3247946494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009ae0 con 0x7f9000159ec0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f900578d700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b610 tx=0x7f8ff0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000f510 con 0x7f9000159ec0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000f670 con 0x7f9000159ec0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900016dfc0 con 0x7f9000159ec0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000fa30 con 0x7f9000159ec0 2023-10-14T18:56:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.041+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9000149c00 con 0x7f9000159ec0 2023-10-14T18:56:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.042+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900004c3c0 con 0x7f9000159ec0 2023-10-14T18:56:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.043+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ff001a400 con 0x7f9000159ec0 2023-10-14T18:56:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.043+0000 7f8ff5ffb700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 0x7f8fe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.043+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ff0083c30 con 0x7f9000159ec0 2023-10-14T18:56:02.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.043+0000 7f9005f8e700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 0x7f8fe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.043+0000 7f9005f8e700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 0x7f8fe40693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009880 tx=0x7f8ffc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.047+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ff0051270 con 0x7f9000159ec0 2023-10-14T18:56:02.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.229+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f900016e750 con 0x7f9000159ec0 2023-10-14T18:56:02.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.230+0000 7f8ff5ffb700 1 -- 172.21.15.79:0/3247946494 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ff0054890 con 0x7f9000159ec0 2023-10-14T18:56:02.231 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:56:02.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 msgr2=0x7f8fe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 0x7f8fe40693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009880 tx=0x7f8ffc017000 comp rx=0 tx=0).stop 2023-10-14T18:56:02.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 msgr2=0x7f90000b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b610 tx=0x7f8ff0009120 comp rx=0 tx=0).stop 2023-10-14T18:56:02.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 shutdown_connections 2023-10-14T18:56:02.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8fe4066f30 0x7f8fe40693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f900015a290 0x7f90000b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f900006acb0 0x7f90001496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 --2- 172.21.15.79:0/3247946494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9000159ec0 0x7f90000b18f0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 >> 172.21.15.79:0/3247946494 conn(0x7f90000d1880 msgr2=0x7f90000afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:02.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 shutdown_connections 2023-10-14T18:56:02.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.232+0000 7f90081f2700 1 -- 172.21.15.79:0/3247946494 wait complete. 2023-10-14T18:56:02.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T18:56:02.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.359+0000 7f0c97d4f700 1 Processor -- start 2023-10-14T18:56:02.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 -- start start 2023-10-14T18:56:02.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c900cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c900cbd40 0x7f0c90067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c9006c630 0x7f0c90067ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900cb370 con 0x7f0c900cbd40 2023-10-14T18:56:02.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c900b0c60 con 0x7f0c9006c630 2023-10-14T18:56:02.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c97d4f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9006a1e0 con 0x7f0c900b0890 2023-10-14T18:56:02.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c952ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c900cbd40 0x7f0c90067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c952ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c900cbd40 0x7f0c90067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53088/0 (socket says 172.21.15.79:53088) 2023-10-14T18:56:02.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.360+0000 7f0c952ea700 1 -- 172.21.15.79:0/862515048 learned_addr learned my addr 172.21.15.79:0/862515048 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:02.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c962ec700 1 --2- 172.21.15.79:0/862515048 >> v2:172.21.15.144:3300/0 conn(0x7f0c9006c630 0x7f0c90067ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c95aeb700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c900cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 -- 172.21.15.79:0/862515048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 msgr2=0x7f0c900cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c900cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 -- 172.21.15.79:0/862515048 >> v2:172.21.15.144:3300/0 conn(0x7f0c9006c630 msgr2=0x7f0c90067ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 --2- 172.21.15.79:0/862515048 >> v2:172.21.15.144:3300/0 conn(0x7f0c9006c630 0x7f0c90067ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 -- 172.21.15.79:0/862515048 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9006cb80 con 0x7f0c900cbd40 2023-10-14T18:56:02.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c952ea700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c900cbd40 0x7f0c90067660 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0c90071430 tx=0x7f0c84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbcfd78ee57e8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c94ae9700 1 -- 172.21.15.79:0/862515048 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400b860 con 0x7f0c900cbd40 2023-10-14T18:56:02.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c94ae9700 1 -- 172.21.15.79:0/862515048 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400b9c0 con 0x7f0c900cbd40 2023-10-14T18:56:02.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c94ae9700 1 -- 172.21.15.79:0/862515048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400bd60 con 0x7f0c900cbd40 2023-10-14T18:56:02.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c97d4f700 1 -- 172.21.15.79:0/862515048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c900cbd40 msgr2=0x7f0c90067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.361+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c900cbd40 0x7f0c90067660 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0c90071430 tx=0x7f0c84009250 comp rx=0 tx=0).stop 2023-10-14T18:56:02.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 -- 172.21.15.79:0/862515048 shutdown_connections 2023-10-14T18:56:02.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c900cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/862515048 >> v2:172.21.15.144:3300/0 conn(0x7f0c9006c630 0x7f0c90067ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/862515048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c900cbd40 0x7f0c90067660 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 -- 172.21.15.79:0/862515048 >> 172.21.15.79:0/862515048 conn(0x7f0c9006fe50 msgr2=0x7f0c90069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:02.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 -- 172.21.15.79:0/862515048 shutdown_connections 2023-10-14T18:56:02.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.362+0000 7f0c97d4f700 1 -- 172.21.15.79:0/862515048 wait complete. 2023-10-14T18:56:02.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 Processor -- start 2023-10-14T18:56:02.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 -- start start 2023-10-14T18:56:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c9014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 0x7f0c900ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9016a770 con 0x7f0c9006c630 2023-10-14T18:56:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9016aa50 con 0x7f0c900cbd40 2023-10-14T18:56:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c97d4f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9016ad30 con 0x7f0c900b0890 2023-10-14T18:56:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c95aeb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.363+0000 7f0c95aeb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53098/0 (socket says 172.21.15.79:53098) 2023-10-14T18:56:02.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 -- 172.21.15.79:0/1974042916 learned_addr learned my addr 172.21.15.79:0/1974042916 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c962ec700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 0x7f0c900ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c952ea700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c9014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 -- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 msgr2=0x7f0c9014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c9014df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 -- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 msgr2=0x7f0c900ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 0x7f0c900ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 -- 172.21.15.79:0/1974042916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840094f0 con 0x7f0c9006c630 2023-10-14T18:56:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c962ec700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 0x7f0c900ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:02.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c95aeb700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e190 tx=0x7f0c80009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8000ee30 con 0x7f0c9006c630 2023-10-14T18:56:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80014420 con 0x7f0c9006c630 2023-10-14T18:56:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9016b010 con 0x7f0c9006c630 2023-10-14T18:56:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c800147e0 con 0x7f0c9006c630 2023-10-14T18:56:02.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.364+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9016a320 con 0x7f0c9006c630 2023-10-14T18:56:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.365+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9016a540 con 0x7f0c9006c630 2023-10-14T18:56:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.366+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c80014b90 con 0x7f0c9006c630 2023-10-14T18:56:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.366+0000 7f0c8dffb700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 0x7f0c7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.366+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0c80084a40 con 0x7f0c9006c630 2023-10-14T18:56:02.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.366+0000 7f0c952ea700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 0x7f0c7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.367+0000 7f0c952ea700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 0x7f0c7c0693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0c90071430 tx=0x7f0c84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.370+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c80086e60 con 0x7f0c9006c630 2023-10-14T18:56:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.553+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0c900b1b00 con 0x7f0c9006c630 2023-10-14T18:56:02.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.553+0000 7f0c8dffb700 1 -- 172.21.15.79:0/1974042916 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v182) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0c80052000 con 0x7f0c9006c630 2023-10-14T18:56:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-14T18:56:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-14T18:56:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-14T18:56:02.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-14T18:56:02.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 msgr2=0x7f0c7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 0x7f0c7c0693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0c90071430 tx=0x7f0c84017000 comp rx=0 tx=0).stop 2023-10-14T18:56:02.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 msgr2=0x7f0c900b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000e190 tx=0x7f0c80009920 comp rx=0 tx=0).stop 2023-10-14T18:56:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 shutdown_connections 2023-10-14T18:56:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0c7c066f30 0x7f0c7c0693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c900cbd40 0x7f0c900ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c9006c630 0x7f0c900b2d20 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 --2- 172.21.15.79:0/1974042916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0c900b0890 0x7f0c9014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 >> 172.21.15.79:0/1974042916 conn(0x7f0c9006fe50 msgr2=0x7f0c9015c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 shutdown_connections 2023-10-14T18:56:02.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.555+0000 7f0c97d4f700 1 -- 172.21.15.79:0/1974042916 wait complete. 2023-10-14T18:56:02.568 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T18:56:02.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T18:56:02.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.687+0000 7f5d7c8a3700 1 Processor -- start 2023-10-14T18:56:02.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.687+0000 7f5d7c8a3700 1 -- start start 2023-10-14T18:56:02.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7c8a3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d780b6a10 0x7f5d7815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7c8a3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780b17b0 con 0x7f5d78159ef0 2023-10-14T18:56:02.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7c8a3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780b1a60 con 0x7f5d780b46f0 2023-10-14T18:56:02.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7c8a3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780b1d40 con 0x7f5d780b6a10 2023-10-14T18:56:02.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5d78159ef0 0x7f5d780b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40656/0 (socket says 172.21.15.79:40656) 2023-10-14T18:56:02.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.688+0000 7f5d7659c700 1 -- 172.21.15.79:0/2214682619 learned_addr learned my addr 172.21.15.79:0/2214682619 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2214682619 >> v2:172.21.15.144:3300/0 conn(0x7f5d780b6a10 0x7f5d7815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530201716 0 0) 0x7f5d780b17b0 con 0x7f5d78159ef0 2023-10-14T18:56:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d64003570 con 0x7f5d78159ef0 2023-10-14T18:56:02.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1684964306 0 0) 0x7f5d64003570 con 0x7f5d78159ef0 2023-10-14T18:56:02.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 >> v2:172.21.15.144:3300/0 conn(0x7f5d780b6a10 msgr2=0x7f5d7815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 --2- 172.21.15.79:0/2214682619 >> v2:172.21.15.144:3300/0 conn(0x7f5d780b6a10 0x7f5d7815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 >> v1:172.21.15.144:6789/0 conn(0x7f5d780b46f0 legacy=0x7f5d780b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780b2020 con 0x7f5d78159ef0 2023-10-14T18:56:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f5d68001970 con 0x7f5d78159ef0 2023-10-14T18:56:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 >> v1:172.21.15.79:6789/0 conn(0x7f5d78159ef0 legacy=0x7f5d780b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d64003a60 0x7f5d64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 0x7f5d64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d640051c0 0x7f5d6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780b1d40 con 0x7f5d64004810 2023-10-14T18:56:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6400c0d0 con 0x7f5d64003a60 2023-10-14T18:56:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6400c290 con 0x7f5d640051c0 2023-10-14T18:56:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 0x7f5d64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d7659c700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d64003a60 0x7f5d64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d76d9d700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d640051c0 0x7f5d6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 -- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d640051c0 msgr2=0x7f5d6400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d640051c0 0x7f5d6400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 -- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d64003a60 msgr2=0x7f5d64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.689+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d64003a60 0x7f5d64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d75d9b700 1 -- 172.21.15.79:0/2214682619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64003570 con 0x7f5d64004810 2023-10-14T18:56:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d76d9d700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d640051c0 0x7f5d6400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d76d9d700 1 -- 172.21.15.79:0/2214682619 reap_dead start 2023-10-14T18:56:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 0x7f5d64004c80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5d780b6e10 tx=0x7f5d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4bef77557f76cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6000e710 con 0x7f5d64004810 2023-10-14T18:56:02.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6000e870 con 0x7f5d64004810 2023-10-14T18:56:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7559a700 1 -- 172.21.15.79:0/2214682619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6000ec30 con 0x7f5d64004810 2023-10-14T18:56:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 msgr2=0x7f5d64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 0x7f5d64004c80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5d780b6e10 tx=0x7f5d600091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2214682619 shutdown_connections 2023-10-14T18:56:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2214682619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d64004810 0x7f5d64004c80 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2214682619 >> 172.21.15.79:0/2214682619 conn(0x7f5d7809a0a0 msgr2=0x7f5d78067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2214682619 shutdown_connections 2023-10-14T18:56:02.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.690+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2214682619 wait complete. 2023-10-14T18:56:02.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.691+0000 7f5d7c8a3700 1 Processor -- start 2023-10-14T18:56:02.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.691+0000 7f5d7c8a3700 1 -- start start 2023-10-14T18:56:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 0x7f5d78156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d780af240 0x7f5d780ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780b0230 con 0x7f5d780af6b0 2023-10-14T18:56:02.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780afc70 con 0x7f5d780af240 2023-10-14T18:56:02.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7c8a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780aff50 con 0x7f5d64004810 2023-10-14T18:56:02.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53124/0 (socket says 172.21.15.79:53124) 2023-10-14T18:56:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 -- 172.21.15.79:0/2862986116 learned_addr learned my addr 172.21.15.79:0/2862986116 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d75d9b700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d780af240 0x7f5d780ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7659c700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 0x7f5d78156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 -- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 msgr2=0x7f5d78156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 0x7f5d78156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 -- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d780af240 msgr2=0x7f5d780ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:02.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d780af240 0x7f5d780ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:02.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d76d9d700 1 -- 172.21.15.79:0/2862986116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7809cc10 con 0x7f5d780af6b0 2023-10-14T18:56:02.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.692+0000 7f5d7659c700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 0x7f5d78156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:02.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d76d9d700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5d780b3940 tx=0x7f5d70009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70014480 con 0x7f5d780af6b0 2023-10-14T18:56:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70014600 con 0x7f5d780af6b0 2023-10-14T18:56:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7809cef0 con 0x7f5d780af6b0 2023-10-14T18:56:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700149c0 con 0x7f5d780af6b0 2023-10-14T18:56:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.693+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d781565a0 con 0x7f5d780af6b0 2023-10-14T18:56:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.694+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7809d0e0 con 0x7f5d780af6b0 2023-10-14T18:56:02.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.694+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d700133e0 con 0x7f5d780af6b0 2023-10-14T18:56:02.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.694+0000 7f5d6e7fc700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 0x7f5d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:02.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.695+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5d70083c90 con 0x7f5d780af6b0 2023-10-14T18:56:02.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.695+0000 7f5d7659c700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 0x7f5d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:02.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.695+0000 7f5d7659c700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 0x7f5d580693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5d68001270 tx=0x7f5d68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:02.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.699+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d70051250 con 0x7f5d780af6b0 2023-10-14T18:56:02.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:02.882+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5d7804c3c0 con 0x7f5d780af6b0 2023-10-14T18:56:03.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.593+0000 7f5d6e7fc700 1 -- 172.21.15.79:0/2862986116 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v183) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5d70054870 con 0x7f5d780af6b0 2023-10-14T18:56:03.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 msgr2=0x7f5d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:03.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 0x7f5d580693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5d68001270 tx=0x7f5d68009040 comp rx=0 tx=0).stop 2023-10-14T18:56:03.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 msgr2=0x7f5d780acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:03.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5d780b3940 tx=0x7f5d70009040 comp rx=0 tx=0).stop 2023-10-14T18:56:03.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 shutdown_connections 2023-10-14T18:56:03.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5d58066f30 0x7f5d580693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d780af6b0 0x7f5d780acd70 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d64004810 0x7f5d78156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 --2- 172.21.15.79:0/2862986116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d780af240 0x7f5d780ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 >> 172.21.15.79:0/2862986116 conn(0x7f5d7809a0a0 msgr2=0x7f5d780b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:03.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 shutdown_connections 2023-10-14T18:56:03.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.596+0000 7f5d7c8a3700 1 -- 172.21.15.79:0/2862986116 wait complete. 2023-10-14T18:56:03.600 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-14T18:56:03.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T18:56:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.733+0000 7f444a4a3700 1 Processor -- start 2023-10-14T18:56:03.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.733+0000 7f444a4a3700 1 -- start start 2023-10-14T18:56:03.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 0x7f4444068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4444141780 0x7f4444070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f444406e2e0 0x7f4444070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444406e8a0 con 0x7f444406e2e0 2023-10-14T18:56:03.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444406eb80 con 0x7f4444141780 2023-10-14T18:56:03.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f444a4a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444406ee60 con 0x7f44441413b0 2023-10-14T18:56:03.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f4448a40700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f444406e2e0 0x7f4444070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f4448a40700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f444406e2e0 0x7f4444070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53128/0 (socket says 172.21.15.79:53128) 2023-10-14T18:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f4448a40700 1 -- 172.21.15.79:0/2709814153 learned_addr learned my addr 172.21.15.79:0/2709814153 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.734+0000 7f44437fe700 1 --2- 172.21.15.79:0/2709814153 >> v2:172.21.15.144:3300/0 conn(0x7f4444141780 0x7f4444070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4443fff700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 0x7f4444068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 -- 172.21.15.79:0/2709814153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 msgr2=0x7f4444068a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:03.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 0x7f4444068a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 -- 172.21.15.79:0/2709814153 >> v2:172.21.15.144:3300/0 conn(0x7f4444141780 msgr2=0x7f4444070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:03.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 --2- 172.21.15.79:0/2709814153 >> v2:172.21.15.144:3300/0 conn(0x7f4444141780 0x7f4444070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 -- 172.21.15.79:0/2709814153 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444406f140 con 0x7f444406e2e0 2023-10-14T18:56:03.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4443fff700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 0x7f4444068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:03.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4448a40700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f444406e2e0 0x7f4444070c40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f44440cd930 tx=0x7f443c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebd51246342e913 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:03.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4442ffd700 1 -- 172.21.15.79:0/2709814153 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00e070 con 0x7f444406e2e0 2023-10-14T18:56:03.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4442ffd700 1 -- 172.21.15.79:0/2709814153 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c00ba50 con 0x7f444406e2e0 2023-10-14T18:56:03.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f4442ffd700 1 -- 172.21.15.79:0/2709814153 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c0092e0 con 0x7f444406e2e0 2023-10-14T18:56:03.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 -- 172.21.15.79:0/2709814153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f444406e2e0 msgr2=0x7f4444070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f444406e2e0 0x7f4444070c40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f44440cd930 tx=0x7f443c009840 comp rx=0 tx=0).stop 2023-10-14T18:56:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 -- 172.21.15.79:0/2709814153 shutdown_connections 2023-10-14T18:56:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f44441413b0 0x7f4444068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 --2- 172.21.15.79:0/2709814153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f444406e2e0 0x7f4444070c40 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 --2- 172.21.15.79:0/2709814153 >> v2:172.21.15.144:3300/0 conn(0x7f4444141780 0x7f4444070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 -- 172.21.15.79:0/2709814153 >> 172.21.15.79:0/2709814153 conn(0x7f44440ce570 msgr2=0x7f44440ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 -- 172.21.15.79:0/2709814153 shutdown_connections 2023-10-14T18:56:03.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.735+0000 7f444a4a3700 1 -- 172.21.15.79:0/2709814153 wait complete. 2023-10-14T18:56:03.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.736+0000 7f444a4a3700 1 Processor -- start 2023-10-14T18:56:03.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 -- start start 2023-10-14T18:56:03.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 0x7f4444139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 0x7f444413b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444413be60 con 0x7f44441413b0 2023-10-14T18:56:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44440c4cf0 con 0x7f4444141780 2023-10-14T18:56:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f444a4a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4444156640 con 0x7f444406e2e0 2023-10-14T18:56:03.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f44437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.737+0000 7f44437fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53140/0 (socket says 172.21.15.79:53140) 2023-10-14T18:56:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 -- 172.21.15.79:0/4030802778 learned_addr learned my addr 172.21.15.79:0/4030802778 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f4448a40700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 0x7f444413b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f4443fff700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 0x7f4444139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 -- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 msgr2=0x7f4444139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 0x7f4444139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 -- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 msgr2=0x7f444413b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 0x7f444413b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 -- 172.21.15.79:0/4030802778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009ae0 con 0x7f44441413b0 2023-10-14T18:56:03.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f4443fff700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 0x7f4444139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f4448a40700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 0x7f444413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f44437fe700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f443800d860 tx=0x7f4438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:03.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438009610 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438009770 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4444136f20 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438009b30 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.738+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44441562d0 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.739+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44441567d0 con 0x7f44441413b0 2023-10-14T18:56:03.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.739+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f443801e460 con 0x7f44441413b0 2023-10-14T18:56:03.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.740+0000 7f442bfff700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 0x7f44300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:03.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.740+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f44380849c0 con 0x7f44441413b0 2023-10-14T18:56:03.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.740+0000 7f4443fff700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 0x7f44300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:03.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.740+0000 7f4443fff700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 0x7f44300693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f443400ac10 tx=0x7f4434006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:03.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.744+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4438051e10 con 0x7f44441413b0 2023-10-14T18:56:03.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:03.926+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f444404c3c0 con 0x7f44441413b0 2023-10-14T18:56:04.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.599+0000 7f442bfff700 1 -- 172.21.15.79:0/4030802778 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v184) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4438055430 con 0x7f44441413b0 2023-10-14T18:56:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 msgr2=0x7f44300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 0x7f44300693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f443400ac10 tx=0x7f4434006f90 comp rx=0 tx=0).stop 2023-10-14T18:56:04.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 msgr2=0x7f4444155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f443800d860 tx=0x7f4438008040 comp rx=0 tx=0).stop 2023-10-14T18:56:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 shutdown_connections 2023-10-14T18:56:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4430066f30 0x7f44300693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4444141780 0x7f444413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f444406e2e0 0x7f4444139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 --2- 172.21.15.79:0/4030802778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44441413b0 0x7f4444155910 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.608+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 >> 172.21.15.79:0/4030802778 conn(0x7f44440ce570 msgr2=0x7f44441403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.609+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 shutdown_connections 2023-10-14T18:56:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.609+0000 7f444a4a3700 1 -- 172.21.15.79:0/4030802778 wait complete. 2023-10-14T18:56:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-14T18:56:04.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T18:56:04.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.740+0000 7f4920e03700 1 Processor -- start 2023-10-14T18:56:04.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 -- start start 2023-10-14T18:56:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0cce30 0x7f491c15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c06aa00 0x7f491c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0b4d70 con 0x7f491c0b6580 2023-10-14T18:56:04.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0cd8d0 con 0x7f491c06aa00 2023-10-14T18:56:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f4920e03700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b4440 con 0x7f491c0cce30 2023-10-14T18:56:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.741+0000 7f491bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c06aa00 0x7f491c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f491c06aa00 0x7f491c0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53148/0 (socket says 172.21.15.79:53148) 2023-10-14T18:56:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 -- 172.21.15.79:0/1947392517 learned_addr learned my addr 172.21.15.79:0/1947392517 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:04.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 -- 172.21.15.79:0/1947392517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0cce30 msgr2=0x7f491c15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 --2- 172.21.15.79:0/1947392517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0cce30 0x7f491c15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 -- 172.21.15.79:0/1947392517 >> v1:172.21.15.144:6789/0 conn(0x7f491c0b6580 legacy=0x7f491c06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 -- 172.21.15.79:0/1947392517 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0b4720 con 0x7f491c06aa00 2023-10-14T18:56:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491bfff700 1 --2- 172.21.15.79:0/1947392517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c06aa00 0x7f491c0b5200 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4914009f20 tx=0x7f4914009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6c075f9f01b790 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:04.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491affd700 1 -- 172.21.15.79:0/1947392517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400e070 con 0x7f491c06aa00 2023-10-14T18:56:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491affd700 1 -- 172.21.15.79:0/1947392517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400ba40 con 0x7f491c06aa00 2023-10-14T18:56:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.742+0000 7f491affd700 1 -- 172.21.15.79:0/1947392517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140092e0 con 0x7f491c06aa00 2023-10-14T18:56:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 -- 172.21.15.79:0/1947392517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c06aa00 msgr2=0x7f491c0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:04.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 --2- 172.21.15.79:0/1947392517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c06aa00 0x7f491c0b5200 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f4914009f20 tx=0x7f4914009840 comp rx=0 tx=0).stop 2023-10-14T18:56:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 -- 172.21.15.79:0/1947392517 shutdown_connections 2023-10-14T18:56:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 --2- 172.21.15.79:0/1947392517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c06aa00 0x7f491c0b5200 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 --2- 172.21.15.79:0/1947392517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0cce30 0x7f491c15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 -- 172.21.15.79:0/1947392517 >> 172.21.15.79:0/1947392517 conn(0x7f491c068cb0 msgr2=0x7f491c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:04.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 -- 172.21.15.79:0/1947392517 shutdown_connections 2023-10-14T18:56:04.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.743+0000 7f4920e03700 1 -- 172.21.15.79:0/1947392517 wait complete. 2023-10-14T18:56:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.744+0000 7f4920e03700 1 Processor -- start 2023-10-14T18:56:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.744+0000 7f4920e03700 1 -- start start 2023-10-14T18:56:04.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c06aa00 0x7f491c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0b6580 0x7f491c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c152770 con 0x7f491c0cce30 2023-10-14T18:56:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c152a50 con 0x7f491c06aa00 2023-10-14T18:56:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c154a10 con 0x7f491c0b6580 2023-10-14T18:56:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53154/0 (socket says 172.21.15.79:53154) 2023-10-14T18:56:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 -- 172.21.15.79:0/1534054503 learned_addr learned my addr 172.21.15.79:0/1534054503 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4912ffd700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0b6580 0x7f491c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:04.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491b7fe700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c06aa00 0x7f491c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 -- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0b6580 msgr2=0x7f491c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0b6580 0x7f491c156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 -- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c06aa00 msgr2=0x7f491c150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c06aa00 0x7f491c150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:04.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 -- 172.21.15.79:0/1534054503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914009ae0 con 0x7f491c0cce30 2023-10-14T18:56:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f491bfff700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4914009880 tx=0x7f4914017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140092e0 con 0x7f491c0cce30 2023-10-14T18:56:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914012d00 con 0x7f491c0cce30 2023-10-14T18:56:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c154cf0 con 0x7f491c0cce30 2023-10-14T18:56:04.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491401e680 con 0x7f491c0cce30 2023-10-14T18:56:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.745+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c153f90 con 0x7f491c0cce30 2023-10-14T18:56:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.746+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c154180 con 0x7f491c0cce30 2023-10-14T18:56:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.747+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f491401e9f0 con 0x7f491c0cce30 2023-10-14T18:56:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.747+0000 7f4913fff700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:04.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.747+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4914085fc0 con 0x7f491c0cce30 2023-10-14T18:56:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.747+0000 7f491b7fe700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.748+0000 7f491b7fe700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f490c009b40 tx=0x7f490c0090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:04.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.752+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49140b75a0 con 0x7f491c0cce30 2023-10-14T18:56:04.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:04.980+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f491c152c90 con 0x7f491c0cce30 2023-10-14T18:56:05.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.612+0000 7f4913fff700 1 -- 172.21.15.79:0/1534054503 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v84) v1 ==== 174+0+0 (secure 0 0 0) 0x7f491c152c90 con 0x7f491c0cce30 2023-10-14T18:56:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 msgr2=0x7f48fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 0x7f48fc0693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f490c009b40 tx=0x7f490c0090f0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 msgr2=0x7f491c157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f4914009880 tx=0x7f4914017000 comp rx=0 tx=0).stop 2023-10-14T18:56:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 shutdown_connections 2023-10-14T18:56:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f48fc066f30 0x7f48fc0693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f491c0cce30 0x7f491c157010 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491c06aa00 0x7f491c150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 --2- 172.21.15.79:0/1534054503 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f491c0b6580 0x7f491c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 >> 172.21.15.79:0/1534054503 conn(0x7f491c068cb0 msgr2=0x7f491c0b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.615+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 shutdown_connections 2023-10-14T18:56:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.616+0000 7f4920e03700 1 -- 172.21.15.79:0/1534054503 wait complete. 2023-10-14T18:56:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 22 and data pool 23 2023-10-14T18:56:05.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:05.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.743+0000 7fd88c8df700 1 Processor -- start 2023-10-14T18:56:05.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.743+0000 7fd88c8df700 1 -- start start 2023-10-14T18:56:05.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd88c8df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd888157e60 0x7fd8880b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:05.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd88c8df700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880cb0b0 con 0x7fd888157a90 2023-10-14T18:56:05.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd88c8df700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880b0830 con 0x7fd88806fef0 2023-10-14T18:56:05.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd88c8df700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880b0ad0 con 0x7fd888157e60 2023-10-14T18:56:05.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd87ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd888157e60 0x7fd8880b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:05.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd886d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd888157a90 0x7fd8880b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40664/0 (socket says 172.21.15.79:40664) 2023-10-14T18:56:05.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd886d9d700 1 -- 172.21.15.79:0/1216281461 learned_addr learned my addr 172.21.15.79:0/1216281461 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:05.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd87ffff700 1 -- 172.21.15.79:0/1216281461 >> v1:172.21.15.144:6789/0 conn(0x7fd88806fef0 legacy=0x7fd8880ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:05.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd87ffff700 1 -- 172.21.15.79:0/1216281461 >> v1:172.21.15.79:6789/0 conn(0x7fd888157a90 legacy=0x7fd8880b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd87ffff700 1 -- 172.21.15.79:0/1216281461 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880ca780 con 0x7fd888157e60 2023-10-14T18:56:05.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.744+0000 7fd88659c700 1 -- 172.21.15.79:0/1216281461 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718412898 0 0) 0x7fd8880cb0b0 con 0x7fd888157a90 2023-10-14T18:56:05.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd87ffff700 1 --2- 172.21.15.79:0/1216281461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157e60 0x7fd8880b1790 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fd8700098e0 tx=0x7fd8700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bece32e8abc3e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:05.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88659c700 1 -- 172.21.15.79:0/1216281461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870009e80 con 0x7fd888157e60 2023-10-14T18:56:05.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88659c700 1 -- 172.21.15.79:0/1216281461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87000b820 con 0x7fd888157e60 2023-10-14T18:56:05.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88659c700 1 -- 172.21.15.79:0/1216281461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000bba0 con 0x7fd888157e60 2023-10-14T18:56:05.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 -- 172.21.15.79:0/1216281461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157e60 msgr2=0x7fd8880b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1216281461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157e60 0x7fd8880b1790 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fd8700098e0 tx=0x7fd8700091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 -- 172.21.15.79:0/1216281461 shutdown_connections 2023-10-14T18:56:05.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1216281461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157e60 0x7fd8880b1790 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 -- 172.21.15.79:0/1216281461 >> 172.21.15.79:0/1216281461 conn(0x7fd88806bc70 msgr2=0x7fd88806c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:05.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 -- 172.21.15.79:0/1216281461 shutdown_connections 2023-10-14T18:56:05.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.745+0000 7fd88c8df700 1 -- 172.21.15.79:0/1216281461 wait complete. 2023-10-14T18:56:05.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.746+0000 7fd88c8df700 1 Processor -- start 2023-10-14T18:56:05.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.746+0000 7fd88c8df700 1 -- start start 2023-10-14T18:56:05.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd88806fef0 0x7fd8880cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:05.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:05.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd888157e60 0x7fd888153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:05.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b20d0 con 0x7fd888157a90 2023-10-14T18:56:05.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b23b0 con 0x7fd88806fef0 2023-10-14T18:56:05.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88c8df700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880b2690 con 0x7fd888157e60 2023-10-14T18:56:05.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:05.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53174/0 (socket says 172.21.15.79:53174) 2023-10-14T18:56:05.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 -- 172.21.15.79:0/1213187957 learned_addr learned my addr 172.21.15.79:0/1213187957 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:05.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd886d9d700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd88806fef0 0x7fd8880cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:05.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd88759e700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd888157e60 0x7fd888153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:05.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 -- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd888157e60 msgr2=0x7fd888153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd888157e60 0x7fd888153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 -- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd88806fef0 msgr2=0x7fd8880cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd88806fef0 0x7fd8880cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.747+0000 7fd87ffff700 1 -- 172.21.15.79:0/1213187957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009420 con 0x7fd888157a90 2023-10-14T18:56:05.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd87ffff700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fd8700030c0 tx=0x7fd870016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:05.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87000b990 con 0x7fd888157a90 2023-10-14T18:56:05.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd870020070 con 0x7fd888157a90 2023-10-14T18:56:05.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87001b6a0 con 0x7fd888157a90 2023-10-14T18:56:05.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880b2970 con 0x7fd888157a90 2023-10-14T18:56:05.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.748+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880b3150 con 0x7fd888157a90 2023-10-14T18:56:05.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.749+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8880b2e10 con 0x7fd888157a90 2023-10-14T18:56:05.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.749+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd870022030 con 0x7fd888157a90 2023-10-14T18:56:05.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.749+0000 7fd87effd700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.749+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8700863a0 con 0x7fd888157a90 2023-10-14T18:56:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.750+0000 7fd886d9d700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.750+0000 7fd886d9d700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd878007fd0 tx=0x7fd878007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:05.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.754+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd870053610 con 0x7fd888157a90 2023-10-14T18:56:05.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.937+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8880b2e10 con 0x7fd888157a90 2023-10-14T18:56:05.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.937+0000 7fd87effd700 1 -- 172.21.15.79:0/1213187957 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fd870056c30 con 0x7fd888157a90 2023-10-14T18:56:05.938 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:05.939 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":185,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:04.981909+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:05.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 msgr2=0x7fd8680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 0x7fd8680693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd878007fd0 tx=0x7fd878007d30 comp rx=0 tx=0).stop 2023-10-14T18:56:05.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 msgr2=0x7fd8881557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:05.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fd8700030c0 tx=0x7fd870016000 comp rx=0 tx=0).stop 2023-10-14T18:56:05.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 shutdown_connections 2023-10-14T18:56:05.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd868066f30 0x7fd8680693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd888157e60 0x7fd888153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd88806fef0 0x7fd8880cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 --2- 172.21.15.79:0/1213187957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd888157a90 0x7fd8881557b0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:05.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 >> 172.21.15.79:0/1213187957 conn(0x7fd88806bc70 msgr2=0x7fd8881534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:05.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 shutdown_connections 2023-10-14T18:56:05.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:05.939+0000 7fd88c8df700 1 -- 172.21.15.79:0/1213187957 wait complete. 2023-10-14T18:56:05.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:06.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.067+0000 7f952759e700 1 Processor -- start 2023-10-14T18:56:06.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.067+0000 7f952759e700 1 -- start start 2023-10-14T18:56:06.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952759e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f95280cd6e0 0x7f95280cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952759e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280cb7c0 con 0x7f952815cbd0 2023-10-14T18:56:06.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952759e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952815e290 con 0x7f95280cdab0 2023-10-14T18:56:06.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952759e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952815e850 con 0x7f95280cd6e0 2023-10-14T18:56:06.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f9526d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f952815cbd0 0x7f952815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40666/0 (socket says 172.21.15.79:40666) 2023-10-14T18:56:06.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f9526d9d700 1 -- 172.21.15.79:0/2055038075 learned_addr learned my addr 172.21.15.79:0/2055038075 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:06.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952659c700 1 --2- 172.21.15.79:0/2055038075 >> v2:172.21.15.144:3300/0 conn(0x7f95280cd6e0 0x7f95280cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952559a700 1 -- 172.21.15.79:0/2055038075 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789608811 0 0) 0x7f95280cb7c0 con 0x7f952815cbd0 2023-10-14T18:56:06.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952559a700 1 -- 172.21.15.79:0/2055038075 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9514003570 con 0x7f952815cbd0 2023-10-14T18:56:06.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.068+0000 7f952659c700 1 -- 172.21.15.79:0/2055038075 >> v1:172.21.15.144:6789/0 conn(0x7f95280cdab0 legacy=0x7f952815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952659c700 1 -- 172.21.15.79:0/2055038075 >> v1:172.21.15.79:6789/0 conn(0x7f952815cbd0 legacy=0x7f952815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952659c700 1 -- 172.21.15.79:0/2055038075 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952815e570 con 0x7f95280cd6e0 2023-10-14T18:56:06.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952659c700 1 --2- 172.21.15.79:0/2055038075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280cbc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9518009e60 tx=0x7f9518009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623a0c8b9934afd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952559a700 1 -- 172.21.15.79:0/2055038075 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800e070 con 0x7f95280cd6e0 2023-10-14T18:56:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952559a700 1 -- 172.21.15.79:0/2055038075 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800bb60 con 0x7f95280cd6e0 2023-10-14T18:56:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952559a700 1 -- 172.21.15.79:0/2055038075 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518012430 con 0x7f95280cd6e0 2023-10-14T18:56:06.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952759e700 1 -- 172.21.15.79:0/2055038075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 msgr2=0x7f95280cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952759e700 1 --2- 172.21.15.79:0/2055038075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280cbc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9518009e60 tx=0x7f9518009780 comp rx=0 tx=0).stop 2023-10-14T18:56:06.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.069+0000 7f952759e700 1 -- 172.21.15.79:0/2055038075 shutdown_connections 2023-10-14T18:56:06.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.070+0000 7f952759e700 1 --2- 172.21.15.79:0/2055038075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280cbc50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.070+0000 7f952759e700 1 -- 172.21.15.79:0/2055038075 >> 172.21.15.79:0/2055038075 conn(0x7f9528067660 msgr2=0x7f9528067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:06.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.070+0000 7f952759e700 1 -- 172.21.15.79:0/2055038075 shutdown_connections 2023-10-14T18:56:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.070+0000 7f952759e700 1 -- 172.21.15.79:0/2055038075 wait complete. 2023-10-14T18:56:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 Processor -- start 2023-10-14T18:56:06.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 -- start start 2023-10-14T18:56:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815cbd0 0x7f95280c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c7e30 con 0x7f95280cdab0 2023-10-14T18:56:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c8110 con 0x7f95280cd6e0 2023-10-14T18:56:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f952759e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280c83f0 con 0x7f952815cbd0 2023-10-14T18:56:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f9525d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f9525d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53182/0 (socket says 172.21.15.79:53182) 2023-10-14T18:56:06.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.071+0000 7f9525d9b700 1 -- 172.21.15.79:0/2587634790 learned_addr learned my addr 172.21.15.79:0/2587634790 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:06.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 -- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815cbd0 msgr2=0x7f95280c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815cbd0 0x7f95280c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f952659c700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 -- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 msgr2=0x7f95280b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 -- 172.21.15.79:0/2587634790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009a20 con 0x7f95280cdab0 2023-10-14T18:56:06.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f9525d9b700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f951000c590 tx=0x7f951000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510011590 con 0x7f95280cdab0 2023-10-14T18:56:06.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100116f0 con 0x7f95280cdab0 2023-10-14T18:56:06.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95280c86d0 con 0x7f95280cdab0 2023-10-14T18:56:06.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510011ab0 con 0x7f95280cdab0 2023-10-14T18:56:06.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.072+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95280c8ed0 con 0x7f95280cdab0 2023-10-14T18:56:06.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.073+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9528089280 con 0x7f95280cdab0 2023-10-14T18:56:06.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.073+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f951001b3b0 con 0x7f95280cdab0 2023-10-14T18:56:06.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.074+0000 7f951e7fc700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.074+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9510083a90 con 0x7f95280cdab0 2023-10-14T18:56:06.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.074+0000 7f952659c700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.074+0000 7f952659c700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f95180097c0 tx=0x7f9518019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.078+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9510050d00 con 0x7f95280cdab0 2023-10-14T18:56:06.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.261+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f952804bb80 con 0x7f95280cdab0 2023-10-14T18:56:06.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.262+0000 7f951e7fc700 1 -- 172.21.15.79:0/2587634790 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f9510017020 con 0x7f95280cdab0 2023-10-14T18:56:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:06.263 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":185,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:04.981909+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:06.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 msgr2=0x7f95080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 0x7f95080693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f95180097c0 tx=0x7f9518019000 comp rx=0 tx=0).stop 2023-10-14T18:56:06.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 msgr2=0x7f95280b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f951000c590 tx=0x7f951000c950 comp rx=0 tx=0).stop 2023-10-14T18:56:06.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 shutdown_connections 2023-10-14T18:56:06.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9508066f30 0x7f95080693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f952815cbd0 0x7f95280c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95280cd6e0 0x7f95280b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 --2- 172.21.15.79:0/2587634790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95280cdab0 0x7f95280b2840 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 >> 172.21.15.79:0/2587634790 conn(0x7f9528067660 msgr2=0x7f952814d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:06.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 shutdown_connections 2023-10-14T18:56:06.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.264+0000 7f952759e700 1 -- 172.21.15.79:0/2587634790 wait complete. 2023-10-14T18:56:06.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T18:56:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.393+0000 7f4e0f424700 1 Processor -- start 2023-10-14T18:56:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.394+0000 7f4e0f424700 1 -- start start 2023-10-14T18:56:06.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.394+0000 7f4e0f424700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e0806c380 0x7f4e0806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.394+0000 7f4e0f424700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0806f330 con 0x7f4e08156b90 2023-10-14T18:56:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.394+0000 7f4e0f424700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0806e720 con 0x7f4e08067b10 2023-10-14T18:56:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.394+0000 7f4e0f424700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0806cd60 con 0x7f4e0806c380 2023-10-14T18:56:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0c9bf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e0806c380 0x7f4e0806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0d1c0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4e08156b90 0x7f4e08157b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40668/0 (socket says 172.21.15.79:40668) 2023-10-14T18:56:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0d1c0700 1 -- 172.21.15.79:0/246879227 learned_addr learned my addr 172.21.15.79:0/246879227 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/246879227 >> v1:172.21.15.144:6789/0 conn(0x7f4e08067b10 legacy=0x7f4e08067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/246879227 >> v1:172.21.15.79:6789/0 conn(0x7f4e08156b90 legacy=0x7f4e08157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/246879227 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0806ea00 con 0x7f4e0806c380 2023-10-14T18:56:06.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4e0c9bf700 1 --2- 172.21.15.79:0/246879227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e0806c820 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170c0b73d35804d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4dfffff700 1 -- 172.21.15.79:0/246879227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8009e80 con 0x7f4e0806c380 2023-10-14T18:56:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4dfffff700 1 -- 172.21.15.79:0/246879227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b820 con 0x7f4e0806c380 2023-10-14T18:56:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.395+0000 7f4dfffff700 1 -- 172.21.15.79:0/246879227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bba0 con 0x7f4e0806c380 2023-10-14T18:56:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 -- 172.21.15.79:0/246879227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 msgr2=0x7f4e0806c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 --2- 172.21.15.79:0/246879227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e0806c820 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 -- 172.21.15.79:0/246879227 shutdown_connections 2023-10-14T18:56:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 --2- 172.21.15.79:0/246879227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e0806c820 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 -- 172.21.15.79:0/246879227 >> 172.21.15.79:0/246879227 conn(0x7f4e080cb030 msgr2=0x7f4e0806bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 -- 172.21.15.79:0/246879227 shutdown_connections 2023-10-14T18:56:06.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.396+0000 7f4e0f424700 1 -- 172.21.15.79:0/246879227 wait complete. 2023-10-14T18:56:06.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.397+0000 7f4e0f424700 1 Processor -- start 2023-10-14T18:56:06.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.397+0000 7f4e0f424700 1 -- start start 2023-10-14T18:56:06.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e08067b10 0x7f4e081496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 0x7f4e08070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08153ac0 con 0x7f4e0806c380 2023-10-14T18:56:06.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e081560b0 con 0x7f4e08156b90 2023-10-14T18:56:06.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0f424700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08153470 con 0x7f4e08067b10 2023-10-14T18:56:06.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53196/0 (socket says 172.21.15.79:53196) 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/4024307036 learned_addr learned my addr 172.21.15.79:0/4024307036 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0d9c1700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 0x7f4e08070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0d1c0700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e08067b10 0x7f4e081496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e08067b10 msgr2=0x7f4e081496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e08067b10 0x7f4e081496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 msgr2=0x7f4e08070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 0x7f4e08070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 -- 172.21.15.79:0/4024307036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009420 con 0x7f4e0806c380 2023-10-14T18:56:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0d9c1700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 0x7f4e08070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:06.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.398+0000 7f4e0c9bf700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4df80030c0 tx=0x7f4df8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.399+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bae0 con 0x7f4e0806c380 2023-10-14T18:56:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.399+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8024070 con 0x7f4e0806c380 2023-10-14T18:56:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.399+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e08153750 con 0x7f4e0806c380 2023-10-14T18:56:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.399+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8020ab0 con 0x7f4e0806c380 2023-10-14T18:56:06.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.399+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e08149c10 con 0x7f4e0806c380 2023-10-14T18:56:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.400+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e081538e0 con 0x7f4e0806c380 2023-10-14T18:56:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.400+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df8026030 con 0x7f4e0806c380 2023-10-14T18:56:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.400+0000 7f4dfd7fa700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.400+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4df808a9a0 con 0x7f4e0806c380 2023-10-14T18:56:06.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.401+0000 7f4e0d1c0700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:06.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.401+0000 7f4e0d1c0700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4e04001780 tx=0x7f4e04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:06.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.404+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df8057c10 con 0x7f4e0806c380 2023-10-14T18:56:06.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:06.631+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4e081538e0 con 0x7f4e0806c380 2023-10-14T18:56:07.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.618+0000 7f4dfd7fa700 1 -- 172.21.15.79:0/4024307036 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4df805b230 con 0x7f4e0806c380 2023-10-14T18:56:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 msgr2=0x7f4dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4e04001780 tx=0x7f4e04009040 comp rx=0 tx=0).stop 2023-10-14T18:56:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 msgr2=0x7f4e08070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f4df80030c0 tx=0x7f4df8016000 comp rx=0 tx=0).stop 2023-10-14T18:56:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 shutdown_connections 2023-10-14T18:56:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e08156b90 0x7f4e08070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e08067b10 0x7f4e081496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 --2- 172.21.15.79:0/4024307036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e0806c380 0x7f4e08070730 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 >> 172.21.15.79:0/4024307036 conn(0x7f4e080cb030 msgr2=0x7f4e080c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 shutdown_connections 2023-10-14T18:56:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.621+0000 7f4e0f424700 1 -- 172.21.15.79:0/4024307036 wait complete. 2023-10-14T18:56:07.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T18:56:07.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.758+0000 7f646106a700 1 Processor -- start 2023-10-14T18:56:07.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.758+0000 7f646106a700 1 -- start start 2023-10-14T18:56:07.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f646106a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f645c159b90 0x7f645c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f646106a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f645c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f646106a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c15de10 con 0x7f645c0c9c40 2023-10-14T18:56:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f646106a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c15e0f0 con 0x7f645c159b90 2023-10-14T18:56:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f646106a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15e3d0 con 0x7f645c159f60 2023-10-14T18:56:07.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f645b59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f645c0c9c40 0x7f645c0ca0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:40674/0 (socket says 172.21.15.79:40674) 2023-10-14T18:56:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.759+0000 7f645b59e700 1 -- 172.21.15.79:0/3996426067 learned_addr learned my addr 172.21.15.79:0/3996426067 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214262413 0 0) 0x7f645c15de10 con 0x7f645c0c9c40 2023-10-14T18:56:07.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645ad9d700 1 --2- 172.21.15.79:0/3996426067 >> v2:172.21.15.144:3300/0 conn(0x7f645c159b90 0x7f645c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6444003570 con 0x7f645c0c9c40 2023-10-14T18:56:07.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f645c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1228469139 0 0) 0x7f6444003570 con 0x7f645c0c9c40 2023-10-14T18:56:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 msgr2=0x7f645c0cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f645c0cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 >> v2:172.21.15.144:3300/0 conn(0x7f645c159b90 msgr2=0x7f645c06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:07.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 --2- 172.21.15.79:0/3996426067 >> v2:172.21.15.144:3300/0 conn(0x7f645c159b90 0x7f645c06daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c15e6b0 con 0x7f645c0c9c40 2023-10-14T18:56:07.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f6454001470 con 0x7f645c0c9c40 2023-10-14T18:56:07.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 >> v1:172.21.15.79:6789/0 conn(0x7f645c0c9c40 legacy=0x7f645c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f6444003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6444003fe0 0x7f6444004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6444004d50 0x7f64440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15e0f0 con 0x7f6444003fe0 2023-10-14T18:56:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15e3d0 con 0x7f6444004d50 2023-10-14T18:56:07.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644400bb40 con 0x7f645c159f60 2023-10-14T18:56:07.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6444003fe0 0x7f6444004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645ad9d700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f6444003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645b59e700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6444004d50 0x7f64440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 -- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 msgr2=0x7f6444003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c159f60 0x7f6444003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 -- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6444004d50 msgr2=0x7f64440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6444004d50 0x7f64440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.760+0000 7f645a59c700 1 -- 172.21.15.79:0/3996426067 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444003570 con 0x7f6444003fe0 2023-10-14T18:56:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f645a59c700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6444003fe0 0x7f6444004810 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f645000bb60 tx=0x7f6450008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5da7a125da18893 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000d5d0 con 0x7f6444003fe0 2023-10-14T18:56:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645000d730 con 0x7f6444003fe0 2023-10-14T18:56:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f6459d9b700 1 -- 172.21.15.79:0/3996426067 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645000daf0 con 0x7f6444003fe0 2023-10-14T18:56:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 -- 172.21.15.79:0/3996426067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6444003fe0 msgr2=0x7f6444004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 --2- 172.21.15.79:0/3996426067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6444003fe0 0x7f6444004810 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f645000bb60 tx=0x7f6450008040 comp rx=0 tx=0).stop 2023-10-14T18:56:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f645b59e700 1 -- 172.21.15.79:0/3996426067 reap_dead start 2023-10-14T18:56:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 -- 172.21.15.79:0/3996426067 shutdown_connections 2023-10-14T18:56:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 -- 172.21.15.79:0/3996426067 >> 172.21.15.79:0/3996426067 conn(0x7f645c067660 msgr2=0x7f645c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 -- 172.21.15.79:0/3996426067 shutdown_connections 2023-10-14T18:56:07.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.761+0000 7f646106a700 1 -- 172.21.15.79:0/3996426067 wait complete. 2023-10-14T18:56:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 Processor -- start 2023-10-14T18:56:07.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 -- start start 2023-10-14T18:56:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6444003fe0 0x7f645c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c06a1e0 0x7f645c06a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c158450 con 0x7f645c157aa0 2023-10-14T18:56:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15ab30 con 0x7f645c06a1e0 2023-10-14T18:56:07.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f646106a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c152bd0 con 0x7f6444003fe0 2023-10-14T18:56:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f645b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f645b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53216/0 (socket says 172.21.15.79:53216) 2023-10-14T18:56:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.763+0000 7f645b59e700 1 -- 172.21.15.79:0/1396046088 learned_addr learned my addr 172.21.15.79:0/1396046088 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:07.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645ad9d700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6444003fe0 0x7f645c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645a59c700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c06a1e0 0x7f645c06a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 -- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6444003fe0 msgr2=0x7f645c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6444003fe0 0x7f645c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 -- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c06a1e0 msgr2=0x7f645c06a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c06a1e0 0x7f645c06a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 -- 172.21.15.79:0/1396046088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c157160 con 0x7f645c157aa0 2023-10-14T18:56:07.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f645b59e700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f645c0685e0 tx=0x7f6454001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400f840 con 0x7f645c157aa0 2023-10-14T18:56:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400f9c0 con 0x7f645c157aa0 2023-10-14T18:56:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c06ad50 con 0x7f645c157aa0 2023-10-14T18:56:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400fd80 con 0x7f645c157aa0 2023-10-14T18:56:07.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.764+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c15a4e0 con 0x7f645c157aa0 2023-10-14T18:56:07.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.765+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c06b1f0 con 0x7f645c157aa0 2023-10-14T18:56:07.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.765+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64540135c0 con 0x7f645c157aa0 2023-10-14T18:56:07.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.766+0000 7f6442ffd700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 0x7f64480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:07.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.766+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6454084160 con 0x7f645c157aa0 2023-10-14T18:56:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.766+0000 7f645ad9d700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 0x7f64480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.766+0000 7f645ad9d700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 0x7f64480693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f644c009fd0 tx=0x7f644c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:07.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.770+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64540513d0 con 0x7f645c157aa0 2023-10-14T18:56:07.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:07.997+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f645c15ace0 con 0x7f645c157aa0 2023-10-14T18:56:08.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.623+0000 7f6442ffd700 1 -- 172.21.15.79:0/1396046088 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) v1 ==== 122+0+0 (secure 0 0 0) 0x7f645c15ace0 con 0x7f645c157aa0 2023-10-14T18:56:08.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 msgr2=0x7f64480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 0x7f64480693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f644c009fd0 tx=0x7f644c00b040 comp rx=0 tx=0).stop 2023-10-14T18:56:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 msgr2=0x7f645c157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f645c0685e0 tx=0x7f6454001e90 comp rx=0 tx=0).stop 2023-10-14T18:56:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 shutdown_connections 2023-10-14T18:56:08.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6448066f30 0x7f64480693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f645c157aa0 0x7f645c157f10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6444003fe0 0x7f645c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 --2- 172.21.15.79:0/1396046088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c06a1e0 0x7f645c06a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.625+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 >> 172.21.15.79:0/1396046088 conn(0x7f645c067660 msgr2=0x7f645c06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:08.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.626+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 shutdown_connections 2023-10-14T18:56:08.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.626+0000 7f646106a700 1 -- 172.21.15.79:0/1396046088 wait complete. 2023-10-14T18:56:08.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.752+0000 7fa10d725700 1 Processor -- start 2023-10-14T18:56:08.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.752+0000 7fa10d725700 1 -- start start 2023-10-14T18:56:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa10d725700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa108068d80 0x7fa1080b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa10d725700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080b3290 con 0x7fa1080b2980 2023-10-14T18:56:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa10d725700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa108158da0 con 0x7fa10815c2f0 2023-10-14T18:56:08.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa10d725700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa108159080 con 0x7fa108068d80 2023-10-14T18:56:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa106ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa1080b2980 0x7fa108068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49144/0 (socket says 172.21.15.79:49144) 2023-10-14T18:56:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa106ffd700 1 -- 172.21.15.79:0/2152569545 learned_addr learned my addr 172.21.15.79:0/2152569545 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113445494 0 0) 0x7fa1080b3290 con 0x7fa1080b2980 2023-10-14T18:56:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f0003570 con 0x7fa1080b2980 2023-10-14T18:56:08.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.753+0000 7fa1067fc700 1 --2- 172.21.15.79:0/2152569545 >> v2:172.21.15.144:3300/0 conn(0x7fa108068d80 0x7fa1080b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762855281 0 0) 0x7fa0f0003570 con 0x7fa1080b2980 2023-10-14T18:56:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 >> v2:172.21.15.144:3300/0 conn(0x7fa108068d80 msgr2=0x7fa1080b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 --2- 172.21.15.79:0/2152569545 >> v2:172.21.15.144:3300/0 conn(0x7fa108068d80 0x7fa1080b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 >> v1:172.21.15.144:6789/0 conn(0x7fa10815c2f0 legacy=0x7fa108158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10815b810 con 0x7fa1080b2980 2023-10-14T18:56:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fa0f8001470 con 0x7fa1080b2980 2023-10-14T18:56:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 >> v1:172.21.15.79:6789/0 conn(0x7fa1080b2980 legacy=0x7fa108068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f0003a90 0x7fa0f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0004810 0x7fa0f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa0f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa108159080 con 0x7fa0f0005210 2023-10-14T18:56:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f000c130 con 0x7fa0f0004810 2023-10-14T18:56:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f000c2c0 con 0x7fa0f0003a90 2023-10-14T18:56:08.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa0f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa106ffd700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f0003a90 0x7fa0f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1067fc700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0004810 0x7fa0f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 -- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f0003a90 msgr2=0x7fa0f0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f0003a90 0x7fa0f0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 -- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0004810 msgr2=0x7fa0f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0f0004810 0x7fa0f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 -- 172.21.15.79:0/2152569545 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0003570 con 0x7fa0f0005210 2023-10-14T18:56:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa106ffd700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa0f0003a90 0x7fa0f0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:08.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 -- 172.21.15.79:0/2152569545 reap_dead start 2023-10-14T18:56:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa1077fe700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa0f000ba60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa100001fc0 tx=0x7fa100001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76622f73f6abd535 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100001950 con 0x7fa0f0005210 2023-10-14T18:56:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10000c870 con 0x7fa0f0005210 2023-10-14T18:56:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.754+0000 7fa105ffb700 1 -- 172.21.15.79:0/2152569545 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000cc10 con 0x7fa0f0005210 2023-10-14T18:56:08.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 -- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 msgr2=0x7fa0f000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa0f000ba60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fa100001fc0 tx=0x7fa100001640 comp rx=0 tx=0).stop 2023-10-14T18:56:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 -- 172.21.15.79:0/2152569545 shutdown_connections 2023-10-14T18:56:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 --2- 172.21.15.79:0/2152569545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa0f000ba60 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 -- 172.21.15.79:0/2152569545 >> 172.21.15.79:0/2152569545 conn(0x7fa1080ce390 msgr2=0x7fa108069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:08.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 -- 172.21.15.79:0/2152569545 shutdown_connections 2023-10-14T18:56:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.755+0000 7fa10d725700 1 -- 172.21.15.79:0/2152569545 wait complete. 2023-10-14T18:56:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.756+0000 7fa10d725700 1 Processor -- start 2023-10-14T18:56:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.756+0000 7fa10d725700 1 -- start start 2023-10-14T18:56:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa108143f60 0x7fa1081443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa108156cf0 0x7fa108157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10814fe80 con 0x7fa0f0005210 2023-10-14T18:56:08.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa108144910 con 0x7fa108156cf0 2023-10-14T18:56:08.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1081576d0 con 0x7fa108143f60 2023-10-14T18:56:08.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39392/0 (socket says 172.21.15.79:39392) 2023-10-14T18:56:08.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 -- 172.21.15.79:0/87805998 learned_addr learned my addr 172.21.15.79:0/87805998 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:08.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa1077fe700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa108156cf0 0x7fa108157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa1067fc700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa108143f60 0x7fa1081443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 -- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa108143f60 msgr2=0x7fa1081443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa108143f60 0x7fa1081443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 -- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa108156cf0 msgr2=0x7fa108157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa108156cf0 0x7fa108157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 -- 172.21.15.79:0/87805998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10814f270 con 0x7fa0f0005210 2023-10-14T18:56:08.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa106ffd700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8001ed0 tx=0x7fa0f8001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:08.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800a760 con 0x7fa0f0005210 2023-10-14T18:56:08.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8010040 con 0x7fa0f0005210 2023-10-14T18:56:08.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10814f550 con 0x7fa0f0005210 2023-10-14T18:56:08.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.757+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800aaf0 con 0x7fa0f0005210 2023-10-14T18:56:08.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.758+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10814fb10 con 0x7fa0f0005210 2023-10-14T18:56:08.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.758+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10806d3a0 con 0x7fa0f0005210 2023-10-14T18:56:08.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.759+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa0f80143f0 con 0x7fa0f0005210 2023-10-14T18:56:08.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.759+0000 7fa0eeffd700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 0x7fa0f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:08.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.759+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0f80839f0 con 0x7fa0f0005210 2023-10-14T18:56:08.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.759+0000 7fa1067fc700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 0x7fa0f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:08.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.760+0000 7fa1067fc700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 0x7fa0f40693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa108144cd0 tx=0x7fa0fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:08.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.763+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0f804d5a0 con 0x7fa0f0005210 2023-10-14T18:56:08.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.989+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa10815baf0 con 0x7fa0f0005210 2023-10-14T18:56:08.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.990+0000 7fa0eeffd700 1 -- 172.21.15.79:0/87805998 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fa0f8019070 con 0x7fa0f0005210 2023-10-14T18:56:08.991 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:08.991 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:08.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 msgr2=0x7fa0f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 0x7fa0f40693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa108144cd0 tx=0x7fa0fc008040 comp rx=0 tx=0).stop 2023-10-14T18:56:08.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 msgr2=0x7fa108157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:08.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8001ed0 tx=0x7fa0f8001c50 comp rx=0 tx=0).stop 2023-10-14T18:56:08.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 shutdown_connections 2023-10-14T18:56:08.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fa0f4066f30 0x7fa0f40693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa108156cf0 0x7fa108157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0f0005210 0x7fa108157ff0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 --2- 172.21.15.79:0/87805998 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa108143f60 0x7fa1081443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:08.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 >> 172.21.15.79:0/87805998 conn(0x7fa1080ce390 msgr2=0x7fa10815aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:08.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 shutdown_connections 2023-10-14T18:56:08.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:08.992+0000 7fa10d725700 1 -- 172.21.15.79:0/87805998 wait complete. 2023-10-14T18:56:08.996 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:09.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.118+0000 7ffb2f6da700 1 Processor -- start 2023-10-14T18:56:09.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.118+0000 7ffb2f6da700 1 -- start start 2023-10-14T18:56:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2f6da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb280cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2f6da700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb28157ba0 0x7ffb2806a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2f6da700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2815c360 con 0x7ffb2815b0d0 2023-10-14T18:56:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2f6da700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2815b790 con 0x7ffb28157ba0 2023-10-14T18:56:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2f6da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2815d800 con 0x7ffb281577d0 2023-10-14T18:56:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2cc75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb28157ba0 0x7ffb2806a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2cc75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb28157ba0 0x7ffb2806a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39396/0 (socket says 172.21.15.79:39396) 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.119+0000 7ffb2cc75700 1 -- 172.21.15.79:0/3804028358 learned_addr learned my addr 172.21.15.79:0/3804028358 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2cc75700 1 -- 172.21.15.79:0/3804028358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 msgr2=0x7ffb280cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2d476700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb280cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2cc75700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb280cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2cc75700 1 -- 172.21.15.79:0/3804028358 >> v1:172.21.15.144:6789/0 conn(0x7ffb2815b0d0 legacy=0x7ffb2815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2cc75700 1 -- 172.21.15.79:0/3804028358 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2815ba30 con 0x7ffb28157ba0 2023-10-14T18:56:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2d476700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb280cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2cc75700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb28157ba0 0x7ffb2806a520 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0099b0 tx=0x7ffb1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc59f737bb9fb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb27fff700 1 -- 172.21.15.79:0/3804028358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00b860 con 0x7ffb28157ba0 2023-10-14T18:56:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb27fff700 1 -- 172.21.15.79:0/3804028358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c00b9c0 con 0x7ffb28157ba0 2023-10-14T18:56:09.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb27fff700 1 -- 172.21.15.79:0/3804028358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00bd60 con 0x7ffb28157ba0 2023-10-14T18:56:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 -- 172.21.15.79:0/3804028358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb28157ba0 msgr2=0x7ffb2806a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb28157ba0 0x7ffb2806a520 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0099b0 tx=0x7ffb1c009250 comp rx=0 tx=0).stop 2023-10-14T18:56:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 -- 172.21.15.79:0/3804028358 shutdown_connections 2023-10-14T18:56:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb280cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/3804028358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb28157ba0 0x7ffb2806a520 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.120+0000 7ffb2f6da700 1 -- 172.21.15.79:0/3804028358 >> 172.21.15.79:0/3804028358 conn(0x7ffb28068ce0 msgr2=0x7ffb280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.121+0000 7ffb2f6da700 1 -- 172.21.15.79:0/3804028358 shutdown_connections 2023-10-14T18:56:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.121+0000 7ffb2f6da700 1 -- 172.21.15.79:0/3804028358 wait complete. 2023-10-14T18:56:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.122+0000 7ffb2f6da700 1 Processor -- start 2023-10-14T18:56:09.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.122+0000 7ffb2f6da700 1 -- start start 2023-10-14T18:56:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.122+0000 7ffb2f6da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb2816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28157ba0 0x7ffb280b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2816b170 con 0x7ffb2815b0d0 2023-10-14T18:56:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b2a00 con 0x7ffb28157ba0 2023-10-14T18:56:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b1710 con 0x7ffb281577d0 2023-10-14T18:56:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39404/0 (socket says 172.21.15.79:39404) 2023-10-14T18:56:09.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 -- 172.21.15.79:0/1758396639 learned_addr learned my addr 172.21.15.79:0/1758396639 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2cc75700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28157ba0 0x7ffb280b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2d476700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb2816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 -- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 msgr2=0x7ffb2816ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb2816ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 -- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28157ba0 msgr2=0x7ffb280b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28157ba0 0x7ffb280b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 -- 172.21.15.79:0/1758396639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094f0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2dc77700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c560 tx=0x7ffb20007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20011590 con 0x7ffb2815b0d0 2023-10-14T18:56:09.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb200116f0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280b2720 con 0x7ffb2815b0d0 2023-10-14T18:56:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20011ab0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.123+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb280b07a0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.124+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2804c3c0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.125+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb2001b3b0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.125+0000 7ffb257fa700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 0x7ffb140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.125+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb200838f0 con 0x7ffb2815b0d0 2023-10-14T18:56:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.125+0000 7ffb2d476700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 0x7ffb140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.126+0000 7ffb2d476700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 0x7ffb140693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffb28153dc0 tx=0x7ffb180077b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.129+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb20050b60 con 0x7ffb2815b0d0 2023-10-14T18:56:09.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.311+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb2815bd10 con 0x7ffb2815b0d0 2023-10-14T18:56:09.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.312+0000 7ffb257fa700 1 -- 172.21.15.79:0/1758396639 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15365 (secure 0 0 0) 0x7ffb20017070 con 0x7ffb2815b0d0 2023-10-14T18:56:09.313 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:09.313 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":186,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:06.598536+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:09.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 msgr2=0x7ffb140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 0x7ffb140693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffb28153dc0 tx=0x7ffb180077b0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 msgr2=0x7ffb2813f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000c560 tx=0x7ffb20007ef0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 shutdown_connections 2023-10-14T18:56:09.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ffb14066f30 0x7ffb140693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb2815b0d0 0x7ffb2813f650 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffb281577d0 0x7ffb2816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 --2- 172.21.15.79:0/1758396639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb28157ba0 0x7ffb280b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 >> 172.21.15.79:0/1758396639 conn(0x7ffb28068ce0 msgr2=0x7ffb280d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:09.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 shutdown_connections 2023-10-14T18:56:09.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.314+0000 7ffb2f6da700 1 -- 172.21.15.79:0/1758396639 wait complete. 2023-10-14T18:56:09.327 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T18:56:09.328 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:09.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.441+0000 7f3d3e088700 1 Processor -- start 2023-10-14T18:56:09.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.441+0000 7f3d3e088700 1 -- start start 2023-10-14T18:56:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3e088700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38156930 0x7f3d380b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3e088700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3806a040 0x7f3d3806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3e088700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3806f180 con 0x7f3d38156d00 2023-10-14T18:56:09.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3e088700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3806a9e0 con 0x7f3d38156930 2023-10-14T18:56:09.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3e088700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380c82d0 con 0x7f3d3806a040 2023-10-14T18:56:09.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3d086700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38156930 0x7f3d380b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3c885700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d38156d00 0x7f3d38067b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49160/0 (socket says 172.21.15.79:49160) 2023-10-14T18:56:09.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3d086700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38156930 0x7f3d380b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39412/0 (socket says 172.21.15.79:39412) 2023-10-14T18:56:09.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3c885700 1 -- 172.21.15.79:0/2578510224 learned_addr learned my addr 172.21.15.79:0/2578510224 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:09.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.442+0000 7f3d3d887700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3806a040 0x7f3d3806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3d086700 1 -- 172.21.15.79:0/2578510224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3806a040 msgr2=0x7f3d3806a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:09.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3d086700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3806a040 0x7f3d3806a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3d086700 1 -- 172.21.15.79:0/2578510224 >> v1:172.21.15.79:6789/0 conn(0x7f3d38156d00 legacy=0x7f3d38067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d2ffff700 1 -- 172.21.15.79:0/2578510224 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558529501 0 0) 0x7f3d3806f180 con 0x7f3d38156d00 2023-10-14T18:56:09.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3d086700 1 -- 172.21.15.79:0/2578510224 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38068280 con 0x7f3d38156930 2023-10-14T18:56:09.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3d086700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38156930 0x7f3d380b0d40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3d340098e0 tx=0x7f3d340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86694493b887a28d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d2ffff700 1 -- 172.21.15.79:0/2578510224 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34009e80 con 0x7f3d38156930 2023-10-14T18:56:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d2ffff700 1 -- 172.21.15.79:0/2578510224 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400b860 con 0x7f3d38156930 2023-10-14T18:56:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d2ffff700 1 -- 172.21.15.79:0/2578510224 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400bbe0 con 0x7f3d38156930 2023-10-14T18:56:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3e088700 1 -- 172.21.15.79:0/2578510224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38156930 msgr2=0x7f3d380b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.443+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38156930 0x7f3d380b0d40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3d340098e0 tx=0x7f3d340091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 -- 172.21.15.79:0/2578510224 shutdown_connections 2023-10-14T18:56:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3806a040 0x7f3d3806a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2578510224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38156930 0x7f3d380b0d40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 -- 172.21.15.79:0/2578510224 >> 172.21.15.79:0/2578510224 conn(0x7f3d380cd8f0 msgr2=0x7f3d380cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 -- 172.21.15.79:0/2578510224 shutdown_connections 2023-10-14T18:56:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.444+0000 7f3d3e088700 1 -- 172.21.15.79:0/2578510224 wait complete. 2023-10-14T18:56:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.445+0000 7f3d3e088700 1 Processor -- start 2023-10-14T18:56:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.445+0000 7f3d3e088700 1 -- start start 2023-10-14T18:56:09.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.445+0000 7f3d3e088700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.445+0000 7f3d3e088700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 0x7f3d38153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.445+0000 7f3d3e088700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d38156d00 0x7f3d38070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3e088700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38153880 con 0x7f3d3806a040 2023-10-14T18:56:09.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3e088700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380c5c30 con 0x7f3d38156930 2023-10-14T18:56:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3e088700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38168130 con 0x7f3d38156d00 2023-10-14T18:56:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39422/0 (socket says 172.21.15.79:39422) 2023-10-14T18:56:09.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 -- 172.21.15.79:0/2169458397 learned_addr learned my addr 172.21.15.79:0/2169458397 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 -- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d38156d00 msgr2=0x7f3d38070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d38156d00 0x7f3d38070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3c885700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 0x7f3d38153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 -- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 msgr2=0x7f3d38153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 0x7f3d38153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 -- 172.21.15.79:0/2169458397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34009420 con 0x7f3d3806a040 2023-10-14T18:56:09.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3c885700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 0x7f3d38153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:09.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3d086700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f3d380ce4a0 tx=0x7f3d34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400b9d0 con 0x7f3d3806a040 2023-10-14T18:56:09.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400bb30 con 0x7f3d3806a040 2023-10-14T18:56:09.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d38168410 con 0x7f3d3806a040 2023-10-14T18:56:09.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34025670 con 0x7f3d3806a040 2023-10-14T18:56:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.446+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d381689d0 con 0x7f3d3806a040 2023-10-14T18:56:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.447+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d380c5e30 con 0x7f3d3806a040 2023-10-14T18:56:09.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.448+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d34023070 con 0x7f3d3806a040 2023-10-14T18:56:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.448+0000 7f3d2d7fa700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 0x7f3d1c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.448+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d34085c70 con 0x7f3d3806a040 2023-10-14T18:56:09.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.448+0000 7f3d3c885700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 0x7f3d1c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.449+0000 7f3d3c885700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 0x7f3d1c069460 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3d380c4620 tx=0x7f3d28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.452+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d380c5e30 con 0x7f3d3806a040 2023-10-14T18:56:09.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.630+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d380c5e30 con 0x7f3d1c066fb0 2023-10-14T18:56:09.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.639+0000 7f3d2d7fa700 1 -- 172.21.15.79:0/2169458397 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276713 (secure 0 0 0) 0x7f3d380c5e30 con 0x7f3d1c066fb0 2023-10-14T18:56:09.644 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 msgr2=0x7f3d1c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 0x7f3d1c069460 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3d380c4620 tx=0x7f3d28009040 comp rx=0 tx=0).stop 2023-10-14T18:56:09.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 msgr2=0x7f3d38167ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f3d380ce4a0 tx=0x7f3d34017000 comp rx=0 tx=0).stop 2023-10-14T18:56:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 shutdown_connections 2023-10-14T18:56:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066fb0 0x7f3d1c069460 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d38156d00 0x7f3d38070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d3806a040 0x7f3d38167ab0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 --2- 172.21.15.79:0/2169458397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38156930 0x7f3d38153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 >> 172.21.15.79:0/2169458397 conn(0x7f3d380cd8f0 msgr2=0x7f3d38155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 shutdown_connections 2023-10-14T18:56:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.642+0000 7f3d3e088700 1 -- 172.21.15.79:0/2169458397 wait complete. 2023-10-14T18:56:09.649 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:09.658 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-14T18:56:08.495405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9123,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553376,"statfs":{"total":1600000000,"available":1590657912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.900056"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597154+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:18.423404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597320+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595381+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595122+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596968+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:19.307674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595066+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598144+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:43.544482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596042+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596851+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:41.227898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596833+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:57.812349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596964+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595036+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596314+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594896+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598407+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597755+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:29.552919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596520+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:32.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597266+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:59.675248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598252+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:00.107353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594654+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596850+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594651+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596589+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596667+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596378+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:23.781680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597753+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:58.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597019+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597665+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594588+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597391+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:00.239843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596592+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598067+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":326,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T18:56:01.139818+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:01.139818+0000","last_peered":"2023-10-14T18:56:01.139818+0000","last_clean":"2023-10-14T18:56:01.139818+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:01.139818+0000","last_undegraded":"2023-10-14T18:56:01.139818+0000","last_fullsized":"2023-10-14T18:56:01.139818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1573,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193738,"statfs":{"total":200000000,"available":198388611,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.76800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.437,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73499999999999999,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.57599999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.77000000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84299999999999997},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81699999999999995,"5min":0.83999999999999997,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.81799999999999995,"15min":0.92300000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.95699999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.78800000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.628}]},{"osd":1,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.83599999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.71999999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.64700000000000002,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.65200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.78700000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.34799999999999998,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.5}]},{"osd":5,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.75800000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.46700000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.38300000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.432,"5min":3.992,"15min":3.992},"last":0.25}]},{"osd":2,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44400000000000001,"5min":1.252,"15min":1.252},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.59799999999999998},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.496,"5min":1.3340000000000001,"15min":10.574},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":10.792,"15min":10.792},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76300000000000001,"5min":3.536,"15min":3.536},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.38200000000000001},"max":{"1min":0.77800000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.498}]},{"osd":5,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":1.504,"15min":1.504},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84799999999999998,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":1.288,"15min":1.288},"last":0.72099999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":3.577,"15min":3.577},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1572,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193739,"statfs":{"total":200000000,"available":198389622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.51100000000000001,"15min":0.59599999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.623},"last":0.308}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.34000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.379},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.92500000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":991,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194321,"statfs":{"total":200000000,"available":198984784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.26600000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.48599999999999999,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40400000000000003,"15min":0.38500000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":1.006},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56100000000000005,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.4820000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.87,"15min":3.5419999999999998},"last":0.53000000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0429999999999999},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.48699999999999999,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.33000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.433},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.86899999999999999,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.499},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.37},"max":{"1min":0.84799999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.745}]},{"osd":1,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.746,"15min":0.83399999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.81000000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67700000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.254,"15min":0.254},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76100000000000001},"last":0.312},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73799999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.89300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.74199999999999999,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":1.603}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.80500000000000005},"last":0.51700000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:09.665 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.812+0000 7f43cf4eb700 1 Processor -- start 2023-10-14T18:56:09.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.812+0000 7f43cf4eb700 1 -- start start 2023-10-14T18:56:09.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cf4eb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 0x7f43c815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cf4eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 0x7f43c815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cf4eb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c80cb7c0 con 0x7f43c80cd6e0 2023-10-14T18:56:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cf4eb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c815e850 con 0x7f43c80cdab0 2023-10-14T18:56:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cf4eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80cc360 con 0x7f43c815dda0 2023-10-14T18:56:09.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cdce8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 0x7f43c815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43cecea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 0x7f43c815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43ce4e9700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f43c80cd6e0 0x7f43c80cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:41226/0 (socket says 172.21.15.79:41226) 2023-10-14T18:56:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.813+0000 7f43ce4e9700 1 -- 172.21.15.79:0/2402468726 learned_addr learned my addr 172.21.15.79:0/2402468726 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cd4e7700 1 -- 172.21.15.79:0/2402468726 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311522597 0 0) 0x7f43c80cb7c0 con 0x7f43c80cd6e0 2023-10-14T18:56:09.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cd4e7700 1 -- 172.21.15.79:0/2402468726 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4003570 con 0x7f43c80cd6e0 2023-10-14T18:56:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cecea700 1 -- 172.21.15.79:0/2402468726 >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 msgr2=0x7f43c815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cecea700 1 --2- 172.21.15.79:0/2402468726 >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 0x7f43c815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cecea700 1 -- 172.21.15.79:0/2402468726 >> v1:172.21.15.144:6789/0 conn(0x7f43c80cd6e0 legacy=0x7f43c80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cecea700 1 -- 172.21.15.79:0/2402468726 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c815e290 con 0x7f43c815dda0 2023-10-14T18:56:09.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cdce8700 1 --2- 172.21.15.79:0/2402468726 >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 0x7f43c815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cecea700 1 --2- 172.21.15.79:0/2402468726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 0x7f43c815cbd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009e60 tx=0x7f43c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa18f6d311a9b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cd4e7700 1 -- 172.21.15.79:0/2402468726 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000e070 con 0x7f43c815dda0 2023-10-14T18:56:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cd4e7700 1 -- 172.21.15.79:0/2402468726 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c000bab0 con 0x7f43c815dda0 2023-10-14T18:56:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.814+0000 7f43cd4e7700 1 -- 172.21.15.79:0/2402468726 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c000be30 con 0x7f43c815dda0 2023-10-14T18:56:09.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 -- 172.21.15.79:0/2402468726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 msgr2=0x7f43c815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/2402468726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 0x7f43c815cbd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009e60 tx=0x7f43c0009780 comp rx=0 tx=0).stop 2023-10-14T18:56:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 -- 172.21.15.79:0/2402468726 shutdown_connections 2023-10-14T18:56:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/2402468726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c815dda0 0x7f43c815cbd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/2402468726 >> v2:172.21.15.144:3300/0 conn(0x7f43c80cdab0 0x7f43c815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 -- 172.21.15.79:0/2402468726 >> 172.21.15.79:0/2402468726 conn(0x7f43c8067660 msgr2=0x7f43c8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 -- 172.21.15.79:0/2402468726 shutdown_connections 2023-10-14T18:56:09.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.815+0000 7f43cf4eb700 1 -- 172.21.15.79:0/2402468726 wait complete. 2023-10-14T18:56:09.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.816+0000 7f43cf4eb700 1 Processor -- start 2023-10-14T18:56:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.816+0000 7f43cf4eb700 1 -- start start 2023-10-14T18:56:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c80cdab0 0x7f43c8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c815dda0 0x7f43c80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c814ace0 con 0x7f43c80cd6e0 2023-10-14T18:56:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80b5570 con 0x7f43c815dda0 2023-10-14T18:56:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c815bad0 con 0x7f43c80cdab0 2023-10-14T18:56:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39438/0 (socket says 172.21.15.79:39438) 2023-10-14T18:56:09.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 -- 172.21.15.79:0/1038273442 learned_addr learned my addr 172.21.15.79:0/1038273442 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cecea700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c815dda0 0x7f43c80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cdce8700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c80cdab0 0x7f43c8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 -- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c80cdab0 msgr2=0x7f43c8158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c80cdab0 0x7f43c8158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 -- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c815dda0 msgr2=0x7f43c80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c815dda0 0x7f43c80b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 -- 172.21.15.79:0/1038273442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009420 con 0x7f43c80cd6e0 2023-10-14T18:56:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43ce4e9700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f43c40011e0 tx=0x7f43c4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005b30 con 0x7f43c80cd6e0 2023-10-14T18:56:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4005c90 con 0x7f43c80cd6e0 2023-10-14T18:56:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c0009a20 con 0x7f43c80cd6e0 2023-10-14T18:56:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007320 con 0x7f43c80cd6e0 2023-10-14T18:56:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.817+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c815c050 con 0x7f43c80cd6e0 2023-10-14T18:56:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.818+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c8089280 con 0x7f43c80cd6e0 2023-10-14T18:56:09.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.819+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43c4007690 con 0x7f43c80cd6e0 2023-10-14T18:56:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.819+0000 7f43be7fc700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.819+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43c40838e0 con 0x7f43c80cd6e0 2023-10-14T18:56:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.819+0000 7f43cdce8700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:09.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.820+0000 7f43cdce8700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 0x7f43ac0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009f40 tx=0x7f43b80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:09.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:09.823+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43c4050b50 con 0x7f43c80cd6e0 2023-10-14T18:56:10.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.003+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43c815c270 con 0x7f43ac066f30 2023-10-14T18:56:10.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.011+0000 7f43be7fc700 1 -- 172.21.15.79:0/1038273442 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276713 (secure 0 0 0) 0x7f43b801a030 con 0x7f43ac066f30 2023-10-14T18:56:10.015 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:10.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 msgr2=0x7f43ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 0x7f43ac0693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009f40 tx=0x7f43b80091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 msgr2=0x7f43c814a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f43c40011e0 tx=0x7f43c4007df0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 shutdown_connections 2023-10-14T18:56:10.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43ac066f30 0x7f43ac0693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c815dda0 0x7f43c80b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43c80cd6e0 0x7f43c814a7a0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 --2- 172.21.15.79:0/1038273442 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43c80cdab0 0x7f43c8158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 >> 172.21.15.79:0/1038273442 conn(0x7f43c8067660 msgr2=0x7f43c81565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:10.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 shutdown_connections 2023-10-14T18:56:10.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.014+0000 7f43cf4eb700 1 -- 172.21.15.79:0/1038273442 wait complete. 2023-10-14T18:56:10.020 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:10.028 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-14T18:56:08.495405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9123,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553376,"statfs":{"total":1600000000,"available":1590657912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.900056"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597154+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:18.423404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597320+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595381+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595122+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596968+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:19.307674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595066+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598144+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:43.544482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596042+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596851+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:41.227898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596833+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:57.812349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596964+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595036+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596314+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594896+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598407+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597755+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:29.552919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596520+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:32.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597266+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:59.675248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598252+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:00.107353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594654+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596850+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594651+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596589+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596667+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596378+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:23.781680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597753+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:58.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597019+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597665+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594588+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597391+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:00.239843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596592+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598067+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":326,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T18:56:01.139818+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:01.139818+0000","last_peered":"2023-10-14T18:56:01.139818+0000","last_clean":"2023-10-14T18:56:01.139818+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:01.139818+0000","last_undegraded":"2023-10-14T18:56:01.139818+0000","last_fullsized":"2023-10-14T18:56:01.139818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1573,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193738,"statfs":{"total":200000000,"available":198388611,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.76800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.437,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73499999999999999,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.57599999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.77000000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84299999999999997},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81699999999999995,"5min":0.83999999999999997,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.81799999999999995,"15min":0.92300000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.95699999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.78800000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.628}]},{"osd":1,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.83599999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.71999999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.64700000000000002,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.65200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.78700000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.34799999999999998,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.5}]},{"osd":5,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.75800000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.46700000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.38300000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.432,"5min":3.992,"15min":3.992},"last":0.25}]},{"osd":2,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44400000000000001,"5min":1.252,"15min":1.252},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.59799999999999998},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.496,"5min":1.3340000000000001,"15min":10.574},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":10.792,"15min":10.792},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76300000000000001,"5min":3.536,"15min":3.536},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.38200000000000001},"max":{"1min":0.77800000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.498}]},{"osd":5,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":1.504,"15min":1.504},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84799999999999998,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":1.288,"15min":1.288},"last":0.72099999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":3.577,"15min":3.577},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1572,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193739,"statfs":{"total":200000000,"available":198389622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.51100000000000001,"15min":0.59599999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.623},"last":0.308}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.34000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.379},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.92500000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":991,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194321,"statfs":{"total":200000000,"available":198984784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.26600000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.48599999999999999,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40400000000000003,"15min":0.38500000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":1.006},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56100000000000005,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.4820000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.87,"15min":3.5419999999999998},"last":0.53000000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0429999999999999},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.48699999999999999,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.33000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.433},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.86899999999999999,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.499},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.37},"max":{"1min":0.84799999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.745}]},{"osd":1,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.746,"15min":0.83399999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.81000000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67700000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.254,"15min":0.254},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76100000000000001},"last":0.312},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73799999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.89300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.74199999999999999,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":1.603}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.80500000000000005},"last":0.51700000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:10.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:10.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.181+0000 7f8f01e0a700 1 Processor -- start 2023-10-14T18:56:10.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.181+0000 7f8f01e0a700 1 -- start start 2023-10-14T18:56:10.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8f01e0a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc157870 0x7f8efc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8f01e0a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8efc157c40 0x7f8efc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8f01e0a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc15cbb0 con 0x7f8efc15a620 2023-10-14T18:56:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8f01e0a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc15bfa0 con 0x7f8efc157c40 2023-10-14T18:56:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8f01e0a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc15c280 con 0x7f8efc157870 2023-10-14T18:56:10.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8efbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8efc157c40 0x7f8efc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8efbfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8efc157c40 0x7f8efc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39446/0 (socket says 172.21.15.79:39446) 2023-10-14T18:56:10.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.182+0000 7f8efbfff700 1 -- 172.21.15.79:0/1390433069 learned_addr learned my addr 172.21.15.79:0/1390433069 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:10.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efbfff700 1 -- 172.21.15.79:0/1390433069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc157870 msgr2=0x7f8efc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efb7fe700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc157870 0x7f8efc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efbfff700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc157870 0x7f8efc15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efbfff700 1 -- 172.21.15.79:0/1390433069 >> v1:172.21.15.144:6789/0 conn(0x7f8efc15a620 legacy=0x7f8efc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efbfff700 1 -- 172.21.15.79:0/1390433069 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc15c560 con 0x7f8efc157c40 2023-10-14T18:56:10.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efbfff700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc158110 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40099b0 tx=0x7f8ef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfc2609d25de324 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efa7fc700 1 -- 172.21.15.79:0/1390433069 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400b820 con 0x7f8efc157c40 2023-10-14T18:56:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efa7fc700 1 -- 172.21.15.79:0/1390433069 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400b980 con 0x7f8efc157c40 2023-10-14T18:56:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8efa7fc700 1 -- 172.21.15.79:0/1390433069 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400bd20 con 0x7f8efc157c40 2023-10-14T18:56:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 -- 172.21.15.79:0/1390433069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 msgr2=0x7f8efc158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc158110 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40099b0 tx=0x7f8ef4009250 comp rx=0 tx=0).stop 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 -- 172.21.15.79:0/1390433069 shutdown_connections 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc158110 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/1390433069 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc157870 0x7f8efc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 -- 172.21.15.79:0/1390433069 >> 172.21.15.79:0/1390433069 conn(0x7f8efc068ce0 msgr2=0x7f8efc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 -- 172.21.15.79:0/1390433069 shutdown_connections 2023-10-14T18:56:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.183+0000 7f8f01e0a700 1 -- 172.21.15.79:0/1390433069 wait complete. 2023-10-14T18:56:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 Processor -- start 2023-10-14T18:56:10.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 -- start start 2023-10-14T18:56:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8efc157870 0x7f8efc13ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc15a620 0x7f8efc13f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1538f0 con 0x7f8efc157c40 2023-10-14T18:56:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0b26f0 con 0x7f8efc157870 2023-10-14T18:56:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8f01e0a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc151290 con 0x7f8efc15a620 2023-10-14T18:56:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8efaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8efaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39460/0 (socket says 172.21.15.79:39460) 2023-10-14T18:56:10.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.185+0000 7f8efaffd700 1 -- 172.21.15.79:0/578756891 learned_addr learned my addr 172.21.15.79:0/578756891 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:10.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efb7fe700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8efc157870 0x7f8efc13ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efbfff700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc15a620 0x7f8efc13f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 -- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc15a620 msgr2=0x7f8efc13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc15a620 0x7f8efc13f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 -- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8efc157870 msgr2=0x7f8efc13ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8efc157870 0x7f8efc13ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 -- 172.21.15.79:0/578756891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40094f0 con 0x7f8efc157c40 2023-10-14T18:56:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8efaffd700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000b5e0 tx=0x7f8ef0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000f510 con 0x7f8efc157c40 2023-10-14T18:56:10.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000f670 con 0x7f8efc157c40 2023-10-14T18:56:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0b2130 con 0x7f8efc157c40 2023-10-14T18:56:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000fa30 con 0x7f8efc157c40 2023-10-14T18:56:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.186+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc150f20 con 0x7f8efc157c40 2023-10-14T18:56:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.187+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc04c3c0 con 0x7f8efc157c40 2023-10-14T18:56:10.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.188+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ef001a400 con 0x7f8efc157c40 2023-10-14T18:56:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.188+0000 7f8ee37fe700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.188+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ef0084020 con 0x7f8efc157c40 2023-10-14T18:56:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.188+0000 7f8efb7fe700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.188+0000 7f8efb7fe700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 0x7f8ee80693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e4c0 tx=0x7f8eec0076f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.192+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef0051310 con 0x7f8efc157c40 2023-10-14T18:56:10.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.370+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8efc0d17b0 con 0x7f8ee8066f30 2023-10-14T18:56:10.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.378+0000 7f8ee37fe700 1 -- 172.21.15.79:0/578756891 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276713 (secure 0 0 0) 0x7f8efc0d17b0 con 0x7f8ee8066f30 2023-10-14T18:56:10.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:10.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 msgr2=0x7f8ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 0x7f8ee80693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e4c0 tx=0x7f8eec0076f0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 msgr2=0x7f8efc0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000b5e0 tx=0x7f8ef0009120 comp rx=0 tx=0).stop 2023-10-14T18:56:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 shutdown_connections 2023-10-14T18:56:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8efc15a620 0x7f8efc13f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8efc157870 0x7f8efc13ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.380+0000 7f8f01e0a700 1 --2- 172.21.15.79:0/578756891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8efc157c40 0x7f8efc0b1690 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.381+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 >> 172.21.15.79:0/578756891 conn(0x7f8efc068ce0 msgr2=0x7f8efc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:10.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.381+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 shutdown_connections 2023-10-14T18:56:10.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.381+0000 7f8f01e0a700 1 -- 172.21.15.79:0/578756891 wait complete. 2023-10-14T18:56:10.387 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:10.393 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2023-10-14T18:56:08.495405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9123,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553376,"statfs":{"total":1600000000,"available":1590657912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.900056"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597154+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:18.423404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597320+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595381+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595122+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596968+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:19.307674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595066+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598144+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:43.544482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596042+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596851+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:03:41.227898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596833+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:50:57.812349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596964+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.595036+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596314+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594896+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598407+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597755+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:29.552919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596520+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:32.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597266+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:03:59.675248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598252+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:00.107353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594654+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596850+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594651+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596589+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596667+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596378+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:23.781680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597753+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:58.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597019+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597665+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.594588+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.597391+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:45:00.239843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.596592+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-14T18:56:04.591999+0000","last_change":"2023-10-14T18:56:04.591999+0000","last_active":"2023-10-14T18:56:04.591999+0000","last_peered":"2023-10-14T18:56:04.591999+0000","last_clean":"2023-10-14T18:56:04.591999+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:04.591999+0000","last_undegraded":"2023-10-14T18:56:04.591999+0000","last_fullsized":"2023-10-14T18:56:04.591999+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-14T18:56:03.589803+0000","last_change":"2023-10-14T18:56:03.598067+0000","last_active":"2023-10-14T18:56:03.589803+0000","last_peered":"2023-10-14T18:56:03.589803+0000","last_clean":"2023-10-14T18:56:03.589803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T18:56:03.589803+0000","last_undegraded":"2023-10-14T18:56:03.589803+0000","last_fullsized":"2023-10-14T18:56:03.589803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":326,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-14T18:56:01.139818+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:01.139818+0000","last_peered":"2023-10-14T18:56:01.139818+0000","last_clean":"2023-10-14T18:56:01.139818+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:01.139818+0000","last_undegraded":"2023-10-14T18:56:01.139818+0000","last_fullsized":"2023-10-14T18:56:01.139818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1573,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193738,"statfs":{"total":200000000,"available":198388611,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.76800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.437,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73499999999999999,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.57599999999999996}]},{"osd":4,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.77000000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84299999999999997},"last":0.497}]},{"osd":5,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81699999999999995,"5min":0.83999999999999997,"15min":0.89500000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48699999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.81799999999999995,"15min":0.92300000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.95699999999999996},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.78800000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.628}]},{"osd":1,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.83599999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.71999999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.64700000000000002,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.65200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.78700000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.34799999999999998,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.5}]},{"osd":5,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.75800000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.46700000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.38300000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.432,"5min":3.992,"15min":3.992},"last":0.25}]},{"osd":2,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44400000000000001,"5min":1.252,"15min":1.252},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.59799999999999998},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.496,"5min":1.3340000000000001,"15min":10.574},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":10.792,"15min":10.792},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76300000000000001,"5min":3.536,"15min":3.536},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.38200000000000001},"max":{"1min":0.77800000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.498}]},{"osd":5,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":1.504,"15min":1.504},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84799999999999998,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":1.288,"15min":1.288},"last":0.72099999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":3.577,"15min":3.577},"last":0.61199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1572,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193739,"statfs":{"total":200000000,"available":198389622,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.51100000000000001,"15min":0.59599999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.623},"last":0.308}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.34000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.379},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.92500000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.68300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":991,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194321,"statfs":{"total":200000000,"available":198984784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.26600000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.48599999999999999,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40400000000000003,"15min":0.38500000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":1.006},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56100000000000005,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.4820000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.87,"15min":3.5419999999999998},"last":0.53000000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0429999999999999},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.48699999999999999,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33900000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.33000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.433},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.51200000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.86899999999999999,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.499},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.41999999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.37},"max":{"1min":0.84799999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.48199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.745}]},{"osd":1,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.746,"15min":0.83399999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.66800000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.81000000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67700000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.254,"15min":0.254},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.54900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.505}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":997,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194315,"statfs":{"total":200000000,"available":198978979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76100000000000001},"last":0.312},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73799999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.375}]},{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.443}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.89300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.74199999999999999,"15min":0.746},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":1.603}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.80500000000000005},"last":0.51700000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:10.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-10-14T18:56:10.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-10-14T18:56:10.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-10-14T18:56:10.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2023-10-14T18:56:10.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-10-14T18:56:10.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3a is not active+clean 2023-10-14T18:56:10.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.39 is not active+clean 2023-10-14T18:56:10.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-10-14T18:56:10.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-10-14T18:56:10.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-10-14T18:56:10.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-10-14T18:56:10.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-10-14T18:56:10.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-10-14T18:56:10.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-10-14T18:56:10.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-10-14T18:56:10.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.30 is not active+clean 2023-10-14T18:56:10.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2f is not active+clean 2023-10-14T18:56:10.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2e is not active+clean 2023-10-14T18:56:10.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2d is not active+clean 2023-10-14T18:56:10.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-10-14T18:56:10.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2b is not active+clean 2023-10-14T18:56:10.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-10-14T18:56:10.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.29 is not active+clean 2023-10-14T18:56:10.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-10-14T18:56:10.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-10-14T18:56:10.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.26 is not active+clean 2023-10-14T18:56:10.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-10-14T18:56:10.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2023-10-14T18:56:10.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-10-14T18:56:10.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-10-14T18:56:10.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-10-14T18:56:10.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.20 is not active+clean 2023-10-14T18:56:10.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1e is not active+clean 2023-10-14T18:56:10.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-10-14T18:56:10.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597154+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:59:18.423404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:56:10.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-10-14T18:56:10.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-14T18:56:10.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597320+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2023-10-14T18:56:10.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-10-14T18:56:10.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.595381+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-10-14T18:56:10.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-10-14T18:56:10.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.595122+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1a is not active+clean 2023-10-14T18:56:10.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-14T18:56:10.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596968+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:18:19.307674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:56:10.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-10-14T18:56:10.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-10-14T18:56:10.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.595066+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-10-14T18:56:10.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-14T18:56:10.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.598144+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:59:43.544482+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:56:10.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2023-10-14T18:56:10.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-10-14T18:56:10.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596042+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T18:56:10.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2023-10-14T18:56:10.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-10-14T18:56:10.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596851+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T00:03:41.227898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:56:10.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2023-10-14T18:56:10.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-10-14T18:56:10.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596833+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T02:50:57.812349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T18:56:10.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-10-14T18:56:10.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-14T18:56:10.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596964+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2023-10-14T18:56:10.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-10-14T18:56:10.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.595036+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.13 is not active+clean 2023-10-14T18:56:10.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-10-14T18:56:10.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596314+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:56:10.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-10-14T18:56:10.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-10-14T18:56:10.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.594896+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-10-14T18:56:10.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-14T18:56:10.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.598407+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:46:31.566046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-10-14T18:56:10.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-14T18:56:10.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597755+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T06:36:29.552919+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:56:10.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2023-10-14T18:56:10.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-14T18:56:10.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596520+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:32:32.415721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:56:10.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-10-14T18:56:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-10-14T18:56:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597266+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:03:59.675248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:56:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.d is not active+clean 2023-10-14T18:56:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-10-14T18:56:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.598252+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:58:00.107353+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:56:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-10-14T18:56:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-10-14T18:56:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.594654+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.b is not active+clean 2023-10-14T18:56:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-10-14T18:56:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596850+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:56:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-10-14T18:56:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-10-14T18:56:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.594651+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:32:22.652664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2023-10-14T18:56:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-10-14T18:56:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596589+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:54:18.514809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T18:56:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2023-10-14T18:56:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-10-14T18:56:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596667+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:56:10.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.7 is not active+clean 2023-10-14T18:56:10.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-14T18:56:10.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596378+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:40:23.781680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T18:56:10.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2023-10-14T18:56:10.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-14T18:56:10.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597753+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T21:56:58.935917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:56:10.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2023-10-14T18:56:10.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-10-14T18:56:10.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597019+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T18:56:10.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2023-10-14T18:56:10.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-14T18:56:10.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597665+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T05:23:52.303709+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-10-14T18:56:10.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-10-14T18:56:10.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.594588+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:46:08.603485+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T18:56:10.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.0 is not active+clean 2023-10-14T18:56:10.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-14T18:56:10.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.597391+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-15T22:45:00.239843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T18:56:10.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-10-14T18:56:10.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-14T18:56:10.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.596592+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2023-10-14T18:56:10.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-14T18:56:04.591999+0000', 'last_change': '2023-10-14T18:56:04.591999+0000', 'last_active': '2023-10-14T18:56:04.591999+0000', 'last_peered': '2023-10-14T18:56:04.591999+0000', 'last_clean': '2023-10-14T18:56:04.591999+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:04.591999+0000', 'last_undegraded': '2023-10-14T18:56:04.591999+0000', 'last_fullsized': '2023-10-14T18:56:04.591999+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:04.591999+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-14T18:56:10.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-14T18:56:10.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-14T18:56:03.589803+0000', 'last_change': '2023-10-14T18:56:03.598067+0000', 'last_active': '2023-10-14T18:56:03.589803+0000', 'last_peered': '2023-10-14T18:56:03.589803+0000', 'last_clean': '2023-10-14T18:56:03.589803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T18:56:03.589803+0000', 'last_undegraded': '2023-10-14T18:56:03.589803+0000', 'last_fullsized': '2023-10-14T18:56:03.589803+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'last_clean_scrub_stamp': '2023-10-14T18:56:03.589803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-16T03:30:10.627571+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T18:56:10.492 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T18:56:10.493 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-10-14T18:56:10.445+0000 7f986dd08700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:56:10.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.606+0000 7fc3c7fff700 1 Processor -- start 2023-10-14T18:56:10.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.606+0000 7fc3c7fff700 1 -- start start 2023-10-14T18:56:10.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3c815b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c7fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3c815aea0 0x7fc3c80d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c7fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c80cf0c0 con 0x7fc3c8153e50 2023-10-14T18:56:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c7fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c815e8f0 con 0x7fc3c815aea0 2023-10-14T18:56:10.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815b340 con 0x7fc3c80d0970 2023-10-14T18:56:10.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc3c8153e50 0x7fc3c81542b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49170/0 (socket says 172.21.15.79:49170) 2023-10-14T18:56:10.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c77fe700 1 -- 172.21.15.79:0/1989075851 learned_addr learned my addr 172.21.15.79:0/1989075851 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:10.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> v2:172.21.15.144:3300/0 conn(0x7fc3c815aea0 0x7fc3c80d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3c815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765273301 0 0) 0x7fc3c80cf0c0 con 0x7fc3c8153e50 2023-10-14T18:56:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.607+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b4003570 con 0x7fc3c8153e50 2023-10-14T18:56:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684325455 0 0) 0x7fc3b4003570 con 0x7fc3c8153e50 2023-10-14T18:56:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 msgr2=0x7fc3c815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3c815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 >> v2:172.21.15.144:3300/0 conn(0x7fc3c815aea0 msgr2=0x7fc3c80d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 --2- 172.21.15.79:0/1989075851 >> v2:172.21.15.144:3300/0 conn(0x7fc3c815aea0 0x7fc3c80d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80d1280 con 0x7fc3c8153e50 2023-10-14T18:56:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> v2:172.21.15.144:3300/0 conn(0x7fc3c815aea0 0x7fc3c80d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:10.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fc3c0001470 con 0x7fc3c8153e50 2023-10-14T18:56:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 >> v1:172.21.15.79:6789/0 conn(0x7fc3c8153e50 legacy=0x7fc3c81542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4003a60 0x7fc3b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b4004810 0x7fc3b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815e8f0 con 0x7fc3b4004810 2023-10-14T18:56:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815b340 con 0x7fc3b4003a60 2023-10-14T18:56:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b400ba60 con 0x7fc3c80d0970 2023-10-14T18:56:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b4004810 0x7fc3b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4003a60 0x7fc3b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c77fe700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 -- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 msgr2=0x7fc3b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80d0970 0x7fc3b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 -- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4003a60 msgr2=0x7fc3b4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4003a60 0x7fc3b4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 -- 172.21.15.79:0/1989075851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4003570 con 0x7fc3b4004810 2023-10-14T18:56:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b4004810 0x7fc3b4004c80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009e20 tx=0x7fc3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b52b903bab4a41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000e920 con 0x7fc3b4004810 2023-10-14T18:56:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b000ea80 con 0x7fc3b4004810 2023-10-14T18:56:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.608+0000 7fc3c5ffb700 1 -- 172.21.15.79:0/1989075851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000ee20 con 0x7fc3b4004810 2023-10-14T18:56:10.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 -- 172.21.15.79:0/1989075851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b4004810 msgr2=0x7fc3b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/1989075851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3b4004810 0x7fc3b4004c80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009e20 tx=0x7fc3b00091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c77fe700 1 -- 172.21.15.79:0/1989075851 reap_dead start 2023-10-14T18:56:10.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 -- 172.21.15.79:0/1989075851 shutdown_connections 2023-10-14T18:56:10.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 -- 172.21.15.79:0/1989075851 >> 172.21.15.79:0/1989075851 conn(0x7fc3c8068c00 msgr2=0x7fc3c8069000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:10.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 -- 172.21.15.79:0/1989075851 shutdown_connections 2023-10-14T18:56:10.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.609+0000 7fc3c7fff700 1 -- 172.21.15.79:0/1989075851 wait complete. 2023-10-14T18:56:10.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.610+0000 7fc3c7fff700 1 Processor -- start 2023-10-14T18:56:10.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.610+0000 7fc3c7fff700 1 -- start start 2023-10-14T18:56:10.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:10.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 0x7fc3c814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c814a5e0 0x7fc3c814aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80b0f60 con 0x7fc3c814d290 2023-10-14T18:56:10.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814ba40 con 0x7fc3b4004810 2023-10-14T18:56:10.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c7fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80b0630 con 0x7fc3c814a5e0 2023-10-14T18:56:10.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39468/0 (socket says 172.21.15.79:39468) 2023-10-14T18:56:10.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 -- 172.21.15.79:0/161050664 learned_addr learned my addr 172.21.15.79:0/161050664 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:10.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 0x7fc3c814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c77fe700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c814a5e0 0x7fc3c814aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 -- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c814a5e0 msgr2=0x7fc3c814aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c814a5e0 0x7fc3c814aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 -- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 msgr2=0x7fc3c814ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 0x7fc3c814ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c67fc700 1 -- 172.21.15.79:0/161050664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80b0910 con 0x7fc3c814d290 2023-10-14T18:56:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.611+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 0x7fc3c814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3c67fc700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e790 tx=0x7fc3b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0006e50 con 0x7fc3c814d290 2023-10-14T18:56:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0022040 con 0x7fc3c814d290 2023-10-14T18:56:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0013ea0 con 0x7fc3c814d290 2023-10-14T18:56:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c80b0bf0 con 0x7fc3c814d290 2023-10-14T18:56:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.612+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c814af70 con 0x7fc3c814d290 2023-10-14T18:56:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.613+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c8089290 con 0x7fc3c814d290 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.613+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3b001c910 con 0x7fc3c814d290 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.613+0000 7fc3beffd700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 0x7fc3a8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.613+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3b00860d0 con 0x7fc3c814d290 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.614+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 0x7fc3a8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.614+0000 7fc3c6ffd700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 0x7fc3a8069410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099f0 tx=0x7fc3b800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:10.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.618+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3b0053340 con 0x7fc3c814d290 2023-10-14T18:56:10.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.881+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc3c815e050 con 0x7fc3c814d290 2023-10-14T18:56:10.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.881+0000 7fc3beffd700 1 -- 172.21.15.79:0/161050664 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fc3b0056960 con 0x7fc3c814d290 2023-10-14T18:56:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:10.883 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":678,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":186,"num_osds":8,"num_up_osds":8,"osd_up_since":1697309098,"num_in_osds":8,"osd_in_since":1697309095,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":9507017,"bytes_avail":1590492983,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":88,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":8160}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-14T18:55:40.488740+0000","services":{}},"progress_events":{}} 2023-10-14T18:56:10.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 msgr2=0x7fc3a8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 0x7fc3a8069410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80099f0 tx=0x7fc3b800b040 comp rx=0 tx=0).stop 2023-10-14T18:56:10.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 msgr2=0x7fc3c8152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:10.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e790 tx=0x7fc3b001a000 comp rx=0 tx=0).stop 2023-10-14T18:56:10.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 shutdown_connections 2023-10-14T18:56:10.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc3a8066f60 0x7fc3a8069410 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c814a5e0 0x7fc3c814aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3b4004810 0x7fc3c814ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 --2- 172.21.15.79:0/161050664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3c814d290 0x7fc3c8152b70 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:10.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.883+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 >> 172.21.15.79:0/161050664 conn(0x7fc3c8068c00 msgr2=0x7fc3c815cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:10.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.884+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 shutdown_connections 2023-10-14T18:56:10.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:10.884+0000 7fc3c7fff700 1 -- 172.21.15.79:0/161050664 wait complete. 2023-10-14T18:56:10.897 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T18:56:10.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.011+0000 7fe217328700 1 Processor -- start 2023-10-14T18:56:11.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.011+0000 7fe217328700 1 -- start start 2023-10-14T18:56:11.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe217328700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe21015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe217328700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe21015a620 0x7fe21015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe217328700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21015cbb0 con 0x7fe21015d580 2023-10-14T18:56:11.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe217328700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21015bfa0 con 0x7fe21015a620 2023-10-14T18:56:11.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe217328700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21015c280 con 0x7fe210157870 2023-10-14T18:56:11.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe2148c3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe21015a620 0x7fe21015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe2158c5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe21015d580 0x7fe210158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49174/0 (socket says 172.21.15.79:49174) 2023-10-14T18:56:11.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.012+0000 7fe2158c5700 1 -- 172.21.15.79:0/3229273553 learned_addr learned my addr 172.21.15.79:0/3229273553 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:11.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2150c4700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe21015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe207fff700 1 -- 172.21.15.79:0/3229273553 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788025188 0 0) 0x7fe21015cbb0 con 0x7fe21015d580 2023-10-14T18:56:11.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe207fff700 1 -- 172.21.15.79:0/3229273553 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc003570 con 0x7fe21015d580 2023-10-14T18:56:11.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2148c3700 1 -- 172.21.15.79:0/3229273553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 msgr2=0x7fe21015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:11.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2148c3700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe21015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2148c3700 1 -- 172.21.15.79:0/3229273553 >> v1:172.21.15.79:6789/0 conn(0x7fe21015d580 legacy=0x7fe210158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2148c3700 1 -- 172.21.15.79:0/3229273553 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21015c560 con 0x7fe21015a620 2023-10-14T18:56:11.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe2148c3700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015a620 0x7fe21015d040 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fe2000098e0 tx=0x7fe2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9050cc148fcbdb00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:11.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe207fff700 1 -- 172.21.15.79:0/3229273553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000b640 con 0x7fe21015a620 2023-10-14T18:56:11.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe207fff700 1 -- 172.21.15.79:0/3229273553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b7a0 con 0x7fe21015a620 2023-10-14T18:56:11.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.013+0000 7fe207fff700 1 -- 172.21.15.79:0/3229273553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000bb40 con 0x7fe21015a620 2023-10-14T18:56:11.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 -- 172.21.15.79:0/3229273553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015a620 msgr2=0x7fe21015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015a620 0x7fe21015d040 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fe2000098e0 tx=0x7fe2000091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 -- 172.21.15.79:0/3229273553 shutdown_connections 2023-10-14T18:56:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe21015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 --2- 172.21.15.79:0/3229273553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015a620 0x7fe21015d040 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 -- 172.21.15.79:0/3229273553 >> 172.21.15.79:0/3229273553 conn(0x7fe210068ce0 msgr2=0x7fe2100690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:11.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 -- 172.21.15.79:0/3229273553 shutdown_connections 2023-10-14T18:56:11.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.014+0000 7fe217328700 1 -- 172.21.15.79:0/3229273553 wait complete. 2023-10-14T18:56:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.015+0000 7fe217328700 1 Processor -- start 2023-10-14T18:56:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.015+0000 7fe217328700 1 -- start start 2023-10-14T18:56:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe210150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe21015a620 0x7fe21014bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21016e260 con 0x7fe21015d580 2023-10-14T18:56:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21016e540 con 0x7fe21015a620 2023-10-14T18:56:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21016e820 con 0x7fe210157870 2023-10-14T18:56:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39476/0 (socket says 172.21.15.79:39476) 2023-10-14T18:56:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 -- 172.21.15.79:0/4159316715 learned_addr learned my addr 172.21.15.79:0/4159316715 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2150c4700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe210150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2148c3700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe21015a620 0x7fe21014bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 -- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 msgr2=0x7fe210150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe210150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 -- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe21015a620 msgr2=0x7fe21014bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe21015a620 0x7fe21014bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 -- 172.21.15.79:0/4159316715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe200009420 con 0x7fe21015d580 2023-10-14T18:56:11.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2158c5700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe20800cc40 tx=0x7fe208001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20800a960 con 0x7fe21015d580 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20800aac0 con 0x7fe21015d580 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21016eb00 con 0x7fe21015d580 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.016+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20800ae40 con 0x7fe21015d580 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.017+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2100d0980 con 0x7fe21015d580 2023-10-14T18:56:11.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.017+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21004c3c0 con 0x7fe21015d580 2023-10-14T18:56:11.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.018+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe208007300 con 0x7fe21015d580 2023-10-14T18:56:11.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.018+0000 7fe2057fa700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 0x7fe1f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:11.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.018+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe208084970 con 0x7fe21015d580 2023-10-14T18:56:11.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.018+0000 7fe2150c4700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 0x7fe1f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:11.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.019+0000 7fe2150c4700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 0x7fe1f40693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006fd0 tx=0x7fe20c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:11.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.022+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe208051bd0 con 0x7fe21015d580 2023-10-14T18:56:11.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.199+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2100d0bd0 con 0x7fe1f4066f30 2023-10-14T18:56:11.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.208+0000 7fe2057fa700 1 -- 172.21.15.79:0/4159316715 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285874 (secure 0 0 0) 0x7fe20c00f710 con 0x7fe1f4066f30 2023-10-14T18:56:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:11.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 msgr2=0x7fe1f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 0x7fe1f40693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006fd0 tx=0x7fe20c008040 comp rx=0 tx=0).stop 2023-10-14T18:56:11.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 msgr2=0x7fe210154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:11.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe20800cc40 tx=0x7fe208001a00 comp rx=0 tx=0).stop 2023-10-14T18:56:11.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 shutdown_connections 2023-10-14T18:56:11.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe1f4066f30 0x7fe1f40693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe21015d580 0x7fe210154610 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe210157870 0x7fe210150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 --2- 172.21.15.79:0/4159316715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe21015a620 0x7fe21014bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 >> 172.21.15.79:0/4159316715 conn(0x7fe210068ce0 msgr2=0x7fe21015fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:11.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 shutdown_connections 2023-10-14T18:56:11.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:11.211+0000 7fe217328700 1 -- 172.21.15.79:0/4159316715 wait complete. 2023-10-14T18:56:11.217 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:11.224 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2023-10-14T18:56:10.495789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9284,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553215,"statfs":{"total":1600000000,"available":1590492983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605640+0000","last_change":"2023-10-14T18:56:05.605515+0000","last_active":"2023-10-14T18:56:05.605640+0000","last_peered":"2023-10-14T18:56:05.605640+0000","last_clean":"2023-10-14T18:56:05.605640+0000","last_became_active":"2023-10-14T18:56:05.605273+0000","last_became_peered":"2023-10-14T18:56:05.605273+0000","last_unstale":"2023-10-14T18:56:05.605640+0000","last_undegraded":"2023-10-14T18:56:05.605640+0000","last_fullsized":"2023-10-14T18:56:05.605640+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:25.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623057+0000","last_change":"2023-10-14T18:56:05.623002+0000","last_active":"2023-10-14T18:56:05.623057+0000","last_peered":"2023-10-14T18:56:05.623057+0000","last_clean":"2023-10-14T18:56:05.623057+0000","last_became_active":"2023-10-14T18:56:05.622267+0000","last_became_peered":"2023-10-14T18:56:05.622267+0000","last_unstale":"2023-10-14T18:56:05.623057+0000","last_undegraded":"2023-10-14T18:56:05.623057+0000","last_fullsized":"2023-10-14T18:56:05.623057+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:47.503324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613844+0000","last_change":"2023-10-14T18:56:05.613057+0000","last_active":"2023-10-14T18:56:05.613844+0000","last_peered":"2023-10-14T18:56:05.613844+0000","last_clean":"2023-10-14T18:56:05.613844+0000","last_became_active":"2023-10-14T18:56:05.612494+0000","last_became_peered":"2023-10-14T18:56:05.612494+0000","last_unstale":"2023-10-14T18:56:05.613844+0000","last_undegraded":"2023-10-14T18:56:05.613844+0000","last_fullsized":"2023-10-14T18:56:05.613844+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:38.769225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611542+0000","last_change":"2023-10-14T18:56:05.611489+0000","last_active":"2023-10-14T18:56:05.611542+0000","last_peered":"2023-10-14T18:56:05.611542+0000","last_clean":"2023-10-14T18:56:05.611542+0000","last_became_active":"2023-10-14T18:56:05.611285+0000","last_became_peered":"2023-10-14T18:56:05.611285+0000","last_unstale":"2023-10-14T18:56:05.611542+0000","last_undegraded":"2023-10-14T18:56:05.611542+0000","last_fullsized":"2023-10-14T18:56:05.611542+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:07.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.619418+0000","last_change":"2023-10-14T18:56:05.619231+0000","last_active":"2023-10-14T18:56:05.619418+0000","last_peered":"2023-10-14T18:56:05.619418+0000","last_clean":"2023-10-14T18:56:05.619418+0000","last_became_active":"2023-10-14T18:56:05.619037+0000","last_became_peered":"2023-10-14T18:56:05.619037+0000","last_unstale":"2023-10-14T18:56:05.619418+0000","last_undegraded":"2023-10-14T18:56:05.619418+0000","last_fullsized":"2023-10-14T18:56:05.619418+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:31.785452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605353+0000","last_change":"2023-10-14T18:56:05.605304+0000","last_active":"2023-10-14T18:56:05.605353+0000","last_peered":"2023-10-14T18:56:05.605353+0000","last_clean":"2023-10-14T18:56:05.605353+0000","last_became_active":"2023-10-14T18:56:05.605085+0000","last_became_peered":"2023-10-14T18:56:05.605085+0000","last_unstale":"2023-10-14T18:56:05.605353+0000","last_undegraded":"2023-10-14T18:56:05.605353+0000","last_fullsized":"2023-10-14T18:56:05.605353+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:24.783876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608184+0000","last_change":"2023-10-14T18:56:05.608086+0000","last_active":"2023-10-14T18:56:05.608184+0000","last_peered":"2023-10-14T18:56:05.608184+0000","last_clean":"2023-10-14T18:56:05.608184+0000","last_became_active":"2023-10-14T18:56:05.607869+0000","last_became_peered":"2023-10-14T18:56:05.607869+0000","last_unstale":"2023-10-14T18:56:05.608184+0000","last_undegraded":"2023-10-14T18:56:05.608184+0000","last_fullsized":"2023-10-14T18:56:05.608184+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:02.575507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621083+0000","last_change":"2023-10-14T18:56:05.621018+0000","last_active":"2023-10-14T18:56:05.621083+0000","last_peered":"2023-10-14T18:56:05.621083+0000","last_clean":"2023-10-14T18:56:05.621083+0000","last_became_active":"2023-10-14T18:56:05.620685+0000","last_became_peered":"2023-10-14T18:56:05.620685+0000","last_unstale":"2023-10-14T18:56:05.621083+0000","last_undegraded":"2023-10-14T18:56:05.621083+0000","last_fullsized":"2023-10-14T18:56:05.621083+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:02.419318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622686+0000","last_change":"2023-10-14T18:56:05.622621+0000","last_active":"2023-10-14T18:56:05.622686+0000","last_peered":"2023-10-14T18:56:05.622686+0000","last_clean":"2023-10-14T18:56:05.622686+0000","last_became_active":"2023-10-14T18:56:05.622394+0000","last_became_peered":"2023-10-14T18:56:05.622394+0000","last_unstale":"2023-10-14T18:56:05.622686+0000","last_undegraded":"2023-10-14T18:56:05.622686+0000","last_fullsized":"2023-10-14T18:56:05.622686+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:13.982676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622486+0000","last_change":"2023-10-14T18:56:05.621975+0000","last_active":"2023-10-14T18:56:05.622486+0000","last_peered":"2023-10-14T18:56:05.622486+0000","last_clean":"2023-10-14T18:56:05.622486+0000","last_became_active":"2023-10-14T18:56:05.620216+0000","last_became_peered":"2023-10-14T18:56:05.620216+0000","last_unstale":"2023-10-14T18:56:05.622486+0000","last_undegraded":"2023-10-14T18:56:05.622486+0000","last_fullsized":"2023-10-14T18:56:05.622486+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:05.822336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.620948+0000","last_change":"2023-10-14T18:56:05.620691+0000","last_active":"2023-10-14T18:56:05.620948+0000","last_peered":"2023-10-14T18:56:05.620948+0000","last_clean":"2023-10-14T18:56:05.620948+0000","last_became_active":"2023-10-14T18:56:05.620449+0000","last_became_peered":"2023-10-14T18:56:05.620449+0000","last_unstale":"2023-10-14T18:56:05.620948+0000","last_undegraded":"2023-10-14T18:56:05.620948+0000","last_fullsized":"2023-10-14T18:56:05.620948+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:49.053006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623650+0000","last_change":"2023-10-14T18:56:05.623559+0000","last_active":"2023-10-14T18:56:05.623650+0000","last_peered":"2023-10-14T18:56:05.623650+0000","last_clean":"2023-10-14T18:56:05.623650+0000","last_became_active":"2023-10-14T18:56:05.623337+0000","last_became_peered":"2023-10-14T18:56:05.623337+0000","last_unstale":"2023-10-14T18:56:05.623650+0000","last_undegraded":"2023-10-14T18:56:05.623650+0000","last_fullsized":"2023-10-14T18:56:05.623650+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:17.878904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613799+0000","last_change":"2023-10-14T18:56:05.612729+0000","last_active":"2023-10-14T18:56:05.613799+0000","last_peered":"2023-10-14T18:56:05.613799+0000","last_clean":"2023-10-14T18:56:05.613799+0000","last_became_active":"2023-10-14T18:56:05.611857+0000","last_became_peered":"2023-10-14T18:56:05.611857+0000","last_unstale":"2023-10-14T18:56:05.613799+0000","last_undegraded":"2023-10-14T18:56:05.613799+0000","last_fullsized":"2023-10-14T18:56:05.613799+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:15.204768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610701+0000","last_change":"2023-10-14T18:56:05.609031+0000","last_active":"2023-10-14T18:56:05.610701+0000","last_peered":"2023-10-14T18:56:05.610701+0000","last_clean":"2023-10-14T18:56:05.610701+0000","last_became_active":"2023-10-14T18:56:05.608477+0000","last_became_peered":"2023-10-14T18:56:05.608477+0000","last_unstale":"2023-10-14T18:56:05.610701+0000","last_undegraded":"2023-10-14T18:56:05.610701+0000","last_fullsized":"2023-10-14T18:56:05.610701+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:46.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.615688+0000","last_change":"2023-10-14T18:56:05.615612+0000","last_active":"2023-10-14T18:56:05.615688+0000","last_peered":"2023-10-14T18:56:05.615688+0000","last_clean":"2023-10-14T18:56:05.615688+0000","last_became_active":"2023-10-14T18:56:05.615148+0000","last_became_peered":"2023-10-14T18:56:05.615148+0000","last_unstale":"2023-10-14T18:56:05.615688+0000","last_undegraded":"2023-10-14T18:56:05.615688+0000","last_fullsized":"2023-10-14T18:56:05.615688+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:12.444664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606658+0000","last_change":"2023-10-14T18:56:05.606601+0000","last_active":"2023-10-14T18:56:05.606658+0000","last_peered":"2023-10-14T18:56:05.606658+0000","last_clean":"2023-10-14T18:56:05.606658+0000","last_became_active":"2023-10-14T18:56:05.606383+0000","last_became_peered":"2023-10-14T18:56:05.606383+0000","last_unstale":"2023-10-14T18:56:05.606658+0000","last_undegraded":"2023-10-14T18:56:05.606658+0000","last_fullsized":"2023-10-14T18:56:05.606658+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:34:13.885048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611033+0000","last_change":"2023-10-14T18:56:05.610972+0000","last_active":"2023-10-14T18:56:05.611033+0000","last_peered":"2023-10-14T18:56:05.611033+0000","last_clean":"2023-10-14T18:56:05.611033+0000","last_became_active":"2023-10-14T18:56:05.610724+0000","last_became_peered":"2023-10-14T18:56:05.610724+0000","last_unstale":"2023-10-14T18:56:05.611033+0000","last_undegraded":"2023-10-14T18:56:05.611033+0000","last_fullsized":"2023-10-14T18:56:05.611033+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:12:14.968254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.602808+0000","last_change":"2023-10-14T18:56:05.602696+0000","last_active":"2023-10-14T18:56:05.602808+0000","last_peered":"2023-10-14T18:56:05.602808+0000","last_clean":"2023-10-14T18:56:05.602808+0000","last_became_active":"2023-10-14T18:56:05.602481+0000","last_became_peered":"2023-10-14T18:56:05.602481+0000","last_unstale":"2023-10-14T18:56:05.602808+0000","last_undegraded":"2023-10-14T18:56:05.602808+0000","last_fullsized":"2023-10-14T18:56:05.602808+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:07.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607023+0000","last_change":"2023-10-14T18:56:05.606963+0000","last_active":"2023-10-14T18:56:05.607023+0000","last_peered":"2023-10-14T18:56:05.607023+0000","last_clean":"2023-10-14T18:56:05.607023+0000","last_became_active":"2023-10-14T18:56:05.606754+0000","last_became_peered":"2023-10-14T18:56:05.606754+0000","last_unstale":"2023-10-14T18:56:05.607023+0000","last_undegraded":"2023-10-14T18:56:05.607023+0000","last_fullsized":"2023-10-14T18:56:05.607023+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:51.273844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612322+0000","last_change":"2023-10-14T18:56:05.612202+0000","last_active":"2023-10-14T18:56:05.612322+0000","last_peered":"2023-10-14T18:56:05.612322+0000","last_clean":"2023-10-14T18:56:05.612322+0000","last_became_active":"2023-10-14T18:56:05.612004+0000","last_became_peered":"2023-10-14T18:56:05.612004+0000","last_unstale":"2023-10-14T18:56:05.612322+0000","last_undegraded":"2023-10-14T18:56:05.612322+0000","last_fullsized":"2023-10-14T18:56:05.612322+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:49.053006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609623+0000","last_change":"2023-10-14T18:56:05.609565+0000","last_active":"2023-10-14T18:56:05.609623+0000","last_peered":"2023-10-14T18:56:05.609623+0000","last_clean":"2023-10-14T18:56:05.609623+0000","last_became_active":"2023-10-14T18:56:05.609350+0000","last_became_peered":"2023-10-14T18:56:05.609350+0000","last_unstale":"2023-10-14T18:56:05.609623+0000","last_undegraded":"2023-10-14T18:56:05.609623+0000","last_fullsized":"2023-10-14T18:56:05.609623+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.555116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623192+0000","last_change":"2023-10-14T18:56:05.623126+0000","last_active":"2023-10-14T18:56:05.623192+0000","last_peered":"2023-10-14T18:56:05.623192+0000","last_clean":"2023-10-14T18:56:05.623192+0000","last_became_active":"2023-10-14T18:56:05.622698+0000","last_became_peered":"2023-10-14T18:56:05.622698+0000","last_unstale":"2023-10-14T18:56:05.623192+0000","last_undegraded":"2023-10-14T18:56:05.623192+0000","last_fullsized":"2023-10-14T18:56:05.623192+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.478842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605876+0000","last_change":"2023-10-14T18:56:05.605795+0000","last_active":"2023-10-14T18:56:05.605876+0000","last_peered":"2023-10-14T18:56:05.605876+0000","last_clean":"2023-10-14T18:56:05.605876+0000","last_became_active":"2023-10-14T18:56:05.605577+0000","last_became_peered":"2023-10-14T18:56:05.605577+0000","last_unstale":"2023-10-14T18:56:05.605876+0000","last_undegraded":"2023-10-14T18:56:05.605876+0000","last_fullsized":"2023-10-14T18:56:05.605876+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:20.309870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623630+0000","last_change":"2023-10-14T18:56:05.623541+0000","last_active":"2023-10-14T18:56:05.623630+0000","last_peered":"2023-10-14T18:56:05.623630+0000","last_clean":"2023-10-14T18:56:05.623630+0000","last_became_active":"2023-10-14T18:56:05.623279+0000","last_became_peered":"2023-10-14T18:56:05.623279+0000","last_unstale":"2023-10-14T18:56:05.623630+0000","last_undegraded":"2023-10-14T18:56:05.623630+0000","last_fullsized":"2023-10-14T18:56:05.623630+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:59.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613859+0000","last_change":"2023-10-14T18:56:05.613618+0000","last_active":"2023-10-14T18:56:05.613859+0000","last_peered":"2023-10-14T18:56:05.613859+0000","last_clean":"2023-10-14T18:56:05.613859+0000","last_became_active":"2023-10-14T18:56:05.613294+0000","last_became_peered":"2023-10-14T18:56:05.613294+0000","last_unstale":"2023-10-14T18:56:05.613859+0000","last_undegraded":"2023-10-14T18:56:05.613859+0000","last_fullsized":"2023-10-14T18:56:05.613859+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:05.822336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608163+0000","last_change":"2023-10-14T18:56:05.607694+0000","last_active":"2023-10-14T18:56:05.608163+0000","last_peered":"2023-10-14T18:56:05.608163+0000","last_clean":"2023-10-14T18:56:05.608163+0000","last_became_active":"2023-10-14T18:56:05.607479+0000","last_became_peered":"2023-10-14T18:56:05.607479+0000","last_unstale":"2023-10-14T18:56:05.608163+0000","last_undegraded":"2023-10-14T18:56:05.608163+0000","last_fullsized":"2023-10-14T18:56:05.608163+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:12.444664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611638+0000","last_change":"2023-10-14T18:56:05.611564+0000","last_active":"2023-10-14T18:56:05.611638+0000","last_peered":"2023-10-14T18:56:05.611638+0000","last_clean":"2023-10-14T18:56:05.611638+0000","last_became_active":"2023-10-14T18:56:05.611325+0000","last_became_peered":"2023-10-14T18:56:05.611325+0000","last_unstale":"2023-10-14T18:56:05.611638+0000","last_undegraded":"2023-10-14T18:56:05.611638+0000","last_fullsized":"2023-10-14T18:56:05.611638+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.478842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613489+0000","last_change":"2023-10-14T18:56:05.613444+0000","last_active":"2023-10-14T18:56:05.613489+0000","last_peered":"2023-10-14T18:56:05.613489+0000","last_clean":"2023-10-14T18:56:05.613489+0000","last_became_active":"2023-10-14T18:56:05.613286+0000","last_became_peered":"2023-10-14T18:56:05.613286+0000","last_unstale":"2023-10-14T18:56:05.613489+0000","last_undegraded":"2023-10-14T18:56:05.613489+0000","last_fullsized":"2023-10-14T18:56:05.613489+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:30.803100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612476+0000","last_change":"2023-10-14T18:56:05.612356+0000","last_active":"2023-10-14T18:56:05.612476+0000","last_peered":"2023-10-14T18:56:05.612476+0000","last_clean":"2023-10-14T18:56:05.612476+0000","last_became_active":"2023-10-14T18:56:05.610549+0000","last_became_peered":"2023-10-14T18:56:05.610549+0000","last_unstale":"2023-10-14T18:56:05.612476+0000","last_undegraded":"2023-10-14T18:56:05.612476+0000","last_fullsized":"2023-10-14T18:56:05.612476+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:32.568242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610966+0000","last_change":"2023-10-14T18:56:05.610892+0000","last_active":"2023-10-14T18:56:05.610966+0000","last_peered":"2023-10-14T18:56:05.610966+0000","last_clean":"2023-10-14T18:56:05.610966+0000","last_became_active":"2023-10-14T18:56:05.610629+0000","last_became_peered":"2023-10-14T18:56:05.610629+0000","last_unstale":"2023-10-14T18:56:05.610966+0000","last_undegraded":"2023-10-14T18:56:05.610966+0000","last_fullsized":"2023-10-14T18:56:05.610966+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:58:10.361994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610447+0000","last_change":"2023-10-14T18:56:05.610192+0000","last_active":"2023-10-14T18:56:05.610447+0000","last_peered":"2023-10-14T18:56:05.610447+0000","last_clean":"2023-10-14T18:56:05.610447+0000","last_became_active":"2023-10-14T18:56:05.609560+0000","last_became_peered":"2023-10-14T18:56:05.609560+0000","last_unstale":"2023-10-14T18:56:05.610447+0000","last_undegraded":"2023-10-14T18:56:05.610447+0000","last_fullsized":"2023-10-14T18:56:05.610447+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:13.982676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603591+0000","last_change":"2023-10-14T18:56:05.603093+0000","last_active":"2023-10-14T18:56:05.603591+0000","last_peered":"2023-10-14T18:56:05.603591+0000","last_clean":"2023-10-14T18:56:05.603591+0000","last_became_active":"2023-10-14T18:56:05.602750+0000","last_became_peered":"2023-10-14T18:56:05.602750+0000","last_unstale":"2023-10-14T18:56:05.603591+0000","last_undegraded":"2023-10-14T18:56:05.603591+0000","last_fullsized":"2023-10-14T18:56:05.603591+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:51.449357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610128+0000","last_change":"2023-10-14T18:56:05.610073+0000","last_active":"2023-10-14T18:56:05.610128+0000","last_peered":"2023-10-14T18:56:05.610128+0000","last_clean":"2023-10-14T18:56:05.610128+0000","last_became_active":"2023-10-14T18:56:05.609734+0000","last_became_peered":"2023-10-14T18:56:05.609734+0000","last_unstale":"2023-10-14T18:56:05.610128+0000","last_undegraded":"2023-10-14T18:56:05.610128+0000","last_fullsized":"2023-10-14T18:56:05.610128+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:30.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"185'4","reported_seq":14,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623684+0000","last_change":"2023-10-14T18:56:04.609334+0000","last_active":"2023-10-14T18:56:05.623684+0000","last_peered":"2023-10-14T18:56:05.623684+0000","last_clean":"2023-10-14T18:56:05.623684+0000","last_became_active":"2023-10-14T18:56:04.608610+0000","last_became_peered":"2023-10-14T18:56:04.608610+0000","last_unstale":"2023-10-14T18:56:05.623684+0000","last_undegraded":"2023-10-14T18:56:05.623684+0000","last_fullsized":"2023-10-14T18:56:05.623684+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:10.288016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611564+0000","last_change":"2023-10-14T18:56:05.611492+0000","last_active":"2023-10-14T18:56:05.611564+0000","last_peered":"2023-10-14T18:56:05.611564+0000","last_clean":"2023-10-14T18:56:05.611564+0000","last_became_active":"2023-10-14T18:56:05.611270+0000","last_became_peered":"2023-10-14T18:56:05.611270+0000","last_unstale":"2023-10-14T18:56:05.611564+0000","last_undegraded":"2023-10-14T18:56:05.611564+0000","last_fullsized":"2023-10-14T18:56:05.611564+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:35.844218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626706+0000","last_change":"2023-10-14T18:56:04.614210+0000","last_active":"2023-10-14T18:56:05.626706+0000","last_peered":"2023-10-14T18:56:05.626706+0000","last_clean":"2023-10-14T18:56:05.626706+0000","last_became_active":"2023-10-14T18:56:04.613961+0000","last_became_peered":"2023-10-14T18:56:04.613961+0000","last_unstale":"2023-10-14T18:56:05.626706+0000","last_undegraded":"2023-10-14T18:56:05.626706+0000","last_fullsized":"2023-10-14T18:56:05.626706+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603595+0000","last_change":"2023-10-14T18:56:05.603532+0000","last_active":"2023-10-14T18:56:05.603595+0000","last_peered":"2023-10-14T18:56:05.603595+0000","last_clean":"2023-10-14T18:56:05.603595+0000","last_became_active":"2023-10-14T18:56:05.603313+0000","last_became_peered":"2023-10-14T18:56:05.603313+0000","last_unstale":"2023-10-14T18:56:05.603595+0000","last_undegraded":"2023-10-14T18:56:05.603595+0000","last_fullsized":"2023-10-14T18:56:05.603595+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:31.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622181+0000","last_change":"2023-10-14T18:56:04.605771+0000","last_active":"2023-10-14T18:56:05.622181+0000","last_peered":"2023-10-14T18:56:05.622181+0000","last_clean":"2023-10-14T18:56:05.622181+0000","last_became_active":"2023-10-14T18:56:04.605370+0000","last_became_peered":"2023-10-14T18:56:04.605370+0000","last_unstale":"2023-10-14T18:56:05.622181+0000","last_undegraded":"2023-10-14T18:56:05.622181+0000","last_fullsized":"2023-10-14T18:56:05.622181+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:48.050809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618619+0000","last_change":"2023-10-14T18:56:05.617350+0000","last_active":"2023-10-14T18:56:05.618619+0000","last_peered":"2023-10-14T18:56:05.618619+0000","last_clean":"2023-10-14T18:56:05.618619+0000","last_became_active":"2023-10-14T18:56:05.617122+0000","last_became_peered":"2023-10-14T18:56:05.617122+0000","last_unstale":"2023-10-14T18:56:05.618619+0000","last_undegraded":"2023-10-14T18:56:05.618619+0000","last_fullsized":"2023-10-14T18:56:05.618619+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:42.227441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621102+0000","last_change":"2023-10-14T18:56:04.609868+0000","last_active":"2023-10-14T18:56:05.621102+0000","last_peered":"2023-10-14T18:56:05.621102+0000","last_clean":"2023-10-14T18:56:05.621102+0000","last_became_active":"2023-10-14T18:56:04.609689+0000","last_became_peered":"2023-10-14T18:56:04.609689+0000","last_unstale":"2023-10-14T18:56:05.621102+0000","last_undegraded":"2023-10-14T18:56:05.621102+0000","last_fullsized":"2023-10-14T18:56:05.621102+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611476+0000","last_change":"2023-10-14T18:56:05.611397+0000","last_active":"2023-10-14T18:56:05.611476+0000","last_peered":"2023-10-14T18:56:05.611476+0000","last_clean":"2023-10-14T18:56:05.611476+0000","last_became_active":"2023-10-14T18:56:05.611151+0000","last_became_peered":"2023-10-14T18:56:05.611151+0000","last_unstale":"2023-10-14T18:56:05.611476+0000","last_undegraded":"2023-10-14T18:56:05.611476+0000","last_fullsized":"2023-10-14T18:56:05.611476+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:31.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626397+0000","last_change":"2023-10-14T18:56:04.611376+0000","last_active":"2023-10-14T18:56:05.626397+0000","last_peered":"2023-10-14T18:56:05.626397+0000","last_clean":"2023-10-14T18:56:05.626397+0000","last_became_active":"2023-10-14T18:56:04.611147+0000","last_became_peered":"2023-10-14T18:56:04.611147+0000","last_unstale":"2023-10-14T18:56:05.626397+0000","last_undegraded":"2023-10-14T18:56:05.626397+0000","last_fullsized":"2023-10-14T18:56:05.626397+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:50.271647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610181+0000","last_change":"2023-10-14T18:56:05.609956+0000","last_active":"2023-10-14T18:56:05.610181+0000","last_peered":"2023-10-14T18:56:05.610181+0000","last_clean":"2023-10-14T18:56:05.610181+0000","last_became_active":"2023-10-14T18:56:05.609454+0000","last_became_peered":"2023-10-14T18:56:05.609454+0000","last_unstale":"2023-10-14T18:56:05.610181+0000","last_undegraded":"2023-10-14T18:56:05.610181+0000","last_fullsized":"2023-10-14T18:56:05.610181+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:56.625874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.619522+0000","last_change":"2023-10-14T18:56:04.602684+0000","last_active":"2023-10-14T18:56:05.619522+0000","last_peered":"2023-10-14T18:56:05.619522+0000","last_clean":"2023-10-14T18:56:05.619522+0000","last_became_active":"2023-10-14T18:56:04.602473+0000","last_became_peered":"2023-10-14T18:56:04.602473+0000","last_unstale":"2023-10-14T18:56:05.619522+0000","last_undegraded":"2023-10-14T18:56:05.619522+0000","last_fullsized":"2023-10-14T18:56:05.619522+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608770+0000","last_change":"2023-10-14T18:56:05.608707+0000","last_active":"2023-10-14T18:56:05.608770+0000","last_peered":"2023-10-14T18:56:05.608770+0000","last_clean":"2023-10-14T18:56:05.608770+0000","last_became_active":"2023-10-14T18:56:05.608461+0000","last_became_peered":"2023-10-14T18:56:05.608461+0000","last_unstale":"2023-10-14T18:56:05.608770+0000","last_undegraded":"2023-10-14T18:56:05.608770+0000","last_fullsized":"2023-10-14T18:56:05.608770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:16.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618556+0000","last_change":"2023-10-14T18:56:04.612958+0000","last_active":"2023-10-14T18:56:05.618556+0000","last_peered":"2023-10-14T18:56:05.618556+0000","last_clean":"2023-10-14T18:56:05.618556+0000","last_became_active":"2023-10-14T18:56:04.611998+0000","last_became_peered":"2023-10-14T18:56:04.611998+0000","last_unstale":"2023-10-14T18:56:05.618556+0000","last_undegraded":"2023-10-14T18:56:05.618556+0000","last_fullsized":"2023-10-14T18:56:05.618556+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605336+0000","last_change":"2023-10-14T18:56:05.605243+0000","last_active":"2023-10-14T18:56:05.605336+0000","last_peered":"2023-10-14T18:56:05.605336+0000","last_clean":"2023-10-14T18:56:05.605336+0000","last_became_active":"2023-10-14T18:56:05.605029+0000","last_became_peered":"2023-10-14T18:56:05.605029+0000","last_unstale":"2023-10-14T18:56:05.605336+0000","last_undegraded":"2023-10-14T18:56:05.605336+0000","last_fullsized":"2023-10-14T18:56:05.605336+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:33.417917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.604281+0000","last_change":"2023-10-14T18:56:04.601361+0000","last_active":"2023-10-14T18:56:05.604281+0000","last_peered":"2023-10-14T18:56:05.604281+0000","last_clean":"2023-10-14T18:56:05.604281+0000","last_became_active":"2023-10-14T18:56:04.601140+0000","last_became_peered":"2023-10-14T18:56:04.601140+0000","last_unstale":"2023-10-14T18:56:05.604281+0000","last_undegraded":"2023-10-14T18:56:05.604281+0000","last_fullsized":"2023-10-14T18:56:05.604281+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607773+0000","last_change":"2023-10-14T18:56:05.607714+0000","last_active":"2023-10-14T18:56:05.607773+0000","last_peered":"2023-10-14T18:56:05.607773+0000","last_clean":"2023-10-14T18:56:05.607773+0000","last_became_active":"2023-10-14T18:56:05.607299+0000","last_became_peered":"2023-10-14T18:56:05.607299+0000","last_unstale":"2023-10-14T18:56:05.607773+0000","last_undegraded":"2023-10-14T18:56:05.607773+0000","last_fullsized":"2023-10-14T18:56:05.607773+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:39.733927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.599649+0000","last_change":"2023-10-14T18:56:04.604104+0000","last_active":"2023-10-14T18:56:05.599649+0000","last_peered":"2023-10-14T18:56:05.599649+0000","last_clean":"2023-10-14T18:56:05.599649+0000","last_became_active":"2023-10-14T18:56:04.603852+0000","last_became_peered":"2023-10-14T18:56:04.603852+0000","last_unstale":"2023-10-14T18:56:05.599649+0000","last_undegraded":"2023-10-14T18:56:05.599649+0000","last_fullsized":"2023-10-14T18:56:05.599649+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:18.126483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610779+0000","last_change":"2023-10-14T18:56:05.610402+0000","last_active":"2023-10-14T18:56:05.610779+0000","last_peered":"2023-10-14T18:56:05.610779+0000","last_clean":"2023-10-14T18:56:05.610779+0000","last_became_active":"2023-10-14T18:56:05.609832+0000","last_became_peered":"2023-10-14T18:56:05.609832+0000","last_unstale":"2023-10-14T18:56:05.610779+0000","last_undegraded":"2023-10-14T18:56:05.610779+0000","last_fullsized":"2023-10-14T18:56:05.610779+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:56.625874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"185'3","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.624516+0000","last_change":"2023-10-14T18:56:04.608406+0000","last_active":"2023-10-14T18:56:05.624516+0000","last_peered":"2023-10-14T18:56:05.624516+0000","last_clean":"2023-10-14T18:56:05.624516+0000","last_became_active":"2023-10-14T18:56:04.607955+0000","last_became_peered":"2023-10-14T18:56:04.607955+0000","last_unstale":"2023-10-14T18:56:05.624516+0000","last_undegraded":"2023-10-14T18:56:05.624516+0000","last_fullsized":"2023-10-14T18:56:05.624516+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:01.513803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612838+0000","last_change":"2023-10-14T18:56:05.612770+0000","last_active":"2023-10-14T18:56:05.612838+0000","last_peered":"2023-10-14T18:56:05.612838+0000","last_clean":"2023-10-14T18:56:05.612838+0000","last_became_active":"2023-10-14T18:56:05.612539+0000","last_became_peered":"2023-10-14T18:56:05.612539+0000","last_unstale":"2023-10-14T18:56:05.612838+0000","last_undegraded":"2023-10-14T18:56:05.612838+0000","last_fullsized":"2023-10-14T18:56:05.612838+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:17.878904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"185'6","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.627747+0000","last_change":"2023-10-14T18:56:04.612667+0000","last_active":"2023-10-14T18:56:05.627747+0000","last_peered":"2023-10-14T18:56:05.627747+0000","last_clean":"2023-10-14T18:56:05.627747+0000","last_became_active":"2023-10-14T18:56:04.612491+0000","last_became_peered":"2023-10-14T18:56:04.612491+0000","last_unstale":"2023-10-14T18:56:05.627747+0000","last_undegraded":"2023-10-14T18:56:05.627747+0000","last_fullsized":"2023-10-14T18:56:05.627747+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607877+0000","last_change":"2023-10-14T18:56:05.607833+0000","last_active":"2023-10-14T18:56:05.607877+0000","last_peered":"2023-10-14T18:56:05.607877+0000","last_clean":"2023-10-14T18:56:05.607877+0000","last_became_active":"2023-10-14T18:56:05.607538+0000","last_became_peered":"2023-10-14T18:56:05.607538+0000","last_unstale":"2023-10-14T18:56:05.607877+0000","last_undegraded":"2023-10-14T18:56:05.607877+0000","last_fullsized":"2023-10-14T18:56:05.607877+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:32.386515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621304+0000","last_change":"2023-10-14T18:56:04.605840+0000","last_active":"2023-10-14T18:56:05.621304+0000","last_peered":"2023-10-14T18:56:05.621304+0000","last_clean":"2023-10-14T18:56:05.621304+0000","last_became_active":"2023-10-14T18:56:04.605640+0000","last_became_peered":"2023-10-14T18:56:04.605640+0000","last_unstale":"2023-10-14T18:56:05.621304+0000","last_undegraded":"2023-10-14T18:56:05.621304+0000","last_fullsized":"2023-10-14T18:56:05.621304+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612327+0000","last_change":"2023-10-14T18:56:05.612252+0000","last_active":"2023-10-14T18:56:05.612327+0000","last_peered":"2023-10-14T18:56:05.612327+0000","last_clean":"2023-10-14T18:56:05.612327+0000","last_became_active":"2023-10-14T18:56:05.612011+0000","last_became_peered":"2023-10-14T18:56:05.612011+0000","last_unstale":"2023-10-14T18:56:05.612327+0000","last_undegraded":"2023-10-14T18:56:05.612327+0000","last_fullsized":"2023-10-14T18:56:05.612327+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:12:43.641846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601091+0000","last_change":"2023-10-14T18:56:04.608355+0000","last_active":"2023-10-14T18:56:05.601091+0000","last_peered":"2023-10-14T18:56:05.601091+0000","last_clean":"2023-10-14T18:56:05.601091+0000","last_became_active":"2023-10-14T18:56:04.608127+0000","last_became_peered":"2023-10-14T18:56:04.608127+0000","last_unstale":"2023-10-14T18:56:05.601091+0000","last_undegraded":"2023-10-14T18:56:05.601091+0000","last_fullsized":"2023-10-14T18:56:05.601091+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:41.225245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612465+0000","last_change":"2023-10-14T18:56:05.612410+0000","last_active":"2023-10-14T18:56:05.612465+0000","last_peered":"2023-10-14T18:56:05.612465+0000","last_clean":"2023-10-14T18:56:05.612465+0000","last_became_active":"2023-10-14T18:56:05.612187+0000","last_became_peered":"2023-10-14T18:56:05.612187+0000","last_unstale":"2023-10-14T18:56:05.612465+0000","last_undegraded":"2023-10-14T18:56:05.612465+0000","last_fullsized":"2023-10-14T18:56:05.612465+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:32.386515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606203+0000","last_change":"2023-10-14T18:56:04.604537+0000","last_active":"2023-10-14T18:56:05.606203+0000","last_peered":"2023-10-14T18:56:05.606203+0000","last_clean":"2023-10-14T18:56:05.606203+0000","last_became_active":"2023-10-14T18:56:04.604315+0000","last_became_peered":"2023-10-14T18:56:04.604315+0000","last_unstale":"2023-10-14T18:56:05.606203+0000","last_undegraded":"2023-10-14T18:56:05.606203+0000","last_fullsized":"2023-10-14T18:56:05.606203+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:30.783256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611457+0000","last_change":"2023-10-14T18:56:05.609943+0000","last_active":"2023-10-14T18:56:05.611457+0000","last_peered":"2023-10-14T18:56:05.611457+0000","last_clean":"2023-10-14T18:56:05.611457+0000","last_became_active":"2023-10-14T18:56:05.609684+0000","last_became_peered":"2023-10-14T18:56:05.609684+0000","last_unstale":"2023-10-14T18:56:05.611457+0000","last_undegraded":"2023-10-14T18:56:05.611457+0000","last_fullsized":"2023-10-14T18:56:05.611457+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:45.752458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"185'8","reported_seq":18,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626645+0000","last_change":"2023-10-14T18:56:04.610838+0000","last_active":"2023-10-14T18:56:05.626645+0000","last_peered":"2023-10-14T18:56:05.626645+0000","last_clean":"2023-10-14T18:56:05.626645+0000","last_became_active":"2023-10-14T18:56:04.610466+0000","last_became_peered":"2023-10-14T18:56:04.610466+0000","last_unstale":"2023-10-14T18:56:05.626645+0000","last_undegraded":"2023-10-14T18:56:05.626645+0000","last_fullsized":"2023-10-14T18:56:05.626645+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611906+0000","last_change":"2023-10-14T18:56:05.611846+0000","last_active":"2023-10-14T18:56:05.611906+0000","last_peered":"2023-10-14T18:56:05.611906+0000","last_clean":"2023-10-14T18:56:05.611906+0000","last_became_active":"2023-10-14T18:56:05.611629+0000","last_became_peered":"2023-10-14T18:56:05.611629+0000","last_unstale":"2023-10-14T18:56:05.611906+0000","last_undegraded":"2023-10-14T18:56:05.611906+0000","last_fullsized":"2023-10-14T18:56:05.611906+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:39.733927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622638+0000","last_change":"2023-10-14T18:56:04.614509+0000","last_active":"2023-10-14T18:56:05.622638+0000","last_peered":"2023-10-14T18:56:05.622638+0000","last_clean":"2023-10-14T18:56:05.622638+0000","last_became_active":"2023-10-14T18:56:04.614274+0000","last_became_peered":"2023-10-14T18:56:04.614274+0000","last_unstale":"2023-10-14T18:56:05.622638+0000","last_undegraded":"2023-10-14T18:56:05.622638+0000","last_fullsized":"2023-10-14T18:56:05.622638+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:30.069155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610796+0000","last_change":"2023-10-14T18:56:05.610535+0000","last_active":"2023-10-14T18:56:05.610796+0000","last_peered":"2023-10-14T18:56:05.610796+0000","last_clean":"2023-10-14T18:56:05.610796+0000","last_became_active":"2023-10-14T18:56:05.610132+0000","last_became_peered":"2023-10-14T18:56:05.610132+0000","last_unstale":"2023-10-14T18:56:05.610796+0000","last_undegraded":"2023-10-14T18:56:05.610796+0000","last_fullsized":"2023-10-14T18:56:05.610796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:19.160945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621349+0000","last_change":"2023-10-14T18:56:04.612413+0000","last_active":"2023-10-14T18:56:05.621349+0000","last_peered":"2023-10-14T18:56:05.621349+0000","last_clean":"2023-10-14T18:56:05.621349+0000","last_became_active":"2023-10-14T18:56:04.611474+0000","last_became_peered":"2023-10-14T18:56:04.611474+0000","last_unstale":"2023-10-14T18:56:05.621349+0000","last_undegraded":"2023-10-14T18:56:05.621349+0000","last_fullsized":"2023-10-14T18:56:05.621349+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:50.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610196+0000","last_change":"2023-10-14T18:56:05.610127+0000","last_active":"2023-10-14T18:56:05.610196+0000","last_peered":"2023-10-14T18:56:05.610196+0000","last_clean":"2023-10-14T18:56:05.610196+0000","last_became_active":"2023-10-14T18:56:05.609729+0000","last_became_peered":"2023-10-14T18:56:05.609729+0000","last_unstale":"2023-10-14T18:56:05.610196+0000","last_undegraded":"2023-10-14T18:56:05.610196+0000","last_fullsized":"2023-10-14T18:56:05.610196+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:11.247634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626552+0000","last_change":"2023-10-14T18:56:04.612224+0000","last_active":"2023-10-14T18:56:05.626552+0000","last_peered":"2023-10-14T18:56:05.626552+0000","last_clean":"2023-10-14T18:56:05.626552+0000","last_became_active":"2023-10-14T18:56:04.611503+0000","last_became_peered":"2023-10-14T18:56:04.611503+0000","last_unstale":"2023-10-14T18:56:05.626552+0000","last_undegraded":"2023-10-14T18:56:05.626552+0000","last_fullsized":"2023-10-14T18:56:05.626552+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:58:47.923458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609695+0000","last_change":"2023-10-14T18:56:05.609615+0000","last_active":"2023-10-14T18:56:05.609695+0000","last_peered":"2023-10-14T18:56:05.609695+0000","last_clean":"2023-10-14T18:56:05.609695+0000","last_became_active":"2023-10-14T18:56:05.609216+0000","last_became_peered":"2023-10-14T18:56:05.609216+0000","last_unstale":"2023-10-14T18:56:05.609695+0000","last_undegraded":"2023-10-14T18:56:05.609695+0000","last_fullsized":"2023-10-14T18:56:05.609695+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:00:00.327227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600487+0000","last_change":"2023-10-14T18:56:04.607440+0000","last_active":"2023-10-14T18:56:05.600487+0000","last_peered":"2023-10-14T18:56:05.600487+0000","last_clean":"2023-10-14T18:56:05.600487+0000","last_became_active":"2023-10-14T18:56:04.607205+0000","last_became_peered":"2023-10-14T18:56:04.607205+0000","last_unstale":"2023-10-14T18:56:05.600487+0000","last_undegraded":"2023-10-14T18:56:05.600487+0000","last_fullsized":"2023-10-14T18:56:05.600487+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:01.337710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610738+0000","last_change":"2023-10-14T18:56:05.609151+0000","last_active":"2023-10-14T18:56:05.610738+0000","last_peered":"2023-10-14T18:56:05.610738+0000","last_clean":"2023-10-14T18:56:05.610738+0000","last_became_active":"2023-10-14T18:56:05.608839+0000","last_became_peered":"2023-10-14T18:56:05.608839+0000","last_unstale":"2023-10-14T18:56:05.610738+0000","last_undegraded":"2023-10-14T18:56:05.610738+0000","last_fullsized":"2023-10-14T18:56:05.610738+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:10.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622094+0000","last_change":"2023-10-14T18:56:04.607989+0000","last_active":"2023-10-14T18:56:05.622094+0000","last_peered":"2023-10-14T18:56:05.622094+0000","last_clean":"2023-10-14T18:56:05.622094+0000","last_became_active":"2023-10-14T18:56:04.607756+0000","last_became_peered":"2023-10-14T18:56:04.607756+0000","last_unstale":"2023-10-14T18:56:05.622094+0000","last_undegraded":"2023-10-14T18:56:05.622094+0000","last_fullsized":"2023-10-14T18:56:05.622094+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:01.417122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605475+0000","last_change":"2023-10-14T18:56:05.605417+0000","last_active":"2023-10-14T18:56:05.605475+0000","last_peered":"2023-10-14T18:56:05.605475+0000","last_clean":"2023-10-14T18:56:05.605475+0000","last_became_active":"2023-10-14T18:56:05.605212+0000","last_became_peered":"2023-10-14T18:56:05.605212+0000","last_unstale":"2023-10-14T18:56:05.605475+0000","last_undegraded":"2023-10-14T18:56:05.605475+0000","last_fullsized":"2023-10-14T18:56:05.605475+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:31.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600682+0000","last_change":"2023-10-14T18:56:04.609141+0000","last_active":"2023-10-14T18:56:05.600682+0000","last_peered":"2023-10-14T18:56:05.600682+0000","last_clean":"2023-10-14T18:56:05.600682+0000","last_became_active":"2023-10-14T18:56:04.608839+0000","last_became_peered":"2023-10-14T18:56:04.608839+0000","last_unstale":"2023-10-14T18:56:05.600682+0000","last_undegraded":"2023-10-14T18:56:05.600682+0000","last_fullsized":"2023-10-14T18:56:05.600682+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:23.762007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607210+0000","last_change":"2023-10-14T18:56:05.607057+0000","last_active":"2023-10-14T18:56:05.607210+0000","last_peered":"2023-10-14T18:56:05.607210+0000","last_clean":"2023-10-14T18:56:05.607210+0000","last_became_active":"2023-10-14T18:56:05.606803+0000","last_became_peered":"2023-10-14T18:56:05.606803+0000","last_unstale":"2023-10-14T18:56:05.607210+0000","last_undegraded":"2023-10-14T18:56:05.607210+0000","last_fullsized":"2023-10-14T18:56:05.607210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:31.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607468+0000","last_change":"2023-10-14T18:56:04.607088+0000","last_active":"2023-10-14T18:56:05.607468+0000","last_peered":"2023-10-14T18:56:05.607468+0000","last_clean":"2023-10-14T18:56:05.607468+0000","last_became_active":"2023-10-14T18:56:04.606870+0000","last_became_peered":"2023-10-14T18:56:04.606870+0000","last_unstale":"2023-10-14T18:56:05.607468+0000","last_undegraded":"2023-10-14T18:56:05.607468+0000","last_fullsized":"2023-10-14T18:56:05.607468+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:41.225245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605925+0000","last_change":"2023-10-14T18:56:05.605860+0000","last_active":"2023-10-14T18:56:05.605925+0000","last_peered":"2023-10-14T18:56:05.605925+0000","last_clean":"2023-10-14T18:56:05.605925+0000","last_became_active":"2023-10-14T18:56:05.605631+0000","last_became_peered":"2023-10-14T18:56:05.605631+0000","last_unstale":"2023-10-14T18:56:05.605925+0000","last_undegraded":"2023-10-14T18:56:05.605925+0000","last_fullsized":"2023-10-14T18:56:05.605925+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:46.698834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601652+0000","last_change":"2023-10-14T18:56:04.612073+0000","last_active":"2023-10-14T18:56:05.601652+0000","last_peered":"2023-10-14T18:56:05.601652+0000","last_clean":"2023-10-14T18:56:05.601652+0000","last_became_active":"2023-10-14T18:56:04.611127+0000","last_became_peered":"2023-10-14T18:56:04.611127+0000","last_unstale":"2023-10-14T18:56:05.601652+0000","last_undegraded":"2023-10-14T18:56:05.601652+0000","last_fullsized":"2023-10-14T18:56:05.601652+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:31.648870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610230+0000","last_change":"2023-10-14T18:56:05.610154+0000","last_active":"2023-10-14T18:56:05.610230+0000","last_peered":"2023-10-14T18:56:05.610230+0000","last_clean":"2023-10-14T18:56:05.610230+0000","last_became_active":"2023-10-14T18:56:05.609132+0000","last_became_peered":"2023-10-14T18:56:05.609132+0000","last_unstale":"2023-10-14T18:56:05.610230+0000","last_undegraded":"2023-10-14T18:56:05.610230+0000","last_fullsized":"2023-10-14T18:56:05.610230+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:30.803100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622639+0000","last_change":"2023-10-14T18:56:04.609389+0000","last_active":"2023-10-14T18:56:05.622639+0000","last_peered":"2023-10-14T18:56:05.622639+0000","last_clean":"2023-10-14T18:56:05.622639+0000","last_became_active":"2023-10-14T18:56:04.608611+0000","last_became_peered":"2023-10-14T18:56:04.608611+0000","last_unstale":"2023-10-14T18:56:05.622639+0000","last_undegraded":"2023-10-14T18:56:05.622639+0000","last_fullsized":"2023-10-14T18:56:05.622639+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:48.050809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.624320+0000","last_change":"2023-10-14T18:56:05.624250+0000","last_active":"2023-10-14T18:56:05.624320+0000","last_peered":"2023-10-14T18:56:05.624320+0000","last_clean":"2023-10-14T18:56:05.624320+0000","last_became_active":"2023-10-14T18:56:05.623971+0000","last_became_peered":"2023-10-14T18:56:05.623971+0000","last_unstale":"2023-10-14T18:56:05.624320+0000","last_undegraded":"2023-10-14T18:56:05.624320+0000","last_fullsized":"2023-10-14T18:56:05.624320+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:25.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608596+0000","last_change":"2023-10-14T18:56:04.609915+0000","last_active":"2023-10-14T18:56:05.608596+0000","last_peered":"2023-10-14T18:56:05.608596+0000","last_clean":"2023-10-14T18:56:05.608596+0000","last_became_active":"2023-10-14T18:56:04.609680+0000","last_became_peered":"2023-10-14T18:56:04.609680+0000","last_unstale":"2023-10-14T18:56:05.608596+0000","last_undegraded":"2023-10-14T18:56:05.608596+0000","last_fullsized":"2023-10-14T18:56:05.608596+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:45.696638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609444+0000","last_change":"2023-10-14T18:56:05.609332+0000","last_active":"2023-10-14T18:56:05.609444+0000","last_peered":"2023-10-14T18:56:05.609444+0000","last_clean":"2023-10-14T18:56:05.609444+0000","last_became_active":"2023-10-14T18:56:05.609090+0000","last_became_peered":"2023-10-14T18:56:05.609090+0000","last_unstale":"2023-10-14T18:56:05.609444+0000","last_undegraded":"2023-10-14T18:56:05.609444+0000","last_fullsized":"2023-10-14T18:56:05.609444+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:51.335054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618657+0000","last_change":"2023-10-14T18:56:04.613106+0000","last_active":"2023-10-14T18:56:05.618657+0000","last_peered":"2023-10-14T18:56:05.618657+0000","last_clean":"2023-10-14T18:56:05.618657+0000","last_became_active":"2023-10-14T18:56:04.612296+0000","last_became_peered":"2023-10-14T18:56:04.612296+0000","last_unstale":"2023-10-14T18:56:05.618657+0000","last_undegraded":"2023-10-14T18:56:05.618657+0000","last_fullsized":"2023-10-14T18:56:05.618657+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:24.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.602058+0000","last_change":"2023-10-14T18:56:05.602016+0000","last_active":"2023-10-14T18:56:05.602058+0000","last_peered":"2023-10-14T18:56:05.602058+0000","last_clean":"2023-10-14T18:56:05.602058+0000","last_became_active":"2023-10-14T18:56:05.601842+0000","last_became_peered":"2023-10-14T18:56:05.601842+0000","last_unstale":"2023-10-14T18:56:05.602058+0000","last_undegraded":"2023-10-14T18:56:05.602058+0000","last_fullsized":"2023-10-14T18:56:05.602058+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:19.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601008+0000","last_change":"2023-10-14T18:56:04.613391+0000","last_active":"2023-10-14T18:56:05.601008+0000","last_peered":"2023-10-14T18:56:05.601008+0000","last_clean":"2023-10-14T18:56:05.601008+0000","last_became_active":"2023-10-14T18:56:04.613217+0000","last_became_peered":"2023-10-14T18:56:04.613217+0000","last_unstale":"2023-10-14T18:56:05.601008+0000","last_undegraded":"2023-10-14T18:56:05.601008+0000","last_fullsized":"2023-10-14T18:56:05.601008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:30.783256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603571+0000","last_change":"2023-10-14T18:56:05.602960+0000","last_active":"2023-10-14T18:56:05.603571+0000","last_peered":"2023-10-14T18:56:05.603571+0000","last_clean":"2023-10-14T18:56:05.603571+0000","last_became_active":"2023-10-14T18:56:05.602474+0000","last_became_peered":"2023-10-14T18:56:05.602474+0000","last_unstale":"2023-10-14T18:56:05.603571+0000","last_undegraded":"2023-10-14T18:56:05.603571+0000","last_fullsized":"2023-10-14T18:56:05.603571+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:12.123197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607379+0000","last_change":"2023-10-14T18:56:04.611054+0000","last_active":"2023-10-14T18:56:05.607379+0000","last_peered":"2023-10-14T18:56:05.607379+0000","last_clean":"2023-10-14T18:56:05.607379+0000","last_became_active":"2023-10-14T18:56:04.610498+0000","last_became_peered":"2023-10-14T18:56:04.610498+0000","last_unstale":"2023-10-14T18:56:05.607379+0000","last_undegraded":"2023-10-14T18:56:05.607379+0000","last_fullsized":"2023-10-14T18:56:05.607379+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610467+0000","last_change":"2023-10-14T18:56:05.610333+0000","last_active":"2023-10-14T18:56:05.610467+0000","last_peered":"2023-10-14T18:56:05.610467+0000","last_clean":"2023-10-14T18:56:05.610467+0000","last_became_active":"2023-10-14T18:56:05.609904+0000","last_became_peered":"2023-10-14T18:56:05.609904+0000","last_unstale":"2023-10-14T18:56:05.610467+0000","last_undegraded":"2023-10-14T18:56:05.610467+0000","last_fullsized":"2023-10-14T18:56:05.610467+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:59.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606291+0000","last_change":"2023-10-14T18:56:04.609482+0000","last_active":"2023-10-14T18:56:05.606291+0000","last_peered":"2023-10-14T18:56:05.606291+0000","last_clean":"2023-10-14T18:56:05.606291+0000","last_became_active":"2023-10-14T18:56:04.609222+0000","last_became_peered":"2023-10-14T18:56:04.609222+0000","last_unstale":"2023-10-14T18:56:05.606291+0000","last_undegraded":"2023-10-14T18:56:05.606291+0000","last_fullsized":"2023-10-14T18:56:05.606291+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:16.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605913+0000","last_change":"2023-10-14T18:56:05.605850+0000","last_active":"2023-10-14T18:56:05.605913+0000","last_peered":"2023-10-14T18:56:05.605913+0000","last_clean":"2023-10-14T18:56:05.605913+0000","last_became_active":"2023-10-14T18:56:05.605574+0000","last_became_peered":"2023-10-14T18:56:05.605574+0000","last_unstale":"2023-10-14T18:56:05.605913+0000","last_undegraded":"2023-10-14T18:56:05.605913+0000","last_fullsized":"2023-10-14T18:56:05.605913+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:21.835340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605144+0000","last_change":"2023-10-14T18:56:04.609233+0000","last_active":"2023-10-14T18:56:05.605144+0000","last_peered":"2023-10-14T18:56:05.605144+0000","last_clean":"2023-10-14T18:56:05.605144+0000","last_became_active":"2023-10-14T18:56:04.608951+0000","last_became_peered":"2023-10-14T18:56:04.608951+0000","last_unstale":"2023-10-14T18:56:05.605144+0000","last_undegraded":"2023-10-14T18:56:05.605144+0000","last_fullsized":"2023-10-14T18:56:05.605144+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:30.965390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613828+0000","last_change":"2023-10-14T18:56:05.612915+0000","last_active":"2023-10-14T18:56:05.613828+0000","last_peered":"2023-10-14T18:56:05.613828+0000","last_clean":"2023-10-14T18:56:05.613828+0000","last_became_active":"2023-10-14T18:56:05.612185+0000","last_became_peered":"2023-10-14T18:56:05.612185+0000","last_unstale":"2023-10-14T18:56:05.613828+0000","last_undegraded":"2023-10-14T18:56:05.613828+0000","last_fullsized":"2023-10-14T18:56:05.613828+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:23.654861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606367+0000","last_change":"2023-10-14T18:56:04.611465+0000","last_active":"2023-10-14T18:56:05.606367+0000","last_peered":"2023-10-14T18:56:05.606367+0000","last_clean":"2023-10-14T18:56:05.606367+0000","last_became_active":"2023-10-14T18:56:04.611248+0000","last_became_peered":"2023-10-14T18:56:04.611248+0000","last_unstale":"2023-10-14T18:56:05.606367+0000","last_undegraded":"2023-10-14T18:56:05.606367+0000","last_fullsized":"2023-10-14T18:56:05.606367+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607071+0000","last_change":"2023-10-14T18:56:05.606997+0000","last_active":"2023-10-14T18:56:05.607071+0000","last_peered":"2023-10-14T18:56:05.607071+0000","last_clean":"2023-10-14T18:56:05.607071+0000","last_became_active":"2023-10-14T18:56:05.606759+0000","last_became_peered":"2023-10-14T18:56:05.606759+0000","last_unstale":"2023-10-14T18:56:05.607071+0000","last_undegraded":"2023-10-14T18:56:05.607071+0000","last_fullsized":"2023-10-14T18:56:05.607071+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:11.247634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607481+0000","last_change":"2023-10-14T18:56:04.611208+0000","last_active":"2023-10-14T18:56:05.607481+0000","last_peered":"2023-10-14T18:56:05.607481+0000","last_clean":"2023-10-14T18:56:05.607481+0000","last_became_active":"2023-10-14T18:56:04.610816+0000","last_became_peered":"2023-10-14T18:56:04.610816+0000","last_unstale":"2023-10-14T18:56:05.607481+0000","last_undegraded":"2023-10-14T18:56:05.607481+0000","last_fullsized":"2023-10-14T18:56:05.607481+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":329,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600779+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:05.600779+0000","last_peered":"2023-10-14T18:56:05.600779+0000","last_clean":"2023-10-14T18:56:05.600779+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:05.600779+0000","last_undegraded":"2023-10-14T18:56:05.600779+0000","last_fullsized":"2023-10-14T18:56:05.600779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193717,"statfs":{"total":200000000,"available":198367047,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.32200000000000001,"15min":0.26000000000000001},"max":{"1min":0.76800000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.437,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42299999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.499,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.71299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":7.8129999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.41399999999999998,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.443},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73499999999999999,"5min":0.79500000000000004,"15min":0.90400000000000003},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46899999999999997,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.77000000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.498,"15min":0.498},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.84299999999999997},"last":0.49299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81699999999999995,"5min":0.83999999999999997,"15min":0.89500000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71899999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.81799999999999995,"15min":0.92300000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80500000000000005,"15min":0.95699999999999996},"last":0.53600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.78800000000000003},"last":0.505},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.53100000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.83599999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.71999999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.64700000000000002,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.78700000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.34799999999999998,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.75800000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.46700000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.38300000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.432,"5min":3.992,"15min":3.992},"last":0.373}]},{"osd":2,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44400000000000001,"5min":1.252,"15min":1.252},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.59799999999999998},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.496,"5min":1.3340000000000001,"15min":10.574},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":10.792,"15min":10.792},"last":0.32400000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76300000000000001,"5min":3.536,"15min":3.536},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.38200000000000001},"max":{"1min":0.77800000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":1.504,"15min":1.504},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84799999999999998,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":1.288,"15min":1.288},"last":0.73199999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":3.577,"15min":3.577},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1591,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193721,"statfs":{"total":200000000,"available":198370308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.497,"5min":0.51100000000000001,"15min":0.59599999999999997},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.23799999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53900000000000003,"5min":0.57299999999999995,"15min":0.623},"last":0.25800000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.35899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36799999999999999},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.41399999999999998,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.38}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.63500000000000001,"15min":0.60399999999999998},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.316},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.623,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.34000000000000002},"max":{"1min":0.81899999999999995,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.60099999999999998,"15min":0.57299999999999995},"min":{"1min":0.46300000000000002,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.435}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.50800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61799999999999999,"15min":0.58899999999999997},"min":{"1min":0.41799999999999998,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.874,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.625,"15min":0.59499999999999997},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.379},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.625,"15min":0.58999999999999997},"min":{"1min":0.48599999999999999,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.92500000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.46999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.26600000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.223},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.28100000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.48599999999999999,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.34699999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40400000000000003,"15min":0.38500000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":1.006},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.30499999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56100000000000005,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.4820000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47599999999999998}]},{"osd":5,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.87,"15min":3.5419999999999998},"last":0.44400000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.496},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0429999999999999},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.48699999999999999,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.248},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27800000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.309}]},{"osd":2,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.33000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.37},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.34200000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.442},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.435}]},{"osd":5,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.86899999999999999,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.47499999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.42699999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.504},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.37},"max":{"1min":0.84799999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.40899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1017,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194294,"statfs":{"total":200000000,"available":198958059,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.746,"15min":0.83399999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.497}]},{"osd":2,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.55500000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.81000000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65800000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.254,"15min":0.254},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.629}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194295,"statfs":{"total":200000000,"available":198959089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.76100000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73799999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51300000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.79900000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.376,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.33100000000000002},"max":{"1min":0.71699999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72699999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47999999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.69699999999999995,"5min":0.74099999999999999,"15min":0.75},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.89300000000000002},"last":0.379},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.49199999999999999,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.92800000000000005},"last":0.442}]},{"osd":6,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.74199999999999999,"15min":0.746},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.42099999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81899999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.80500000000000005},"last":0.39200000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:14.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.354+0000 7f3708a53700 1 Processor -- start 2023-10-14T18:56:14.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.354+0000 7f3708a53700 1 -- start start 2023-10-14T18:56:14.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f370415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f370415a620 0x7f370415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f370415d580 0x7f3704158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370415cbb0 con 0x7f370415a620 2023-10-14T18:56:14.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370415bfa0 con 0x7f370415d580 2023-10-14T18:56:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3708a53700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370415c280 con 0x7f3704157870 2023-10-14T18:56:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.355+0000 7f3701d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f370415a620 0x7f370415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f370415a620 0x7f370415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39478/0 (socket says 172.21.15.79:39478) 2023-10-14T18:56:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 -- 172.21.15.79:0/4180495269 learned_addr learned my addr 172.21.15.79:0/4180495269 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:14.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3702d9d700 1 --2- 172.21.15.79:0/4180495269 >> v2:172.21.15.144:3300/0 conn(0x7f370415d580 0x7f3704158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f370259c700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f370415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 -- 172.21.15.79:0/4180495269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 msgr2=0x7f370415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f370415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 -- 172.21.15.79:0/4180495269 >> v2:172.21.15.144:3300/0 conn(0x7f370415d580 msgr2=0x7f3704158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:14.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 --2- 172.21.15.79:0/4180495269 >> v2:172.21.15.144:3300/0 conn(0x7f370415d580 0x7f3704158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 -- 172.21.15.79:0/4180495269 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370415c560 con 0x7f370415a620 2023-10-14T18:56:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f3701d9b700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415a620 0x7f370415d040 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f37040b03b0 tx=0x7f36f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f670874cd1cb2af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f370159a700 1 -- 172.21.15.79:0/4180495269 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800b860 con 0x7f370415a620 2023-10-14T18:56:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f370159a700 1 -- 172.21.15.79:0/4180495269 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f800b9c0 con 0x7f370415a620 2023-10-14T18:56:14.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.356+0000 7f370159a700 1 -- 172.21.15.79:0/4180495269 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800bd60 con 0x7f370415a620 2023-10-14T18:56:14.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 -- 172.21.15.79:0/4180495269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415a620 msgr2=0x7f370415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415a620 0x7f370415d040 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f37040b03b0 tx=0x7f36f8009250 comp rx=0 tx=0).stop 2023-10-14T18:56:14.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 -- 172.21.15.79:0/4180495269 shutdown_connections 2023-10-14T18:56:14.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f370415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 --2- 172.21.15.79:0/4180495269 >> v2:172.21.15.144:3300/0 conn(0x7f370415d580 0x7f3704158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 --2- 172.21.15.79:0/4180495269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415a620 0x7f370415d040 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 -- 172.21.15.79:0/4180495269 >> 172.21.15.79:0/4180495269 conn(0x7f3704068ce0 msgr2=0x7f37040690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:14.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 -- 172.21.15.79:0/4180495269 shutdown_connections 2023-10-14T18:56:14.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.357+0000 7f3708a53700 1 -- 172.21.15.79:0/4180495269 wait complete. 2023-10-14T18:56:14.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.358+0000 7f3708a53700 1 Processor -- start 2023-10-14T18:56:14.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.358+0000 7f3708a53700 1 -- start start 2023-10-14T18:56:14.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f37040cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370415a620 0x7f37040b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040d0ba0 con 0x7f370415d580 2023-10-14T18:56:14.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040d0020 con 0x7f370415a620 2023-10-14T18:56:14.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040d0300 con 0x7f3704157870 2023-10-14T18:56:14.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39484/0 (socket says 172.21.15.79:39484) 2023-10-14T18:56:14.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 -- 172.21.15.79:0/1337269268 learned_addr learned my addr 172.21.15.79:0/1337269268 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:14.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3701d9b700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370415a620 0x7f37040b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f370259c700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f37040cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 -- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 msgr2=0x7f37040cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f37040cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 -- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370415a620 msgr2=0x7f37040b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370415a620 0x7f37040b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 -- 172.21.15.79:0/1337269268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80094f0 con 0x7f370415d580 2023-10-14T18:56:14.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3702d9d700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d860 tx=0x7f36fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0125f0 con 0x7f370415d580 2023-10-14T18:56:14.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc012750 con 0x7f370415d580 2023-10-14T18:56:14.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040d05e0 con 0x7f370415d580 2023-10-14T18:56:14.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc012af0 con 0x7f370415d580 2023-10-14T18:56:14.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.359+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040b1570 con 0x7f370415d580 2023-10-14T18:56:14.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.360+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370404c3c0 con 0x7f370415d580 2023-10-14T18:56:14.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.361+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36fc013480 con 0x7f370415d580 2023-10-14T18:56:14.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.361+0000 7f36f27fc700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 0x7f36e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.361+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36fc0847e0 con 0x7f370415d580 2023-10-14T18:56:14.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.361+0000 7f370259c700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 0x7f36e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.362+0000 7f370259c700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 0x7f36e40693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009fd0 tx=0x7f36f4009880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.365+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36fc051a50 con 0x7f370415d580 2023-10-14T18:56:14.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.544+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f370415c840 con 0x7f36e4066f30 2023-10-14T18:56:14.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.552+0000 7f36f27fc700 1 -- 172.21.15.79:0/1337269268 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285810 (secure 0 0 0) 0x7f370415c840 con 0x7f36e4066f30 2023-10-14T18:56:14.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 msgr2=0x7f36e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 0x7f36e40693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009fd0 tx=0x7f36f4009880 comp rx=0 tx=0).stop 2023-10-14T18:56:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 msgr2=0x7f37040b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00d860 tx=0x7f36fc008040 comp rx=0 tx=0).stop 2023-10-14T18:56:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 shutdown_connections 2023-10-14T18:56:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f36e4066f30 0x7f36e40693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f370415d580 0x7f37040b1030 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3704157870 0x7f37040cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 --2- 172.21.15.79:0/1337269268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f370415a620 0x7f37040b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 >> 172.21.15.79:0/1337269268 conn(0x7f3704068ce0 msgr2=0x7f370415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 shutdown_connections 2023-10-14T18:56:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.555+0000 7f3708a53700 1 -- 172.21.15.79:0/1337269268 wait complete. 2023-10-14T18:56:14.562 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:14.568 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":514,"stamp":"2023-10-14T18:56:14.496758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9284,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553215,"statfs":{"total":1600000000,"available":1590492983,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.897122"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605640+0000","last_change":"2023-10-14T18:56:05.605515+0000","last_active":"2023-10-14T18:56:05.605640+0000","last_peered":"2023-10-14T18:56:05.605640+0000","last_clean":"2023-10-14T18:56:05.605640+0000","last_became_active":"2023-10-14T18:56:05.605273+0000","last_became_peered":"2023-10-14T18:56:05.605273+0000","last_unstale":"2023-10-14T18:56:05.605640+0000","last_undegraded":"2023-10-14T18:56:05.605640+0000","last_fullsized":"2023-10-14T18:56:05.605640+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:25.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623057+0000","last_change":"2023-10-14T18:56:05.623002+0000","last_active":"2023-10-14T18:56:05.623057+0000","last_peered":"2023-10-14T18:56:05.623057+0000","last_clean":"2023-10-14T18:56:05.623057+0000","last_became_active":"2023-10-14T18:56:05.622267+0000","last_became_peered":"2023-10-14T18:56:05.622267+0000","last_unstale":"2023-10-14T18:56:05.623057+0000","last_undegraded":"2023-10-14T18:56:05.623057+0000","last_fullsized":"2023-10-14T18:56:05.623057+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:55:47.503324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613844+0000","last_change":"2023-10-14T18:56:05.613057+0000","last_active":"2023-10-14T18:56:05.613844+0000","last_peered":"2023-10-14T18:56:05.613844+0000","last_clean":"2023-10-14T18:56:05.613844+0000","last_became_active":"2023-10-14T18:56:05.612494+0000","last_became_peered":"2023-10-14T18:56:05.612494+0000","last_unstale":"2023-10-14T18:56:05.613844+0000","last_undegraded":"2023-10-14T18:56:05.613844+0000","last_fullsized":"2023-10-14T18:56:05.613844+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:38.769225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611542+0000","last_change":"2023-10-14T18:56:05.611489+0000","last_active":"2023-10-14T18:56:05.611542+0000","last_peered":"2023-10-14T18:56:05.611542+0000","last_clean":"2023-10-14T18:56:05.611542+0000","last_became_active":"2023-10-14T18:56:05.611285+0000","last_became_peered":"2023-10-14T18:56:05.611285+0000","last_unstale":"2023-10-14T18:56:05.611542+0000","last_undegraded":"2023-10-14T18:56:05.611542+0000","last_fullsized":"2023-10-14T18:56:05.611542+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:07.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.619418+0000","last_change":"2023-10-14T18:56:05.619231+0000","last_active":"2023-10-14T18:56:05.619418+0000","last_peered":"2023-10-14T18:56:05.619418+0000","last_clean":"2023-10-14T18:56:05.619418+0000","last_became_active":"2023-10-14T18:56:05.619037+0000","last_became_peered":"2023-10-14T18:56:05.619037+0000","last_unstale":"2023-10-14T18:56:05.619418+0000","last_undegraded":"2023-10-14T18:56:05.619418+0000","last_fullsized":"2023-10-14T18:56:05.619418+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:31.785452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605353+0000","last_change":"2023-10-14T18:56:05.605304+0000","last_active":"2023-10-14T18:56:05.605353+0000","last_peered":"2023-10-14T18:56:05.605353+0000","last_clean":"2023-10-14T18:56:05.605353+0000","last_became_active":"2023-10-14T18:56:05.605085+0000","last_became_peered":"2023-10-14T18:56:05.605085+0000","last_unstale":"2023-10-14T18:56:05.605353+0000","last_undegraded":"2023-10-14T18:56:05.605353+0000","last_fullsized":"2023-10-14T18:56:05.605353+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:40:24.783876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608184+0000","last_change":"2023-10-14T18:56:05.608086+0000","last_active":"2023-10-14T18:56:05.608184+0000","last_peered":"2023-10-14T18:56:05.608184+0000","last_clean":"2023-10-14T18:56:05.608184+0000","last_became_active":"2023-10-14T18:56:05.607869+0000","last_became_peered":"2023-10-14T18:56:05.607869+0000","last_unstale":"2023-10-14T18:56:05.608184+0000","last_undegraded":"2023-10-14T18:56:05.608184+0000","last_fullsized":"2023-10-14T18:56:05.608184+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:35:02.575507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621083+0000","last_change":"2023-10-14T18:56:05.621018+0000","last_active":"2023-10-14T18:56:05.621083+0000","last_peered":"2023-10-14T18:56:05.621083+0000","last_clean":"2023-10-14T18:56:05.621083+0000","last_became_active":"2023-10-14T18:56:05.620685+0000","last_became_peered":"2023-10-14T18:56:05.620685+0000","last_unstale":"2023-10-14T18:56:05.621083+0000","last_undegraded":"2023-10-14T18:56:05.621083+0000","last_fullsized":"2023-10-14T18:56:05.621083+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:02.419318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622686+0000","last_change":"2023-10-14T18:56:05.622621+0000","last_active":"2023-10-14T18:56:05.622686+0000","last_peered":"2023-10-14T18:56:05.622686+0000","last_clean":"2023-10-14T18:56:05.622686+0000","last_became_active":"2023-10-14T18:56:05.622394+0000","last_became_peered":"2023-10-14T18:56:05.622394+0000","last_unstale":"2023-10-14T18:56:05.622686+0000","last_undegraded":"2023-10-14T18:56:05.622686+0000","last_fullsized":"2023-10-14T18:56:05.622686+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:13.982676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622486+0000","last_change":"2023-10-14T18:56:05.621975+0000","last_active":"2023-10-14T18:56:05.622486+0000","last_peered":"2023-10-14T18:56:05.622486+0000","last_clean":"2023-10-14T18:56:05.622486+0000","last_became_active":"2023-10-14T18:56:05.620216+0000","last_became_peered":"2023-10-14T18:56:05.620216+0000","last_unstale":"2023-10-14T18:56:05.622486+0000","last_undegraded":"2023-10-14T18:56:05.622486+0000","last_fullsized":"2023-10-14T18:56:05.622486+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:05.822336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.620948+0000","last_change":"2023-10-14T18:56:05.620691+0000","last_active":"2023-10-14T18:56:05.620948+0000","last_peered":"2023-10-14T18:56:05.620948+0000","last_clean":"2023-10-14T18:56:05.620948+0000","last_became_active":"2023-10-14T18:56:05.620449+0000","last_became_peered":"2023-10-14T18:56:05.620449+0000","last_unstale":"2023-10-14T18:56:05.620948+0000","last_undegraded":"2023-10-14T18:56:05.620948+0000","last_fullsized":"2023-10-14T18:56:05.620948+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:49.053006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623650+0000","last_change":"2023-10-14T18:56:05.623559+0000","last_active":"2023-10-14T18:56:05.623650+0000","last_peered":"2023-10-14T18:56:05.623650+0000","last_clean":"2023-10-14T18:56:05.623650+0000","last_became_active":"2023-10-14T18:56:05.623337+0000","last_became_peered":"2023-10-14T18:56:05.623337+0000","last_unstale":"2023-10-14T18:56:05.623650+0000","last_undegraded":"2023-10-14T18:56:05.623650+0000","last_fullsized":"2023-10-14T18:56:05.623650+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:17.878904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613799+0000","last_change":"2023-10-14T18:56:05.612729+0000","last_active":"2023-10-14T18:56:05.613799+0000","last_peered":"2023-10-14T18:56:05.613799+0000","last_clean":"2023-10-14T18:56:05.613799+0000","last_became_active":"2023-10-14T18:56:05.611857+0000","last_became_peered":"2023-10-14T18:56:05.611857+0000","last_unstale":"2023-10-14T18:56:05.613799+0000","last_undegraded":"2023-10-14T18:56:05.613799+0000","last_fullsized":"2023-10-14T18:56:05.613799+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:15.204768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610701+0000","last_change":"2023-10-14T18:56:05.609031+0000","last_active":"2023-10-14T18:56:05.610701+0000","last_peered":"2023-10-14T18:56:05.610701+0000","last_clean":"2023-10-14T18:56:05.610701+0000","last_became_active":"2023-10-14T18:56:05.608477+0000","last_became_peered":"2023-10-14T18:56:05.608477+0000","last_unstale":"2023-10-14T18:56:05.610701+0000","last_undegraded":"2023-10-14T18:56:05.610701+0000","last_fullsized":"2023-10-14T18:56:05.610701+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:46.275968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.615688+0000","last_change":"2023-10-14T18:56:05.615612+0000","last_active":"2023-10-14T18:56:05.615688+0000","last_peered":"2023-10-14T18:56:05.615688+0000","last_clean":"2023-10-14T18:56:05.615688+0000","last_became_active":"2023-10-14T18:56:05.615148+0000","last_became_peered":"2023-10-14T18:56:05.615148+0000","last_unstale":"2023-10-14T18:56:05.615688+0000","last_undegraded":"2023-10-14T18:56:05.615688+0000","last_fullsized":"2023-10-14T18:56:05.615688+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:12.444664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606658+0000","last_change":"2023-10-14T18:56:05.606601+0000","last_active":"2023-10-14T18:56:05.606658+0000","last_peered":"2023-10-14T18:56:05.606658+0000","last_clean":"2023-10-14T18:56:05.606658+0000","last_became_active":"2023-10-14T18:56:05.606383+0000","last_became_peered":"2023-10-14T18:56:05.606383+0000","last_unstale":"2023-10-14T18:56:05.606658+0000","last_undegraded":"2023-10-14T18:56:05.606658+0000","last_fullsized":"2023-10-14T18:56:05.606658+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:34:13.885048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611033+0000","last_change":"2023-10-14T18:56:05.610972+0000","last_active":"2023-10-14T18:56:05.611033+0000","last_peered":"2023-10-14T18:56:05.611033+0000","last_clean":"2023-10-14T18:56:05.611033+0000","last_became_active":"2023-10-14T18:56:05.610724+0000","last_became_peered":"2023-10-14T18:56:05.610724+0000","last_unstale":"2023-10-14T18:56:05.611033+0000","last_undegraded":"2023-10-14T18:56:05.611033+0000","last_fullsized":"2023-10-14T18:56:05.611033+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:12:14.968254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.602808+0000","last_change":"2023-10-14T18:56:05.602696+0000","last_active":"2023-10-14T18:56:05.602808+0000","last_peered":"2023-10-14T18:56:05.602808+0000","last_clean":"2023-10-14T18:56:05.602808+0000","last_became_active":"2023-10-14T18:56:05.602481+0000","last_became_peered":"2023-10-14T18:56:05.602481+0000","last_unstale":"2023-10-14T18:56:05.602808+0000","last_undegraded":"2023-10-14T18:56:05.602808+0000","last_fullsized":"2023-10-14T18:56:05.602808+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:45:07.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607023+0000","last_change":"2023-10-14T18:56:05.606963+0000","last_active":"2023-10-14T18:56:05.607023+0000","last_peered":"2023-10-14T18:56:05.607023+0000","last_clean":"2023-10-14T18:56:05.607023+0000","last_became_active":"2023-10-14T18:56:05.606754+0000","last_became_peered":"2023-10-14T18:56:05.606754+0000","last_unstale":"2023-10-14T18:56:05.607023+0000","last_undegraded":"2023-10-14T18:56:05.607023+0000","last_fullsized":"2023-10-14T18:56:05.607023+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:51.273844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612322+0000","last_change":"2023-10-14T18:56:05.612202+0000","last_active":"2023-10-14T18:56:05.612322+0000","last_peered":"2023-10-14T18:56:05.612322+0000","last_clean":"2023-10-14T18:56:05.612322+0000","last_became_active":"2023-10-14T18:56:05.612004+0000","last_became_peered":"2023-10-14T18:56:05.612004+0000","last_unstale":"2023-10-14T18:56:05.612322+0000","last_undegraded":"2023-10-14T18:56:05.612322+0000","last_fullsized":"2023-10-14T18:56:05.612322+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:49.053006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609623+0000","last_change":"2023-10-14T18:56:05.609565+0000","last_active":"2023-10-14T18:56:05.609623+0000","last_peered":"2023-10-14T18:56:05.609623+0000","last_clean":"2023-10-14T18:56:05.609623+0000","last_became_active":"2023-10-14T18:56:05.609350+0000","last_became_peered":"2023-10-14T18:56:05.609350+0000","last_unstale":"2023-10-14T18:56:05.609623+0000","last_undegraded":"2023-10-14T18:56:05.609623+0000","last_fullsized":"2023-10-14T18:56:05.609623+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:36:30.555116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623192+0000","last_change":"2023-10-14T18:56:05.623126+0000","last_active":"2023-10-14T18:56:05.623192+0000","last_peered":"2023-10-14T18:56:05.623192+0000","last_clean":"2023-10-14T18:56:05.623192+0000","last_became_active":"2023-10-14T18:56:05.622698+0000","last_became_peered":"2023-10-14T18:56:05.622698+0000","last_unstale":"2023-10-14T18:56:05.623192+0000","last_undegraded":"2023-10-14T18:56:05.623192+0000","last_fullsized":"2023-10-14T18:56:05.623192+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.478842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605876+0000","last_change":"2023-10-14T18:56:05.605795+0000","last_active":"2023-10-14T18:56:05.605876+0000","last_peered":"2023-10-14T18:56:05.605876+0000","last_clean":"2023-10-14T18:56:05.605876+0000","last_became_active":"2023-10-14T18:56:05.605577+0000","last_became_peered":"2023-10-14T18:56:05.605577+0000","last_unstale":"2023-10-14T18:56:05.605876+0000","last_undegraded":"2023-10-14T18:56:05.605876+0000","last_fullsized":"2023-10-14T18:56:05.605876+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:18:20.309870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623630+0000","last_change":"2023-10-14T18:56:05.623541+0000","last_active":"2023-10-14T18:56:05.623630+0000","last_peered":"2023-10-14T18:56:05.623630+0000","last_clean":"2023-10-14T18:56:05.623630+0000","last_became_active":"2023-10-14T18:56:05.623279+0000","last_became_peered":"2023-10-14T18:56:05.623279+0000","last_unstale":"2023-10-14T18:56:05.623630+0000","last_undegraded":"2023-10-14T18:56:05.623630+0000","last_fullsized":"2023-10-14T18:56:05.623630+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:59.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613859+0000","last_change":"2023-10-14T18:56:05.613618+0000","last_active":"2023-10-14T18:56:05.613859+0000","last_peered":"2023-10-14T18:56:05.613859+0000","last_clean":"2023-10-14T18:56:05.613859+0000","last_became_active":"2023-10-14T18:56:05.613294+0000","last_became_peered":"2023-10-14T18:56:05.613294+0000","last_unstale":"2023-10-14T18:56:05.613859+0000","last_undegraded":"2023-10-14T18:56:05.613859+0000","last_fullsized":"2023-10-14T18:56:05.613859+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:05.822336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608163+0000","last_change":"2023-10-14T18:56:05.607694+0000","last_active":"2023-10-14T18:56:05.608163+0000","last_peered":"2023-10-14T18:56:05.608163+0000","last_clean":"2023-10-14T18:56:05.608163+0000","last_became_active":"2023-10-14T18:56:05.607479+0000","last_became_peered":"2023-10-14T18:56:05.607479+0000","last_unstale":"2023-10-14T18:56:05.608163+0000","last_undegraded":"2023-10-14T18:56:05.608163+0000","last_fullsized":"2023-10-14T18:56:05.608163+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:32:12.444664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611638+0000","last_change":"2023-10-14T18:56:05.611564+0000","last_active":"2023-10-14T18:56:05.611638+0000","last_peered":"2023-10-14T18:56:05.611638+0000","last_clean":"2023-10-14T18:56:05.611638+0000","last_became_active":"2023-10-14T18:56:05.611325+0000","last_became_peered":"2023-10-14T18:56:05.611325+0000","last_unstale":"2023-10-14T18:56:05.611638+0000","last_undegraded":"2023-10-14T18:56:05.611638+0000","last_fullsized":"2023-10-14T18:56:05.611638+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:12.478842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613489+0000","last_change":"2023-10-14T18:56:05.613444+0000","last_active":"2023-10-14T18:56:05.613489+0000","last_peered":"2023-10-14T18:56:05.613489+0000","last_clean":"2023-10-14T18:56:05.613489+0000","last_became_active":"2023-10-14T18:56:05.613286+0000","last_became_peered":"2023-10-14T18:56:05.613286+0000","last_unstale":"2023-10-14T18:56:05.613489+0000","last_undegraded":"2023-10-14T18:56:05.613489+0000","last_fullsized":"2023-10-14T18:56:05.613489+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:30.803100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612476+0000","last_change":"2023-10-14T18:56:05.612356+0000","last_active":"2023-10-14T18:56:05.612476+0000","last_peered":"2023-10-14T18:56:05.612476+0000","last_clean":"2023-10-14T18:56:05.612476+0000","last_became_active":"2023-10-14T18:56:05.610549+0000","last_became_peered":"2023-10-14T18:56:05.610549+0000","last_unstale":"2023-10-14T18:56:05.612476+0000","last_undegraded":"2023-10-14T18:56:05.612476+0000","last_fullsized":"2023-10-14T18:56:05.612476+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:46:32.568242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610966+0000","last_change":"2023-10-14T18:56:05.610892+0000","last_active":"2023-10-14T18:56:05.610966+0000","last_peered":"2023-10-14T18:56:05.610966+0000","last_clean":"2023-10-14T18:56:05.610966+0000","last_became_active":"2023-10-14T18:56:05.610629+0000","last_became_peered":"2023-10-14T18:56:05.610629+0000","last_unstale":"2023-10-14T18:56:05.610966+0000","last_undegraded":"2023-10-14T18:56:05.610966+0000","last_fullsized":"2023-10-14T18:56:05.610966+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:58:10.361994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610447+0000","last_change":"2023-10-14T18:56:05.610192+0000","last_active":"2023-10-14T18:56:05.610447+0000","last_peered":"2023-10-14T18:56:05.610447+0000","last_clean":"2023-10-14T18:56:05.610447+0000","last_became_active":"2023-10-14T18:56:05.609560+0000","last_became_peered":"2023-10-14T18:56:05.609560+0000","last_unstale":"2023-10-14T18:56:05.610447+0000","last_undegraded":"2023-10-14T18:56:05.610447+0000","last_fullsized":"2023-10-14T18:56:05.610447+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:13.982676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603591+0000","last_change":"2023-10-14T18:56:05.603093+0000","last_active":"2023-10-14T18:56:05.603591+0000","last_peered":"2023-10-14T18:56:05.603591+0000","last_clean":"2023-10-14T18:56:05.603591+0000","last_became_active":"2023-10-14T18:56:05.602750+0000","last_became_peered":"2023-10-14T18:56:05.602750+0000","last_unstale":"2023-10-14T18:56:05.603591+0000","last_undegraded":"2023-10-14T18:56:05.603591+0000","last_fullsized":"2023-10-14T18:56:05.603591+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:08:51.449357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610128+0000","last_change":"2023-10-14T18:56:05.610073+0000","last_active":"2023-10-14T18:56:05.610128+0000","last_peered":"2023-10-14T18:56:05.610128+0000","last_clean":"2023-10-14T18:56:05.610128+0000","last_became_active":"2023-10-14T18:56:05.609734+0000","last_became_peered":"2023-10-14T18:56:05.609734+0000","last_unstale":"2023-10-14T18:56:05.610128+0000","last_undegraded":"2023-10-14T18:56:05.610128+0000","last_fullsized":"2023-10-14T18:56:05.610128+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:30.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"185'4","reported_seq":14,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.623684+0000","last_change":"2023-10-14T18:56:04.609334+0000","last_active":"2023-10-14T18:56:05.623684+0000","last_peered":"2023-10-14T18:56:05.623684+0000","last_clean":"2023-10-14T18:56:05.623684+0000","last_became_active":"2023-10-14T18:56:04.608610+0000","last_became_peered":"2023-10-14T18:56:04.608610+0000","last_unstale":"2023-10-14T18:56:05.623684+0000","last_undegraded":"2023-10-14T18:56:05.623684+0000","last_fullsized":"2023-10-14T18:56:05.623684+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:55:10.288016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611564+0000","last_change":"2023-10-14T18:56:05.611492+0000","last_active":"2023-10-14T18:56:05.611564+0000","last_peered":"2023-10-14T18:56:05.611564+0000","last_clean":"2023-10-14T18:56:05.611564+0000","last_became_active":"2023-10-14T18:56:05.611270+0000","last_became_peered":"2023-10-14T18:56:05.611270+0000","last_unstale":"2023-10-14T18:56:05.611564+0000","last_undegraded":"2023-10-14T18:56:05.611564+0000","last_fullsized":"2023-10-14T18:56:05.611564+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:24:35.844218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626706+0000","last_change":"2023-10-14T18:56:04.614210+0000","last_active":"2023-10-14T18:56:05.626706+0000","last_peered":"2023-10-14T18:56:05.626706+0000","last_clean":"2023-10-14T18:56:05.626706+0000","last_became_active":"2023-10-14T18:56:04.613961+0000","last_became_peered":"2023-10-14T18:56:04.613961+0000","last_unstale":"2023-10-14T18:56:05.626706+0000","last_undegraded":"2023-10-14T18:56:05.626706+0000","last_fullsized":"2023-10-14T18:56:05.626706+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603595+0000","last_change":"2023-10-14T18:56:05.603532+0000","last_active":"2023-10-14T18:56:05.603595+0000","last_peered":"2023-10-14T18:56:05.603595+0000","last_clean":"2023-10-14T18:56:05.603595+0000","last_became_active":"2023-10-14T18:56:05.603313+0000","last_became_peered":"2023-10-14T18:56:05.603313+0000","last_unstale":"2023-10-14T18:56:05.603595+0000","last_undegraded":"2023-10-14T18:56:05.603595+0000","last_fullsized":"2023-10-14T18:56:05.603595+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:31.071351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622181+0000","last_change":"2023-10-14T18:56:04.605771+0000","last_active":"2023-10-14T18:56:05.622181+0000","last_peered":"2023-10-14T18:56:05.622181+0000","last_clean":"2023-10-14T18:56:05.622181+0000","last_became_active":"2023-10-14T18:56:04.605370+0000","last_became_peered":"2023-10-14T18:56:04.605370+0000","last_unstale":"2023-10-14T18:56:05.622181+0000","last_undegraded":"2023-10-14T18:56:05.622181+0000","last_fullsized":"2023-10-14T18:56:05.622181+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:48.050809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618619+0000","last_change":"2023-10-14T18:56:05.617350+0000","last_active":"2023-10-14T18:56:05.618619+0000","last_peered":"2023-10-14T18:56:05.618619+0000","last_clean":"2023-10-14T18:56:05.618619+0000","last_became_active":"2023-10-14T18:56:05.617122+0000","last_became_peered":"2023-10-14T18:56:05.617122+0000","last_unstale":"2023-10-14T18:56:05.618619+0000","last_undegraded":"2023-10-14T18:56:05.618619+0000","last_fullsized":"2023-10-14T18:56:05.618619+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:42.227441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621102+0000","last_change":"2023-10-14T18:56:04.609868+0000","last_active":"2023-10-14T18:56:05.621102+0000","last_peered":"2023-10-14T18:56:05.621102+0000","last_clean":"2023-10-14T18:56:05.621102+0000","last_became_active":"2023-10-14T18:56:04.609689+0000","last_became_peered":"2023-10-14T18:56:04.609689+0000","last_unstale":"2023-10-14T18:56:05.621102+0000","last_undegraded":"2023-10-14T18:56:05.621102+0000","last_fullsized":"2023-10-14T18:56:05.621102+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611476+0000","last_change":"2023-10-14T18:56:05.611397+0000","last_active":"2023-10-14T18:56:05.611476+0000","last_peered":"2023-10-14T18:56:05.611476+0000","last_clean":"2023-10-14T18:56:05.611476+0000","last_became_active":"2023-10-14T18:56:05.611151+0000","last_became_peered":"2023-10-14T18:56:05.611151+0000","last_unstale":"2023-10-14T18:56:05.611476+0000","last_undegraded":"2023-10-14T18:56:05.611476+0000","last_fullsized":"2023-10-14T18:56:05.611476+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:31.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626397+0000","last_change":"2023-10-14T18:56:04.611376+0000","last_active":"2023-10-14T18:56:05.626397+0000","last_peered":"2023-10-14T18:56:05.626397+0000","last_clean":"2023-10-14T18:56:05.626397+0000","last_became_active":"2023-10-14T18:56:04.611147+0000","last_became_peered":"2023-10-14T18:56:04.611147+0000","last_unstale":"2023-10-14T18:56:05.626397+0000","last_undegraded":"2023-10-14T18:56:05.626397+0000","last_fullsized":"2023-10-14T18:56:05.626397+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:04:50.271647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610181+0000","last_change":"2023-10-14T18:56:05.609956+0000","last_active":"2023-10-14T18:56:05.610181+0000","last_peered":"2023-10-14T18:56:05.610181+0000","last_clean":"2023-10-14T18:56:05.610181+0000","last_became_active":"2023-10-14T18:56:05.609454+0000","last_became_peered":"2023-10-14T18:56:05.609454+0000","last_unstale":"2023-10-14T18:56:05.610181+0000","last_undegraded":"2023-10-14T18:56:05.610181+0000","last_fullsized":"2023-10-14T18:56:05.610181+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:56.625874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.619522+0000","last_change":"2023-10-14T18:56:04.602684+0000","last_active":"2023-10-14T18:56:05.619522+0000","last_peered":"2023-10-14T18:56:05.619522+0000","last_clean":"2023-10-14T18:56:05.619522+0000","last_became_active":"2023-10-14T18:56:04.602473+0000","last_became_peered":"2023-10-14T18:56:04.602473+0000","last_unstale":"2023-10-14T18:56:05.619522+0000","last_undegraded":"2023-10-14T18:56:05.619522+0000","last_fullsized":"2023-10-14T18:56:05.619522+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.608770+0000","last_change":"2023-10-14T18:56:05.608707+0000","last_active":"2023-10-14T18:56:05.608770+0000","last_peered":"2023-10-14T18:56:05.608770+0000","last_clean":"2023-10-14T18:56:05.608770+0000","last_became_active":"2023-10-14T18:56:05.608461+0000","last_became_peered":"2023-10-14T18:56:05.608461+0000","last_unstale":"2023-10-14T18:56:05.608770+0000","last_undegraded":"2023-10-14T18:56:05.608770+0000","last_fullsized":"2023-10-14T18:56:05.608770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:24:16.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618556+0000","last_change":"2023-10-14T18:56:04.612958+0000","last_active":"2023-10-14T18:56:05.618556+0000","last_peered":"2023-10-14T18:56:05.618556+0000","last_clean":"2023-10-14T18:56:05.618556+0000","last_became_active":"2023-10-14T18:56:04.611998+0000","last_became_peered":"2023-10-14T18:56:04.611998+0000","last_unstale":"2023-10-14T18:56:05.618556+0000","last_undegraded":"2023-10-14T18:56:05.618556+0000","last_fullsized":"2023-10-14T18:56:05.618556+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:37.767028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605336+0000","last_change":"2023-10-14T18:56:05.605243+0000","last_active":"2023-10-14T18:56:05.605336+0000","last_peered":"2023-10-14T18:56:05.605336+0000","last_clean":"2023-10-14T18:56:05.605336+0000","last_became_active":"2023-10-14T18:56:05.605029+0000","last_became_peered":"2023-10-14T18:56:05.605029+0000","last_unstale":"2023-10-14T18:56:05.605336+0000","last_undegraded":"2023-10-14T18:56:05.605336+0000","last_fullsized":"2023-10-14T18:56:05.605336+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:32:33.417917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.604281+0000","last_change":"2023-10-14T18:56:04.601361+0000","last_active":"2023-10-14T18:56:05.604281+0000","last_peered":"2023-10-14T18:56:05.604281+0000","last_clean":"2023-10-14T18:56:05.604281+0000","last_became_active":"2023-10-14T18:56:04.601140+0000","last_became_peered":"2023-10-14T18:56:04.601140+0000","last_unstale":"2023-10-14T18:56:05.604281+0000","last_undegraded":"2023-10-14T18:56:05.604281+0000","last_fullsized":"2023-10-14T18:56:05.604281+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:18.158748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607773+0000","last_change":"2023-10-14T18:56:05.607714+0000","last_active":"2023-10-14T18:56:05.607773+0000","last_peered":"2023-10-14T18:56:05.607773+0000","last_clean":"2023-10-14T18:56:05.607773+0000","last_became_active":"2023-10-14T18:56:05.607299+0000","last_became_peered":"2023-10-14T18:56:05.607299+0000","last_unstale":"2023-10-14T18:56:05.607773+0000","last_undegraded":"2023-10-14T18:56:05.607773+0000","last_fullsized":"2023-10-14T18:56:05.607773+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:39.733927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.599649+0000","last_change":"2023-10-14T18:56:04.604104+0000","last_active":"2023-10-14T18:56:05.599649+0000","last_peered":"2023-10-14T18:56:05.599649+0000","last_clean":"2023-10-14T18:56:05.599649+0000","last_became_active":"2023-10-14T18:56:04.603852+0000","last_became_peered":"2023-10-14T18:56:04.603852+0000","last_unstale":"2023-10-14T18:56:05.599649+0000","last_undegraded":"2023-10-14T18:56:05.599649+0000","last_fullsized":"2023-10-14T18:56:05.599649+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:25:18.126483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610779+0000","last_change":"2023-10-14T18:56:05.610402+0000","last_active":"2023-10-14T18:56:05.610779+0000","last_peered":"2023-10-14T18:56:05.610779+0000","last_clean":"2023-10-14T18:56:05.610779+0000","last_became_active":"2023-10-14T18:56:05.609832+0000","last_became_peered":"2023-10-14T18:56:05.609832+0000","last_unstale":"2023-10-14T18:56:05.610779+0000","last_undegraded":"2023-10-14T18:56:05.610779+0000","last_fullsized":"2023-10-14T18:56:05.610779+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:27:56.625874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"185'3","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.624516+0000","last_change":"2023-10-14T18:56:04.608406+0000","last_active":"2023-10-14T18:56:05.624516+0000","last_peered":"2023-10-14T18:56:05.624516+0000","last_clean":"2023-10-14T18:56:05.624516+0000","last_became_active":"2023-10-14T18:56:04.607955+0000","last_became_peered":"2023-10-14T18:56:04.607955+0000","last_unstale":"2023-10-14T18:56:05.624516+0000","last_undegraded":"2023-10-14T18:56:05.624516+0000","last_fullsized":"2023-10-14T18:56:05.624516+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:56:01.513803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612838+0000","last_change":"2023-10-14T18:56:05.612770+0000","last_active":"2023-10-14T18:56:05.612838+0000","last_peered":"2023-10-14T18:56:05.612838+0000","last_clean":"2023-10-14T18:56:05.612838+0000","last_became_active":"2023-10-14T18:56:05.612539+0000","last_became_peered":"2023-10-14T18:56:05.612539+0000","last_unstale":"2023-10-14T18:56:05.612838+0000","last_undegraded":"2023-10-14T18:56:05.612838+0000","last_fullsized":"2023-10-14T18:56:05.612838+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:17.878904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"185'6","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.627747+0000","last_change":"2023-10-14T18:56:04.612667+0000","last_active":"2023-10-14T18:56:05.627747+0000","last_peered":"2023-10-14T18:56:05.627747+0000","last_clean":"2023-10-14T18:56:05.627747+0000","last_became_active":"2023-10-14T18:56:04.612491+0000","last_became_peered":"2023-10-14T18:56:04.612491+0000","last_unstale":"2023-10-14T18:56:05.627747+0000","last_undegraded":"2023-10-14T18:56:05.627747+0000","last_fullsized":"2023-10-14T18:56:05.627747+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:44.750261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607877+0000","last_change":"2023-10-14T18:56:05.607833+0000","last_active":"2023-10-14T18:56:05.607877+0000","last_peered":"2023-10-14T18:56:05.607877+0000","last_clean":"2023-10-14T18:56:05.607877+0000","last_became_active":"2023-10-14T18:56:05.607538+0000","last_became_peered":"2023-10-14T18:56:05.607538+0000","last_unstale":"2023-10-14T18:56:05.607877+0000","last_undegraded":"2023-10-14T18:56:05.607877+0000","last_fullsized":"2023-10-14T18:56:05.607877+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:32.386515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621304+0000","last_change":"2023-10-14T18:56:04.605840+0000","last_active":"2023-10-14T18:56:05.621304+0000","last_peered":"2023-10-14T18:56:05.621304+0000","last_clean":"2023-10-14T18:56:05.621304+0000","last_became_active":"2023-10-14T18:56:04.605640+0000","last_became_peered":"2023-10-14T18:56:04.605640+0000","last_unstale":"2023-10-14T18:56:05.621304+0000","last_undegraded":"2023-10-14T18:56:05.621304+0000","last_fullsized":"2023-10-14T18:56:05.621304+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:47:14.202571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612327+0000","last_change":"2023-10-14T18:56:05.612252+0000","last_active":"2023-10-14T18:56:05.612327+0000","last_peered":"2023-10-14T18:56:05.612327+0000","last_clean":"2023-10-14T18:56:05.612327+0000","last_became_active":"2023-10-14T18:56:05.612011+0000","last_became_peered":"2023-10-14T18:56:05.612011+0000","last_unstale":"2023-10-14T18:56:05.612327+0000","last_undegraded":"2023-10-14T18:56:05.612327+0000","last_fullsized":"2023-10-14T18:56:05.612327+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:12:43.641846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601091+0000","last_change":"2023-10-14T18:56:04.608355+0000","last_active":"2023-10-14T18:56:05.601091+0000","last_peered":"2023-10-14T18:56:05.601091+0000","last_clean":"2023-10-14T18:56:05.601091+0000","last_became_active":"2023-10-14T18:56:04.608127+0000","last_became_peered":"2023-10-14T18:56:04.608127+0000","last_unstale":"2023-10-14T18:56:05.601091+0000","last_undegraded":"2023-10-14T18:56:05.601091+0000","last_fullsized":"2023-10-14T18:56:05.601091+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:41.225245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.612465+0000","last_change":"2023-10-14T18:56:05.612410+0000","last_active":"2023-10-14T18:56:05.612465+0000","last_peered":"2023-10-14T18:56:05.612465+0000","last_clean":"2023-10-14T18:56:05.612465+0000","last_became_active":"2023-10-14T18:56:05.612187+0000","last_became_peered":"2023-10-14T18:56:05.612187+0000","last_unstale":"2023-10-14T18:56:05.612465+0000","last_undegraded":"2023-10-14T18:56:05.612465+0000","last_fullsized":"2023-10-14T18:56:05.612465+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:32:32.386515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606203+0000","last_change":"2023-10-14T18:56:04.604537+0000","last_active":"2023-10-14T18:56:05.606203+0000","last_peered":"2023-10-14T18:56:05.606203+0000","last_clean":"2023-10-14T18:56:05.606203+0000","last_became_active":"2023-10-14T18:56:04.604315+0000","last_became_peered":"2023-10-14T18:56:04.604315+0000","last_unstale":"2023-10-14T18:56:05.606203+0000","last_undegraded":"2023-10-14T18:56:05.606203+0000","last_fullsized":"2023-10-14T18:56:05.606203+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:30.783256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611457+0000","last_change":"2023-10-14T18:56:05.609943+0000","last_active":"2023-10-14T18:56:05.611457+0000","last_peered":"2023-10-14T18:56:05.611457+0000","last_clean":"2023-10-14T18:56:05.611457+0000","last_became_active":"2023-10-14T18:56:05.609684+0000","last_became_peered":"2023-10-14T18:56:05.609684+0000","last_unstale":"2023-10-14T18:56:05.611457+0000","last_undegraded":"2023-10-14T18:56:05.611457+0000","last_fullsized":"2023-10-14T18:56:05.611457+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:05:45.752458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"185'8","reported_seq":18,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626645+0000","last_change":"2023-10-14T18:56:04.610838+0000","last_active":"2023-10-14T18:56:05.626645+0000","last_peered":"2023-10-14T18:56:05.626645+0000","last_clean":"2023-10-14T18:56:05.626645+0000","last_became_active":"2023-10-14T18:56:04.610466+0000","last_became_peered":"2023-10-14T18:56:04.610466+0000","last_unstale":"2023-10-14T18:56:05.626645+0000","last_undegraded":"2023-10-14T18:56:05.626645+0000","last_fullsized":"2023-10-14T18:56:05.626645+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:54:45.273772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.611906+0000","last_change":"2023-10-14T18:56:05.611846+0000","last_active":"2023-10-14T18:56:05.611906+0000","last_peered":"2023-10-14T18:56:05.611906+0000","last_clean":"2023-10-14T18:56:05.611906+0000","last_became_active":"2023-10-14T18:56:05.611629+0000","last_became_peered":"2023-10-14T18:56:05.611629+0000","last_unstale":"2023-10-14T18:56:05.611906+0000","last_undegraded":"2023-10-14T18:56:05.611906+0000","last_fullsized":"2023-10-14T18:56:05.611906+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:02:39.733927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622638+0000","last_change":"2023-10-14T18:56:04.614509+0000","last_active":"2023-10-14T18:56:05.622638+0000","last_peered":"2023-10-14T18:56:05.622638+0000","last_clean":"2023-10-14T18:56:05.622638+0000","last_became_active":"2023-10-14T18:56:04.614274+0000","last_became_peered":"2023-10-14T18:56:04.614274+0000","last_unstale":"2023-10-14T18:56:05.622638+0000","last_undegraded":"2023-10-14T18:56:05.622638+0000","last_fullsized":"2023-10-14T18:56:05.622638+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:06:30.069155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610796+0000","last_change":"2023-10-14T18:56:05.610535+0000","last_active":"2023-10-14T18:56:05.610796+0000","last_peered":"2023-10-14T18:56:05.610796+0000","last_clean":"2023-10-14T18:56:05.610796+0000","last_became_active":"2023-10-14T18:56:05.610132+0000","last_became_peered":"2023-10-14T18:56:05.610132+0000","last_unstale":"2023-10-14T18:56:05.610796+0000","last_undegraded":"2023-10-14T18:56:05.610796+0000","last_fullsized":"2023-10-14T18:56:05.610796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:09:19.160945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.621349+0000","last_change":"2023-10-14T18:56:04.612413+0000","last_active":"2023-10-14T18:56:05.621349+0000","last_peered":"2023-10-14T18:56:05.621349+0000","last_clean":"2023-10-14T18:56:05.621349+0000","last_became_active":"2023-10-14T18:56:04.611474+0000","last_became_peered":"2023-10-14T18:56:04.611474+0000","last_unstale":"2023-10-14T18:56:05.621349+0000","last_undegraded":"2023-10-14T18:56:05.621349+0000","last_fullsized":"2023-10-14T18:56:05.621349+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:50.332858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610196+0000","last_change":"2023-10-14T18:56:05.610127+0000","last_active":"2023-10-14T18:56:05.610196+0000","last_peered":"2023-10-14T18:56:05.610196+0000","last_clean":"2023-10-14T18:56:05.610196+0000","last_became_active":"2023-10-14T18:56:05.609729+0000","last_became_peered":"2023-10-14T18:56:05.609729+0000","last_unstale":"2023-10-14T18:56:05.610196+0000","last_undegraded":"2023-10-14T18:56:05.610196+0000","last_fullsized":"2023-10-14T18:56:05.610196+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:11.247634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.626552+0000","last_change":"2023-10-14T18:56:04.612224+0000","last_active":"2023-10-14T18:56:05.626552+0000","last_peered":"2023-10-14T18:56:05.626552+0000","last_clean":"2023-10-14T18:56:05.626552+0000","last_became_active":"2023-10-14T18:56:04.611503+0000","last_became_peered":"2023-10-14T18:56:04.611503+0000","last_unstale":"2023-10-14T18:56:05.626552+0000","last_undegraded":"2023-10-14T18:56:05.626552+0000","last_fullsized":"2023-10-14T18:56:05.626552+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:58:47.923458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609695+0000","last_change":"2023-10-14T18:56:05.609615+0000","last_active":"2023-10-14T18:56:05.609695+0000","last_peered":"2023-10-14T18:56:05.609695+0000","last_clean":"2023-10-14T18:56:05.609695+0000","last_became_active":"2023-10-14T18:56:05.609216+0000","last_became_peered":"2023-10-14T18:56:05.609216+0000","last_unstale":"2023-10-14T18:56:05.609695+0000","last_undegraded":"2023-10-14T18:56:05.609695+0000","last_fullsized":"2023-10-14T18:56:05.609695+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:00:00.327227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600487+0000","last_change":"2023-10-14T18:56:04.607440+0000","last_active":"2023-10-14T18:56:05.600487+0000","last_peered":"2023-10-14T18:56:05.600487+0000","last_clean":"2023-10-14T18:56:05.600487+0000","last_became_active":"2023-10-14T18:56:04.607205+0000","last_became_peered":"2023-10-14T18:56:04.607205+0000","last_unstale":"2023-10-14T18:56:05.600487+0000","last_undegraded":"2023-10-14T18:56:05.600487+0000","last_fullsized":"2023-10-14T18:56:05.600487+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:55:01.337710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610738+0000","last_change":"2023-10-14T18:56:05.609151+0000","last_active":"2023-10-14T18:56:05.610738+0000","last_peered":"2023-10-14T18:56:05.610738+0000","last_clean":"2023-10-14T18:56:05.610738+0000","last_became_active":"2023-10-14T18:56:05.608839+0000","last_became_peered":"2023-10-14T18:56:05.608839+0000","last_unstale":"2023-10-14T18:56:05.610738+0000","last_undegraded":"2023-10-14T18:56:05.610738+0000","last_fullsized":"2023-10-14T18:56:05.610738+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:10.195278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622094+0000","last_change":"2023-10-14T18:56:04.607989+0000","last_active":"2023-10-14T18:56:05.622094+0000","last_peered":"2023-10-14T18:56:05.622094+0000","last_clean":"2023-10-14T18:56:05.622094+0000","last_became_active":"2023-10-14T18:56:04.607756+0000","last_became_peered":"2023-10-14T18:56:04.607756+0000","last_unstale":"2023-10-14T18:56:05.622094+0000","last_undegraded":"2023-10-14T18:56:05.622094+0000","last_fullsized":"2023-10-14T18:56:05.622094+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:44:01.417122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605475+0000","last_change":"2023-10-14T18:56:05.605417+0000","last_active":"2023-10-14T18:56:05.605475+0000","last_peered":"2023-10-14T18:56:05.605475+0000","last_clean":"2023-10-14T18:56:05.605475+0000","last_became_active":"2023-10-14T18:56:05.605212+0000","last_became_peered":"2023-10-14T18:56:05.605212+0000","last_unstale":"2023-10-14T18:56:05.605475+0000","last_undegraded":"2023-10-14T18:56:05.605475+0000","last_fullsized":"2023-10-14T18:56:05.605475+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:44:31.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600682+0000","last_change":"2023-10-14T18:56:04.609141+0000","last_active":"2023-10-14T18:56:05.600682+0000","last_peered":"2023-10-14T18:56:05.600682+0000","last_clean":"2023-10-14T18:56:05.600682+0000","last_became_active":"2023-10-14T18:56:04.608839+0000","last_became_peered":"2023-10-14T18:56:04.608839+0000","last_unstale":"2023-10-14T18:56:05.600682+0000","last_undegraded":"2023-10-14T18:56:05.600682+0000","last_fullsized":"2023-10-14T18:56:05.600682+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:42:23.762007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607210+0000","last_change":"2023-10-14T18:56:05.607057+0000","last_active":"2023-10-14T18:56:05.607210+0000","last_peered":"2023-10-14T18:56:05.607210+0000","last_clean":"2023-10-14T18:56:05.607210+0000","last_became_active":"2023-10-14T18:56:05.606803+0000","last_became_peered":"2023-10-14T18:56:05.606803+0000","last_unstale":"2023-10-14T18:56:05.607210+0000","last_undegraded":"2023-10-14T18:56:05.607210+0000","last_fullsized":"2023-10-14T18:56:05.607210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:06:31.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607468+0000","last_change":"2023-10-14T18:56:04.607088+0000","last_active":"2023-10-14T18:56:05.607468+0000","last_peered":"2023-10-14T18:56:05.607468+0000","last_clean":"2023-10-14T18:56:05.607468+0000","last_became_active":"2023-10-14T18:56:04.606870+0000","last_became_peered":"2023-10-14T18:56:04.606870+0000","last_unstale":"2023-10-14T18:56:05.607468+0000","last_undegraded":"2023-10-14T18:56:05.607468+0000","last_fullsized":"2023-10-14T18:56:05.607468+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:59:41.225245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605925+0000","last_change":"2023-10-14T18:56:05.605860+0000","last_active":"2023-10-14T18:56:05.605925+0000","last_peered":"2023-10-14T18:56:05.605925+0000","last_clean":"2023-10-14T18:56:05.605925+0000","last_became_active":"2023-10-14T18:56:05.605631+0000","last_became_peered":"2023-10-14T18:56:05.605631+0000","last_unstale":"2023-10-14T18:56:05.605925+0000","last_undegraded":"2023-10-14T18:56:05.605925+0000","last_fullsized":"2023-10-14T18:56:05.605925+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:46.698834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601652+0000","last_change":"2023-10-14T18:56:04.612073+0000","last_active":"2023-10-14T18:56:05.601652+0000","last_peered":"2023-10-14T18:56:05.601652+0000","last_clean":"2023-10-14T18:56:05.601652+0000","last_became_active":"2023-10-14T18:56:04.611127+0000","last_became_peered":"2023-10-14T18:56:04.611127+0000","last_unstale":"2023-10-14T18:56:05.601652+0000","last_undegraded":"2023-10-14T18:56:05.601652+0000","last_fullsized":"2023-10-14T18:56:05.601652+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:31.648870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610230+0000","last_change":"2023-10-14T18:56:05.610154+0000","last_active":"2023-10-14T18:56:05.610230+0000","last_peered":"2023-10-14T18:56:05.610230+0000","last_clean":"2023-10-14T18:56:05.610230+0000","last_became_active":"2023-10-14T18:56:05.609132+0000","last_became_peered":"2023-10-14T18:56:05.609132+0000","last_unstale":"2023-10-14T18:56:05.610230+0000","last_undegraded":"2023-10-14T18:56:05.610230+0000","last_fullsized":"2023-10-14T18:56:05.610230+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T05:26:30.803100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.622639+0000","last_change":"2023-10-14T18:56:04.609389+0000","last_active":"2023-10-14T18:56:05.622639+0000","last_peered":"2023-10-14T18:56:05.622639+0000","last_clean":"2023-10-14T18:56:05.622639+0000","last_became_active":"2023-10-14T18:56:04.608611+0000","last_became_peered":"2023-10-14T18:56:04.608611+0000","last_unstale":"2023-10-14T18:56:05.622639+0000","last_undegraded":"2023-10-14T18:56:05.622639+0000","last_fullsized":"2023-10-14T18:56:05.622639+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T02:43:48.050809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.624320+0000","last_change":"2023-10-14T18:56:05.624250+0000","last_active":"2023-10-14T18:56:05.624320+0000","last_peered":"2023-10-14T18:56:05.624320+0000","last_clean":"2023-10-14T18:56:05.624320+0000","last_became_active":"2023-10-14T18:56:05.623971+0000","last_became_peered":"2023-10-14T18:56:05.623971+0000","last_unstale":"2023-10-14T18:56:05.624320+0000","last_undegraded":"2023-10-14T18:56:05.624320+0000","last_fullsized":"2023-10-14T18:56:05.624320+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:42:25.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-14T18:56:07.424451+0000","last_change":"2023-10-14T18:56:04.609915+0000","last_active":"2023-10-14T18:56:07.424451+0000","last_peered":"2023-10-14T18:56:07.424451+0000","last_clean":"2023-10-14T18:56:07.424451+0000","last_became_active":"2023-10-14T18:56:04.609680+0000","last_became_peered":"2023-10-14T18:56:04.609680+0000","last_unstale":"2023-10-14T18:56:07.424451+0000","last_undegraded":"2023-10-14T18:56:07.424451+0000","last_fullsized":"2023-10-14T18:56:07.424451+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:17:45.696638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.609444+0000","last_change":"2023-10-14T18:56:05.609332+0000","last_active":"2023-10-14T18:56:05.609444+0000","last_peered":"2023-10-14T18:56:05.609444+0000","last_clean":"2023-10-14T18:56:05.609444+0000","last_became_active":"2023-10-14T18:56:05.609090+0000","last_became_peered":"2023-10-14T18:56:05.609090+0000","last_unstale":"2023-10-14T18:56:05.609444+0000","last_undegraded":"2023-10-14T18:56:05.609444+0000","last_fullsized":"2023-10-14T18:56:05.609444+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:27:51.335054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.618657+0000","last_change":"2023-10-14T18:56:04.613106+0000","last_active":"2023-10-14T18:56:05.618657+0000","last_peered":"2023-10-14T18:56:05.618657+0000","last_clean":"2023-10-14T18:56:05.618657+0000","last_became_active":"2023-10-14T18:56:04.612296+0000","last_became_peered":"2023-10-14T18:56:04.612296+0000","last_unstale":"2023-10-14T18:56:05.618657+0000","last_undegraded":"2023-10-14T18:56:05.618657+0000","last_fullsized":"2023-10-14T18:56:05.618657+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:24.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.602058+0000","last_change":"2023-10-14T18:56:05.602016+0000","last_active":"2023-10-14T18:56:05.602058+0000","last_peered":"2023-10-14T18:56:05.602058+0000","last_clean":"2023-10-14T18:56:05.602058+0000","last_became_active":"2023-10-14T18:56:05.601842+0000","last_became_peered":"2023-10-14T18:56:05.601842+0000","last_unstale":"2023-10-14T18:56:05.602058+0000","last_undegraded":"2023-10-14T18:56:05.602058+0000","last_fullsized":"2023-10-14T18:56:05.602058+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:54:19.517006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.601008+0000","last_change":"2023-10-14T18:56:04.613391+0000","last_active":"2023-10-14T18:56:05.601008+0000","last_peered":"2023-10-14T18:56:05.601008+0000","last_clean":"2023-10-14T18:56:05.601008+0000","last_became_active":"2023-10-14T18:56:04.613217+0000","last_became_peered":"2023-10-14T18:56:04.613217+0000","last_unstale":"2023-10-14T18:56:05.601008+0000","last_undegraded":"2023-10-14T18:56:05.601008+0000","last_fullsized":"2023-10-14T18:56:05.601008+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:33:30.783256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.603571+0000","last_change":"2023-10-14T18:56:05.602960+0000","last_active":"2023-10-14T18:56:05.603571+0000","last_peered":"2023-10-14T18:56:05.603571+0000","last_clean":"2023-10-14T18:56:05.603571+0000","last_became_active":"2023-10-14T18:56:05.602474+0000","last_became_peered":"2023-10-14T18:56:05.602474+0000","last_unstale":"2023-10-14T18:56:05.603571+0000","last_undegraded":"2023-10-14T18:56:05.603571+0000","last_fullsized":"2023-10-14T18:56:05.603571+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T04:35:12.123197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607379+0000","last_change":"2023-10-14T18:56:04.611054+0000","last_active":"2023-10-14T18:56:05.607379+0000","last_peered":"2023-10-14T18:56:05.607379+0000","last_clean":"2023-10-14T18:56:05.607379+0000","last_became_active":"2023-10-14T18:56:04.610498+0000","last_became_peered":"2023-10-14T18:56:04.610498+0000","last_unstale":"2023-10-14T18:56:05.607379+0000","last_undegraded":"2023-10-14T18:56:05.607379+0000","last_fullsized":"2023-10-14T18:56:05.607379+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:11.476645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.610467+0000","last_change":"2023-10-14T18:56:05.610333+0000","last_active":"2023-10-14T18:56:05.610467+0000","last_peered":"2023-10-14T18:56:05.610467+0000","last_clean":"2023-10-14T18:56:05.610467+0000","last_became_active":"2023-10-14T18:56:05.609904+0000","last_became_peered":"2023-10-14T18:56:05.609904+0000","last_unstale":"2023-10-14T18:56:05.610467+0000","last_undegraded":"2023-10-14T18:56:05.610467+0000","last_fullsized":"2023-10-14T18:56:05.610467+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:59.985739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606291+0000","last_change":"2023-10-14T18:56:04.609482+0000","last_active":"2023-10-14T18:56:05.606291+0000","last_peered":"2023-10-14T18:56:05.606291+0000","last_clean":"2023-10-14T18:56:05.606291+0000","last_became_active":"2023-10-14T18:56:04.609222+0000","last_became_peered":"2023-10-14T18:56:04.609222+0000","last_unstale":"2023-10-14T18:56:05.606291+0000","last_undegraded":"2023-10-14T18:56:05.606291+0000","last_fullsized":"2023-10-14T18:56:05.606291+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:16.876707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605913+0000","last_change":"2023-10-14T18:56:05.605850+0000","last_active":"2023-10-14T18:56:05.605913+0000","last_peered":"2023-10-14T18:56:05.605913+0000","last_clean":"2023-10-14T18:56:05.605913+0000","last_became_active":"2023-10-14T18:56:05.605574+0000","last_became_peered":"2023-10-14T18:56:05.605574+0000","last_unstale":"2023-10-14T18:56:05.605913+0000","last_undegraded":"2023-10-14T18:56:05.605913+0000","last_fullsized":"2023-10-14T18:56:05.605913+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:42:21.835340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.605144+0000","last_change":"2023-10-14T18:56:04.609233+0000","last_active":"2023-10-14T18:56:05.605144+0000","last_peered":"2023-10-14T18:56:05.605144+0000","last_clean":"2023-10-14T18:56:05.605144+0000","last_became_active":"2023-10-14T18:56:04.608951+0000","last_became_peered":"2023-10-14T18:56:04.608951+0000","last_unstale":"2023-10-14T18:56:05.605144+0000","last_undegraded":"2023-10-14T18:56:05.605144+0000","last_fullsized":"2023-10-14T18:56:05.605144+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:30.965390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.613828+0000","last_change":"2023-10-14T18:56:05.612915+0000","last_active":"2023-10-14T18:56:05.613828+0000","last_peered":"2023-10-14T18:56:05.613828+0000","last_clean":"2023-10-14T18:56:05.613828+0000","last_became_active":"2023-10-14T18:56:05.612185+0000","last_became_peered":"2023-10-14T18:56:05.612185+0000","last_unstale":"2023-10-14T18:56:05.613828+0000","last_undegraded":"2023-10-14T18:56:05.613828+0000","last_fullsized":"2023-10-14T18:56:05.613828+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:32:23.654861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.606367+0000","last_change":"2023-10-14T18:56:04.611465+0000","last_active":"2023-10-14T18:56:05.606367+0000","last_peered":"2023-10-14T18:56:05.606367+0000","last_clean":"2023-10-14T18:56:05.606367+0000","last_became_active":"2023-10-14T18:56:04.611248+0000","last_became_peered":"2023-10-14T18:56:04.611248+0000","last_unstale":"2023-10-14T18:56:05.606367+0000","last_undegraded":"2023-10-14T18:56:05.606367+0000","last_fullsized":"2023-10-14T18:56:05.606367+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T03:29:09.193082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607071+0000","last_change":"2023-10-14T18:56:05.606997+0000","last_active":"2023-10-14T18:56:05.607071+0000","last_peered":"2023-10-14T18:56:05.607071+0000","last_clean":"2023-10-14T18:56:05.607071+0000","last_became_active":"2023-10-14T18:56:05.606759+0000","last_became_peered":"2023-10-14T18:56:05.606759+0000","last_unstale":"2023-10-14T18:56:05.607071+0000","last_undegraded":"2023-10-14T18:56:05.607071+0000","last_fullsized":"2023-10-14T18:56:05.607071+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:04.591999+0000","last_clean_scrub_stamp":"2023-10-14T18:56:04.591999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:11.247634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.607481+0000","last_change":"2023-10-14T18:56:04.611208+0000","last_active":"2023-10-14T18:56:05.607481+0000","last_peered":"2023-10-14T18:56:05.607481+0000","last_clean":"2023-10-14T18:56:05.607481+0000","last_became_active":"2023-10-14T18:56:04.610816+0000","last_became_peered":"2023-10-14T18:56:04.610816+0000","last_unstale":"2023-10-14T18:56:05.607481+0000","last_undegraded":"2023-10-14T18:56:05.607481+0000","last_fullsized":"2023-10-14T18:56:05.607481+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:56:03.589803+0000","last_clean_scrub_stamp":"2023-10-14T18:56:03.589803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:53:04.820139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":329,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-14T18:56:05.600779+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:05.600779+0000","last_peered":"2023-10-14T18:56:05.600779+0000","last_clean":"2023-10-14T18:56:05.600779+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:05.600779+0000","last_undegraded":"2023-10-14T18:56:05.600779+0000","last_fullsized":"2023-10-14T18:56:05.600779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1594,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193717,"statfs":{"total":200000000,"available":198367047,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.755}]},{"osd":1,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.307},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.627},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":7.8129999999999997},"last":0.53300000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.74199999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77000000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.92300000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.49399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959643,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.35499999999999998,"5min":0.33400000000000002,"15min":0.245},"max":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.78800000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53700000000000003,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.36399999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.83599999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54000000000000004,"15min":0.71999999999999997},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.64700000000000002,"5min":0.69799999999999995,"15min":9.5779999999999994},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.626}]},{"osd":4,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.47299999999999998,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.78700000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.34799999999999998,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67800000000000005,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45600000000000002,"15min":0.46899999999999997},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.67600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.75800000000000001,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.61199999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.72099999999999997,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.47599999999999998,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.19700000000000001},"max":{"1min":0.46700000000000003,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.316,"5min":0.38300000000000001,"15min":0.35299999999999998},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.432,"5min":3.992,"15min":3.992},"last":0.55900000000000005}]},{"osd":2,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44400000000000001,"5min":1.252,"15min":1.252},"last":0.499},{"interface":"front","average":{"1min":0.378,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23200000000000001},"max":{"1min":0.54900000000000004,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40799999999999997,"15min":0.59799999999999998},"min":{"1min":0.28899999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.496,"5min":1.3340000000000001,"15min":10.574},"last":0.622},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.48099999999999998,"15min":0.41299999999999998},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48299999999999998,"5min":10.792,"15min":10.792},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.59099999999999997},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76300000000000001,"5min":3.536,"15min":3.536},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.40799999999999997,"15min":0.38200000000000001},"max":{"1min":0.77800000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.36099999999999999},"max":{"1min":0.81499999999999995,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61699999999999999,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":1.504,"15min":1.504},"last":1.0249999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65800000000000003,"15min":0.61599999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84799999999999998,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":1.05},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.60999999999999999},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.38},"max":{"1min":0.86499999999999999,"5min":1.288,"15min":1.288},"last":0.91900000000000004}]},{"osd":7,"last update":"Sat Oct 14 18:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68899999999999995,"15min":0.64400000000000002},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.379},"max":{"1min":0.88300000000000001,"5min":3.577,"15min":3.577},"last":1.0109999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1591,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193721,"statfs":{"total":200000000,"available":198370308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.376},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.623},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.43099999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.373,"15min":0.34899999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.495}]},{"osd":4,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80000000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.754},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.79900000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959575,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.26600000000000001,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.50900000000000001,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.35199999999999998},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.21099999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34499999999999997,"15min":0.33700000000000002},"min":{"1min":0.25700000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.48599999999999999,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.376},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.38600000000000001,"15min":0.38900000000000001},"min":{"1min":0.30299999999999999,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.78900000000000003},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.40400000000000003,"15min":0.38500000000000001},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":1.006},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39200000000000002,"15min":0.39800000000000002},"min":{"1min":0.27400000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56100000000000005,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":3.4820000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.85499999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.63800000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.87,"5min":0.87,"15min":3.5419999999999998},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.51500000000000001,"5min":0.41499999999999998,"15min":0.41299999999999998},"max":{"1min":0.91700000000000004,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.441,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.83399999999999996,"15min":0.88500000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.629,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0429999999999999},"last":0.47199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1015,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959631,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.218,"15min":0.20599999999999999},"max":{"1min":0.48699999999999999,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.251}]},{"osd":1,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.34300000000000003},"min":{"1min":0.22600000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":0.61799999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.38300000000000001},"min":{"1min":0.33000000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.318},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42899999999999999,"15min":0.41599999999999998},"min":{"1min":0.30399999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.41599999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.44500000000000001,"5min":0.36099999999999999,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.47699999999999998,"5min":0.40200000000000002,"15min":0.36299999999999999},"max":{"1min":0.86899999999999999,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.41199999999999998,"15min":0.38400000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.91400000000000003}]},{"osd":6,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":0.80100000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.60599999999999998},"min":{"1min":0.496,"5min":0.40200000000000002,"15min":0.38900000000000001},"max":{"1min":0.82399999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Oct 14 18:55:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.33400000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.378,"15min":0.37},"max":{"1min":0.84799999999999998,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1017,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194294,"statfs":{"total":200000000,"available":198958059,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51800000000000002,"15min":0.52600000000000002},"min":{"1min":0.36399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.73499999999999999,"15min":0.79200000000000004},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.66700000000000004,"5min":0.746,"15min":0.83399999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.39100000000000001,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":0.68300000000000005,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.36799999999999999},"max":{"1min":0.747,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":0.72399999999999998,"15min":0.81000000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.498}]},{"osd":5,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.254,"15min":0.254},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.47799999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.32200000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.45200000000000001,"15min":0.48299999999999998},"min":{"1min":0.35199999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.44900000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.44500000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.54400000000000004},"min":{"1min":0.39600000000000002,"5min":0.33600000000000002,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.376,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.39000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194295,"statfs":{"total":200000000,"available":198959089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.78400000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.96299999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.94899999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.97799999999999998}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:14.574 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T18:56:14.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-14T18:56:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.729+0000 7f8345df4700 1 Processor -- start 2023-10-14T18:56:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.729+0000 7f8345df4700 1 -- start start 2023-10-14T18:56:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f8345df4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 0x7f83400af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f8345df4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f834006acb0 0x7f83400afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f8345df4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400b0790 con 0x7f834015a290 2023-10-14T18:56:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f8345df4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400ce1f0 con 0x7f834006acb0 2023-10-14T18:56:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f8345df4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400b0b20 con 0x7f8340159ec0 2023-10-14T18:56:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f834006acb0 0x7f83400afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f834015a290 0x7f834006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49184/0 (socket says 172.21.15.79:49184) 2023-10-14T18:56:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833effd700 1 -- 172.21.15.79:0/1374729792 learned_addr learned my addr 172.21.15.79:0/1374729792 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833f7fe700 1 --2- 172.21.15.79:0/1374729792 >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 0x7f83400af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833ffff700 1 -- 172.21.15.79:0/1374729792 >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 msgr2=0x7f83400af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:14.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833ffff700 1 --2- 172.21.15.79:0/1374729792 >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 0x7f83400af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833ffff700 1 -- 172.21.15.79:0/1374729792 >> v1:172.21.15.79:6789/0 conn(0x7f834015a290 legacy=0x7f834006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833ffff700 1 -- 172.21.15.79:0/1374729792 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400b04b0 con 0x7f834006acb0 2023-10-14T18:56:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.730+0000 7f833e7fc700 1 -- 172.21.15.79:0/1374729792 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996557598 0 0) 0x7f83400b0790 con 0x7f834015a290 2023-10-14T18:56:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f833f7fe700 1 --2- 172.21.15.79:0/1374729792 >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 0x7f83400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:14.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f833ffff700 1 --2- 172.21.15.79:0/1374729792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834006acb0 0x7f83400afe80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f83400898e0 tx=0x7f83380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8845aa050a260bc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f833e7fc700 1 -- 172.21.15.79:0/1374729792 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800b6b0 con 0x7f834006acb0 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f833e7fc700 1 -- 172.21.15.79:0/1374729792 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800b810 con 0x7f834006acb0 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f833e7fc700 1 -- 172.21.15.79:0/1374729792 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800bbb0 con 0x7f834006acb0 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 -- 172.21.15.79:0/1374729792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834006acb0 msgr2=0x7f83400afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 --2- 172.21.15.79:0/1374729792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834006acb0 0x7f83400afe80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f83400898e0 tx=0x7f83380091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 -- 172.21.15.79:0/1374729792 shutdown_connections 2023-10-14T18:56:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 --2- 172.21.15.79:0/1374729792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834006acb0 0x7f83400afe80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 --2- 172.21.15.79:0/1374729792 >> v2:172.21.15.144:3300/0 conn(0x7f8340159ec0 0x7f83400af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 -- 172.21.15.79:0/1374729792 >> 172.21.15.79:0/1374729792 conn(0x7f83400d1880 msgr2=0x7f83400cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 -- 172.21.15.79:0/1374729792 shutdown_connections 2023-10-14T18:56:14.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.731+0000 7f8345df4700 1 -- 172.21.15.79:0/1374729792 wait complete. 2023-10-14T18:56:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 Processor -- start 2023-10-14T18:56:14.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 -- start start 2023-10-14T18:56:14.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f834006acb0 0x7f83400c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8340159ec0 0x7f83401558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b4050 con 0x7f834015a290 2023-10-14T18:56:14.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b4330 con 0x7f834006acb0 2023-10-14T18:56:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f8345df4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b4610 con 0x7f8340159ec0 2023-10-14T18:56:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f833ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f833ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39502/0 (socket says 172.21.15.79:39502) 2023-10-14T18:56:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.733+0000 7f833ffff700 1 -- 172.21.15.79:0/4088938514 learned_addr learned my addr 172.21.15.79:0/4088938514 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:14.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 -- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8340159ec0 msgr2=0x7f83401558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8340159ec0 0x7f83401558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 -- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f834006acb0 msgr2=0x7f83400c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f834006acb0 0x7f83400c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 -- 172.21.15.79:0/4088938514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009420 con 0x7f834015a290 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f833ffff700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8338013000 tx=0x7f8338017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011630 con 0x7f834015a290 2023-10-14T18:56:14.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338011790 con 0x7f834015a290 2023-10-14T18:56:14.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400b48f0 con 0x7f834015a290 2023-10-14T18:56:14.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011b50 con 0x7f834015a290 2023-10-14T18:56:14.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.734+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340155e00 con 0x7f834015a290 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.735+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834004c3c0 con 0x7f834015a290 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.735+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f833802e440 con 0x7f834015a290 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.735+0000 7f83277fe700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 0x7f832c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.736+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8338086180 con 0x7f834015a290 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.736+0000 7f833f7fe700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 0x7f832c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:14.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.736+0000 7f833f7fe700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 0x7f832c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3d0 tx=0x7f83300074d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:14.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:14.740+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83380533f0 con 0x7f834015a290 2023-10-14T18:56:15.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.000+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f83400ceab0 con 0x7f834015a290 2023-10-14T18:56:15.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.004+0000 7f83277fe700 1 -- 172.21.15.79:0/4088938514 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8338056a10 con 0x7f834015a290 2023-10-14T18:56:15.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 msgr2=0x7f832c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 0x7f832c0693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3d0 tx=0x7f83300074d0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 msgr2=0x7f83400b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8338013000 tx=0x7f8338017000 comp rx=0 tx=0).stop 2023-10-14T18:56:15.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 shutdown_connections 2023-10-14T18:56:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f832c066f30 0x7f832c0693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f834015a290 0x7f83400b2140 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f834006acb0 0x7f83400c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 --2- 172.21.15.79:0/4088938514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8340159ec0 0x7f83401558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 >> 172.21.15.79:0/4088938514 conn(0x7f83400d1880 msgr2=0x7f83400c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 shutdown_connections 2023-10-14T18:56:15.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.006+0000 7f8345df4700 1 -- 172.21.15.79:0/4088938514 wait complete. 2023-10-14T18:56:15.009 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-14T18:56:15.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:15.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.133+0000 7fcd55d8f700 1 Processor -- start 2023-10-14T18:56:15.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.133+0000 7fcd55d8f700 1 -- start start 2023-10-14T18:56:15.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd55d8f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd50157270 0x7fcd500c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd55d8f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd5006e2b0 0x7fcd5006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd55d8f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd500c42b0 con 0x7fcd50156ea0 2023-10-14T18:56:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd55d8f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5006fac0 con 0x7fcd5006e2b0 2023-10-14T18:56:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd55d8f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5006ec10 con 0x7fcd50157270 2023-10-14T18:56:15.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd4ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd5006e2b0 0x7fcd5006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd4f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcd50156ea0 0x7fcd5006f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49196/0 (socket says 172.21.15.79:49196) 2023-10-14T18:56:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.134+0000 7fcd4f7fe700 1 -- 172.21.15.79:0/3671994977 learned_addr learned my addr 172.21.15.79:0/3671994977 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4effd700 1 --2- 172.21.15.79:0/3671994977 >> v2:172.21.15.144:3300/0 conn(0x7fcd50157270 0x7fcd500c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3671994977 >> v2:172.21.15.144:3300/0 conn(0x7fcd50157270 msgr2=0x7fcd500c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4ffff700 1 --2- 172.21.15.79:0/3671994977 >> v2:172.21.15.144:3300/0 conn(0x7fcd50157270 0x7fcd500c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3671994977 >> v1:172.21.15.79:6789/0 conn(0x7fcd50156ea0 legacy=0x7fcd5006f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3671994977 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500c36a0 con 0x7fcd5006e2b0 2023-10-14T18:56:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4e7fc700 1 -- 172.21.15.79:0/3671994977 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902596514 0 0) 0x7fcd500c42b0 con 0x7fcd50156ea0 2023-10-14T18:56:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4ffff700 1 --2- 172.21.15.79:0/3671994977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5006e2b0 0x7fcd5006e6d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006dd30 tx=0x7fcd480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e66f3f218d3080 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4e7fc700 1 -- 172.21.15.79:0/3671994977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011630 con 0x7fcd5006e2b0 2023-10-14T18:56:15.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4e7fc700 1 -- 172.21.15.79:0/3671994977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48011790 con 0x7fcd5006e2b0 2023-10-14T18:56:15.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.135+0000 7fcd4e7fc700 1 -- 172.21.15.79:0/3671994977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011b30 con 0x7fcd5006e2b0 2023-10-14T18:56:15.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3671994977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5006e2b0 msgr2=0x7fcd5006e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3671994977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5006e2b0 0x7fcd5006e6d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006dd30 tx=0x7fcd480091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3671994977 shutdown_connections 2023-10-14T18:56:15.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3671994977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd5006e2b0 0x7fcd5006e6d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3671994977 >> v2:172.21.15.144:3300/0 conn(0x7fcd50157270 0x7fcd500c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3671994977 >> 172.21.15.79:0/3671994977 conn(0x7fcd500ca4f0 msgr2=0x7fcd500ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3671994977 shutdown_connections 2023-10-14T18:56:15.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.136+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3671994977 wait complete. 2023-10-14T18:56:15.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.137+0000 7fcd55d8f700 1 Processor -- start 2023-10-14T18:56:15.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.137+0000 7fcd55d8f700 1 -- start start 2023-10-14T18:56:15.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006e2b0 0x7fcd500b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 0x7fcd500b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b3610 con 0x7fcd50157270 2023-10-14T18:56:15.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b2c40 con 0x7fcd5006e2b0 2023-10-14T18:56:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd500b1d90 con 0x7fcd50156ea0 2023-10-14T18:56:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39512/0 (socket says 172.21.15.79:39512) 2023-10-14T18:56:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3446589866 learned_addr learned my addr 172.21.15.79:0/3446589866 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4f7fe700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006e2b0 0x7fcd500b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4effd700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 0x7fcd500b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 msgr2=0x7fcd500b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 0x7fcd500b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006e2b0 msgr2=0x7fcd500b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006e2b0 0x7fcd500b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 -- 172.21.15.79:0/3446589866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009420 con 0x7fcd50157270 2023-10-14T18:56:15.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4effd700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 0x7fcd500b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:15.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd4ffff700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006d110 tx=0x7fcd48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480253f0 con 0x7fcd50157270 2023-10-14T18:56:15.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48025550 con 0x7fcd50157270 2023-10-14T18:56:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd500b2030 con 0x7fcd50157270 2023-10-14T18:56:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48025910 con 0x7fcd50157270 2023-10-14T18:56:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.138+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd500b25f0 con 0x7fcd50157270 2023-10-14T18:56:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.139+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5004c3c0 con 0x7fcd50157270 2023-10-14T18:56:15.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.140+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd48025d00 con 0x7fcd50157270 2023-10-14T18:56:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.140+0000 7fcd477fe700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.140+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd48085f30 con 0x7fcd50157270 2023-10-14T18:56:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.140+0000 7fcd4f7fe700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.141+0000 7fcd4f7fe700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcd40002230 tx=0x7fcd40001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.144+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd480531a0 con 0x7fcd50157270 2023-10-14T18:56:15.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.369+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5006b620 con 0x7fcd50157270 2023-10-14T18:56:15.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.369+0000 7fcd477fe700 1 -- 172.21.15.79:0/3446589866 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fcd48015090 con 0x7fcd50157270 2023-10-14T18:56:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:15.371 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 msgr2=0x7fcd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 0x7fcd300693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcd40002230 tx=0x7fcd40001a20 comp rx=0 tx=0).stop 2023-10-14T18:56:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 msgr2=0x7fcd50147410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcd5006d110 tx=0x7fcd48017000 comp rx=0 tx=0).stop 2023-10-14T18:56:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 shutdown_connections 2023-10-14T18:56:15.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcd30066f30 0x7fcd300693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd50157270 0x7fcd50147410 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006e2b0 0x7fcd500b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 --2- 172.21.15.79:0/3446589866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcd50156ea0 0x7fcd500b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 >> 172.21.15.79:0/3446589866 conn(0x7fcd500ca4f0 msgr2=0x7fcd500cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 shutdown_connections 2023-10-14T18:56:15.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.371+0000 7fcd55d8f700 1 -- 172.21.15.79:0/3446589866 wait complete. 2023-10-14T18:56:15.375 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:15.786 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T18:56:04.982217+0000', 'modified': '2023-10-14T18:56:08.618140+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8160}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8160': {'gid': 8160, 'name': 'd', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/958841168', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 958841168}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 958841168}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-14T18:56:15.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T18:56:15.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T18:56:15.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.902+0000 7f0a809b2700 1 Processor -- start 2023-10-14T18:56:15.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.902+0000 7f0a809b2700 1 -- start start 2023-10-14T18:56:15.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.903+0000 7f0a809b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a7c159e10 0x7f0a7c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.903+0000 7f0a809b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.903+0000 7f0a809b2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c15db80 con 0x7f0a7c15a1e0 2023-10-14T18:56:15.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.903+0000 7f0a809b2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c15e800 con 0x7f0a7c159e10 2023-10-14T18:56:15.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.903+0000 7f0a809b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c15de60 con 0x7f0a7c0cde50 2023-10-14T18:56:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7ad9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a7c159e10 0x7f0a7c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7ad9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c0b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:43636/0 (socket says 172.21.15.79:43636) 2023-10-14T18:56:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7ad9d700 1 -- 172.21.15.79:0/3238196585 learned_addr learned my addr 172.21.15.79:0/3238196585 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 -- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 msgr2=0x7f0a7c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 -- 172.21.15.79:0/3238196585 >> v1:172.21.15.144:6789/0 conn(0x7f0a7c15a1e0 legacy=0x7f0a7c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 -- 172.21.15.79:0/3238196585 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c15e140 con 0x7f0a7c159e10 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c159e10 0x7f0a7c0b2d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009e60 tx=0x7f0a6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bffc003af2f9142c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.904+0000 7f0a7959a700 1 -- 172.21.15.79:0/3238196585 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e070 con 0x7f0a7c159e10 2023-10-14T18:56:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a7959a700 1 -- 172.21.15.79:0/3238196585 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00bb60 con 0x7f0a7c159e10 2023-10-14T18:56:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a7959a700 1 -- 172.21.15.79:0/3238196585 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c012430 con 0x7f0a7c159e10 2023-10-14T18:56:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 -- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c159e10 msgr2=0x7f0a7c0b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c159e10 0x7f0a7c0b2d20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009e60 tx=0x7f0a6c009780 comp rx=0 tx=0).stop 2023-10-14T18:56:15.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 -- 172.21.15.79:0/3238196585 shutdown_connections 2023-10-14T18:56:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3238196585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c159e10 0x7f0a7c0b2d20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 -- 172.21.15.79:0/3238196585 >> 172.21.15.79:0/3238196585 conn(0x7f0a7c067660 msgr2=0x7f0a7c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 -- 172.21.15.79:0/3238196585 shutdown_connections 2023-10-14T18:56:15.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.905+0000 7f0a809b2700 1 -- 172.21.15.79:0/3238196585 wait complete. 2023-10-14T18:56:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.906+0000 7f0a809b2700 1 Processor -- start 2023-10-14T18:56:15.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.906+0000 7f0a809b2700 1 -- start start 2023-10-14T18:56:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c15a1e0 0x7f0a7c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c16ba50 con 0x7f0a7c159e10 2023-10-14T18:56:15.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c16adc0 con 0x7f0a7c15a1e0 2023-10-14T18:56:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a809b2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c16b0a0 con 0x7f0a7c0cde50 2023-10-14T18:56:15.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39522/0 (socket says 172.21.15.79:39522) 2023-10-14T18:56:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 -- 172.21.15.79:0/3544516361 learned_addr learned my addr 172.21.15.79:0/3544516361 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c15a1e0 0x7f0a7c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 -- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 msgr2=0x7f0a7c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 -- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c15a1e0 msgr2=0x7f0a7c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c15a1e0 0x7f0a7c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.907+0000 7f0a79d9b700 1 -- 172.21.15.79:0/3544516361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009a20 con 0x7f0a7c159e10 2023-10-14T18:56:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c590 tx=0x7f0a64007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a727fc700 1 -- 172.21.15.79:0/3544516361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64011590 con 0x7f0a7c159e10 2023-10-14T18:56:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a727fc700 1 -- 172.21.15.79:0/3544516361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64011710 con 0x7f0a7c159e10 2023-10-14T18:56:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c16b6e0 con 0x7f0a7c159e10 2023-10-14T18:56:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a727fc700 1 -- 172.21.15.79:0/3544516361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64011ad0 con 0x7f0a7c159e10 2023-10-14T18:56:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.908+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c158aa0 con 0x7f0a7c159e10 2023-10-14T18:56:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.909+0000 7f0a727fc700 1 -- 172.21.15.79:0/3544516361 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a6401b3b0 con 0x7f0a7c159e10 2023-10-14T18:56:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.909+0000 7f0a727fc700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.910+0000 7f0a727fc700 1 -- 172.21.15.79:0/3544516361 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a640838d0 con 0x7f0a7c159e10 2023-10-14T18:56:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.910+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.910+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 0x7f0a5c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 Processor -- start 2023-10-14T18:56:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 -- start start 2023-10-14T18:56:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602adfbacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602adf15a70 con 0x5602adfbea50 2023-10-14T18:56:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602adf13270 con 0x5602adfe7f60 2023-10-14T18:56:15.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602adf0f060 con 0x5602ae008d00 2023-10-14T18:56:15.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.912+0000 7f0a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39528/0 (socket says 172.21.15.79:39528) 2023-10-14T18:56:15.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 -- 172.21.15.79:0/2171675484 learned_addr learned my addr 172.21.15.79:0/2171675484 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602adfbacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 -- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 msgr2=0x5602adfe7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 -- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 msgr2=0x5602adfbacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602adfbacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 -- 172.21.15.79:0/2171675484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602adda9270 con 0x5602adfbea50 2023-10-14T18:56:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b6c0 tx=0x7f0a6c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcfe9ac2eae989c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a5b7fe700 1 -- 172.21.15.79:0/2171675484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c01f580 con 0x5602adfbea50 2023-10-14T18:56:15.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a5b7fe700 1 -- 172.21.15.79:0/2171675484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c01f6e0 con 0x5602adfbea50 2023-10-14T18:56:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.913+0000 7f0a5b7fe700 1 -- 172.21.15.79:0/2171675484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c01faa0 con 0x5602adfbea50 2023-10-14T18:56:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2171675484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 msgr2=0x5602adfbee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b6c0 tx=0x7f0a6c021040 comp rx=0 tx=0).stop 2023-10-14T18:56:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2171675484 shutdown_connections 2023-10-14T18:56:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602adfbacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602adfbee20 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2171675484 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2171675484 >> 172.21.15.79:0/2171675484 conn(0x5602adfc0370 msgr2=0x5602adfc0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2171675484 shutdown_connections 2023-10-14T18:56:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2171675484 wait complete. 2023-10-14T18:56:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.914+0000 7f0a89cabb80 1 -- start start 2023-10-14T18:56:15.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 Processor -- start 2023-10-14T18:56:15.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfbea50 0x5602ae015a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602adeba890 con 0x5602ae008d00 2023-10-14T18:56:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602aded5ea0 con 0x5602adfe7f60 2023-10-14T18:56:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602add91e30 con 0x5602adfbea50 2023-10-14T18:56:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.915+0000 7f0a89cabb80 10 client.0 _ll_register_callbacks cb 0x5602adf82110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:56:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39542/0 (socket says 172.21.15.79:39542) 2023-10-14T18:56:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 -- 172.21.15.79:0/1125407618 learned_addr learned my addr 172.21.15.79:0/1125407618 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfbea50 0x5602ae015a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 -- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfbea50 msgr2=0x5602ae015a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfbea50 0x5602ae015a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 -- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 msgr2=0x5602ae005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 -- 172.21.15.79:0/1125407618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c15e140 con 0x5602ae008d00 2023-10-14T18:56:15.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0a74014980 tx=0x7f0a74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436a0c97411a3465 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:56:15.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74012730 con 0x5602ae008d00 2023-10-14T18:56:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a7401a070 con 0x5602ae008d00 2023-10-14T18:56:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602adfb3b70 con 0x5602ae008d00 2023-10-14T18:56:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a74012aa0 con 0x5602ae008d00 2023-10-14T18:56:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a89cabb80 10 client.8316 fetch_fsmap learned FSMap version 88 2023-10-14T18:56:15.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x5602add4bfe0 con 0x5602ae008d00 2023-10-14T18:56:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.916+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5602adfb3b70 con 0x5602ae008d00 2023-10-14T18:56:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 88) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a74011030 con 0x5602ae008d00 2023-10-14T18:56:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 10 client.8316 fetch_fsmap finished waiting for FSMap version 88 2023-10-14T18:56:15.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 10 client.8316 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T18:56:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 20 client.8316 populate_metadata read hostname 'smithi079' 2023-10-14T18:56:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602adfbb780 0x5602adfbbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 4 client.8316 mds_command: new command op to 8160 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-14T18:56:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 --> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602adf90aa0 con 0x5602adfbb780 2023-10-14T18:56:15.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602adfbb780 0x5602adfbbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a58ff9700 10 client.8316 ms_handle_connect on v2:172.21.15.144:6835/958841168 2023-10-14T18:56:15.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.917+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602adfbb780 0x5602adfbbb50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e05f76f7b5857a6 server_cookie=2fcbc93d18e316f5 in_seq=0 out_seq=0 2023-10-14T18:56:15.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1125407618 <== mds.0 v2:172.21.15.144:6835/958841168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5602adf90aa0 con 0x5602adfbb780 2023-10-14T18:56:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a58ff9700 10 client.8316 handle_command_reply: tid=0 2023-10-14T18:56:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 client.8316 shutdown 2023-10-14T18:56:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 msgr2=0x5602ae0184d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f0a74014980 tx=0x7f0a74008040 comp rx=0 tx=0).stop 2023-10-14T18:56:15.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 shutdown_connections 2023-10-14T18:56:15.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602ae008d00 0x5602ae0184d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602adfbb780 0x5602adfbbb50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfbea50 0x5602ae015a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a58ff9700 0 client.8316 ms_handle_reset on v2:172.21.15.144:6835/958841168 2023-10-14T18:56:15.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1125407618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 >> 172.21.15.79:0/1125407618 conn(0x5602adfc0370 msgr2=0x5602ae004550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 shutdown_connections 2023-10-14T18:56:15.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1125407618 wait complete. 2023-10-14T18:56:15.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.918+0000 7f0a89cabb80 20 client.8316 trim_cache size 0 max 16384 2023-10-14T18:56:15.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.935+0000 7f0a89cabb80 1 Processor -- start 2023-10-14T18:56:15.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.935+0000 7f0a89cabb80 1 -- start start 2023-10-14T18:56:15.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfbea50 0x5602ae014370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602ae004380 con 0x5602adfe7f60 2023-10-14T18:56:15.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602adf974b0 con 0x5602adfbea50 2023-10-14T18:56:15.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602adfbe130 con 0x5602ae008d00 2023-10-14T18:56:15.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39558/0 (socket says 172.21.15.79:39558) 2023-10-14T18:56:15.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 -- 172.21.15.79:0/2766869971 learned_addr learned my addr 172.21.15.79:0/2766869971 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 -- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 msgr2=0x5602adfe3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 -- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfbea50 msgr2=0x5602ae014370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfbea50 0x5602ae014370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 -- 172.21.15.79:0/2766869971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602adedd780 con 0x5602adfe7f60 2023-10-14T18:56:15.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0a64050c60 tx=0x7f0a64014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582b9d084df81eff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a5bfff700 1 -- 172.21.15.79:0/2766869971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640579b0 con 0x5602adfe7f60 2023-10-14T18:56:15.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a5bfff700 1 -- 172.21.15.79:0/2766869971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6405b700 con 0x5602adfe7f60 2023-10-14T18:56:15.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.936+0000 7f0a5bfff700 1 -- 172.21.15.79:0/2766869971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64011e80 con 0x5602adfe7f60 2023-10-14T18:56:15.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2766869971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 msgr2=0x5602adfee900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0a64050c60 tx=0x7f0a64014040 comp rx=0 tx=0).stop 2023-10-14T18:56:15.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2766869971 shutdown_connections 2023-10-14T18:56:15.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602ae008d00 0x5602adfe3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602adfbea50 0x5602ae014370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/2766869971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfe7f60 0x5602adfee900 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2766869971 >> 172.21.15.79:0/2766869971 conn(0x5602adfc0370 msgr2=0x5602adfbbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2766869971 shutdown_connections 2023-10-14T18:56:15.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- 172.21.15.79:0/2766869971 wait complete. 2023-10-14T18:56:15.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 -- start start 2023-10-14T18:56:15.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.937+0000 7f0a89cabb80 1 Processor -- start 2023-10-14T18:56:15.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 0x5602ae006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602ae064300 con 0x5602adfbea50 2023-10-14T18:56:15.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602ae04eed0 con 0x5602ae008d00 2023-10-14T18:56:15.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602adffb560 con 0x5602adfe7f60 2023-10-14T18:56:15.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a89cabb80 10 client.0 _ll_register_callbacks cb 0x5602adf82110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T18:56:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39564/0 (socket says 172.21.15.79:39564) 2023-10-14T18:56:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.938+0000 7f0a7a59c700 1 -- 172.21.15.79:0/1904379822 learned_addr learned my addr 172.21.15.79:0/1904379822 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 0x5602ae006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 -- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfe7f60 msgr2=0x5602ae005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 -- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 msgr2=0x5602ae006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 0x5602ae006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 -- 172.21.15.79:0/1904379822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c158aa0 con 0x5602adfbea50 2023-10-14T18:56:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7ad9d700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 0x5602ae006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a7a59c700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bee0 tx=0x7f0a6c03c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b196bd49f87258be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-14T18:56:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c01fa60 con 0x5602adfbea50 2023-10-14T18:56:15.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a6c038040 con 0x5602adfbea50 2023-10-14T18:56:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a6c01f6e0 con 0x5602adfbea50 2023-10-14T18:56:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c033690 con 0x5602adfbea50 2023-10-14T18:56:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 10 client.8322 fetch_fsmap learned FSMap version 88 2023-10-14T18:56:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x5602adec4470 con 0x5602adfbea50 2023-10-14T18:56:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c01f6e0 con 0x5602adfbea50 2023-10-14T18:56:15.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 88) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a6c0337f0 con 0x5602adfbea50 2023-10-14T18:56:15.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 10 client.8322 fetch_fsmap finished waiting for FSMap version 88 2023-10-14T18:56:15.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 10 client.8322 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T18:56:15.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 20 client.8322 populate_metadata read hostname 'smithi079' 2023-10-14T18:56:15.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602ae009380 0x5602ae009750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 4 client.8322 mds_command: new command op to 8160 tid=0[{"prefix": "status"}] 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.939+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 --> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5602adeb1e00 con 0x5602ae009380 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602ae009380 0x5602ae009750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a58ff9700 10 client.8322 ms_handle_connect on v2:172.21.15.144:6835/958841168 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a79d9b700 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602ae009380 0x5602ae009750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9be713aa52d984 server_cookie=2e62aa5fe5b512a1 in_seq=0 out_seq=0 2023-10-14T18:56:15.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a58ff9700 1 -- 172.21.15.79:0/1904379822 <== mds.0 v2:172.21.15.144:6835/958841168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5602adeb1e00 con 0x5602ae009380 2023-10-14T18:56:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a58ff9700 10 client.8322 handle_command_reply: tid=0 2023-10-14T18:56:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 client.8322 shutdown 2023-10-14T18:56:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 msgr2=0x5602ae04e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bee0 tx=0x7f0a6c03c250 comp rx=0 tx=0).stop 2023-10-14T18:56:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 shutdown_connections 2023-10-14T18:56:15.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602ae008d00 0x5602ae006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5602adfbea50 0x5602ae04e990 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:6835/958841168,v1:172.21.15.144:6837/958841168] conn(0x5602ae009380 0x5602ae009750 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 --2- 172.21.15.79:0/1904379822 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x5602adfe7f60 0x5602ae005ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a58ff9700 0 client.8322 ms_handle_reset on v2:172.21.15.144:6835/958841168 2023-10-14T18:56:15.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 >> 172.21.15.79:0/1904379822 conn(0x5602adfc0370 msgr2=0x5602adfe3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 shutdown_connections 2023-10-14T18:56:15.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.940+0000 7f0a89cabb80 1 -- 172.21.15.79:0/1904379822 wait complete. 2023-10-14T18:56:15.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a89cabb80 20 client.8322 trim_cache size 0 max 16384 2023-10-14T18:56:15.984 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-14T18:56:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 8160, 2023-10-14T18:56:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-14T18:56:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-14T18:56:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-14T18:56:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 10.329113490999999, 2023-10-14T18:56:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 88, 2023-10-14T18:56:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 186, 2023-10-14T18:56:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 186, 2023-10-14T18:56:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 15.897987136999999 2023-10-14T18:56:15.986 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:15.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 msgr2=0x7f0a5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 0x7f0a5c0693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0097c0 tx=0x7f0a6c019000 comp rx=0 tx=0).stop 2023-10-14T18:56:15.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 msgr2=0x7f0a7c16a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:15.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c590 tx=0x7f0a64007f50 comp rx=0 tx=0).stop 2023-10-14T18:56:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 shutdown_connections 2023-10-14T18:56:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0a5c066f30 0x7f0a5c0693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a7c15a1e0 0x7f0a7c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a7c0cde50 0x7f0a7c158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 --2- 172.21.15.79:0/3544516361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a7c159e10 0x7f0a7c16a470 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 >> 172.21.15.79:0/3544516361 conn(0x7f0a7c067660 msgr2=0x7f0a7c0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 shutdown_connections 2023-10-14T18:56:15.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:15.941+0000 7f0a809b2700 1 -- 172.21.15.79:0/3544516361 wait complete. 2023-10-14T18:56:15.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:56:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.105+0000 7f88519d9700 1 Processor -- start 2023-10-14T18:56:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.105+0000 7f88519d9700 1 -- start start 2023-10-14T18:56:16.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88519d9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f884c0cdab0 0x7f884c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:16.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88519d9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0cb7c0 con 0x7f884c0cd6e0 2023-10-14T18:56:16.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88519d9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c15e290 con 0x7f884c15dda0 2023-10-14T18:56:16.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88519d9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c15e850 con 0x7f884c0cdab0 2023-10-14T18:56:16.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f884bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f884c0cdab0 0x7f884c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:16.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88509d7700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f884c0cd6e0 0x7f884c0cbc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49212/0 (socket says 172.21.15.79:49212) 2023-10-14T18:56:16.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f88509d7700 1 -- 172.21.15.79:0/3435931592 learned_addr learned my addr 172.21.15.79:0/3435931592 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:16.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f884bfff700 1 -- 172.21.15.79:0/3435931592 >> v1:172.21.15.144:6789/0 conn(0x7f884c15dda0 legacy=0x7f884c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f884bfff700 1 -- 172.21.15.79:0/3435931592 >> v1:172.21.15.79:6789/0 conn(0x7f884c0cd6e0 legacy=0x7f884c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f884bfff700 1 -- 172.21.15.79:0/3435931592 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c15e570 con 0x7f884c0cdab0 2023-10-14T18:56:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.106+0000 7f884b7fe700 1 -- 172.21.15.79:0/3435931592 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108964510 0 0) 0x7f884c0cb7c0 con 0x7f884c0cd6e0 2023-10-14T18:56:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f884bfff700 1 --2- 172.21.15.79:0/3435931592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c0cdab0 0x7f884c15d860 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f88400098e0 tx=0x7f88400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5522639f36854b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f884b7fe700 1 -- 172.21.15.79:0/3435931592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840009e80 con 0x7f884c0cdab0 2023-10-14T18:56:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f884b7fe700 1 -- 172.21.15.79:0/3435931592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000b820 con 0x7f884c0cdab0 2023-10-14T18:56:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f884b7fe700 1 -- 172.21.15.79:0/3435931592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000bba0 con 0x7f884c0cdab0 2023-10-14T18:56:16.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 -- 172.21.15.79:0/3435931592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c0cdab0 msgr2=0x7f884c15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 --2- 172.21.15.79:0/3435931592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c0cdab0 0x7f884c15d860 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f88400098e0 tx=0x7f88400091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 -- 172.21.15.79:0/3435931592 shutdown_connections 2023-10-14T18:56:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 --2- 172.21.15.79:0/3435931592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c0cdab0 0x7f884c15d860 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 -- 172.21.15.79:0/3435931592 >> 172.21.15.79:0/3435931592 conn(0x7f884c067660 msgr2=0x7f884c067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 -- 172.21.15.79:0/3435931592 shutdown_connections 2023-10-14T18:56:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.107+0000 7f88519d9700 1 -- 172.21.15.79:0/3435931592 wait complete. 2023-10-14T18:56:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.108+0000 7f88519d9700 1 Processor -- start 2023-10-14T18:56:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 -- start start 2023-10-14T18:56:16.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c0cd6e0 0x7f884c153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:16.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c0cdab0 0x7f884c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:16.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:16.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0cc360 con 0x7f884c15dda0 2023-10-14T18:56:16.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b3bb0 con 0x7f884c0cdab0 2023-10-14T18:56:16.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88519d9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b3e90 con 0x7f884c0cd6e0 2023-10-14T18:56:16.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88511d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:16.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88511d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39582/0 (socket says 172.21.15.79:39582) 2023-10-14T18:56:16.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.109+0000 7f88511d8700 1 -- 172.21.15.79:0/2795153783 learned_addr learned my addr 172.21.15.79:0/2795153783 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:16.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f884bfff700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c0cdab0 0x7f884c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:16.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88509d7700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c0cd6e0 0x7f884c153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:16.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 -- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c0cd6e0 msgr2=0x7f884c153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c0cd6e0 0x7f884c153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 -- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c0cdab0 msgr2=0x7f884c0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c0cdab0 0x7f884c0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 -- 172.21.15.79:0/2795153783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009420 con 0x7f884c15dda0 2023-10-14T18:56:16.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88511d8700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f884400b5e0 tx=0x7f8844009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400f510 con 0x7f884c15dda0 2023-10-14T18:56:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884400f670 con 0x7f884c15dda0 2023-10-14T18:56:16.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c0b4170 con 0x7f884c15dda0 2023-10-14T18:56:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400fa30 con 0x7f884c15dda0 2023-10-14T18:56:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.110+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c0b4730 con 0x7f884c15dda0 2023-10-14T18:56:16.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.111+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c089280 con 0x7f884c15dda0 2023-10-14T18:56:16.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.111+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f884401a400 con 0x7f884c15dda0 2023-10-14T18:56:16.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.112+0000 7f8848ff9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.112+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8844084090 con 0x7f884c15dda0 2023-10-14T18:56:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.112+0000 7f88509d7700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.113+0000 7f88509d7700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f883c001560 tx=0x7f883c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:16.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.116+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8844054e10 con 0x7f884c15dda0 2023-10-14T18:56:16.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.341+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f884c04bb80 con 0x7f884c15dda0 2023-10-14T18:56:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.342+0000 7f8848ff9700 1 -- 172.21.15.79:0/2795153783 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7f88440549a0 con 0x7f884c15dda0 2023-10-14T18:56:16.343 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:56:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 msgr2=0x7f88380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f883c001560 tx=0x7f883c009040 comp rx=0 tx=0).stop 2023-10-14T18:56:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 msgr2=0x7f884c159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f884400b5e0 tx=0x7f8844009060 comp rx=0 tx=0).stop 2023-10-14T18:56:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 shutdown_connections 2023-10-14T18:56:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f884c15dda0 0x7f884c159810 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f884c0cd6e0 0x7f884c153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 --2- 172.21.15.79:0/2795153783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f884c0cdab0 0x7f884c0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 >> 172.21.15.79:0/2795153783 conn(0x7f884c067660 msgr2=0x7f884c0c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 shutdown_connections 2023-10-14T18:56:16.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:16.344+0000 7f88519d9700 1 -- 172.21.15.79:0/2795153783 wait complete. 2023-10-14T18:56:16.356 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:56:16.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:56:16.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-14T18:56:16.358 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T18:56:16.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T18:56:16.359 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:56:16.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:56:16.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:56:16.360 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:56:16.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.361 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-14T18:56:16.376 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:56:16.376 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:56:16.377 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:56:16.377 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.378 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-14T18:56:16.378 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.379 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:16.379 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:16.379 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2023-10-14T18:56:16.379 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:16.379 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2023-10-14T18:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:16.381 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:56:16.381 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 41858sec preferred_lft 41858sec 2023-10-14T18:56:16.381 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2023-10-14T18:56:16.381 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.381 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:56:16.382 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:16.382 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:56:16.382 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.382 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::1093:e5ff:fe8e:17e4/64 scope link 2023-10-14T18:56:16.382 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.383 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:56:16.383 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 72:9b:f8:00:50:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:56:16.383 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::709b:f8ff:fe00:50dc/64 scope link 2023-10-14T18:56:16.383 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.383 INFO:teuthology.orchestra.run.smithi079.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:56:16.384 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:86:5f:4a:31:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:56:16.384 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e486:5fff:fe4a:31c9/64 scope link 2023-10-14T18:56:16.384 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:16.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.385 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:56:16.439 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-14T18:56:16.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.441 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-14T18:56:16.497 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-14T18:56:16.498 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:56:16.498 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:56:16.498 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:56:16.498 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:56:16.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.500 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-14T18:56:16.500 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-14T18:56:16.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:56:16.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:56:16.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:56:16.502 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-14T18:56:16.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.598 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:56:16.613 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:56:16.613 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:56:16.614 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:56:16.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-14T18:56:16.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:56:16.678 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T18:56:16.733 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T18:56:16.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:56:16.734 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:56:16.787 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:56:16.788 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:56:16.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:56:16.867 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:56:16.868 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:56:16.868 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:56:16.876 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:56:16.876 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:56:16.876 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:56:16.876 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:56:16.877 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:56:16.898 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-14T18:56:16.898 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-14T18:56:16.899 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2023-10-14T18:56:16.899 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:56:16.899 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:56:16.899 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:56:16.900 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:56:16.900 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:56:16.901 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:56:16.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:16.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T18:56:16.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T18:56:17.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.121+0000 7fd380507700 1 Processor -- start 2023-10-14T18:56:17.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.121+0000 7fd380507700 1 -- start start 2023-10-14T18:56:17.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd380507700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd378157870 0x7fd37815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd380507700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd378157c40 0x7fd378158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd380507700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37815cbb0 con 0x7fd37815a620 2023-10-14T18:56:17.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd380507700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37815bfa0 con 0x7fd378157c40 2023-10-14T18:56:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd380507700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37815c280 con 0x7fd378157870 2023-10-14T18:56:17.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37daa2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd37815a620 0x7fd37815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:49220/0 (socket says 172.21.15.79:49220) 2023-10-14T18:56:17.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37daa2700 1 -- 172.21.15.79:0/3891516785 learned_addr learned my addr 172.21.15.79:0/3891516785 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:17.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 --2- 172.21.15.79:0/3891516785 >> v2:172.21.15.144:3300/0 conn(0x7fd378157c40 0x7fd378158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37e2a3700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd378157870 0x7fd37815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37d2a1700 1 -- 172.21.15.79:0/3891516785 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361146684 0 0) 0x7fd37815cbb0 con 0x7fd37815a620 2023-10-14T18:56:17.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37d2a1700 1 -- 172.21.15.79:0/3891516785 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003570 con 0x7fd37815a620 2023-10-14T18:56:17.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 -- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd378157870 msgr2=0x7fd37815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:17.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd378157870 0x7fd37815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 -- 172.21.15.79:0/3891516785 >> v1:172.21.15.79:6789/0 conn(0x7fd37815a620 legacy=0x7fd37815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 -- 172.21.15.79:0/3891516785 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37815c560 con 0x7fd378157c40 2023-10-14T18:56:17.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.122+0000 7fd37eaa4700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157c40 0x7fd378158110 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd370009e60 tx=0x7fd370009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6808e4be1fa10be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:17.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd37d2a1700 1 -- 172.21.15.79:0/3891516785 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000e070 con 0x7fd378157c40 2023-10-14T18:56:17.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd37d2a1700 1 -- 172.21.15.79:0/3891516785 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37000bab0 con 0x7fd378157c40 2023-10-14T18:56:17.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd37d2a1700 1 -- 172.21.15.79:0/3891516785 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37000be70 con 0x7fd378157c40 2023-10-14T18:56:17.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 -- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157c40 msgr2=0x7fd378158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157c40 0x7fd378158110 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd370009e60 tx=0x7fd370009780 comp rx=0 tx=0).stop 2023-10-14T18:56:17.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 -- 172.21.15.79:0/3891516785 shutdown_connections 2023-10-14T18:56:17.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157c40 0x7fd378158110 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 --2- 172.21.15.79:0/3891516785 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd378157870 0x7fd37815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 -- 172.21.15.79:0/3891516785 >> 172.21.15.79:0/3891516785 conn(0x7fd378068ce0 msgr2=0x7fd3780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:17.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 -- 172.21.15.79:0/3891516785 shutdown_connections 2023-10-14T18:56:17.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.123+0000 7fd380507700 1 -- 172.21.15.79:0/3891516785 wait complete. 2023-10-14T18:56:17.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.124+0000 7fd380507700 1 Processor -- start 2023-10-14T18:56:17.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.124+0000 7fd380507700 1 -- start start 2023-10-14T18:56:17.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 0x7fd3780a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37815a620 0x7fd3780af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37815ec20 con 0x7fd378157c40 2023-10-14T18:56:17.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378142330 con 0x7fd378157870 2023-10-14T18:56:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd380507700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37815e940 con 0x7fd37815a620 2023-10-14T18:56:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39592/0 (socket says 172.21.15.79:39592) 2023-10-14T18:56:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 -- 172.21.15.79:0/3534960385 learned_addr learned my addr 172.21.15.79:0/3534960385 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:17.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37e2a3700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 0x7fd3780a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37eaa4700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37815a620 0x7fd3780af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 -- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37815a620 msgr2=0x7fd3780af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37815a620 0x7fd3780af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 -- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 msgr2=0x7fd3780a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 0x7fd3780a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37daa2700 1 -- 172.21.15.79:0/3534960385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370009a20 con 0x7fd378157c40 2023-10-14T18:56:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.125+0000 7fd37e2a3700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 0x7fd3780a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd37daa2700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c590 tx=0x7fd368007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368005b30 con 0x7fd378157c40 2023-10-14T18:56:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd368005cb0 con 0x7fd378157c40 2023-10-14T18:56:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3781425d0 con 0x7fd378157c40 2023-10-14T18:56:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368007320 con 0x7fd378157c40 2023-10-14T18:56:17.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.126+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3780a8f30 con 0x7fd378157c40 2023-10-14T18:56:17.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.127+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3780a9120 con 0x7fd378157c40 2023-10-14T18:56:17.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.127+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd36801b3b0 con 0x7fd378157c40 2023-10-14T18:56:17.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.127+0000 7fd36e7fc700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:17.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.127+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd368083af0 con 0x7fd378157c40 2023-10-14T18:56:17.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.127+0000 7fd37e2a3700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:17.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.128+0000 7fd37e2a3700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 0x7fd35c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd374009d80 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:17.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.131+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd368050d60 con 0x7fd378157c40 2023-10-14T18:56:17.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.354+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd37804c3c0 con 0x7fd378157c40 2023-10-14T18:56:17.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.354+0000 7fd36e7fc700 1 -- 172.21.15.79:0/3534960385 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd368017020 con 0x7fd378157c40 2023-10-14T18:56:17.355 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T18:56:17.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 msgr2=0x7fd35c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 0x7fd35c0693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd374009d80 tx=0x7fd374008040 comp rx=0 tx=0).stop 2023-10-14T18:56:17.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 msgr2=0x7fd3780aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:17.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fd36800c590 tx=0x7fd368007e00 comp rx=0 tx=0).stop 2023-10-14T18:56:17.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 shutdown_connections 2023-10-14T18:56:17.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd35c066f30 0x7fd35c0693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd37815a620 0x7fd3780af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd378157870 0x7fd3780a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 --2- 172.21.15.79:0/3534960385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd378157c40 0x7fd3780aeb40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:17.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 >> 172.21.15.79:0/3534960385 conn(0x7fd378068ce0 msgr2=0x7fd3780b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:17.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 shutdown_connections 2023-10-14T18:56:17.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:17.357+0000 7fd380507700 1 -- 172.21.15.79:0/3534960385 wait complete. 2023-10-14T18:56:17.369 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T18:56:17.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T18:56:17.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2023-10-14T18:56:17.370 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T18:56:17.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T18:56:17.371 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T18:56:17.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T18:56:17.372 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T18:56:17.372 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:56:17.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.373 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2023-10-14T18:56:17.392 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T18:56:17.392 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T18:56:17.392 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T18:56:17.393 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.393 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2023-10-14T18:56:17.393 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.394 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2023-10-14T18:56:17.394 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:17.394 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2023-10-14T18:56:17.395 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T18:56:17.395 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:17.395 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T18:56:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T18:56:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41849sec preferred_lft 41849sec 2023-10-14T18:56:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2023-10-14T18:56:17.396 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.397 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T18:56:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff 2023-10-14T18:56:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T18:56:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.397 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::a063:9cff:fe95:4beb/64 scope link 2023-10-14T18:56:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.398 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:56:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 62:ca:75:89:27:20 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:56:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::60ca:75ff:fe89:2720/64 scope link 2023-10-14T18:56:17.398 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.399 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T18:56:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 82:72:b2:0e:b9:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:56:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::8072:b2ff:fe0e:b935/64 scope link 2023-10-14T18:56:17.399 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2023-10-14T18:56:17.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.400 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T18:56:17.459 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-10-14T18:56:17.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.461 DEBUG:teuthology.orchestra.run.smithi144:> route 2023-10-14T18:56:17.519 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2023-10-14T18:56:17.519 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T18:56:17.519 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T18:56:17.519 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T18:56:17.520 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T18:56:17.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.520 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec bash -c ' 2023-10-14T18:56:17.521 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2023-10-14T18:56:17.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T18:56:17.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T18:56:17.522 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T18:56:17.522 DEBUG:teuthology.orchestra.run.smithi144:> ') 2023-10-14T18:56:17.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.627 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:56:17.643 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:56:17.643 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:56:17.644 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:56:17.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2023-10-14T18:56:17.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:56:17.709 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T18:56:17.763 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T18:56:17.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T18:56:17.764 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:56:17.817 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-14T18:56:17.818 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-14T18:56:17.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:56:17.897 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:56:17.897 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:56:17.898 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:56:17.906 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:56:17.906 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:56:17.906 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:56:17.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:56:17.907 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:56:17.926 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-14T18:56:17.927 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-14T18:56:17.927 INFO:teuthology.orchestra.run.smithi144.stdout:invalid new device string format 2023-10-14T18:56:17.927 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-10-14T18:56:17.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T18:56:17.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-10-14T18:56:17.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-10-14T18:56:17.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=73e97ab7-e872-4b12-8e7a-6b299bb24b40" will pass to kernel 2023-10-14T18:56:17.929 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T18:56:17.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:17.930 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T18:56:17.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.108+0000 7efd76244700 1 Processor -- start 2023-10-14T18:56:18.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.108+0000 7efd76244700 1 -- start start 2023-10-14T18:56:18.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd76244700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd70157870 0x7efd7015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd76244700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7015a620 0x7efd7015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd76244700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7015cbb0 con 0x7efd7015d580 2023-10-14T18:56:18.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd76244700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7015bfa0 con 0x7efd7015a620 2023-10-14T18:56:18.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd76244700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7015c280 con 0x7efd70157870 2023-10-14T18:56:18.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd6effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7015a620 0x7efd7015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd6effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7015a620 0x7efd7015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39604/0 (socket says 172.21.15.79:39604) 2023-10-14T18:56:18.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd6effd700 1 -- 172.21.15.79:0/3288580436 learned_addr learned my addr 172.21.15.79:0/3288580436 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:18.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd6f7fe700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd70157870 0x7efd7015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.109+0000 7efd6effd700 1 -- 172.21.15.79:0/3288580436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd70157870 msgr2=0x7efd7015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:18.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6effd700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd70157870 0x7efd7015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6effd700 1 -- 172.21.15.79:0/3288580436 >> v1:172.21.15.144:6789/0 conn(0x7efd7015d580 legacy=0x7efd70158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6effd700 1 -- 172.21.15.79:0/3288580436 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7015c560 con 0x7efd7015a620 2023-10-14T18:56:18.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6effd700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7015a620 0x7efd7015d040 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7efd640099b0 tx=0x7efd64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b235cb8d8ab90364 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6e7fc700 1 -- 172.21.15.79:0/3288580436 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64009ea0 con 0x7efd7015a620 2023-10-14T18:56:18.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6e7fc700 1 -- 172.21.15.79:0/3288580436 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6400b860 con 0x7efd7015a620 2023-10-14T18:56:18.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd6e7fc700 1 -- 172.21.15.79:0/3288580436 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400bc00 con 0x7efd7015a620 2023-10-14T18:56:18.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 -- 172.21.15.79:0/3288580436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7015a620 msgr2=0x7efd7015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7015a620 0x7efd7015d040 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7efd640099b0 tx=0x7efd64009250 comp rx=0 tx=0).stop 2023-10-14T18:56:18.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 -- 172.21.15.79:0/3288580436 shutdown_connections 2023-10-14T18:56:18.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd70157870 0x7efd7015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 --2- 172.21.15.79:0/3288580436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7015a620 0x7efd7015d040 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 -- 172.21.15.79:0/3288580436 >> 172.21.15.79:0/3288580436 conn(0x7efd70068ce0 msgr2=0x7efd700690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:18.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 -- 172.21.15.79:0/3288580436 shutdown_connections 2023-10-14T18:56:18.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.110+0000 7efd76244700 1 -- 172.21.15.79:0/3288580436 wait complete. 2023-10-14T18:56:18.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 Processor -- start 2023-10-14T18:56:18.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 -- start start 2023-10-14T18:56:18.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015a620 0x7efd700d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015d580 0x7efd701498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7016eac0 con 0x7efd70157870 2023-10-14T18:56:18.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7016deb0 con 0x7efd7015a620 2023-10-14T18:56:18.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd76244700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7016e190 con 0x7efd7015d580 2023-10-14T18:56:18.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd6f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.112+0000 7efd6f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39614/0 (socket says 172.21.15.79:39614) 2023-10-14T18:56:18.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 -- 172.21.15.79:0/3380102786 learned_addr learned my addr 172.21.15.79:0/3380102786 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:18.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6ffff700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015d580 0x7efd701498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6effd700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015a620 0x7efd700d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 -- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015d580 msgr2=0x7efd701498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015d580 0x7efd701498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 -- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015a620 msgr2=0x7efd700d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015a620 0x7efd700d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 -- 172.21.15.79:0/3380102786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640094f0 con 0x7efd70157870 2023-10-14T18:56:18.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd6f7fe700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7efd60009ef0 tx=0x7efd6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6000cc50 con 0x7efd70157870 2023-10-14T18:56:18.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6000f040 con 0x7efd70157870 2023-10-14T18:56:18.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7016e470 con 0x7efd70157870 2023-10-14T18:56:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60014480 con 0x7efd70157870 2023-10-14T18:56:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.113+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700d0b10 con 0x7efd70157870 2023-10-14T18:56:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.114+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7016eda0 con 0x7efd70157870 2023-10-14T18:56:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.114+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd600147f0 con 0x7efd70157870 2023-10-14T18:56:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.115+0000 7efd577fe700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 0x7efd5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.115+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd60085000 con 0x7efd70157870 2023-10-14T18:56:18.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.115+0000 7efd6effd700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 0x7efd5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.115+0000 7efd6effd700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 0x7efd5c0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7efd640099b0 tx=0x7efd64017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.119+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd60052270 con 0x7efd70157870 2023-10-14T18:56:18.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.343+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd7004c3c0 con 0x7efd70157870 2023-10-14T18:56:18.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.344+0000 7efd577fe700 1 -- 172.21.15.79:0/3380102786 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7efd60055890 con 0x7efd70157870 2023-10-14T18:56:18.345 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:18.345 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:18.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 msgr2=0x7efd5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 0x7efd5c0693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7efd640099b0 tx=0x7efd64017000 comp rx=0 tx=0).stop 2023-10-14T18:56:18.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 msgr2=0x7efd700cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7efd60009ef0 tx=0x7efd6000b040 comp rx=0 tx=0).stop 2023-10-14T18:56:18.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 shutdown_connections 2023-10-14T18:56:18.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efd5c066f30 0x7efd5c0693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efd7015d580 0x7efd701498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd70157870 0x7efd700cfe80 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 --2- 172.21.15.79:0/3380102786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd7015a620 0x7efd700d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 >> 172.21.15.79:0/3380102786 conn(0x7efd70068ce0 msgr2=0x7efd70158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:18.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 shutdown_connections 2023-10-14T18:56:18.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.346+0000 7efd76244700 1 -- 172.21.15.79:0/3380102786 wait complete. 2023-10-14T18:56:18.349 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:18.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-14T18:56:18.494 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.872253062,"mdsmap_epoch":88,"osdmap_epoch":186,"osdmap_epoch_barrier":186,"uptime":18.441127466000001} 2023-10-14T18:56:18.494 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 88, "osdmap_epoch": 186, "osdmap_epoch_barrier": 186, "rank_uptime": 12.872253062, "state": "up:active", "uptime": 18.441127466, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:56:18.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-14T18:56:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 Processor -- start 2023-10-14T18:56:18.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 -- start start 2023-10-14T18:56:18.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f296015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29600b17b0 con 0x7f2960159ef0 2023-10-14T18:56:18.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29600b1a60 con 0x7f29600b46f0 2023-10-14T18:56:18.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.614+0000 7f2964c19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29600b1d40 con 0x7f29600b6a10 2023-10-14T18:56:18.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295e59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2960159ef0 0x7f29600b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33536/0 (socket says 172.21.15.79:33536) 2023-10-14T18:56:18.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295e59c700 1 -- 172.21.15.79:0/136362448 learned_addr learned my addr 172.21.15.79:0/136362448 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:18.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f2955d9b700 1 --2- 172.21.15.79:0/136362448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f296015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959844576 0 0) 0x7f29600b17b0 con 0x7f2960159ef0 2023-10-14T18:56:18.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f294c003570 con 0x7f2960159ef0 2023-10-14T18:56:18.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674446170 0 0) 0x7f29600b1a60 con 0x7f29600b46f0 2023-10-14T18:56:18.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29600b17b0 con 0x7f29600b46f0 2023-10-14T18:56:18.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f2955d9b700 1 -- 172.21.15.79:0/136362448 >> v1:172.21.15.144:6789/0 conn(0x7f29600b46f0 legacy=0x7f29600cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f2955d9b700 1 -- 172.21.15.79:0/136362448 >> v1:172.21.15.79:6789/0 conn(0x7f2960159ef0 legacy=0x7f29600b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145711778 0 0) 0x7f294c003570 con 0x7f2960159ef0 2023-10-14T18:56:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f2955d9b700 1 -- 172.21.15.79:0/136362448 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29600b2020 con 0x7f29600b6a10 2023-10-14T18:56:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f2955d9b700 1 --2- 172.21.15.79:0/136362448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f296015a2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2948009910 tx=0x7f29480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39594274c0cfd2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500015f0 con 0x7f29600b6a10 2023-10-14T18:56:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948011420 con 0x7f29600b6a10 2023-10-14T18:56:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.615+0000 7f295dd9b700 1 -- 172.21.15.79:0/136362448 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480117c0 con 0x7f29600b6a10 2023-10-14T18:56:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 -- 172.21.15.79:0/136362448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 msgr2=0x7f296015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 --2- 172.21.15.79:0/136362448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f296015a2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2948009910 tx=0x7f29480091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 -- 172.21.15.79:0/136362448 shutdown_connections 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 --2- 172.21.15.79:0/136362448 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f296015a2c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 -- 172.21.15.79:0/136362448 >> 172.21.15.79:0/136362448 conn(0x7f296009a0a0 msgr2=0x7f2960067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 -- 172.21.15.79:0/136362448 shutdown_connections 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.616+0000 7f2964c19700 1 -- 172.21.15.79:0/136362448 wait complete. 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.617+0000 7f2964c19700 1 Processor -- start 2023-10-14T18:56:18.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.617+0000 7f2964c19700 1 -- start start 2023-10-14T18:56:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29600b46f0 0x7f296014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f2960150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960156500 con 0x7f2960159ef0 2023-10-14T18:56:18.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960155e90 con 0x7f29600b46f0 2023-10-14T18:56:18.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2964c19700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2960156170 con 0x7f29600b6a10 2023-10-14T18:56:18.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46404/0 (socket says 172.21.15.79:46404) 2023-10-14T18:56:18.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 -- 172.21.15.79:0/1933358579 learned_addr learned my addr 172.21.15.79:0/1933358579 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:18.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f2955d9b700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f2960150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295e59c700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29600b46f0 0x7f296014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 -- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 msgr2=0x7f2960150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f2960150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 -- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29600b46f0 msgr2=0x7f296014de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:18.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29600b46f0 0x7f296014de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:18.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 -- 172.21.15.79:0/1933358579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009420 con 0x7f2960159ef0 2023-10-14T18:56:18.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.618+0000 7f295ed9d700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f295800c910 tx=0x7f29580027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958012630 con 0x7f2960159ef0 2023-10-14T18:56:18.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29580127b0 con 0x7f2960159ef0 2023-10-14T18:56:18.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2960156750 con 0x7f2960159ef0 2023-10-14T18:56:18.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958012b70 con 0x7f2960159ef0 2023-10-14T18:56:18.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296014e380 con 0x7f2960159ef0 2023-10-14T18:56:18.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.619+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960156c70 con 0x7f2960159ef0 2023-10-14T18:56:18.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.620+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f295801b400 con 0x7f2960159ef0 2023-10-14T18:56:18.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.620+0000 7f2956ffd700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 0x7f29400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:18.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.620+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2958084840 con 0x7f2960159ef0 2023-10-14T18:56:18.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.621+0000 7f295e59c700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 0x7f29400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:18.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.621+0000 7f295e59c700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 0x7f29400693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2950000c00 tx=0x7f29500016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:18.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.625+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2960156c70 con 0x7f2960159ef0 2023-10-14T18:56:18.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:18.809+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f2960156c70 con 0x7f2960159ef0 2023-10-14T18:56:19.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.658+0000 7f2956ffd700 1 -- 172.21.15.79:0/1933358579 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v187) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2960156c70 con 0x7f2960159ef0 2023-10-14T18:56:19.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 msgr2=0x7f29400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:19.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 0x7f29400693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2950000c00 tx=0x7f29500016c0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 msgr2=0x7f2960152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f295800c910 tx=0x7f29580027a0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 shutdown_connections 2023-10-14T18:56:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f2940066f30 0x7f29400693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2960159ef0 0x7f2960152f70 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29600b46f0 0x7f296014de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 --2- 172.21.15.79:0/1933358579 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29600b6a10 0x7f2960150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:19.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 >> 172.21.15.79:0/1933358579 conn(0x7f296009a0a0 msgr2=0x7f2960068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:19.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 shutdown_connections 2023-10-14T18:56:19.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:19.660+0000 7f2964c19700 1 -- 172.21.15.79:0/1933358579 wait complete. 2023-10-14T18:56:19.664 INFO:teuthology.orchestra.run.smithi079.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-14T18:56:19.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-14T18:56:19.803 INFO:teuthology.orchestra.run.smithi079.stdout:{"osd_mon_report_interval":"5"} 2023-10-14T18:56:19.804 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-14T18:56:19.804 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-14T18:56:19.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:19.805 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-14T18:56:19.916 INFO:teuthology.orchestra.run.smithi079.stderr:16+0 records in 2023-10-14T18:56:19.917 INFO:teuthology.orchestra.run.smithi079.stderr:16+0 records out 2023-10-14T18:56:19.917 INFO:teuthology.orchestra.run.smithi079.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0909059 s, 185 MB/s 2023-10-14T18:56:19.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:19.919 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-14T18:56:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:17+0 records in 2023-10-14T18:56:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:17+0 records out 2023-10-14T18:56:20.029 INFO:teuthology.orchestra.run.smithi079.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0939 s, 190 MB/s 2023-10-14T18:56:20.030 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-14T18:56:20.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:20.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.145+0000 7f658359e700 1 Processor -- start 2023-10-14T18:56:20.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.145+0000 7f658359e700 1 -- start start 2023-10-14T18:56:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658359e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65840cd6e0 0x7f65840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f658415cbd0 0x7f658415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658359e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840cb7c0 con 0x7f65840cdab0 2023-10-14T18:56:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658359e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658415e850 con 0x7f65840cd6e0 2023-10-14T18:56:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840cd030 con 0x7f658415cbd0 2023-10-14T18:56:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65840cd6e0 0x7f65840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f6579d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65840cdab0 0x7f658415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33542/0 (socket says 172.21.15.79:33542) 2023-10-14T18:56:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f6579d9b700 1 -- 172.21.15.79:0/2215793934 learned_addr learned my addr 172.21.15.79:0/2215793934 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 -- 172.21.15.79:0/2215793934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f658415cbd0 msgr2=0x7f658415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f6582d9d700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f658415cbd0 0x7f658415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f658415cbd0 0x7f658415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f6581d9b700 1 -- 172.21.15.79:0/2215793934 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278007273 0 0) 0x7f65840cb7c0 con 0x7f65840cdab0 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 -- 172.21.15.79:0/2215793934 >> v1:172.21.15.79:6789/0 conn(0x7f65840cdab0 legacy=0x7f658415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 -- 172.21.15.79:0/2215793934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658415e290 con 0x7f65840cd6e0 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.146+0000 7f658259c700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f65840cbc50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f65740098e0 tx=0x7f65740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a484889d60454f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f6581d9b700 1 -- 172.21.15.79:0/2215793934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574009e80 con 0x7f65840cd6e0 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f6581d9b700 1 -- 172.21.15.79:0/2215793934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400b860 con 0x7f65840cd6e0 2023-10-14T18:56:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f6581d9b700 1 -- 172.21.15.79:0/2215793934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400bbe0 con 0x7f65840cd6e0 2023-10-14T18:56:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 -- 172.21.15.79:0/2215793934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 msgr2=0x7f65840cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f65840cbc50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f65740098e0 tx=0x7f65740091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 -- 172.21.15.79:0/2215793934 shutdown_connections 2023-10-14T18:56:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f658415cbd0 0x7f658415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 --2- 172.21.15.79:0/2215793934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f65840cbc50 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 -- 172.21.15.79:0/2215793934 >> 172.21.15.79:0/2215793934 conn(0x7f6584067660 msgr2=0x7f6584067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 -- 172.21.15.79:0/2215793934 shutdown_connections 2023-10-14T18:56:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.147+0000 7f658359e700 1 -- 172.21.15.79:0/2215793934 wait complete. 2023-10-14T18:56:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.148+0000 7f658359e700 1 Processor -- start 2023-10-14T18:56:20.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.148+0000 7f658359e700 1 -- start start 2023-10-14T18:56:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65840cdab0 0x7f65841517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f658415cbd0 0x7f65840c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c9420 con 0x7f65840cd6e0 2023-10-14T18:56:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65840b4200 con 0x7f658415cbd0 2023-10-14T18:56:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658359e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584151d10 con 0x7f65840cdab0 2023-10-14T18:56:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46422/0 (socket says 172.21.15.79:46422) 2023-10-14T18:56:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 -- 172.21.15.79:0/4046370851 learned_addr learned my addr 172.21.15.79:0/4046370851 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f6579d9b700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65840cdab0 0x7f65841517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f6582d9d700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f658415cbd0 0x7f65840c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 -- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65840cdab0 msgr2=0x7f65841517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65840cdab0 0x7f65841517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 -- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f658415cbd0 msgr2=0x7f65840c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.149+0000 7f658259c700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f658415cbd0 0x7f65840c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f658259c700 1 -- 172.21.15.79:0/4046370851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574009420 con 0x7f65840cd6e0 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f658259c700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f65840c7b10 tx=0x7f6574017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400b9d0 con 0x7f65840cd6e0 2023-10-14T18:56:20.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400bb30 con 0x7f65840cd6e0 2023-10-14T18:56:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65840c9140 con 0x7f65840cd6e0 2023-10-14T18:56:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574025670 con 0x7f65840cd6e0 2023-10-14T18:56:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.150+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65840b3e90 con 0x7f65840cd6e0 2023-10-14T18:56:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.151+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65840b3a10 con 0x7f65840cd6e0 2023-10-14T18:56:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.151+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6574023070 con 0x7f65840cd6e0 2023-10-14T18:56:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.151+0000 7f657affd700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 0x7f65640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.152+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6574085b00 con 0x7f65840cd6e0 2023-10-14T18:56:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.152+0000 7f6579d9b700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 0x7f65640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.152+0000 7f6579d9b700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 0x7f65640693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f658406aed0 tx=0x7f656c007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.156+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65840b3a10 con 0x7f65840cd6e0 2023-10-14T18:56:20.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.337+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f65840b3a10 con 0x7f65840cd6e0 2023-10-14T18:56:20.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.338+0000 7f657affd700 1 -- 172.21.15.79:0/4046370851 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f65840b3a10 con 0x7f65840cd6e0 2023-10-14T18:56:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:20.340 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 187, 2023-10-14T18:56:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:19.648675+0000", 2023-10-14T18:56:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "187", 2023-10-14T18:56:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.519 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.521 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.522 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:20.523 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.523 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:20.523 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.524 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.524 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.524 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.524 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.524 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:20.525 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.525 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:20.525 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.526 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.526 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.526 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.526 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.527 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.528 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.528 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.528 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.528 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:20.528 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:20.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.531 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:20.531 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:20.531 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:20.531 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:20.531 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:20.532 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:20.532 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:20.532 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:20.532 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:20.532 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:20.534 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:20.535 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:20.535 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:20.535 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:20.535 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:20.535 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:20.536 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:20.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:20.536 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 msgr2=0x7f65640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 0x7f65640693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f658406aed0 tx=0x7f656c007d10 comp rx=0 tx=0).stop 2023-10-14T18:56:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 msgr2=0x7f6584142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:20.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f65840c7b10 tx=0x7f6574017000 comp rx=0 tx=0).stop 2023-10-14T18:56:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 shutdown_connections 2023-10-14T18:56:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6564066f30 0x7f65640693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f658415cbd0 0x7f65840c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65840cd6e0 0x7f6584142850 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 --2- 172.21.15.79:0/4046370851 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f65840cdab0 0x7f65841517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 >> 172.21.15.79:0/4046370851 conn(0x7f6584067660 msgr2=0x7f65840d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 shutdown_connections 2023-10-14T18:56:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:20.340+0000 7f658359e700 1 -- 172.21.15.79:0/4046370851 wait complete. 2023-10-14T18:56:20.541 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:56:25.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:25.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.669+0000 7fe23a957700 1 Processor -- start 2023-10-14T18:56:25.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.669+0000 7fe23a957700 1 -- start start 2023-10-14T18:56:25.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe23a957700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe234159e10 0x7fe2340b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe23a957700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23415db80 con 0x7fe2340cde50 2023-10-14T18:56:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe23a957700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23415de60 con 0x7fe23415a1e0 2023-10-14T18:56:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe23a957700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23415e800 con 0x7fe234159e10 2023-10-14T18:56:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe238ef4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2340cde50 0x7fe2340cbb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:33558/0 (socket says 172.21.15.79:33558) 2023-10-14T18:56:25.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe238ef4700 1 -- 172.21.15.79:0/1971669127 learned_addr learned my addr 172.21.15.79:0/1971669127 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe233fff700 1 --2- 172.21.15.79:0/1971669127 >> v2:172.21.15.144:3300/0 conn(0x7fe234159e10 0x7fe2340b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393408028 0 0) 0x7fe23415db80 con 0x7fe2340cde50 2023-10-14T18:56:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe220003570 con 0x7fe2340cde50 2023-10-14T18:56:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3488361649 0 0) 0x7fe220003570 con 0x7fe2340cde50 2023-10-14T18:56:25.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 >> v2:172.21.15.144:3300/0 conn(0x7fe234159e10 msgr2=0x7fe2340b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 --2- 172.21.15.79:0/1971669127 >> v2:172.21.15.144:3300/0 conn(0x7fe234159e10 0x7fe2340b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 >> v1:172.21.15.144:6789/0 conn(0x7fe23415a1e0 legacy=0x7fe2340cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23415e140 con 0x7fe2340cde50 2023-10-14T18:56:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.670+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe22c0017f0 con 0x7fe2340cde50 2023-10-14T18:56:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 >> v1:172.21.15.79:6789/0 conn(0x7fe2340cde50 legacy=0x7fe2340cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe220003a60 0x7fe220003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 0x7fe220004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2200051c0 0x7fe22000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23415e800 con 0x7fe220004810 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000c160 con 0x7fe220003a60 2023-10-14T18:56:25.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22000c320 con 0x7fe2200051c0 2023-10-14T18:56:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 0x7fe220004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe233fff700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe220003a60 0x7fe220003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe238ef4700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2200051c0 0x7fe22000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 -- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2200051c0 msgr2=0x7fe22000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:25.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe2200051c0 0x7fe22000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 -- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe220003a60 msgr2=0x7fe220003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe220003a60 0x7fe220003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 -- 172.21.15.79:0/1971669127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220003570 con 0x7fe220004810 2023-10-14T18:56:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe238ef4700 1 -- 172.21.15.79:0/1971669127 reap_dead start 2023-10-14T18:56:25.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe2337fe700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 0x7fe220004c80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001880 tx=0x7fe21c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9334c98c90678aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012420 con 0x7fe220004810 2023-10-14T18:56:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c012580 con 0x7fe220004810 2023-10-14T18:56:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.671+0000 7fe232ffd700 1 -- 172.21.15.79:0/1971669127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012920 con 0x7fe220004810 2023-10-14T18:56:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 -- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 msgr2=0x7fe220004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:25.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 0x7fe220004c80 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001880 tx=0x7fe21c007d30 comp rx=0 tx=0).stop 2023-10-14T18:56:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 -- 172.21.15.79:0/1971669127 shutdown_connections 2023-10-14T18:56:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 --2- 172.21.15.79:0/1971669127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe220004810 0x7fe220004c80 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 -- 172.21.15.79:0/1971669127 >> 172.21.15.79:0/1971669127 conn(0x7fe234067660 msgr2=0x7fe234067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 -- 172.21.15.79:0/1971669127 shutdown_connections 2023-10-14T18:56:25.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.672+0000 7fe23a957700 1 -- 172.21.15.79:0/1971669127 wait complete. 2023-10-14T18:56:25.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.673+0000 7fe23a957700 1 Processor -- start 2023-10-14T18:56:25.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.673+0000 7fe23a957700 1 -- start start 2023-10-14T18:56:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe220004810 0x7fe23416b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2340b5690 0x7fe2340b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340b6040 con 0x7fe2340c6040 2023-10-14T18:56:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23415a5b0 con 0x7fe2340b5690 2023-10-14T18:56:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe23a957700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe234158770 con 0x7fe220004810 2023-10-14T18:56:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46438/0 (socket says 172.21.15.79:46438) 2023-10-14T18:56:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 -- 172.21.15.79:0/3082074888 learned_addr learned my addr 172.21.15.79:0/3082074888 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe233fff700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe220004810 0x7fe23416b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe238ef4700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2340b5690 0x7fe2340b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 -- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe220004810 msgr2=0x7fe23416b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe220004810 0x7fe23416b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 -- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2340b5690 msgr2=0x7fe2340b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:25.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2340b5690 0x7fe2340b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.674+0000 7fe2337fe700 1 -- 172.21.15.79:0/3082074888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2340c6800 con 0x7fe2340c6040 2023-10-14T18:56:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe2337fe700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001e70 tx=0x7fe21c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c012420 con 0x7fe2340c6040 2023-10-14T18:56:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c001200 con 0x7fe2340c6040 2023-10-14T18:56:25.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2340c6ae0 con 0x7fe2340c6040 2023-10-14T18:56:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c0126f0 con 0x7fe2340c6040 2023-10-14T18:56:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.675+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2340c70a0 con 0x7fe2340c6040 2023-10-14T18:56:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.676+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe234067b50 con 0x7fe2340c6040 2023-10-14T18:56:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.676+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe21c019070 con 0x7fe2340c6040 2023-10-14T18:56:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.676+0000 7fe22bfff700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 0x7fe2140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.676+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe21c085aa0 con 0x7fe2340c6040 2023-10-14T18:56:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.677+0000 7fe233fff700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 0x7fe2140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.677+0000 7fe233fff700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 0x7fe2140693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c5890 tx=0x7fe2240091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.681+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe21c052d10 con 0x7fe2340c6040 2023-10-14T18:56:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.863+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe23404c3c0 con 0x7fe2340c6040 2023-10-14T18:56:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.864+0000 7fe22bfff700 1 -- 172.21.15.79:0/3082074888 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fe21c017090 con 0x7fe2340c6040 2023-10-14T18:56:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:25.865 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 187, 2023-10-14T18:56:25.865 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:19.648675+0000", 2023-10-14T18:56:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:25.866 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:25.867 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:25.868 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "187", 2023-10-14T18:56:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:25.960 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:25.961 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:25.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:25.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.969 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:25.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:25.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.974 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:25.979 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:25.981 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:25.982 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:25.983 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:25.984 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:25.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:25.987 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:25.990 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:25.992 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:25.995 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:25.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:25.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:25.998 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:25.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.000 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.003 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:26.004 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:26.006 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:26.007 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:26.008 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:26.011 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:26.013 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:26.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:26.017 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.018 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:26.022 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:26.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:26.024 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:26.025 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:26.026 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.027 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.028 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:26.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:26.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.032 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:26.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:26.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:26.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:26.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:26.037 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.038 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:26.039 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:26.042 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:26.043 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:26.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:26.047 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.049 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:26.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:26.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:26.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:26.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:26.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.055 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:26.056 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:26.058 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.063 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.064 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.066 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.069 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:26.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:26.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:26.073 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:26.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.075 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.076 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.078 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.080 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.082 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.083 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.084 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.085 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.086 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.087 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.089 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:26.091 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:26.092 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:26.093 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:26.094 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:26.099 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:26.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.865+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 msgr2=0x7fe2140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:26.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.865+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 0x7fe2140693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe2340c5890 tx=0x7fe2240091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:26.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.865+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 msgr2=0x7fe234158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:26.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.865+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fe21c001e70 tx=0x7fe21c015000 comp rx=0 tx=0).stop 2023-10-14T18:56:26.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 shutdown_connections 2023-10-14T18:56:26.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe214066f30 0x7fe2140693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:26.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2340b5690 0x7fe2340b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:26.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe220004810 0x7fe23416b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:26.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 --2- 172.21.15.79:0/3082074888 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2340c6040 0x7fe234158230 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:26.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 >> 172.21.15.79:0/3082074888 conn(0x7fe234067660 msgr2=0x7fe234159010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:26.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 shutdown_connections 2023-10-14T18:56:26.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:25.866+0000 7fe23a957700 1 -- 172.21.15.79:0/3082074888 wait complete. 2023-10-14T18:56:26.105 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:56:31.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:31.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.231+0000 7fc9f4abf700 1 Processor -- start 2023-10-14T18:56:31.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.231+0000 7fc9f4abf700 1 -- start start 2023-10-14T18:56:31.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9f4abf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0157d70 0x7fc9f00c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9f4abf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9f0158140 0x7fc9f00b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9f4abf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f00ca070 con 0x7fc9f006ecc0 2023-10-14T18:56:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9f4abf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f0067800 con 0x7fc9f0158140 2023-10-14T18:56:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9f4abf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0067ae0 con 0x7fc9f0157d70 2023-10-14T18:56:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9f0158140 0x7fc9f00b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9f0158140 0x7fc9f00b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49310/0 (socket says 172.21.15.79:49310) 2023-10-14T18:56:31.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 -- 172.21.15.79:0/3911683898 learned_addr learned my addr 172.21.15.79:0/3911683898 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:31.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9ee59c700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0157d70 0x7fc9f00c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 -- 172.21.15.79:0/3911683898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0157d70 msgr2=0x7fc9f00c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:31.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0157d70 0x7fc9f00c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 -- 172.21.15.79:0/3911683898 >> v1:172.21.15.144:6789/0 conn(0x7fc9f006ecc0 legacy=0x7fc9f0070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:31.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.232+0000 7fc9edd9b700 1 -- 172.21.15.79:0/3911683898 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0067dc0 con 0x7fc9f0158140 2023-10-14T18:56:31.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f0158140 0x7fc9f00b0880 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40099b0 tx=0x7fc9e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a1b0fafc4f4d20 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:31.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9ed59a700 1 -- 172.21.15.79:0/3911683898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400b820 con 0x7fc9f0158140 2023-10-14T18:56:31.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9ed59a700 1 -- 172.21.15.79:0/3911683898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400b980 con 0x7fc9f0158140 2023-10-14T18:56:31.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9ed59a700 1 -- 172.21.15.79:0/3911683898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400bd20 con 0x7fc9f0158140 2023-10-14T18:56:31.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 -- 172.21.15.79:0/3911683898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f0158140 msgr2=0x7fc9f00b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:31.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f0158140 0x7fc9f00b0880 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40099b0 tx=0x7fc9e4009250 comp rx=0 tx=0).stop 2023-10-14T18:56:31.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 -- 172.21.15.79:0/3911683898 shutdown_connections 2023-10-14T18:56:31.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0157d70 0x7fc9f00c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/3911683898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f0158140 0x7fc9f00b0880 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.233+0000 7fc9f4abf700 1 -- 172.21.15.79:0/3911683898 >> 172.21.15.79:0/3911683898 conn(0x7fc9f00ca4f0 msgr2=0x7fc9f00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:31.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.234+0000 7fc9f4abf700 1 -- 172.21.15.79:0/3911683898 shutdown_connections 2023-10-14T18:56:31.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.234+0000 7fc9f4abf700 1 -- 172.21.15.79:0/3911683898 wait complete. 2023-10-14T18:56:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 Processor -- start 2023-10-14T18:56:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 -- start start 2023-10-14T18:56:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 0x7fc9f015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0158140 0x7fc9f00cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f016ca20 con 0x7fc9f006ecc0 2023-10-14T18:56:31.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0141110 con 0x7fc9f0157d70 2023-10-14T18:56:31.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9f4abf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f016bda0 con 0x7fc9f0158140 2023-10-14T18:56:31.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.235+0000 7fc9ee59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49318/0 (socket says 172.21.15.79:49318) 2023-10-14T18:56:31.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 -- 172.21.15.79:0/2160689866 learned_addr learned my addr 172.21.15.79:0/2160689866 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9eed9d700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0158140 0x7fc9f00cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 0x7fc9f015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 -- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0158140 msgr2=0x7fc9f00cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0158140 0x7fc9f00cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 -- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 msgr2=0x7fc9f015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:31.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 0x7fc9f015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e40094f0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 0x7fc9f015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:31.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9ee59c700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000d890 tx=0x7fc9e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:31.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00125f0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0012750 con 0x7fc9f006ecc0 2023-10-14T18:56:31.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0012ad0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f016c080 con 0x7fc9f006ecc0 2023-10-14T18:56:31.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.236+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f016c640 con 0x7fc9f006ecc0 2023-10-14T18:56:31.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.237+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f004c3c0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.237+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9e001e460 con 0x7fc9f006ecc0 2023-10-14T18:56:31.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.238+0000 7fc9de7fc700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 0x7fc9d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:31.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.238+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9e0084b50 con 0x7fc9f006ecc0 2023-10-14T18:56:31.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.238+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7fc9d006ea50 con 0x7fc9f006ecc0 2023-10-14T18:56:31.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.238+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 0x7fc9d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:31.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.238+0000 7fc9edd9b700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 0x7fc9d00693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40099b0 tx=0x7fc9e4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:31.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.242+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9e0051dc0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.427+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc9f00c8810 con 0x7fc9f006ecc0 2023-10-14T18:56:31.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.428+0000 7fc9de7fc700 1 -- 172.21.15.79:0/2160689866 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fc9e00553e0 con 0x7fc9f006ecc0 2023-10-14T18:56:31.430 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:31.430 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:31.431 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 188, 2023-10-14T18:56:31.431 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:31.431 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:31.431 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:27.593088+0000", 2023-10-14T18:56:31.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:31.432 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:31.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:31.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:31.434 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:31.434 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:31.434 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:31.434 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:31.434 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:31.435 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:31.435 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:31.435 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:31.435 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:31.435 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:31.436 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:31.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:31.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:31.436 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:31.437 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:31.438 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:31.439 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:31.439 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:31.439 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:31.439 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:31.439 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:31.440 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:31.440 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:31.440 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:31.440 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:31.440 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:31.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.442 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:31.442 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:31.442 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:31.442 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:31.443 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:31.443 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:31.443 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:31.443 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:31.443 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:31.444 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:31.444 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:31.444 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:31.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:31.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:31.445 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:31.445 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:31.445 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:31.445 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:31.445 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:31.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:31.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:31.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:31.446 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:31.447 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:31.447 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:31.447 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:31.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:31.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.448 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:31.448 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:31.448 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:31.449 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:31.449 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:31.449 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:31.449 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:31.449 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:31.450 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:31.450 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:31.450 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:31.450 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:31.450 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:31.451 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:31.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.451 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:31.451 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:31.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.452 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:31.452 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:31.452 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:31.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:31.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:31.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:31.453 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:31.453 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:31.454 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:31.454 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:31.454 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:31.454 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:31.454 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:31.455 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:31.455 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:31.455 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:31.455 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:31.455 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:31.456 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:31.456 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:31.456 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:31.456 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:31.456 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:31.457 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:31.457 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:31.457 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:31.459 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:31.459 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:31.459 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:31.459 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:31.459 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:31.460 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:31.460 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:31.460 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:31.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:31.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:31.461 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:31.461 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:31.461 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:31.461 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:31.462 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:31.462 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:31.462 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:31.462 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:31.462 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:31.463 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:31.463 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:31.463 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:31.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:31.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:56:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:56:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "188", 2023-10-14T18:56:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:31.521 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.521 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.521 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.560 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:31.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:31.562 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:31.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:31.568 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:31.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:31.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.571 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.572 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.573 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.576 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:31.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.579 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:31.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:31.585 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:31.587 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.588 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.589 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:31.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:31.604 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:31.605 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:31.610 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:31.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:31.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:31.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:31.619 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:31.619 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:31.619 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:31.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:31.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.620 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:31.620 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:31.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.620 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:31.620 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.621 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.621 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.621 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.621 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:31.622 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.622 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:31.623 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.623 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.623 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.623 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.623 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.624 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:31.624 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.624 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:31.625 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.625 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.625 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.625 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.626 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.626 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:31.626 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.627 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:31.627 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.627 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.628 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:31.629 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.629 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.629 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.629 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.629 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.630 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:31.630 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.630 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:31.631 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.631 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.631 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.631 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.631 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.632 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:31.633 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.633 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.633 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.633 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.633 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.634 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:31.634 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:31.634 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:31.635 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:31.636 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:31.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.636 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:31.636 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:31.636 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:31.637 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:31.637 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:31.637 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:31.637 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:31.637 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:31.638 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:31.638 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:31.638 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:31.638 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:31.638 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:31.639 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:31.640 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:31.640 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:31.640 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:31.640 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:31.640 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:31.641 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:31.641 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:31.641 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:31.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:31.641 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 msgr2=0x7fc9d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 0x7fc9d00693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40099b0 tx=0x7fc9e4016000 comp rx=0 tx=0).stop 2023-10-14T18:56:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 msgr2=0x7fc9f0140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000d890 tx=0x7fc9e0008040 comp rx=0 tx=0).stop 2023-10-14T18:56:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 shutdown_connections 2023-10-14T18:56:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc9d0066f30 0x7fc9d00693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc9f0158140 0x7fc9f00cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc9f006ecc0 0x7fc9f0140bd0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 --2- 172.21.15.79:0/2160689866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f0157d70 0x7fc9f015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 >> 172.21.15.79:0/2160689866 conn(0x7fc9f00ca4f0 msgr2=0x7fc9f01571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:31.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 shutdown_connections 2023-10-14T18:56:31.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:31.430+0000 7fc9f4abf700 1 -- 172.21.15.79:0/2160689866 wait complete. 2023-10-14T18:56:31.647 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-14T18:56:31.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:31.648 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-14T18:56:31.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:56:31.903 INFO:teuthology.orchestra.run.smithi079.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2023-10-14T18:56:31.904 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:56:31.904 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:56:31.904 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.234381 s, 224 MB/s 2023-10-14T18:56:31.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:32.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.017+0000 7f726bc23700 1 Processor -- start 2023-10-14T18:56:32.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.017+0000 7f726bc23700 1 -- start start 2023-10-14T18:56:32.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726bc23700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7264157870 0x7f726415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726bc23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726bc23700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726415cbb0 con 0x7f726415d580 2023-10-14T18:56:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726bc23700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726415bfa0 con 0x7f7264157870 2023-10-14T18:56:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726bc23700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726415c280 con 0x7f726415a620 2023-10-14T18:56:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72691be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72699bf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7264157870 0x7f726415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726a1c0700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f726415d580 0x7f7264158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:38404/0 (socket says 172.21.15.79:38404) 2023-10-14T18:56:32.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72691be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:36620/0 (socket says 172.21.15.79:36620) 2023-10-14T18:56:32.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f726a1c0700 1 -- 172.21.15.79:0/1754093906 learned_addr learned my addr 172.21.15.79:0/1754093906 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72699bf700 1 -- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 msgr2=0x7f726415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72699bf700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72699bf700 1 -- 172.21.15.79:0/1754093906 >> v1:172.21.15.144:6789/0 conn(0x7f726415d580 legacy=0x7f7264158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72699bf700 1 -- 172.21.15.79:0/1754093906 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726415c560 con 0x7f7264157870 2023-10-14T18:56:32.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72689bd700 1 -- 172.21.15.79:0/1754093906 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713451646 0 0) 0x7f726415cbb0 con 0x7f726415d580 2023-10-14T18:56:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.018+0000 7f72691be700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f72699bf700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7264157870 0x7f726415b6a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f725c009e60 tx=0x7f725c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdbfc91a7d8dc42 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f72689bd700 1 -- 172.21.15.79:0/1754093906 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00e070 con 0x7f7264157870 2023-10-14T18:56:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f72689bd700 1 -- 172.21.15.79:0/1754093906 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00bb60 con 0x7f7264157870 2023-10-14T18:56:32.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f72689bd700 1 -- 172.21.15.79:0/1754093906 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c012430 con 0x7f7264157870 2023-10-14T18:56:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 -- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7264157870 msgr2=0x7f726415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7264157870 0x7f726415b6a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f725c009e60 tx=0x7f725c009780 comp rx=0 tx=0).stop 2023-10-14T18:56:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 -- 172.21.15.79:0/1754093906 shutdown_connections 2023-10-14T18:56:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7264157870 0x7f726415b6a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 --2- 172.21.15.79:0/1754093906 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 -- 172.21.15.79:0/1754093906 >> 172.21.15.79:0/1754093906 conn(0x7f7264068ce0 msgr2=0x7f72640690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 -- 172.21.15.79:0/1754093906 shutdown_connections 2023-10-14T18:56:32.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.019+0000 7f726bc23700 1 -- 172.21.15.79:0/1754093906 wait complete. 2023-10-14T18:56:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.020+0000 7f726bc23700 1 Processor -- start 2023-10-14T18:56:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 -- start start 2023-10-14T18:56:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726415d580 0x7f726415e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726416e980 con 0x7f7264157870 2023-10-14T18:56:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72640b1a90 con 0x7f726415d580 2023-10-14T18:56:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f726bc23700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72640c6ba0 con 0x7f726415a620 2023-10-14T18:56:32.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f72699bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f72699bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49332/0 (socket says 172.21.15.79:49332) 2023-10-14T18:56:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.021+0000 7f72699bf700 1 -- 172.21.15.79:0/960829517 learned_addr learned my addr 172.21.15.79:0/960829517 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72691be700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f726a1c0700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726415d580 0x7f726415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 -- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 msgr2=0x7f726415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 -- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726415d580 msgr2=0x7f726415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726415d580 0x7f726415e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254009420 con 0x7f7264157870 2023-10-14T18:56:32.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72691be700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f72699bf700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f726406b530 tx=0x7f725c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c012e20 con 0x7f7264157870 2023-10-14T18:56:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c027470 con 0x7f7264157870 2023-10-14T18:56:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c009a20 con 0x7f7264157870 2023-10-14T18:56:32.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c027830 con 0x7f7264157870 2023-10-14T18:56:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.022+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72640c68c0 con 0x7f7264157870 2023-10-14T18:56:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.023+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726404c3c0 con 0x7f7264157870 2023-10-14T18:56:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.023+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f725c024070 con 0x7f7264157870 2023-10-14T18:56:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.024+0000 7f7259ffb700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 0x7f72480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.024+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f725c086f20 con 0x7f7264157870 2023-10-14T18:56:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.024+0000 7f72691be700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 0x7f72480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.024+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f724806ea50 con 0x7f7264157870 2023-10-14T18:56:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.025+0000 7f72691be700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 0x7f72480693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f72640c7e00 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.028+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f725c054190 con 0x7f7264157870 2023-10-14T18:56:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.211+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f726415c840 con 0x7f7264157870 2023-10-14T18:56:32.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.212+0000 7f7259ffb700 1 -- 172.21.15.79:0/960829517 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f725c0577b0 con 0x7f7264157870 2023-10-14T18:56:32.213 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:32.213 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:32.214 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 188, 2023-10-14T18:56:32.214 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:32.214 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:32.214 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:27.593088+0000", 2023-10-14T18:56:32.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:32.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:32.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:32.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:32.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:32.216 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:32.216 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:32.216 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:32.216 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:32.217 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:32.217 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:32.217 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:32.217 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:32.217 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:32.218 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:32.218 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:32.218 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:32.218 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:32.218 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:32.219 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:32.219 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:32.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.219 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:32.219 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:32.220 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:32.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:32.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:32.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:32.221 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:32.221 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:32.221 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:32.221 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:32.222 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:32.222 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:32.222 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:32.222 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:32.222 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:32.223 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:32.223 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:32.223 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:32.223 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:32.223 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:32.224 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:32.224 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:32.224 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:32.224 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:32.225 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:32.225 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:32.225 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:32.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.225 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:32.226 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:32.226 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:32.226 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:32.226 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:32.226 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:32.227 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:32.227 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:32.227 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:32.227 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:32.228 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:32.228 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:32.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:32.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:32.228 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:32.229 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:32.230 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:32.230 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:32.230 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:32.230 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:32.230 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:32.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:32.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.231 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:32.231 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:32.231 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:32.232 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:32.232 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:32.232 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:32.232 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:32.232 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:32.233 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:32.233 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:32.233 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:32.233 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:32.233 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.235 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:32.235 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:32.235 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:32.235 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:32.236 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:32.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:32.236 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:32.236 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:32.236 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:32.237 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:32.237 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:32.237 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:32.237 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:32.237 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:32.238 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:32.239 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:32.239 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:32.239 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:32.239 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:32.239 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:32.240 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:32.240 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:32.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.240 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:32.240 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:32.241 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:32.241 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:32.241 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:32.241 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:32.241 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:32.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:32.243 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:32.243 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:32.243 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:32.243 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:32.243 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:32.244 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:32.244 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:32.244 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:32.244 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:32.244 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.245 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:32.246 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:32.246 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:32.246 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:32.246 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:32.246 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:32.247 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.248 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.250 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:32.250 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:32.250 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:32.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:56:32.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:56:32.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:32.251 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:32.251 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:32.251 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:32.252 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:32.253 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:32.253 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:32.253 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:32.253 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:32.253 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:32.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:32.254 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:32.254 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:32.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:32.254 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "188", 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:32.255 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:32.256 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:32.256 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:32.256 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:32.256 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:32.256 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:32.257 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:32.257 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:32.257 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:32.257 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:32.258 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:32.258 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:32.258 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:32.258 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:32.258 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:32.259 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:32.260 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:32.260 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:32.260 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:32.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:32.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.261 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:32.261 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:32.261 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:32.261 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:32.261 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:32.262 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:32.262 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:32.262 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:32.262 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:32.262 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:32.263 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:32.263 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:32.263 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:32.263 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:32.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.265 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:32.265 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:32.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.265 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:32.265 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.266 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.266 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.266 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.266 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.266 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.267 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.268 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.268 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:32.268 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.269 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:32.269 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.270 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.270 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.272 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.274 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:32.274 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.275 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.276 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.276 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:32.276 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.277 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:32.277 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:32.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.278 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.278 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:32.278 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.279 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.280 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:32.280 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.280 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.281 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.282 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.288 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:32.289 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.290 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:32.293 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.295 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.296 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.300 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.301 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.302 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:32.308 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.310 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.311 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.312 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.313 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.313 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.317 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:32.317 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:32.318 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.318 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.319 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.319 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:32.321 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.321 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.322 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:32.322 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.323 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:32.323 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:32.324 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:32.325 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:32.325 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.325 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.325 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.326 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:32.326 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.326 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.327 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.328 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.328 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.328 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.328 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.328 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.329 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:32.329 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:32.332 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.333 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:32.333 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:32.334 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.336 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:32.337 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.339 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:32.339 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:32.339 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:32.339 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:32.340 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.340 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.340 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.340 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.341 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.342 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.342 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.342 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.342 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.342 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.343 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.343 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.343 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.345 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:32.345 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.346 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:32.347 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.347 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:32.348 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.348 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.350 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:32.350 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.353 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:32.353 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:32.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.354 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:32.354 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:32.354 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:32.354 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:32.354 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.355 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.355 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.356 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:32.356 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.356 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.356 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.356 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.357 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.358 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.358 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:32.359 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.361 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:32.362 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.362 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:32.363 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.363 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:32.364 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.366 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.367 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:32.367 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.368 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:32.368 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:32.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.369 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:32.369 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:32.369 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:32.369 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:32.371 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:32.372 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:32.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:32.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:32.372 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:32.372 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.374 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:32.374 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:32.375 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:32.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:32.377 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:32.378 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.379 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:32.379 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.381 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:32.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:32.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:32.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:32.382 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:32.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:32.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:32.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:32.384 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:32.385 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:32.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:32.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.385 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:32.385 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:32.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.386 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:32.386 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.386 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.386 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.388 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:32.388 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.388 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.388 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.388 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.389 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.389 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:32.389 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.390 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.391 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:32.391 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.391 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:32.392 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.392 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.392 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.392 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.392 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.393 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:32.395 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:32.395 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.396 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.396 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.396 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.396 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.396 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.398 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.398 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.398 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.398 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.398 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:32.399 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:32.400 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:32.400 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:32.400 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:32.400 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:32.400 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:32.401 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:32.402 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:32.403 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:32.403 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:32.403 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:32.403 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:32.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:32.404 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:32.404 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:32.404 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:32.404 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:32.405 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:32.406 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:32.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:32.406 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:32.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 msgr2=0x7f72480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 0x7f72480693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f72640c7e00 tx=0x7f7254008040 comp rx=0 tx=0).stop 2023-10-14T18:56:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 msgr2=0x7f726416e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f726406b530 tx=0x7f725c019000 comp rx=0 tx=0).stop 2023-10-14T18:56:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 shutdown_connections 2023-10-14T18:56:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7248066f30 0x7f72480693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f726415d580 0x7f726415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7264157870 0x7f726416e440 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 --2- 172.21.15.79:0/960829517 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f726415a620 0x7f726415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 >> 172.21.15.79:0/960829517 conn(0x7f7264068ce0 msgr2=0x7f7264155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 shutdown_connections 2023-10-14T18:56:32.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.214+0000 7f726bc23700 1 -- 172.21.15.79:0/960829517 wait complete. 2023-10-14T18:56:32.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:32.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.526+0000 7fd47cbfc700 1 Processor -- start 2023-10-14T18:56:32.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.526+0000 7fd47cbfc700 1 -- start start 2023-10-14T18:56:32.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd47cbfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd478164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd47cbfc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47815c360 con 0x7fd478157ba0 2023-10-14T18:56:32.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd47cbfc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47815b790 con 0x7fd4781577d0 2023-10-14T18:56:32.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd47cbfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815d800 con 0x7fd47806ac30 2023-10-14T18:56:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd46dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd478157ba0 0x7fd47806a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:34492/0 (socket says 172.21.15.79:34492) 2023-10-14T18:56:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd46dd9b700 1 -- 172.21.15.79:0/3793903926 learned_addr learned my addr 172.21.15.79:0/3793903926 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd476d9d700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd478164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.527+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775396142 0 0) 0x7fd47815c360 con 0x7fd478157ba0 2023-10-14T18:56:32.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd464003570 con 0x7fd478157ba0 2023-10-14T18:56:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167788612 0 0) 0x7fd464003570 con 0x7fd478157ba0 2023-10-14T18:56:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 msgr2=0x7fd478164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd478164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 >> v1:172.21.15.144:6789/0 conn(0x7fd4781577d0 legacy=0x7fd4780cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47815ba30 con 0x7fd478157ba0 2023-10-14T18:56:32.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fd460001470 con 0x7fd478157ba0 2023-10-14T18:56:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 >> v1:172.21.15.79:6789/0 conn(0x7fd478157ba0 legacy=0x7fd47806a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd464003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd464003fd0 0x7fd464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd464004d50 0x7fd4640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815d800 con 0x7fd464003fd0 2023-10-14T18:56:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46400bb40 con 0x7fd464004d50 2023-10-14T18:56:32.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46400bd00 con 0x7fd47806ac30 2023-10-14T18:56:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd464003fd0 0x7fd464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd47659c700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd464003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 -- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 msgr2=0x7fd464003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd47806ac30 0x7fd464003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 -- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd464004d50 msgr2=0x7fd4640051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T18:56:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd464004d50 0x7fd4640051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 -- 172.21.15.79:0/3793903926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464003570 con 0x7fd464003fd0 2023-10-14T18:56:32.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.528+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd464003fd0 0x7fd464004810 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c3c0 tx=0x7fd460001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1005b9198f9536e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000cc90 con 0x7fd464003fd0 2023-10-14T18:56:32.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46000cdf0 con 0x7fd464003fd0 2023-10-14T18:56:32.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd475d9b700 1 -- 172.21.15.79:0/3793903926 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460005b70 con 0x7fd464003fd0 2023-10-14T18:56:32.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 -- 172.21.15.79:0/3793903926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd464003fd0 msgr2=0x7fd464004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/3793903926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd464003fd0 0x7fd464004810 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c3c0 tx=0x7fd460001e70 comp rx=0 tx=0).stop 2023-10-14T18:56:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd476d9d700 1 -- 172.21.15.79:0/3793903926 reap_dead start 2023-10-14T18:56:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 -- 172.21.15.79:0/3793903926 shutdown_connections 2023-10-14T18:56:32.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 -- 172.21.15.79:0/3793903926 >> 172.21.15.79:0/3793903926 conn(0x7fd478068ce0 msgr2=0x7fd4780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 -- 172.21.15.79:0/3793903926 shutdown_connections 2023-10-14T18:56:32.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.529+0000 7fd47cbfc700 1 -- 172.21.15.79:0/3793903926 wait complete. 2023-10-14T18:56:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.530+0000 7fd47cbfc700 1 Processor -- start 2023-10-14T18:56:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.530+0000 7fd47cbfc700 1 -- start start 2023-10-14T18:56:32.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 0x7fd4780cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 0x7fd47816abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47816b0f0 con 0x7fd47813e700 2023-10-14T18:56:32.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780b05c0 con 0x7fd47814dc90 2023-10-14T18:56:32.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47cbfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4780b0dd0 con 0x7fd464003fd0 2023-10-14T18:56:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd476d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd476d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49350/0 (socket says 172.21.15.79:49350) 2023-10-14T18:56:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd476d9d700 1 -- 172.21.15.79:0/2725148242 learned_addr learned my addr 172.21.15.79:0/2725148242 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd47659c700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 0x7fd4780cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.531+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 0x7fd47816abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 -- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 msgr2=0x7fd4780cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 0x7fd4780cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 -- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 msgr2=0x7fd47816abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 0x7fd47816abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780b0810 con 0x7fd47813e700 2023-10-14T18:56:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd47659c700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 0x7fd4780cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd46dd9b700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 0x7fd47816abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd476d9d700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd478071de0 tx=0x7fd47000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470009bb0 con 0x7fd47813e700 2023-10-14T18:56:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47000f040 con 0x7fd47813e700 2023-10-14T18:56:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4780b0af0 con 0x7fd47813e700 2023-10-14T18:56:32.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47000ccf0 con 0x7fd47813e700 2023-10-14T18:56:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.532+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd478158f50 con 0x7fd47813e700 2023-10-14T18:56:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.533+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd478159170 con 0x7fd47813e700 2023-10-14T18:56:32.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.533+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd470014690 con 0x7fd47813e700 2023-10-14T18:56:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.534+0000 7fd46effd700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.534+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd470084f40 con 0x7fd47813e700 2023-10-14T18:56:32.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.534+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7fd45806ea50 con 0x7fd47813e700 2023-10-14T18:56:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.534+0000 7fd47659c700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.535+0000 7fd47659c700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c00 tx=0x7fd468009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:32.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.538+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd470052110 con 0x7fd47813e700 2023-10-14T18:56:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.761+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd47804c3c0 con 0x7fd47813e700 2023-10-14T18:56:32.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.762+0000 7fd46effd700 1 -- 172.21.15.79:0/2725148242 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fd470018030 con 0x7fd47813e700 2023-10-14T18:56:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:32.764 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 msgr2=0x7fd4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c00 tx=0x7fd468009040 comp rx=0 tx=0).stop 2023-10-14T18:56:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 msgr2=0x7fd4780b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:32.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fd478071de0 tx=0x7fd47000b040 comp rx=0 tx=0).stop 2023-10-14T18:56:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 shutdown_connections 2023-10-14T18:56:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd47813e700 0x7fd4780b1430 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd464003fd0 0x7fd4780cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 --2- 172.21.15.79:0/2725148242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd47814dc90 0x7fd47816abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:32.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 >> 172.21.15.79:0/2725148242 conn(0x7fd478068ce0 msgr2=0x7fd47814fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:32.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 shutdown_connections 2023-10-14T18:56:32.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:32.764+0000 7fd47cbfc700 1 -- 172.21.15.79:0/2725148242 wait complete. 2023-10-14T18:56:32.768 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:32.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-14T18:56:32.922 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":27.300565677000002,"mdsmap_epoch":88,"osdmap_epoch":188,"osdmap_epoch_barrier":188,"uptime":32.869441109999997} 2023-10-14T18:56:32.923 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 88, "osdmap_epoch": 188, "osdmap_epoch_barrier": 188, "rank_uptime": 27.300565677, "state": "up:active", "uptime": 32.86944111, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:56:32.923 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:56:32.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:32.924 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-14T18:56:32.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:32.942 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-14T18:56:33.007 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.163+0000 7fba3016a700 1 Processor -- start 2023-10-14T18:56:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.163+0000 7fba3016a700 1 -- start start 2023-10-14T18:56:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba3016a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba28157870 0x7fba2815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba3016a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba2815a620 0x7fba2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba3016a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2815cbb0 con 0x7fba2815d580 2023-10-14T18:56:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba3016a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2815bfa0 con 0x7fba28157870 2023-10-14T18:56:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba3016a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2815c280 con 0x7fba2815a620 2023-10-14T18:56:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba28157870 0x7fba2815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fba28157870 0x7fba2815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49364/0 (socket says 172.21.15.79:49364) 2023-10-14T18:56:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 -- 172.21.15.79:0/226728996 learned_addr learned my addr 172.21.15.79:0/226728996 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 -- 172.21.15.79:0/226728996 >> v2:172.21.15.144:3300/0 conn(0x7fba2815a620 msgr2=0x7fba2815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2d705700 1 --2- 172.21.15.79:0/226728996 >> v2:172.21.15.144:3300/0 conn(0x7fba2815a620 0x7fba2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 --2- 172.21.15.79:0/226728996 >> v2:172.21.15.144:3300/0 conn(0x7fba2815a620 0x7fba2815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 -- 172.21.15.79:0/226728996 >> v1:172.21.15.144:6789/0 conn(0x7fba2815d580 legacy=0x7fba28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 -- 172.21.15.79:0/226728996 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2815c560 con 0x7fba28157870 2023-10-14T18:56:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2df06700 1 --2- 172.21.15.79:0/226728996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba28157870 0x7fba2815b6a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fba2815cb20 tx=0x7fba24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742ed1968aca586c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.164+0000 7fba2cf04700 1 -- 172.21.15.79:0/226728996 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400b820 con 0x7fba28157870 2023-10-14T18:56:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba2cf04700 1 -- 172.21.15.79:0/226728996 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400b980 con 0x7fba28157870 2023-10-14T18:56:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba2cf04700 1 -- 172.21.15.79:0/226728996 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400bd20 con 0x7fba28157870 2023-10-14T18:56:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 -- 172.21.15.79:0/226728996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba28157870 msgr2=0x7fba2815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 --2- 172.21.15.79:0/226728996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba28157870 0x7fba2815b6a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fba2815cb20 tx=0x7fba24009250 comp rx=0 tx=0).stop 2023-10-14T18:56:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 -- 172.21.15.79:0/226728996 shutdown_connections 2023-10-14T18:56:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 --2- 172.21.15.79:0/226728996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba28157870 0x7fba2815b6a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 --2- 172.21.15.79:0/226728996 >> v2:172.21.15.144:3300/0 conn(0x7fba2815a620 0x7fba2815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 -- 172.21.15.79:0/226728996 >> 172.21.15.79:0/226728996 conn(0x7fba28068ce0 msgr2=0x7fba280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 -- 172.21.15.79:0/226728996 shutdown_connections 2023-10-14T18:56:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.165+0000 7fba3016a700 1 -- 172.21.15.79:0/226728996 wait complete. 2023-10-14T18:56:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.166+0000 7fba3016a700 1 Processor -- start 2023-10-14T18:56:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.166+0000 7fba3016a700 1 -- start start 2023-10-14T18:56:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba28157870 0x7fba280cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba2815d580 0x7fba2814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2816de10 con 0x7fba2815a620 2023-10-14T18:56:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28149d80 con 0x7fba2815d580 2023-10-14T18:56:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba3016a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2816e060 con 0x7fba28157870 2023-10-14T18:56:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49378/0 (socket says 172.21.15.79:49378) 2023-10-14T18:56:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 -- 172.21.15.79:0/586453097 learned_addr learned my addr 172.21.15.79:0/586453097 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:33.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2df06700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba28157870 0x7fba280cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2e707700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba2815d580 0x7fba2814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 -- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba28157870 msgr2=0x7fba280cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba28157870 0x7fba280cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 -- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba2815d580 msgr2=0x7fba2814b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba2815d580 0x7fba2814b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.167+0000 7fba2d705700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240094f0 con 0x7fba2815a620 2023-10-14T18:56:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba2d705700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c850 tx=0x7fba18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18011660 con 0x7fba2815a620 2023-10-14T18:56:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba180117c0 con 0x7fba2815a620 2023-10-14T18:56:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2816e340 con 0x7fba2815a620 2023-10-14T18:56:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18011b80 con 0x7fba2815a620 2023-10-14T18:56:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.168+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2816e900 con 0x7fba2815a620 2023-10-14T18:56:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.169+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2804c3c0 con 0x7fba2815a620 2023-10-14T18:56:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.169+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba180193f0 con 0x7fba2815a620 2023-10-14T18:56:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.170+0000 7fba1dffb700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 0x7fba0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:33.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.170+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba18084930 con 0x7fba2815a620 2023-10-14T18:56:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.170+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7fba0c06ea50 con 0x7fba2815a620 2023-10-14T18:56:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.170+0000 7fba2df06700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 0x7fba0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:33.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.170+0000 7fba2df06700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 0x7fba0c0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba2815cb20 tx=0x7fba24016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:33.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.174+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba18051b00 con 0x7fba2815a620 2023-10-14T18:56:33.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.356+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fba2816a810 con 0x7fba2815a620 2023-10-14T18:56:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.357+0000 7fba1dffb700 1 -- 172.21.15.79:0/586453097 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fba18055120 con 0x7fba2815a620 2023-10-14T18:56:33.359 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:33.359 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:33.359 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 188, 2023-10-14T18:56:33.360 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:33.360 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:33.360 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:27.593088+0000", 2023-10-14T18:56:33.360 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:33.361 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:33.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:33.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:33.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:33.361 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:33.362 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:33.362 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:33.362 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:33.362 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:33.362 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:33.363 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:33.363 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:33.363 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:33.363 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:33.363 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:33.364 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:33.364 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:33.364 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:33.364 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:33.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:33.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:33.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:33.367 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:33.367 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:33.367 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:33.367 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:33.368 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:33.368 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:33.368 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:33.368 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:33.369 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:33.369 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:33.369 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:33.369 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:33.369 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:33.370 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:33.370 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:33.370 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:33.371 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:33.371 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:33.371 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:33.371 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:33.371 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:33.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:33.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:33.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:33.372 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:33.373 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:33.373 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:33.373 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:33.373 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:33.374 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:33.374 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:33.374 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:33.374 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:33.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:33.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:33.375 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:33.376 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:33.376 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:33.376 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:33.376 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:33.377 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:33.377 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:33.377 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:33.377 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:33.378 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:33.378 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:33.378 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:33.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:33.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.379 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:33.379 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:33.379 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:33.379 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:33.379 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:33.380 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.382 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:33.382 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:33.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.383 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:33.387 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:33.388 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:33.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:33.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:33.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:33.389 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:33.389 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:33.389 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:33.390 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:33.390 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:33.390 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:33.390 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:33.391 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:33.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:33.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:33.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:33.392 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:33.392 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:33.392 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:33.392 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:33.393 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:33.393 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:33.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:33.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:33.394 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:33.394 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:33.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.395 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:33.395 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:33.396 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:33.396 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:33.396 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:33.396 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:33.397 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:33.397 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:33.398 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:33.398 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:33.398 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:33.399 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:33.399 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:33.399 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:33.399 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:33.400 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:33.400 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:33.400 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:33.400 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:33.400 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:33.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:33.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:33.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:33.401 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:33.401 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:33.403 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:33.403 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:33.403 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:33.403 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:33.404 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:33.404 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:33.404 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:33.404 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:33.404 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:33.405 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:33.405 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:33.405 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:33.405 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:33.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.406 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:33.406 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:33.406 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:33.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.407 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:33.407 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:33.407 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:33.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:56:33.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:56:33.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:33.409 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:33.409 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:33.409 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:33.410 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:33.410 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:33.410 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:33.410 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:33.410 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:33.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:33.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:33.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:33.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:33.411 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:33.412 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:33.412 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:33.412 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:33.412 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:33.412 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:33.413 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:33.413 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:33.413 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:33.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.413 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "188", 2023-10-14T18:56:33.414 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:33.414 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:33.414 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:33.414 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:33.414 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:33.415 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:33.415 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:33.415 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:33.415 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:33.415 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:33.416 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:33.417 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:33.417 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:33.417 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:33.417 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:33.417 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:33.418 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:33.418 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:33.418 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:33.419 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:33.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:33.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.420 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:33.420 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:33.420 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:33.422 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:33.422 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:33.422 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:33.422 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:33.422 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:33.423 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:33.423 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:33.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.423 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:33.424 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:33.424 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:33.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.425 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:33.425 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:33.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.426 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:33.426 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.426 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.426 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.427 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.427 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.427 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.427 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.428 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.428 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.429 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:33.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:33.431 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.432 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.433 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:33.433 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:33.435 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.436 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:33.437 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:33.439 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.439 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:33.441 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:33.442 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:33.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.442 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:33.443 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:33.443 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:33.443 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:33.443 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.443 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:33.444 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.445 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.446 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.447 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:33.448 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.450 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.450 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.451 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:33.452 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.452 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.453 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.453 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:33.454 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.455 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:33.455 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.456 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.456 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.457 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:33.457 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.458 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:33.458 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:33.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.459 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:33.460 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:33.460 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:33.460 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:33.460 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.461 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.461 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.462 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:33.462 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.462 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.463 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.463 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.463 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.464 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.464 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.464 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.464 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.465 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.465 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.465 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.465 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.466 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:33.466 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.467 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.467 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:33.467 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.468 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.468 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.469 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:33.469 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.470 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:33.470 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.473 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:33.473 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.474 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.474 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:33.475 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.476 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:33.477 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:33.477 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:33.477 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:33.477 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.477 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.478 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.478 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:33.479 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.479 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.479 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.479 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.479 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.480 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.480 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.480 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.480 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.480 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.481 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.481 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.481 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.483 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:33.483 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.483 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.484 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.484 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.484 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:33.485 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.485 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:33.486 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.487 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.487 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.488 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:33.488 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.489 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.489 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:33.489 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.490 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.491 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.491 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:33.491 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.492 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:33.492 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:33.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.493 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:33.493 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:33.494 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:33.494 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:33.494 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.494 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.495 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.496 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:33.496 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.496 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.497 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.497 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.497 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.497 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.498 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.499 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:33.500 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.501 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.503 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:33.504 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.505 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:33.511 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.514 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.515 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.516 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:33.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.521 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.523 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.524 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:33.531 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.533 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.534 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:33.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:33.540 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:33.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:33.543 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:33.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.549 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.550 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.551 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:33.552 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:33.553 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:33.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.556 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:33.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.561 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.562 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:33.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:33.568 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:33.569 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:33.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.571 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.572 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.573 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:33.595 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:33.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 msgr2=0x7fba0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:33.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 0x7fba0c0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba2815cb20 tx=0x7fba24016000 comp rx=0 tx=0).stop 2023-10-14T18:56:33.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 msgr2=0x7fba28149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:33.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c850 tx=0x7fba18008040 comp rx=0 tx=0).stop 2023-10-14T18:56:33.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 shutdown_connections 2023-10-14T18:56:33.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fba0c066f30 0x7fba0c0693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba2815d580 0x7fba2814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba28157870 0x7fba280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 --2- 172.21.15.79:0/586453097 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fba2815a620 0x7fba28149190 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 >> 172.21.15.79:0/586453097 conn(0x7fba28068ce0 msgr2=0x7fba2814c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 shutdown_connections 2023-10-14T18:56:33.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:33.359+0000 7fba3016a700 1 -- 172.21.15.79:0/586453097 wait complete. 2023-10-14T18:56:33.600 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:56:38.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:38.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.730+0000 7f123b2ca700 1 Processor -- start 2023-10-14T18:56:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.730+0000 7f123b2ca700 1 -- start start 2023-10-14T18:56:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f123b2ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 0x7f123406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f123b2ca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1234070700 0x7f1234070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f123b2ca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1234071080 con 0x7f12341510f0 2023-10-14T18:56:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f123b2ca700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340ca0b0 con 0x7f1234070700 2023-10-14T18:56:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f123b2ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234068a10 con 0x7f12340c9af0 2023-10-14T18:56:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1234070700 0x7f1234070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1234070700 0x7f1234070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54326/0 (socket says 172.21.15.79:54326) 2023-10-14T18:56:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 -- 172.21.15.79:0/1493028080 learned_addr learned my addr 172.21.15.79:0/1493028080 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1238865700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 0x7f123406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 -- 172.21.15.79:0/1493028080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 msgr2=0x7f123406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 0x7f123406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 -- 172.21.15.79:0/1493028080 >> v1:172.21.15.144:6789/0 conn(0x7f12341510f0 legacy=0x7f123415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:38.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 -- 172.21.15.79:0/1493028080 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234068cf0 con 0x7f1234070700 2023-10-14T18:56:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1238865700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 0x7f123406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f1239867700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234070700 0x7f1234070b40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f122c009f20 tx=0x7f122c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a4c39f3dbdf011 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f122bfff700 1 -- 172.21.15.79:0/1493028080 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00e070 con 0x7f1234070700 2023-10-14T18:56:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.731+0000 7f122bfff700 1 -- 172.21.15.79:0/1493028080 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00ba80 con 0x7f1234070700 2023-10-14T18:56:38.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f122bfff700 1 -- 172.21.15.79:0/1493028080 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0092e0 con 0x7f1234070700 2023-10-14T18:56:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 -- 172.21.15.79:0/1493028080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234070700 msgr2=0x7f1234070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234070700 0x7f1234070b40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f122c009f20 tx=0x7f122c009840 comp rx=0 tx=0).stop 2023-10-14T18:56:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 -- 172.21.15.79:0/1493028080 shutdown_connections 2023-10-14T18:56:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1234070700 0x7f1234070b40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1493028080 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f12340c9af0 0x7f123406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 -- 172.21.15.79:0/1493028080 >> 172.21.15.79:0/1493028080 conn(0x7f12340ca4f0 msgr2=0x7f12340ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 -- 172.21.15.79:0/1493028080 shutdown_connections 2023-10-14T18:56:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.732+0000 7f123b2ca700 1 -- 172.21.15.79:0/1493028080 wait complete. 2023-10-14T18:56:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.733+0000 7f123b2ca700 1 Processor -- start 2023-10-14T18:56:38.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.733+0000 7f123b2ca700 1 -- start start 2023-10-14T18:56:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1234070700 0x7f123415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 0x7f12340cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123415cd60 con 0x7f12341510f0 2023-10-14T18:56:38.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234154df0 con 0x7f12340c9af0 2023-10-14T18:56:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f123b2ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234155000 con 0x7f1234070700 2023-10-14T18:56:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54336/0 (socket says 172.21.15.79:54336) 2023-10-14T18:56:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 -- 172.21.15.79:0/1838583880 learned_addr learned my addr 172.21.15.79:0/1838583880 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:38.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1238865700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 0x7f12340cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239066700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1234070700 0x7f123415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 -- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1234070700 msgr2=0x7f123415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1234070700 0x7f123415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 -- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 msgr2=0x7f12340cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 0x7f12340cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1239867700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c009ae0 con 0x7f12341510f0 2023-10-14T18:56:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.734+0000 7f1238865700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 0x7f12340cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f1239867700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b6c0 tx=0x7f122c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0032f0 con 0x7f12341510f0 2023-10-14T18:56:38.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c026460 con 0x7f12341510f0 2023-10-14T18:56:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12341552e0 con 0x7f12341510f0 2023-10-14T18:56:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c026800 con 0x7f12341510f0 2023-10-14T18:56:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.735+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12341558a0 con 0x7f12341510f0 2023-10-14T18:56:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.736+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404c3c0 con 0x7f12341510f0 2023-10-14T18:56:38.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.736+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f122c003040 con 0x7f12341510f0 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.737+0000 7f12297fa700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.737+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f122c0864c0 con 0x7f12341510f0 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.737+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f121806ea50 con 0x7f12341510f0 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.737+0000 7f1239066700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.737+0000 7f1239066700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 0x7f12180693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f12300016c0 tx=0x7f1230009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:38.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.741+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f122c053730 con 0x7f12341510f0 2023-10-14T18:56:38.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.923+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f123406b620 con 0x7f12341510f0 2023-10-14T18:56:38.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.924+0000 7f12297fa700 1 -- 172.21.15.79:0/1838583880 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f122c021090 con 0x7f12341510f0 2023-10-14T18:56:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:38.926 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 188, 2023-10-14T18:56:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:38.926 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:27.593088+0000", 2023-10-14T18:56:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:38.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:38.928 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:38.929 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:38.930 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.931 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:38.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:38.933 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:38.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:38.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:38.936 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:38.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:38.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:38.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:38.940 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:38.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:38.943 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:38.944 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:38.945 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:38.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:38.948 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:38.949 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:38.950 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:38.951 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:38.952 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:38.953 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:38.954 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:38.955 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:38.956 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:38.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:38.958 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:38.959 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:38.960 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:38.961 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.962 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1027, 2023-10-14T18:56:38.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-14T18:56:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:38.964 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:38.965 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:38.966 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:38.967 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:38.968 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "188", 2023-10-14T18:56:38.969 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:38.970 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:38.971 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:38.972 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:38.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:38.974 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:38.975 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:38.976 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:38.977 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:38.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:38.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:38.980 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:38.981 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:38.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:38.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:38.994 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:38.996 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:38.997 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:38.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:38.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.007 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.008 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.009 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.010 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.011 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.012 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.013 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.014 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.015 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.016 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:39.017 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:39.018 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.021 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:39.021 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.022 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.022 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.023 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:39.023 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.024 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:39.025 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:39.025 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:39.025 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:39.025 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.027 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.028 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.028 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.028 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.028 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.029 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.029 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.029 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.030 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:39.030 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.031 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:39.031 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.032 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.032 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.033 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:39.033 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.034 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:39.034 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:39.035 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.036 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:39.036 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.037 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.037 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.039 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:39.039 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:39.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.040 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:39.040 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:39.040 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.042 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:39.042 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.042 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.042 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.043 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.043 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.043 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.044 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.044 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.044 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.044 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.044 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.045 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:39.045 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.047 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.047 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.047 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.048 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:39.048 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.049 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:39.049 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:39.050 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.051 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:39.051 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.052 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.052 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.053 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:39.053 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:39.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.055 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:39.055 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:39.055 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.057 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:39.057 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.057 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.058 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.058 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.058 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.058 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.058 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.059 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.059 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.059 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.059 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.059 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:39.060 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.061 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.062 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:39.063 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:39.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.066 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:39.067 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:39.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:39.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.071 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:39.071 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:39.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.072 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:39.072 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:39.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:39.072 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:39.072 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.073 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.073 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.074 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:39.074 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.074 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.074 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.075 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.076 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.076 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.079 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:39.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:39.082 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:39.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.084 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:39.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:39.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:39.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:39.087 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.088 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.088 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.089 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:39.089 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:39.089 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:39.089 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:39.089 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:39.090 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:39.090 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:39.090 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:39.090 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:39.090 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:39.091 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:39.091 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:39.091 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:39.091 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:39.092 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.094 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:39.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:39.095 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:39.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:39.098 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.099 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:39.099 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:39.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:39.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:39.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:39.102 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:39.103 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:39.103 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:39.103 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:39.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:39.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.104 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.106 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:39.106 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.106 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.107 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.107 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.107 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.107 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:39.107 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.108 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:39.108 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.108 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.110 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:39.110 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.110 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.110 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.111 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.111 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.111 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:39.111 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.112 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:39.112 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.112 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.112 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.114 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:39.114 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.114 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.114 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.114 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.116 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:39.116 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.116 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.116 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.116 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.117 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.117 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:39.117 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:39.119 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:39.119 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:39.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.119 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:39.119 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:39.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:39.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:39.120 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:39.120 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:39.120 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:39.121 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:39.121 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:39.121 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:39.121 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:39.121 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:39.122 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:39.122 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:39.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:39.122 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:39.123 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:39.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:39.125 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 msgr2=0x7f12180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:39.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 0x7f12180693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f12300016c0 tx=0x7f1230009040 comp rx=0 tx=0).stop 2023-10-14T18:56:39.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 msgr2=0x7f12340af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:39.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b6c0 tx=0x7f122c018000 comp rx=0 tx=0).stop 2023-10-14T18:56:39.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 shutdown_connections 2023-10-14T18:56:39.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:39.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12341510f0 0x7f12340af9c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:39.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1234070700 0x7f123415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:39.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 --2- 172.21.15.79:0/1838583880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12340c9af0 0x7f12340cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:39.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.926+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 >> 172.21.15.79:0/1838583880 conn(0x7f12340ca4f0 msgr2=0x7f12340cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:39.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.927+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 shutdown_connections 2023-10-14T18:56:39.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:38.927+0000 7f123b2ca700 1 -- 172.21.15.79:0/1838583880 wait complete. 2023-10-14T18:56:39.129 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-14T18:56:40.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:40.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:44.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.258+0000 7f53ba208700 1 Processor -- start 2023-10-14T18:56:44.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.258+0000 7f53ba208700 1 -- start start 2023-10-14T18:56:44.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53ba208700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53ba208700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53b4157c40 0x7f53b4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53ba208700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b415cbb0 con 0x7f53b415a620 2023-10-14T18:56:44.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53ba208700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b415bfa0 con 0x7f53b4157c40 2023-10-14T18:56:44.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53ba208700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b415c280 con 0x7f53b4157870 2023-10-14T18:56:44.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53b4157c40 0x7f53b4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f53b4157c40 0x7f53b4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54338/0 (socket says 172.21.15.79:54338) 2023-10-14T18:56:44.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 -- 172.21.15.79:0/1554717087 learned_addr learned my addr 172.21.15.79:0/1554717087 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:44.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b37fe700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 -- 172.21.15.79:0/1554717087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 msgr2=0x7f53b415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:44.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 -- 172.21.15.79:0/1554717087 >> v1:172.21.15.144:6789/0 conn(0x7f53b415a620 legacy=0x7f53b415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 -- 172.21.15.79:0/1554717087 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b415c560 con 0x7f53b4157c40 2023-10-14T18:56:44.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.259+0000 7f53b3fff700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b4158110 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0099b0 tx=0x7f53ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad01feae08030bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53b27fc700 1 -- 172.21.15.79:0/1554717087 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac009ea0 con 0x7f53b4157c40 2023-10-14T18:56:44.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53b27fc700 1 -- 172.21.15.79:0/1554717087 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00b860 con 0x7f53b4157c40 2023-10-14T18:56:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53b27fc700 1 -- 172.21.15.79:0/1554717087 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00bc00 con 0x7f53b4157c40 2023-10-14T18:56:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 -- 172.21.15.79:0/1554717087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 msgr2=0x7f53b4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b4158110 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0099b0 tx=0x7f53ac009250 comp rx=0 tx=0).stop 2023-10-14T18:56:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 -- 172.21.15.79:0/1554717087 shutdown_connections 2023-10-14T18:56:44.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b4158110 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 --2- 172.21.15.79:0/1554717087 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 -- 172.21.15.79:0/1554717087 >> 172.21.15.79:0/1554717087 conn(0x7f53b4068ce0 msgr2=0x7f53b40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:44.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 -- 172.21.15.79:0/1554717087 shutdown_connections 2023-10-14T18:56:44.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.260+0000 7f53ba208700 1 -- 172.21.15.79:0/1554717087 wait complete. 2023-10-14T18:56:44.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.261+0000 7f53ba208700 1 Processor -- start 2023-10-14T18:56:44.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.261+0000 7f53ba208700 1 -- start start 2023-10-14T18:56:44.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b41605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 0x7f53b416a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b415dcf0 con 0x7f53b4157c40 2023-10-14T18:56:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b415d3c0 con 0x7f53b415a620 2023-10-14T18:56:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53ba208700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b415d6a0 con 0x7f53b4157870 2023-10-14T18:56:44.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53b2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53b2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54340/0 (socket says 172.21.15.79:54340) 2023-10-14T18:56:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53b2ffd700 1 -- 172.21.15.79:0/237680639 learned_addr learned my addr 172.21.15.79:0/237680639 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53b37fe700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b41605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.262+0000 7f53b3fff700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 0x7f53b416a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 -- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 msgr2=0x7f53b41605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b41605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 -- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 msgr2=0x7f53b416a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 0x7f53b416a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 -- 172.21.15.79:0/237680639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0094f0 con 0x7f53b4157c40 2023-10-14T18:56:44.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b3fff700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 0x7f53b416a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:44.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53b2ffd700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c4e0 tx=0x7f53a800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8011590 con 0x7f53b4157c40 2023-10-14T18:56:44.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8011710 con 0x7f53b4157c40 2023-10-14T18:56:44.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b415d980 con 0x7f53b4157c40 2023-10-14T18:56:44.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8011ad0 con 0x7f53b4157c40 2023-10-14T18:56:44.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.263+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b413fca0 con 0x7f53b4157c40 2023-10-14T18:56:44.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.264+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b404c3c0 con 0x7f53b4157c40 2023-10-14T18:56:44.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.264+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53a801b3b0 con 0x7f53b4157c40 2023-10-14T18:56:44.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.265+0000 7f539b7fe700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 0x7f53a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.265+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53a8083a00 con 0x7f53b4157c40 2023-10-14T18:56:44.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.265+0000 7f53b37fe700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 0x7f53a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.266+0000 7f53b37fe700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 0x7f53a00693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f53a400f570 tx=0x7f53a400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.269+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53a8050bd0 con 0x7f53b4157c40 2023-10-14T18:56:44.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.452+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f53b415c840 con 0x7f53b4157c40 2023-10-14T18:56:44.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.453+0000 7f539b7fe700 1 -- 172.21.15.79:0/237680639 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f53a8017070 con 0x7f53b4157c40 2023-10-14T18:56:44.455 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:44.455 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:44.455 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 189, 2023-10-14T18:56:44.455 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:44.456 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:44.456 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:42.596000+0000", 2023-10-14T18:56:44.457 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:44.457 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:44.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:44.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:44.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:44.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:44.458 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:44.459 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:44.459 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:44.459 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:44.460 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:44.460 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:44.460 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:44.460 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:44.461 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:44.461 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:44.461 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:44.461 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:44.461 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:44.462 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:44.462 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:44.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.462 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:44.463 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:44.463 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:44.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:44.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:44.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:44.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:44.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:44.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:44.466 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:44.466 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:44.467 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:44.467 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:44.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:44.467 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:44.467 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:44.468 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:44.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.468 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:44.468 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:44.468 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:44.469 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:44.469 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:44.469 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:44.469 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:44.469 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:44.470 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:44.470 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:44.470 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:44.470 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:44.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:44.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:44.471 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:44.471 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:44.471 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:44.471 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:44.472 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:44.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:44.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:44.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:44.472 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:44.473 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:44.473 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:44.473 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:44.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:44.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.474 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:44.474 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:44.474 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:44.474 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:44.475 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:44.475 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:44.475 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:44.475 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:44.475 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:44.476 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:44.476 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:44.476 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:44.476 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:44.476 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:44.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.477 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:44.477 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:44.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.478 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:44.478 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:44.478 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:44.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:44.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:44.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:44.480 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:44.480 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:44.480 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:44.480 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:44.481 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:44.481 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:44.481 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:44.481 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:44.482 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:44.482 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:44.482 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:44.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:44.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:44.483 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:44.483 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:44.484 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:44.484 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:44.484 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:44.484 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:44.485 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:44.485 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:44.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.485 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:44.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:44.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:44.486 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:44.486 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:44.486 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:44.487 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:44.487 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:44.487 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:44.487 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:44.488 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:44.488 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:44.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:44.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:44.488 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:44.489 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:44.489 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:44.489 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:44.489 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:44.489 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:44.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:44.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:44.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:44.490 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:44.491 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:44.491 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:44.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:44.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.491 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:44.492 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:44.492 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:44.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:44.492 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:44.493 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:44.493 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:44.493 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:44.493 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:44.493 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:44.494 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:44.494 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:44.494 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:44.494 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:44.495 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:44.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.495 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:44.495 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:44.495 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:44.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.497 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:44.497 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:44.497 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:44.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:44.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:44.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:44.498 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:44.499 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:44.499 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:44.499 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:44.499 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:44.500 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:44.500 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:44.500 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:44.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:44.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:44.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:44.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:44.501 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:44.502 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:44.502 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:44.502 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:44.502 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:44.502 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:44.503 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:44.503 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:44.503 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:44.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "189", 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:44.504 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:44.505 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:44.505 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:44.505 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:44.505 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:44.505 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:44.506 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:44.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:44.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:44.506 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:44.507 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:44.507 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:44.507 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:44.507 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:44.507 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:44.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:44.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:44.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:44.508 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:44.509 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:44.510 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:44.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:44.510 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:44.510 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:44.511 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:44.511 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:44.511 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:44.511 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:44.512 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:44.512 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:44.512 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:44.512 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:44.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.513 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:44.513 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:44.513 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:44.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.514 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:44.514 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:44.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.515 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:44.515 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.515 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.515 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.515 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.516 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.516 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.516 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.516 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.516 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.517 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.517 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.517 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.517 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.519 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:44.519 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.520 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.521 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:44.521 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.522 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:44.523 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.523 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.524 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.524 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:44.524 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.525 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:44.525 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.526 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.526 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.527 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:44.527 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.528 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:44.528 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:44.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.529 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:44.529 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:44.530 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:44.530 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:44.530 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.530 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.531 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.531 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.531 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:44.532 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.532 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.532 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.532 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.532 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.533 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.533 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.533 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.534 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.534 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.534 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.535 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:44.535 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.536 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:44.536 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.537 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.537 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.539 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:44.539 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.540 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.540 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.541 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:44.541 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.542 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:44.542 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.543 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.543 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:44.544 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:44.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:44.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.546 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:44.546 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:44.546 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:44.547 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:44.547 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.547 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.547 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.548 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:44.548 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.548 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.549 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.549 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.549 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.549 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.549 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.550 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.550 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.550 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.550 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.550 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:44.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:44.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.554 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:44.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.556 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:44.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:44.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:44.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:44.562 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:44.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.563 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:44.563 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:44.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:44.563 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:44.564 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.564 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.564 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.565 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:44.565 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.566 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.566 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.566 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.566 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.567 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:44.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.577 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.580 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:44.581 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.583 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.584 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.585 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.602 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.603 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.605 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.606 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:44.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.616 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:44.620 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.622 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.623 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:44.629 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.633 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:44.635 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:44.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.637 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.638 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.639 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:44.640 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:44.641 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.642 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:44.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:44.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:44.654 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:44.655 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:44.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.657 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:44.658 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.659 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.660 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.660 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.660 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.660 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:44.660 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.661 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:44.661 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.662 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.662 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.662 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.662 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.662 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:44.663 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.663 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:44.664 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.664 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.664 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.664 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.664 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.665 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:44.667 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.668 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.668 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.668 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.668 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.668 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:44.669 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.669 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:44.669 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.670 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.670 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.670 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.670 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.670 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:44.671 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:44.671 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:44.671 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:44.672 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:44.672 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:44.672 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:44.672 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:44.672 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:44.673 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:44.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.673 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:44.673 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:44.673 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:44.674 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:44.674 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:44.674 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:44.674 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:44.675 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:44.675 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:44.675 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:44.675 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:44.679 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:44.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 msgr2=0x7f53a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 0x7f53a00693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f53a400f570 tx=0x7f53a400b040 comp rx=0 tx=0).stop 2023-10-14T18:56:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 msgr2=0x7f53b413f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c4e0 tx=0x7f53a800c7f0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 shutdown_connections 2023-10-14T18:56:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f53a0066f30 0x7f53a00693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53b415a620 0x7f53b416a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f53b4157870 0x7f53b41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 --2- 172.21.15.79:0/237680639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53b4157c40 0x7f53b413f760 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 >> 172.21.15.79:0/237680639 conn(0x7f53b4068ce0 msgr2=0x7f53b40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 shutdown_connections 2023-10-14T18:56:44.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.455+0000 7f53ba208700 1 -- 172.21.15.79:0/237680639 wait complete. 2023-10-14T18:56:44.685 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-14T18:56:44.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-14T18:56:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.801+0000 7f9d85fd7700 1 Processor -- start 2023-10-14T18:56:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.801+0000 7f9d85fd7700 1 -- start start 2023-10-14T18:56:44.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d85fd7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d8015a620 0x7f9d8015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d85fd7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d8015d580 0x7f9d80158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d85fd7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8015cbb0 con 0x7f9d80157870 2023-10-14T18:56:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d85fd7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8015bdb0 con 0x7f9d8015d580 2023-10-14T18:56:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d85fd7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8015bfa0 con 0x7f9d8015a620 2023-10-14T18:56:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d8015d580 0x7f9d80158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d8015d580 0x7f9d80158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54344/0 (socket says 172.21.15.79:54344) 2023-10-14T18:56:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 -- 172.21.15.79:0/1569679487 learned_addr learned my addr 172.21.15.79:0/1569679487 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:44.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 -- 172.21.15.79:0/1569679487 >> v2:172.21.15.144:3300/0 conn(0x7f9d8015a620 msgr2=0x7f9d8015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:44.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 --2- 172.21.15.79:0/1569679487 >> v2:172.21.15.144:3300/0 conn(0x7f9d8015a620 0x7f9d8015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 -- 172.21.15.79:0/1569679487 >> v1:172.21.15.144:6789/0 conn(0x7f9d80157870 legacy=0x7f9d8015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:44.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 -- 172.21.15.79:0/1569679487 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8015c280 con 0x7f9d8015d580 2023-10-14T18:56:44.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7ffff700 1 --2- 172.21.15.79:0/1569679487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d8015d580 0x7f9d80158110 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9d8015cb20 tx=0x7f9d78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3376b928a111f74b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.802+0000 7f9d7e7fc700 1 -- 172.21.15.79:0/1569679487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800b820 con 0x7f9d8015d580 2023-10-14T18:56:44.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d7e7fc700 1 -- 172.21.15.79:0/1569679487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800b980 con 0x7f9d8015d580 2023-10-14T18:56:44.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d7e7fc700 1 -- 172.21.15.79:0/1569679487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800bd20 con 0x7f9d8015d580 2023-10-14T18:56:44.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 -- 172.21.15.79:0/1569679487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d8015d580 msgr2=0x7f9d80158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/1569679487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d8015d580 0x7f9d80158110 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9d8015cb20 tx=0x7f9d78009250 comp rx=0 tx=0).stop 2023-10-14T18:56:44.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 -- 172.21.15.79:0/1569679487 shutdown_connections 2023-10-14T18:56:44.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/1569679487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d8015d580 0x7f9d80158110 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/1569679487 >> v2:172.21.15.144:3300/0 conn(0x7f9d8015a620 0x7f9d8015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 -- 172.21.15.79:0/1569679487 >> 172.21.15.79:0/1569679487 conn(0x7f9d80068ce0 msgr2=0x7f9d800690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:44.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 -- 172.21.15.79:0/1569679487 shutdown_connections 2023-10-14T18:56:44.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.803+0000 7f9d85fd7700 1 -- 172.21.15.79:0/1569679487 wait complete. 2023-10-14T18:56:44.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.804+0000 7f9d85fd7700 1 Processor -- start 2023-10-14T18:56:44.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.804+0000 7f9d85fd7700 1 -- start start 2023-10-14T18:56:44.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d8015a620 0x7f9d801592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d8015d580 0x7f9d80159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8014bae0 con 0x7f9d80157870 2023-10-14T18:56:44.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8016db60 con 0x7f9d8015a620 2023-10-14T18:56:44.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d85fd7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8016de20 con 0x7f9d8015d580 2023-10-14T18:56:44.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54358/0 (socket says 172.21.15.79:54358) 2023-10-14T18:56:44.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 -- 172.21.15.79:0/490339698 learned_addr learned my addr 172.21.15.79:0/490339698 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:44.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 -- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d8015d580 msgr2=0x7f9d80159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d8015d580 0x7f9d80159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 -- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d8015a620 msgr2=0x7f9d801592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:44.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d8015a620 0x7f9d801592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.805+0000 7f9d7f7fe700 1 -- 172.21.15.79:0/490339698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780094f0 con 0x7f9d80157870 2023-10-14T18:56:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d7f7fe700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000bbb0 tx=0x7f9d70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700092e0 con 0x7f9d80157870 2023-10-14T18:56:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7000c7a0 con 0x7f9d80157870 2023-10-14T18:56:44.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8016e100 con 0x7f9d80157870 2023-10-14T18:56:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000cb40 con 0x7f9d80157870 2023-10-14T18:56:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.806+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8016e6c0 con 0x7f9d80157870 2023-10-14T18:56:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.807+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8004c3c0 con 0x7f9d80157870 2023-10-14T18:56:44.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.807+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d70012070 con 0x7f9d80157870 2023-10-14T18:56:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.807+0000 7f9d677fe700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 0x7f9d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:44.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.807+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d700842a0 con 0x7f9d80157870 2023-10-14T18:56:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.808+0000 7f9d7effd700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 0x7f9d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.808+0000 7f9d7effd700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 0x7f9d6c0693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d74006fd0 tx=0x7f9d74006db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:44.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.812+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d70051510 con 0x7f9d80157870 2023-10-14T18:56:44.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.994+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9d8015c560 con 0x7f9d80157870 2023-10-14T18:56:44.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.995+0000 7f9d677fe700 1 -- 172.21.15.79:0/490339698 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f9d70054b30 con 0x7f9d80157870 2023-10-14T18:56:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 189, 2023-10-14T18:56:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", 2023-10-14T18:56:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2023-10-14T18:44:52.716828+0000", 2023-10-14T18:56:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2023-10-14T18:56:42.596000+0000", 2023-10-14T18:56:44.997 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2023-10-14T18:44:58.111082+0000", 2023-10-14T18:56:44.998 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2023-10-14T18:44:55.095083+0000", 2023-10-14T18:56:44.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-14T18:56:44.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2023-10-14T18:56:44.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2023-10-14T18:56:44.999 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2023-10-14T18:56:44.999 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2023-10-14T18:56:44.999 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2023-10-14T18:56:44.999 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2023-10-14T18:56:44.999 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:45.000 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2023-10-14T18:56:45.000 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.69999998807907104, 2023-10-14T18:56:45.000 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-14T18:56:45.000 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-14T18:56:45.000 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2023-10-14T18:56:45.001 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 23, 2023-10-14T18:56:45.001 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2023-10-14T18:56:45.001 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2023-10-14T18:56:45.001 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2023-10-14T18:56:45.001 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "quincy", 2023-10-14T18:56:45.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2023-10-14T18:56:45.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2023-10-14T18:56:45.002 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2023-10-14T18:56:45.002 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:44:58.374271+0000", 2023-10-14T18:56:45.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:45.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:45.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:45.003 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:45.004 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:45.005 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:45.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:45.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2023-10-14T18:56:45.005 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2023-10-14T18:56:45.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2023-10-14T18:56:45.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2023-10-14T18:56:45.006 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2023-10-14T18:56:45.006 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:45.006 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:45.007 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:45.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:45.007 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:45.007 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:45.007 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:45.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "111", 2023-10-14T18:56:45.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:45.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:45.008 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:45.009 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:45.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:45.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:45.009 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:45.009 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:45.010 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:45.010 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:45.010 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:45.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:45.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:45.011 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:45.011 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:45.011 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:45.011 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:45.011 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:45.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:45.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:45.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:45.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:45.012 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:45.013 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:45.013 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:45.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:45.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.013 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:45.014 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:45.014 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:45.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:45.014 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:45.014 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:45.015 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:45.015 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:45.015 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:45.015 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:45.015 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:45.016 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:45.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2023-10-14T18:56:45.016 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2023-10-14T18:56:45.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.016 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:45.017 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2023-10-14T18:56:45.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.017 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 22, 2023-10-14T18:56:45.018 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_metadata", 2023-10-14T18:56:45.018 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:02.900407+0000", 2023-10-14T18:56:45.018 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:45.018 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:45.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:45.019 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:45.019 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:45.019 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:45.019 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:45.020 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:45.020 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:45.020 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:45.020 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:45.020 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:45.021 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2023-10-14T18:56:45.021 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2023-10-14T18:56:45.021 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2023-10-14T18:56:45.021 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2023-10-14T18:56:45.021 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2023-10-14T18:56:45.022 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:45.022 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:45.022 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:45.022 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:45.023 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:45.023 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:45.023 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:45.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.024 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "185", 2023-10-14T18:56:45.024 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:45.024 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:45.024 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:45.024 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:45.025 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:45.025 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:45.025 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:45.026 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:45.027 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:45.027 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2023-10-14T18:56:45.027 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:45.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:45.028 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:45.028 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:45.028 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:45.028 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:45.028 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:45.029 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:45.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:45.031 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:45.032 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:45.032 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:45.032 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:45.032 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:45.032 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:45.033 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:45.033 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:45.034 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:45.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_bias": 4, 2023-10-14T18:56:45.034 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 16, 2023-10-14T18:56:45.034 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_priority": 5 2023-10-14T18:56:45.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.035 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:45.035 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:45.035 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": "cephfs" 2023-10-14T18:56:45.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.036 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 23, 2023-10-14T18:56:45.036 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "cephfs_data", 2023-10-14T18:56:45.037 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2023-10-14T18:56:03.944358+0000", 2023-10-14T18:56:45.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2023-10-14T18:56:45.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2023-10-14T18:56:45.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2023-10-14T18:56:45.038 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2023-10-14T18:56:45.038 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2023-10-14T18:56:45.038 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2023-10-14T18:56:45.038 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2023-10-14T18:56:45.039 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2023-10-14T18:56:45.039 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2023-10-14T18:56:45.039 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-14T18:56:45.039 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2023-10-14T18:56:45.039 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2023-10-14T18:56:45.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 64, 2023-10-14T18:56:45.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 64, 2023-10-14T18:56:45.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 64, 2023-10-14T18:56:45.040 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 64, 2023-10-14T18:56:45.041 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 64, 2023-10-14T18:56:45.041 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2023-10-14T18:56:45.041 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2023-10-14T18:56:45.042 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2023-10-14T18:56:45.042 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2023-10-14T18:56:45.042 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2023-10-14T18:56:45.042 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2023-10-14T18:56:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2023-10-14T18:56:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "189", 2023-10-14T18:56:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2023-10-14T18:56:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-14T18:56:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2023-10-14T18:56:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2023-10-14T18:56:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2023-10-14T18:56:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2023-10-14T18:56:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2023-10-14T18:56:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2023-10-14T18:56:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2023-10-14T18:56:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 33554432, 2023-10-14T18:56:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2023-10-14T18:56:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2023-10-14T18:56:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2023-10-14T18:56:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2023-10-14T18:56:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2023-10-14T18:56:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2023-10-14T18:56:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2023-10-14T18:56:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2023-10-14T18:56:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-14T18:56:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-14T18:56:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-14T18:56:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2023-10-14T18:56:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2023-10-14T18:56:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2023-10-14T18:56:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2023-10-14T18:56:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2023-10-14T18:56:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2023-10-14T18:56:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2023-10-14T18:56:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2023-10-14T18:56:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2023-10-14T18:56:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2023-10-14T18:56:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2023-10-14T18:56:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2023-10-14T18:56:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2023-10-14T18:56:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2023-10-14T18:56:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2023-10-14T18:56:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2023-10-14T18:56:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2023-10-14T18:56:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 64, 2023-10-14T18:56:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "target_size_ratio": 0.89999997615814209 2023-10-14T18:56:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2023-10-14T18:56:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs": { 2023-10-14T18:56:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "data": "cephfs" 2023-10-14T18:56:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2023-10-14T18:56:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2023-10-14T18:56:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2023-10-14T18:56:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2023-10-14T18:56:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2023-10-14T18:56:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2023-10-14T18:56:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2023-10-14T18:56:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2023-10-14T18:56:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2023-10-14T18:56:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86336 2023-10-14T18:56:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/86336", 2023-10-14T18:56:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/86336", 2023-10-14T18:56:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/86336", 2023-10-14T18:56:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/86336", 2023-10-14T18:56:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2023-10-14T18:56:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2023-10-14T18:56:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2023-10-14T18:56:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2023-10-14T18:56:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2023-10-14T18:56:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2023-10-14T18:56:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2023-10-14T18:56:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86335 2023-10-14T18:56:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6823/86335", 2023-10-14T18:56:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/86335", 2023-10-14T18:56:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/86335", 2023-10-14T18:56:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/86335", 2023-10-14T18:56:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2023-10-14T18:56:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2023-10-14T18:56:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2023-10-14T18:56:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2023-10-14T18:56:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2023-10-14T18:56:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2023-10-14T18:56:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2023-10-14T18:56:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86333 2023-10-14T18:56:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/86333", 2023-10-14T18:56:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/86333", 2023-10-14T18:56:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/86333", 2023-10-14T18:56:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/86333", 2023-10-14T18:56:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2023-10-14T18:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2023-10-14T18:56:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2023-10-14T18:56:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2023-10-14T18:56:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2023-10-14T18:56:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2023-10-14T18:56:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2023-10-14T18:56:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86334 2023-10-14T18:56:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/86334", 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/86334", 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6826/86334", 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/86334", 2023-10-14T18:56:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6804", 2023-10-14T18:56:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6805", 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6808", 2023-10-14T18:56:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6810", 2023-10-14T18:56:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6814", 2023-10-14T18:56:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6815", 2023-10-14T18:56:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6812", 2023-10-14T18:56:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6813", 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86566 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6805/86566", 2023-10-14T18:56:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6810/86566", 2023-10-14T18:56:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6815/86566", 2023-10-14T18:56:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6813/86566", 2023-10-14T18:56:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6800", 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6801", 2023-10-14T18:56:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6802", 2023-10-14T18:56:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6803", 2023-10-14T18:56:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6809", 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6811", 2023-10-14T18:56:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.146 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6806", 2023-10-14T18:56:45.147 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6807", 2023-10-14T18:56:45.148 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86565 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6801/86565", 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6803/86565", 2023-10-14T18:56:45.149 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6811/86565", 2023-10-14T18:56:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6807/86565", 2023-10-14T18:56:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.151 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.152 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.153 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6824", 2023-10-14T18:56:45.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6825", 2023-10-14T18:56:45.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6826", 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6827", 2023-10-14T18:56:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.158 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6830", 2023-10-14T18:56:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6831", 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6828", 2023-10-14T18:56:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6829", 2023-10-14T18:56:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86602 2023-10-14T18:56:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.164 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6825/86602", 2023-10-14T18:56:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6827/86602", 2023-10-14T18:56:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6831/86602", 2023-10-14T18:56:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6829/86602", 2023-10-14T18:56:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.165 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.166 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-14T18:56:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2023-10-14T18:56:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2023-10-14T18:56:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2023-10-14T18:56:45.167 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2023-10-14T18:56:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2023-10-14T18:56:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2023-10-14T18:56:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2023-10-14T18:56:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 184, 2023-10-14T18:56:45.168 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2023-10-14T18:56:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2023-10-14T18:56:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2023-10-14T18:56:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6816", 2023-10-14T18:56:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6817", 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2023-10-14T18:56:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6818", 2023-10-14T18:56:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6819", 2023-10-14T18:56:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2023-10-14T18:56:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6822", 2023-10-14T18:56:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6823", 2023-10-14T18:56:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2023-10-14T18:56:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2023-10-14T18:56:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2023-10-14T18:56:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6820", 2023-10-14T18:56:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-14T18:56:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.144:6821", 2023-10-14T18:56:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 86567 2023-10-14T18:56:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.144:6817/86567", 2023-10-14T18:56:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.144:6819/86567", 2023-10-14T18:56:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.144:6823/86567", 2023-10-14T18:56:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.144:6821/86567", 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2023-10-14T18:56:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2023-10-14T18:56:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.201734+0000", 2023-10-14T18:56:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2023-10-14T18:56:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.223949+0000", 2023-10-14T18:56:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2023-10-14T18:56:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.203481+0000", 2023-10-14T18:56:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.255672+0000", 2023-10-14T18:56:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2023-10-14T18:56:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.219385+0000", 2023-10-14T18:56:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2023-10-14T18:56:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.235023+0000", 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2023-10-14T18:56:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.265703+0000", 2023-10-14T18:56:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-14T18:56:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2023-10-14T18:56:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2023-10-14T18:56:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2023-10-14T18:56:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2023-10-14T18:56:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138320759226367, 2023-10-14T18:56:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2023-10-14T18:56:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2023-10-14T18:44:56.227825+0000", 2023-10-14T18:56:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2023-10-14T18:56:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2023-10-14T18:56:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2023-10-14T18:56:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2023-10-14T18:56:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2023-10-14T18:56:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2023-10-14T18:56:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2023-10-14T18:56:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2023-10-14T18:56:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2023-10-14T18:56:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2023-10-14T18:56:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2023-10-14T18:56:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2023-10-14T18:56:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2023-10-14T18:56:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2023-10-14T18:56:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2023-10-14T18:56:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-14T18:56:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2023-10-14T18:56:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2023-10-14T18:56:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2023-10-14T18:56:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2023-10-14T18:56:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2023-10-14T18:56:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2023-10-14T18:56:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2023-10-14T18:56:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2023-10-14T18:56:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2023-10-14T18:56:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2023-10-14T18:56:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2023-10-14T18:56:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-14T18:56:45.203 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 msgr2=0x7f9d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 0x7f9d6c0693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9d74006fd0 tx=0x7f9d74006db0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 msgr2=0x7f9d8014b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000bbb0 tx=0x7f9d70009840 comp rx=0 tx=0).stop 2023-10-14T18:56:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 shutdown_connections 2023-10-14T18:56:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f9d6c066f30 0x7f9d6c0693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d8015d580 0x7f9d80159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d80157870 0x7f9d8014b5a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 --2- 172.21.15.79:0/490339698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d8015a620 0x7f9d801592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 >> 172.21.15.79:0/490339698 conn(0x7f9d80068ce0 msgr2=0x7f9d80155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 shutdown_connections 2023-10-14T18:56:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:44.997+0000 7f9d85fd7700 1 -- 172.21.15.79:0/490339698 wait complete. 2023-10-14T18:56:45.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:45.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.322+0000 7f0b5784b700 1 Processor -- start 2023-10-14T18:56:45.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.322+0000 7f0b5784b700 1 -- start start 2023-10-14T18:56:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b5784b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b50157870 0x7f0b5015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b5784b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b50157c40 0x7f0b50158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b5784b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5015cbb0 con 0x7f0b5015a620 2023-10-14T18:56:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b50157870 0x7f0b5015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b5784b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015bfa0 con 0x7f0b50157870 2023-10-14T18:56:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b5784b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5015c280 con 0x7f0b50157c40 2023-10-14T18:56:45.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b50157870 0x7f0b5015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54360/0 (socket says 172.21.15.79:54360) 2023-10-14T18:56:45.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 -- 172.21.15.79:0/2711426032 learned_addr learned my addr 172.21.15.79:0/2711426032 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:45.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b55de8700 1 --2- 172.21.15.79:0/2711426032 >> v2:172.21.15.144:3300/0 conn(0x7f0b50157c40 0x7f0b50158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 -- 172.21.15.79:0/2711426032 >> v2:172.21.15.144:3300/0 conn(0x7f0b50157c40 msgr2=0x7f0b50158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:45.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 --2- 172.21.15.79:0/2711426032 >> v2:172.21.15.144:3300/0 conn(0x7f0b50157c40 0x7f0b50158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 -- 172.21.15.79:0/2711426032 >> v1:172.21.15.144:6789/0 conn(0x7f0b5015a620 legacy=0x7f0b5015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 -- 172.21.15.79:0/2711426032 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5015c560 con 0x7f0b50157870 2023-10-14T18:56:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b555e7700 1 --2- 172.21.15.79:0/2711426032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157870 0x7f0b5015b6a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006b4e0 tx=0x7f0b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b596ccc8a876c80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:45.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b47fff700 1 -- 172.21.15.79:0/2711426032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800b860 con 0x7f0b50157870 2023-10-14T18:56:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b47fff700 1 -- 172.21.15.79:0/2711426032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4800b9c0 con 0x7f0b50157870 2023-10-14T18:56:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.323+0000 7f0b47fff700 1 -- 172.21.15.79:0/2711426032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800bd60 con 0x7f0b50157870 2023-10-14T18:56:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 -- 172.21.15.79:0/2711426032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157870 msgr2=0x7f0b5015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 --2- 172.21.15.79:0/2711426032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157870 0x7f0b5015b6a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006b4e0 tx=0x7f0b48009250 comp rx=0 tx=0).stop 2023-10-14T18:56:45.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 -- 172.21.15.79:0/2711426032 shutdown_connections 2023-10-14T18:56:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 --2- 172.21.15.79:0/2711426032 >> v2:172.21.15.144:3300/0 conn(0x7f0b50157c40 0x7f0b50158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 --2- 172.21.15.79:0/2711426032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157870 0x7f0b5015b6a0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 -- 172.21.15.79:0/2711426032 >> 172.21.15.79:0/2711426032 conn(0x7f0b50068ce0 msgr2=0x7f0b500690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 -- 172.21.15.79:0/2711426032 shutdown_connections 2023-10-14T18:56:45.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.324+0000 7f0b5784b700 1 -- 172.21.15.79:0/2711426032 wait complete. 2023-10-14T18:56:45.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.325+0000 7f0b5784b700 1 Processor -- start 2023-10-14T18:56:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.325+0000 7f0b5784b700 1 -- start start 2023-10-14T18:56:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 0x7f0b5014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5015a620 0x7f0b50150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5013dd60 con 0x7f0b50157c40 2023-10-14T18:56:45.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50150ab0 con 0x7f0b5015a620 2023-10-14T18:56:45.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b5784b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5014eba0 con 0x7f0b50157870 2023-10-14T18:56:45.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b54de6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b54de6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54366/0 (socket says 172.21.15.79:54366) 2023-10-14T18:56:45.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b54de6700 1 -- 172.21.15.79:0/4260024608 learned_addr learned my addr 172.21.15.79:0/4260024608 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:45.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b55de8700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5015a620 0x7f0b50150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.326+0000 7f0b555e7700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 0x7f0b5014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 -- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 msgr2=0x7f0b5014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 0x7f0b5014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 -- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5015a620 msgr2=0x7f0b50150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5015a620 0x7f0b50150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 -- 172.21.15.79:0/4260024608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480094f0 con 0x7f0b50157c40 2023-10-14T18:56:45.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b555e7700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 0x7f0b5014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:45.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b54de6700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c590 tx=0x7f0b40007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:45.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011590 con 0x7f0b50157c40 2023-10-14T18:56:45.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40011710 con 0x7f0b50157c40 2023-10-14T18:56:45.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b500b2520 con 0x7f0b50157c40 2023-10-14T18:56:45.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011ad0 con 0x7f0b50157c40 2023-10-14T18:56:45.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.327+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b500b2ae0 con 0x7f0b50157c40 2023-10-14T18:56:45.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.328+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5013df10 con 0x7f0b50157c40 2023-10-14T18:56:45.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.328+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b4001a360 con 0x7f0b50157c40 2023-10-14T18:56:45.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.328+0000 7f0b457fa700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:45.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.329+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b400834f0 con 0x7f0b50157c40 2023-10-14T18:56:45.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.329+0000 7f0b555e7700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:45.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.329+0000 7f0b555e7700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006b4e0 tx=0x7f0b48017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:45.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.333+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b5013df10 con 0x7f0b50157c40 2023-10-14T18:56:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.556+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5013dea0 con 0x7f0b50157c40 2023-10-14T18:56:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.557+0000 7f0b457fa700 1 -- 172.21.15.79:0/4260024608 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f0b40050760 con 0x7f0b50157c40 2023-10-14T18:56:45.558 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:45.558 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 msgr2=0x7f0b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 0x7f0b340693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0b5006b4e0 tx=0x7f0b48017000 comp rx=0 tx=0).stop 2023-10-14T18:56:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 msgr2=0x7f0b50150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c590 tx=0x7f0b40007f50 comp rx=0 tx=0).stop 2023-10-14T18:56:45.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 shutdown_connections 2023-10-14T18:56:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f0b34066f30 0x7f0b340693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b5015a620 0x7f0b50150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0b50157870 0x7f0b5014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 --2- 172.21.15.79:0/4260024608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b50157c40 0x7f0b50150030 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 >> 172.21.15.79:0/4260024608 conn(0x7f0b50068ce0 msgr2=0x7f0b50158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 shutdown_connections 2023-10-14T18:56:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:45.559+0000 7f0b5784b700 1 -- 172.21.15.79:0/4260024608 wait complete. 2023-10-14T18:56:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:45.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-14T18:56:45.722 INFO:teuthology.orchestra.run.smithi144.stdout:{"cluster_fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","whoami":0,"id":8160,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":40.098438299999998,"mdsmap_epoch":88,"osdmap_epoch":189,"osdmap_epoch_barrier":188,"uptime":45.667313741000001} 2023-10-14T18:56:45.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "73e97ab7-e872-4b12-8e7a-6b299bb24b40", "fs_name": "cephfs", "id": 8160, "mdsmap_epoch": 88, "osdmap_epoch": 189, "osdmap_epoch_barrier": 188, "rank_uptime": 40.0984383, "state": "up:active", "uptime": 45.667313741, "want_state": "up:active", "whoami": 0 } 2023-10-14T18:56:45.723 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-14T18:56:45.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:45.724 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-14T18:56:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records in 2023-10-14T18:56:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:50+0 records out 2023-10-14T18:56:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.266261 s, 197 MB/s 2023-10-14T18:56:46.009 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T18:56:46.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:56:46.054 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T18:56:46.091 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T18:56:46.092 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T18:56:46.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:46.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-14T18:56:46.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:56:46.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:46.163 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T18:56:46.178 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T18:56:46.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-14T18:56:46.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-14T18:56:46.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:56:46.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:46.222 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T18:56:46.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:46.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.389+0000 7fbcc2c71700 1 Processor -- start 2023-10-14T18:56:46.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.389+0000 7fbcc2c71700 1 -- start start 2023-10-14T18:56:46.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc2c71700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcbc15a620 0x7fbcbc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc2c71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc15d580 0x7fbcbc158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc2c71700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc15cbb0 con 0x7fbcbc157870 2023-10-14T18:56:46.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc2c71700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc15bdb0 con 0x7fbcbc15a620 2023-10-14T18:56:46.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc2c71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc15bfa0 con 0x7fbcbc15d580 2023-10-14T18:56:46.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcbc15a620 0x7fbcbc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcbc15a620 0x7fbcbc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54372/0 (socket says 172.21.15.79:54372) 2023-10-14T18:56:46.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 -- 172.21.15.79:0/2814462163 learned_addr learned my addr 172.21.15.79:0/2814462163 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:46.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcc120e700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc15d580 0x7fbcbc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 -- 172.21.15.79:0/2814462163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc15d580 msgr2=0x7fbcbc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc15d580 0x7fbcbc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 -- 172.21.15.79:0/2814462163 >> v1:172.21.15.144:6789/0 conn(0x7fbcbc157870 legacy=0x7fbcbc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.390+0000 7fbcb3fff700 1 -- 172.21.15.79:0/2814462163 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc15c280 con 0x7fbcbc15a620 2023-10-14T18:56:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcb3fff700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15a620 0x7fbcbc15d040 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0099b0 tx=0x7fbcac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95d90d3562a90e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcb37fe700 1 -- 172.21.15.79:0/2814462163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00b820 con 0x7fbcbc15a620 2023-10-14T18:56:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcb37fe700 1 -- 172.21.15.79:0/2814462163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00b980 con 0x7fbcbc15a620 2023-10-14T18:56:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcb37fe700 1 -- 172.21.15.79:0/2814462163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00bd20 con 0x7fbcbc15a620 2023-10-14T18:56:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 -- 172.21.15.79:0/2814462163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15a620 msgr2=0x7fbcbc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15a620 0x7fbcbc15d040 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0099b0 tx=0x7fbcac009250 comp rx=0 tx=0).stop 2023-10-14T18:56:46.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 -- 172.21.15.79:0/2814462163 shutdown_connections 2023-10-14T18:56:46.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc15d580 0x7fbcbc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/2814462163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15a620 0x7fbcbc15d040 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 -- 172.21.15.79:0/2814462163 >> 172.21.15.79:0/2814462163 conn(0x7fbcbc068ce0 msgr2=0x7fbcbc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:46.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 -- 172.21.15.79:0/2814462163 shutdown_connections 2023-10-14T18:56:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.391+0000 7fbcc2c71700 1 -- 172.21.15.79:0/2814462163 wait complete. 2023-10-14T18:56:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.392+0000 7fbcc2c71700 1 Processor -- start 2023-10-14T18:56:46.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.392+0000 7fbcc2c71700 1 -- start start 2023-10-14T18:56:46.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc157870 0x7fbcbc16fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcbc15a620 0x7fbcbc171790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc171300 con 0x7fbcbc15d580 2023-10-14T18:56:46.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1706f0 con 0x7fbcbc15a620 2023-10-14T18:56:46.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc2c71700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1709d0 con 0x7fbcbc157870 2023-10-14T18:56:46.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc120e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc120e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54382/0 (socket says 172.21.15.79:54382) 2023-10-14T18:56:46.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc120e700 1 -- 172.21.15.79:0/456402905 learned_addr learned my addr 172.21.15.79:0/456402905 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:46.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcb3fff700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcbc15a620 0x7fbcbc171790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.393+0000 7fbcc0a0d700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc157870 0x7fbcbc16fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 -- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc157870 msgr2=0x7fbcbc16fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc157870 0x7fbcbc16fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 -- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcbc15a620 msgr2=0x7fbcbc171790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcbc15a620 0x7fbcbc171790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 -- 172.21.15.79:0/456402905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0094f0 con 0x7fbcbc15d580 2023-10-14T18:56:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc120e700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400d860 tx=0x7fbcb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40125f0 con 0x7fbcbc15d580 2023-10-14T18:56:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb4012770 con 0x7fbcbc15d580 2023-10-14T18:56:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc170cb0 con 0x7fbcbc15d580 2023-10-14T18:56:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4012b30 con 0x7fbcbc15d580 2023-10-14T18:56:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.394+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc0a7760 con 0x7fbcbc15d580 2023-10-14T18:56:46.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.395+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc171470 con 0x7fbcbc15d580 2023-10-14T18:56:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.395+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcb4013480 con 0x7fbcbc15d580 2023-10-14T18:56:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.396+0000 7fbcb0ff9700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 0x7fbca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.396+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcb4084800 con 0x7fbcbc15d580 2023-10-14T18:56:46.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.396+0000 7fbcc0a0d700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 0x7fbca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.396+0000 7fbcc0a0d700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 0x7fbca80693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb80026a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.400+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcb4051a70 con 0x7fbcbc15d580 2023-10-14T18:56:46.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.625+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcbc04c3c0 con 0x7fbcbc15d580 2023-10-14T18:56:46.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.625+0000 7fbcb0ff9700 1 -- 172.21.15.79:0/456402905 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fbcb4055090 con 0x7fbcbc15d580 2023-10-14T18:56:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:46.627 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:46.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 msgr2=0x7fbca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 0x7fbca80693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb80026a0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 msgr2=0x7fbcbc0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400d860 tx=0x7fbcb4008040 comp rx=0 tx=0).stop 2023-10-14T18:56:46.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 shutdown_connections 2023-10-14T18:56:46.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbca8066f30 0x7fbca80693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcbc15d580 0x7fbcbc0b20a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbcbc157870 0x7fbcbc16fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 --2- 172.21.15.79:0/456402905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbcbc15a620 0x7fbcbc171790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 >> 172.21.15.79:0/456402905 conn(0x7fbcbc068ce0 msgr2=0x7fbcbc0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:46.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 shutdown_connections 2023-10-14T18:56:46.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.628+0000 7fbcc2c71700 1 -- 172.21.15.79:0/456402905 wait complete. 2023-10-14T18:56:46.632 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:46.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:46.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.754+0000 7f3d3fe3e700 1 Processor -- start 2023-10-14T18:56:46.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.754+0000 7f3d3fe3e700 1 -- start start 2023-10-14T18:56:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3fe3e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38157870 0x7f3d3815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3fe3e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3815cbb0 con 0x7f3d3815a620 2023-10-14T18:56:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3fe3e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3815bfa0 con 0x7f3d38157c40 2023-10-14T18:56:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3fe3e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3815c280 con 0x7f3d38157870 2023-10-14T18:56:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38157870 0x7f3d3815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3d38157870 0x7f3d3815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54386/0 (socket says 172.21.15.79:54386) 2023-10-14T18:56:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3d3d9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3d3815a620 0x7f3d3815d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44528/0 (socket says 172.21.15.79:44528) 2023-10-14T18:56:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 -- 172.21.15.79:0/1248035694 learned_addr learned my addr 172.21.15.79:0/1248035694 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 -- 172.21.15.79:0/1248035694 >> v1:172.21.15.144:6789/0 conn(0x7f3d38157c40 legacy=0x7f3d38158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 -- 172.21.15.79:0/1248035694 >> v1:172.21.15.79:6789/0 conn(0x7f3d3815a620 legacy=0x7f3d3815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.755+0000 7f3d3dbda700 1 -- 172.21.15.79:0/1248035694 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3815c560 con 0x7f3d38157870 2023-10-14T18:56:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3dbda700 1 --2- 172.21.15.79:0/1248035694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157870 0x7f3d3815b6a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099b0 tx=0x7f3d34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2f0be36eb144fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3cbd8700 1 -- 172.21.15.79:0/1248035694 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400b820 con 0x7f3d38157870 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3cbd8700 1 -- 172.21.15.79:0/1248035694 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400b980 con 0x7f3d38157870 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3cbd8700 1 -- 172.21.15.79:0/1248035694 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400bd20 con 0x7f3d38157870 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/1248035694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157870 msgr2=0x7f3d3815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/1248035694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157870 0x7f3d3815b6a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099b0 tx=0x7f3d34009250 comp rx=0 tx=0).stop 2023-10-14T18:56:46.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/1248035694 shutdown_connections 2023-10-14T18:56:46.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/1248035694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157870 0x7f3d3815b6a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/1248035694 >> 172.21.15.79:0/1248035694 conn(0x7f3d38068ce0 msgr2=0x7f3d380690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:46.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/1248035694 shutdown_connections 2023-10-14T18:56:46.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.756+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/1248035694 wait complete. 2023-10-14T18:56:46.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.757+0000 7f3d3fe3e700 1 Processor -- start 2023-10-14T18:56:46.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 -- start start 2023-10-14T18:56:46.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38157870 0x7f3d3813c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3815a620 0x7f3d38150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3813e1a0 con 0x7f3d38157c40 2023-10-14T18:56:46.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38150f90 con 0x7f3d38157870 2023-10-14T18:56:46.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3fe3e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380b2aa0 con 0x7f3d3815a620 2023-10-14T18:56:46.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3d3d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3d3d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54394/0 (socket says 172.21.15.79:54394) 2023-10-14T18:56:46.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3d3d9700 1 -- 172.21.15.79:0/2500876257 learned_addr learned my addr 172.21.15.79:0/2500876257 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:46.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3dbda700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38157870 0x7f3d3813c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.758+0000 7f3d3e3db700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3815a620 0x7f3d38150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 -- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3815a620 msgr2=0x7f3d38150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3815a620 0x7f3d38150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 -- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38157870 msgr2=0x7f3d3813c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38157870 0x7f3d3813c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 -- 172.21.15.79:0/2500876257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340094f0 con 0x7f3d38157c40 2023-10-14T18:56:46.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3d3d9700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001eb0 tx=0x7f3d28007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28005a70 con 0x7f3d38157c40 2023-10-14T18:56:46.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28005bd0 con 0x7f3d38157c40 2023-10-14T18:56:46.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d380b2d80 con 0x7f3d38157c40 2023-10-14T18:56:46.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280070d0 con 0x7f3d38157c40 2023-10-14T18:56:46.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.759+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d380b3340 con 0x7f3d38157c40 2023-10-14T18:56:46.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.760+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3813e310 con 0x7f3d38157c40 2023-10-14T18:56:46.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.761+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d28007480 con 0x7f3d38157c40 2023-10-14T18:56:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.761+0000 7f3d2dffb700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 0x7f3d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.761+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d280838f0 con 0x7f3d38157c40 2023-10-14T18:56:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.761+0000 7f3d3dbda700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 0x7f3d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:46.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.761+0000 7f3d3dbda700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 0x7f3d1c0693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099b0 tx=0x7f3d34016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:46.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.765+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d28050b60 con 0x7f3d38157c40 2023-10-14T18:56:46.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.949+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d3804c3c0 con 0x7f3d38157c40 2023-10-14T18:56:46.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.950+0000 7f3d2dffb700 1 -- 172.21.15.79:0/2500876257 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f3d28017020 con 0x7f3d38157c40 2023-10-14T18:56:46.951 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:46.951 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":189,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:42.596000+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:46.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 msgr2=0x7f3d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 0x7f3d1c0693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3d340099b0 tx=0x7f3d34016000 comp rx=0 tx=0).stop 2023-10-14T18:56:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 msgr2=0x7f3d38150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f3d28001eb0 tx=0x7f3d28007f40 comp rx=0 tx=0).stop 2023-10-14T18:56:46.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 shutdown_connections 2023-10-14T18:56:46.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f3d1c066f30 0x7f3d1c0693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3d3815a620 0x7f3d38150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d38157870 0x7f3d3813c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 --2- 172.21.15.79:0/2500876257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d38157c40 0x7f3d38150510 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:46.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 >> 172.21.15.79:0/2500876257 conn(0x7f3d38068ce0 msgr2=0x7f3d380d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:46.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 shutdown_connections 2023-10-14T18:56:46.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:46.952+0000 7f3d3fe3e700 1 -- 172.21.15.79:0/2500876257 wait complete. 2023-10-14T18:56:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T18:44:58.374271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T18:56:02.900407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T18:56:03.944358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T18:56:46.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T18:56:47.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.081+0000 7fe7d48df700 1 Processor -- start 2023-10-14T18:56:47.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.081+0000 7fe7d48df700 1 -- start start 2023-10-14T18:56:47.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7d48df700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe7d00b4860 0x7fe7d00b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7d48df700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7d00b3570 0x7fe7d015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7d48df700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00b14f0 con 0x7fe7d00b4c30 2023-10-14T18:56:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7d48df700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00b17d0 con 0x7fe7d00b3570 2023-10-14T18:56:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7d48df700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00b1ab0 con 0x7fe7d00b4860 2023-10-14T18:56:47.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7ced9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe7d00b3570 0x7fe7d015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7cdd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7d00b4c30 0x7fe7d0159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44532/0 (socket says 172.21.15.79:44532) 2023-10-14T18:56:47.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.082+0000 7fe7cdd9b700 1 -- 172.21.15.79:0/2068984915 learned_addr learned my addr 172.21.15.79:0/2068984915 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:47.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ce59c700 1 --2- 172.21.15.79:0/2068984915 >> v2:172.21.15.144:3300/0 conn(0x7fe7d00b4860 0x7fe7d00b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ced9d700 1 -- 172.21.15.79:0/2068984915 >> v2:172.21.15.144:3300/0 conn(0x7fe7d00b4860 msgr2=0x7fe7d00b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ced9d700 1 --2- 172.21.15.79:0/2068984915 >> v2:172.21.15.144:3300/0 conn(0x7fe7d00b4860 0x7fe7d00b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ced9d700 1 -- 172.21.15.79:0/2068984915 >> v1:172.21.15.79:6789/0 conn(0x7fe7d00b4c30 legacy=0x7fe7d0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ced9d700 1 -- 172.21.15.79:0/2068984915 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00b1d90 con 0x7fe7d00b3570 2023-10-14T18:56:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7cd59a700 1 -- 172.21.15.79:0/2068984915 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179971690 0 0) 0x7fe7d00b14f0 con 0x7fe7d00b4c30 2023-10-14T18:56:47.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7ced9d700 1 --2- 172.21.15.79:0/2068984915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d015a1a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00d1e70 tx=0x7fe7c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23581588ca7bba82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7cd59a700 1 -- 172.21.15.79:0/2068984915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800b690 con 0x7fe7d00b3570 2023-10-14T18:56:47.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7cd59a700 1 -- 172.21.15.79:0/2068984915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800b7f0 con 0x7fe7d00b3570 2023-10-14T18:56:47.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.083+0000 7fe7cd59a700 1 -- 172.21.15.79:0/2068984915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800bb90 con 0x7fe7d00b3570 2023-10-14T18:56:47.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 -- 172.21.15.79:0/2068984915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 msgr2=0x7fe7d015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2068984915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d015a1a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00d1e70 tx=0x7fe7c80091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 -- 172.21.15.79:0/2068984915 shutdown_connections 2023-10-14T18:56:47.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2068984915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d015a1a0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2068984915 >> v2:172.21.15.144:3300/0 conn(0x7fe7d00b4860 0x7fe7d00b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 -- 172.21.15.79:0/2068984915 >> 172.21.15.79:0/2068984915 conn(0x7fe7d009a0f0 msgr2=0x7fe7d0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 -- 172.21.15.79:0/2068984915 shutdown_connections 2023-10-14T18:56:47.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.084+0000 7fe7d48df700 1 -- 172.21.15.79:0/2068984915 wait complete. 2023-10-14T18:56:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 Processor -- start 2023-10-14T18:56:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 -- start start 2023-10-14T18:56:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 0x7fe7d015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 0x7fe7d0160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00af1c0 con 0x7fe7d00b3570 2023-10-14T18:56:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d016a860 con 0x7fe7d00b4c30 2023-10-14T18:56:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.085+0000 7fe7d48df700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00aeb70 con 0x7fe7d00b4860 2023-10-14T18:56:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54410/0 (socket says 172.21.15.79:54410) 2023-10-14T18:56:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 -- 172.21.15.79:0/2251470117 learned_addr learned my addr 172.21.15.79:0/2251470117 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ced9d700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 0x7fe7d0160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7cdd9b700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 0x7fe7d015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 -- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 msgr2=0x7fe7d015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 0x7fe7d015fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 -- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 msgr2=0x7fe7d0160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 0x7fe7d0160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 -- 172.21.15.79:0/2251470117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8009420 con 0x7fe7d00b3570 2023-10-14T18:56:47.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ced9d700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 0x7fe7d0160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:47.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7cdd9b700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 0x7fe7d015fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:47.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7ce59c700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009f60 tx=0x7fe7c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000ccd0 con 0x7fe7d00b3570 2023-10-14T18:56:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000f040 con 0x7fe7d00b3570 2023-10-14T18:56:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d00aee50 con 0x7fe7d00b3570 2023-10-14T18:56:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00146d0 con 0x7fe7d00b3570 2023-10-14T18:56:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.086+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00afb90 con 0x7fe7d00b3570 2023-10-14T18:56:47.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.087+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d00af4a0 con 0x7fe7d00b3570 2023-10-14T18:56:47.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.088+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7c0014a80 con 0x7fe7d00b3570 2023-10-14T18:56:47.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.088+0000 7fe7be7fc700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 0x7fe7b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.088+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c0084d80 con 0x7fe7d00b3570 2023-10-14T18:56:47.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.088+0000 7fe7cdd9b700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 0x7fe7b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.089+0000 7fe7cdd9b700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 0x7fe7b00693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0070af0 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.092+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7c0055a80 con 0x7fe7d00b3570 2023-10-14T18:56:47.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.277+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7d004c3c0 con 0x7fe7d00b3570 2023-10-14T18:56:47.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.277+0000 7fe7be7fc700 1 -- 172.21.15.79:0/2251470117 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7c0018020 con 0x7fe7d00b3570 2023-10-14T18:56:47.278 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-14T18:56:47.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 msgr2=0x7fe7b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 0x7fe7b00693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0070af0 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2023-10-14T18:56:47.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 msgr2=0x7fe7d00af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009f60 tx=0x7fe7c000b040 comp rx=0 tx=0).stop 2023-10-14T18:56:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 shutdown_connections 2023-10-14T18:56:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7b0066f30 0x7fe7b00693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7d00b4c30 0x7fe7d0160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d00b3570 0x7fe7d00af650 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 --2- 172.21.15.79:0/2251470117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe7d00b4860 0x7fe7d015fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 >> 172.21.15.79:0/2251470117 conn(0x7fe7d009a0f0 msgr2=0x7fe7d015c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 shutdown_connections 2023-10-14T18:56:47.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.279+0000 7fe7d48df700 1 -- 172.21.15.79:0/2251470117 wait complete. 2023-10-14T18:56:47.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T18:56:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.409+0000 7f64fdcba700 1 Processor -- start 2023-10-14T18:56:47.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.409+0000 7f64fdcba700 1 -- start start 2023-10-14T18:56:47.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64fdcba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64f80b4860 0x7f64f80b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64fdcba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64f80b3570 0x7f64f815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64fdcba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80b14f0 con 0x7f64f80b4c30 2023-10-14T18:56:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64fdcba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80b17d0 con 0x7f64f80b3570 2023-10-14T18:56:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64fdcba700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80b1ab0 con 0x7f64f80b4860 2023-10-14T18:56:47.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64f80b3570 0x7f64f815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f6ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64f80b4c30 0x7f64f8159a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44544/0 (socket says 172.21.15.79:44544) 2023-10-14T18:56:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f6ffd700 1 -- 172.21.15.79:0/4110391730 learned_addr learned my addr 172.21.15.79:0/4110391730 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f77fe700 1 --2- 172.21.15.79:0/4110391730 >> v2:172.21.15.144:3300/0 conn(0x7f64f80b4860 0x7f64f80b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f7fff700 1 -- 172.21.15.79:0/4110391730 >> v2:172.21.15.144:3300/0 conn(0x7f64f80b4860 msgr2=0x7f64f80b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:47.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f7fff700 1 --2- 172.21.15.79:0/4110391730 >> v2:172.21.15.144:3300/0 conn(0x7f64f80b4860 0x7f64f80b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.410+0000 7f64f7fff700 1 -- 172.21.15.79:0/4110391730 >> v1:172.21.15.79:6789/0 conn(0x7f64f80b4c30 legacy=0x7f64f8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f7fff700 1 -- 172.21.15.79:0/4110391730 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80b1d90 con 0x7f64f80b3570 2023-10-14T18:56:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f67fc700 1 -- 172.21.15.79:0/4110391730 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795376098 0 0) 0x7f64f80b14f0 con 0x7f64f80b4c30 2023-10-14T18:56:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f7fff700 1 --2- 172.21.15.79:0/4110391730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b3570 0x7f64f815a1a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d1e70 tx=0x7f64f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ec1592254a5787 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f67fc700 1 -- 172.21.15.79:0/4110391730 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000b740 con 0x7f64f80b3570 2023-10-14T18:56:47.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f67fc700 1 -- 172.21.15.79:0/4110391730 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f000b8a0 con 0x7f64f80b3570 2023-10-14T18:56:47.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64f67fc700 1 -- 172.21.15.79:0/4110391730 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f000bc40 con 0x7f64f80b3570 2023-10-14T18:56:47.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 -- 172.21.15.79:0/4110391730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b3570 msgr2=0x7f64f815a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 --2- 172.21.15.79:0/4110391730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b3570 0x7f64f815a1a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f64f80d1e70 tx=0x7f64f00091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 -- 172.21.15.79:0/4110391730 shutdown_connections 2023-10-14T18:56:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 --2- 172.21.15.79:0/4110391730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b3570 0x7f64f815a1a0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 --2- 172.21.15.79:0/4110391730 >> v2:172.21.15.144:3300/0 conn(0x7f64f80b4860 0x7f64f80b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 -- 172.21.15.79:0/4110391730 >> 172.21.15.79:0/4110391730 conn(0x7f64f809a0f0 msgr2=0x7f64f8067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 -- 172.21.15.79:0/4110391730 shutdown_connections 2023-10-14T18:56:47.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.411+0000 7f64fdcba700 1 -- 172.21.15.79:0/4110391730 wait complete. 2023-10-14T18:56:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 Processor -- start 2023-10-14T18:56:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 -- start start 2023-10-14T18:56:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64f80b3570 0x7f64f815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64f80b4c30 0x7f64f809c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80acfd0 con 0x7f64f80b4860 2023-10-14T18:56:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80ad2b0 con 0x7f64f80b3570 2023-10-14T18:56:47.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64fdcba700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f80ad590 con 0x7f64f80b4c30 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54420/0 (socket says 172.21.15.79:54420) 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.413+0000 7f64f6ffd700 1 -- 172.21.15.79:0/344392376 learned_addr learned my addr 172.21.15.79:0/344392376 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f7fff700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64f80b4c30 0x7f64f809c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f77fe700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64f80b3570 0x7f64f815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 -- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64f80b4c30 msgr2=0x7f64f809c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64f80b4c30 0x7f64f809c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 -- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64f80b3570 msgr2=0x7f64f815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64f80b3570 0x7f64f815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 -- 172.21.15.79:0/344392376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0009420 con 0x7f64f80b4860 2023-10-14T18:56:47.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64f6ffd700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c5b0 tx=0x7f64ec001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec005b30 con 0x7f64f80b4860 2023-10-14T18:56:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec005c90 con 0x7f64f80b4860 2023-10-14T18:56:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f80ad870 con 0x7f64f80b4860 2023-10-14T18:56:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec007300 con 0x7f64f80b4860 2023-10-14T18:56:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.414+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f815cd30 con 0x7f64f80b4860 2023-10-14T18:56:47.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.415+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f815cf50 con 0x7f64f80b4860 2023-10-14T18:56:47.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.415+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64ec01b3b0 con 0x7f64f80b4860 2023-10-14T18:56:47.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.416+0000 7f64df7fe700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.416+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64ec083930 con 0x7f64f80b4860 2023-10-14T18:56:47.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.416+0000 7f64f77fe700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.416+0000 7f64f77fe700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007680 tx=0x7f64e80098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.420+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64ec050ba0 con 0x7f64f80b4860 2023-10-14T18:56:47.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.599+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64f80add90 con 0x7f64f80b4860 2023-10-14T18:56:47.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.600+0000 7f64df7fe700 1 -- 172.21.15.79:0/344392376 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v189) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64ec017020 con 0x7f64f80b4860 2023-10-14T18:56:47.601 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-14T18:56:47.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 msgr2=0x7f64e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 0x7f64e40693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007680 tx=0x7f64e80098d0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 msgr2=0x7f64f809c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c5b0 tx=0x7f64ec001070 comp rx=0 tx=0).stop 2023-10-14T18:56:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 shutdown_connections 2023-10-14T18:56:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f64e4066f30 0x7f64e40693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f64f80b4c30 0x7f64f809c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64f80b3570 0x7f64f815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 --2- 172.21.15.79:0/344392376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f80b4860 0x7f64f809c320 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 >> 172.21.15.79:0/344392376 conn(0x7f64f809a0f0 msgr2=0x7f64f815a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 shutdown_connections 2023-10-14T18:56:47.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.602+0000 7f64fdcba700 1 -- 172.21.15.79:0/344392376 wait complete. 2023-10-14T18:56:47.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T18:56:47.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.731+0000 7f4b5cdb0700 1 Processor -- start 2023-10-14T18:56:47.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.731+0000 7f4b5cdb0700 1 -- start start 2023-10-14T18:56:47.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b5cdb0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b5806aa00 0x7f4b58164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b5cdb0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580b4d70 con 0x7f4b580cce30 2023-10-14T18:56:47.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b5cdb0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5815b3b0 con 0x7f4b580b6580 2023-10-14T18:56:47.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b5cdb0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b580cd8d0 con 0x7f4b5806aa00 2023-10-14T18:56:47.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b57fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b5806aa00 0x7f4b58164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b577fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4b580cce30 0x7f4b5815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44550/0 (socket says 172.21.15.79:44550) 2023-10-14T18:56:47.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b577fe700 1 -- 172.21.15.79:0/3366555817 learned_addr learned my addr 172.21.15.79:0/3366555817 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b57fff700 1 -- 172.21.15.79:0/3366555817 >> v1:172.21.15.144:6789/0 conn(0x7f4b580b6580 legacy=0x7f4b5806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b57fff700 1 -- 172.21.15.79:0/3366555817 >> v1:172.21.15.79:6789/0 conn(0x7f4b580cce30 legacy=0x7f4b5815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b567fc700 1 -- 172.21.15.79:0/3366555817 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493317448 0 0) 0x7f4b580b4d70 con 0x7f4b580cce30 2023-10-14T18:56:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b57fff700 1 -- 172.21.15.79:0/3366555817 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580b4440 con 0x7f4b5806aa00 2023-10-14T18:56:47.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b57fff700 1 --2- 172.21.15.79:0/3366555817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b58164c20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e60 tx=0x7f4b50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49ec238b34aba10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b567fc700 1 -- 172.21.15.79:0/3366555817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000e070 con 0x7f4b5806aa00 2023-10-14T18:56:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b567fc700 1 -- 172.21.15.79:0/3366555817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5000bc30 con 0x7f4b5806aa00 2023-10-14T18:56:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.732+0000 7f4b567fc700 1 -- 172.21.15.79:0/3366555817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50012430 con 0x7f4b5806aa00 2023-10-14T18:56:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/3366555817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 msgr2=0x7f4b58164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/3366555817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b58164c20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009e60 tx=0x7f4b50009780 comp rx=0 tx=0).stop 2023-10-14T18:56:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/3366555817 shutdown_connections 2023-10-14T18:56:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/3366555817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b58164c20 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/3366555817 >> 172.21.15.79:0/3366555817 conn(0x7f4b58068cb0 msgr2=0x7f4b580690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/3366555817 shutdown_connections 2023-10-14T18:56:47.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.733+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/3366555817 wait complete. 2023-10-14T18:56:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.734+0000 7f4b5cdb0700 1 Processor -- start 2023-10-14T18:56:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.734+0000 7f4b5cdb0700 1 -- start start 2023-10-14T18:56:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b580b6580 0x7f4b58155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b580cce30 0x7f4b580d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5816b2b0 con 0x7f4b5806aa00 2023-10-14T18:56:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58143c30 con 0x7f4b580b6580 2023-10-14T18:56:47.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58155ab0 con 0x7f4b580cce30 2023-10-14T18:56:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54434/0 (socket says 172.21.15.79:54434) 2023-10-14T18:56:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 -- 172.21.15.79:0/1604182621 learned_addr learned my addr 172.21.15.79:0/1604182621 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:47.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b56ffd700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b580b6580 0x7f4b58155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b57fff700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b580cce30 0x7f4b580d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 -- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b580cce30 msgr2=0x7f4b580d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b580cce30 0x7f4b580d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 -- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b580b6580 msgr2=0x7f4b58155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b580b6580 0x7f4b58155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 -- 172.21.15.79:0/1604182621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009a20 con 0x7f4b5806aa00 2023-10-14T18:56:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b577fe700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c5b0 tx=0x7f4b48001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48005b30 con 0x7f4b5806aa00 2023-10-14T18:56:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48005c90 con 0x7f4b5806aa00 2023-10-14T18:56:47.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.735+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5816b550 con 0x7f4b5806aa00 2023-10-14T18:56:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.736+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48007300 con 0x7f4b5806aa00 2023-10-14T18:56:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.736+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5816bb10 con 0x7f4b5806aa00 2023-10-14T18:56:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.736+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5816bd30 con 0x7f4b5806aa00 2023-10-14T18:56:47.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.737+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b4801b3b0 con 0x7f4b5806aa00 2023-10-14T18:56:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.737+0000 7f4b3f7fe700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.737+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b48083a00 con 0x7f4b5806aa00 2023-10-14T18:56:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.738+0000 7f4b56ffd700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:47.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.738+0000 7f4b56ffd700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 0x7f4b440693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4b58150ec0 tx=0x7f4b4c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:47.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.742+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b48050bd0 con 0x7f4b5806aa00 2023-10-14T18:56:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.924+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b580b4720 con 0x7f4b5806aa00 2023-10-14T18:56:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.925+0000 7f4b3f7fe700 1 -- 172.21.15.79:0/1604182621 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b480170a0 con 0x7f4b5806aa00 2023-10-14T18:56:47.926 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-14T18:56:47.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.926+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 msgr2=0x7f4b440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.926+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 0x7f4b440693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4b58150ec0 tx=0x7f4b4c007ec0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.926+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 msgr2=0x7f4b581436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c5b0 tx=0x7f4b48001070 comp rx=0 tx=0).stop 2023-10-14T18:56:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 shutdown_connections 2023-10-14T18:56:47.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4b44066f30 0x7f4b440693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4b580cce30 0x7f4b580d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b5806aa00 0x7f4b581436f0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 --2- 172.21.15.79:0/1604182621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b580b6580 0x7f4b58155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 >> 172.21.15.79:0/1604182621 conn(0x7f4b58068cb0 msgr2=0x7f4b580af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:47.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 shutdown_connections 2023-10-14T18:56:47.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:47.927+0000 7f4b5cdb0700 1 -- 172.21.15.79:0/1604182621 wait complete. 2023-10-14T18:56:47.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:48.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.053+0000 7f615cabd700 1 Processor -- start 2023-10-14T18:56:48.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.053+0000 7f615cabd700 1 -- start start 2023-10-14T18:56:48.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615cabd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f615815a620 0x7f615815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615cabd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f615815d580 0x7f6158158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615cabd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615815cbb0 con 0x7f6158157870 2023-10-14T18:56:48.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615cabd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615815bdb0 con 0x7f615815d580 2023-10-14T18:56:48.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615cabd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615815bfa0 con 0x7f615815a620 2023-10-14T18:56:48.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6158157870 0x7f615815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:44566/0 (socket says 172.21.15.79:44566) 2023-10-14T18:56:48.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f6156d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f615815d580 0x7f6158158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.054+0000 7f615659c700 1 -- 172.21.15.79:0/1878652918 learned_addr learned my addr 172.21.15.79:0/1878652918 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:48.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6156d9d700 1 -- 172.21.15.79:0/1878652918 >> v2:172.21.15.144:3300/0 conn(0x7f615815a620 msgr2=0x7f615815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:48.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6155d9b700 1 --2- 172.21.15.79:0/1878652918 >> v2:172.21.15.144:3300/0 conn(0x7f615815a620 0x7f615815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6156d9d700 1 --2- 172.21.15.79:0/1878652918 >> v2:172.21.15.144:3300/0 conn(0x7f615815a620 0x7f615815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6156d9d700 1 -- 172.21.15.79:0/1878652918 >> v1:172.21.15.79:6789/0 conn(0x7f6158157870 legacy=0x7f615815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f615559a700 1 -- 172.21.15.79:0/1878652918 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572123844 0 0) 0x7f615815cbb0 con 0x7f6158157870 2023-10-14T18:56:48.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6156d9d700 1 -- 172.21.15.79:0/1878652918 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615815c280 con 0x7f615815d580 2023-10-14T18:56:48.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f6156d9d700 1 --2- 172.21.15.79:0/1878652918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815d580 0x7f6158158110 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f615815cb20 tx=0x7f61500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b09c3fc304b523 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f615559a700 1 -- 172.21.15.79:0/1878652918 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000b6b0 con 0x7f615815d580 2023-10-14T18:56:48.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f615559a700 1 -- 172.21.15.79:0/1878652918 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000b810 con 0x7f615815d580 2023-10-14T18:56:48.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.055+0000 7f615559a700 1 -- 172.21.15.79:0/1878652918 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bbb0 con 0x7f615815d580 2023-10-14T18:56:48.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 -- 172.21.15.79:0/1878652918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815d580 msgr2=0x7f6158158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 --2- 172.21.15.79:0/1878652918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815d580 0x7f6158158110 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f615815cb20 tx=0x7f61500091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 -- 172.21.15.79:0/1878652918 shutdown_connections 2023-10-14T18:56:48.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 --2- 172.21.15.79:0/1878652918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815d580 0x7f6158158110 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 --2- 172.21.15.79:0/1878652918 >> v2:172.21.15.144:3300/0 conn(0x7f615815a620 0x7f615815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 -- 172.21.15.79:0/1878652918 >> 172.21.15.79:0/1878652918 conn(0x7f6158068ce0 msgr2=0x7f61580690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 -- 172.21.15.79:0/1878652918 shutdown_connections 2023-10-14T18:56:48.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.056+0000 7f615cabd700 1 -- 172.21.15.79:0/1878652918 wait complete. 2023-10-14T18:56:48.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 Processor -- start 2023-10-14T18:56:48.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 -- start start 2023-10-14T18:56:48.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6158157870 0x7f615814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f615815d580 0x7f6158160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158150b90 con 0x7f615815a620 2023-10-14T18:56:48.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158150890 con 0x7f615815d580 2023-10-14T18:56:48.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.057+0000 7f615cabd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580b2000 con 0x7f6158157870 2023-10-14T18:56:48.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54460/0 (socket says 172.21.15.79:54460) 2023-10-14T18:56:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 -- 172.21.15.79:0/2429262217 learned_addr learned my addr 172.21.15.79:0/2429262217 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 -- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6158157870 msgr2=0x7f615814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6158157870 0x7f615814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 -- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f615815d580 msgr2=0x7f6158160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f615815d580 0x7f6158160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 -- 172.21.15.79:0/2429262217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009420 con 0x7f615815a620 2023-10-14T18:56:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f6155d9b700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f614000c880 tx=0x7f6140008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140011600 con 0x7f615815a620 2023-10-14T18:56:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6140011780 con 0x7f615815a620 2023-10-14T18:56:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61580b22e0 con 0x7f615815a620 2023-10-14T18:56:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6140011b40 con 0x7f615815a620 2023-10-14T18:56:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.058+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61580b1260 con 0x7f615815a620 2023-10-14T18:56:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.059+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61581506f0 con 0x7f615815a620 2023-10-14T18:56:48.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.059+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6140010350 con 0x7f615815a620 2023-10-14T18:56:48.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.060+0000 7f614e7fc700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 0x7f61380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.060+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61400842c0 con 0x7f615815a620 2023-10-14T18:56:48.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.060+0000 7f615659c700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 0x7f61380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.060+0000 7f615659c700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 0x7f61380693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6148001560 tx=0x7f61480016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.064+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61581506f0 con 0x7f615815a620 2023-10-14T18:56:48.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.285+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61581506f0 con 0x7f615815a620 2023-10-14T18:56:48.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.285+0000 7f614e7fc700 1 -- 172.21.15.79:0/2429262217 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f61581506f0 con 0x7f615815a620 2023-10-14T18:56:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:48.287 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:48.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.287+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 msgr2=0x7f61380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.287+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 0x7f61380693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6148001560 tx=0x7f61480016c0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.287+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 msgr2=0x7f6158160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.287+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f614000c880 tx=0x7f6140008040 comp rx=0 tx=0).stop 2023-10-14T18:56:48.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 shutdown_connections 2023-10-14T18:56:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6138066f30 0x7f61380693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f615815d580 0x7f6158160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6158157870 0x7f615814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 --2- 172.21.15.79:0/2429262217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f615815a620 0x7f6158160020 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 >> 172.21.15.79:0/2429262217 conn(0x7f6158068ce0 msgr2=0x7f615814c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 shutdown_connections 2023-10-14T18:56:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.288+0000 7f615cabd700 1 -- 172.21.15.79:0/2429262217 wait complete. 2023-10-14T18:56:48.291 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:48.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:48.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.424+0000 7fbc98c26700 1 Processor -- start 2023-10-14T18:56:48.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.424+0000 7fbc98c26700 1 -- start start 2023-10-14T18:56:48.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc98c26700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc94157870 0x7fbc9415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc98c26700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 0x7fbc9415d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc98c26700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9415cbb0 con 0x7fbc9415d580 2023-10-14T18:56:48.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc98c26700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9415bfa0 con 0x7fbc94157870 2023-10-14T18:56:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc98c26700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9415c280 con 0x7fbc9415a620 2023-10-14T18:56:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc94157870 0x7fbc9415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc92d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc9415d580 0x7fbc94158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47898/0 (socket says 172.21.15.79:47898) 2023-10-14T18:56:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc92d9d700 1 -- 172.21.15.79:0/1451305421 learned_addr learned my addr 172.21.15.79:0/1451305421 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc91d9b700 1 --2- 172.21.15.79:0/1451305421 >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 0x7fbc9415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 -- 172.21.15.79:0/1451305421 >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 msgr2=0x7fbc9415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 --2- 172.21.15.79:0/1451305421 >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 0x7fbc9415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 -- 172.21.15.79:0/1451305421 >> v1:172.21.15.79:6789/0 conn(0x7fbc9415d580 legacy=0x7fbc94158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 -- 172.21.15.79:0/1451305421 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9415c560 con 0x7fbc94157870 2023-10-14T18:56:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9159a700 1 -- 172.21.15.79:0/1451305421 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379239557 0 0) 0x7fbc9415cbb0 con 0x7fbc9415d580 2023-10-14T18:56:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc91d9b700 1 --2- 172.21.15.79:0/1451305421 >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 0x7fbc9415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.425+0000 7fbc9259c700 1 --2- 172.21.15.79:0/1451305421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94157870 0x7fbc9415b6a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fbc9415cb20 tx=0x7fbc840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a75cd38ae123cbe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc9159a700 1 -- 172.21.15.79:0/1451305421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400b6b0 con 0x7fbc94157870 2023-10-14T18:56:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc9159a700 1 -- 172.21.15.79:0/1451305421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8400b810 con 0x7fbc94157870 2023-10-14T18:56:48.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc9159a700 1 -- 172.21.15.79:0/1451305421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400bbb0 con 0x7fbc94157870 2023-10-14T18:56:48.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 -- 172.21.15.79:0/1451305421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94157870 msgr2=0x7fbc9415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1451305421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94157870 0x7fbc9415b6a0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fbc9415cb20 tx=0x7fbc840091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 -- 172.21.15.79:0/1451305421 shutdown_connections 2023-10-14T18:56:48.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1451305421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc94157870 0x7fbc9415b6a0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1451305421 >> v2:172.21.15.144:3300/0 conn(0x7fbc9415a620 0x7fbc9415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 -- 172.21.15.79:0/1451305421 >> 172.21.15.79:0/1451305421 conn(0x7fbc94068ce0 msgr2=0x7fbc940690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 -- 172.21.15.79:0/1451305421 shutdown_connections 2023-10-14T18:56:48.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.426+0000 7fbc98c26700 1 -- 172.21.15.79:0/1451305421 wait complete. 2023-10-14T18:56:48.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.427+0000 7fbc98c26700 1 Processor -- start 2023-10-14T18:56:48.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.427+0000 7fbc98c26700 1 -- start start 2023-10-14T18:56:48.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94157870 0x7fbc9416a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 0x7fbc940cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940b0b90 con 0x7fbc9415a620 2023-10-14T18:56:48.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940cfd00 con 0x7fbc94157870 2023-10-14T18:56:48.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc98c26700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940cffe0 con 0x7fbc9415d580 2023-10-14T18:56:48.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc91d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc91d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53842/0 (socket says 172.21.15.79:53842) 2023-10-14T18:56:48.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc91d9b700 1 -- 172.21.15.79:0/1416542134 learned_addr learned my addr 172.21.15.79:0/1416542134 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:48.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc9259c700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94157870 0x7fbc9416a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.428+0000 7fbc92d9d700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 0x7fbc940cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 -- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 msgr2=0x7fbc940cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 0x7fbc940cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 -- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94157870 msgr2=0x7fbc9416a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94157870 0x7fbc9416a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 -- 172.21.15.79:0/1416542134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84009420 con 0x7fbc9415a620 2023-10-14T18:56:48.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc92d9d700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 0x7fbc940cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:48.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc91d9b700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e8a0 tx=0x7fbc88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88013410 con 0x7fbc9415a620 2023-10-14T18:56:48.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88013570 con 0x7fbc9415a620 2023-10-14T18:56:48.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88013930 con 0x7fbc9415a620 2023-10-14T18:56:48.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc940b07b0 con 0x7fbc9415a620 2023-10-14T18:56:48.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.429+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc94153930 con 0x7fbc9415a620 2023-10-14T18:56:48.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.430+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc940b0e00 con 0x7fbc9415a620 2023-10-14T18:56:48.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.430+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc88013d20 con 0x7fbc9415a620 2023-10-14T18:56:48.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.431+0000 7fbc827fc700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.431+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc88084280 con 0x7fbc9415a620 2023-10-14T18:56:48.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.431+0000 7fbc9259c700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.431+0000 7fbc9259c700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 0x7fbc740693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbc840093f0 tx=0x7fbc84017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.435+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc880514f0 con 0x7fbc9415a620 2023-10-14T18:56:48.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.620+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc940b0610 con 0x7fbc9415a620 2023-10-14T18:56:48.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.620+0000 7fbc827fc700 1 -- 172.21.15.79:0/1416542134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fbc940b0610 con 0x7fbc9415a620 2023-10-14T18:56:48.621 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:48.621 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":189,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:42.596000+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 msgr2=0x7fbc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 0x7fbc740693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbc840093f0 tx=0x7fbc84017000 comp rx=0 tx=0).stop 2023-10-14T18:56:48.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 msgr2=0x7fbc940d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800e8a0 tx=0x7fbc88008040 comp rx=0 tx=0).stop 2023-10-14T18:56:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 shutdown_connections 2023-10-14T18:56:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fbc74066f30 0x7fbc740693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc9415d580 0x7fbc940cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94157870 0x7fbc9416a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 --2- 172.21.15.79:0/1416542134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc9415a620 0x7fbc940d0870 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 >> 172.21.15.79:0/1416542134 conn(0x7fbc94068ce0 msgr2=0x7fbc941554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 shutdown_connections 2023-10-14T18:56:48.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.622+0000 7fbc98c26700 1 -- 172.21.15.79:0/1416542134 wait complete. 2023-10-14T18:56:48.635 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:56:48.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:48.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.750+0000 7f4224b7f700 1 Processor -- start 2023-10-14T18:56:48.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.750+0000 7f4224b7f700 1 -- start start 2023-10-14T18:56:48.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.751+0000 7f4224b7f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.751+0000 7f4224b7f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f422015b820 0x7f42200ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.751+0000 7f4224b7f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200c9450 con 0x7f42200b0cd0 2023-10-14T18:56:48.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.751+0000 7f4224b7f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200ce960 con 0x7f422015b820 2023-10-14T18:56:48.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.751+0000 7f4224b7f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200cc520 con 0x7f42200b10a0 2023-10-14T18:56:48.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f422015b820 0x7f42200ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421dd9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421e59c700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42200b0cd0 0x7f42200ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:34676/0 (socket says 172.21.15.79:34676) 2023-10-14T18:56:48.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421e59c700 1 -- 172.21.15.79:0/4050785516 learned_addr learned my addr 172.21.15.79:0/4050785516 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:48.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 -- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 msgr2=0x7f42200cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:48.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 --2- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 -- 172.21.15.79:0/4050785516 >> v1:172.21.15.144:6789/0 conn(0x7f42200b0cd0 legacy=0x7f42200ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 -- 172.21.15.79:0/4050785516 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200cc910 con 0x7f422015b820 2023-10-14T18:56:48.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421d59a700 1 -- 172.21.15.79:0/4050785516 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633624607 0 0) 0x7f42200c9450 con 0x7f42200b0cd0 2023-10-14T18:56:48.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421ed9d700 1 --2- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422015b820 0x7f42200ca930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f42180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cd2e565a0701fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421d59a700 1 -- 172.21.15.79:0/4050785516 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800b640 con 0x7f422015b820 2023-10-14T18:56:48.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421d59a700 1 -- 172.21.15.79:0/4050785516 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421800b7a0 con 0x7f422015b820 2023-10-14T18:56:48.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.752+0000 7f421d59a700 1 -- 172.21.15.79:0/4050785516 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421800bb40 con 0x7f422015b820 2023-10-14T18:56:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 -- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422015b820 msgr2=0x7f42200ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 --2- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422015b820 0x7f42200ca930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42180098e0 tx=0x7f42180091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 -- 172.21.15.79:0/4050785516 shutdown_connections 2023-10-14T18:56:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 --2- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f422015b820 0x7f42200ca930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 --2- 172.21.15.79:0/4050785516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 -- 172.21.15.79:0/4050785516 >> 172.21.15.79:0/4050785516 conn(0x7f422006fdc0 msgr2=0x7f422006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 -- 172.21.15.79:0/4050785516 shutdown_connections 2023-10-14T18:56:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.753+0000 7f4224b7f700 1 -- 172.21.15.79:0/4050785516 wait complete. 2023-10-14T18:56:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.754+0000 7f4224b7f700 1 Processor -- start 2023-10-14T18:56:48.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.754+0000 7f4224b7f700 1 -- start start 2023-10-14T18:56:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 0x7f42201537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220168320 con 0x7f422015b820 2023-10-14T18:56:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201685c0 con 0x7f42200b0cd0 2023-10-14T18:56:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f4224b7f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220153d30 con 0x7f42200b10a0 2023-10-14T18:56:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53844/0 (socket says 172.21.15.79:53844) 2023-10-14T18:56:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 -- 172.21.15.79:0/1965616154 learned_addr learned my addr 172.21.15.79:0/1965616154 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421e59c700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 0x7f42201537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421dd9b700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 -- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 msgr2=0x7f42200c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 -- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 msgr2=0x7f42201537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 0x7f42201537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421ed9d700 1 -- 172.21.15.79:0/1965616154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009420 con 0x7f422015b820 2023-10-14T18:56:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.755+0000 7f421e59c700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 0x7f42201537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f421ed9d700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f422006c860 tx=0x7f4218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218011420 con 0x7f422015b820 2023-10-14T18:56:48.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180115e0 con 0x7f422015b820 2023-10-14T18:56:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200c7000 con 0x7f422015b820 2023-10-14T18:56:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42180119a0 con 0x7f422015b820 2023-10-14T18:56:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.756+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200c75c0 con 0x7f422015b820 2023-10-14T18:56:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.757+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220168750 con 0x7f422015b820 2023-10-14T18:56:48.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.757+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4218011d10 con 0x7f422015b820 2023-10-14T18:56:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.757+0000 7f420e7fc700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 0x7f42000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.758+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4218085fe0 con 0x7f422015b820 2023-10-14T18:56:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.758+0000 7f421e59c700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 0x7f42000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:48.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.758+0000 7f421e59c700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 0x7f42000693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f421000e280 tx=0x7f4210009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:48.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.762+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4218053250 con 0x7f422015b820 2023-10-14T18:56:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.989+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f422004c3c0 con 0x7f422015b820 2023-10-14T18:56:48.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.990+0000 7f420e7fc700 1 -- 172.21.15.79:0/1965616154 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f4218056870 con 0x7f422015b820 2023-10-14T18:56:48.991 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:48.991 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 msgr2=0x7f42000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 0x7f42000693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f421000e280 tx=0x7f4210009040 comp rx=0 tx=0).stop 2023-10-14T18:56:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 msgr2=0x7f42200b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:48.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f422006c860 tx=0x7f4218017000 comp rx=0 tx=0).stop 2023-10-14T18:56:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 shutdown_connections 2023-10-14T18:56:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4200066f30 0x7f42000693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f422015b820 0x7f42200b3140 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42200b0cd0 0x7f42201537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 --2- 172.21.15.79:0/1965616154 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f42200b10a0 0x7f42200c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 >> 172.21.15.79:0/1965616154 conn(0x7f422006fdc0 msgr2=0x7f42200c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 shutdown_connections 2023-10-14T18:56:48.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:48.992+0000 7f4224b7f700 1 -- 172.21.15.79:0/1965616154 wait complete. 2023-10-14T18:56:48.996 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:49.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:56:49.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.118+0000 7f37ed167700 1 Processor -- start 2023-10-14T18:56:49.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.118+0000 7f37ed167700 1 -- start start 2023-10-14T18:56:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37ed167700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37e8157870 0x7f37e815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37ed167700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37e815a620 0x7f37e815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37ed167700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e815cbb0 con 0x7f37e815d580 2023-10-14T18:56:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37ed167700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e815bfa0 con 0x7f37e815a620 2023-10-14T18:56:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37ed167700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e815c280 con 0x7f37e8157870 2023-10-14T18:56:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37e815a620 0x7f37e815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f37e815a620 0x7f37e815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53858/0 (socket says 172.21.15.79:53858) 2023-10-14T18:56:49.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 -- 172.21.15.79:0/1102259167 learned_addr learned my addr 172.21.15.79:0/1102259167 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:49.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37e6d9d700 1 --2- 172.21.15.79:0/1102259167 >> v2:172.21.15.144:3300/0 conn(0x7f37e8157870 0x7f37e815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 -- 172.21.15.79:0/1102259167 >> v2:172.21.15.144:3300/0 conn(0x7f37e8157870 msgr2=0x7f37e815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 --2- 172.21.15.79:0/1102259167 >> v2:172.21.15.144:3300/0 conn(0x7f37e8157870 0x7f37e815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 -- 172.21.15.79:0/1102259167 >> v1:172.21.15.144:6789/0 conn(0x7f37e815d580 legacy=0x7f37e8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.119+0000 7f37de59c700 1 -- 172.21.15.79:0/1102259167 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e815c560 con 0x7f37e815a620 2023-10-14T18:56:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37de59c700 1 --2- 172.21.15.79:0/1102259167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815a620 0x7f37e815d040 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f37e8069d80 tx=0x7f37d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c4f4bbf42d471a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37e659c700 1 -- 172.21.15.79:0/1102259167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000b820 con 0x7f37e815a620 2023-10-14T18:56:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37e659c700 1 -- 172.21.15.79:0/1102259167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000b980 con 0x7f37e815a620 2023-10-14T18:56:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37e659c700 1 -- 172.21.15.79:0/1102259167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000bd20 con 0x7f37e815a620 2023-10-14T18:56:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 -- 172.21.15.79:0/1102259167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815a620 msgr2=0x7f37e815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 --2- 172.21.15.79:0/1102259167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815a620 0x7f37e815d040 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f37e8069d80 tx=0x7f37d0009250 comp rx=0 tx=0).stop 2023-10-14T18:56:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 -- 172.21.15.79:0/1102259167 shutdown_connections 2023-10-14T18:56:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 --2- 172.21.15.79:0/1102259167 >> v2:172.21.15.144:3300/0 conn(0x7f37e8157870 0x7f37e815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 --2- 172.21.15.79:0/1102259167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815a620 0x7f37e815d040 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 -- 172.21.15.79:0/1102259167 >> 172.21.15.79:0/1102259167 conn(0x7f37e8068ce0 msgr2=0x7f37e80690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 -- 172.21.15.79:0/1102259167 shutdown_connections 2023-10-14T18:56:49.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.120+0000 7f37ed167700 1 -- 172.21.15.79:0/1102259167 wait complete. 2023-10-14T18:56:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.121+0000 7f37ed167700 1 Processor -- start 2023-10-14T18:56:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.121+0000 7f37ed167700 1 -- start start 2023-10-14T18:56:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37e8157870 0x7f37e80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 0x7f37e80cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80cf7f0 con 0x7f37e815d580 2023-10-14T18:56:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e814e690 con 0x7f37e815a620 2023-10-14T18:56:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37ed167700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e80cfa90 con 0x7f37e8157870 2023-10-14T18:56:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37e759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37e759e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53868/0 (socket says 172.21.15.79:53868) 2023-10-14T18:56:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37e759e700 1 -- 172.21.15.79:0/3151240524 learned_addr learned my addr 172.21.15.79:0/3151240524 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.122+0000 7f37de59c700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 0x7f37e80cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 -- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37e8157870 msgr2=0x7f37e80b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e6d9d700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37e8157870 0x7f37e80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37e8157870 0x7f37e80b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 -- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 msgr2=0x7f37e80cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 0x7f37e80cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 -- 172.21.15.79:0/3151240524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00094f0 con 0x7f37e815d580 2023-10-14T18:56:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37de59c700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 0x7f37e80cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37e759e700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f37e000bb60 tx=0x7f37e00097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000c940 con 0x7f37e815d580 2023-10-14T18:56:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e000caa0 con 0x7f37e815d580 2023-10-14T18:56:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000ce60 con 0x7f37e815d580 2023-10-14T18:56:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e80cfd70 con 0x7f37e815d580 2023-10-14T18:56:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.123+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80b0860 con 0x7f37e815d580 2023-10-14T18:56:49.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.124+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e80d0290 con 0x7f37e815d580 2023-10-14T18:56:49.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.124+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37e0014620 con 0x7f37e815d580 2023-10-14T18:56:49.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.124+0000 7f37df7fe700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 0x7f37c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.125+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37e0084570 con 0x7f37e815d580 2023-10-14T18:56:49.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.125+0000 7f37e6d9d700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 0x7f37c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.125+0000 7f37e6d9d700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 0x7f37c80693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f37d8006fd0 tx=0x7f37d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.129+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37e004c5a0 con 0x7f37e815d580 2023-10-14T18:56:49.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.355+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e80b06c0 con 0x7f37e815d580 2023-10-14T18:56:49.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.355+0000 7f37df7fe700 1 -- 172.21.15.79:0/3151240524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f37e80b06c0 con 0x7f37e815d580 2023-10-14T18:56:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:49.357 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":88,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T18:56:04.982217+0000","modified":"2023-10-14T18:56:08.618140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8160},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8160":{"gid":8160,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/958841168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":958841168},{"type":"v1","addr":"172.21.15.144:6837","nonce":958841168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-14T18:56:49.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 msgr2=0x7f37c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 0x7f37c80693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f37d8006fd0 tx=0x7f37d8008040 comp rx=0 tx=0).stop 2023-10-14T18:56:49.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 msgr2=0x7f37e814e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f37e000bb60 tx=0x7f37e00097f0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 shutdown_connections 2023-10-14T18:56:49.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f37c8066f30 0x7f37c80693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f37e815d580 0x7f37e814e150 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37e8157870 0x7f37e80b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 --2- 172.21.15.79:0/3151240524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37e815a620 0x7f37e80cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 >> 172.21.15.79:0/3151240524 conn(0x7f37e8068ce0 msgr2=0x7f37e8159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:49.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 shutdown_connections 2023-10-14T18:56:49.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.357+0000 7f37ed167700 1 -- 172.21.15.79:0/3151240524 wait complete. 2023-10-14T18:56:49.361 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 88 2023-10-14T18:56:49.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:49.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.484+0000 7f43fa2e7700 1 Processor -- start 2023-10-14T18:56:49.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43fa2e7700 1 -- start start 2023-10-14T18:56:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43fa2e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f43f4157870 0x7f43f415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43fa2e7700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f415cbb0 con 0x7f43f4157c40 2023-10-14T18:56:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43fa2e7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f415bfa0 con 0x7f43f415a620 2023-10-14T18:56:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43fa2e7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f415c280 con 0x7f43f4157870 2023-10-14T18:56:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43f3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f43f4157870 0x7f43f415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.485+0000 7f43f8884700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43f4157c40 0x7f43f4158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47912/0 (socket says 172.21.15.79:47912) 2023-10-14T18:56:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f8884700 1 -- 172.21.15.79:0/3736395904 learned_addr learned my addr 172.21.15.79:0/3736395904 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f3fff700 1 -- 172.21.15.79:0/3736395904 >> v1:172.21.15.144:6789/0 conn(0x7f43f415a620 legacy=0x7f43f415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f3fff700 1 -- 172.21.15.79:0/3736395904 >> v1:172.21.15.79:6789/0 conn(0x7f43f4157c40 legacy=0x7f43f4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f2ffd700 1 -- 172.21.15.79:0/3736395904 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253443773 0 0) 0x7f43f415cbb0 con 0x7f43f4157c40 2023-10-14T18:56:49.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f3fff700 1 -- 172.21.15.79:0/3736395904 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f415c560 con 0x7f43f4157870 2023-10-14T18:56:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f3fff700 1 --2- 172.21.15.79:0/3736395904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f415b6a0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f43e40098e0 tx=0x7f43e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faaf5c1e32f1b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f2ffd700 1 -- 172.21.15.79:0/3736395904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4009e80 con 0x7f43f4157870 2023-10-14T18:56:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f2ffd700 1 -- 172.21.15.79:0/3736395904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e400b860 con 0x7f43f4157870 2023-10-14T18:56:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.486+0000 7f43f2ffd700 1 -- 172.21.15.79:0/3736395904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400bbe0 con 0x7f43f4157870 2023-10-14T18:56:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 -- 172.21.15.79:0/3736395904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 msgr2=0x7f43f415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/3736395904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f415b6a0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f43e40098e0 tx=0x7f43e40091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 -- 172.21.15.79:0/3736395904 shutdown_connections 2023-10-14T18:56:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/3736395904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f415b6a0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 -- 172.21.15.79:0/3736395904 >> 172.21.15.79:0/3736395904 conn(0x7f43f4068ce0 msgr2=0x7f43f40690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 -- 172.21.15.79:0/3736395904 shutdown_connections 2023-10-14T18:56:49.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.487+0000 7f43fa2e7700 1 -- 172.21.15.79:0/3736395904 wait complete. 2023-10-14T18:56:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.488+0000 7f43fa2e7700 1 Processor -- start 2023-10-14T18:56:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.488+0000 7f43fa2e7700 1 -- start start 2023-10-14T18:56:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4157c40 0x7f43f4152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43f415a620 0x7f43f4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4150f10 con 0x7f43f4157870 2023-10-14T18:56:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4153670 con 0x7f43f4157c40 2023-10-14T18:56:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4153950 con 0x7f43f415a620 2023-10-14T18:56:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53894/0 (socket says 172.21.15.79:53894) 2023-10-14T18:56:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 -- 172.21.15.79:0/1700345398 learned_addr learned my addr 172.21.15.79:0/1700345398 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f8884700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43f415a620 0x7f43f4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f37fe700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4157c40 0x7f43f4152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 -- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43f415a620 msgr2=0x7f43f4153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43f415a620 0x7f43f4153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 -- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4157c40 msgr2=0x7f43f4152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4157c40 0x7f43f4152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 -- 172.21.15.79:0/1700345398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4009420 con 0x7f43f4157870 2023-10-14T18:56:49.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43f3fff700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f43f406b530 tx=0x7f43e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4011420 con 0x7f43f4157870 2023-10-14T18:56:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4011580 con 0x7f43f4157870 2023-10-14T18:56:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4011940 con 0x7f43f4157870 2023-10-14T18:56:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f4153c30 con 0x7f43f4157870 2023-10-14T18:56:49.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.489+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f41541f0 con 0x7f43f4157870 2023-10-14T18:56:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.490+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f40d1760 con 0x7f43f4157870 2023-10-14T18:56:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.491+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43e4011cb0 con 0x7f43f4157870 2023-10-14T18:56:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.491+0000 7f43dbfff700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.491+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43e4085c60 con 0x7f43f4157870 2023-10-14T18:56:49.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.491+0000 7f43f37fe700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.492+0000 7f43f37fe700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 0x7f43e00693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f43f4143e30 tx=0x7f43e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.495+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43e4052f10 con 0x7f43f4157870 2023-10-14T18:56:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.680+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43f41543e0 con 0x7f43f4157870 2023-10-14T18:56:49.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.681+0000 7f43dbfff700 1 -- 172.21.15.79:0/1700345398 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f43e4015090 con 0x7f43f4157870 2023-10-14T18:56:49.682 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:49.682 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":189,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:42.596000+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-14T18:56:02.900407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-14T18:56:03.944358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 msgr2=0x7f43e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 0x7f43e00693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f43f4143e30 tx=0x7f43e8009040 comp rx=0 tx=0).stop 2023-10-14T18:56:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 msgr2=0x7f43f413d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f43f406b530 tx=0x7f43e4017000 comp rx=0 tx=0).stop 2023-10-14T18:56:49.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 shutdown_connections 2023-10-14T18:56:49.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f43e0066f30 0x7f43e00693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f43f415a620 0x7f43f4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43f4157870 0x7f43f413d0d0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 --2- 172.21.15.79:0/1700345398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4157c40 0x7f43f4152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 >> 172.21.15.79:0/1700345398 conn(0x7f43f4068ce0 msgr2=0x7f43f40d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:49.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 shutdown_connections 2023-10-14T18:56:49.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.683+0000 7f43fa2e7700 1 -- 172.21.15.79:0/1700345398 wait complete. 2023-10-14T18:56:49.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T18:56:49.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.811+0000 7f186619a700 1 Processor -- start 2023-10-14T18:56:49.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.811+0000 7f186619a700 1 -- start start 2023-10-14T18:56:49.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f186619a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f186015a620 0x7f186015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f186619a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f186015d580 0x7f1860158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f186619a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186015cbb0 con 0x7f1860157870 2023-10-14T18:56:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f186619a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186015bdb0 con 0x7f186015d580 2023-10-14T18:56:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f186619a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186015bfa0 con 0x7f186015a620 2023-10-14T18:56:49.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f186015d580 0x7f1860158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1860157870 0x7f186015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47916/0 (socket says 172.21.15.79:47916) 2023-10-14T18:56:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185f7fe700 1 -- 172.21.15.79:0/1949104192 learned_addr learned my addr 172.21.15.79:0/1949104192 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:49.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 -- 172.21.15.79:0/1949104192 >> v2:172.21.15.144:3300/0 conn(0x7f186015a620 msgr2=0x7f186015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 --2- 172.21.15.79:0/1949104192 >> v2:172.21.15.144:3300/0 conn(0x7f186015a620 0x7f186015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 -- 172.21.15.79:0/1949104192 >> v1:172.21.15.79:6789/0 conn(0x7f1860157870 legacy=0x7f186015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 -- 172.21.15.79:0/1949104192 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186015c280 con 0x7f186015d580 2023-10-14T18:56:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185e7fc700 1 -- 172.21.15.79:0/1949104192 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451927334 0 0) 0x7f186015cbb0 con 0x7f1860157870 2023-10-14T18:56:49.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.812+0000 7f185ffff700 1 --2- 172.21.15.79:0/1949104192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015d580 0x7f1860158110 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f186015cb20 tx=0x7f18580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8886fe5c0b30f22e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f185e7fc700 1 -- 172.21.15.79:0/1949104192 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800b6b0 con 0x7f186015d580 2023-10-14T18:56:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f185e7fc700 1 -- 172.21.15.79:0/1949104192 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800b810 con 0x7f186015d580 2023-10-14T18:56:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f185e7fc700 1 -- 172.21.15.79:0/1949104192 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800bbb0 con 0x7f186015d580 2023-10-14T18:56:49.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 -- 172.21.15.79:0/1949104192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015d580 msgr2=0x7f1860158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 --2- 172.21.15.79:0/1949104192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015d580 0x7f1860158110 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f186015cb20 tx=0x7f18580091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 -- 172.21.15.79:0/1949104192 shutdown_connections 2023-10-14T18:56:49.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 --2- 172.21.15.79:0/1949104192 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015d580 0x7f1860158110 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 --2- 172.21.15.79:0/1949104192 >> v2:172.21.15.144:3300/0 conn(0x7f186015a620 0x7f186015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 -- 172.21.15.79:0/1949104192 >> 172.21.15.79:0/1949104192 conn(0x7f1860068ce0 msgr2=0x7f18600690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:49.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 -- 172.21.15.79:0/1949104192 shutdown_connections 2023-10-14T18:56:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.813+0000 7f186619a700 1 -- 172.21.15.79:0/1949104192 wait complete. 2023-10-14T18:56:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.814+0000 7f186619a700 1 Processor -- start 2023-10-14T18:56:49.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.814+0000 7f186619a700 1 -- start start 2023-10-14T18:56:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860157870 0x7f186016e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f186015d580 0x7f18600d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186016ebd0 con 0x7f186015a620 2023-10-14T18:56:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860158100 con 0x7f1860157870 2023-10-14T18:56:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f186619a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18601583e0 con 0x7f186015d580 2023-10-14T18:56:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53920/0 (socket says 172.21.15.79:53920) 2023-10-14T18:56:49.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 -- 172.21.15.79:0/1500259242 learned_addr learned my addr 172.21.15.79:0/1500259242 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185f7fe700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860157870 0x7f186016e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185ffff700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f186015d580 0x7f18600d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 -- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f186015d580 msgr2=0x7f18600d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f186015d580 0x7f18600d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 -- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860157870 msgr2=0x7f186016e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860157870 0x7f186016e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.815+0000 7f185effd700 1 -- 172.21.15.79:0/1500259242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009420 con 0x7f186015a620 2023-10-14T18:56:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f185effd700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f185400b810 tx=0x7f1854009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400f510 con 0x7f186015a620 2023-10-14T18:56:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400f670 con 0x7f186015a620 2023-10-14T18:56:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18601586c0 con 0x7f186015a620 2023-10-14T18:56:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400fa30 con 0x7f186015a620 2023-10-14T18:56:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.816+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860158c80 con 0x7f186015a620 2023-10-14T18:56:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.817+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18600b1ba0 con 0x7f186015a620 2023-10-14T18:56:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.817+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f185401a400 con 0x7f186015a620 2023-10-14T18:56:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.818+0000 7f18477fe700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:49.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.818+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1854083fa0 con 0x7f186015a620 2023-10-14T18:56:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.818+0000 7f185f7fe700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:49.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.818+0000 7f185f7fe700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 0x7f184c0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1850002250 tx=0x7f1850001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:49.822+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18600b1ba0 con 0x7f186015a620 2023-10-14T18:56:50.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.046+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f18600b1ba0 con 0x7f186015a620 2023-10-14T18:56:50.047 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-14T18:56:50.047+0000 7fb5dbf6f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T18:56:50.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.051+0000 7f18477fe700 1 -- 172.21.15.79:0/1500259242 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f18600b1ba0 con 0x7f186015a620 2023-10-14T18:56:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 msgr2=0x7f184c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 0x7f184c0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1850002250 tx=0x7f1850001a20 comp rx=0 tx=0).stop 2023-10-14T18:56:50.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 msgr2=0x7f186014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f185400b810 tx=0x7f1854009220 comp rx=0 tx=0).stop 2023-10-14T18:56:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 shutdown_connections 2023-10-14T18:56:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f184c066f30 0x7f184c0693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f186015d580 0x7f18600d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860157870 0x7f186016e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 --2- 172.21.15.79:0/1500259242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186015a620 0x7f186014bb70 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 >> 172.21.15.79:0/1500259242 conn(0x7f1860068ce0 msgr2=0x7f18600b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 shutdown_connections 2023-10-14T18:56:50.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.053+0000 7f186619a700 1 -- 172.21.15.79:0/1500259242 wait complete. 2023-10-14T18:56:50.057 INFO:tasks.ceph.mds.d.smithi144.stderr: -7875> 2023-10-14T18:56:10.445+0000 7f986dd08700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T18:56:50.057 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T18:56:50.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T18:56:50.085 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-10-14T18:56:50.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.182+0000 7fdcc25e6700 1 Processor -- start 2023-10-14T18:56:50.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.182+0000 7fdcc25e6700 1 -- start start 2023-10-14T18:56:50.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc25e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc25e6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc25e6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc0b0790 con 0x7fdcbc159ec0 2023-10-14T18:56:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc25e6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc06af60 con 0x7fdcbc06aae0 2023-10-14T18:56:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc25e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0ce1f0 con 0x7fdcbc15a290 2023-10-14T18:56:50.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcbb7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.183+0000 7fdcc0b83700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcc0b83700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:58326/0 (socket says 172.21.15.79:58326) 2023-10-14T18:56:50.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:50756/0 (socket says 172.21.15.79:50756) 2023-10-14T18:56:50.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcc0b83700 1 -- 172.21.15.79:0/4185828481 learned_addr learned my addr 172.21.15.79:0/4185828481 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:50.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbbfff700 1 --1- 172.21.15.79:0/4185828481 >> v1:172.21.15.144:6789/0 conn(0x7fdcbc159ec0 0x7fdcbc0af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:34698/0 (socket says 172.21.15.79:34698) 2023-10-14T18:56:50.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 -- 172.21.15.79:0/4185828481 >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 msgr2=0x7fdcbc0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 --2- 172.21.15.79:0/4185828481 >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 -- 172.21.15.79:0/4185828481 >> v1:172.21.15.144:6789/0 conn(0x7fdcbc159ec0 legacy=0x7fdcbc0af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbaffd700 1 -- 172.21.15.79:0/4185828481 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933286325 0 0) 0x7fdcbc0b0790 con 0x7fdcbc159ec0 2023-10-14T18:56:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 -- 172.21.15.79:0/4185828481 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0b0b20 con 0x7fdcbc15a290 2023-10-14T18:56:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcc0b83700 1 --2- 172.21.15.79:0/4185828481 >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbb7fe700 1 --2- 172.21.15.79:0/4185828481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00098e0 tx=0x7fdcb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1e47850b5b603 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbaffd700 1 -- 172.21.15.79:0/4185828481 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000b640 con 0x7fdcbc15a290 2023-10-14T18:56:50.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbaffd700 1 -- 172.21.15.79:0/4185828481 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000b7a0 con 0x7fdcbc15a290 2023-10-14T18:56:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.184+0000 7fdcbaffd700 1 -- 172.21.15.79:0/4185828481 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000bb40 con 0x7fdcbc15a290 2023-10-14T18:56:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 -- 172.21.15.79:0/4185828481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 msgr2=0x7fdcbc06a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/4185828481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00098e0 tx=0x7fdcb00091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 -- 172.21.15.79:0/4185828481 shutdown_connections 2023-10-14T18:56:50.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/4185828481 >> v2:172.21.15.144:3300/0 conn(0x7fdcbc06aae0 0x7fdcbc0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/4185828481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc15a290 0x7fdcbc06a5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 -- 172.21.15.79:0/4185828481 >> 172.21.15.79:0/4185828481 conn(0x7fdcbc0d1880 msgr2=0x7fdcbc0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:50.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 -- 172.21.15.79:0/4185828481 shutdown_connections 2023-10-14T18:56:50.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.185+0000 7fdcc25e6700 1 -- 172.21.15.79:0/4185828481 wait complete. 2023-10-14T18:56:50.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.186+0000 7fdcc25e6700 1 Processor -- start 2023-10-14T18:56:50.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.186+0000 7fdcc25e6700 1 -- start start 2023-10-14T18:56:50.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 0x7fdcbc0c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc159ec0 0x7fdcbc0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0c97d0 con 0x7fdcbc15a290 2023-10-14T18:56:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0b3c80 con 0x7fdcbc159ec0 2023-10-14T18:56:50.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc25e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc0b6a70 con 0x7fdcbc06aae0 2023-10-14T18:56:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcbbfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 0x7fdcbc0c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53928/0 (socket says 172.21.15.79:53928) 2023-10-14T18:56:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 -- 172.21.15.79:0/2088379989 learned_addr learned my addr 172.21.15.79:0/2088379989 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:50.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcbb7fe700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc159ec0 0x7fdcbc0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 -- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 msgr2=0x7fdcbc0c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 0x7fdcbc0c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 -- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc159ec0 msgr2=0x7fdcbc0b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc159ec0 0x7fdcbc0b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:50.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 -- 172.21.15.79:0/2088379989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009ae0 con 0x7fdcbc15a290 2023-10-14T18:56:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcbbfff700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 0x7fdcbc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:56:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdcc0b83700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c0c0 tx=0x7fdcb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.187+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4018070 con 0x7fdcbc15a290 2023-10-14T18:56:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.188+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400f040 con 0x7fdcbc15a290 2023-10-14T18:56:50.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.188+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb0009420 con 0x7fdcbc15a290 2023-10-14T18:56:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.188+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400cc00 con 0x7fdcbc15a290 2023-10-14T18:56:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.188+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc0c9210 con 0x7fdcbc15a290 2023-10-14T18:56:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.188+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc0b3e10 con 0x7fdcbc15a290 2023-10-14T18:56:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.189+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcb4003020 con 0x7fdcbc15a290 2023-10-14T18:56:50.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.189+0000 7fdca3fff700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.189+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdcb40849b0 con 0x7fdcbc15a290 2023-10-14T18:56:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.189+0000 7fdcbbfff700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.190+0000 7fdcbbfff700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 0x7fdca80693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdcac007fd0 tx=0x7fdcac007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:50.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.193+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcb4051bd0 con 0x7fdcbc15a290 2023-10-14T18:56:50.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:50.416+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdcbc04c3c0 con 0x7fdcbc15a290 2023-10-14T18:56:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.056+0000 7fdca3fff700 1 -- 172.21.15.79:0/2088379989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdcb40551f0 con 0x7fdcbc15a290 2023-10-14T18:56:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 msgr2=0x7fdca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 0x7fdca80693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdcac007fd0 tx=0x7fdcac007d50 comp rx=0 tx=0).stop 2023-10-14T18:56:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 msgr2=0x7fdcbc0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:51.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c0c0 tx=0x7fdcb400b040 comp rx=0 tx=0).stop 2023-10-14T18:56:51.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 shutdown_connections 2023-10-14T18:56:51.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdcbc15a290 0x7fdcbc0c9ef0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdcbc06aae0 0x7fdcbc0c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 --2- 172.21.15.79:0/2088379989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc159ec0 0x7fdcbc0b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 >> 172.21.15.79:0/2088379989 conn(0x7fdcbc0d1880 msgr2=0x7fdcbc0cfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:51.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 shutdown_connections 2023-10-14T18:56:51.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.058+0000 7fdcc25e6700 1 -- 172.21.15.79:0/2088379989 wait complete. 2023-10-14T18:56:51.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T18:56:51.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.191+0000 7f7f05cb6700 1 Processor -- start 2023-10-14T18:56:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.191+0000 7f7f05cb6700 1 -- start start 2023-10-14T18:56:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7f05cb6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f00156210 0x7f7f0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7f05cb6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f000af8f0 0x7f7f0006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7f05cb6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000c6f20 con 0x7f7f001565e0 2023-10-14T18:56:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7f05cb6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f000c7200 con 0x7f7f000af8f0 2023-10-14T18:56:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7f05cb6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f000c74e0 con 0x7f7f00156210 2023-10-14T18:56:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7efeffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f000af8f0 0x7f7f0006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7efeffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f000af8f0 0x7f7f0006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53942/0 (socket says 172.21.15.79:53942) 2023-10-14T18:56:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.192+0000 7f7efeffd700 1 -- 172.21.15.79:0/3675935796 learned_addr learned my addr 172.21.15.79:0/3675935796 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7eff7fe700 1 --2- 172.21.15.79:0/3675935796 >> v2:172.21.15.144:3300/0 conn(0x7f7f00156210 0x7f7f0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efeffd700 1 -- 172.21.15.79:0/3675935796 >> v2:172.21.15.144:3300/0 conn(0x7f7f00156210 msgr2=0x7f7f0006d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efeffd700 1 --2- 172.21.15.79:0/3675935796 >> v2:172.21.15.144:3300/0 conn(0x7f7f00156210 0x7f7f0006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efeffd700 1 -- 172.21.15.79:0/3675935796 >> v1:172.21.15.144:6789/0 conn(0x7f7f001565e0 legacy=0x7f7f000cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efeffd700 1 -- 172.21.15.79:0/3675935796 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f000c77c0 con 0x7f7f000af8f0 2023-10-14T18:56:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efeffd700 1 --2- 172.21.15.79:0/3675935796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000af8f0 0x7f7f0006d900 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7f0006cfd0 tx=0x7f7ef400b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9844be07311f2c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efe7fc700 1 -- 172.21.15.79:0/3675935796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400dad0 con 0x7f7f000af8f0 2023-10-14T18:56:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efe7fc700 1 -- 172.21.15.79:0/3675935796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef400dc30 con 0x7f7f000af8f0 2023-10-14T18:56:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7efe7fc700 1 -- 172.21.15.79:0/3675935796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4017410 con 0x7f7f000af8f0 2023-10-14T18:56:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 -- 172.21.15.79:0/3675935796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000af8f0 msgr2=0x7f7f0006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/3675935796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000af8f0 0x7f7f0006d900 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f7f0006cfd0 tx=0x7f7ef400b4e0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 -- 172.21.15.79:0/3675935796 shutdown_connections 2023-10-14T18:56:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/3675935796 >> v2:172.21.15.144:3300/0 conn(0x7f7f00156210 0x7f7f0006d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/3675935796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000af8f0 0x7f7f0006d900 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.193+0000 7f7f05cb6700 1 -- 172.21.15.79:0/3675935796 >> 172.21.15.79:0/3675935796 conn(0x7f7f000cd450 msgr2=0x7f7f000c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.194+0000 7f7f05cb6700 1 -- 172.21.15.79:0/3675935796 shutdown_connections 2023-10-14T18:56:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.194+0000 7f7f05cb6700 1 -- 172.21.15.79:0/3675935796 wait complete. 2023-10-14T18:56:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.195+0000 7f7f05cb6700 1 Processor -- start 2023-10-14T18:56:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.195+0000 7f7f05cb6700 1 -- start start 2023-10-14T18:56:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.195+0000 7f7f05cb6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 0x7f7f00149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.195+0000 7f7f05cb6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 0x7f7f000c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00158720 con 0x7f7f001565e0 2023-10-14T18:56:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00157b10 con 0x7f7f000af8f0 2023-10-14T18:56:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00157df0 con 0x7f7f00156210 2023-10-14T18:56:51.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53952/0 (socket says 172.21.15.79:53952) 2023-10-14T18:56:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 -- 172.21.15.79:0/907524987 learned_addr learned my addr 172.21.15.79:0/907524987 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7eff7fe700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 0x7f7f00149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efeffd700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 0x7f7f000c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 -- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 msgr2=0x7f7f000c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 0x7f7f000c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 -- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 msgr2=0x7f7f00149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 0x7f7f00149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 -- 172.21.15.79:0/907524987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef400b780 con 0x7f7f001565e0 2023-10-14T18:56:51.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7eff7fe700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 0x7f7f00149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efeffd700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 0x7f7f000c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7efffff700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009fd0 tx=0x7f7ef8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800f510 con 0x7f7f001565e0 2023-10-14T18:56:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef800f670 con 0x7f7f001565e0 2023-10-14T18:56:51.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f001580d0 con 0x7f7f001565e0 2023-10-14T18:56:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef800fa30 con 0x7f7f001565e0 2023-10-14T18:56:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.196+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f001498b0 con 0x7f7f001565e0 2023-10-14T18:56:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.197+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0004c3c0 con 0x7f7f001565e0 2023-10-14T18:56:51.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.198+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ef801a400 con 0x7f7f001565e0 2023-10-14T18:56:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.198+0000 7f7ee77fe700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.198+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7ef8083f70 con 0x7f7f001565e0 2023-10-14T18:56:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.198+0000 7f7eff7fe700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.199+0000 7f7eff7fe700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7f000b1fc0 tx=0x7f7ef0007600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:51.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.202+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ef8051210 con 0x7f7f001565e0 2023-10-14T18:56:51.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:51.385+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f00158860 con 0x7f7f001565e0 2023-10-14T18:56:52.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.061+0000 7f7ee77fe700 1 -- 172.21.15.79:0/907524987 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v191) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7ef8058e60 con 0x7f7f001565e0 2023-10-14T18:56:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 msgr2=0x7f7eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7f000b1fc0 tx=0x7f7ef0007600 comp rx=0 tx=0).stop 2023-10-14T18:56:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 msgr2=0x7f7f000c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009fd0 tx=0x7f7ef8009060 comp rx=0 tx=0).stop 2023-10-14T18:56:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 shutdown_connections 2023-10-14T18:56:52.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f001565e0 0x7f7f000c61c0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f000af8f0 0x7f7f00149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 --2- 172.21.15.79:0/907524987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f00156210 0x7f7f000c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 >> 172.21.15.79:0/907524987 conn(0x7f7f000cd450 msgr2=0x7f7f0006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 shutdown_connections 2023-10-14T18:56:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.064+0000 7f7f05cb6700 1 -- 172.21.15.79:0/907524987 wait complete. 2023-10-14T18:56:52.068 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-14T18:56:52.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T18:56:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.197+0000 7effb9bec700 1 Processor -- start 2023-10-14T18:56:52.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.197+0000 7effb9bec700 1 -- start start 2023-10-14T18:56:52.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb9bec700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effb415d240 0x7effb40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb9bec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40cd4f0 con 0x7effb40cc940 2023-10-14T18:56:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb9bec700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40b3f40 con 0x7effb40ce810 2023-10-14T18:56:52.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb9bec700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40cbb80 con 0x7effb415d240 2023-10-14T18:56:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7effb40cc940 0x7effb40ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47924/0 (socket says 172.21.15.79:47924) 2023-10-14T18:56:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb3fff700 1 -- 172.21.15.79:0/4133436795 learned_addr learned my addr 172.21.15.79:0/4133436795 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb8bea700 1 --2- 172.21.15.79:0/4133436795 >> v2:172.21.15.144:3300/0 conn(0x7effb415d240 0x7effb40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223221264 0 0) 0x7effb40cd4f0 con 0x7effb40cc940 2023-10-14T18:56:52.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.198+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa0003570 con 0x7effb40cc940 2023-10-14T18:56:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2666150839 0 0) 0x7effa0003570 con 0x7effb40cc940 2023-10-14T18:56:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 >> v2:172.21.15.144:3300/0 conn(0x7effb415d240 msgr2=0x7effb40b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 --2- 172.21.15.79:0/4133436795 >> v2:172.21.15.144:3300/0 conn(0x7effb415d240 0x7effb40b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 >> v1:172.21.15.144:6789/0 conn(0x7effb40ce810 legacy=0x7effb40cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40cbe60 con 0x7effb40cc940 2023-10-14T18:56:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7effa4001470 con 0x7effb40cc940 2023-10-14T18:56:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 >> v1:172.21.15.79:6789/0 conn(0x7effb40cc940 legacy=0x7effb40ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa0003a60 0x7effa0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effa00051c0 0x7effa000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40cbb80 con 0x7effa0004810 2023-10-14T18:56:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa000c160 con 0x7effa0003a60 2023-10-14T18:56:52.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa000c320 con 0x7effa00051c0 2023-10-14T18:56:52.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb8bea700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa0003a60 0x7effa0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb93eb700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effa00051c0 0x7effa000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 -- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effa00051c0 msgr2=0x7effa000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effa00051c0 0x7effa000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 -- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa0003a60 msgr2=0x7effa0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa0003a60 0x7effa0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 -- 172.21.15.79:0/4133436795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0003570 con 0x7effa0004810 2023-10-14T18:56:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb93eb700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effa00051c0 0x7effa000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb93eb700 1 -- 172.21.15.79:0/4133436795 reap_dead start 2023-10-14T18:56:52.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb3fff700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effa0004c80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7effa400c3c0 tx=0x7effa4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36e348622be7590 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400cc90 con 0x7effa0004810 2023-10-14T18:56:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400cdf0 con 0x7effa0004810 2023-10-14T18:56:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.199+0000 7effb37fe700 1 -- 172.21.15.79:0/4133436795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4005b50 con 0x7effa0004810 2023-10-14T18:56:52.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 -- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 msgr2=0x7effa0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effa0004c80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7effa400c3c0 tx=0x7effa4001e50 comp rx=0 tx=0).stop 2023-10-14T18:56:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 -- 172.21.15.79:0/4133436795 shutdown_connections 2023-10-14T18:56:52.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 --2- 172.21.15.79:0/4133436795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effa0004c80 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 -- 172.21.15.79:0/4133436795 >> 172.21.15.79:0/4133436795 conn(0x7effb4067e40 msgr2=0x7effb40d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 -- 172.21.15.79:0/4133436795 shutdown_connections 2023-10-14T18:56:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.200+0000 7effb9bec700 1 -- 172.21.15.79:0/4133436795 wait complete. 2023-10-14T18:56:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.201+0000 7effb9bec700 1 Processor -- start 2023-10-14T18:56:52.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.201+0000 7effb9bec700 1 -- start start 2023-10-14T18:56:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb416b260 0x7effb40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effb40c5f20 0x7effb416db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb416eb40 con 0x7effa0004810 2023-10-14T18:56:52.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c63a0 con 0x7effb416b260 2023-10-14T18:56:52.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb9bec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb416a530 con 0x7effb40c5f20 2023-10-14T18:56:52.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53976/0 (socket says 172.21.15.79:53976) 2023-10-14T18:56:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 -- 172.21.15.79:0/2606911856 learned_addr learned my addr 172.21.15.79:0/2606911856 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb93eb700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effb40c5f20 0x7effb416db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb3fff700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb416b260 0x7effb40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 -- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effb40c5f20 msgr2=0x7effb416db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effb40c5f20 0x7effb416db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 -- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb416b260 msgr2=0x7effb40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb416b260 0x7effb40c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 -- 172.21.15.79:0/2606911856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb416add0 con 0x7effa0004810 2023-10-14T18:56:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.202+0000 7effb8bea700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7effac0115b0 tx=0x7effac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.203+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00e030 con 0x7effa0004810 2023-10-14T18:56:52.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.203+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac016470 con 0x7effa0004810 2023-10-14T18:56:52.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.203+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb416e860 con 0x7effa0004810 2023-10-14T18:56:52.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.203+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac016810 con 0x7effa0004810 2023-10-14T18:56:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.203+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb416aa60 con 0x7effa0004810 2023-10-14T18:56:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.204+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb406ac60 con 0x7effa0004810 2023-10-14T18:56:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.204+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effac016c00 con 0x7effa0004810 2023-10-14T18:56:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.204+0000 7effb0ff9700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 0x7eff94069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.204+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5353+0+0 (secure 0 0 0) 0x7effac00f070 con 0x7effa0004810 2023-10-14T18:56:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.205+0000 7effb3fff700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 0x7eff94069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.205+0000 7effb3fff700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 0x7eff94069460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7effb40caeb0 tx=0x7effa4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.208+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effac052950 con 0x7effa0004810 2023-10-14T18:56:52.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.394+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7effb40cc140 con 0x7effa0004810 2023-10-14T18:56:52.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.600+0000 7effb0ff9700 1 -- 172.21.15.79:0/2606911856 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v192) v1 ==== 169+0+0 (secure 0 0 0) 0x7effac055f70 con 0x7effa0004810 2023-10-14T18:56:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 msgr2=0x7eff94069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 0x7eff94069460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7effb40caeb0 tx=0x7effa4015000 comp rx=0 tx=0).stop 2023-10-14T18:56:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 msgr2=0x7effb41477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7effac0115b0 tx=0x7effac00b040 comp rx=0 tx=0).stop 2023-10-14T18:56:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 shutdown_connections 2023-10-14T18:56:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff94066fb0 0x7eff94069460 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effb40c5f20 0x7effb416db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effa0004810 0x7effb41477c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 --2- 172.21.15.79:0/2606911856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb416b260 0x7effb40c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 >> 172.21.15.79:0/2606911856 conn(0x7effb4067e40 msgr2=0x7effb4158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 shutdown_connections 2023-10-14T18:56:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.603+0000 7effb9bec700 1 -- 172.21.15.79:0/2606911856 wait complete. 2023-10-14T18:56:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-14T18:56:52.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T18:56:52.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.734+0000 7fcb98cf2700 1 Processor -- start 2023-10-14T18:56:52.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.734+0000 7fcb98cf2700 1 -- start start 2023-10-14T18:56:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb98cf2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb94164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb98cf2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940b0790 con 0x7fcb94159ec0 2023-10-14T18:56:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb98cf2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940ce1f0 con 0x7fcb9415a290 2023-10-14T18:56:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb98cf2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b0b20 con 0x7fcb940d05a0 2023-10-14T18:56:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb9259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb94159ec0 0x7fcb940af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47934/0 (socket says 172.21.15.79:47934) 2023-10-14T18:56:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb9259c700 1 -- 172.21.15.79:0/2754378567 learned_addr learned my addr 172.21.15.79:0/2754378567 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb92d9d700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb94164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407594572 0 0) 0x7fcb940b0790 con 0x7fcb94159ec0 2023-10-14T18:56:52.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.735+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c003570 con 0x7fcb94159ec0 2023-10-14T18:56:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2942722172 0 0) 0x7fcb7c003570 con 0x7fcb94159ec0 2023-10-14T18:56:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 msgr2=0x7fcb94164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb94164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 >> v1:172.21.15.144:6789/0 conn(0x7fcb9415a290 legacy=0x7fcb9406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940b04b0 con 0x7fcb94159ec0 2023-10-14T18:56:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fcb840017f0 con 0x7fcb94159ec0 2023-10-14T18:56:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 >> v1:172.21.15.79:6789/0 conn(0x7fcb94159ec0 legacy=0x7fcb940af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c003a90 0x7fcb7c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c004d50 0x7fcb7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b0b20 con 0x7fcb7c003a90 2023-10-14T18:56:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00bb70 con 0x7fcb7c004d50 2023-10-14T18:56:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00bd30 con 0x7fcb940d05a0 2023-10-14T18:56:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c003a90 0x7fcb7c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb92d9d700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c004d50 0x7fcb7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb91d9b700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 -- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 msgr2=0x7fcb7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 -- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c004d50 msgr2=0x7fcb7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c004d50 0x7fcb7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 -- 172.21.15.79:0/2754378567 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c003570 con 0x7fcb7c003a90 2023-10-14T18:56:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb91d9b700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb940d05a0 0x7fcb7c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb92d9d700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c004d50 0x7fcb7c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9259c700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c003a90 0x7fcb7c003ea0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a930 tx=0x7fcb840021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6ce5399d0748d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840070d0 con 0x7fcb7c003a90 2023-10-14T18:56:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84007230 con 0x7fcb7c003a90 2023-10-14T18:56:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.736+0000 7fcb9159a700 1 -- 172.21.15.79:0/2754378567 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840075d0 con 0x7fcb7c003a90 2023-10-14T18:56:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 -- 172.21.15.79:0/2754378567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c003a90 msgr2=0x7fcb7c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/2754378567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c003a90 0x7fcb7c003ea0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a930 tx=0x7fcb840021d0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb92d9d700 1 -- 172.21.15.79:0/2754378567 reap_dead start 2023-10-14T18:56:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 -- 172.21.15.79:0/2754378567 shutdown_connections 2023-10-14T18:56:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 -- 172.21.15.79:0/2754378567 >> 172.21.15.79:0/2754378567 conn(0x7fcb940d1880 msgr2=0x7fcb940cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 -- 172.21.15.79:0/2754378567 shutdown_connections 2023-10-14T18:56:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.737+0000 7fcb98cf2700 1 -- 172.21.15.79:0/2754378567 wait complete. 2023-10-14T18:56:52.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.738+0000 7fcb98cf2700 1 Processor -- start 2023-10-14T18:56:52.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.738+0000 7fcb98cf2700 1 -- start start 2023-10-14T18:56:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb7c003a90 0x7fcb9416b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 0x7fcb940c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94156230 con 0x7fcb9416d530 2023-10-14T18:56:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941567f0 con 0x7fcb9416ab10 2023-10-14T18:56:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb98cf2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9416d9a0 con 0x7fcb7c003a90 2023-10-14T18:56:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53992/0 (socket says 172.21.15.79:53992) 2023-10-14T18:56:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 -- 172.21.15.79:0/640622184 learned_addr learned my addr 172.21.15.79:0/640622184 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb9259c700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb7c003a90 0x7fcb9416b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb92d9d700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 0x7fcb940c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 -- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb7c003a90 msgr2=0x7fcb9416b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb7c003a90 0x7fcb9416b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 -- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 msgr2=0x7fcb940c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 0x7fcb940c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 -- 172.21.15.79:0/640622184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9416b130 con 0x7fcb9416d530 2023-10-14T18:56:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb92d9d700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 0x7fcb940c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.739+0000 7fcb91d9b700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c00 tx=0x7fcb88009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.740+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88010520 con 0x7fcb9416d530 2023-10-14T18:56:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.740+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88010680 con 0x7fcb9416d530 2023-10-14T18:56:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.740+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9416b410 con 0x7fcb9416d530 2023-10-14T18:56:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.740+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88010a20 con 0x7fcb9416d530 2023-10-14T18:56:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.740+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb940caa00 con 0x7fcb9416d530 2023-10-14T18:56:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.741+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9416aee0 con 0x7fcb9416d530 2023-10-14T18:56:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.741+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb88014480 con 0x7fcb9416d530 2023-10-14T18:56:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.741+0000 7fcb827fc700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.741+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcb88083c40 con 0x7fcb9416d530 2023-10-14T18:56:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.742+0000 7fcb9259c700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:52.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.742+0000 7fcb9259c700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 0x7fcb740693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a3f0 tx=0x7fcb84016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:52.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.746+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb8804d5a0 con 0x7fcb9416d530 2023-10-14T18:56:52.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.931+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcb94156960 con 0x7fcb9416d530 2023-10-14T18:56:52.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.937+0000 7fcb827fc700 1 -- 172.21.15.79:0/640622184 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb880190a0 con 0x7fcb9416d530 2023-10-14T18:56:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 msgr2=0x7fcb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 0x7fcb740693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400a3f0 tx=0x7fcb84016000 comp rx=0 tx=0).stop 2023-10-14T18:56:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 msgr2=0x7fcb9416a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fcb88000c00 tx=0x7fcb88009040 comp rx=0 tx=0).stop 2023-10-14T18:56:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 shutdown_connections 2023-10-14T18:56:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb9416ab10 0x7fcb940c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb7c003a90 0x7fcb9416b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 --2- 172.21.15.79:0/640622184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb9416d530 0x7fcb9416a5d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 >> 172.21.15.79:0/640622184 conn(0x7fcb940d1880 msgr2=0x7fcb940af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:52.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 shutdown_connections 2023-10-14T18:56:52.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:52.940+0000 7fcb98cf2700 1 -- 172.21.15.79:0/640622184 wait complete. 2023-10-14T18:56:52.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-14T18:56:53.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.067+0000 7f5a393f5700 1 Processor -- start 2023-10-14T18:56:53.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.067+0000 7f5a393f5700 1 -- start start 2023-10-14T18:56:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a393f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a340b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a393f5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340ae760 con 0x7f5a341572a0 2023-10-14T18:56:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a393f5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340aea40 con 0x7f5a340a7a20 2023-10-14T18:56:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a393f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340aed20 con 0x7f5a340a7df0 2023-10-14T18:56:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a337fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5a341572a0 0x7f5a34157740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47950/0 (socket says 172.21.15.79:47950) 2023-10-14T18:56:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a337fe700 1 -- 172.21.15.79:0/1560757363 learned_addr learned my addr 172.21.15.79:0/1560757363 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a327fc700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a340b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507766059 0 0) 0x7f5a340ae760 con 0x7f5a341572a0 2023-10-14T18:56:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c003570 con 0x7f5a341572a0 2023-10-14T18:56:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882565653 0 0) 0x7f5a340aea40 con 0x7f5a340a7a20 2023-10-14T18:56:53.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a340ae760 con 0x7f5a340a7a20 2023-10-14T18:56:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902219268 0 0) 0x7f5a1c003570 con 0x7f5a341572a0 2023-10-14T18:56:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 msgr2=0x7f5a340b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a340b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:53.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 >> v1:172.21.15.144:6789/0 conn(0x7f5a340a7a20 legacy=0x7f5a340af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340af000 con 0x7f5a341572a0 2023-10-14T18:56:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f5a2c0017f0 con 0x7f5a341572a0 2023-10-14T18:56:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 >> v1:172.21.15.79:6789/0 conn(0x7f5a341572a0 legacy=0x7f5a34157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a1c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.068+0000 7f5a31ffb700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a1c004180 0x7f5a1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1c004d50 0x7f5a1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340aed20 con 0x7f5a1c004d50 2023-10-14T18:56:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c00bba0 con 0x7f5a1c004180 2023-10-14T18:56:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c00bd60 con 0x7f5a340a7df0 2023-10-14T18:56:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1c004d50 0x7f5a1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a327fc700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a1c004180 0x7f5a1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a32ffd700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a1c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 -- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 msgr2=0x7f5a1c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a340a7df0 0x7f5a1c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 -- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a1c004180 msgr2=0x7f5a1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a1c004180 0x7f5a1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 -- 172.21.15.79:0/1560757363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c003570 con 0x7f5a1c004d50 2023-10-14T18:56:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a327fc700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a1c004180 0x7f5a1c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1c004d50 0x7f5a1c0051c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00a8f0 tx=0x7f5a2c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08cc0e68f68786a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0070d0 con 0x7f5a1c004d50 2023-10-14T18:56:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c007230 con 0x7f5a1c004d50 2023-10-14T18:56:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.069+0000 7f5a31ffb700 1 -- 172.21.15.79:0/1560757363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0075f0 con 0x7f5a1c004d50 2023-10-14T18:56:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 -- 172.21.15.79:0/1560757363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1c004d50 msgr2=0x7f5a1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1560757363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a1c004d50 0x7f5a1c0051c0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00a8f0 tx=0x7f5a2c002190 comp rx=0 tx=0).stop 2023-10-14T18:56:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a337fe700 1 -- 172.21.15.79:0/1560757363 reap_dead start 2023-10-14T18:56:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 -- 172.21.15.79:0/1560757363 shutdown_connections 2023-10-14T18:56:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 -- 172.21.15.79:0/1560757363 >> 172.21.15.79:0/1560757363 conn(0x7f5a340cd1e0 msgr2=0x7f5a340cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:53.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 -- 172.21.15.79:0/1560757363 shutdown_connections 2023-10-14T18:56:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.070+0000 7f5a393f5700 1 -- 172.21.15.79:0/1560757363 wait complete. 2023-10-14T18:56:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.071+0000 7f5a393f5700 1 Processor -- start 2023-10-14T18:56:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.071+0000 7f5a393f5700 1 -- start start 2023-10-14T18:56:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 0x7f5a34098410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a34098950 0x7f5a3406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3406f430 con 0x7f5a3406efb0 2023-10-14T18:56:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34098e60 con 0x7f5a34150860 2023-10-14T18:56:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34099140 con 0x7f5a34098950 2023-10-14T18:56:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54012/0 (socket says 172.21.15.79:54012) 2023-10-14T18:56:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 -- 172.21.15.79:0/1345773859 learned_addr learned my addr 172.21.15.79:0/1345773859 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a32ffd700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 0x7f5a34098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a327fc700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a34098950 0x7f5a3406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 -- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a34098950 msgr2=0x7f5a3406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a34098950 0x7f5a3406ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 -- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 msgr2=0x7f5a34098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 0x7f5a34098410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 -- 172.21.15.79:0/1345773859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34099420 con 0x7f5a3406efb0 2023-10-14T18:56:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a32ffd700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 0x7f5a34098410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a337fe700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c007760 tx=0x7f5a2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0079a0 con 0x7f5a3406efb0 2023-10-14T18:56:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c021070 con 0x7f5a3406efb0 2023-10-14T18:56:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a34099700 con 0x7f5a3406efb0 2023-10-14T18:56:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c026680 con 0x7f5a3406efb0 2023-10-14T18:56:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.072+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a34150c30 con 0x7f5a3406efb0 2023-10-14T18:56:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.073+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a340998c0 con 0x7f5a3406efb0 2023-10-14T18:56:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.074+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a2c023030 con 0x7f5a3406efb0 2023-10-14T18:56:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.074+0000 7f5a1affd700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 0x7f5a200693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.074+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5a2c0864b0 con 0x7f5a3406efb0 2023-10-14T18:56:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.074+0000 7f5a32ffd700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 0x7f5a200693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:53.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.075+0000 7f5a32ffd700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 0x7f5a200693d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007a80 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:53.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.078+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a2c053a20 con 0x7f5a3406efb0 2023-10-14T18:56:53.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:53.339+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f5a3404c3c0 con 0x7f5a3406efb0 2023-10-14T18:56:54.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.066+0000 7f5a1affd700 1 -- 172.21.15.79:0/1345773859 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v554) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5a2c007b20 con 0x7f5a3406efb0 2023-10-14T18:56:54.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 msgr2=0x7f5a200693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 0x7f5a200693d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5a24007a80 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-10-14T18:56:54.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 msgr2=0x7f5a34152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c007760 tx=0x7f5a2c016000 comp rx=0 tx=0).stop 2023-10-14T18:56:54.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 shutdown_connections 2023-10-14T18:56:54.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5a20066f20 0x7f5a200693d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a3406efb0 0x7f5a34152250 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a34150860 0x7f5a34098410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 --2- 172.21.15.79:0/1345773859 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5a34098950 0x7f5a3406ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 >> 172.21.15.79:0/1345773859 conn(0x7f5a340cd1e0 msgr2=0x7f5a341557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:54.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 shutdown_connections 2023-10-14T18:56:54.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.069+0000 7f5a393f5700 1 -- 172.21.15.79:0/1345773859 wait complete. 2023-10-14T18:56:54.082 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-14T18:56:54.083 INFO:tasks.cephfs_test_runner: 2023-10-14T18:56:54.083 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T18:56:54.083 INFO:tasks.cephfs_test_runner:Ran 10 tests in 673.121s 2023-10-14T18:56:54.084 INFO:tasks.cephfs_test_runner: 2023-10-14T18:56:54.084 INFO:tasks.cephfs_test_runner:OK 2023-10-14T18:56:54.084 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T18:56:54.094 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T18:56:54.105 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T18:56:54.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.105 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:56:54.121 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T18:56:54.121 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T18:56:54.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T18:56:54.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T18:56:54.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-14T18:56:54.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.371 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-14T18:56:54.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-14T18:56:54.457 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2023-10-14T18:56:54.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:56:54.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.459 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:56:54.478 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T18:56:54.478 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T18:56:54.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T18:56:54.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T18:56:54.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-14T18:56:54.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.706 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2023-10-14T18:56:54.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T18:56:54.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2023-10-14T18:56:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2023-10-14T18:56:54.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:56:54.793 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T18:56:54.802 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-14T18:56:54.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:54.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.918+0000 7fac1ed57700 1 Processor -- start 2023-10-14T18:56:54.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 -- start start 2023-10-14T18:56:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac180abae0 0x7fac180c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 0x7fac180c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac180c9cb0 con 0x7fac180c8400 2023-10-14T18:56:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac180c90a0 con 0x7fac180abae0 2023-10-14T18:56:54.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1ed57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac180c9380 con 0x7fac180abeb0 2023-10-14T18:56:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.919+0000 7fac1caf3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac180abae0 0x7fac180c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fac180abae0 0x7fac180c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54014/0 (socket says 172.21.15.79:54014) 2023-10-14T18:56:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 -- 172.21.15.79:0/3704381240 learned_addr learned my addr 172.21.15.79:0/3704381240 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac17fff700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 0x7fac180c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 -- 172.21.15.79:0/3704381240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 msgr2=0x7fac180c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 0x7fac180c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 -- 172.21.15.79:0/3704381240 >> v1:172.21.15.144:6789/0 conn(0x7fac180c8400 legacy=0x7fac180c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 -- 172.21.15.79:0/3704381240 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180c9660 con 0x7fac180abae0 2023-10-14T18:56:54.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac17fff700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 0x7fac180c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac1caf3700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abae0 0x7fac180c6eb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fac0000bc50 tx=0x7fac0000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d1084dbbae109e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:54.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac177fe700 1 -- 172.21.15.79:0/3704381240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000be60 con 0x7fac180abae0 2023-10-14T18:56:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac177fe700 1 -- 172.21.15.79:0/3704381240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000de00 con 0x7fac180abae0 2023-10-14T18:56:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.920+0000 7fac177fe700 1 -- 172.21.15.79:0/3704381240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac000196b0 con 0x7fac180abae0 2023-10-14T18:56:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 -- 172.21.15.79:0/3704381240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abae0 msgr2=0x7fac180c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abae0 0x7fac180c6eb0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fac0000bc50 tx=0x7fac0000b4f0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 -- 172.21.15.79:0/3704381240 shutdown_connections 2023-10-14T18:56:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abae0 0x7fac180c6eb0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 --2- 172.21.15.79:0/3704381240 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abeb0 0x7fac180c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 -- 172.21.15.79:0/3704381240 >> 172.21.15.79:0/3704381240 conn(0x7fac18067660 msgr2=0x7fac18067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 -- 172.21.15.79:0/3704381240 shutdown_connections 2023-10-14T18:56:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.921+0000 7fac1ed57700 1 -- 172.21.15.79:0/3704381240 wait complete. 2023-10-14T18:56:54.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.922+0000 7fac1ed57700 1 Processor -- start 2023-10-14T18:56:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.922+0000 7fac1ed57700 1 -- start start 2023-10-14T18:56:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abae0 0x7fac18159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac180c8400 0x7fac180ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18159180 con 0x7fac180abeb0 2023-10-14T18:56:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18158570 con 0x7fac180c8400 2023-10-14T18:56:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1ed57700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac18158850 con 0x7fac180abae0 2023-10-14T18:56:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54024/0 (socket says 172.21.15.79:54024) 2023-10-14T18:56:54.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 -- 172.21.15.79:0/2301626095 learned_addr learned my addr 172.21.15.79:0/2301626095 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1caf3700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abae0 0x7fac18159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac1d2f4700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac180c8400 0x7fac180ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 -- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abae0 msgr2=0x7fac18159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abae0 0x7fac18159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 -- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac180c8400 msgr2=0x7fac180ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac180c8400 0x7fac180ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 -- 172.21.15.79:0/2301626095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0000b790 con 0x7fac180abeb0 2023-10-14T18:56:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.923+0000 7fac17fff700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d1d0 tx=0x7fac08009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800dd10 con 0x7fac180abeb0 2023-10-14T18:56:54.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800f040 con 0x7fac180abeb0 2023-10-14T18:56:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac18158b30 con 0x7fac180abeb0 2023-10-14T18:56:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08015670 con 0x7fac180abeb0 2023-10-14T18:56:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac180b12a0 con 0x7fac180abeb0 2023-10-14T18:56:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.924+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1804c3c0 con 0x7fac180abeb0 2023-10-14T18:56:54.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.925+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac08015a60 con 0x7fac180abeb0 2023-10-14T18:56:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.925+0000 7fac14ff9700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.925+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fac08084590 con 0x7fac180abeb0 2023-10-14T18:56:54.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.926+0000 7fac1caf3700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.926+0000 7fac1caf3700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 0x7fabf80693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fac0000bc50 tx=0x7fac0001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:54.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:54.930+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac0804e5a0 con 0x7fac180abeb0 2023-10-14T18:56:55.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.113+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac1806aeb0 con 0x7fac180abeb0 2023-10-14T18:56:55.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.114+0000 7fac14ff9700 1 -- 172.21.15.79:0/2301626095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+12274 (secure 0 0 0) 0x7fac0801a090 con 0x7fac180abeb0 2023-10-14T18:56:55.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:55.115 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":192,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:52.598237+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/958841168":"2023-10-15T18:56:50.047580+0000","172.21.15.144:6835/958841168":"2023-10-15T18:56:50.047580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 msgr2=0x7fabf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 0x7fabf80693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fac0000bc50 tx=0x7fac0001b000 comp rx=0 tx=0).stop 2023-10-14T18:56:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 msgr2=0x7fac180b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d1d0 tx=0x7fac08009a90 comp rx=0 tx=0).stop 2023-10-14T18:56:55.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 shutdown_connections 2023-10-14T18:56:55.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fabf8066f30 0x7fabf80693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac180c8400 0x7fac180ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fac180abae0 0x7fac18159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 --2- 172.21.15.79:0/2301626095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac180abeb0 0x7fac180b0d60 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 >> 172.21.15.79:0/2301626095 conn(0x7fac18067660 msgr2=0x7fac180adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 shutdown_connections 2023-10-14T18:56:55.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.116+0000 7fac1ed57700 1 -- 172.21.15.79:0/2301626095 wait complete. 2023-10-14T18:56:55.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T18:56:55.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:55.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.243+0000 7f5c2ec76700 1 Processor -- start 2023-10-14T18:56:55.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.243+0000 7f5c2ec76700 1 -- start start 2023-10-14T18:56:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2ec76700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c2815a620 0x7f5c2815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2ec76700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c2815d580 0x7f5c28158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2ec76700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2815cbb0 con 0x7f5c28157870 2023-10-14T18:56:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2ec76700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2815bdb0 con 0x7f5c2815a620 2023-10-14T18:56:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2ec76700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2815bfa0 con 0x7f5c2815d580 2023-10-14T18:56:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c2815a620 0x7f5c2815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c2815a620 0x7f5c2815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54040/0 (socket says 172.21.15.79:54040) 2023-10-14T18:56:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 -- 172.21.15.79:0/2285823701 learned_addr learned my addr 172.21.15.79:0/2285823701 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c2d213700 1 --2- 172.21.15.79:0/2285823701 >> v2:172.21.15.144:3300/0 conn(0x7f5c2815d580 0x7f5c28158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 -- 172.21.15.79:0/2285823701 >> v2:172.21.15.144:3300/0 conn(0x7f5c2815d580 msgr2=0x7f5c28158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 --2- 172.21.15.79:0/2285823701 >> v2:172.21.15.144:3300/0 conn(0x7f5c2815d580 0x7f5c28158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 -- 172.21.15.79:0/2285823701 >> v1:172.21.15.144:6789/0 conn(0x7f5c28157870 legacy=0x7f5c2815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 -- 172.21.15.79:0/2285823701 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2815c280 con 0x7f5c2815a620 2023-10-14T18:56:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.244+0000 7f5c1ffff700 1 --2- 172.21.15.79:0/2285823701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815a620 0x7f5c2815d040 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2806b4e0 tx=0x7f5c18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7473a7d0d850351c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c1f7fe700 1 -- 172.21.15.79:0/2285823701 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18009e70 con 0x7f5c2815a620 2023-10-14T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c1f7fe700 1 -- 172.21.15.79:0/2285823701 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1800b860 con 0x7f5c2815a620 2023-10-14T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c1f7fe700 1 -- 172.21.15.79:0/2285823701 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1800bc00 con 0x7f5c2815a620 2023-10-14T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 -- 172.21.15.79:0/2285823701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815a620 msgr2=0x7f5c2815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/2285823701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815a620 0x7f5c2815d040 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2806b4e0 tx=0x7f5c18009250 comp rx=0 tx=0).stop 2023-10-14T18:56:55.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 -- 172.21.15.79:0/2285823701 shutdown_connections 2023-10-14T18:56:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/2285823701 >> v2:172.21.15.144:3300/0 conn(0x7f5c2815d580 0x7f5c28158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/2285823701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815a620 0x7f5c2815d040 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 -- 172.21.15.79:0/2285823701 >> 172.21.15.79:0/2285823701 conn(0x7f5c28068ce0 msgr2=0x7f5c280690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 -- 172.21.15.79:0/2285823701 shutdown_connections 2023-10-14T18:56:55.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.245+0000 7f5c2ec76700 1 -- 172.21.15.79:0/2285823701 wait complete. 2023-10-14T18:56:55.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.246+0000 7f5c2ec76700 1 Processor -- start 2023-10-14T18:56:55.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.246+0000 7f5c2ec76700 1 -- start start 2023-10-14T18:56:55.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c28157870 0x7f5c280b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 0x7f5c280cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c28152780 con 0x7f5c2815d580 2023-10-14T18:56:55.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c28151eb0 con 0x7f5c2815a620 2023-10-14T18:56:55.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ec76700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280b1b20 con 0x7f5c28157870 2023-10-14T18:56:55.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2d213700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2d213700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54052/0 (socket says 172.21.15.79:54052) 2023-10-14T18:56:55.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2d213700 1 -- 172.21.15.79:0/1687731120 learned_addr learned my addr 172.21.15.79:0/1687731120 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:55.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c1ffff700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 0x7f5c280cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.247+0000 7f5c2ca12700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c28157870 0x7f5c280b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 -- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c28157870 msgr2=0x7f5c280b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c28157870 0x7f5c280b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 -- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 msgr2=0x7f5c280cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 0x7f5c280cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 -- 172.21.15.79:0/1687731120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180094f0 con 0x7f5c2815d580 2023-10-14T18:56:55.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c1ffff700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 0x7f5c280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:55.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2d213700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e900 tx=0x7f5c200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000ee40 con 0x7f5c2815d580 2023-10-14T18:56:55.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000c850 con 0x7f5c2815d580 2023-10-14T18:56:55.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c28152130 con 0x7f5c2815d580 2023-10-14T18:56:55.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000cc10 con 0x7f5c2815d580 2023-10-14T18:56:55.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.248+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c280b17e0 con 0x7f5c2815d580 2023-10-14T18:56:55.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.249+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c281528f0 con 0x7f5c2815d580 2023-10-14T18:56:55.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.249+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c20013470 con 0x7f5c2815d580 2023-10-14T18:56:55.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.250+0000 7f5c1cff9700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 0x7f5c140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.250+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5c20084460 con 0x7f5c2815d580 2023-10-14T18:56:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.250+0000 7f5c2ca12700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 0x7f5c140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.250+0000 7f5c2ca12700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 0x7f5c140693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5c24007fd0 tx=0x7f5c24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.254+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c200519d0 con 0x7f5c2815d580 2023-10-14T18:56:55.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.432+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c280d17b0 con 0x7f5c14066f30 2023-10-14T18:56:55.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.435+0000 7f5c1cff9700 1 -- 172.21.15.79:0/1687731120 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50516 (secure 0 0 0) 0x7f5c280d17b0 con 0x7f5c14066f30 2023-10-14T18:56:55.438 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.436+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 msgr2=0x7f5c140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.436+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 0x7f5c140693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5c24007fd0 tx=0x7f5c24009040 comp rx=0 tx=0).stop 2023-10-14T18:56:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.436+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 msgr2=0x7f5c2814c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.436+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e900 tx=0x7f5c200091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 shutdown_connections 2023-10-14T18:56:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c14066f30 0x7f5c140693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c2815d580 0x7f5c2814c440 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c28157870 0x7f5c280b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 --2- 172.21.15.79:0/1687731120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c2815a620 0x7f5c280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 >> 172.21.15.79:0/1687731120 conn(0x7f5c28068ce0 msgr2=0x7f5c280b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 shutdown_connections 2023-10-14T18:56:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.437+0000 7f5c2ec76700 1 -- 172.21.15.79:0/1687731120 wait complete. 2023-10-14T18:56:55.442 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:55.449 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-14T18:56:54.506842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552932,"statfs":{"total":1600000000,"available":1590202651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001285"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":335,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-10-14T18:56:52.065886+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:52.065886+0000","last_peered":"2023-10-14T18:56:52.065886+0000","last_clean":"2023-10-14T18:56:52.065886+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:52.065886+0000","last_undegraded":"2023-10-14T18:56:52.065886+0000","last_fullsized":"2023-10-14T18:56:52.065886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193684,"statfs":{"total":200000000,"available":198332429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.307},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":7.8129999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77000000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.435}]},{"osd":5,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.92300000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.245},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78800000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26400000000000001},"max":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.83599999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.47399999999999998,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":9.5779999999999994},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.58699999999999997,"5min":0.69799999999999995,"15min":0.71899999999999997},"last":0.434},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.77800000000000002,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.63400000000000001,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.54400000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.69099999999999995,"5min":3.992,"15min":3.992},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73999999999999999,"5min":1.252,"15min":1.252},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.43099999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.65200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.56799999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27000000000000002},"max":{"1min":0.71699999999999997,"5min":1.3340000000000001,"15min":10.574},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.49199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.78500000000000003,"5min":10.792,"15min":10.792},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85699999999999998,"5min":3.536,"15min":3.536},"last":0.746},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.95899999999999996,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.504,"15min":1.504},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.62},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.05,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.38},"max":{"1min":0.93100000000000005,"5min":1.288,"15min":1.288},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67900000000000005,"15min":0.64700000000000002},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.0109999999999999,"5min":3.577,"15min":3.577},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.623},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.216},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.373,"15min":0.34899999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.79900000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.45600000000000002,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.78900000000000003},"last":0.307}]},{"osd":3,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24099999999999999},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":1.006},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.371}]},{"osd":4,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":3.4820000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.371},"max":{"1min":0.876,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":3.5419999999999998},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0429999999999999},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34699999999999998,"15min":0.33500000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.17999999999999999},"max":{"1min":0.50800000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.22700000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47899999999999998,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.438,"15min":0.41699999999999998},"min":{"1min":0.30299999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.502},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.627}]},{"osd":6,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.79200000000000004},"last":0.441}]},{"osd":1,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.83399999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.58299999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.81000000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.60699999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45900000000000002,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59699999999999998,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.503}]},{"osd":7,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71599999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.503}]},{"osd":1,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.64500000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:55.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.564+0000 7f4c1dcd4700 1 Processor -- start 2023-10-14T18:56:55.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.564+0000 7f4c1dcd4700 1 -- start start 2023-10-14T18:56:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c1dcd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815a620 0x7f4c1815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c1dcd4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c1815d580 0x7f4c18158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c1dcd4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1815cbb0 con 0x7f4c18157870 2023-10-14T18:56:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c1dcd4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1815bdb0 con 0x7f4c1815d580 2023-10-14T18:56:55.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c1dcd4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1815bfa0 con 0x7f4c1815a620 2023-10-14T18:56:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c17fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c1815d580 0x7f4c18158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c17fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4c1815d580 0x7f4c18158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54062/0 (socket says 172.21.15.79:54062) 2023-10-14T18:56:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c17fff700 1 -- 172.21.15.79:0/3474934081 learned_addr learned my addr 172.21.15.79:0/3474934081 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.565+0000 7f4c16ffd700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815a620 0x7f4c1815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c17fff700 1 -- 172.21.15.79:0/3474934081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815a620 msgr2=0x7f4c1815d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c17fff700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815a620 0x7f4c1815d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c17fff700 1 -- 172.21.15.79:0/3474934081 >> v1:172.21.15.144:6789/0 conn(0x7f4c18157870 legacy=0x7f4c1815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c17fff700 1 -- 172.21.15.79:0/3474934081 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1815c280 con 0x7f4c1815d580 2023-10-14T18:56:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c17fff700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815d580 0x7f4c18158110 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f4c100099b0 tx=0x7f4c10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61519bace479d8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c167fc700 1 -- 172.21.15.79:0/3474934081 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10009ea0 con 0x7f4c1815d580 2023-10-14T18:56:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c167fc700 1 -- 172.21.15.79:0/3474934081 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000b860 con 0x7f4c1815d580 2023-10-14T18:56:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c167fc700 1 -- 172.21.15.79:0/3474934081 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bc00 con 0x7f4c1815d580 2023-10-14T18:56:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/3474934081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815d580 msgr2=0x7f4c18158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815d580 0x7f4c18158110 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f4c100099b0 tx=0x7f4c10009250 comp rx=0 tx=0).stop 2023-10-14T18:56:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/3474934081 shutdown_connections 2023-10-14T18:56:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815d580 0x7f4c18158110 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/3474934081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815a620 0x7f4c1815d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/3474934081 >> 172.21.15.79:0/3474934081 conn(0x7f4c18068ce0 msgr2=0x7f4c180690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/3474934081 shutdown_connections 2023-10-14T18:56:55.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.566+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/3474934081 wait complete. 2023-10-14T18:56:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 Processor -- start 2023-10-14T18:56:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 -- start start 2023-10-14T18:56:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c18157870 0x7f4c180b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815d580 0x7f4c1814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b19d0 con 0x7f4c1815a620 2023-10-14T18:56:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b1130 con 0x7f4c18157870 2023-10-14T18:56:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.568+0000 7f4c1dcd4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b1410 con 0x7f4c1815d580 2023-10-14T18:56:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54064/0 (socket says 172.21.15.79:54064) 2023-10-14T18:56:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 -- 172.21.15.79:0/696758532 learned_addr learned my addr 172.21.15.79:0/696758532 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c177fe700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c18157870 0x7f4c180b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c17fff700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815d580 0x7f4c1814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 -- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815d580 msgr2=0x7f4c1814c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815d580 0x7f4c1814c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 -- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c18157870 msgr2=0x7f4c180b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c18157870 0x7f4c180b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 -- 172.21.15.79:0/696758532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094f0 con 0x7f4c1815a620 2023-10-14T18:56:55.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c16ffd700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ec50 tx=0x7f4c0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00c850 con 0x7f4c1815a620 2023-10-14T18:56:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00c9b0 con 0x7f4c1815a620 2023-10-14T18:56:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c180b16f0 con 0x7f4c1815a620 2023-10-14T18:56:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00cd70 con 0x7f4c1815a620 2023-10-14T18:56:55.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.569+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c180b6270 con 0x7f4c1815a620 2023-10-14T18:56:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.570+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1804c3c0 con 0x7f4c1815a620 2023-10-14T18:56:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.571+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c0c013680 con 0x7f4c1815a620 2023-10-14T18:56:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.571+0000 7f4bff7fe700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.571+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4c0c084440 con 0x7f4c1815a620 2023-10-14T18:56:55.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.571+0000 7f4c177fe700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.572+0000 7f4c177fe700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4c08007fd0 tx=0x7f4c080016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.575+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c0c0519b0 con 0x7f4c1815a620 2023-10-14T18:56:55.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.751+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c1815c560 con 0x7f4c04066f30 2023-10-14T18:56:55.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.754+0000 7f4bff7fe700 1 -- 172.21.15.79:0/696758532 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50516 (secure 0 0 0) 0x7f4c1815c560 con 0x7f4c04066f30 2023-10-14T18:56:55.755 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:55.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 msgr2=0x7f4c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 0x7f4c040693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4c08007fd0 tx=0x7f4c080016f0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 msgr2=0x7f4c180b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ec50 tx=0x7f4c0c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 shutdown_connections 2023-10-14T18:56:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4c04066f30 0x7f4c040693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4c1815d580 0x7f4c1814c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c18157870 0x7f4c180b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 --2- 172.21.15.79:0/696758532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c1815a620 0x7f4c180b0750 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 >> 172.21.15.79:0/696758532 conn(0x7f4c18068ce0 msgr2=0x7f4c18155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 shutdown_connections 2023-10-14T18:56:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.756+0000 7f4c1dcd4700 1 -- 172.21.15.79:0/696758532 wait complete. 2023-10-14T18:56:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:55.768 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-14T18:56:54.506842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552932,"statfs":{"total":1600000000,"available":1590202651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001285"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":335,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-10-14T18:56:52.065886+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:52.065886+0000","last_peered":"2023-10-14T18:56:52.065886+0000","last_clean":"2023-10-14T18:56:52.065886+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:52.065886+0000","last_undegraded":"2023-10-14T18:56:52.065886+0000","last_fullsized":"2023-10-14T18:56:52.065886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193684,"statfs":{"total":200000000,"available":198332429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.307},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":7.8129999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77000000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.435}]},{"osd":5,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.92300000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.245},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78800000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26400000000000001},"max":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.83599999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.47399999999999998,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":9.5779999999999994},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.58699999999999997,"5min":0.69799999999999995,"15min":0.71899999999999997},"last":0.434},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.77800000000000002,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.63400000000000001,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.54400000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.69099999999999995,"5min":3.992,"15min":3.992},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73999999999999999,"5min":1.252,"15min":1.252},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.43099999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.65200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.56799999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27000000000000002},"max":{"1min":0.71699999999999997,"5min":1.3340000000000001,"15min":10.574},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.49199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.78500000000000003,"5min":10.792,"15min":10.792},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85699999999999998,"5min":3.536,"15min":3.536},"last":0.746},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.95899999999999996,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.504,"15min":1.504},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.62},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.05,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.38},"max":{"1min":0.93100000000000005,"5min":1.288,"15min":1.288},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67900000000000005,"15min":0.64700000000000002},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.0109999999999999,"5min":3.577,"15min":3.577},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.623},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.216},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.373,"15min":0.34899999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.79900000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.45600000000000002,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.78900000000000003},"last":0.307}]},{"osd":3,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24099999999999999},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":1.006},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.371}]},{"osd":4,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":3.4820000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.371},"max":{"1min":0.876,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":3.5419999999999998},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0429999999999999},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34699999999999998,"15min":0.33500000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.17999999999999999},"max":{"1min":0.50800000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.22700000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47899999999999998,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.438,"15min":0.41699999999999998},"min":{"1min":0.30299999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.502},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.627}]},{"osd":6,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.79200000000000004},"last":0.441}]},{"osd":1,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.83399999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.58299999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.81000000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.60699999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45900000000000002,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59699999999999998,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.503}]},{"osd":7,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71599999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.503}]},{"osd":1,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.64500000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:55.770 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T18:56:55.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:56:55.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.885+0000 7f5c3f244700 1 Processor -- start 2023-10-14T18:56:55.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.885+0000 7f5c3f244700 1 -- start start 2023-10-14T18:56:55.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3f244700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c3806ab90 0x7f5c380cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3f244700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c380cac20 con 0x7f5c3815abb0 2023-10-14T18:56:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3f244700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c380cb4c0 con 0x7f5c380cc710 2023-10-14T18:56:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3f244700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c380640c0 con 0x7f5c3806ab90 2023-10-14T18:56:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3ea43700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5c3815abb0 0x7f5c380c7690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47966/0 (socket says 172.21.15.79:47966) 2023-10-14T18:56:55.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3ea43700 1 -- 172.21.15.79:0/182364886 learned_addr learned my addr 172.21.15.79:0/182364886 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:55.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287119618 0 0) 0x7f5c380cac20 con 0x7f5c3815abb0 2023-10-14T18:56:55.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3e242700 1 --2- 172.21.15.79:0/182364886 >> v2:172.21.15.144:3300/0 conn(0x7f5c3806ab90 0x7f5c380cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.886+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c24003570 con 0x7f5c3815abb0 2023-10-14T18:56:55.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097794691 0 0) 0x7f5c24003570 con 0x7f5c3815abb0 2023-10-14T18:56:55.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 >> v2:172.21.15.144:3300/0 conn(0x7f5c3806ab90 msgr2=0x7f5c380cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:55.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 --2- 172.21.15.79:0/182364886 >> v2:172.21.15.144:3300/0 conn(0x7f5c3806ab90 0x7f5c380cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 >> v1:172.21.15.144:6789/0 conn(0x7f5c380cc710 legacy=0x7f5c3806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380ccc10 con 0x7f5c3815abb0 2023-10-14T18:56:55.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f5c300017f0 con 0x7f5c3815abb0 2023-10-14T18:56:55.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 >> v1:172.21.15.79:6789/0 conn(0x7f5c3815abb0 legacy=0x7f5c380c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c24003a60 0x7f5c24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c24004810 0x7f5c24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 0x7f5c2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2400c130 con 0x7f5c240051c0 2023-10-14T18:56:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2400c2a0 con 0x7f5c24003a60 2023-10-14T18:56:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2400c460 con 0x7f5c24004810 2023-10-14T18:56:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 0x7f5c2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3e242700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c24003a60 0x7f5c24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3da41700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c24004810 0x7f5c24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 -- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c24004810 msgr2=0x7f5c24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c24004810 0x7f5c24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 -- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c24003a60 msgr2=0x7f5c24003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:55.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c24003a60 0x7f5c24003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 -- 172.21.15.79:0/182364886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24003570 con 0x7f5c240051c0 2023-10-14T18:56:55.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 -- 172.21.15.79:0/182364886 reap_dead start 2023-10-14T18:56:55.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 0x7f5c2400ba60 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a900 tx=0x7f5c380ccfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc493779849097a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300070d0 con 0x7f5c240051c0 2023-10-14T18:56:55.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30007230 con 0x7f5c240051c0 2023-10-14T18:56:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.887+0000 7f5c3d240700 1 -- 172.21.15.79:0/182364886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300075f0 con 0x7f5c240051c0 2023-10-14T18:56:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 -- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 msgr2=0x7f5c2400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 0x7f5c2400ba60 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a900 tx=0x7f5c380ccfe0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 -- 172.21.15.79:0/182364886 shutdown_connections 2023-10-14T18:56:55.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 --2- 172.21.15.79:0/182364886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c240051c0 0x7f5c2400ba60 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 -- 172.21.15.79:0/182364886 >> 172.21.15.79:0/182364886 conn(0x7f5c380cd050 msgr2=0x7f5c380cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 -- 172.21.15.79:0/182364886 shutdown_connections 2023-10-14T18:56:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.888+0000 7f5c3f244700 1 -- 172.21.15.79:0/182364886 wait complete. 2023-10-14T18:56:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.889+0000 7f5c3f244700 1 Processor -- start 2023-10-14T18:56:55.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.889+0000 7f5c3f244700 1 -- start start 2023-10-14T18:56:55.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c240051c0 0x7f5c38097c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c380c68e0 0x7f5c38157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38099180 con 0x7f5c38158340 2023-10-14T18:56:55.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38099fa0 con 0x7f5c380c68e0 2023-10-14T18:56:55.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3f244700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c381587b0 con 0x7f5c240051c0 2023-10-14T18:56:55.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54088/0 (socket says 172.21.15.79:54088) 2023-10-14T18:56:55.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 -- 172.21.15.79:0/4148680423 learned_addr learned my addr 172.21.15.79:0/4148680423 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:55.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3da41700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c380c68e0 0x7f5c38157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3e242700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c240051c0 0x7f5c38097c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 -- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c240051c0 msgr2=0x7f5c38097c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c240051c0 0x7f5c38097c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 -- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c380c68e0 msgr2=0x7f5c38157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c380c68e0 0x7f5c38157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.890+0000 7f5c3ea43700 1 -- 172.21.15.79:0/4148680423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38099390 con 0x7f5c38158340 2023-10-14T18:56:55.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c3ea43700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a3f0 tx=0x7f5c30015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300070d0 con 0x7f5c38158340 2023-10-14T18:56:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30001250 con 0x7f5c38158340 2023-10-14T18:56:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c38099670 con 0x7f5c38158340 2023-10-14T18:56:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300073a0 con 0x7f5c38158340 2023-10-14T18:56:55.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.891+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c38099c30 con 0x7f5c38158340 2023-10-14T18:56:55.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.892+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3809a130 con 0x7f5c38158340 2023-10-14T18:56:55.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.892+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3001a040 con 0x7f5c38158340 2023-10-14T18:56:55.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.893+0000 7f5c2e7fc700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 0x7f5c1c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:55.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.893+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5c30086510 con 0x7f5c38158340 2023-10-14T18:56:55.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.893+0000 7f5c3e242700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 0x7f5c1c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:55.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.893+0000 7f5c3e242700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 0x7f5c1c069410 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006f00 tx=0x7f5c340091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:55.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:55.897+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c300539e0 con 0x7f5c38158340 2023-10-14T18:56:56.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.080+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c3804bb80 con 0x7f5c1c066f60 2023-10-14T18:56:56.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.083+0000 7f5c2e7fc700 1 -- 172.21.15.79:0/4148680423 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50516 (secure 0 0 0) 0x7f5c3804bb80 con 0x7f5c1c066f60 2023-10-14T18:56:56.084 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 msgr2=0x7f5c1c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 0x7f5c1c069410 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006f00 tx=0x7f5c340091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 msgr2=0x7f5c3816a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a3f0 tx=0x7f5c30015000 comp rx=0 tx=0).stop 2023-10-14T18:56:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 shutdown_connections 2023-10-14T18:56:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f5c1c066f60 0x7f5c1c069410 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c38158340 0x7f5c3816a480 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5c240051c0 0x7f5c38097c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 --2- 172.21.15.79:0/4148680423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c380c68e0 0x7f5c38157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 >> 172.21.15.79:0/4148680423 conn(0x7f5c380cd050 msgr2=0x7f5c380c37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 shutdown_connections 2023-10-14T18:56:56.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.085+0000 7f5c3f244700 1 -- 172.21.15.79:0/4148680423 wait complete. 2023-10-14T18:56:56.089 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:56:56.098 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-14T18:56:54.506842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552932,"statfs":{"total":1600000000,"available":1590202651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-44025,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-97,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001285"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":335,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-10-14T18:56:52.065886+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:52.065886+0000","last_peered":"2023-10-14T18:56:52.065886+0000","last_clean":"2023-10-14T18:56:52.065886+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:52.065886+0000","last_undegraded":"2023-10-14T18:56:52.065886+0000","last_fullsized":"2023-10-14T18:56:52.065886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193684,"statfs":{"total":200000000,"available":198332429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.307},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":7.8129999999999997},"last":0.53900000000000003}]},{"osd":3,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77000000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.435}]},{"osd":5,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.92300000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.245},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78800000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26400000000000001},"max":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.46899999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.83599999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.47399999999999998,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":9.5779999999999994},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.58699999999999997,"5min":0.69799999999999995,"15min":0.71899999999999997},"last":0.434},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.77800000000000002,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.45000000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.63400000000000001,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.54400000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.69099999999999995,"5min":3.992,"15min":3.992},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73999999999999999,"5min":1.252,"15min":1.252},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.43099999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.65200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.29499999999999998}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.56799999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27000000000000002},"max":{"1min":0.71699999999999997,"5min":1.3340000000000001,"15min":10.574},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.49199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.78500000000000003,"5min":10.792,"15min":10.792},"last":0.35799999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85699999999999998,"5min":3.536,"15min":3.536},"last":0.746},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.95899999999999996,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.504,"15min":1.504},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.62},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.05,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.38},"max":{"1min":0.93100000000000005,"5min":1.288,"15min":1.288},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67900000000000005,"15min":0.64700000000000002},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.0109999999999999,"5min":3.577,"15min":3.577},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.623},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.216},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.373,"15min":0.34899999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.31}]},{"osd":4,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.79900000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.45600000000000002,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.34899999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.78900000000000003},"last":0.307}]},{"osd":3,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24099999999999999},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":1.006},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.371}]},{"osd":4,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":3.4820000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.371},"max":{"1min":0.876,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":3.5419999999999998},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.57699999999999996}]},{"osd":7,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0429999999999999},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34699999999999998,"15min":0.33500000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.17999999999999999},"max":{"1min":0.50800000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.22700000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47899999999999998,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.438,"15min":0.41699999999999998},"min":{"1min":0.30299999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.502},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.44900000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.627}]},{"osd":6,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.79200000000000004},"last":0.441}]},{"osd":1,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.83399999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.58299999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.81000000000000005},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52300000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.60699999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45900000000000002,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59699999999999998,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.503}]},{"osd":7,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71599999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.503}]},{"osd":1,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.61299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.64500000000000002}]}]}],"pool_statfs":[]}} 2023-10-14T18:56:56.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T18:56:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.214+0000 7f3030d2d700 1 Processor -- start 2023-10-14T18:56:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.214+0000 7f3030d2d700 1 -- start start 2023-10-14T18:56:56.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3030d2d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f302c0b1220 0x7f302c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3030d2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302c0cb4f0 0x7f302c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3030d2d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c15de60 con 0x7f302c0b0e50 2023-10-14T18:56:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3030d2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c0cbeb0 con 0x7f302c0cb4f0 2023-10-14T18:56:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3030d2d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c15e140 con 0x7f302c0b1220 2023-10-14T18:56:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f302ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302c0cb4f0 0x7f302c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f302ad9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f302c0cb4f0 0x7f302c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54098/0 (socket says 172.21.15.79:54098) 2023-10-14T18:56:56.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f302ad9d700 1 -- 172.21.15.79:0/1519655518 learned_addr learned my addr 172.21.15.79:0/1519655518 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:56.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f3029d9b700 1 --2- 172.21.15.79:0/1519655518 >> v2:172.21.15.144:3300/0 conn(0x7f302c0b1220 0x7f302c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:56.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.215+0000 7f302ad9d700 1 -- 172.21.15.79:0/1519655518 >> v2:172.21.15.144:3300/0 conn(0x7f302c0b1220 msgr2=0x7f302c0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:56.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302ad9d700 1 --2- 172.21.15.79:0/1519655518 >> v2:172.21.15.144:3300/0 conn(0x7f302c0b1220 0x7f302c0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302ad9d700 1 -- 172.21.15.79:0/1519655518 >> v1:172.21.15.144:6789/0 conn(0x7f302c0b0e50 legacy=0x7f302c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:56.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302ad9d700 1 -- 172.21.15.79:0/1519655518 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c15e420 con 0x7f302c0cb4f0 2023-10-14T18:56:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302ad9d700 1 --2- 172.21.15.79:0/1519655518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0cb4f0 0x7f302c0cb970 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f302c06cd30 tx=0x7f3024009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a52b672cf46a76e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302959a700 1 -- 172.21.15.79:0/1519655518 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400e070 con 0x7f302c0cb4f0 2023-10-14T18:56:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302959a700 1 -- 172.21.15.79:0/1519655518 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400ba10 con 0x7f302c0cb4f0 2023-10-14T18:56:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f302959a700 1 -- 172.21.15.79:0/1519655518 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240092e0 con 0x7f302c0cb4f0 2023-10-14T18:56:56.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 -- 172.21.15.79:0/1519655518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0cb4f0 msgr2=0x7f302c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 --2- 172.21.15.79:0/1519655518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0cb4f0 0x7f302c0cb970 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f302c06cd30 tx=0x7f3024009840 comp rx=0 tx=0).stop 2023-10-14T18:56:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 -- 172.21.15.79:0/1519655518 shutdown_connections 2023-10-14T18:56:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 --2- 172.21.15.79:0/1519655518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0cb4f0 0x7f302c0cb970 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 --2- 172.21.15.79:0/1519655518 >> v2:172.21.15.144:3300/0 conn(0x7f302c0b1220 0x7f302c0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.216+0000 7f3030d2d700 1 -- 172.21.15.79:0/1519655518 >> 172.21.15.79:0/1519655518 conn(0x7f302c069870 msgr2=0x7f302c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.217+0000 7f3030d2d700 1 -- 172.21.15.79:0/1519655518 shutdown_connections 2023-10-14T18:56:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.217+0000 7f3030d2d700 1 -- 172.21.15.79:0/1519655518 wait complete. 2023-10-14T18:56:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 Processor -- start 2023-10-14T18:56:56.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 -- start start 2023-10-14T18:56:56.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b1220 0x7f302c16cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f302c0cb4f0 0x7f302c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c16b660 con 0x7f302c0b0e50 2023-10-14T18:56:56.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c16d430 con 0x7f302c0b1220 2023-10-14T18:56:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f3030d2d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c16aec0 con 0x7f302c0cb4f0 2023-10-14T18:56:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f302a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f302a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54112/0 (socket says 172.21.15.79:54112) 2023-10-14T18:56:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.218+0000 7f302a59c700 1 -- 172.21.15.79:0/3228531680 learned_addr learned my addr 172.21.15.79:0/3228531680 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:56.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 -- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f302c0cb4f0 msgr2=0x7f302c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f302c0cb4f0 0x7f302c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 -- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b1220 msgr2=0x7f302c16cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b1220 0x7f302c16cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 -- 172.21.15.79:0/3228531680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009ae0 con 0x7f302c0b0e50 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f302a59c700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c5d0 tx=0x7f301c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c011590 con 0x7f302c0b0e50 2023-10-14T18:56:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0116f0 con 0x7f302c0b0e50 2023-10-14T18:56:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c011ab0 con 0x7f302c0b0e50 2023-10-14T18:56:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c16a030 con 0x7f302c0b0e50 2023-10-14T18:56:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.219+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c16a590 con 0x7f302c0b0e50 2023-10-14T18:56:56.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.220+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c04c3c0 con 0x7f302c0b0e50 2023-10-14T18:56:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.220+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f301c01c460 con 0x7f302c0b0e50 2023-10-14T18:56:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.221+0000 7f301a7fc700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.221+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f301c083fa0 con 0x7f302c0b0e50 2023-10-14T18:56:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.221+0000 7f3029d9b700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:56.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.221+0000 7f3029d9b700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 0x7f300c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f302c0c9670 tx=0x7f3020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:56.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.225+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f301c051510 con 0x7f302c0b0e50 2023-10-14T18:56:56.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.405+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f302c068ba0 con 0x7f302c0b0e50 2023-10-14T18:56:56.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.406+0000 7f301a7fc700 1 -- 172.21.15.79:0/3228531680 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+12274 (secure 0 0 0) 0x7f301c054b30 con 0x7f302c0b0e50 2023-10-14T18:56:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:56:56.407 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":192,"fsid":"73e97ab7-e872-4b12-8e7a-6b299bb24b40","created":"2023-10-14T18:44:52.716828+0000","modified":"2023-10-14T18:56:52.598237+0000","last_up_change":"2023-10-14T18:44:58.111082+0000","last_in_change":"2023-10-14T18:44:55.095083+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T18:44:58.374271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":86336},{"type":"v1","addr":"172.21.15.79:6809","nonce":86336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":86336},{"type":"v1","addr":"172.21.15.79:6811","nonce":86336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":86336},{"type":"v1","addr":"172.21.15.79:6815","nonce":86336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":86336},{"type":"v1","addr":"172.21.15.79:6813","nonce":86336}]},"public_addr":"172.21.15.79:6809/86336","cluster_addr":"172.21.15.79:6811/86336","heartbeat_back_addr":"172.21.15.79:6815/86336","heartbeat_front_addr":"172.21.15.79:6813/86336","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":86335},{"type":"v1","addr":"172.21.15.79:6823","nonce":86335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":86335},{"type":"v1","addr":"172.21.15.79:6827","nonce":86335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":86335},{"type":"v1","addr":"172.21.15.79:6831","nonce":86335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":86335},{"type":"v1","addr":"172.21.15.79:6829","nonce":86335}]},"public_addr":"172.21.15.79:6823/86335","cluster_addr":"172.21.15.79:6827/86335","heartbeat_back_addr":"172.21.15.79:6831/86335","heartbeat_front_addr":"172.21.15.79:6829/86335","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":86333},{"type":"v1","addr":"172.21.15.79:6801","nonce":86333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":86333},{"type":"v1","addr":"172.21.15.79:6803","nonce":86333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":86333},{"type":"v1","addr":"172.21.15.79:6807","nonce":86333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":86333},{"type":"v1","addr":"172.21.15.79:6805","nonce":86333}]},"public_addr":"172.21.15.79:6801/86333","cluster_addr":"172.21.15.79:6803/86333","heartbeat_back_addr":"172.21.15.79:6807/86333","heartbeat_front_addr":"172.21.15.79:6805/86333","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":86334},{"type":"v1","addr":"172.21.15.79:6817","nonce":86334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":86334},{"type":"v1","addr":"172.21.15.79:6819","nonce":86334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":86334},{"type":"v1","addr":"172.21.15.79:6826","nonce":86334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":86334},{"type":"v1","addr":"172.21.15.79:6821","nonce":86334}]},"public_addr":"172.21.15.79:6817/86334","cluster_addr":"172.21.15.79:6819/86334","heartbeat_back_addr":"172.21.15.79:6826/86334","heartbeat_front_addr":"172.21.15.79:6821/86334","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":86566},{"type":"v1","addr":"172.21.15.144:6805","nonce":86566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":86566},{"type":"v1","addr":"172.21.15.144:6810","nonce":86566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":86566},{"type":"v1","addr":"172.21.15.144:6815","nonce":86566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":86566},{"type":"v1","addr":"172.21.15.144:6813","nonce":86566}]},"public_addr":"172.21.15.144:6805/86566","cluster_addr":"172.21.15.144:6810/86566","heartbeat_back_addr":"172.21.15.144:6815/86566","heartbeat_front_addr":"172.21.15.144:6813/86566","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":86565},{"type":"v1","addr":"172.21.15.144:6801","nonce":86565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":86565},{"type":"v1","addr":"172.21.15.144:6803","nonce":86565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":86565},{"type":"v1","addr":"172.21.15.144:6811","nonce":86565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":86565},{"type":"v1","addr":"172.21.15.144:6807","nonce":86565}]},"public_addr":"172.21.15.144:6801/86565","cluster_addr":"172.21.15.144:6803/86565","heartbeat_back_addr":"172.21.15.144:6811/86565","heartbeat_front_addr":"172.21.15.144:6807/86565","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":86602},{"type":"v1","addr":"172.21.15.144:6825","nonce":86602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":86602},{"type":"v1","addr":"172.21.15.144:6827","nonce":86602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":86602},{"type":"v1","addr":"172.21.15.144:6831","nonce":86602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":86602},{"type":"v1","addr":"172.21.15.144:6829","nonce":86602}]},"public_addr":"172.21.15.144:6825/86602","cluster_addr":"172.21.15.144:6827/86602","heartbeat_back_addr":"172.21.15.144:6831/86602","heartbeat_front_addr":"172.21.15.144:6829/86602","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":86567},{"type":"v1","addr":"172.21.15.144:6817","nonce":86567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":86567},{"type":"v1","addr":"172.21.15.144:6819","nonce":86567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":86567},{"type":"v1","addr":"172.21.15.144:6823","nonce":86567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":86567},{"type":"v1","addr":"172.21.15.144:6821","nonce":86567}]},"public_addr":"172.21.15.144:6817/86567","cluster_addr":"172.21.15.144:6819/86567","heartbeat_back_addr":"172.21.15.144:6823/86567","heartbeat_front_addr":"172.21.15.144:6821/86567","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.201734+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.223949+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.203481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.255672+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.219385+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.235023+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.265703+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T18:44:56.227825+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/958841168":"2023-10-15T18:56:50.047580+0000","172.21.15.144:6835/958841168":"2023-10-15T18:56:50.047580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T18:56:56.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 msgr2=0x7f300c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 0x7f300c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f302c0c9670 tx=0x7f3020008040 comp rx=0 tx=0).stop 2023-10-14T18:56:56.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 msgr2=0x7f302c16b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:56.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c5d0 tx=0x7f301c007f60 comp rx=0 tx=0).stop 2023-10-14T18:56:56.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 shutdown_connections 2023-10-14T18:56:56.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f300c066f30 0x7f300c0693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f302c0cb4f0 0x7f302c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f302c0b0e50 0x7f302c16b120 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 --2- 172.21.15.79:0/3228531680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b1220 0x7f302c16cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:56.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 >> 172.21.15.79:0/3228531680 conn(0x7f302c069870 msgr2=0x7f302c069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:56.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 shutdown_connections 2023-10-14T18:56:56.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:56.408+0000 7f3030d2d700 1 -- 172.21.15.79:0/3228531680 wait complete. 2023-10-14T18:56:57.421 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T18:56:57.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:56:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.544+0000 7fdff766b700 1 Processor -- start 2023-10-14T18:56:57.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 -- start start 2023-10-14T18:56:57.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdff0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdff0152520 0x7fdff00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff0159350 con 0x7fdff00b1950 2023-10-14T18:56:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00b1110 con 0x7fdff0152520 2023-10-14T18:56:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.545+0000 7fdff766b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00ae4e0 con 0x7fdff00b36c0 2023-10-14T18:56:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff4c06700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdff00b1950 0x7fdff0151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47970/0 (socket says 172.21.15.79:47970) 2023-10-14T18:56:57.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff4c06700 1 -- 172.21.15.79:0/3421658783 learned_addr learned my addr 172.21.15.79:0/3421658783 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916123282 0 0) 0x7fdff0159350 con 0x7fdff00b1950 2023-10-14T18:56:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff5407700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdff0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff5c08700 1 --2- 172.21.15.79:0/3421658783 >> v2:172.21.15.144:3300/0 conn(0x7fdff0152520 0x7fdff00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfdc003570 con 0x7fdff00b1950 2023-10-14T18:56:57.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4200186974 0 0) 0x7fdfdc003570 con 0x7fdff00b1950 2023-10-14T18:56:57.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 msgr2=0x7fdff0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdff0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 >> v2:172.21.15.144:3300/0 conn(0x7fdff0152520 msgr2=0x7fdff00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 --2- 172.21.15.79:0/3421658783 >> v2:172.21.15.144:3300/0 conn(0x7fdff0152520 0x7fdff00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00b1ea0 con 0x7fdff00b1950 2023-10-14T18:56:57.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fdfe0001470 con 0x7fdff00b1950 2023-10-14T18:56:57.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 >> v1:172.21.15.79:6789/0 conn(0x7fdff00b1950 legacy=0x7fdff0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a60 0x7fdfdc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfdc004810 0x7fdfdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdfdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b1110 con 0x7fdfdc004810 2023-10-14T18:56:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00ae4e0 con 0x7fdfdc003a60 2023-10-14T18:56:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00ba60 con 0x7fdff00b36c0 2023-10-14T18:56:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff4c06700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfdc004810 0x7fdfdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff5407700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a60 0x7fdfdc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.546+0000 7fdff5c08700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdfdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 -- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 msgr2=0x7fdfdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff00b36c0 0x7fdfdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 -- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a60 msgr2=0x7fdfdc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc003a60 0x7fdfdc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 -- 172.21.15.79:0/3421658783 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc003570 con 0x7fdfdc004810 2023-10-14T18:56:57.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff4c06700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfdc004810 0x7fdfdc004c80 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c3f0 tx=0x7fdfe0001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f918b40ca54a8468 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000cc80 con 0x7fdfdc004810 2023-10-14T18:56:57.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000ce00 con 0x7fdfdc004810 2023-10-14T18:56:57.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdfe7fff700 1 -- 172.21.15.79:0/3421658783 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0005b70 con 0x7fdfdc004810 2023-10-14T18:56:57.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff766b700 1 -- 172.21.15.79:0/3421658783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfdc004810 msgr2=0x7fdfdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff766b700 1 --2- 172.21.15.79:0/3421658783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdfdc004810 0x7fdfdc004c80 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c3f0 tx=0x7fdfe0001e90 comp rx=0 tx=0).stop 2023-10-14T18:56:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff5c08700 1 -- 172.21.15.79:0/3421658783 reap_dead start 2023-10-14T18:56:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff766b700 1 -- 172.21.15.79:0/3421658783 shutdown_connections 2023-10-14T18:56:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.547+0000 7fdff766b700 1 -- 172.21.15.79:0/3421658783 >> 172.21.15.79:0/3421658783 conn(0x7fdff0069870 msgr2=0x7fdff0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:57.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.548+0000 7fdff766b700 1 -- 172.21.15.79:0/3421658783 shutdown_connections 2023-10-14T18:56:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.548+0000 7fdff766b700 1 -- 172.21.15.79:0/3421658783 wait complete. 2023-10-14T18:56:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 Processor -- start 2023-10-14T18:56:57.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 -- start start 2023-10-14T18:56:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc004810 0x7fdff0069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff016b010 0x7fdff00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 0x7fdff015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0068de0 con 0x7fdff016b480 2023-10-14T18:56:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00681d0 con 0x7fdfdc004810 2023-10-14T18:56:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.549+0000 7fdff766b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00684b0 con 0x7fdff016b010 2023-10-14T18:56:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 0x7fdff015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 0x7fdff015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54138/0 (socket says 172.21.15.79:54138) 2023-10-14T18:56:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 -- 172.21.15.79:0/1366977182 learned_addr learned my addr 172.21.15.79:0/1366977182 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 -- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff016b010 msgr2=0x7fdff00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff4c06700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff016b010 0x7fdff00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5407700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc004810 0x7fdff0069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdff016b010 0x7fdff00c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 -- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc004810 msgr2=0x7fdff0069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc004810 0x7fdff0069270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0068790 con 0x7fdff016b480 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff5c08700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 0x7fdff015aa60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b4c30 tx=0x7fdfe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800f910 con 0x7fdff016b480 2023-10-14T18:56:57.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe800fa70 con 0x7fdff016b480 2023-10-14T18:56:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff0068a70 con 0x7fdff016b480 2023-10-14T18:56:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800fe10 con 0x7fdff016b480 2023-10-14T18:56:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.550+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00c98c0 con 0x7fdff016b480 2023-10-14T18:56:57.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.551+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdff00c9ae0 con 0x7fdff016b480 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.551+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfe8014650 con 0x7fdff016b480 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdfe57fa700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfd4066f30 0x7fdfd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdfe8084890 con 0x7fdff016b480 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdfe57fa700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7fdfd406cd80 0x7fdfd406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdff5407700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfd4066f30 0x7fdfd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfd406f860 con 0x7fdfd406cd80 2023-10-14T18:56:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe8089240 con 0x7fdff016b480 2023-10-14T18:56:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdff4c06700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7fdfd406cd80 0x7fdfd406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.552+0000 7fdff4c06700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7fdfd406cd80 0x7fdfd406f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.553+0000 7fdff5407700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfd4066f30 0x7fdfd40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0099f0 tx=0x7fdfec00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.553+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== osd.0 v2:172.21.15.79:6808/86336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fdfd406f860 con 0x7fdfd406cd80 2023-10-14T18:56:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.565+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 --> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdff006b900 con 0x7fdfd406cd80 2023-10-14T18:56:57.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdfe57fa700 1 -- 172.21.15.79:0/1366977182 <== osd.0 v2:172.21.15.79:6808/86336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fdff006b900 con 0x7fdfd406cd80 2023-10-14T18:56:57.570 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:56:57.570 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7fdfd406cd80 msgr2=0x7fdfd406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:6808/86336,v1:172.21.15.79:6809/86336] conn(0x7fdfd406cd80 0x7fdfd406f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfd4066f30 msgr2=0x7fdfd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fdfd4066f30 0x7fdfd40693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0099f0 tx=0x7fdfec00b040 comp rx=0 tx=0).stop 2023-10-14T18:56:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 msgr2=0x7fdff015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 --2- 172.21.15.79:0/1366977182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdff016b480 0x7fdff015aa60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b4c30 tx=0x7fdfe80091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff5c08700 1 -- 172.21.15.79:0/1366977182 reap_dead start 2023-10-14T18:56:57.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 shutdown_connections 2023-10-14T18:56:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 >> 172.21.15.79:0/1366977182 conn(0x7fdff0069870 msgr2=0x7fdff0159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 shutdown_connections 2023-10-14T18:56:57.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.566+0000 7fdff766b700 1 -- 172.21.15.79:0/1366977182 wait complete. 2023-10-14T18:56:57.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T18:56:57.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.693+0000 7fc837cf7700 1 Processor -- start 2023-10-14T18:56:57.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.693+0000 7fc837cf7700 1 -- start start 2023-10-14T18:56:57.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc837cf7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc83015a620 0x7fc83015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc837cf7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc83015d580 0x7fc830158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc837cf7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83015cbb0 con 0x7fc830157870 2023-10-14T18:56:57.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc837cf7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015bdb0 con 0x7fc83015d580 2023-10-14T18:56:57.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc837cf7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83015bfa0 con 0x7fc83015a620 2023-10-14T18:56:57.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc836294700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc83015d580 0x7fc830158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc836294700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc83015d580 0x7fc830158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54148/0 (socket says 172.21.15.79:54148) 2023-10-14T18:56:57.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc836294700 1 -- 172.21.15.79:0/1798207279 learned_addr learned my addr 172.21.15.79:0/1798207279 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:57.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.694+0000 7fc835292700 1 --2- 172.21.15.79:0/1798207279 >> v2:172.21.15.144:3300/0 conn(0x7fc83015a620 0x7fc83015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc836294700 1 -- 172.21.15.79:0/1798207279 >> v2:172.21.15.144:3300/0 conn(0x7fc83015a620 msgr2=0x7fc83015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc836294700 1 --2- 172.21.15.79:0/1798207279 >> v2:172.21.15.144:3300/0 conn(0x7fc83015a620 0x7fc83015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc836294700 1 -- 172.21.15.79:0/1798207279 >> v1:172.21.15.144:6789/0 conn(0x7fc830157870 legacy=0x7fc83015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:57.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc836294700 1 -- 172.21.15.79:0/1798207279 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83015c280 con 0x7fc83015d580 2023-10-14T18:56:57.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc836294700 1 --2- 172.21.15.79:0/1798207279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83015d580 0x7fc830158110 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fc83015cb20 tx=0x7fc828009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917e5e69b8d9a7c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc834a91700 1 -- 172.21.15.79:0/1798207279 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800b820 con 0x7fc83015d580 2023-10-14T18:56:57.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc834a91700 1 -- 172.21.15.79:0/1798207279 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800b980 con 0x7fc83015d580 2023-10-14T18:56:57.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc834a91700 1 -- 172.21.15.79:0/1798207279 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800bd20 con 0x7fc83015d580 2023-10-14T18:56:57.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 -- 172.21.15.79:0/1798207279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83015d580 msgr2=0x7fc830158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1798207279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83015d580 0x7fc830158110 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fc83015cb20 tx=0x7fc828009250 comp rx=0 tx=0).stop 2023-10-14T18:56:57.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 -- 172.21.15.79:0/1798207279 shutdown_connections 2023-10-14T18:56:57.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1798207279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc83015d580 0x7fc830158110 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1798207279 >> v2:172.21.15.144:3300/0 conn(0x7fc83015a620 0x7fc83015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.695+0000 7fc837cf7700 1 -- 172.21.15.79:0/1798207279 >> 172.21.15.79:0/1798207279 conn(0x7fc830068ce0 msgr2=0x7fc8300690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:57.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.696+0000 7fc837cf7700 1 -- 172.21.15.79:0/1798207279 shutdown_connections 2023-10-14T18:56:57.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.696+0000 7fc837cf7700 1 -- 172.21.15.79:0/1798207279 wait complete. 2023-10-14T18:56:57.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 Processor -- start 2023-10-14T18:56:57.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 -- start start 2023-10-14T18:56:57.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83015a620 0x7fc83014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc83015d580 0x7fc83014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300b1f90 con 0x7fc830157870 2023-10-14T18:56:57.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014f2f0 con 0x7fc83015a620 2023-10-14T18:56:57.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc837cf7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014e9c0 con 0x7fc83015d580 2023-10-14T18:56:57.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc835a93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc835a93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54162/0 (socket says 172.21.15.79:54162) 2023-10-14T18:56:57.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.697+0000 7fc835a93700 1 -- 172.21.15.79:0/1860141289 learned_addr learned my addr 172.21.15.79:0/1860141289 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:57.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc836294700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc83015d580 0x7fc83014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835292700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83015a620 0x7fc83014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 -- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc83015d580 msgr2=0x7fc83014c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc83015d580 0x7fc83014c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 -- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83015a620 msgr2=0x7fc83014cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83015a620 0x7fc83014cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 -- 172.21.15.79:0/1860141289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280094f0 con 0x7fc830157870 2023-10-14T18:56:57.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc835a93700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cb60 tx=0x7fc82c0027b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c006ba0 con 0x7fc830157870 2023-10-14T18:56:57.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c006d20 con 0x7fc830157870 2023-10-14T18:56:57.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00aa00 con 0x7fc830157870 2023-10-14T18:56:57.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83014eca0 con 0x7fc830157870 2023-10-14T18:56:57.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.698+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8300b3560 con 0x7fc830157870 2023-10-14T18:56:57.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.699+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830063820 con 0x7fc830157870 2023-10-14T18:56:57.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.699+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc82c012420 con 0x7fc830157870 2023-10-14T18:56:57.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.700+0000 7fc825ffb700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:57.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.700+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc82c0841d0 con 0x7fc830157870 2023-10-14T18:56:57.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.700+0000 7fc835292700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:57.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.700+0000 7fc835292700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc83014e630 tx=0x7fc820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:57.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.704+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc82c051740 con 0x7fc830157870 2023-10-14T18:56:57.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.894+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8300cdd40 con 0x7fc814066f30 2023-10-14T18:56:57.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.895+0000 7fc825ffb700 1 -- 172.21.15.79:0/1860141289 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc8300cdd40 con 0x7fc814066f30 2023-10-14T18:56:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.896+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 msgr2=0x7fc8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.896+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 0x7fc8140693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc83014e630 tx=0x7fc820008040 comp rx=0 tx=0).stop 2023-10-14T18:56:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.896+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 msgr2=0x7fc8300b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:57.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.896+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cb60 tx=0x7fc82c0027b0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 shutdown_connections 2023-10-14T18:56:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fc814066f30 0x7fc8140693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc83015d580 0x7fc83014c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc830157870 0x7fc8300b2f80 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 --2- 172.21.15.79:0/1860141289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83015a620 0x7fc83014cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 >> 172.21.15.79:0/1860141289 conn(0x7fc830068ce0 msgr2=0x7fc830155770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 shutdown_connections 2023-10-14T18:56:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:57.897+0000 7fc837cf7700 1 -- 172.21.15.79:0/1860141289 wait complete. 2023-10-14T18:56:57.900 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T18:56:57.909 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T18:56:57.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:56:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.027+0000 7f08d4fe0700 1 Processor -- start 2023-10-14T18:56:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.027+0000 7f08d4fe0700 1 -- start start 2023-10-14T18:56:58.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08d0159ef0 0x7f08d015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d00b6a10 0x7f08d00b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b15e0 0x7f08d00b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00b1a60 con 0x7f08d00b6a10 2023-10-14T18:56:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00b1d40 con 0x7f08d0159ef0 2023-10-14T18:56:58.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08d4fe0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00b2020 con 0x7f08d00b15e0 2023-10-14T18:56:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d00b6a10 0x7f08d00b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08d00b6a10 0x7f08d00b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54172/0 (socket says 172.21.15.79:54172) 2023-10-14T18:56:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08ce59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08d0159ef0 0x7f08d015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 -- 172.21.15.79:0/4267482937 learned_addr learned my addr 172.21.15.79:0/4267482937 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:58.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08ced9d700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b15e0 0x7f08d00b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 -- 172.21.15.79:0/4267482937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b15e0 msgr2=0x7f08d00b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b15e0 0x7f08d00b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 -- 172.21.15.79:0/4267482937 >> v2:172.21.15.144:3300/0 conn(0x7f08d0159ef0 msgr2=0x7f08d015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/4267482937 >> v2:172.21.15.144:3300/0 conn(0x7f08d0159ef0 0x7f08d015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 -- 172.21.15.79:0/4267482937 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00b2300 con 0x7f08d00b6a10 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.028+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d00b6a10 0x7f08d00b10a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f08d008a710 tx=0x7f08c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e07414b6484eff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08cd59a700 1 -- 172.21.15.79:0/4267482937 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400b640 con 0x7f08d00b6a10 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08cd59a700 1 -- 172.21.15.79:0/4267482937 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400b7a0 con 0x7f08d00b6a10 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08cd59a700 1 -- 172.21.15.79:0/4267482937 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400bb60 con 0x7f08d00b6a10 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 -- 172.21.15.79:0/4267482937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d00b6a10 msgr2=0x7f08d00b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d00b6a10 0x7f08d00b10a0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f08d008a710 tx=0x7f08c4009250 comp rx=0 tx=0).stop 2023-10-14T18:56:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 -- 172.21.15.79:0/4267482937 shutdown_connections 2023-10-14T18:56:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b15e0 0x7f08d00b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/4267482937 >> v2:172.21.15.144:3300/0 conn(0x7f08d0159ef0 0x7f08d015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/4267482937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d00b6a10 0x7f08d00b10a0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 -- 172.21.15.79:0/4267482937 >> 172.21.15.79:0/4267482937 conn(0x7f08d009a0a0 msgr2=0x7f08d0067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 -- 172.21.15.79:0/4267482937 shutdown_connections 2023-10-14T18:56:58.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.029+0000 7f08d4fe0700 1 -- 172.21.15.79:0/4267482937 wait complete. 2023-10-14T18:56:58.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.030+0000 7f08d4fe0700 1 Processor -- start 2023-10-14T18:56:58.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.030+0000 7f08d4fe0700 1 -- start start 2023-10-14T18:56:58.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b6a10 0x7f08d0155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08d0159ef0 0x7f08d00af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 0x7f08d0158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d009cfb0 con 0x7f08d0156270 2023-10-14T18:56:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00b0190 con 0x7f08d0159ef0 2023-10-14T18:56:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08d4fe0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00afbd0 con 0x7f08d00b6a10 2023-10-14T18:56:58.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 0x7f08d0158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 0x7f08d0158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54186/0 (socket says 172.21.15.79:54186) 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 -- 172.21.15.79:0/1135694821 learned_addr learned my addr 172.21.15.79:0/1135694821 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08d0159ef0 0x7f08d00af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ce59c700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b6a10 0x7f08d0155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 -- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b6a10 msgr2=0x7f08d0155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f08d00b6a10 0x7f08d0155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 -- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08d0159ef0 msgr2=0x7f08d00af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08d0159ef0 0x7f08d00af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08ced9d700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40094f0 con 0x7f08d0156270 2023-10-14T18:56:58.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.031+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08d0159ef0 0x7f08d00af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08ced9d700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 0x7f08d0158950 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009e90 tx=0x7f08c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800cc20 con 0x7f08d0156270 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800f040 con 0x7f08d0156270 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00afeb0 con 0x7f08d0156270 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8014480 con 0x7f08d0156270 2023-10-14T18:56:58.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00aca50 con 0x7f08d0156270 2023-10-14T18:56:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.032+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08d004c3c0 con 0x7f08d0156270 2023-10-14T18:56:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.033+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08c8014830 con 0x7f08d0156270 2023-10-14T18:56:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.033+0000 7f08be7fc700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08b0066f30 0x7f08b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f08c8085380 con 0x7f08d0156270 2023-10-14T18:56:58.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08be7fc700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f08b006cd80 0x7f08b006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08ce59c700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08b0066f30 0x7f08b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08b006f860 con 0x7f08b006cd80 2023-10-14T18:56:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08c8085750 con 0x7f08d0156270 2023-10-14T18:56:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f08b006cd80 0x7f08b006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08cdd9b700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f08b006cd80 0x7f08b006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.034+0000 7f08ce59c700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08b0066f30 0x7f08b00693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f08d0159640 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.035+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== osd.1 v2:172.21.15.79:6822/86335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f08b006f860 con 0x7f08b006cd80 2023-10-14T18:56:58.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.047+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 --> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f08d006a0c0 con 0x7f08b006cd80 2023-10-14T18:56:58.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.047+0000 7f08be7fc700 1 -- 172.21.15.79:0/1135694821 <== osd.1 v2:172.21.15.79:6822/86335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f08d006a0c0 con 0x7f08b006cd80 2023-10-14T18:56:58.049 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:56:58.049 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f08b006cd80 msgr2=0x7f08b006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:6822/86335,v1:172.21.15.79:6823/86335] conn(0x7f08b006cd80 0x7f08b006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08b0066f30 msgr2=0x7f08b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f08b0066f30 0x7f08b00693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f08d0159640 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-10-14T18:56:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 msgr2=0x7f08d0158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 --2- 172.21.15.79:0/1135694821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08d0156270 0x7f08d0158950 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009e90 tx=0x7f08c800b040 comp rx=0 tx=0).stop 2023-10-14T18:56:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08ced9d700 1 -- 172.21.15.79:0/1135694821 reap_dead start 2023-10-14T18:56:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 shutdown_connections 2023-10-14T18:56:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 >> 172.21.15.79:0/1135694821 conn(0x7f08d009a0a0 msgr2=0x7f08d0157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 shutdown_connections 2023-10-14T18:56:58.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.048+0000 7f08d4fe0700 1 -- 172.21.15.79:0/1135694821 wait complete. 2023-10-14T18:56:58.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T18:56:58.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.174+0000 7fe811682700 1 Processor -- start 2023-10-14T18:56:58.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.174+0000 7fe811682700 1 -- start start 2023-10-14T18:56:58.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe811682700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe80c157870 0x7fe80c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe811682700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 0x7fe80c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe811682700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c15cbb0 con 0x7fe80c15a620 2023-10-14T18:56:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe811682700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c15bfa0 con 0x7fe80c157870 2023-10-14T18:56:58.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe811682700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c15c280 con 0x7fe80c157c40 2023-10-14T18:56:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe80affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe80c157870 0x7fe80c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe80a7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe80c15a620 0x7fe80c15d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47982/0 (socket says 172.21.15.79:47982) 2023-10-14T18:56:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.175+0000 7fe80a7fc700 1 -- 172.21.15.79:0/340063054 learned_addr learned my addr 172.21.15.79:0/340063054 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80affd700 1 -- 172.21.15.79:0/340063054 >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 msgr2=0x7fe80c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:58.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80b7fe700 1 --2- 172.21.15.79:0/340063054 >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 0x7fe80c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80affd700 1 --2- 172.21.15.79:0/340063054 >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 0x7fe80c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80affd700 1 -- 172.21.15.79:0/340063054 >> v1:172.21.15.79:6789/0 conn(0x7fe80c15a620 legacy=0x7fe80c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe809ffb700 1 -- 172.21.15.79:0/340063054 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601805407 0 0) 0x7fe80c15cbb0 con 0x7fe80c15a620 2023-10-14T18:56:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80affd700 1 -- 172.21.15.79:0/340063054 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c15c560 con 0x7fe80c157870 2023-10-14T18:56:58.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80b7fe700 1 --2- 172.21.15.79:0/340063054 >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 0x7fe80c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe80affd700 1 --2- 172.21.15.79:0/340063054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c157870 0x7fe80c15b6a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06b4e0 tx=0x7fe7fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b30dbdfdcbefcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe809ffb700 1 -- 172.21.15.79:0/340063054 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00e070 con 0x7fe80c157870 2023-10-14T18:56:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe809ffb700 1 -- 172.21.15.79:0/340063054 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00bc30 con 0x7fe80c157870 2023-10-14T18:56:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe809ffb700 1 -- 172.21.15.79:0/340063054 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc012430 con 0x7fe80c157870 2023-10-14T18:56:58.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe811682700 1 -- 172.21.15.79:0/340063054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c157870 msgr2=0x7fe80c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.176+0000 7fe811682700 1 --2- 172.21.15.79:0/340063054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c157870 0x7fe80c15b6a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06b4e0 tx=0x7fe7fc009780 comp rx=0 tx=0).stop 2023-10-14T18:56:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 -- 172.21.15.79:0/340063054 shutdown_connections 2023-10-14T18:56:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 --2- 172.21.15.79:0/340063054 >> v2:172.21.15.144:3300/0 conn(0x7fe80c157c40 0x7fe80c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 --2- 172.21.15.79:0/340063054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c157870 0x7fe80c15b6a0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 -- 172.21.15.79:0/340063054 >> 172.21.15.79:0/340063054 conn(0x7fe80c068ce0 msgr2=0x7fe80c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 -- 172.21.15.79:0/340063054 shutdown_connections 2023-10-14T18:56:58.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.177+0000 7fe811682700 1 -- 172.21.15.79:0/340063054 wait complete. 2023-10-14T18:56:58.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 Processor -- start 2023-10-14T18:56:58.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 -- start start 2023-10-14T18:56:58.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 0x7fe80c160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 0x7fe80c0a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0a9910 con 0x7fe80c15a620 2023-10-14T18:56:58.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0a8870 con 0x7fe80c157c40 2023-10-14T18:56:58.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.178+0000 7fe811682700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0a8b50 con 0x7fe80c157870 2023-10-14T18:56:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54210/0 (socket says 172.21.15.79:54210) 2023-10-14T18:56:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 -- 172.21.15.79:0/3567889022 learned_addr learned my addr 172.21.15.79:0/3567889022 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80affd700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 0x7fe80c160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80a7fc700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 0x7fe80c0a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 -- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 msgr2=0x7fe80c160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 0x7fe80c160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 -- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 msgr2=0x7fe80c0a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 0x7fe80c0a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 -- 172.21.15.79:0/3567889022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009a20 con 0x7fe80c15a620 2023-10-14T18:56:58.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80affd700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 0x7fe80c160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80a7fc700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 0x7fe80c0a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe80b7fe700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c880 tx=0x7fe804008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804011600 con 0x7fe80c15a620 2023-10-14T18:56:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804011780 con 0x7fe80c15a620 2023-10-14T18:56:58.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0a8e30 con 0x7fe80c15a620 2023-10-14T18:56:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804011b40 con 0x7fe80c15a620 2023-10-14T18:56:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.179+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0a91c0 con 0x7fe80c15a620 2023-10-14T18:56:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.180+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0a8620 con 0x7fe80c15a620 2023-10-14T18:56:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.180+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe804018360 con 0x7fe80c15a620 2023-10-14T18:56:58.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.181+0000 7fe802ffd700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.181+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe804084030 con 0x7fe80c15a620 2023-10-14T18:56:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.181+0000 7fe80affd700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.181+0000 7fe80affd700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 0x7fe7ec0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06b4e0 tx=0x7fe7fc019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.185+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8040515a0 con 0x7fe80c15a620 2023-10-14T18:56:58.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.368+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe80c04c3c0 con 0x7fe7ec066f30 2023-10-14T18:56:58.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.369+0000 7fe802ffd700 1 -- 172.21.15.79:0/3567889022 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe80c04c3c0 con 0x7fe7ec066f30 2023-10-14T18:56:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 msgr2=0x7fe7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 0x7fe7ec0693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06b4e0 tx=0x7fe7fc019000 comp rx=0 tx=0).stop 2023-10-14T18:56:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 msgr2=0x7fe80c1486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c880 tx=0x7fe804008040 comp rx=0 tx=0).stop 2023-10-14T18:56:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 shutdown_connections 2023-10-14T18:56:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe7ec066f30 0x7fe7ec0693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe80c15a620 0x7fe80c1486e0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe80c157870 0x7fe80c160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 --2- 172.21.15.79:0/3567889022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80c157c40 0x7fe80c0a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 >> 172.21.15.79:0/3567889022 conn(0x7fe80c068ce0 msgr2=0x7fe80c0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 shutdown_connections 2023-10-14T18:56:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.371+0000 7fe811682700 1 -- 172.21.15.79:0/3567889022 wait complete. 2023-10-14T18:56:58.375 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T18:56:58.383 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T18:56:58.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:56:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.502+0000 7faa46b0f700 1 Processor -- start 2023-10-14T18:56:58.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.502+0000 7faa46b0f700 1 -- start start 2023-10-14T18:56:58.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa46b0f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa400ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa46b0f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400cbb80 con 0x7faa4015d240 2023-10-14T18:56:58.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa46b0f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400cbe60 con 0x7faa400ce810 2023-10-14T18:56:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa46b0f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400cc140 con 0x7faa400cc940 2023-10-14T18:56:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa45b0d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faa4015d240 0x7faa400b3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47336/0 (socket says 172.21.15.79:47336) 2023-10-14T18:56:58.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa45b0d700 1 -- 172.21.15.79:0/2146481076 learned_addr learned my addr 172.21.15.79:0/2146481076 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa4530c700 1 --2- 172.21.15.79:0/2146481076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa400ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890337364 0 0) 0x7faa400cbb80 con 0x7faa4015d240 2023-10-14T18:56:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c003570 con 0x7faa4015d240 2023-10-14T18:56:58.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.503+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154034971 0 0) 0x7faa400cbe60 con 0x7faa400ce810 2023-10-14T18:56:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa400cbb80 con 0x7faa400ce810 2023-10-14T18:56:58.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187890856 0 0) 0x7faa2c003570 con 0x7faa4015d240 2023-10-14T18:56:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa4530c700 1 -- 172.21.15.79:0/2146481076 >> v1:172.21.15.144:6789/0 conn(0x7faa400ce810 legacy=0x7faa400cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa4530c700 1 -- 172.21.15.79:0/2146481076 >> v1:172.21.15.79:6789/0 conn(0x7faa4015d240 legacy=0x7faa400b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa4530c700 1 -- 172.21.15.79:0/2146481076 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400cc420 con 0x7faa400cc940 2023-10-14T18:56:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa4530c700 1 --2- 172.21.15.79:0/2146481076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa400ccdb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa30009910 tx=0x7faa300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55940d5e7fa49732 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0015f0 con 0x7faa400cc940 2023-10-14T18:56:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30011420 con 0x7faa400cc940 2023-10-14T18:56:58.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa44b0b700 1 -- 172.21.15.79:0/2146481076 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300117c0 con 0x7faa400cc940 2023-10-14T18:56:58.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa46b0f700 1 -- 172.21.15.79:0/2146481076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 msgr2=0x7faa400ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.504+0000 7faa46b0f700 1 --2- 172.21.15.79:0/2146481076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa400ccdb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa30009910 tx=0x7faa300091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.505+0000 7faa46b0f700 1 -- 172.21.15.79:0/2146481076 shutdown_connections 2023-10-14T18:56:58.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.505+0000 7faa46b0f700 1 --2- 172.21.15.79:0/2146481076 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa400ccdb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.505+0000 7faa46b0f700 1 -- 172.21.15.79:0/2146481076 >> 172.21.15.79:0/2146481076 conn(0x7faa40067e40 msgr2=0x7faa400d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.505+0000 7faa46b0f700 1 -- 172.21.15.79:0/2146481076 shutdown_connections 2023-10-14T18:56:58.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.505+0000 7faa46b0f700 1 -- 172.21.15.79:0/2146481076 wait complete. 2023-10-14T18:56:58.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 Processor -- start 2023-10-14T18:56:58.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 -- start start 2023-10-14T18:56:58.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa40146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa400ce810 0x7faa4009a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 0x7faa4009ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c8ac0 con 0x7faa4015d240 2023-10-14T18:56:58.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009d1e0 con 0x7faa400ce810 2023-10-14T18:56:58.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa46b0f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4009c8f0 con 0x7faa400cc940 2023-10-14T18:56:58.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.506+0000 7faa4630e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 0x7faa4009ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 0x7faa4009ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47758/0 (socket says 172.21.15.79:47758) 2023-10-14T18:56:58.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 -- 172.21.15.79:0/3709314901 learned_addr learned my addr 172.21.15.79:0/3709314901 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:58.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa45b0d700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa40146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4530c700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa400ce810 0x7faa4009a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 -- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 msgr2=0x7faa40146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faa400cc940 0x7faa40146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 -- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa400ce810 msgr2=0x7faa4009a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa400ce810 0x7faa4009a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30009420 con 0x7faa4015d240 2023-10-14T18:56:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa4630e700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 0x7faa4009ad50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c860 tx=0x7faa38002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38002030 con 0x7faa4015d240 2023-10-14T18:56:58.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380021b0 con 0x7faa4015d240 2023-10-14T18:56:58.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38012630 con 0x7faa4015d240 2023-10-14T18:56:58.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.507+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4009cb90 con 0x7faa4015d240 2023-10-14T18:56:58.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.508+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400b69e0 con 0x7faa4015d240 2023-10-14T18:56:58.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.508+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa400c6c00 con 0x7faa4015d240 2023-10-14T18:56:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa38012a20 con 0x7faa4015d240 2023-10-14T18:56:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa24066f30 0x7faa240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7faa38084170 con 0x7faa4015d240 2023-10-14T18:56:58.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7faa2406cd80 0x7faa2406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa2406f860 con 0x7faa2406cd80 2023-10-14T18:56:58.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa380867b0 con 0x7faa4015d240 2023-10-14T18:56:58.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa45b0d700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa24066f30 0x7faa240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.509+0000 7faa4530c700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7faa2406cd80 0x7faa2406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.510+0000 7faa4530c700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7faa2406cd80 0x7faa2406f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.510+0000 7faa45b0d700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa24066f30 0x7faa240693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006ce0 tx=0x7faa3c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.510+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== osd.2 v2:172.21.15.79:6800/86333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7faa2406f860 con 0x7faa2406cd80 2023-10-14T18:56:58.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.522+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 --> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faa4006ac60 con 0x7faa2406cd80 2023-10-14T18:56:58.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa35ffb700 1 -- 172.21.15.79:0/3709314901 <== osd.2 v2:172.21.15.79:6800/86333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7faa4006ac60 con 0x7faa2406cd80 2023-10-14T18:56:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:58.714 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:56:58.714 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:58.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7faa2406cd80 msgr2=0x7faa2406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:6800/86333,v1:172.21.15.79:6801/86333] conn(0x7faa2406cd80 0x7faa2406f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa24066f30 msgr2=0x7faa240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7faa24066f30 0x7faa240693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7faa3c006ce0 tx=0x7faa3c0012c0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 msgr2=0x7faa4009ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 --2- 172.21.15.79:0/3709314901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa4015d240 0x7faa4009ad50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c860 tx=0x7faa38002700 comp rx=0 tx=0).stop 2023-10-14T18:56:58.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa4630e700 1 -- 172.21.15.79:0/3709314901 reap_dead start 2023-10-14T18:56:58.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 shutdown_connections 2023-10-14T18:56:58.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 >> 172.21.15.79:0/3709314901 conn(0x7faa40067e40 msgr2=0x7faa40157ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 shutdown_connections 2023-10-14T18:56:58.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.523+0000 7faa46b0f700 1 -- 172.21.15.79:0/3709314901 wait complete. 2023-10-14T18:56:58.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T18:56:58.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.839+0000 7fd02107e700 1 Processor -- start 2023-10-14T18:56:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.839+0000 7fd02107e700 1 -- start start 2023-10-14T18:56:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd02107e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd01c15a620 0x7fd01c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd02107e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c15cbb0 con 0x7fd01c157870 2023-10-14T18:56:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd02107e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c15bfa0 con 0x7fd01c15d580 2023-10-14T18:56:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd02107e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c15bdb0 con 0x7fd01c15a620 2023-10-14T18:56:58.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01ad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd01c157870 0x7fd01c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47342/0 (socket says 172.21.15.79:47342) 2023-10-14T18:56:58.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01ad9d700 1 -- 172.21.15.79:0/1001676077 learned_addr learned my addr 172.21.15.79:0/1001676077 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:58.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01259c700 1 --2- 172.21.15.79:0/1001676077 >> v2:172.21.15.79:3300/0 conn(0x7fd01c15a620 0x7fd01c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01a59c700 1 -- 172.21.15.79:0/1001676077 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760090303 0 0) 0x7fd01c15cbb0 con 0x7fd01c157870 2023-10-14T18:56:58.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01a59c700 1 -- 172.21.15.79:0/1001676077 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd008003570 con 0x7fd01c157870 2023-10-14T18:56:58.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01259c700 1 -- 172.21.15.79:0/1001676077 >> v1:172.21.15.144:6789/0 conn(0x7fd01c15d580 legacy=0x7fd01c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:58.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01259c700 1 -- 172.21.15.79:0/1001676077 >> v1:172.21.15.79:6789/0 conn(0x7fd01c157870 legacy=0x7fd01c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.840+0000 7fd01259c700 1 -- 172.21.15.79:0/1001676077 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c15c280 con 0x7fd01c15a620 2023-10-14T18:56:58.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd01259c700 1 --2- 172.21.15.79:0/1001676077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c15a620 0x7fd01c15d040 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd0040098e0 tx=0x7fd0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97118b71a5700b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd01a59c700 1 -- 172.21.15.79:0/1001676077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004011630 con 0x7fd01c15a620 2023-10-14T18:56:58.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd01a59c700 1 -- 172.21.15.79:0/1001676077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004011790 con 0x7fd01c15a620 2023-10-14T18:56:58.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd01a59c700 1 -- 172.21.15.79:0/1001676077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004011b30 con 0x7fd01c15a620 2023-10-14T18:56:58.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 -- 172.21.15.79:0/1001676077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c15a620 msgr2=0x7fd01c15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 --2- 172.21.15.79:0/1001676077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c15a620 0x7fd01c15d040 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd0040098e0 tx=0x7fd0040091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 -- 172.21.15.79:0/1001676077 shutdown_connections 2023-10-14T18:56:58.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 --2- 172.21.15.79:0/1001676077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c15a620 0x7fd01c15d040 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 -- 172.21.15.79:0/1001676077 >> 172.21.15.79:0/1001676077 conn(0x7fd01c068ce0 msgr2=0x7fd01c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:58.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 -- 172.21.15.79:0/1001676077 shutdown_connections 2023-10-14T18:56:58.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.841+0000 7fd02107e700 1 -- 172.21.15.79:0/1001676077 wait complete. 2023-10-14T18:56:58.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.842+0000 7fd02107e700 1 Processor -- start 2023-10-14T18:56:58.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 -- start start 2023-10-14T18:56:58.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 0x7fd01c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 0x7fd01c15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c149e20 con 0x7fd01c157870 2023-10-14T18:56:58.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b4970 con 0x7fd01c15a620 2023-10-14T18:56:58.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd02107e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c0b1990 con 0x7fd01c15d580 2023-10-14T18:56:58.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd01ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd01ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47766/0 (socket says 172.21.15.79:47766) 2023-10-14T18:56:58.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.843+0000 7fd01ad9d700 1 -- 172.21.15.79:0/1352540925 learned_addr learned my addr 172.21.15.79:0/1352540925 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:58.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01259c700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 0x7fd01c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 -- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 msgr2=0x7fd01c15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01b59e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 0x7fd01c15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 0x7fd01c15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 -- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 msgr2=0x7fd01c15f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:58.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 0x7fd01c15f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:58.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 -- 172.21.15.79:0/1352540925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009420 con 0x7fd01c157870 2023-10-14T18:56:58.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01259c700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 0x7fd01c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:58.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01b59e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 0x7fd01c15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:58.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd01ad9d700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c7c0 tx=0x7fd00c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c005b30 con 0x7fd01c157870 2023-10-14T18:56:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c005c90 con 0x7fd01c157870 2023-10-14T18:56:58.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c13cd90 con 0x7fd01c157870 2023-10-14T18:56:58.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c007340 con 0x7fd01c157870 2023-10-14T18:56:58.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.844+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c0d1130 con 0x7fd01c157870 2023-10-14T18:56:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.845+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c04c3c0 con 0x7fd01c157870 2023-10-14T18:56:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.845+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd00c01b400 con 0x7fd01c157870 2023-10-14T18:56:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.846+0000 7fd0137fe700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:58.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.846+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd00c083d40 con 0x7fd01c157870 2023-10-14T18:56:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.846+0000 7fd01259c700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:58.870 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.846+0000 7fd01259c700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 0x7fcffc0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd01c15aa20 tx=0x7fd004016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:58.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:58.850+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd00c051330 con 0x7fd01c157870 2023-10-14T18:56:59.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.030+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd01c15c560 con 0x7fcffc066f30 2023-10-14T18:56:59.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.031+0000 7fd0137fe700 1 -- 172.21.15.79:0/1352540925 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd01c15c560 con 0x7fcffc066f30 2023-10-14T18:56:59.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.032+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 msgr2=0x7fcffc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.032+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 0x7fcffc0693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd01c15aa20 tx=0x7fd004016000 comp rx=0 tx=0).stop 2023-10-14T18:56:59.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.032+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 msgr2=0x7fd01c13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.032+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c7c0 tx=0x7fd00c007e00 comp rx=0 tx=0).stop 2023-10-14T18:56:59.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 shutdown_connections 2023-10-14T18:56:59.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcffc066f30 0x7fcffc0693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd01c15d580 0x7fd01c15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01c157870 0x7fd01c13c850 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 --2- 172.21.15.79:0/1352540925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd01c15a620 0x7fd01c15f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 >> 172.21.15.79:0/1352540925 conn(0x7fd01c068ce0 msgr2=0x7fd01c063380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 shutdown_connections 2023-10-14T18:56:59.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.033+0000 7fd02107e700 1 -- 172.21.15.79:0/1352540925 wait complete. 2023-10-14T18:56:59.037 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T18:56:59.045 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T18:56:59.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:56:59.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.163+0000 7f4076cfd700 1 Processor -- start 2023-10-14T18:56:59.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.163+0000 7f4076cfd700 1 -- start start 2023-10-14T18:56:59.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4076cfd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f40700b6a10 0x7f407015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4076cfd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f40700b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4076cfd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40700b5070 con 0x7f4070159ef0 2023-10-14T18:56:59.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4076cfd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700b17b0 con 0x7f40700b6a10 2023-10-14T18:56:59.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4076cfd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b1a60 con 0x7f40700b46f0 2023-10-14T18:56:59.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4074a99700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4070159ef0 0x7f40700b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47346/0 (socket says 172.21.15.79:47346) 2023-10-14T18:56:59.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.164+0000 7f4074a99700 1 -- 172.21.15.79:0/390476795 learned_addr learned my addr 172.21.15.79:0/390476795 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:59.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f40700b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406ffff700 1 --2- 172.21.15.79:0/390476795 >> v2:172.21.15.144:3300/0 conn(0x7f40700b6a10 0x7f407015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712429220 0 0) 0x7f40700b5070 con 0x7f4070159ef0 2023-10-14T18:56:59.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c003570 con 0x7f4070159ef0 2023-10-14T18:56:59.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3654124369 0 0) 0x7f405c003570 con 0x7f4070159ef0 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 msgr2=0x7f40700b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f40700b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 >> v2:172.21.15.144:3300/0 conn(0x7f40700b6a10 msgr2=0x7f407015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 --2- 172.21.15.79:0/390476795 >> v2:172.21.15.144:3300/0 conn(0x7f40700b6a10 0x7f407015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700b1d40 con 0x7f4070159ef0 2023-10-14T18:56:59.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f4060001970 con 0x7f4070159ef0 2023-10-14T18:56:59.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 >> v1:172.21.15.79:6789/0 conn(0x7f4070159ef0 legacy=0x7f40700b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f405c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c003fe0 0x7f405c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f405c004d50 0x7f405c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b17b0 con 0x7f405c004d50 2023-10-14T18:56:59.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b1a60 con 0x7f405c003fe0 2023-10-14T18:56:59.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c00ba90 con 0x7f40700b46f0 2023-10-14T18:56:59.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f405c004d50 0x7f405c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f406ffff700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c003fe0 0x7f405c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f4074a99700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f405c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 -- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 msgr2=0x7f405c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f40700b46f0 0x7f405c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 -- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c003fe0 msgr2=0x7f405c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c003fe0 0x7f405c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.165+0000 7f407529a700 1 -- 172.21.15.79:0/390476795 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c003570 con 0x7f405c004d50 2023-10-14T18:56:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f407529a700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f405c004d50 0x7f405c0051c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4068009c00 tx=0x7f40680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b542519b54fc7ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800e6b0 con 0x7f405c004d50 2023-10-14T18:56:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800e810 con 0x7f405c004d50 2023-10-14T18:56:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f406f7fe700 1 -- 172.21.15.79:0/390476795 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800ebd0 con 0x7f405c004d50 2023-10-14T18:56:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 -- 172.21.15.79:0/390476795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f405c004d50 msgr2=0x7f405c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 --2- 172.21.15.79:0/390476795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f405c004d50 0x7f405c0051c0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4068009c00 tx=0x7f40680091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f407529a700 1 -- 172.21.15.79:0/390476795 reap_dead start 2023-10-14T18:56:59.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 -- 172.21.15.79:0/390476795 shutdown_connections 2023-10-14T18:56:59.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 -- 172.21.15.79:0/390476795 >> 172.21.15.79:0/390476795 conn(0x7f407009a0a0 msgr2=0x7f4070067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 -- 172.21.15.79:0/390476795 shutdown_connections 2023-10-14T18:56:59.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.166+0000 7f4076cfd700 1 -- 172.21.15.79:0/390476795 wait complete. 2023-10-14T18:56:59.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.167+0000 7f4076cfd700 1 Processor -- start 2023-10-14T18:56:59.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 -- start start 2023-10-14T18:56:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f405c004d50 0x7f40701562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 0x7f407009de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f407009c340 0x7f407015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407009e7e0 con 0x7f40700af8e0 2023-10-14T18:56:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407009beb0 con 0x7f407009c340 2023-10-14T18:56:59.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f4076cfd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407009b5c0 con 0x7f405c004d50 2023-10-14T18:56:59.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f406ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 0x7f407009de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f406ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 0x7f407009de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47788/0 (socket says 172.21.15.79:47788) 2023-10-14T18:56:59.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.168+0000 7f406ffff700 1 -- 172.21.15.79:0/3592288650 learned_addr learned my addr 172.21.15.79:0/3592288650 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f407529a700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f407009c340 0x7f407015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f4074a99700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f405c004d50 0x7f40701562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 -- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f405c004d50 msgr2=0x7f40701562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f405c004d50 0x7f40701562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 -- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f407009c340 msgr2=0x7f407015fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f407009c340 0x7f407015fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.183 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407009b860 con 0x7f40700af8e0 2023-10-14T18:56:59.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f407529a700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f407009c340 0x7f407015fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:59.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f4074a99700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f405c004d50 0x7f40701562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:59.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406ffff700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 0x7f407009de90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4058011a40 tx=0x7f40580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800f940 con 0x7f40700af8e0 2023-10-14T18:56:59.184 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800faa0 con 0x7f40700af8e0 2023-10-14T18:56:59.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800fe20 con 0x7f40700af8e0 2023-10-14T18:56:59.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407009bb40 con 0x7f40700af8e0 2023-10-14T18:56:59.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.169+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407009c7e0 con 0x7f40700af8e0 2023-10-14T18:56:59.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.170+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f407004c3c0 con 0x7f40700af8e0 2023-10-14T18:56:59.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.170+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4058014650 con 0x7f40700af8e0 2023-10-14T18:56:59.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f406cff9700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4050066f30 0x7f40500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4058018030 con 0x7f40700af8e0 2023-10-14T18:56:59.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f406cff9700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7f405006cd80 0x7f405006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f405006f860 con 0x7f405006cd80 2023-10-14T18:56:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4058089240 con 0x7f40700af8e0 2023-10-14T18:56:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f407529a700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7f405006cd80 0x7f405006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f4074a99700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4050066f30 0x7f40500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.171+0000 7f407529a700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7f405006cd80 0x7f405006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.172+0000 7f4074a99700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4050066f30 0x7f40500693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4060007db0 tx=0x7f4060009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.172+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== osd.3 v2:172.21.15.79:6816/86334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f405006f860 con 0x7f405006cd80 2023-10-14T18:56:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.184+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 --> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f407009bcd0 con 0x7f405006cd80 2023-10-14T18:56:59.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.184+0000 7f406cff9700 1 -- 172.21.15.79:0/3592288650 <== osd.3 v2:172.21.15.79:6816/86334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f407009bcd0 con 0x7f405006cd80 2023-10-14T18:56:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:59.189 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:56:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:59.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7f405006cd80 msgr2=0x7f405006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:6816/86334,v1:172.21.15.79:6817/86334] conn(0x7f405006cd80 0x7f405006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4050066f30 msgr2=0x7f40500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4050066f30 0x7f40500693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4060007db0 tx=0x7f4060009040 comp rx=0 tx=0).stop 2023-10-14T18:56:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 msgr2=0x7f407009de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 --2- 172.21.15.79:0/3592288650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40700af8e0 0x7f407009de90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4058011a40 tx=0x7f40580091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f407529a700 1 -- 172.21.15.79:0/3592288650 reap_dead start 2023-10-14T18:56:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 shutdown_connections 2023-10-14T18:56:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 >> 172.21.15.79:0/3592288650 conn(0x7f407009a0a0 msgr2=0x7f407015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 shutdown_connections 2023-10-14T18:56:59.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.185+0000 7f4076cfd700 1 -- 172.21.15.79:0/3592288650 wait complete. 2023-10-14T18:56:59.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T18:56:59.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.313+0000 7f6927286700 1 Processor -- start 2023-10-14T18:56:59.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.313+0000 7f6927286700 1 -- start start 2023-10-14T18:56:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6927286700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6920159da0 0x7f69200b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6927286700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f692015a170 0x7f6920068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6927286700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69200694a0 con 0x7f6920069040 2023-10-14T18:56:59.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6927286700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692015ea70 con 0x7f692015a170 2023-10-14T18:56:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6927286700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69200b3990 con 0x7f6920159da0 2023-10-14T18:56:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f692015a170 0x7f6920068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f692015a170 0x7f6920068b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47796/0 (socket says 172.21.15.79:47796) 2023-10-14T18:56:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6926a85700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6920069040 0x7f69200af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47360/0 (socket says 172.21.15.79:47360) 2023-10-14T18:56:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 -- 172.21.15.79:0/706595622 learned_addr learned my addr 172.21.15.79:0/706595622 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 -- 172.21.15.79:0/706595622 >> v2:172.21.15.144:3300/0 conn(0x7f6920159da0 msgr2=0x7f69200b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 --2- 172.21.15.79:0/706595622 >> v2:172.21.15.144:3300/0 conn(0x7f6920159da0 0x7f69200b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 -- 172.21.15.79:0/706595622 >> v1:172.21.15.79:6789/0 conn(0x7f6920069040 legacy=0x7f69200af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 -- 172.21.15.79:0/706595622 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200b0b70 con 0x7f692015a170 2023-10-14T18:56:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925282700 1 -- 172.21.15.79:0/706595622 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883893674 0 0) 0x7f6918001110 con 0x7f6920069040 2023-10-14T18:56:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925a83700 1 --2- 172.21.15.79:0/706595622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f692015a170 0x7f6920068b00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f692006b290 tx=0x7f6910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed6090a307fc04a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925282700 1 -- 172.21.15.79:0/706595622 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000b860 con 0x7f692015a170 2023-10-14T18:56:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925282700 1 -- 172.21.15.79:0/706595622 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000b9c0 con 0x7f692015a170 2023-10-14T18:56:59.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.314+0000 7f6925282700 1 -- 172.21.15.79:0/706595622 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000bd80 con 0x7f692015a170 2023-10-14T18:56:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 -- 172.21.15.79:0/706595622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f692015a170 msgr2=0x7f6920068b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 --2- 172.21.15.79:0/706595622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f692015a170 0x7f6920068b00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f692006b290 tx=0x7f6910009250 comp rx=0 tx=0).stop 2023-10-14T18:56:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 -- 172.21.15.79:0/706595622 shutdown_connections 2023-10-14T18:56:59.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 --2- 172.21.15.79:0/706595622 >> v2:172.21.15.144:3300/0 conn(0x7f6920159da0 0x7f69200b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 --2- 172.21.15.79:0/706595622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f692015a170 0x7f6920068b00 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 -- 172.21.15.79:0/706595622 >> 172.21.15.79:0/706595622 conn(0x7f69200d0bc0 msgr2=0x7f69200d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 -- 172.21.15.79:0/706595622 shutdown_connections 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.315+0000 7f6927286700 1 -- 172.21.15.79:0/706595622 wait complete. 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.316+0000 7f6927286700 1 Processor -- start 2023-10-14T18:56:59.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.316+0000 7f6927286700 1 -- start start 2023-10-14T18:56:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6920069040 0x7f6920145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 0x7f69200c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200ca1e0 con 0x7f6920159da0 2023-10-14T18:56:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c95d0 con 0x7f692015a170 2023-10-14T18:56:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6927286700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c98b0 con 0x7f6920069040 2023-10-14T18:56:59.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47804/0 (socket says 172.21.15.79:47804) 2023-10-14T18:56:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 -- 172.21.15.79:0/1862522418 learned_addr learned my addr 172.21.15.79:0/1862522418 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 -- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6920069040 msgr2=0x7f6920145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6920069040 0x7f6920145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 -- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 msgr2=0x7f69200c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6926a85700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 0x7f69200c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 0x7f69200c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 -- 172.21.15.79:0/1862522418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100094f0 con 0x7f6920159da0 2023-10-14T18:56:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6926a85700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 0x7f69200c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:56:59.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.317+0000 7f6925a83700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6910009880 tx=0x7f6910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.318+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910026450 con 0x7f6920159da0 2023-10-14T18:56:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.318+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69100265b0 con 0x7f6920159da0 2023-10-14T18:56:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.318+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69200c9b90 con 0x7f6920159da0 2023-10-14T18:56:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.318+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910026970 con 0x7f6920159da0 2023-10-14T18:56:59.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.318+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69200ca670 con 0x7f6920159da0 2023-10-14T18:56:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.319+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69200ca4c0 con 0x7f6920159da0 2023-10-14T18:56:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.319+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f691001a420 con 0x7f6920159da0 2023-10-14T18:56:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.319+0000 7f69167fc700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 0x7f69040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.320+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6910086040 con 0x7f6920159da0 2023-10-14T18:56:59.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.320+0000 7f6926284700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 0x7f69040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.320+0000 7f6926284700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 0x7f69040693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f691c00acf0 tx=0x7f691c009370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.324+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6910053630 con 0x7f6920159da0 2023-10-14T18:56:59.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.508+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f69200ca320 con 0x7f6904066f30 2023-10-14T18:56:59.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.509+0000 7f69167fc700 1 -- 172.21.15.79:0/1862522418 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f691c008d40 con 0x7f6904066f30 2023-10-14T18:56:59.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 msgr2=0x7f69040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 0x7f69040693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f691c00acf0 tx=0x7f691c009370 comp rx=0 tx=0).stop 2023-10-14T18:56:59.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 msgr2=0x7f69200c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6910009880 tx=0x7f6910017000 comp rx=0 tx=0).stop 2023-10-14T18:56:59.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 shutdown_connections 2023-10-14T18:56:59.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f6904066f30 0x7f69040693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692015a170 0x7f69200c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6920069040 0x7f6920145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 --2- 172.21.15.79:0/1862522418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920159da0 0x7f69200c8ba0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 >> 172.21.15.79:0/1862522418 conn(0x7f69200d0bc0 msgr2=0x7f69201583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 shutdown_connections 2023-10-14T18:56:59.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.511+0000 7f6927286700 1 -- 172.21.15.79:0/1862522418 wait complete. 2023-10-14T18:56:59.517 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T18:56:59.523 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T18:56:59.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:56:59.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.642+0000 7f1f946f6700 1 Processor -- start 2023-10-14T18:56:59.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.642+0000 7f1f946f6700 1 -- start start 2023-10-14T18:56:59.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f946f6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f8c0b6a10 0x7f1f8c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f946f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f8c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f946f6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0b5070 con 0x7f1f8c159ef0 2023-10-14T18:56:59.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f946f6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b17b0 con 0x7f1f8c0b6a10 2023-10-14T18:56:59.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f946f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b1a60 con 0x7f1f8c0b46f0 2023-10-14T18:56:59.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f92492700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1f8c159ef0 0x7f1f8c0b10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47366/0 (socket says 172.21.15.79:47366) 2023-10-14T18:56:59.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f92492700 1 -- 172.21.15.79:0/2458121553 learned_addr learned my addr 172.21.15.79:0/2458121553 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:56:59.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91c91700 1 --2- 172.21.15.79:0/2458121553 >> v2:172.21.15.144:3300/0 conn(0x7f1f8c0b6a10 0x7f1f8c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f92c93700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f8c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156027040 0 0) 0x7f1f8c0b5070 con 0x7f1f8c159ef0 2023-10-14T18:56:59.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f78003570 con 0x7f1f8c159ef0 2023-10-14T18:56:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975901317 0 0) 0x7f1f78003570 con 0x7f1f8c159ef0 2023-10-14T18:56:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 msgr2=0x7f1f8c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f8c0b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 >> v2:172.21.15.144:3300/0 conn(0x7f1f8c0b6a10 msgr2=0x7f1f8c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 --2- 172.21.15.79:0/2458121553 >> v2:172.21.15.144:3300/0 conn(0x7f1f8c0b6a10 0x7f1f8c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0b1d40 con 0x7f1f8c159ef0 2023-10-14T18:56:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7f1f880015f0 con 0x7f1f8c159ef0 2023-10-14T18:56:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 >> v1:172.21.15.79:6789/0 conn(0x7f1f8c159ef0 legacy=0x7f1f8c0b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f78003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f78003fe0 0x7f1f78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78004d50 0x7f1f780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b17b0 con 0x7f1f78003fe0 2023-10-14T18:56:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b1a60 con 0x7f1f78004d50 2023-10-14T18:56:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7800ba90 con 0x7f1f8c0b46f0 2023-10-14T18:56:59.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.643+0000 7f1f91c91700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f78003fe0 0x7f1f78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f92c93700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78004d50 0x7f1f780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f92492700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f78003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 -- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 msgr2=0x7f1f78003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f78003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 -- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78004d50 msgr2=0x7f1f780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78004d50 0x7f1f780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 -- 172.21.15.79:0/2458121553 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78003570 con 0x7f1f78003fe0 2023-10-14T18:56:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f92492700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c0b46f0 0x7f1f78003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91c91700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f78003fe0 0x7f1f78004810 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0b6e10 tx=0x7f1f7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a0da43063226d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00e6b0 con 0x7f1f78003fe0 2023-10-14T18:56:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c00e810 con 0x7f1f78003fe0 2023-10-14T18:56:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f91490700 1 -- 172.21.15.79:0/2458121553 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c00ebd0 con 0x7f1f78003fe0 2023-10-14T18:56:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f946f6700 1 -- 172.21.15.79:0/2458121553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f78003fe0 msgr2=0x7f1f78004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f946f6700 1 --2- 172.21.15.79:0/2458121553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f78003fe0 0x7f1f78004810 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0b6e10 tx=0x7f1f7c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f92c93700 1 -- 172.21.15.79:0/2458121553 reap_dead start 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f946f6700 1 -- 172.21.15.79:0/2458121553 shutdown_connections 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.644+0000 7f1f946f6700 1 -- 172.21.15.79:0/2458121553 >> 172.21.15.79:0/2458121553 conn(0x7f1f8c09a0a0 msgr2=0x7f1f8c067e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.645+0000 7f1f946f6700 1 -- 172.21.15.79:0/2458121553 shutdown_connections 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.645+0000 7f1f946f6700 1 -- 172.21.15.79:0/2458121553 wait complete. 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 Processor -- start 2023-10-14T18:56:59.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 -- start start 2023-10-14T18:56:59.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78003fe0 0x7f1f8c069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c06a120 0x7f1f8c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 0x7f1f8c14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c153df0 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c14d930 con 0x7f1f78003fe0 2023-10-14T18:56:59.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f946f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c151040 con 0x7f1f8c06a120 2023-10-14T18:56:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f92c93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 0x7f1f8c14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f92c93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 0x7f1f8c14fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47816/0 (socket says 172.21.15.79:47816) 2023-10-14T18:56:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.646+0000 7f1f92c93700 1 -- 172.21.15.79:0/3158188111 learned_addr learned my addr 172.21.15.79:0/3158188111 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f91c91700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c06a120 0x7f1f8c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92492700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78003fe0 0x7f1f8c069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 -- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c06a120 msgr2=0x7f1f8c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1f8c06a120 0x7f1f8c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 -- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78003fe0 msgr2=0x7f1f8c069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78003fe0 0x7f1f8c069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c1507a0 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92492700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f78003fe0 0x7f1f8c069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f92c93700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 0x7f1f8c14fa70 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c09ece0 tx=0x7f1f8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400e070 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84011c30 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c150a80 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84016470 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.647+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c14ffb0 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.648+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f8c153bc0 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.648+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f840168a0 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f827fc700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f70066f30 0x7f1f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f84085a30 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f827fc700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7f1f7006cd80 0x7f1f7006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f7006f860 con 0x7f1f7006cd80 2023-10-14T18:56:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f92492700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f70066f30 0x7f1f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f84085e00 con 0x7f1f8c14d4e0 2023-10-14T18:56:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f91c91700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7f1f7006cd80 0x7f1f7006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.649+0000 7f1f92492700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f70066f30 0x7f1f700693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000ef0 tx=0x7f1f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.650+0000 7f1f91c91700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7f1f7006cd80 0x7f1f7006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.650+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== osd.4 v2:172.21.15.144:6804/86566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1f7006f860 con 0x7f1f7006cd80 2023-10-14T18:56:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.663+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 --> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1f8c04c3c0 con 0x7f1f7006cd80 2023-10-14T18:56:59.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.663+0000 7f1f827fc700 1 -- 172.21.15.79:0/3158188111 <== osd.4 v2:172.21.15.144:6804/86566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1f8c04c3c0 con 0x7f1f7006cd80 2023-10-14T18:56:59.666 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:56:59.667 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:56:59.667 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:56:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7f1f7006cd80 msgr2=0x7f1f7006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6804/86566,v1:172.21.15.144:6805/86566] conn(0x7f1f7006cd80 0x7f1f7006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f70066f30 msgr2=0x7f1f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1f70066f30 0x7f1f700693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1f88000ef0 tx=0x7f1f88009040 comp rx=0 tx=0).stop 2023-10-14T18:56:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 msgr2=0x7f1f8c14fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 --2- 172.21.15.79:0/3158188111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f8c14d4e0 0x7f1f8c14fa70 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c09ece0 tx=0x7f1f8400b040 comp rx=0 tx=0).stop 2023-10-14T18:56:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f92c93700 1 -- 172.21.15.79:0/3158188111 reap_dead start 2023-10-14T18:56:59.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 shutdown_connections 2023-10-14T18:56:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 >> 172.21.15.79:0/3158188111 conn(0x7f1f8c09a0a0 msgr2=0x7f1f8c14f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 shutdown_connections 2023-10-14T18:56:59.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.664+0000 7f1f946f6700 1 -- 172.21.15.79:0/3158188111 wait complete. 2023-10-14T18:56:59.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T18:56:59.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.790+0000 7eff7e704700 1 Processor -- start 2023-10-14T18:56:59.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.790+0000 7eff7e704700 1 -- start start 2023-10-14T18:56:59.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff7e704700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 0x7eff7815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff7e704700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff7815a620 0x7eff7815d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff7e704700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7815cbb0 con 0x7eff7815d580 2023-10-14T18:56:59.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff7e704700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7815bfa0 con 0x7eff7815a620 2023-10-14T18:56:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff7e704700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7815c280 con 0x7eff78157870 2023-10-14T18:56:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff7815a620 0x7eff7815d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff7815a620 0x7eff7815d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47820/0 (socket says 172.21.15.79:47820) 2023-10-14T18:56:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 -- 172.21.15.79:0/2240439837 learned_addr learned my addr 172.21.15.79:0/2240439837 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff77fff700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 0x7eff7815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 -- 172.21.15.79:0/2240439837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 msgr2=0x7eff7815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:56:59.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 0x7eff7815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 -- 172.21.15.79:0/2240439837 >> v1:172.21.15.144:6789/0 conn(0x7eff7815d580 legacy=0x7eff78158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 -- 172.21.15.79:0/2240439837 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7815c560 con 0x7eff7815a620 2023-10-14T18:56:59.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff77fff700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 0x7eff7815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:56:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff777fe700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815a620 0x7eff7815d040 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0099b0 tx=0x7eff6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8dbef709b259cf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff76ffd700 1 -- 172.21.15.79:0/2240439837 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00b860 con 0x7eff7815a620 2023-10-14T18:56:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff76ffd700 1 -- 172.21.15.79:0/2240439837 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c00b9c0 con 0x7eff7815a620 2023-10-14T18:56:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.791+0000 7eff76ffd700 1 -- 172.21.15.79:0/2240439837 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00bd60 con 0x7eff7815a620 2023-10-14T18:56:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 -- 172.21.15.79:0/2240439837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815a620 msgr2=0x7eff7815d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815a620 0x7eff7815d040 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0099b0 tx=0x7eff6c009250 comp rx=0 tx=0).stop 2023-10-14T18:56:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 -- 172.21.15.79:0/2240439837 shutdown_connections 2023-10-14T18:56:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff78157870 0x7eff7815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 --2- 172.21.15.79:0/2240439837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815a620 0x7eff7815d040 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 -- 172.21.15.79:0/2240439837 >> 172.21.15.79:0/2240439837 conn(0x7eff78068ce0 msgr2=0x7eff780690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 -- 172.21.15.79:0/2240439837 shutdown_connections 2023-10-14T18:56:59.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.792+0000 7eff7e704700 1 -- 172.21.15.79:0/2240439837 wait complete. 2023-10-14T18:56:59.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.793+0000 7eff7e704700 1 Processor -- start 2023-10-14T18:56:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.793+0000 7eff7e704700 1 -- start start 2023-10-14T18:56:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 0x7eff780b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff7815a620 0x7eff78153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7815e340 con 0x7eff7815d580 2023-10-14T18:56:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff780cf8b0 con 0x7eff78157870 2023-10-14T18:56:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7e704700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780cf580 con 0x7eff7815a620 2023-10-14T18:56:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff77fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 0x7eff780b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47822/0 (socket says 172.21.15.79:47822) 2023-10-14T18:56:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff77fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 0x7eff780b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:44888/0 (socket says 172.21.15.79:44888) 2023-10-14T18:56:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 -- 172.21.15.79:0/3351991966 learned_addr learned my addr 172.21.15.79:0/3351991966 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:56:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff777fe700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff7815a620 0x7eff78153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 -- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff7815a620 msgr2=0x7eff78153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff7815a620 0x7eff78153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 -- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 msgr2=0x7eff780b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 0x7eff780b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.794+0000 7eff7cca1700 1 -- 172.21.15.79:0/3351991966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0094f0 con 0x7eff7815d580 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff7cca1700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c810 tx=0x7eff70001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70012630 con 0x7eff7815d580 2023-10-14T18:56:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff700127b0 con 0x7eff7815d580 2023-10-14T18:56:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7814adb0 con 0x7eff7815d580 2023-10-14T18:56:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70012b70 con 0x7eff7815d580 2023-10-14T18:56:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.795+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff78154730 con 0x7eff7815d580 2023-10-14T18:56:59.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.796+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff78154d00 con 0x7eff7815d580 2023-10-14T18:56:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.796+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff70003030 con 0x7eff7815d580 2023-10-14T18:56:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.796+0000 7eff5ffff700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:56:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.796+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7eff70084070 con 0x7eff7815d580 2023-10-14T18:56:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.797+0000 7eff77fff700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:56:59.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.797+0000 7eff77fff700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 0x7eff640693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff68006f00 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:56:59.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.801+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff78154d00 con 0x7eff7815d580 2023-10-14T18:56:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.984+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7eff78154d00 con 0x7eff64066f30 2023-10-14T18:56:59.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.985+0000 7eff5ffff700 1 -- 172.21.15.79:0/3351991966 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff78154d00 con 0x7eff64066f30 2023-10-14T18:56:59.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 msgr2=0x7eff640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 0x7eff640693e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7eff68006f00 tx=0x7eff68008040 comp rx=0 tx=0).stop 2023-10-14T18:56:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 msgr2=0x7eff78154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:56:59.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7eff7000c810 tx=0x7eff70001650 comp rx=0 tx=0).stop 2023-10-14T18:56:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 shutdown_connections 2023-10-14T18:56:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7eff64066f30 0x7eff640693e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff7815d580 0x7eff78154050 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff78157870 0x7eff780b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 --2- 172.21.15.79:0/3351991966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7eff7815a620 0x7eff78153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:56:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 >> 172.21.15.79:0/3351991966 conn(0x7eff78068ce0 msgr2=0x7eff7814fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:56:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 shutdown_connections 2023-10-14T18:56:59.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:56:59.987+0000 7eff7e704700 1 -- 172.21.15.79:0/3351991966 wait complete. 2023-10-14T18:56:59.991 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T18:56:59.999 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T18:57:00.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:57:00.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.117+0000 7f2401b2a700 1 Processor -- start 2023-10-14T18:57:00.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.117+0000 7f2401b2a700 1 -- start start 2023-10-14T18:57:00.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401b2a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23fc159c30 0x7f23fc068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401b2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc067760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401b2a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc15b0a0 con 0x7f23fc15a000 2023-10-14T18:57:00.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401b2a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23fc15a490 con 0x7f23fc159c30 2023-10-14T18:57:00.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401b2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc15a770 con 0x7f23fc0cf010 2023-10-14T18:57:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23fc159c30 0x7f23fc068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23fc159c30 0x7f23fc068fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47832/0 (socket says 172.21.15.79:47832) 2023-10-14T18:57:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 -- 172.21.15.79:0/1743460362 learned_addr learned my addr 172.21.15.79:0/1743460362 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401329700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc067760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 -- 172.21.15.79:0/1743460362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 msgr2=0x7f23fc067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:00.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc067760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 -- 172.21.15.79:0/1743460362 >> v1:172.21.15.144:6789/0 conn(0x7f23fc15a000 legacy=0x7f23fc0ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 -- 172.21.15.79:0/1743460362 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc15aa50 con 0x7f23fc159c30 2023-10-14T18:57:00.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2401329700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:57:00.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.118+0000 7f2400b28700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc159c30 0x7f23fc068fd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f23f00099b0 tx=0x7f23f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd311167cc1b15e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f23fb7fe700 1 -- 172.21.15.79:0/1743460362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000b860 con 0x7f23fc159c30 2023-10-14T18:57:00.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f23fb7fe700 1 -- 172.21.15.79:0/1743460362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f000b9c0 con 0x7f23fc159c30 2023-10-14T18:57:00.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f23fb7fe700 1 -- 172.21.15.79:0/1743460362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000bd60 con 0x7f23fc159c30 2023-10-14T18:57:00.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 -- 172.21.15.79:0/1743460362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc159c30 msgr2=0x7f23fc068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc159c30 0x7f23fc068fd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f23f00099b0 tx=0x7f23f0009250 comp rx=0 tx=0).stop 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 -- 172.21.15.79:0/1743460362 shutdown_connections 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc067760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 --2- 172.21.15.79:0/1743460362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc159c30 0x7f23fc068fd0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 -- 172.21.15.79:0/1743460362 >> 172.21.15.79:0/1743460362 conn(0x7f23fc06c740 msgr2=0x7f23fc069870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 -- 172.21.15.79:0/1743460362 shutdown_connections 2023-10-14T18:57:00.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.119+0000 7f2401b2a700 1 -- 172.21.15.79:0/1743460362 wait complete. 2023-10-14T18:57:00.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.120+0000 7f2401b2a700 1 Processor -- start 2023-10-14T18:57:00.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.120+0000 7f2401b2a700 1 -- start start 2023-10-14T18:57:00.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23fc159c30 0x7f23fc0abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 0x7f23fc15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc156980 con 0x7f23fc15a000 2023-10-14T18:57:00.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc153390 con 0x7f23fc159c30 2023-10-14T18:57:00.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401b2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc16d640 con 0x7f23fc0cf010 2023-10-14T18:57:00.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401329700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 0x7f23fc15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401329700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 0x7f23fc15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47836/0 (socket says 172.21.15.79:47836) 2023-10-14T18:57:00.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2401329700 1 -- 172.21.15.79:0/2451608507 learned_addr learned my addr 172.21.15.79:0/2451608507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f2400b28700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.121+0000 7f23fbfff700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23fc159c30 0x7f23fc0abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 -- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 msgr2=0x7f23fc152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23fc0cf010 0x7f23fc152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 -- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23fc159c30 msgr2=0x7f23fc0abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23fc159c30 0x7f23fc0abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00094f0 con 0x7f23fc15a000 2023-10-14T18:57:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401329700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 0x7f23fc15b4f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f23f400d180 tx=0x7f23f4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400dcc0 con 0x7f23fc15a000 2023-10-14T18:57:00.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f400f040 con 0x7f23fc15a000 2023-10-14T18:57:00.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4015690 con 0x7f23fc15a000 2023-10-14T18:57:00.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc0b09d0 con 0x7f23fc15a000 2023-10-14T18:57:00.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.122+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc0b0f50 con 0x7f23fc15a000 2023-10-14T18:57:00.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.123+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23fc06e190 con 0x7f23fc15a000 2023-10-14T18:57:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.123+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23f401e3b0 con 0x7f23fc15a000 2023-10-14T18:57:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23f8ff9700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f23e0066f30 0x7f23e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f23f4084e50 con 0x7f23fc15a000 2023-10-14T18:57:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23f8ff9700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f23e006cd80 0x7f23e006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23e006f860 con 0x7f23e006cd80 2023-10-14T18:57:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23f4085220 con 0x7f23fc15a000 2023-10-14T18:57:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f2400b28700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f23e0066f30 0x7f23e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23fbfff700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f23e006cd80 0x7f23e006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f2400b28700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f23e0066f30 0x7f23e00693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f23f00099b0 tx=0x7f23f0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.124+0000 7f23fbfff700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f23e006cd80 0x7f23e006f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.125+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== osd.5 v2:172.21.15.144:6800/86565 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f23e006f860 con 0x7f23e006cd80 2023-10-14T18:57:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.137+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 --> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23fc04bb80 con 0x7f23e006cd80 2023-10-14T18:57:00.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f23f8ff9700 1 -- 172.21.15.79:0/2451608507 <== osd.5 v2:172.21.15.144:6800/86565 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f23fc04bb80 con 0x7f23e006cd80 2023-10-14T18:57:00.139 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:57:00.139 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:57:00.139 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:57:00.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f23e006cd80 msgr2=0x7f23e006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6800/86565,v1:172.21.15.144:6801/86565] conn(0x7f23e006cd80 0x7f23e006f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f23e0066f30 msgr2=0x7f23e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f23e0066f30 0x7f23e00693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f23f00099b0 tx=0x7f23f0017000 comp rx=0 tx=0).stop 2023-10-14T18:57:00.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 msgr2=0x7f23fc15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 --2- 172.21.15.79:0/2451608507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23fc15a000 0x7f23fc15b4f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f23f400d180 tx=0x7f23f4009a50 comp rx=0 tx=0).stop 2023-10-14T18:57:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401329700 1 -- 172.21.15.79:0/2451608507 reap_dead start 2023-10-14T18:57:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 shutdown_connections 2023-10-14T18:57:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.138+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 >> 172.21.15.79:0/2451608507 conn(0x7f23fc06c740 msgr2=0x7f23fc0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.139+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 shutdown_connections 2023-10-14T18:57:00.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.139+0000 7f2401b2a700 1 -- 172.21.15.79:0/2451608507 wait complete. 2023-10-14T18:57:00.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T18:57:00.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.265+0000 7f28d3558700 1 Processor -- start 2023-10-14T18:57:00.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.265+0000 7f28d3558700 1 -- start start 2023-10-14T18:57:00.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d3558700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d3558700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d3558700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc15cbb0 con 0x7f28cc15d580 2023-10-14T18:57:00.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d3558700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc15bfa0 con 0x7f28cc157870 2023-10-14T18:57:00.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d3558700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc15c280 con 0x7f28cc15a620 2023-10-14T18:57:00.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d12f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d0af3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d0af3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.79:40278/0 (socket says 172.21.15.79:40278) 2023-10-14T18:57:00.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d12f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.79:44918/0 (socket says 172.21.15.79:44918) 2023-10-14T18:57:00.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d0af3700 1 -- 172.21.15.79:0/3511314052 learned_addr learned my addr 172.21.15.79:0/3511314052 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.266+0000 7f28d1af5700 1 --1- 172.21.15.79:0/3511314052 >> v1:172.21.15.144:6789/0 conn(0x7f28cc15d580 0x7f28cc158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.79:33656/0 (socket says 172.21.15.79:33656) 2023-10-14T18:57:00.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d0af3700 1 -- 172.21.15.79:0/3511314052 >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 msgr2=0x7f28cc15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:00.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d0af3700 1 --2- 172.21.15.79:0/3511314052 >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d0af3700 1 -- 172.21.15.79:0/3511314052 >> v1:172.21.15.144:6789/0 conn(0x7f28cc15d580 legacy=0x7f28cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d0af3700 1 -- 172.21.15.79:0/3511314052 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc15c560 con 0x7f28cc15a620 2023-10-14T18:57:00.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d12f4700 1 --2- 172.21.15.79:0/3511314052 >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T18:57:00.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28d0af3700 1 --2- 172.21.15.79:0/3511314052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0099b0 tx=0x7f28bc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0b7a5b84f1000d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28c3fff700 1 -- 172.21.15.79:0/3511314052 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc009ea0 con 0x7f28cc15a620 2023-10-14T18:57:00.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28c3fff700 1 -- 172.21.15.79:0/3511314052 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00b860 con 0x7f28cc15a620 2023-10-14T18:57:00.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.267+0000 7f28c3fff700 1 -- 172.21.15.79:0/3511314052 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00bc00 con 0x7f28cc15a620 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 -- 172.21.15.79:0/3511314052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 msgr2=0x7f28cc15d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 --2- 172.21.15.79:0/3511314052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0099b0 tx=0x7f28bc009250 comp rx=0 tx=0).stop 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 -- 172.21.15.79:0/3511314052 shutdown_connections 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 --2- 172.21.15.79:0/3511314052 >> v2:172.21.15.144:3300/0 conn(0x7f28cc157870 0x7f28cc15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 --2- 172.21.15.79:0/3511314052 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc15d040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 -- 172.21.15.79:0/3511314052 >> 172.21.15.79:0/3511314052 conn(0x7f28cc068ce0 msgr2=0x7f28cc0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 -- 172.21.15.79:0/3511314052 shutdown_connections 2023-10-14T18:57:00.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.268+0000 7f28d3558700 1 -- 172.21.15.79:0/3511314052 wait complete. 2023-10-14T18:57:00.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.269+0000 7f28d3558700 1 Processor -- start 2023-10-14T18:57:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.269+0000 7f28d3558700 1 -- start start 2023-10-14T18:57:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28cc15d580 0x7f28cc152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0b20d0 con 0x7f28cc157870 2023-10-14T18:57:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc16b620 con 0x7f28cc15d580 2023-10-14T18:57:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d3558700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc16aa10 con 0x7f28cc15a620 2023-10-14T18:57:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47840/0 (socket says 172.21.15.79:47840) 2023-10-14T18:57:00.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 -- 172.21.15.79:0/3050150030 learned_addr learned my addr 172.21.15.79:0/3050150030 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d0af3700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d1af5700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28cc15d580 0x7f28cc152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 -- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 msgr2=0x7f28cc151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 -- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28cc15d580 msgr2=0x7f28cc152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28cc15d580 0x7f28cc152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 -- 172.21.15.79:0/3050150030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009a20 con 0x7f28cc157870 2023-10-14T18:57:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28d12f4700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c170 tx=0x7f28c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.270+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800ccb0 con 0x7f28cc157870 2023-10-14T18:57:00.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.271+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800f040 con 0x7f28cc157870 2023-10-14T18:57:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.271+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8014480 con 0x7f28cc157870 2023-10-14T18:57:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.271+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0094f0 con 0x7f28cc157870 2023-10-14T18:57:00.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.271+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc16afd0 con 0x7f28cc157870 2023-10-14T18:57:00.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.271+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc04c3c0 con 0x7f28cc157870 2023-10-14T18:57:00.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.272+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28c80147f0 con 0x7f28cc157870 2023-10-14T18:57:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.272+0000 7f28c17fa700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.272+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f28c8085050 con 0x7f28cc157870 2023-10-14T18:57:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.272+0000 7f28d0af3700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.273+0000 7f28d0af3700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 0x7f28b00693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0099b0 tx=0x7f28bc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.276+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28c8052520 con 0x7f28cc157870 2023-10-14T18:57:00.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.461+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f28cc15c840 con 0x7f28b0066f30 2023-10-14T18:57:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.462+0000 7f28c17fa700 1 -- 172.21.15.79:0/3050150030 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f28cc15c840 con 0x7f28b0066f30 2023-10-14T18:57:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 msgr2=0x7f28b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 0x7f28b00693e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0099b0 tx=0x7f28bc017000 comp rx=0 tx=0).stop 2023-10-14T18:57:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 msgr2=0x7f28cc0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f28c800c170 tx=0x7f28c800b040 comp rx=0 tx=0).stop 2023-10-14T18:57:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 shutdown_connections 2023-10-14T18:57:00.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f28b0066f30 0x7f28b00693e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28cc15d580 0x7f28cc152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28cc157870 0x7f28cc0b1b90 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 --2- 172.21.15.79:0/3050150030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f28cc15a620 0x7f28cc151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 >> 172.21.15.79:0/3050150030 conn(0x7f28cc068ce0 msgr2=0x7f28cc153320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 shutdown_connections 2023-10-14T18:57:00.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.464+0000 7f28d3558700 1 -- 172.21.15.79:0/3050150030 wait complete. 2023-10-14T18:57:00.468 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T18:57:00.476 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T18:57:00.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:57:00.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 Processor -- start 2023-10-14T18:57:00.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 -- start start 2023-10-14T18:57:00.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0030067d70 0x7f003015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00300cf350 con 0x7f0030157b10 2023-10-14T18:57:00.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003015b360 con 0x7f003015aee0 2023-10-14T18:57:00.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.595+0000 7f0036579700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003015e9e0 con 0x7f0030067d70 2023-10-14T18:57:00.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0030067d70 0x7f003015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0030157b10 0x7f0030067660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47372/0 (socket says 172.21.15.79:47372) 2023-10-14T18:57:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002ffff700 1 -- 172.21.15.79:0/3965981000 learned_addr learned my addr 172.21.15.79:0/3965981000 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:57:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002f7fe700 1 -- 172.21.15.79:0/3965981000 >> v1:172.21.15.144:6789/0 conn(0x7f003015aee0 legacy=0x7f00300cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002f7fe700 1 -- 172.21.15.79:0/3965981000 >> v1:172.21.15.79:6789/0 conn(0x7f0030157b10 legacy=0x7f0030067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002f7fe700 1 -- 172.21.15.79:0/3965981000 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003015e140 con 0x7f0030067d70 2023-10-14T18:57:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002effd700 1 -- 172.21.15.79:0/3965981000 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668833096 0 0) 0x7f00300cf350 con 0x7f0030157b10 2023-10-14T18:57:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002f7fe700 1 --2- 172.21.15.79:0/3965981000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030067d70 0x7f003015dab0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0024009910 tx=0x7f00240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4ae297f5aecda server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002effd700 1 -- 172.21.15.79:0/3965981000 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400b820 con 0x7f0030067d70 2023-10-14T18:57:00.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002effd700 1 -- 172.21.15.79:0/3965981000 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400b980 con 0x7f0030067d70 2023-10-14T18:57:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.596+0000 7f002effd700 1 -- 172.21.15.79:0/3965981000 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400bd20 con 0x7f0030067d70 2023-10-14T18:57:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 -- 172.21.15.79:0/3965981000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030067d70 msgr2=0x7f003015dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 --2- 172.21.15.79:0/3965981000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030067d70 0x7f003015dab0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0024009910 tx=0x7f00240091a0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 -- 172.21.15.79:0/3965981000 shutdown_connections 2023-10-14T18:57:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 --2- 172.21.15.79:0/3965981000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030067d70 0x7f003015dab0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 -- 172.21.15.79:0/3965981000 >> 172.21.15.79:0/3965981000 conn(0x7f00300d0de0 msgr2=0x7f00300d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 -- 172.21.15.79:0/3965981000 shutdown_connections 2023-10-14T18:57:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.597+0000 7f0036579700 1 -- 172.21.15.79:0/3965981000 wait complete. 2023-10-14T18:57:00.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.598+0000 7f0036579700 1 Processor -- start 2023-10-14T18:57:00.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.598+0000 7f0036579700 1 -- start start 2023-10-14T18:57:00.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0030067d70 0x7f003016b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 0x7f00300b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003015aee0 0x7f00300b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b6160 con 0x7f0030157b10 2023-10-14T18:57:00.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b12c0 con 0x7f003015aee0 2023-10-14T18:57:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0036579700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b15a0 con 0x7f0030067d70 2023-10-14T18:57:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 0x7f00300b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 0x7f00300b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47862/0 (socket says 172.21.15.79:47862) 2023-10-14T18:57:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 -- 172.21.15.79:0/1864194804 learned_addr learned my addr 172.21.15.79:0/1864194804 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002ffff700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0030067d70 0x7f003016b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0034b16700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003015aee0 0x7f00300b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 -- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0030067d70 msgr2=0x7f003016b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0030067d70 0x7f003016b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 -- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003015aee0 msgr2=0x7f00300b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f003015aee0 0x7f00300b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009420 con 0x7f0030157b10 2023-10-14T18:57:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f002f7fe700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 0x7f00300b0bc0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f00240093f0 tx=0x7f0024017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.599+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002401f070 con 0x7f0030157b10 2023-10-14T18:57:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.600+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024002f70 con 0x7f0030157b10 2023-10-14T18:57:00.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.600+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00300b1880 con 0x7f0030157b10 2023-10-14T18:57:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.600+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400bd20 con 0x7f0030157b10 2023-10-14T18:57:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.600+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00300b3c20 con 0x7f0030157b10 2023-10-14T18:57:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.600+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f003004c3c0 con 0x7f0030157b10 2023-10-14T18:57:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0024023070 con 0x7f0030157b10 2023-10-14T18:57:00.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f001c066f30 0x7f001c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f00240855b0 con 0x7f0030157b10 2023-10-14T18:57:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7f001c06cd80 0x7f001c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f001c06f860 con 0x7f001c06cd80 2023-10-14T18:57:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.601+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0024087bf0 con 0x7f0030157b10 2023-10-14T18:57:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.602+0000 7f002ffff700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f001c066f30 0x7f001c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.602+0000 7f0034b16700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7f001c06cd80 0x7f001c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.602+0000 7f0034b16700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7f001c06cd80 0x7f001c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.602+0000 7f002ffff700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f001c066f30 0x7f001c0693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0030156fb0 tx=0x7f0020007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.603+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== osd.6 v2:172.21.15.144:6824/86602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f001c06f860 con 0x7f001c06cd80 2023-10-14T18:57:00.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.617+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 --> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00300cd430 con 0x7f001c06cd80 2023-10-14T18:57:00.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.617+0000 7f0017fff700 1 -- 172.21.15.79:0/1864194804 <== osd.6 v2:172.21.15.144:6824/86602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f00300cd430 con 0x7f001c06cd80 2023-10-14T18:57:00.618 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:57:00.619 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:57:00.619 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:57:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.617+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7f001c06cd80 msgr2=0x7f001c06f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.617+0000 7f0036579700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6824/86602,v1:172.21.15.144:6825/86602] conn(0x7f001c06cd80 0x7f001c06f190 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f001c066f30 msgr2=0x7f001c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f001c066f30 0x7f001c0693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0030156fb0 tx=0x7f0020007d10 comp rx=0 tx=0).stop 2023-10-14T18:57:00.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 msgr2=0x7f00300b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 --2- 172.21.15.79:0/1864194804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0030157b10 0x7f00300b0bc0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f00240093f0 tx=0x7f0024017000 comp rx=0 tx=0).stop 2023-10-14T18:57:00.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0034b16700 1 -- 172.21.15.79:0/1864194804 reap_dead start 2023-10-14T18:57:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 shutdown_connections 2023-10-14T18:57:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 >> 172.21.15.79:0/1864194804 conn(0x7f00300d0de0 msgr2=0x7f00301560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 shutdown_connections 2023-10-14T18:57:00.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.618+0000 7f0036579700 1 -- 172.21.15.79:0/1864194804 wait complete. 2023-10-14T18:57:00.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T18:57:00.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 Processor -- start 2023-10-14T18:57:00.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 -- start start 2023-10-14T18:57:00.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb24157c40 0x7fcb24158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2415cbb0 con 0x7fcb24157870 2023-10-14T18:57:00.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2415bfa0 con 0x7fcb2415a620 2023-10-14T18:57:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.744+0000 7fcb2970e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2415bdb0 con 0x7fcb24157c40 2023-10-14T18:57:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb24157c40 0x7fcb24158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb22ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb24157870 0x7fcb2415b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47388/0 (socket says 172.21.15.79:47388) 2023-10-14T18:57:00.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb24157c40 0x7fcb24158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47876/0 (socket says 172.21.15.79:47876) 2023-10-14T18:57:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb22ffd700 1 -- 172.21.15.79:0/1123778302 learned_addr learned my addr 172.21.15.79:0/1123778302 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:57:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 -- 172.21.15.79:0/1123778302 >> v1:172.21.15.144:6789/0 conn(0x7fcb2415a620 legacy=0x7fcb2415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 -- 172.21.15.79:0/1123778302 >> v1:172.21.15.79:6789/0 conn(0x7fcb24157870 legacy=0x7fcb2415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 -- 172.21.15.79:0/1123778302 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2415c280 con 0x7fcb24157c40 2023-10-14T18:57:00.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb21ffb700 1 -- 172.21.15.79:0/1123778302 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444520268 0 0) 0x7fcb2415cbb0 con 0x7fcb24157870 2023-10-14T18:57:00.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb237fe700 1 --2- 172.21.15.79:0/1123778302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb24157c40 0x7fcb24158110 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0098e0 tx=0x7fcb1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6e1fefa86a1f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb21ffb700 1 -- 172.21.15.79:0/1123778302 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c009e80 con 0x7fcb24157c40 2023-10-14T18:57:00.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb21ffb700 1 -- 172.21.15.79:0/1123778302 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00b820 con 0x7fcb24157c40 2023-10-14T18:57:00.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.745+0000 7fcb21ffb700 1 -- 172.21.15.79:0/1123778302 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00bba0 con 0x7fcb24157c40 2023-10-14T18:57:00.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 -- 172.21.15.79:0/1123778302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb24157c40 msgr2=0x7fcb24158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 --2- 172.21.15.79:0/1123778302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb24157c40 0x7fcb24158110 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0098e0 tx=0x7fcb1c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 -- 172.21.15.79:0/1123778302 shutdown_connections 2023-10-14T18:57:00.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 --2- 172.21.15.79:0/1123778302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb24157c40 0x7fcb24158110 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 -- 172.21.15.79:0/1123778302 >> 172.21.15.79:0/1123778302 conn(0x7fcb24068ce0 msgr2=0x7fcb240690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 -- 172.21.15.79:0/1123778302 shutdown_connections 2023-10-14T18:57:00.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.746+0000 7fcb2970e700 1 -- 172.21.15.79:0/1123778302 wait complete. 2023-10-14T18:57:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.747+0000 7fcb2970e700 1 Processor -- start 2023-10-14T18:57:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.747+0000 7fcb2970e700 1 -- start start 2023-10-14T18:57:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb24157870 0x7fcb240b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24157c40 0x7fcb24153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240b25d0 con 0x7fcb2415a620 2023-10-14T18:57:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240b2fa0 con 0x7fcb24157870 2023-10-14T18:57:00.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240b19c0 con 0x7fcb24157c40 2023-10-14T18:57:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47886/0 (socket says 172.21.15.79:47886) 2023-10-14T18:57:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 -- 172.21.15.79:0/2627822004 learned_addr learned my addr 172.21.15.79:0/2627822004 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:00.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb22ffd700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb24157870 0x7fcb240b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb227fc700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24157c40 0x7fcb24153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 -- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24157c40 msgr2=0x7fcb24153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24157c40 0x7fcb24153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 -- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb24157870 msgr2=0x7fcb240b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb24157870 0x7fcb240b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 -- 172.21.15.79:0/2627822004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c009420 con 0x7fcb2415a620 2023-10-14T18:57:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb237fe700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0093f0 tx=0x7fcb1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00bb60 con 0x7fcb2415a620 2023-10-14T18:57:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c020070 con 0x7fcb2415a620 2023-10-14T18:57:00.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb240b1ca0 con 0x7fcb2415a620 2023-10-14T18:57:00.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.748+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c01b6a0 con 0x7fcb2415a620 2023-10-14T18:57:00.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.749+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb240b2260 con 0x7fcb2415a620 2023-10-14T18:57:00.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.749+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2404c3c0 con 0x7fcb2415a620 2023-10-14T18:57:00.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.750+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb1c022030 con 0x7fcb2415a620 2023-10-14T18:57:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.750+0000 7fcb1affd700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 0x7fcb040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.750+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcb1c086340 con 0x7fcb2415a620 2023-10-14T18:57:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.750+0000 7fcb22ffd700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 0x7fcb040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.751+0000 7fcb22ffd700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 0x7fcb040693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcb14002230 tx=0x7fcb14001a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.754+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb1c0538b0 con 0x7fcb2415a620 2023-10-14T18:57:00.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.938+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb24159460 con 0x7fcb04066f30 2023-10-14T18:57:00.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.939+0000 7fcb1affd700 1 -- 172.21.15.79:0/2627822004 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb24159460 con 0x7fcb04066f30 2023-10-14T18:57:00.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 msgr2=0x7fcb040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 0x7fcb040693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcb14002230 tx=0x7fcb14001a20 comp rx=0 tx=0).stop 2023-10-14T18:57:00.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 msgr2=0x7fcb2416b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:00.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0093f0 tx=0x7fcb1c016000 comp rx=0 tx=0).stop 2023-10-14T18:57:00.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 shutdown_connections 2023-10-14T18:57:00.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fcb04066f30 0x7fcb040693e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb2415a620 0x7fcb2416b380 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb24157870 0x7fcb240b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 --2- 172.21.15.79:0/2627822004 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24157c40 0x7fcb24153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:00.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 >> 172.21.15.79:0/2627822004 conn(0x7fcb24068ce0 msgr2=0x7fcb240690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:00.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 shutdown_connections 2023-10-14T18:57:00.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:00.941+0000 7fcb2970e700 1 -- 172.21.15.79:0/2627822004 wait complete. 2023-10-14T18:57:00.945 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T18:57:00.953 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T18:57:00.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T18:57:01.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.071+0000 7f1c6aae1700 1 Processor -- start 2023-10-14T18:57:01.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.071+0000 7f1c6aae1700 1 -- start start 2023-10-14T18:57:01.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c640b10a0 0x7f1c640c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c640cb740 0x7f1c640cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 0x7f1c6406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6406dd90 con 0x7f1c640b10a0 2023-10-14T18:57:01.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6415e940 con 0x7f1c640cb740 2023-10-14T18:57:01.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6aae1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415a250 con 0x7f1c6406d3f0 2023-10-14T18:57:01.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6887d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c640b10a0 0x7f1c640c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6887d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c640b10a0 0x7f1c640c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47900/0 (socket says 172.21.15.79:47900) 2023-10-14T18:57:01.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.072+0000 7f1c6887d700 1 -- 172.21.15.79:0/2915300435 learned_addr learned my addr 172.21.15.79:0/2915300435 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:01.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c63fff700 1 --2- 172.21.15.79:0/2915300435 >> v2:172.21.15.144:3300/0 conn(0x7f1c640cb740 0x7f1c640cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6907e700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 0x7f1c6406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 -- 172.21.15.79:0/2915300435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 msgr2=0x7f1c6406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 0x7f1c6406d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 -- 172.21.15.79:0/2915300435 >> v2:172.21.15.144:3300/0 conn(0x7f1c640cb740 msgr2=0x7f1c640cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2915300435 >> v2:172.21.15.144:3300/0 conn(0x7f1c640cb740 0x7f1c640cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 -- 172.21.15.79:0/2915300435 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6415dd30 con 0x7f1c640b10a0 2023-10-14T18:57:01.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6907e700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 0x7f1c6406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:57:01.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c91c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1c64068ae0 tx=0x7f1c54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291416292729242 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c637fe700 1 -- 172.21.15.79:0/2915300435 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400e070 con 0x7f1c640b10a0 2023-10-14T18:57:01.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c637fe700 1 -- 172.21.15.79:0/2915300435 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400ba20 con 0x7f1c640b10a0 2023-10-14T18:57:01.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c637fe700 1 -- 172.21.15.79:0/2915300435 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540092e0 con 0x7f1c640b10a0 2023-10-14T18:57:01.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2915300435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 msgr2=0x7f1c640c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.073+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c91c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1c64068ae0 tx=0x7f1c54009840 comp rx=0 tx=0).stop 2023-10-14T18:57:01.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2915300435 shutdown_connections 2023-10-14T18:57:01.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c6406d3f0 0x7f1c6406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2915300435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c91c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2915300435 >> v2:172.21.15.144:3300/0 conn(0x7f1c640cb740 0x7f1c640cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2915300435 >> 172.21.15.79:0/2915300435 conn(0x7f1c64069870 msgr2=0x7f1c64069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2915300435 shutdown_connections 2023-10-14T18:57:01.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.074+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2915300435 wait complete. 2023-10-14T18:57:01.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.075+0000 7f1c6aae1700 1 Processor -- start 2023-10-14T18:57:01.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.075+0000 7f1c6aae1700 1 -- start start 2023-10-14T18:57:01.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6406d3f0 0x7f1c64144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c640cb740 0x7f1c64069c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415d3d0 con 0x7f1c640b10a0 2023-10-14T18:57:01.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64145340 con 0x7f1c6406d3f0 2023-10-14T18:57:01.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415c7c0 con 0x7f1c640cb740 2023-10-14T18:57:01.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47910/0 (socket says 172.21.15.79:47910) 2023-10-14T18:57:01.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 -- 172.21.15.79:0/2516500753 learned_addr learned my addr 172.21.15.79:0/2516500753 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:01.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6406d3f0 0x7f1c64144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6907e700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c640cb740 0x7f1c64069c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 -- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c640cb740 msgr2=0x7f1c64069c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1c640cb740 0x7f1c64069c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 -- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6406d3f0 msgr2=0x7f1c64144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c6406d3f0 0x7f1c64144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009ae0 con 0x7f1c640b10a0 2023-10-14T18:57:01.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c63fff700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c8360 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00ec80 tx=0x7f1c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00c8e0 con 0x7f1c640b10a0 2023-10-14T18:57:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c00ca40 con 0x7f1c640b10a0 2023-10-14T18:57:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6415caa0 con 0x7f1c640b10a0 2023-10-14T18:57:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00cde0 con 0x7f1c640b10a0 2023-10-14T18:57:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.076+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6415d060 con 0x7f1c640b10a0 2023-10-14T18:57:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.077+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c6404c3c0 con 0x7f1c640b10a0 2023-10-14T18:57:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c4c013680 con 0x7f1c640b10a0 2023-10-14T18:57:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c44066f30 0x7f1c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1c4c0844c0 con 0x7f1c640b10a0 2023-10-14T18:57:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7f1c4406cd80 0x7f1c4406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c44066f30 0x7f1c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c4406f860 con 0x7f1c4406cd80 2023-10-14T18:57:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=192) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c4c086b00 con 0x7f1c640b10a0 2023-10-14T18:57:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.078+0000 7f1c6907e700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7f1c4406cd80 0x7f1c4406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.079+0000 7f1c6887d700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c44066f30 0x7f1c440693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009880 tx=0x7f1c54018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.079+0000 7f1c6907e700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7f1c4406cd80 0x7f1c4406f190 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.079+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== osd.7 v2:172.21.15.144:6816/86567 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f1c4406f860 con 0x7f1c4406cd80 2023-10-14T18:57:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 --> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1c64068b10 con 0x7f1c4406cd80 2023-10-14T18:57:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c60ff9700 1 -- 172.21.15.79:0/2516500753 <== osd.7 v2:172.21.15.144:6816/86567 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f1c64068b10 con 0x7f1c4406cd80 2023-10-14T18:57:01.094 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-14T18:57:01.095 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-14T18:57:01.095 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-14T18:57:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7f1c4406cd80 msgr2=0x7f1c4406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6816/86567,v1:172.21.15.144:6817/86567] conn(0x7f1c4406cd80 0x7f1c4406f190 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c44066f30 msgr2=0x7f1c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f1c44066f30 0x7f1c440693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009880 tx=0x7f1c54018000 comp rx=0 tx=0).stop 2023-10-14T18:57:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 msgr2=0x7f1c640c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 --2- 172.21.15.79:0/2516500753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c640b10a0 0x7f1c640c8360 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00ec80 tx=0x7f1c4c0091a0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6907e700 1 -- 172.21.15.79:0/2516500753 reap_dead start 2023-10-14T18:57:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 shutdown_connections 2023-10-14T18:57:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.092+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 >> 172.21.15.79:0/2516500753 conn(0x7f1c64069870 msgr2=0x7f1c64159770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.093+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 shutdown_connections 2023-10-14T18:57:01.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.093+0000 7f1c6aae1700 1 -- 172.21.15.79:0/2516500753 wait complete. 2023-10-14T18:57:01.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T18:57:01.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.219+0000 7ff8a3fff700 1 Processor -- start 2023-10-14T18:57:01.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.219+0000 7ff8a3fff700 1 -- start start 2023-10-14T18:57:01.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8a415a170 0x7ff8a4068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a3fff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40694a0 con 0x7ff8a4159da0 2023-10-14T18:57:01.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a3fff700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a415ea70 con 0x7ff8a4069040 2023-10-14T18:57:01.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a3fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40b34b0 con 0x7ff8a415a170 2023-10-14T18:57:01.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff8a4159da0 0x7ff8a40b2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:47390/0 (socket says 172.21.15.79:47390) 2023-10-14T18:57:01.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a2ffd700 1 -- 172.21.15.79:0/3691778492 learned_addr learned my addr 172.21.15.79:0/3691778492 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:57:01.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3691778492 >> v2:172.21.15.144:3300/0 conn(0x7ff8a415a170 0x7ff8a4068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308920315 0 0) 0x7ff894001110 con 0x7ff8a4159da0 2023-10-14T18:57:01.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.220+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff88c003570 con 0x7ff8a4159da0 2023-10-14T18:57:01.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098408253 0 0) 0x7ff88c003570 con 0x7ff8a4159da0 2023-10-14T18:57:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 >> v2:172.21.15.144:3300/0 conn(0x7ff8a415a170 msgr2=0x7ff8a4068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 --2- 172.21.15.79:0/3691778492 >> v2:172.21.15.144:3300/0 conn(0x7ff8a415a170 0x7ff8a4068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 >> v1:172.21.15.144:6789/0 conn(0x7ff8a4069040 legacy=0x7ff8a40af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40b3990 con 0x7ff8a4159da0 2023-10-14T18:57:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7ff894001600 con 0x7ff8a4159da0 2023-10-14T18:57:01.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 >> v1:172.21.15.79:6789/0 conn(0x7ff8a4159da0 legacy=0x7ff8a40b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff88c003a60 0x7ff88c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c004810 0x7ff88c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff88c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40b34b0 con 0x7ff88c0052e0 2023-10-14T18:57:01.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c00c2a0 con 0x7ff88c004810 2023-10-14T18:57:01.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c00c460 con 0x7ff88c003a60 2023-10-14T18:57:01.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff88c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a2ffd700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff88c003a60 0x7ff88c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c004810 0x7ff88c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 -- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff88c003a60 msgr2=0x7ff88c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff88c003a60 0x7ff88c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 -- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c004810 msgr2=0x7ff88c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c004810 0x7ff88c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 -- 172.21.15.79:0/3691778492 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c003570 con 0x7ff88c0052e0 2023-10-14T18:57:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 -- 172.21.15.79:0/3691778492 reap_dead start 2023-10-14T18:57:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff88c00ba60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001ff0 tx=0x7ff89c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9260b9a9cf82ba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c001980 con 0x7ff88c0052e0 2023-10-14T18:57:01.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c00c8b0 con 0x7ff88c0052e0 2023-10-14T18:57:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.221+0000 7ff8a1ffb700 1 -- 172.21.15.79:0/3691778492 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c00cc90 con 0x7ff88c0052e0 2023-10-14T18:57:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 msgr2=0x7ff88c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff88c00ba60 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001ff0 tx=0x7ff89c001670 comp rx=0 tx=0).stop 2023-10-14T18:57:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3691778492 shutdown_connections 2023-10-14T18:57:01.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3691778492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff88c00ba60 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3691778492 >> 172.21.15.79:0/3691778492 conn(0x7ff8a40d0bc0 msgr2=0x7ff8a40d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3691778492 shutdown_connections 2023-10-14T18:57:01.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.222+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3691778492 wait complete. 2023-10-14T18:57:01.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.223+0000 7ff8a3fff700 1 Processor -- start 2023-10-14T18:57:01.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.223+0000 7ff8a3fff700 1 -- start start 2023-10-14T18:57:01.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 0x7ff8a40caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 0x7ff8a40b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40caff0 con 0x7ff88c0052e0 2023-10-14T18:57:01.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40c7f20 con 0x7ff8a40b4af0 2023-10-14T18:57:01.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a3fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40b54a0 con 0x7ff8a40ca640 2023-10-14T18:57:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47928/0 (socket says 172.21.15.79:47928) 2023-10-14T18:57:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 -- 172.21.15.79:0/3454646971 learned_addr learned my addr 172.21.15.79:0/3454646971 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 0x7ff8a40b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 0x7ff8a40caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 -- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 msgr2=0x7ff8a40caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 0x7ff8a40caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 -- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 msgr2=0x7ff8a40b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 0x7ff8a40b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 -- 172.21.15.79:0/3454646971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a416dba0 con 0x7ff88c0052e0 2023-10-14T18:57:01.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 0x7ff8a40caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:57:01.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a37fe700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 0x7ff8a40b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:57:01.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.224+0000 7ff8a2ffd700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff894007140 tx=0x7ff894007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400f6e0 con 0x7ff88c0052e0 2023-10-14T18:57:01.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400f860 con 0x7ff88c0052e0 2023-10-14T18:57:01.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a416ea00 con 0x7ff88c0052e0 2023-10-14T18:57:01.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400fc20 con 0x7ff88c0052e0 2023-10-14T18:57:01.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a416e150 con 0x7ff88c0052e0 2023-10-14T18:57:01.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.225+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4089480 con 0x7ff88c0052e0 2023-10-14T18:57:01.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.226+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff89400fd80 con 0x7ff88c0052e0 2023-10-14T18:57:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.226+0000 7ff88affd700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.226+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff894084130 con 0x7ff88c0052e0 2023-10-14T18:57:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.226+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.227+0000 7ff8a27fc700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff8a416db00 tx=0x7ff898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.230+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8940516a0 con 0x7ff88c0052e0 2023-10-14T18:57:01.412 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.411+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8a40694a0 con 0x7ff890066f30 2023-10-14T18:57:01.413 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.412+0000 7ff88affd700 1 -- 172.21.15.79:0/3454646971 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8a40694a0 con 0x7ff890066f30 2023-10-14T18:57:01.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 msgr2=0x7ff8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.415 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff8a416db00 tx=0x7ff898008040 comp rx=0 tx=0).stop 2023-10-14T18:57:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 msgr2=0x7ff8a40afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff894007140 tx=0x7ff894007a50 comp rx=0 tx=0).stop 2023-10-14T18:57:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 shutdown_connections 2023-10-14T18:57:01.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8a40b4af0 0x7ff8a40b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff88c0052e0 0x7ff8a40afa50 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 --2- 172.21.15.79:0/3454646971 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff8a40ca640 0x7ff8a40caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 >> 172.21.15.79:0/3454646971 conn(0x7ff8a40d0bc0 msgr2=0x7ff8a40cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 shutdown_connections 2023-10-14T18:57:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.414+0000 7ff8a3fff700 1 -- 172.21.15.79:0/3454646971 wait complete. 2023-10-14T18:57:01.418 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T18:57:01.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:57:01.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.540+0000 7f4ef3fff700 1 Processor -- start 2023-10-14T18:57:01.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.540+0000 7f4ef3fff700 1 -- start start 2023-10-14T18:57:01.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 0x7f4ef415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef415e850 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef40cd030 con 0x7f4ef415dda0 2023-10-14T18:57:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef3fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40cb7c0 con 0x7f4ef40cdab0 2023-10-14T18:57:01.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47930/0 (socket says 172.21.15.79:47930) 2023-10-14T18:57:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 -- 172.21.15.79:0/646060793 learned_addr learned my addr 172.21.15.79:0/646060793 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef37fe700 1 --2- 172.21.15.79:0/646060793 >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 0x7f4ef415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4eea7fc700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 -- 172.21.15.79:0/646060793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 msgr2=0x7f4ef415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 -- 172.21.15.79:0/646060793 >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 msgr2=0x7f4ef415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/646060793 >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 0x7f4ef415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef2ffd700 1 -- 172.21.15.79:0/646060793 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef415e290 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.541+0000 7f4ef37fe700 1 --2- 172.21.15.79:0/646060793 >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 0x7f4ef415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:57:01.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4eea7fc700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T18:57:01.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4089ac0 tx=0x7f4ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665a9055ee0b6c18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef27fc700 1 -- 172.21.15.79:0/646060793 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400b860 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef27fc700 1 -- 172.21.15.79:0/646060793 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee400b9c0 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef27fc700 1 -- 172.21.15.79:0/646060793 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400bd60 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 -- 172.21.15.79:0/646060793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef40cd6e0 msgr2=0x7f4ef40cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4089ac0 tx=0x7f4ee4009250 comp rx=0 tx=0).stop 2023-10-14T18:57:01.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 -- 172.21.15.79:0/646060793 shutdown_connections 2023-10-14T18:57:01.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/646060793 >> v2:172.21.15.144:3300/0 conn(0x7f4ef415dda0 0x7f4ef415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef40cbc50 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/646060793 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 -- 172.21.15.79:0/646060793 >> 172.21.15.79:0/646060793 conn(0x7f4ef4067660 msgr2=0x7f4ef4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 -- 172.21.15.79:0/646060793 shutdown_connections 2023-10-14T18:57:01.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.542+0000 7f4ef3fff700 1 -- 172.21.15.79:0/646060793 wait complete. 2023-10-14T18:57:01.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 Processor -- start 2023-10-14T18:57:01.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 -- start start 2023-10-14T18:57:01.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40b0100 con 0x7f4ef415dda0 2023-10-14T18:57:01.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef416b2b0 con 0x7f4ef40cd6e0 2023-10-14T18:57:01.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef3fff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef41560b0 con 0x7f4ef40cdab0 2023-10-14T18:57:01.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47932/0 (socket says 172.21.15.79:47932) 2023-10-14T18:57:01.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.544+0000 7f4ef37fe700 1 -- 172.21.15.79:0/2485829698 learned_addr learned my addr 172.21.15.79:0/2485829698 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:01.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4eea7fc700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 -- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 msgr2=0x7f4ef415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 -- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef40cd6e0 msgr2=0x7f4ef415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef415c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 -- 172.21.15.79:0/2485829698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40094f0 con 0x7f4ef415dda0 2023-10-14T18:57:01.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef37fe700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00a380 tx=0x7f4eec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00ae10 con 0x7f4ef415dda0 2023-10-14T18:57:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00d650 con 0x7f4ef415dda0 2023-10-14T18:57:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00da10 con 0x7f4ef415dda0 2023-10-14T18:57:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef416a6a0 con 0x7f4ef415dda0 2023-10-14T18:57:01.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.545+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef416ac60 con 0x7f4ef415dda0 2023-10-14T18:57:01.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.546+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40c7d20 con 0x7f4ef415dda0 2023-10-14T18:57:01.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.546+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4eec01e3b0 con 0x7f4ef415dda0 2023-10-14T18:57:01.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.547+0000 7f4eeb7fe700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:01.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.547+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4eec084b50 con 0x7f4ef415dda0 2023-10-14T18:57:01.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.547+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:01.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.547+0000 7f4ef2ffd700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4089ac0 tx=0x7f4ee4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:01.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.551+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4eec0520c0 con 0x7f4ef415dda0 2023-10-14T18:57:01.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.729+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ef40892f0 con 0x7f4ed4066f30 2023-10-14T18:57:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.731+0000 7f4eeb7fe700 1 -- 172.21.15.79:0/2485829698 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50552 (secure 0 0 0) 0x7f4ef40892f0 con 0x7f4ed4066f30 2023-10-14T18:57:01.733 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:57:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 msgr2=0x7f4ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4089ac0 tx=0x7f4ee4017000 comp rx=0 tx=0).stop 2023-10-14T18:57:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 msgr2=0x7f4ef4158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00a380 tx=0x7f4eec007900 comp rx=0 tx=0).stop 2023-10-14T18:57:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 shutdown_connections 2023-10-14T18:57:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ef415dda0 0x7f4ef4158750 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ef40cd6e0 0x7f4ef415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 --2- 172.21.15.79:0/2485829698 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ef40cdab0 0x7f4ef415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 >> 172.21.15.79:0/2485829698 conn(0x7f4ef4067660 msgr2=0x7f4ef40c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 shutdown_connections 2023-10-14T18:57:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:01.733+0000 7f4ef3fff700 1 -- 172.21.15.79:0/2485829698 wait complete. 2023-10-14T18:57:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:57:01.747 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2023-10-14T18:57:00.508034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552932,"statfs":{"total":1600000000,"available":1590202651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.444320"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":335,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-10-14T18:56:52.065886+0000","last_change":"2023-10-14T18:45:00.234457+0000","last_active":"2023-10-14T18:56:52.065886+0000","last_peered":"2023-10-14T18:56:52.065886+0000","last_clean":"2023-10-14T18:56:52.065886+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:56:52.065886+0000","last_undegraded":"2023-10-14T18:56:52.065886+0000","last_fullsized":"2023-10-14T18:56:52.065886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T18:44:59.117937+0000","last_clean_scrub_stamp":"2023-10-14T18:44:59.117937+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T06:09:37.663641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193684,"statfs":{"total":200000000,"available":198332429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":3.8580000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.307},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57999999999999996,"15min":0.68999999999999995},"min":{"1min":0.40500000000000003,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":7.8129999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.443,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.441,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29699999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77000000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.496,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.63900000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:56:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.60999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.245},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78800000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26400000000000001},"max":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.83599999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.47399999999999998,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63200000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":9.5779999999999994},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.58699999999999997,"5min":0.69799999999999995,"15min":0.71899999999999997},"last":0.621},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.77800000000000002,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.63400000000000001,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.70099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.54400000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.69099999999999995,"5min":3.992,"15min":3.992},"last":0.33000000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73999999999999999,"5min":1.252,"15min":1.252},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.43099999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.65200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.56799999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27000000000000002},"max":{"1min":0.71699999999999997,"5min":1.3340000000000001,"15min":10.574},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.49199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.78500000000000003,"5min":10.792,"15min":10.792},"last":0.25800000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85699999999999998,"5min":3.536,"15min":3.536},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.95899999999999996,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.504,"15min":1.504},"last":0.55900000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.62},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.05,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.38},"max":{"1min":0.93100000000000005,"5min":1.288,"15min":1.288},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67900000000000005,"15min":0.64700000000000002},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.0109999999999999,"5min":3.577,"15min":3.577},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.20200000000000001},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.623},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.60799999999999998},"last":0.375},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39200000000000002,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.40300000000000002}]},{"osd":3,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.373,"15min":0.34899999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.747,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.79100000000000004,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.82699999999999996,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:56:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59599999999999997},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.378},"max":{"1min":0.79900000000000004,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.66000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.33200000000000002,"15min":0.33800000000000002},"min":{"1min":0.223,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.45600000000000002,"5min":0.56799999999999995,"15min":3.4380000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.29299999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22600000000000001,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.86199999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.38400000000000001,"15min":0.38700000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.24299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.78900000000000003},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24099999999999999},"max":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":1.006},"last":0.308},{"interface":"front","average":{"1min":0.374,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":3.5760000000000001},"last":0.31900000000000001}]},{"osd":4,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.58599999999999997},"min":{"1min":0.41599999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":3.4820000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.376,"15min":0.34799999999999998},"max":{"1min":0.70699999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.371},"max":{"1min":0.876,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.44400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":3.5419999999999998},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.377},"max":{"1min":0.84099999999999997,"5min":0.88600000000000001,"15min":0.96899999999999997},"last":0.5},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.64100000000000001,"15min":0.63700000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":0.92600000000000005,"15min":0.96999999999999997},"last":0.61499999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:56:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.40500000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.624},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.623,"15min":0.621},"min":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0429999999999999},"last":0.54800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34699999999999998,"15min":0.33500000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.311},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.17999999999999999},"max":{"1min":0.50800000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.22700000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47899999999999998,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.438,"15min":0.41699999999999998},"min":{"1min":0.30299999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.41399999999999998}]},{"osd":4,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.79200000000000004},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.83399999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.34300000000000003},"max":{"1min":0.71199999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.58299999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.55900000000000005},"min":{"1min":0.44800000000000001,"5min":0.371,"15min":0.35999999999999999},"max":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.81000000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.67700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.44500000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.46500000000000002},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.60699999999999998,"5min":0.72199999999999998,"15min":0.999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.45900000000000002,"15min":0.47399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.44500000000000001,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59699999999999998,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67700000000000005,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:56:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":0.81999999999999995,"15min":0.85299999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71599999999999997,"5min":0.84499999999999997,"15min":0.872},"last":0.55200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.312,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60499999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.35599999999999998,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.71599999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57999999999999996,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.80700000000000005},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56000000000000005},"min":{"1min":0.41999999999999998,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.5}]},{"osd":3,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28499999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.31,"15min":0.29399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.48799999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.59299999999999997}]},{"osd":7,"last update":"Sat Oct 14 18:56:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61499999999999999}]}]}],"pool_statfs":[]}} 2023-10-14T18:57:01.752 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T18:44:59.117937+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=18, tm_min=44, tm_sec=59, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=18, tm_min=56, tm_sec=56, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T18:57:01.752 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T18:57:10.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:10.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:21.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T18:57:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 Processor -- start 2023-10-14T18:57:21.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 -- start start 2023-10-14T18:57:21.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcb01577d0 0x7efcb00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb006ac30 0x7efcb015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb015c360 con 0x7efcb0157ba0 2023-10-14T18:57:21.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb015b790 con 0x7efcb01577d0 2023-10-14T18:57:21.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.878+0000 7efcb82da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb015ba30 con 0x7efcb006ac30 2023-10-14T18:57:21.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcb01577d0 0x7efcb00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:21.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efcb01577d0 0x7efcb00cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45616/0 (socket says 172.21.15.79:45616) 2023-10-14T18:57:21.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 -- 172.21.15.79:0/2740190210 learned_addr learned my addr 172.21.15.79:0/2740190210 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:21.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 -- 172.21.15.79:0/2740190210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb006ac30 msgr2=0x7efcb015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 --2- 172.21.15.79:0/2740190210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb006ac30 0x7efcb015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 -- 172.21.15.79:0/2740190210 >> v1:172.21.15.144:6789/0 conn(0x7efcb0157ba0 legacy=0x7efcb006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 -- 172.21.15.79:0/2740190210 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb015bd10 con 0x7efcb01577d0 2023-10-14T18:57:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb6076700 1 --2- 172.21.15.79:0/2740190210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00cd770 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7efcac0099b0 tx=0x7efcac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d92812824717f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:21.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb5074700 1 -- 172.21.15.79:0/2740190210 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac00b820 con 0x7efcb01577d0 2023-10-14T18:57:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb5074700 1 -- 172.21.15.79:0/2740190210 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac00b980 con 0x7efcb01577d0 2023-10-14T18:57:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.879+0000 7efcb5074700 1 -- 172.21.15.79:0/2740190210 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac00bd20 con 0x7efcb01577d0 2023-10-14T18:57:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 -- 172.21.15.79:0/2740190210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 msgr2=0x7efcb00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 --2- 172.21.15.79:0/2740190210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00cd770 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7efcac0099b0 tx=0x7efcac009250 comp rx=0 tx=0).stop 2023-10-14T18:57:21.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 -- 172.21.15.79:0/2740190210 shutdown_connections 2023-10-14T18:57:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 --2- 172.21.15.79:0/2740190210 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb006ac30 0x7efcb015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 --2- 172.21.15.79:0/2740190210 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00cd770 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 -- 172.21.15.79:0/2740190210 >> 172.21.15.79:0/2740190210 conn(0x7efcb0068ce0 msgr2=0x7efcb00690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 -- 172.21.15.79:0/2740190210 shutdown_connections 2023-10-14T18:57:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.880+0000 7efcb82da700 1 -- 172.21.15.79:0/2740190210 wait complete. 2023-10-14T18:57:21.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.881+0000 7efcb82da700 1 Processor -- start 2023-10-14T18:57:21.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.881+0000 7efcb82da700 1 -- start start 2023-10-14T18:57:21.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb006ac30 0x7efcb0150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 0x7efcb00b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0151330 con 0x7efcb01577d0 2023-10-14T18:57:21.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00a9430 con 0x7efcb006ac30 2023-10-14T18:57:21.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00acda0 con 0x7efcb0157ba0 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45632/0 (socket says 172.21.15.79:45632) 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 -- 172.21.15.79:0/2605946725 learned_addr learned my addr 172.21.15.79:0/2605946725 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb6076700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb006ac30 0x7efcb0150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb6877700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 0x7efcb00b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:21.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 -- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 msgr2=0x7efcb00b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:21.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 0x7efcb00b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:21.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 -- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb006ac30 msgr2=0x7efcb0150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:21.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb006ac30 0x7efcb0150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:21.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 -- 172.21.15.79:0/2605946725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0094f0 con 0x7efcb01577d0 2023-10-14T18:57:21.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb6877700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 0x7efcb00b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T18:57:21.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb5875700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7efca000b610 tx=0x7efca0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:21.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000f510 con 0x7efcb01577d0 2023-10-14T18:57:21.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000f6b0 con 0x7efcb01577d0 2023-10-14T18:57:21.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca000fa70 con 0x7efcb01577d0 2023-10-14T18:57:21.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb00ac470 con 0x7efcb01577d0 2023-10-14T18:57:21.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.882+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb00aca30 con 0x7efcb01577d0 2023-10-14T18:57:21.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.883+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb004c3c0 con 0x7efcb01577d0 2023-10-14T18:57:21.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.884+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efca001a400 con 0x7efcb01577d0 2023-10-14T18:57:21.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.884+0000 7efca67fc700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:21.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.884+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efca0083ca0 con 0x7efcb01577d0 2023-10-14T18:57:21.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.884+0000 7efcb6076700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:21.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.885+0000 7efcb6076700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 0x7efc940693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efcac0099b0 tx=0x7efcac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:21.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:21.888+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efca0051290 con 0x7efcb01577d0 2023-10-14T18:57:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.067+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 --> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcb015bff0 con 0x7efc94066f30 2023-10-14T18:57:22.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.070+0000 7efca67fc700 1 -- 172.21.15.79:0/2605946725 <== mgr.4100 v2:172.21.15.144:6832/85980 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50694 (secure 0 0 0) 0x7efcb015bff0 con 0x7efc94066f30 2023-10-14T18:57:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:57:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 msgr2=0x7efc940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 0x7efc940693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efcac0099b0 tx=0x7efcac016000 comp rx=0 tx=0).stop 2023-10-14T18:57:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 msgr2=0x7efcb00b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7efca000b610 tx=0x7efca0009120 comp rx=0 tx=0).stop 2023-10-14T18:57:22.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 shutdown_connections 2023-10-14T18:57:22.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7efc94066f30 0x7efc940693e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efcb0157ba0 0x7efcb00b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb006ac30 0x7efcb0150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 --2- 172.21.15.79:0/2605946725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcb01577d0 0x7efcb00b5e00 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 >> 172.21.15.79:0/2605946725 conn(0x7efcb0068ce0 msgr2=0x7efcb00b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:22.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 shutdown_connections 2023-10-14T18:57:22.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.071+0000 7efcb82da700 1 -- 172.21.15.79:0/2605946725 wait complete. 2023-10-14T18:57:22.076 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-14T18:57:22.084 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2023-10-14T18:57:20.512631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9567,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552932,"statfs":{"total":1600000000,"available":1590202651,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002620"},"pg_stats":[{"pgid":"1.0","version":"192'119","reported_seq":348,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-10-14T18:57:06.252466+0000","last_change":"2023-10-14T18:57:06.252439+0000","last_active":"2023-10-14T18:57:06.252466+0000","last_peered":"2023-10-14T18:57:06.252466+0000","last_clean":"2023-10-14T18:57:06.252466+0000","last_became_active":"2023-10-14T18:45:00.233796+0000","last_became_peered":"2023-10-14T18:45:00.233796+0000","last_unstale":"2023-10-14T18:57:06.252466+0000","last_undegraded":"2023-10-14T18:57:06.252466+0000","last_fullsized":"2023-10-14T18:57:06.252466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"192'119","last_scrub_stamp":"2023-10-14T18:57:06.252385+0000","last_deep_scrub":"192'119","last_deep_scrub_stamp":"2023-10-14T18:57:06.252385+0000","last_clean_scrub_stamp":"2023-10-14T18:57:06.252385+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T01:44:52.104202+0000","scrub_duration":0.002940776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1628,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193684,"statfs":{"total":200000000,"available":198332429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.27800000000000002,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":0.77000000000000002,"15min":0.85999999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56899999999999995,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.82899999999999996,"5min":0.874,"15min":0.874},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.35599999999999998,"5min":0.32700000000000001,"15min":0.309},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":3.8580000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.307},"max":{"1min":0.76800000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.34300000000000003},"max":{"1min":0.71999999999999997,"5min":0.79700000000000004,"15min":0.92200000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.66800000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.35099999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":7.8129999999999997},"last":0.54500000000000004}]},{"osd":3,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.54900000000000004},"min":{"1min":0.42499999999999999,"5min":0.35099999999999998,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.88700000000000001},"last":0.628},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.41099999999999998,"15min":0.35499999999999998},"max":{"1min":0.79900000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.64500000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47599999999999998,"15min":0.46000000000000002},"min":{"1min":0.311,"5min":0.31,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50700000000000001,"15min":0.5},"min":{"1min":0.378,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.81799999999999995,"15min":0.84299999999999997},"last":0.66100000000000003}]},{"osd":5,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.32400000000000001,"15min":0.29599999999999999},"max":{"1min":0.82399999999999995,"5min":0.86599999999999999,"15min":0.89500000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.92300000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.315,"15min":0.315},"max":{"1min":0.84399999999999997,"5min":0.84999999999999998,"15min":0.95699999999999996},"last":0.69899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.245},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78800000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.38100000000000001,"5min":0.33500000000000002,"15min":0.20899999999999999},"max":{"1min":0.72699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.371,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.73599999999999999,"15min":0.76000000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.59299999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.26400000000000001},"max":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":3.4489999999999998},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.54800000000000004},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.83599999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57099999999999995},"min":{"1min":0.47399999999999998,"5min":0.36599999999999999,"15min":0.32100000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.311},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":9.5779999999999994},"last":0.625},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.28100000000000003},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.84099999999999997},"last":0.65500000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47499999999999998,"15min":0.45300000000000001},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.28000000000000003,"15min":0.25900000000000001},"max":{"1min":0.67200000000000004,"5min":0.69199999999999995,"15min":0.76800000000000002},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45700000000000002,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.58699999999999997,"5min":0.69799999999999995,"15min":0.71899999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.28499999999999998},"max":{"1min":0.77800000000000002,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.81100000000000005}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.29599999999999999},"max":{"1min":0.63400000000000001,"5min":0.80900000000000005,"15min":0.83199999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.317},"max":{"1min":0.66200000000000003,"5min":0.74399999999999999,"15min":0.89700000000000002},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33300000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.54400000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.373},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.35599999999999998},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.69099999999999995,"5min":3.992,"15min":3.992},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73999999999999999,"5min":1.252,"15min":1.252},"last":0.309},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.43099999999999999,"15min":0.38400000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.23200000000000001},"max":{"1min":0.65200000000000002,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.56799999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.27000000000000002},"max":{"1min":0.71699999999999997,"5min":1.3340000000000001,"15min":10.574},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.49199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.78500000000000003,"5min":10.792,"15min":10.792},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.629,"15min":0.59199999999999997},"min":{"1min":0.40600000000000003,"5min":0.40200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85699999999999998,"5min":3.536,"15min":3.536},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"max":{"1min":0.93999999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.51700000000000002}]},{"osd":5,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64400000000000002,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.36099999999999999},"max":{"1min":0.95899999999999996,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":0.497},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.504,"15min":1.504},"last":0.42299999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.62},"min":{"1min":0.435,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.05,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.437,"15min":0.38},"max":{"1min":0.93100000000000005,"5min":1.288,"15min":1.288},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 18:56:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.41699999999999998},"max":{"1min":0.998,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67900000000000005,"15min":0.64700000000000002},"min":{"1min":0.46500000000000002,"5min":0.439,"15min":0.379},"max":{"1min":1.0109999999999999,"5min":3.577,"15min":3.577},"last":0.40100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17499999999999999},"max":{"1min":0.44800000000000001,"5min":0.497,"15min":0.59599999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.35299999999999998,"15min":0.34399999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":0.52900000000000003,"5min":0.57299999999999995,"15min":0.623},"last":0.317}]},{"osd":2,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.372,"15min":0.36099999999999999},"min":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.60799999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39200000000000002,"15min":0.371},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.23599999999999999},"max":{"1min":0.51500000000000001,"5min":0.56299999999999994,"15min":0.61899999999999999},"last":0.38}]},{"osd":3,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.35199999999999998},"min":{"1min":0.248,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.64200000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.42199999999999999,"15min":0.39500000000000002},"min":{"1min":0.31,"5min":0.26800000000000002,"15min":0.25700000000000001},"max":{"1min":0.54700000000000004,"5min":0.64500000000000002,"15min":0.65200000000000002},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.63100000000000001,"15min":0.60699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.316},"max":{"1min":0.81999999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63400000000000001,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.39600000000000002,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59399999999999997,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":0.73299999999999998,"5min":0.84799999999999998,"15min":1.0369999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":0.77000000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63500000000000001,"15min":0.59799999999999998},"min":{"1min":0.44400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.82799999999999996,"5min":0.99399999999999999,"15min":1.0249999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61899999999999999,"15min":0.59399999999999997},"min":{"1min":0.40400000000000003,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":0.87,"5min":0.89600000000000002,"15min":0.98799999999999999},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 18:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63400000000000001,"15min":0.60099999999999998},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.379},"max":{"1min":0.83099999999999996,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.629,"15min":0.59699999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.378},"max":{"1min":0.80800000000000005,"5min":0.93000000000000005,"15min":0.96299999999999997},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.23300000000000001,"5min":0.223,"15min":0.19600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":3.4380000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38200000000000001,"15min":0.35599999999999998},"min":{"1min":0.23899999999999999,"5min":0.214,"15min":0.21099999999999999},"max":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.67200000000000004},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.34100000000000003},"min":{"1min":0.26000000000000001,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.86199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.38800000000000001},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.24299999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.78900000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.29999999999999999,"5min":0.26900000000000002,"15min":0.24099999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":1.006},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":3.5760000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":0.86199999999999999,"15min":3.4820000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.41499999999999998,"15min":0.34799999999999998},"max":{"1min":0.81200000000000006,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.46600000000000003,"5min":0.438,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88600000000000001,"5min":0.90800000000000003,"15min":3.5419999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.624},"min":{"1min":0.47299999999999998,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.96899999999999997},"last":0.75},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66400000000000003,"15min":0.64100000000000001},"min":{"1min":0.49099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.96999999999999997},"last":0.82299999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:57:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.499,"5min":0.441,"15min":0.40500000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.624},"min":{"1min":0.41499999999999998,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.0429999999999999},"last":0.78500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.34699999999999998,"15min":0.33500000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55600000000000005,"15min":0.68100000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34399999999999997},"min":{"1min":0.22900000000000001,"5min":0.217,"15min":0.17999999999999999},"max":{"1min":0.50800000000000001,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34399999999999997},"min":{"1min":0.22700000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.47899999999999998,"5min":0.57299999999999995,"15min":0.65600000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39900000000000002,"15min":0.38400000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.22800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40100000000000002,"15min":0.38400000000000001},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.57899999999999996,"15min":0.61499999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.438,"15min":0.41699999999999998},"min":{"1min":0.30299999999999999,"5min":0.28100000000000003,"15min":0.23799999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.91900000000000004,"15min":0.92500000000000004},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.33200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.81399999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.81399999999999995,"5min":0.92800000000000005,"15min":0.95599999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.621,"15min":0.61299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59099999999999997,"15min":0.58599999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.34300000000000003},"max":{"1min":0.77600000000000002,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Oct 14 18:56:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.625,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.378,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.90200000000000002,"15min":0.92300000000000004},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29699999999999999},"max":{"1min":0.621,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":0.745,"15min":0.79200000000000004},"last":0.50600000000000001}]},{"osd":1,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52700000000000002},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33000000000000002},"max":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.83399999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66300000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63300000000000001}]},{"osd":2,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69699999999999995,"5min":0.78700000000000003,"15min":0.79900000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.45700000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.70599999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.35999999999999999},"max":{"1min":0.65900000000000003,"5min":0.72199999999999998,"15min":0.81000000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.38400000000000001},"max":{"1min":0.71799999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.254},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32600000000000001,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.94999999999999996},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.44600000000000001,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.23899999999999999},"max":{"1min":0.71699999999999997,"5min":0.77900000000000003,"15min":0.80800000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.32200000000000001},"max":{"1min":0.78600000000000003,"5min":0.83099999999999996,"15min":0.89300000000000002},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Oct 14 18:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77900000000000003,"5min":0.80200000000000005,"15min":0.85299999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.26800000000000002},"max":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.872},"last":0.65200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1051,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922797,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.755,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.33100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69899999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.5}]},{"osd":1,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.309,"15min":0.29599999999999999},"max":{"1min":0.67500000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.35099999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.80700000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.377,"15min":0.36199999999999999},"max":{"1min":0.71299999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.55600000000000005,"15min":0.56100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67600000000000005,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55800000000000005,"15min":0.55300000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.44500000000000001,"15min":0.47299999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70099999999999996,"5min":0.88800000000000001,"15min":0.89300000000000002},"last":0.371},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49399999999999999,"15min":0.51500000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70699999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46400000000000002,"15min":0.48599999999999999},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72299999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73799999999999999,"5min":1.603,"15min":1.603},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Oct 14 18:57:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.55300000000000005},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.73399999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.33100000000000002},"max":{"1min":0.68000000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39100000000000001}]}]}],"pool_statfs":[]}} 2023-10-14T18:57:22.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T18:57:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.199+0000 7f87da2ed700 1 Processor -- start 2023-10-14T18:57:22.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.199+0000 7f87da2ed700 1 -- start start 2023-10-14T18:57:22.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87da2ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87d415a290 0x7f87d406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87da2ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87da2ed700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d40b0790 con 0x7f87d4159ec0 2023-10-14T18:57:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87da2ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d406af60 con 0x7f87d415a290 2023-10-14T18:57:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87da2ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40ce1f0 con 0x7f87d406aae0 2023-10-14T18:57:22.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87d415a290 0x7f87d406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f87d415a290 0x7f87d406a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45640/0 (socket says 172.21.15.79:45640) 2023-10-14T18:57:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 -- 172.21.15.79:0/2262555295 learned_addr learned my addr 172.21.15.79:0/2262555295 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d888a700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 -- 172.21.15.79:0/2262555295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 msgr2=0x7f87d40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:22.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.200+0000 7f87d37fe700 1 -- 172.21.15.79:0/2262555295 >> v1:172.21.15.144:6789/0 conn(0x7f87d4159ec0 legacy=0x7f87d40af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87d37fe700 1 -- 172.21.15.79:0/2262555295 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40b0b20 con 0x7f87d415a290 2023-10-14T18:57:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87d37fe700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d406a5a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f87c80099b0 tx=0x7f87c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0cca0c3318407e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87d2ffd700 1 -- 172.21.15.79:0/2262555295 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800b860 con 0x7f87d415a290 2023-10-14T18:57:22.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87d2ffd700 1 -- 172.21.15.79:0/2262555295 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c800b9c0 con 0x7f87d415a290 2023-10-14T18:57:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87d2ffd700 1 -- 172.21.15.79:0/2262555295 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c800bd60 con 0x7f87d415a290 2023-10-14T18:57:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 -- 172.21.15.79:0/2262555295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 msgr2=0x7f87d406a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d406a5a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f87c80099b0 tx=0x7f87c8009250 comp rx=0 tx=0).stop 2023-10-14T18:57:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 -- 172.21.15.79:0/2262555295 shutdown_connections 2023-10-14T18:57:22.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 --2- 172.21.15.79:0/2262555295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d406a5a0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 -- 172.21.15.79:0/2262555295 >> 172.21.15.79:0/2262555295 conn(0x7f87d40d1880 msgr2=0x7f87d40cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 -- 172.21.15.79:0/2262555295 shutdown_connections 2023-10-14T18:57:22.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.201+0000 7f87da2ed700 1 -- 172.21.15.79:0/2262555295 wait complete. 2023-10-14T18:57:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.202+0000 7f87da2ed700 1 Processor -- start 2023-10-14T18:57:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 -- start start 2023-10-14T18:57:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d4159ec0 0x7f87d40a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d416b700 con 0x7f87d415a290 2023-10-14T18:57:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40b5ba0 con 0x7f87d4159ec0 2023-10-14T18:57:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87da2ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40b5e80 con 0x7f87d406aae0 2023-10-14T18:57:22.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87d888a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87d888a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45646/0 (socket says 172.21.15.79:45646) 2023-10-14T18:57:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.203+0000 7f87d888a700 1 -- 172.21.15.79:0/801690431 learned_addr learned my addr 172.21.15.79:0/801690431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d3fff700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d37fe700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d4159ec0 0x7f87d40a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 -- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 msgr2=0x7f87d40afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 -- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d4159ec0 msgr2=0x7f87d40a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d4159ec0 0x7f87d40a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 -- 172.21.15.79:0/801690431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c80094f0 con 0x7f87d415a290 2023-10-14T18:57:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87d888a700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00ceb0 tx=0x7f87cc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00ae40 con 0x7f87d415a290 2023-10-14T18:57:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc016430 con 0x7f87d415a290 2023-10-14T18:57:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d40b6160 con 0x7f87d415a290 2023-10-14T18:57:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0167d0 con 0x7f87d415a290 2023-10-14T18:57:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.204+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d40b6440 con 0x7f87d415a290 2023-10-14T18:57:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.205+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d416b870 con 0x7f87d415a290 2023-10-14T18:57:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.205+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87cc003020 con 0x7f87d415a290 2023-10-14T18:57:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.206+0000 7f87bbfff700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.206+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f87cc012070 con 0x7f87d415a290 2023-10-14T18:57:22.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.206+0000 7f87d3fff700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.206+0000 7f87d3fff700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 0x7f87c00693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f87d40d1d30 tx=0x7f87c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.211+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87d416b870 con 0x7f87d415a290 2023-10-14T18:57:22.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.392+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f87d416b840 con 0x7f87d415a290 2023-10-14T18:57:22.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.396+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87cc056160 con 0x7f87d415a290 2023-10-14T18:57:22.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.396+0000 7f87bbfff700 1 -- 172.21.15.79:0/801690431 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f87cc055ed0 con 0x7f87d415a290 2023-10-14T18:57:22.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 msgr2=0x7f87c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 0x7f87c00693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f87d40d1d30 tx=0x7f87c4009040 comp rx=0 tx=0).stop 2023-10-14T18:57:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 msgr2=0x7f87d40a7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00ceb0 tx=0x7f87cc007870 comp rx=0 tx=0).stop 2023-10-14T18:57:22.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 shutdown_connections 2023-10-14T18:57:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7f87c0066f30 0x7f87c00693e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87d415a290 0x7f87d40a7bf0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87d406aae0 0x7f87d40afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 --2- 172.21.15.79:0/801690431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87d4159ec0 0x7f87d40a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.398+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 >> 172.21.15.79:0/801690431 conn(0x7f87d40d1880 msgr2=0x7f87d40cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.399+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 shutdown_connections 2023-10-14T18:57:22.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.399+0000 7f87da2ed700 1 -- 172.21.15.79:0/801690431 wait complete. 2023-10-14T18:57:22.412 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T18:57:22.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T18:57:22.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 Processor -- start 2023-10-14T18:57:22.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 -- start start 2023-10-14T18:57:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe61c157c40 0x7fe61c158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c15cbb0 con 0x7fe61c157870 2023-10-14T18:57:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c15bfa0 con 0x7fe61c15a620 2023-10-14T18:57:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe6218f9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c15bdb0 con 0x7fe61c157c40 2023-10-14T18:57:22.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe61affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe61c157870 0x7fe61c15b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:38452/0 (socket says 172.21.15.79:38452) 2023-10-14T18:57:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe61affd700 1 -- 172.21.15.79:0/1329674075 learned_addr learned my addr 172.21.15.79:0/1329674075 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-14T18:57:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/1329674075 >> v2:172.21.15.144:3300/0 conn(0x7fe61c157c40 0x7fe61c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838591322 0 0) 0x7fe61c15cbb0 con 0x7fe61c157870 2023-10-14T18:57:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.525+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe604003570 con 0x7fe61c157870 2023-10-14T18:57:22.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507083880 0 0) 0x7fe604003570 con 0x7fe61c157870 2023-10-14T18:57:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 >> v2:172.21.15.144:3300/0 conn(0x7fe61c157c40 msgr2=0x7fe61c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 --2- 172.21.15.79:0/1329674075 >> v2:172.21.15.144:3300/0 conn(0x7fe61c157c40 0x7fe61c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 >> v1:172.21.15.144:6789/0 conn(0x7fe61c15a620 legacy=0x7fe61c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c15c280 con 0x7fe61c157870 2023-10-14T18:57:22.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1931776344 0 0) 0x7fe60c0017f0 con 0x7fe61c157870 2023-10-14T18:57:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 >> v1:172.21.15.79:6789/0 conn(0x7fe61c157870 legacy=0x7fe61c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60400c130 con 0x7fe6040051c0 2023-10-14T18:57:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60400c2a0 con 0x7fe604004810 2023-10-14T18:57:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60400c460 con 0x7fe604003a60 2023-10-14T18:57:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61a7fc700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61affd700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 -- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe604003a60 msgr2=0x7fe604003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 -- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604004810 msgr2=0x7fe604004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T18:57:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 -- 172.21.15.79:0/1329674075 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604003570 con 0x7fe6040051c0 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 -- 172.21.15.79:0/1329674075 reap_dead start 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe61c1580c0 tx=0x7fe6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aece029772e306ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e710 con 0x7fe6040051c0 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe61400e870 con 0x7fe6040051c0 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.526+0000 7fe619ffb700 1 -- 172.21.15.79:0/1329674075 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400ec50 con 0x7fe6040051c0 2023-10-14T18:57:22.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 -- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 msgr2=0x7fe60400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fe61c1580c0 tx=0x7fe6140091a0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 -- 172.21.15.79:0/1329674075 shutdown_connections 2023-10-14T18:57:22.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 --2- 172.21.15.79:0/1329674075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 -- 172.21.15.79:0/1329674075 >> 172.21.15.79:0/1329674075 conn(0x7fe61c068ce0 msgr2=0x7fe61c0690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:22.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 -- 172.21.15.79:0/1329674075 shutdown_connections 2023-10-14T18:57:22.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.527+0000 7fe6218f9700 1 -- 172.21.15.79:0/1329674075 wait complete. 2023-10-14T18:57:22.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.528+0000 7fe6218f9700 1 Processor -- start 2023-10-14T18:57:22.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.528+0000 7fe6218f9700 1 -- start start 2023-10-14T18:57:22.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6040051c0 0x7fe61c14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b32a0 0x7fe61c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1506a0 con 0x7fe61c150200 2023-10-14T18:57:22.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0b1c30 con 0x7fe61c0b32a0 2023-10-14T18:57:22.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe6218f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0b1300 con 0x7fe6040051c0 2023-10-14T18:57:22.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45664/0 (socket says 172.21.15.79:45664) 2023-10-14T18:57:22.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 -- 172.21.15.79:0/2788946800 learned_addr learned my addr 172.21.15.79:0/2788946800 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-14T18:57:22.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61a7fc700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b32a0 0x7fe61c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61affd700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6040051c0 0x7fe61c14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 -- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6040051c0 msgr2=0x7fe61c14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6040051c0 0x7fe61c14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 -- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b32a0 msgr2=0x7fe61c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b32a0 0x7fe61c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 -- 172.21.15.79:0/2788946800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0b15e0 con 0x7fe61c150200 2023-10-14T18:57:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe61b7fe700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0b03b0 tx=0x7fe6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.529+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614022070 con 0x7fe61c150200 2023-10-14T18:57:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.530+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe614013cd0 con 0x7fe61c150200 2023-10-14T18:57:22.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.530+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c0b18c0 con 0x7fe61c150200 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.530+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e710 con 0x7fe61c150200 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.530+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1522f0 con 0x7fe61c150200 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.531+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c0b1de0 con 0x7fe61c150200 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.531+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe614026070 con 0x7fe61c150200 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.531+0000 7fe602ffd700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T18:57:22.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.531+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe614085970 con 0x7fe61c150200 2023-10-14T18:57:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.531+0000 7fe61affd700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T18:57:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.532+0000 7fe61affd700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0af930 tx=0x7fe60c00c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T18:57:22.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.535+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe61c0b1de0 con 0x7fe61c150200 2023-10-14T18:57:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.762+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe61c0b1fc0 con 0x7fe61c150200 2023-10-14T18:57:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.763+0000 7fe602ffd700 1 -- 172.21.15.79:0/2788946800 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe61c0b1fc0 con 0x7fe61c150200 2023-10-14T18:57:22.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-14T18:57:22.765 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3700227975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":3700227975},{"type":"v1","addr":"172.21.15.79:6835","nonce":3700227975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":6497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/334670860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":334670860},{"type":"v1","addr":"172.21.15.144:6836","nonce":334670860}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2920065037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2920065037},{"type":"v1","addr":"172.21.15.144:6837","nonce":2920065037}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/3852572536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3852572536},{"type":"v1","addr":"172.21.15.79:6834","nonce":3852572536}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[]} 2023-10-14T18:57:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 msgr2=0x7fe6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 0x7fe6080693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0af930 tx=0x7fe60c00c040 comp rx=0 tx=0).stop 2023-10-14T18:57:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 msgr2=0x7fe61c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T18:57:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0b03b0 tx=0x7fe6140091a0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 shutdown_connections 2023-10-14T18:57:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:6832/85980,v1:172.21.15.144:6833/85980] conn(0x7fe608066f30 0x7fe6080693e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe61c150200 0x7fe61c151db0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe6040051c0 0x7fe61c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 --2- 172.21.15.79:0/2788946800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b32a0 0x7fe61c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T18:57:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 >> 172.21.15.79:0/2788946800 conn(0x7fe61c068ce0 msgr2=0x7fe61c0b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T18:57:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 shutdown_connections 2023-10-14T18:57:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-14T18:57:22.765+0000 7fe6218f9700 1 -- 172.21.15.79:0/2788946800 wait complete. 2023-10-14T18:57:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 90 2023-10-14T18:57:22.779 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T18:57:22.779 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T18:57:22.780 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T18:57:22.780 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.788 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T18:57:22.788 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T18:57:22.789 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.837 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T18:57:22.837 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T18:57:22.838 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.848 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T18:57:22.848 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T18:57:22.848 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.898 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T18:57:22.899 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T18:57:22.899 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T18:57:22.899 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.919 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T18:57:22.919 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T18:57:22.920 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:22.983 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T18:57:22.983 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T18:57:22.984 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.048 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T18:57:23.049 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T18:57:23.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.108 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T18:57:23.108 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T18:57:23.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.131 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T18:57:23.132 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T18:57:23.132 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.191 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T18:57:23.192 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T18:57:23.192 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.255 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T18:57:23.256 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T18:57:23.256 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.317 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T18:57:23.317 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T18:57:23.318 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T18:57:23.318 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.341 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T18:57:23.341 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T18:57:23.342 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.384 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T18:57:23.384 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T18:57:23.385 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T18:57:23.385 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.395 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T18:57:23.396 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T18:57:23.396 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.435 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T18:57:23.435 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T18:57:23.436 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T18:57:23.486 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T18:57:23.486 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T18:57:23.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-14T18:57:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:1697309097.1160598 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 218088.856815 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-14T18:57:23.518 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-14T18:57:23.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-14T18:57:23.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-14T18:57:23.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-14T18:57:23.728 INFO:teuthology.orchestra.run.smithi079.stdout:1697309097.1160598 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 218088.856815 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-14T18:57:23.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:57:23.729 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T18:57:24.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:57:24.006 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T18:57:24.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:57:24.114 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T18:57:24.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:57:24.182 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T18:57:24.252 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:57:24.253 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T18:57:24.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:57:24.420 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T18:57:24.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:57:24.532 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T18:57:24.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:57:24.581 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T18:57:24.641 INFO:tasks.ceph:Archiving mon data... 2023-10-14T18:57:24.642 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/data/mon.a.tgz 2023-10-14T18:57:24.643 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2023-10-14T18:57:24.658 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.x6fYDTzB8i 2023-10-14T18:57:24.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.x6fYDTzB8i 2023-10-14T18:57:24.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.x6fYDTzB8i 2023-10-14T18:57:24.883 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.x6fYDTzB8i is 377KB 2023-10-14T18:57:24.979 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.x6fYDTzB8i 2023-10-14T18:57:24.993 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/data/mon.b.tgz 2023-10-14T18:57:24.994 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-14T18:57:25.010 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.5OCYXLjjq9 2023-10-14T18:57:25.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5OCYXLjjq9 2023-10-14T18:57:25.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.5OCYXLjjq9 2023-10-14T18:57:25.245 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.5OCYXLjjq9 is 383KB 2023-10-14T18:57:25.344 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.5OCYXLjjq9 2023-10-14T18:57:25.359 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/data/mon.c.tgz 2023-10-14T18:57:25.359 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-10-14T18:57:25.413 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.Pnes9uP8UP 2023-10-14T18:57:25.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Pnes9uP8UP 2023-10-14T18:57:25.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.Pnes9uP8UP 2023-10-14T18:57:25.630 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.Pnes9uP8UP is 383KB 2023-10-14T18:57:25.727 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.Pnes9uP8UP 2023-10-14T18:57:25.741 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T18:57:25.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T18:57:25.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T18:57:25.804 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T18:57:25.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T18:57:25.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T18:57:25.832 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T18:57:25.869 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T18:57:25.875 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T18:57:25.877 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi079/crash 2023-10-14T18:57:25.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T18:57:25.903 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi144/crash 2023-10-14T18:57:25.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T18:57:25.939 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T18:57:25.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:25.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:26.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:26.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:26.080 INFO:tasks.ceph:Compressing logs... 2023-10-14T18:57:26.080 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T18:57:26.098 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T18:57:26.167 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89818.log 2023-10-14T18:57:26.168 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89423.log 2023-10-14T18:57:26.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88619.log 2023-10-14T18:57:26.168 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89818.log.gz 2023-10-14T18:57:26.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91878.log 2023-10-14T18:57:26.168 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89423.log.gz 2023-10-14T18:57:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87849.log 2023-10-14T18:57:26.169 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88619.log.gz 2023-10-14T18:57:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91463.log 2023-10-14T18:57:26.169 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91878.log.gz 2023-10-14T18:57:26.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.3.87849.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T18:57:26.170 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87849.log.gz 2023-10-14T18:57:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89814.log 2023-10-14T18:57:26.170 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91463.log.gz 2023-10-14T18:57:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T18:57:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86339.log 2023-10-14T18:57:26.171 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89814.log.gz 2023-10-14T18:57:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86385.log 2023-10-14T18:57:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86339.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T18:57:26.171 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86339.log.gz 2023-10-14T18:57:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90967.log 2023-10-14T18:57:26.172 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86385.log.gz 2023-10-14T18:57:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T18:57:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.1.90967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90967.log.gz 2023-10-14T18:57:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T18:57:26.172 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T18:57:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91467.log 2023-10-14T18:57:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.91467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91467.log.gz 2023-10-14T18:57:26.173 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86213.log 2023-10-14T18:57:26.173 INFO:teuthology.orchestra.run.smithi144.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T18:57:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86469.log 2023-10-14T18:57:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86213.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T18:57:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86213.log.gz 2023-10-14T18:57:26.174 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86469.log.gz 2023-10-14T18:57:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T18:57:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-mds.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T18:57:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90207.log 2023-10-14T18:57:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87490.log 2023-10-14T18:57:26.175 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90207.log.gz 2023-10-14T18:57:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.87490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87490.log.gz 2023-10-14T18:57:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88260.log 2023-10-14T18:57:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.91882.log 2023-10-14T18:57:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88260.log.gz 2023-10-14T18:57:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.91882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.91882.log.gz 2023-10-14T18:57:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T18:57:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86254.log 2023-10-14T18:57:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.86254.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86254.log.gz 2023-10-14T18:57:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88256.log 2023-10-14T18:57:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88256.log.gz 2023-10-14T18:57:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89427.log 2023-10-14T18:57:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89427.log.gz 2023-10-14T18:57:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90573.log 2023-10-14T18:57:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90573.log.gz 2023-10-14T18:57:26.178 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T18:57:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86426.log 2023-10-14T18:57:26.186 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86426.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86426.log.gz 2023-10-14T18:57:26.200 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86297.log 2023-10-14T18:57:26.213 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86297.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86297.log.gz 2023-10-14T18:57:26.220 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.87853.log 2023-10-14T18:57:26.220 INFO:teuthology.orchestra.run.smithi144.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T18:57:26.227 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.3.87853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.87853.log.gz 2023-10-14T18:57:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.87481.log 2023-10-14T18:57:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.87481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.87481.log.gz 2023-10-14T18:57:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90971.log 2023-10-14T18:57:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90971.log.gz 2023-10-14T18:57:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.88623.log 2023-10-14T18:57:26.229 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.88623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.88623.log.gz 2023-10-14T18:57:26.229 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T18:57:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T18:57:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89011.log 2023-10-14T18:57:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89011.log.gz 2023-10-14T18:57:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86173.log 2023-10-14T18:57:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86173.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86173.log.gz 2023-10-14T18:57:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90569.log 2023-10-14T18:57:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90569.log.gz 2023-10-14T18:57:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.89007.log 2023-10-14T18:57:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.89007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.89007.log.gz 2023-10-14T18:57:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.90203.log 2023-10-14T18:57:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.1.90203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.90203.log.gz 2023-10-14T18:57:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95937.log 2023-10-14T18:57:26.289 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87195.log 2023-10-14T18:57:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113316.log 2023-10-14T18:57:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95937.log: /var/log/ceph/ceph-client.admin.87195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90878.log 2023-10-14T18:57:26.290 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95937.log.gz 2023-10-14T18:57:26.290 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115879.log 2023-10-14T18:57:26.291 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87195.log.gz 2023-10-14T18:57:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90878.log: gzip -5 89.3%--verbose -- /var/log/ceph/ceph-client.admin.94775.log -- replaced with /var/log/ceph/ceph-client.admin.113316.log.gz 2023-10-14T18:57:26.291 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:26.291 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109888.log 2023-10-14T18:57:26.291 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90878.log.gz 2023-10-14T18:57:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94775.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115879.log.gz 2023-10-14T18:57:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104127.log 2023-10-14T18:57:26.292 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94775.log.gz 2023-10-14T18:57:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96134.log 2023-10-14T18:57:26.292 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110712.log 2023-10-14T18:57:26.293 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109888.log.gz 2023-10-14T18:57:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100796.log 2023-10-14T18:57:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.96134.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104127.log.gz 2023-10-14T18:57:26.293 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96134.log.gz 2023-10-14T18:57:26.293 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104807.log 2023-10-14T18:57:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100796.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110712.log.gz 2023-10-14T18:57:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116261.log 2023-10-14T18:57:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104765.log 2023-10-14T18:57:26.294 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100796.log.gz 2023-10-14T18:57:26.294 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108873.log 2023-10-14T18:57:26.295 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104807.log.gz 2023-10-14T18:57:26.295 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116261.log.gz 2023-10-14T18:57:26.295 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113400.log 2023-10-14T18:57:26.295 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104596.log 2023-10-14T18:57:26.295 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104765.log.gz 2023-10-14T18:57:26.296 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113400.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108873.log.gzgzip 2023-10-14T18:57:26.296 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.111358.log 2023-10-14T18:57:26.296 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%/var/log/ceph/ceph-client.admin.104596.log: -- replaced with /var/log/ceph/ceph-client.admin.113400.log.gz 2023-10-14T18:57:26.296 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111316.log 2023-10-14T18:57:26.296 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111358.log: gzip -5 --verbose 89.0%-- /var/log/ceph/ceph-client.admin.89127.log -- replaced with /var/log/ceph/ceph-client.admin.104596.log.gz 2023-10-14T18:57:26.297 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:26.297 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111316.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111358.log.gz 2023-10-14T18:57:26.297 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94294.log 2023-10-14T18:57:26.297 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111316.log.gz 2023-10-14T18:57:26.297 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107297.log 2023-10-14T18:57:26.298 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103975.log 2023-10-14T18:57:26.298 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89127.log.gz 2023-10-14T18:57:26.298 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107297.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94294.log.gz 2023-10-14T18:57:26.298 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105707.log 2023-10-14T18:57:26.298 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107297.log.gz 2023-10-14T18:57:26.299 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100964.log 2023-10-14T18:57:26.299 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118909.log 2023-10-14T18:57:26.299 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103975.log.gz 2023-10-14T18:57:26.299 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100964.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105707.log.gz 2023-10-14T18:57:26.299 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104638.log 2023-10-14T18:57:26.300 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100964.log.gz 2023-10-14T18:57:26.300 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89253.log 2023-10-14T18:57:26.300 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90794.log 2023-10-14T18:57:26.300 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118909.log.gz 2023-10-14T18:57:26.300 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110670.log 2023-10-14T18:57:26.301 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104638.log.gz 2023-10-14T18:57:26.301 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89253.log.gz 2023-10-14T18:57:26.301 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92866.log 2023-10-14T18:57:26.301 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110670.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.90794.log.gz 2023-10-14T18:57:26.301 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.102342.log 2023-10-14T18:57:26.302 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92866.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110670.log.gz 2023-10-14T18:57:26.302 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107880.log 2023-10-14T18:57:26.302 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102342.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92866.log.gz 2023-10-14T18:57:26.302 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101006.log 2023-10-14T18:57:26.302 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103816.log 2023-10-14T18:57:26.303 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102342.log.gz 2023-10-14T18:57:26.303 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101006.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107880.log.gz 2023-10-14T18:57:26.303 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99144.log 2023-10-14T18:57:26.303 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105485.log 2023-10-14T18:57:26.303 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101006.log.gz 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99144.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.103816.log.gz-5 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106671.log 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4%/var/log/ceph/ceph-client.admin.105485.log: -- replaced with /var/log/ceph/ceph-client.admin.99144.log.gz 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109559.log 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97557.log 2023-10-14T18:57:26.304 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105485.log.gz 2023-10-14T18:57:26.305 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3%/var/log/ceph/ceph-client.admin.109559.log: -- replaced with /var/log/ceph/ceph-client.admin.106671.log.gz 2023-10-14T18:57:26.305 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115363.log 2023-10-14T18:57:26.305 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106137.log 2023-10-14T18:57:26.305 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109559.log.gz 2023-10-14T18:57:26.305 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104512.log 2023-10-14T18:57:26.306 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97557.log.gz 2023-10-14T18:57:26.306 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106137.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115363.log.gz 2023-10-14T18:57:26.306 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92780.log 2023-10-14T18:57:26.306 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106263.log 2023-10-14T18:57:26.306 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106137.log.gz 2023-10-14T18:57:26.307 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98249.log 2023-10-14T18:57:26.307 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104512.log.gz 2023-10-14T18:57:26.307 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106263.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.92780.log.gz-5 2023-10-14T18:57:26.307 INFO:teuthology.orchestra.run.smithi079.stderr:--verbose -- /var/log/ceph/ceph-client.admin.88959.log 2023-10-14T18:57:26.307 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98249.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T18:57:26.308 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88959.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98249.log.gz 2023-10-14T18:57:26.308 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116531.log 2023-10-14T18:57:26.308 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.106263.log.gz 2023-10-14T18:57:26.308 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88959.log.gz 2023-10-14T18:57:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103104.log 2023-10-14T18:57:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90455.log 2023-10-14T18:57:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103104.log: gzip -5 89.1%--verbose -- /var/log/ceph/ceph-client.admin.111274.log -- replaced with /var/log/ceph/ceph-client.admin.116531.log.gz 2023-10-14T18:57:26.309 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:26.309 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.2.90455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88668.log 2023-10-14T18:57:26.310 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103104.log.gz -- replaced with /var/log/ceph/ceph-client.2.90455.log.gz 2023-10-14T18:57:26.310 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105843.log 2023-10-14T18:57:26.310 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111274.log.gz 2023-10-14T18:57:26.310 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111144.log 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88668.log.gz 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88335.log 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111144.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.105843.log.gz--verbose 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.108747.log 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111144.log.gz 2023-10-14T18:57:26.311 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118206.log 2023-10-14T18:57:26.312 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88335.log.gz 2023-10-14T18:57:26.312 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118080.log 2023-10-14T18:57:26.312 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118206.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108747.log.gz 2023-10-14T18:57:26.312 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97515.log 2023-10-14T18:57:26.312 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118206.log.gz 2023-10-14T18:57:26.313 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91928.log 2023-10-14T18:57:26.313 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118080.log.gz 2023-10-14T18:57:26.313 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117996.log 2023-10-14T18:57:26.313 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91928.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97515.log.gz-5 2023-10-14T18:57:26.313 INFO:teuthology.orchestra.run.smithi079.stderr:--verbose -- /var/log/ceph/ceph-client.admin.97118.log 2023-10-14T18:57:26.314 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91928.log.gz 2023-10-14T18:57:26.314 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105359.log 2023-10-14T18:57:26.314 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117996.log.gz 2023-10-14T18:57:26.314 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105749.log 2023-10-14T18:57:26.314 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105359.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97118.log.gz 2023-10-14T18:57:26.315 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111400.log 2023-10-14T18:57:26.315 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105359.log.gz 2023-10-14T18:57:26.315 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93911.log 2023-10-14T18:57:26.315 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111400.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105749.log.gz 2023-10-14T18:57:26.315 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118615.log 2023-10-14T18:57:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93911.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111400.log.gz 2023-10-14T18:57:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102626.log 2023-10-14T18:57:26.316 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93911.log.gz 2023-10-14T18:57:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99765.log 2023-10-14T18:57:26.316 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102626.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118615.log.gz 2023-10-14T18:57:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95355.log 2023-10-14T18:57:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113664.log 2023-10-14T18:57:26.317 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102626.log.gz 2023-10-14T18:57:26.317 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99765.log.gz 2023-10-14T18:57:26.317 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101436.log 2023-10-14T18:57:26.318 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95355.log.gz 2023-10-14T18:57:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114103.log 2023-10-14T18:57:26.318 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91760.log 2023-10-14T18:57:26.318 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113664.log.gz 2023-10-14T18:57:26.318 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101436.log.gz 2023-10-14T18:57:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109846.log 2023-10-14T18:57:26.319 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114103.log.gz 2023-10-14T18:57:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116488.log 2023-10-14T18:57:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109846.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91760.log.gz 2023-10-14T18:57:26.319 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112673.log 2023-10-14T18:57:26.320 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.109846.log.gz 2023-10-14T18:57:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96175.log 2023-10-14T18:57:26.320 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9%/var/log/ceph/ceph-client.admin.112673.log: -- replaced with /var/log/ceph/ceph-client.admin.116488.log.gz 2023-10-14T18:57:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92644.log 2023-10-14T18:57:26.320 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96175.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112673.log.gz 2023-10-14T18:57:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87657.log 2023-10-14T18:57:26.321 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96175.log.gz 2023-10-14T18:57:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118699.log 2023-10-14T18:57:26.321 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92644.log.gz 2023-10-14T18:57:26.321 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86663.log 2023-10-14T18:57:26.322 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103702.log 2023-10-14T18:57:26.322 INFO:teuthology.orchestra.run.smithi079.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.87657.log.gz 2023-10-14T18:57:26.322 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86663.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118699.log.gz 2023-10-14T18:57:26.322 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90836.log 2023-10-14T18:57:26.322 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.86663.log.gz 2023-10-14T18:57:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108006.log 2023-10-14T18:57:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90836.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103702.log.gz 2023-10-14T18:57:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113274.log 2023-10-14T18:57:26.323 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90836.log.gz 2023-10-14T18:57:26.323 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88000.log 2023-10-14T18:57:26.324 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108006.log.gz 2023-10-14T18:57:26.324 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91592.log 2023-10-14T18:57:26.324 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88000.log: 89.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.113274.log.gz--verbose 2023-10-14T18:57:26.324 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.104386.log 2023-10-14T18:57:26.324 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88000.log.gz 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119329.log 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104386.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.91592.log.gz 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.100574.log 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119329.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104386.log.gzgzip 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.110894.log 2023-10-14T18:57:26.325 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119329.log.gz 2023-10-14T18:57:26.326 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109796.log 2023-10-14T18:57:26.326 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114798.log 89.6% 2023-10-14T18:57:26.326 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100574.log.gz 2023-10-14T18:57:26.326 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109796.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110894.log.gz 2023-10-14T18:57:26.327 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93464.log 2023-10-14T18:57:26.327 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114798.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109796.log.gz 2023-10-14T18:57:26.327 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119203.log 2023-10-14T18:57:26.327 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114798.log.gz 2023-10-14T18:57:26.327 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102544.log 2023-10-14T18:57:26.328 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119203.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93464.log.gz 2023-10-14T18:57:26.328 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93419.log 2023-10-14T18:57:26.328 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119203.log.gz 2023-10-14T18:57:26.328 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102838.log 2023-10-14T18:57:26.328 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102544.log.gz 2023-10-14T18:57:26.329 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.93419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116345.log 2023-10-14T18:57:26.329 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93419.log.gz 2023-10-14T18:57:26.329 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111652.log 2023-10-14T18:57:26.329 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107675.log 2023-10-14T18:57:26.329 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102838.log.gz 2023-10-14T18:57:26.330 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96490.log 2023-10-14T18:57:26.330 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116345.log.gz 2023-10-14T18:57:26.330 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107675.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111652.log.gz 2023-10-14T18:57:26.330 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89001.log 2023-10-14T18:57:26.330 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107675.log.gz 2023-10-14T18:57:26.331 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100036.log 2023-10-14T18:57:26.331 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114187.log 2023-10-14T18:57:26.331 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96490.log.gz 2023-10-14T18:57:26.331 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102063.log 2023-10-14T18:57:26.331 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89001.log.gz 2023-10-14T18:57:26.332 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100036.log.gz 2023-10-14T18:57:26.332 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109261.log 2023-10-14T18:57:26.332 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101090.log 2023-10-14T18:57:26.332 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109261.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102063.log.gz 2023-10-14T18:57:26.332 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107549.log 2023-10-14T18:57:26.333 INFO:teuthology.orchestra.run.smithi079.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.114187.log.gz 2023-10-14T18:57:26.333 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109261.log.gz 2023-10-14T18:57:26.333 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113918.log 2023-10-14T18:57:26.333 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107254.log 2023-10-14T18:57:26.333 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113918.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107549.log.gz 2023-10-14T18:57:26.334 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89421.log 2023-10-14T18:57:26.334 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101090.log.gz 2023-10-14T18:57:26.334 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113918.log.gz 2023-10-14T18:57:26.334 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106329.log 2023-10-14T18:57:26.334 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107254.log: /var/log/ceph/ceph-client.admin.89421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104169.log 2023-10-14T18:57:26.335 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107254.log.gz 2023-10-14T18:57:26.335 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107591.log 2023-10-14T18:57:26.335 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89421.log.gz 2023-10-14T18:57:26.335 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106329.log.gz 2023-10-14T18:57:26.335 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106609.log 2023-10-14T18:57:26.336 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104169.log.gz 2023-10-14T18:57:26.336 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113486.log 2023-10-14T18:57:26.336 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119515.log 2023-10-14T18:57:26.336 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107591.log.gz 2023-10-14T18:57:26.336 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106609.log.gz 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87048.log 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113486.log.gz 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103356.log 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119515.log: /var/log/ceph/ceph-client.admin.87048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107735.log 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119515.log.gz 2023-10-14T18:57:26.337 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87048.log.gz 2023-10-14T18:57:26.338 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110315.log 2023-10-14T18:57:26.338 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99102.log 2023-10-14T18:57:26.338 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110315.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107735.log.gz 2023-10-14T18:57:26.338 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88329.log 2023-10-14T18:57:26.338 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.103356.log.gz 2023-10-14T18:57:26.339 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110315.log.gz 2023-10-14T18:57:26.339 INFO:teuthology.orchestra.run.smithi079.stderr:gzip /var/log/ceph/ceph-client.admin.99102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95449.log 2023-10-14T18:57:26.339 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108313.log 2023-10-14T18:57:26.339 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99102.log.gz 2023-10-14T18:57:26.339 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95449.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88329.log.gz 2023-10-14T18:57:26.340 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97286.log 2023-10-14T18:57:26.340 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95449.log.gz/var/log/ceph/ceph-client.admin.108313.log: 2023-10-14T18:57:26.340 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108229.log 2023-10-14T18:57:26.340 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108313.log.gz 2023-10-14T18:57:26.340 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116009.log 2023-10-14T18:57:26.341 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114603.log 2023-10-14T18:57:26.341 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97286.log.gz 2023-10-14T18:57:26.341 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108229.log.gz 2023-10-14T18:57:26.341 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86879.log 2023-10-14T18:57:26.341 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116009.log.gz 2023-10-14T18:57:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94252.log 2023-10-14T18:57:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86879.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114603.log.gz 2023-10-14T18:57:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111232.log 2023-10-14T18:57:26.342 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86879.log.gz 2023-10-14T18:57:26.342 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95745.log 2023-10-14T18:57:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106876.log 2023-10-14T18:57:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111232.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94252.log.gz 2023-10-14T18:57:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102974.log 2023-10-14T18:57:26.343 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111232.log.gz 2023-10-14T18:57:26.343 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106876.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95745.log.gz 2023-10-14T18:57:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102932.log 2023-10-14T18:57:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102974.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106876.log.gz 2023-10-14T18:57:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114840.log 2023-10-14T18:57:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102932.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102974.log.gz 2023-10-14T18:57:26.344 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96390.log 2023-10-14T18:57:26.345 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102932.log.gz 2023-10-14T18:57:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87999.log 2023-10-14T18:57:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96390.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T18:57:26.345 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114840.log.gz 2023-10-14T18:57:26.345 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114966.log 2023-10-14T18:57:26.346 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96390.log.gz 2023-10-14T18:57:26.346 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87999.log.gz 2023-10-14T18:57:26.346 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87985.log 2023-10-14T18:57:26.346 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94691.log 2023-10-14T18:57:26.346 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87985.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114966.log.gz 2023-10-14T18:57:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115092.log 2023-10-14T18:57:26.347 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87985.log.gz 2023-10-14T18:57:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93226.log 2023-10-14T18:57:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2023-10-14T18:57:26.347 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115092.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94691.log.gz 2023-10-14T18:57:26.348 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111484.log 2023-10-14T18:57:26.348 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115092.log.gz 2023-10-14T18:57:26.348 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91844.log 2023-10-14T18:57:26.348 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117223.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93226.log.gz 2023-10-14T18:57:26.348 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111484.log: gzip -5 --verbose 88.8%-- /var/log/ceph/ceph-client.admin.111568.log -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107820.log 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111484.log.gz 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87996.log 2023-10-14T18:57:26.349 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91844.log.gz 2023-10-14T18:57:26.350 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111568.log.gz 2023-10-14T18:57:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87741.log 2023-10-14T18:57:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87996.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107820.log.gz 2023-10-14T18:57:26.350 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117694.log 2023-10-14T18:57:26.350 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87996.log.gz 2023-10-14T18:57:26.351 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118783.log 2023-10-14T18:57:26.351 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87741.log.gz 2023-10-14T18:57:26.351 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117139.log 2023-10-14T18:57:26.351 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117694.log.gz 2023-10-14T18:57:26.351 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103230.log 2023-10-14T18:57:26.352 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117139.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118783.log.gz 2023-10-14T18:57:26.352 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106221.log 2023-10-14T18:57:26.352 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117139.log.gz 2023-10-14T18:57:26.352 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103272.log 2023-10-14T18:57:26.352 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118825.log 2023-10-14T18:57:26.353 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103230.log.gz 2023-10-14T18:57:26.353 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103272.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106221.log.gz 2023-10-14T18:57:26.353 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87134.log 2023-10-14T18:57:26.353 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103272.log.gz 2023-10-14T18:57:26.353 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102258.log 2023-10-14T18:57:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118531.log 2023-10-14T18:57:26.354 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118825.log.gz 2023-10-14T18:57:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102258.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.87134.log.gz 2023-10-14T18:57:26.354 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91634.log 2023-10-14T18:57:26.354 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102258.log.gz 2023-10-14T18:57:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91718.log 2023-10-14T18:57:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91634.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118531.log.gz 2023-10-14T18:57:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108705.log 2023-10-14T18:57:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91634.log.gz 2023-10-14T18:57:26.355 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104910.log 2023-10-14T18:57:26.356 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91718.log.gz 2023-10-14T18:57:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112505.log 2023-10-14T18:57:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104910.log: gzip 88.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.108705.log.gz--verbose 2023-10-14T18:57:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.91550.log 2023-10-14T18:57:26.356 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112505.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104910.log.gz 2023-10-14T18:57:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113834.log 2023-10-14T18:57:26.357 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112505.log.gz 2023-10-14T18:57:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112421.log 2023-10-14T18:57:26.357 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94546.log 2023-10-14T18:57:26.357 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91550.log.gz 2023-10-14T18:57:26.358 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112421.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113834.log.gz 2023-10-14T18:57:26.358 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102166.log 2023-10-14T18:57:26.358 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112421.log.gz 2023-10-14T18:57:26.358 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103933.log 2023-10-14T18:57:26.358 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102166.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94546.log.gz 2023-10-14T18:57:26.359 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97328.log 2023-10-14T18:57:26.361 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103933.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102166.log.gz 2023-10-14T18:57:26.361 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108397.log 2023-10-14T18:57:26.361 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103933.log.gz 2023-10-14T18:57:26.362 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115795.log 2023-10-14T18:57:26.362 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88672.log 2023-10-14T18:57:26.362 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97328.log.gz 2023-10-14T18:57:26.362 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115795.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108397.log.gz 2023-10-14T18:57:26.363 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101349.log 2023-10-14T18:57:26.363 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115795.log.gz 2023-10-14T18:57:26.363 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88330.log 2023-10-14T18:57:26.363 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.101349.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88672.log.gzgzip 2023-10-14T18:57:26.363 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.93689.log 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101349.log.gz 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113622.log 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93689.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88330.log.gz 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97034.log 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93689.log.gz 2023-10-14T18:57:26.364 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103619.log 2023-10-14T18:57:26.365 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110586.log 2023-10-14T18:57:26.365 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113622.log.gz 2023-10-14T18:57:26.365 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9%/var/log/ceph/ceph-client.0.103619.log: -- replaced with /var/log/ceph/ceph-client.admin.97034.log.gz 2023-10-14T18:57:26.365 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105615.log 2023-10-14T18:57:26.366 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103619.log.gz 2023-10-14T18:57:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103188.log 2023-10-14T18:57:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101048.log 2023-10-14T18:57:26.366 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110586.log.gz 2023-10-14T18:57:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100140.log 2023-10-14T18:57:26.367 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105615.log.gz 2023-10-14T18:57:26.367 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103188.log.gz 2023-10-14T18:57:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111610.log 2023-10-14T18:57:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87615.log 2023-10-14T18:57:26.367 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101048.log.gz 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111610.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100140.log.gz 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109754.log 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111610.log.gz 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95535.log /var/log/ceph/ceph-client.admin.87615.log: 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96908.log 2023-10-14T18:57:26.368 INFO:teuthology.orchestra.run.smithi079.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.87615.log.gz 2023-10-14T18:57:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95535.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109754.log.gz 2023-10-14T18:57:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100752.log 2023-10-14T18:57:26.369 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95535.log.gz 2023-10-14T18:57:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97160.log 2023-10-14T18:57:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100752.log: gzip 87.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.96908.log.gz--verbose 2023-10-14T18:57:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.92822.log 2023-10-14T18:57:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114145.log 2023-10-14T18:57:26.370 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100752.log.gz 2023-10-14T18:57:26.370 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97160.log.gz 2023-10-14T18:57:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112057.log 2023-10-14T18:57:26.371 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114145.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92822.log.gz 2023-10-14T18:57:26.371 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104085.log 2023-10-14T18:57:26.371 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112057.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114145.log.gz 2023-10-14T18:57:26.371 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87825.log 2023-10-14T18:57:26.371 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112057.log.gz 2023-10-14T18:57:26.372 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106011.log 2023-10-14T18:57:26.372 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104085.log.gz 2023-10-14T18:57:26.372 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110021.log 2023-10-14T18:57:26.372 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106011.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87825.log.gz 2023-10-14T18:57:26.372 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90054.log 2023-10-14T18:57:26.373 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106011.log.gz 2023-10-14T18:57:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114924.log 2023-10-14T18:57:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.90054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110021.log.gz 2023-10-14T18:57:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87997.log 2023-10-14T18:57:26.373 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90054.log.gz 2023-10-14T18:57:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88666.log 2023-10-14T18:57:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87997.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114924.log.gz 2023-10-14T18:57:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100078.log 2023-10-14T18:57:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88666.log: gzip 87.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.87997.log.gz--verbose 2023-10-14T18:57:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.100838.log 2023-10-14T18:57:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100078.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.88666.log.gz--verbose 2023-10-14T18:57:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.100922.log 2023-10-14T18:57:26.375 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100078.log.gz 2023-10-14T18:57:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86756.log 2023-10-14T18:57:26.375 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100838.log.gz 2023-10-14T18:57:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103060.log 2023-10-14T18:57:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112799.log 2023-10-14T18:57:26.376 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100922.log.gz 2023-10-14T18:57:26.376 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86756.log.gz 2023-10-14T18:57:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103060.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T18:57:26.377 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.admin.112799.log: -- replaced with /var/log/ceph/ceph-client.admin.103060.log.gz 2023-10-14T18:57:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96600.log 2023-10-14T18:57:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90095.log 2023-10-14T18:57:26.377 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112799.log.gz 2023-10-14T18:57:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88334.log 2023-10-14T18:57:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90095.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96600.log.gz 2023-10-14T18:57:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102404.log 2023-10-14T18:57:26.378 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.90095.log.gz 2023-10-14T18:57:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90626.log 2023-10-14T18:57:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119433.log 2023-10-14T18:57:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102404.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88334.log.gz 2023-10-14T18:57:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110105.log 2023-10-14T18:57:26.379 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102404.log.gz 2023-10-14T18:57:26.379 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90626.log.gz 2023-10-14T18:57:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109365.log 2023-10-14T18:57:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119433.log: /var/log/ceph/ceph-client.admin.110105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100446.log 2023-10-14T18:57:26.380 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119433.log.gz 2023-10-14T18:57:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109365.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110105.log.gz 2023-10-14T18:57:26.380 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98335.log 2023-10-14T18:57:26.380 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T18:57:26.381 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109365.log.gz 2023-10-14T18:57:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109501.log 2023-10-14T18:57:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98335.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.100446.log.gz--verbose 2023-10-14T18:57:26.381 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.112015.log 2023-10-14T18:57:26.381 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6%/var/log/ceph/ceph-client.admin.109501.log: -- replaced with /var/log/ceph/ceph-client.admin.98335.log.gz 2023-10-14T18:57:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97901.log 2023-10-14T18:57:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89295.log 2023-10-14T18:57:26.382 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109501.log.gz 2023-10-14T18:57:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97901.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112015.log.gz 2023-10-14T18:57:26.382 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108619.log 2023-10-14T18:57:26.383 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97901.log.gz 2023-10-14T18:57:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112547.log 2023-10-14T18:57:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108619.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.89295.log.gz-5 2023-10-14T18:57:26.383 INFO:teuthology.orchestra.run.smithi079.stderr:--verbose -- /var/log/ceph/ceph-client.admin.98461.log 2023-10-14T18:57:26.384 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112547.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108619.log.gz 2023-10-14T18:57:26.384 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117870.log 2023-10-14T18:57:26.384 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112547.log.gz 2023-10-14T18:57:26.384 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87006.log 2023-10-14T18:57:26.384 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117870.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.98461.log.gz--verbose 2023-10-14T18:57:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:-- /var/log/ceph/ceph-client.admin.105260.log 2023-10-14T18:57:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87006.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117870.log.gz 2023-10-14T18:57:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95787.log 2023-10-14T18:57:26.385 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87006.log.gz 2023-10-14T18:57:26.385 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112883.log 2023-10-14T18:57:26.386 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103660.log 2023-10-14T18:57:26.386 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105260.log.gz 2023-10-14T18:57:26.386 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112883.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95787.log.gz 2023-10-14T18:57:26.386 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89169.log 2023-10-14T18:57:26.386 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112883.log.gz 2023-10-14T18:57:26.387 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98629.log 2023-10-14T18:57:26.387 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86837.log 2023-10-14T18:57:26.387 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103660.log.gz 2023-10-14T18:57:26.387 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98629.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89169.log.gz 2023-10-14T18:57:26.387 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92474.log 2023-10-14T18:57:26.388 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98629.log.gz 2023-10-14T18:57:26.388 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93118.log 2023-10-14T18:57:26.388 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92474.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86837.log.gz 2023-10-14T18:57:26.388 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106526.log 2023-10-14T18:57:26.388 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93118.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.92474.log.gz 2023-10-14T18:57:26.389 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.105443.log 2023-10-14T18:57:26.389 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93118.log.gz 2023-10-14T18:57:26.389 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.106526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89379.log 2023-10-14T18:57:26.389 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106526.log.gz 2023-10-14T18:57:26.389 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95269.log 2023-10-14T18:57:26.390 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0%/var/log/ceph/ceph-client.admin.89379.log: -- replaced with /var/log/ceph/ceph-client.admin.105443.log.gz 2023-10-14T18:57:26.390 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112589.log 2023-10-14T18:57:26.390 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95269.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89379.log.gzgzip 2023-10-14T18:57:26.390 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.110544.log 2023-10-14T18:57:26.390 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105527.log 2023-10-14T18:57:26.391 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95269.log.gz 2023-10-14T18:57:26.391 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110544.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112589.log.gz 2023-10-14T18:57:26.391 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108485.log 2023-10-14T18:57:26.391 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105527.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110544.log.gz 2023-10-14T18:57:26.391 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113192.log 2023-10-14T18:57:26.392 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103875.log 88.2% 2023-10-14T18:57:26.392 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105527.log.gz 2023-10-14T18:57:26.392 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113192.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108485.log.gz 2023-10-14T18:57:26.392 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115531.log 2023-10-14T18:57:26.392 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113192.log.gz 2023-10-14T18:57:26.393 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115593.log 2023-10-14T18:57:26.393 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115531.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103875.log.gz 2023-10-14T18:57:26.393 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97431.log 2023-10-14T18:57:26.393 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115593.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115531.log.gz 2023-10-14T18:57:26.393 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T18:57:26.394 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115593.log.gz 2023-10-14T18:57:26.394 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118332.log 2023-10-14T18:57:26.394 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116961.log 2023-10-14T18:57:26.394 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97431.log.gz 2023-10-14T18:57:26.394 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115921.log 2023-10-14T18:57:26.395 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118332.log.gz 2023-10-14T18:57:26.395 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108577.log 2023-10-14T18:57:26.395 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116961.log.gz 2023-10-14T18:57:26.395 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113051.log 2023-10-14T18:57:26.395 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104554.log 2023-10-14T18:57:26.396 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115921.log.gz 2023-10-14T18:57:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116657.log 2023-10-14T18:57:26.396 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108577.log.gz 2023-10-14T18:57:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104554.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113051.log.gz 2023-10-14T18:57:26.396 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93506.log 2023-10-14T18:57:26.397 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104554.log.gz 2023-10-14T18:57:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113750.log 2023-10-14T18:57:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116657.log: /var/log/ceph/ceph-client.admin.93506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112841.log 2023-10-14T18:57:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113750.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93506.log.gz 2023-10-14T18:57:26.397 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104723.log 2023-10-14T18:57:26.398 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.116657.log.gz 2023-10-14T18:57:26.398 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96650.log 2023-10-14T18:57:26.398 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113750.log.gz 2023-10-14T18:57:26.398 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109459.log 2023-10-14T18:57:26.398 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112841.log.gz 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104723.log.gz 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98291.log 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96650.log.gz 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102794.log 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109459.log: /var/log/ceph/ceph-client.admin.98291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113708.log 2023-10-14T18:57:26.399 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109459.log.gz 2023-10-14T18:57:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102794.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98291.log.gz 2023-10-14T18:57:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96217.log 2023-10-14T18:57:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119119.log 2023-10-14T18:57:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113708.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102794.log.gz 2023-10-14T18:57:26.400 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96217.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113708.log.gz 2023-10-14T18:57:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97244.log 2023-10-14T18:57:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119119.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96217.log.gz 2023-10-14T18:57:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119161.log 2023-10-14T18:57:26.401 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89043.log 2023-10-14T18:57:26.401 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119119.log.gz 2023-10-14T18:57:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108831.log 2023-10-14T18:57:26.402 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97244.log.gz 2023-10-14T18:57:26.402 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119161.log.gz 2023-10-14T18:57:26.402 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118489.log 2023-10-14T18:57:26.402 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89043.log.gz 2023-10-14T18:57:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98713.log 2023-10-14T18:57:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108831.log: /var/log/ceph/ceph-client.admin.118489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100880.log 2023-10-14T18:57:26.403 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108831.log.gz 2023-10-14T18:57:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98713.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118489.log.gz 2023-10-14T18:57:26.403 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92098.log 2023-10-14T18:57:26.404 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116177.log 2023-10-14T18:57:26.404 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98713.log.gz 2023-10-14T18:57:26.404 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100880.log: /var/log/ceph/ceph-client.admin.92098.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100880.log.gz 2023-10-14T18:57:26.404 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103615.log 2023-10-14T18:57:26.404 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92098.log.gz 2023-10-14T18:57:26.405 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111102.log 2023-10-14T18:57:26.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116177.log: /var/log/ceph/ceph-client.0.103615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110063.log 2023-10-14T18:57:26.405 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103615.log.gz 2023-10-14T18:57:26.405 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116177.log.gz 2023-10-14T18:57:26.405 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105036.log 2023-10-14T18:57:26.406 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111102.log.gz 2023-10-14T18:57:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106053.log 2023-10-14T18:57:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90046.log 2023-10-14T18:57:26.406 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3%/var/log/ceph/ceph-client.admin.105036.log: -- replaced with /var/log/ceph/ceph-client.admin.110063.log.gz 2023-10-14T18:57:26.406 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106053.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105036.log.gz 2023-10-14T18:57:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108535.log 2023-10-14T18:57:26.407 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8%/var/log/ceph/ceph-client.0.90046.log: -- replaced with /var/log/ceph/ceph-client.admin.106053.log.gz 2023-10-14T18:57:26.407 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90046.log.gz 2023-10-14T18:57:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113530.log 2023-10-14T18:57:26.407 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87321.log 2023-10-14T18:57:26.408 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1%/var/log/ceph/ceph-client.admin.113530.log: -- replaced with /var/log/ceph/ceph-client.admin.108535.log.gz 2023-10-14T18:57:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108441.log 2023-10-14T18:57:26.408 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113530.log.gz 2023-10-14T18:57:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101685.log 2023-10-14T18:57:26.408 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87321.log: /var/log/ceph/ceph-client.admin.108441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99056.log 2023-10-14T18:57:26.409 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87321.log.gz 2023-10-14T18:57:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101685.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108441.log.gz 2023-10-14T18:57:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104470.log 2023-10-14T18:57:26.409 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101685.log.gz 2023-10-14T18:57:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.99056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99056.log.gz 2023-10-14T18:57:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117439.log 2023-10-14T18:57:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97076.log 2023-10-14T18:57:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104470.log: /var/log/ceph/ceph-client.admin.117439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106179.log 2023-10-14T18:57:26.410 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104470.log.gz 2023-10-14T18:57:26.410 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97076.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.117439.log.gz-5 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:--verbose -- /var/log/ceph/ceph-client.admin.86592.log 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97076.log.gz 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88665.log 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106179.log.gz 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90584.log 2023-10-14T18:57:26.411 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86592.log: /var/log/ceph/ceph-client.admin.88665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95871.log 2023-10-14T18:57:26.412 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86592.log.gz 2023-10-14T18:57:26.412 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88665.log.gz 2023-10-14T18:57:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102668.log 2023-10-14T18:57:26.412 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104211.log 2023-10-14T18:57:26.412 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90584.log.gz 2023-10-14T18:57:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95871.log: /var/log/ceph/ceph-client.admin.102668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113358.log 2023-10-14T18:57:26.413 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102668.log.gz 2023-10-14T18:57:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88332.log 2023-10-14T18:57:26.413 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.95871.log.gz 2023-10-14T18:57:26.413 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87531.log 2023-10-14T18:57:26.414 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113358.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104211.log.gz 2023-10-14T18:57:26.414 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111188.log 2023-10-14T18:57:26.414 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113358.log.gz 2023-10-14T18:57:26.414 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88332.log.gz 2023-10-14T18:57:26.414 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104680.log 2023-10-14T18:57:26.415 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87531.log.gz 2023-10-14T18:57:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102300.log 2023-10-14T18:57:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111188.log: /var/log/ceph/ceph-client.admin.104680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106997.log 2023-10-14T18:57:26.415 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111188.log.gz 2023-10-14T18:57:26.415 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102300.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104680.log.gz 2023-10-14T18:57:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105969.log 2023-10-14T18:57:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98027.log 2023-10-14T18:57:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106997.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102300.log.gz 2023-10-14T18:57:26.416 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111760.log 2023-10-14T18:57:26.416 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106997.log.gz 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105969.log.gz 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113792.log 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87237.log 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98027.log.gz 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2%/var/log/ceph/ceph-client.admin.113792.log: -- replaced with /var/log/ceph/ceph-client.admin.111760.log.gz 2023-10-14T18:57:26.417 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92220.log 2023-10-14T18:57:26.418 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113792.log.gz 2023-10-14T18:57:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118867.log 2023-10-14T18:57:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:gzip 89.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.87237.log.gz-- 2023-10-14T18:57:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115050.log 2023-10-14T18:57:26.418 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92220.log: /var/log/ceph/ceph-client.admin.118867.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92220.log.gz 2023-10-14T18:57:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108789.log 2023-10-14T18:57:26.419 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118867.log.gz 2023-10-14T18:57:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116303.log 2023-10-14T18:57:26.419 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115050.log: /var/log/ceph/ceph-client.admin.108789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118657.log 2023-10-14T18:57:26.419 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115050.log.gz 2023-10-14T18:57:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116303.log: gzip -5 --verbose 88.8%-- /var/log/ceph/ceph-client.admin.99421.log 2023-10-14T18:57:26.420 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108789.log.gz 2023-10-14T18:57:26.420 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116303.log.gz 2023-10-14T18:57:26.420 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117828.log 2023-10-14T18:57:26.420 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118657.log.gz 2023-10-14T18:57:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96950.log 2023-10-14T18:57:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99421.log: /var/log/ceph/ceph-client.admin.117828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110501.log 2023-10-14T18:57:26.421 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99421.log.gz 2023-10-14T18:57:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117828.log.gz 2023-10-14T18:57:26.421 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100488.log 2023-10-14T18:57:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94733.log 2023-10-14T18:57:26.422 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96950.log.gz 2023-10-14T18:57:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100488.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110501.log.gz 2023-10-14T18:57:26.422 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114002.log 2023-10-14T18:57:26.423 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100488.log.gz 2023-10-14T18:57:26.423 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92688.log 2023-10-14T18:57:26.423 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94733.log: /var/log/ceph/ceph-client.admin.114002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118951.log 2023-10-14T18:57:26.423 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94733.log.gz 2023-10-14T18:57:26.423 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92688.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114002.log.gz 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110754.log 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92688.log.gz 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100668.log 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117003.log 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110754.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118951.log.gz 2023-10-14T18:57:26.424 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105120.log 2023-10-14T18:57:26.425 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110754.log.gz 2023-10-14T18:57:26.425 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100668.log.gz 2023-10-14T18:57:26.425 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91336.log 2023-10-14T18:57:26.425 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117003.log: /var/log/ceph/ceph-client.admin.105120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95829.log 2023-10-14T18:57:26.425 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117003.log.gz 2023-10-14T18:57:26.426 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91336.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105120.log.gz 2023-10-14T18:57:26.426 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99631.log 2023-10-14T18:57:26.426 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91336.log.gz 2023-10-14T18:57:26.426 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97473.log 2023-10-14T18:57:26.426 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111060.log 2023-10-14T18:57:26.427 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99631.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95829.log.gz 2023-10-14T18:57:26.427 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98377.log 2023-10-14T18:57:26.427 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99631.log.gz 2023-10-14T18:57:26.427 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97473.log.gz 2023-10-14T18:57:26.427 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111060.log: /var/log/ceph/ceph-client.admin.91676.log 2023-10-14T18:57:26.428 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90962.log 2023-10-14T18:57:26.428 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111060.log.gz 2023-10-14T18:57:26.428 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91676.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98377.log.gz 2023-10-14T18:57:26.428 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108069.log 2023-10-14T18:57:26.428 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91676.log.gz 2023-10-14T18:57:26.429 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88875.log 2023-10-14T18:57:26.429 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91274.log 2023-10-14T18:57:26.429 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108069.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90962.log.gz 2023-10-14T18:57:26.429 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107381.log 2023-10-14T18:57:26.429 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108069.log.gz 2023-10-14T18:57:26.430 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88875.log.gz 2023-10-14T18:57:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95311.log 2023-10-14T18:57:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91274.log: /var/log/ceph/ceph-client.admin.107381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111970.log 2023-10-14T18:57:26.430 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91274.log.gz 2023-10-14T18:57:26.430 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95311.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107381.log.gz 2023-10-14T18:57:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113114.log 2023-10-14T18:57:26.431 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95311.log.gz 2023-10-14T18:57:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.111970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107507.log 2023-10-14T18:57:26.431 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111970.log.gz 2023-10-14T18:57:26.431 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105885.log 2023-10-14T18:57:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113114.log: /var/log/ceph/ceph-client.admin.107507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101394.log 2023-10-14T18:57:26.432 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113114.log.gz 2023-10-14T18:57:26.432 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107507.log.gz 2023-10-14T18:57:26.432 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117736.log 2023-10-14T18:57:26.432 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105885.log.gz 2023-10-14T18:57:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102216.log 2023-10-14T18:57:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101394.log: /var/log/ceph/ceph-client.admin.117736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92992.log 2023-10-14T18:57:26.433 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101394.log.gz 2023-10-14T18:57:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102216.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117736.log.gz 2023-10-14T18:57:26.433 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99952.log 2023-10-14T18:57:26.434 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103016.log 2023-10-14T18:57:26.434 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102216.log.gz 2023-10-14T18:57:26.434 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92992.log: /var/log/ceph/ceph-client.admin.99952.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92992.log.gz 2023-10-14T18:57:26.434 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106834.log 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99952.log.gz 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116615.log 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106834.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103016.log.gz 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115008.log 2023-10-14T18:57:26.435 INFO:teuthology.orchestra.run.smithi079.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106834.log.gz 2023-10-14T18:57:26.436 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116615.log.gz 2023-10-14T18:57:26.436 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119035.log 2023-10-14T18:57:26.436 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115837.log 2023-10-14T18:57:26.436 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115008.log: /var/log/ceph/ceph-client.admin.119035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101895.log 2023-10-14T18:57:26.436 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115008.log.gz 2023-10-14T18:57:26.437 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119035.log.gz 2023-10-14T18:57:26.437 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119245.log 2023-10-14T18:57:26.437 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104428.log 2023-10-14T18:57:26.437 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101895.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115837.log.gz 2023-10-14T18:57:26.437 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104253.log 2023-10-14T18:57:26.438 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101895.log.gz 2023-10-14T18:57:26.438 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119245.log.gz 2023-10-14T18:57:26.438 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94859.log 2023-10-14T18:57:26.438 INFO:teuthology.orchestra.run.smithi079.stderr:gzip /var/log/ceph/ceph-client.admin.104253.log: -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T18:57:26.438 INFO:teuthology.orchestra.run.smithi079.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.104428.log.gz 2023-10-14T18:57:26.439 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98545.log 2023-10-14T18:57:26.439 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104253.log.gz 2023-10-14T18:57:26.439 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.1.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94859.log.gz 2023-10-14T18:57:26.439 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104867.log 2023-10-14T18:57:26.439 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112379.log 2023-10-14T18:57:26.440 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111694.log 2023-10-14T18:57:26.440 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98545.log.gz 2023-10-14T18:57:26.440 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98069.log 2023-10-14T18:57:26.440 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104867.log.gz 2023-10-14T18:57:26.440 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112379.log.gz 2023-10-14T18:57:26.441 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98069.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98069.log.gz 2023-10-14T18:57:26.441 INFO:teuthology.orchestra.run.smithi079.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.111694.log.gzgzip 2023-10-14T18:57:26.441 INFO:teuthology.orchestra.run.smithi079.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.105401.log 2023-10-14T18:57:26.441 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91802.log 2023-10-14T18:57:26.441 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93034.log 2023-10-14T18:57:26.442 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93731.log 2023-10-14T18:57:26.442 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105401.log.gz 2023-10-14T18:57:26.442 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92516.log 2023-10-14T18:57:26.442 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91802.log.gz 2023-10-14T18:57:26.442 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93034.log.gz 2023-10-14T18:57:26.443 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92516.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93731.log.gz 2023-10-14T18:57:26.443 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92516.log.gz 2023-10-14T18:57:26.443 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103422.log 2023-10-14T18:57:26.443 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92390.log 2023-10-14T18:57:26.443 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107339.log 2023-10-14T18:57:26.444 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92390.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103422.log.gz 2023-10-14T18:57:26.444 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107339.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92390.log.gz 2023-10-14T18:57:26.444 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107339.log.gz 2023-10-14T18:57:26.444 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95703.log 2023-10-14T18:57:26.444 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105927.log 2023-10-14T18:57:26.445 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95399.log 2023-10-14T18:57:26.445 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105927.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95703.log.gz 2023-10-14T18:57:26.445 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91021.log 2023-10-14T18:57:26.445 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95399.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105927.log.gz 2023-10-14T18:57:26.445 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95577.log 2023-10-14T18:57:26.446 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95399.log.gz 2023-10-14T18:57:26.446 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91021.log: /var/log/ceph/ceph-client.admin.95577.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91021.log.gz 2023-10-14T18:57:26.446 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95577.log.gz 2023-10-14T18:57:26.446 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96734.log 2023-10-14T18:57:26.446 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109601.log 2023-10-14T18:57:26.447 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96331.log 2023-10-14T18:57:26.447 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109601.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96734.log.gz 2023-10-14T18:57:26.447 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109601.log.gz 2023-10-14T18:57:26.447 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96331.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96331.log.gz 2023-10-14T18:57:26.447 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92306.log 2023-10-14T18:57:26.448 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95143.log 2023-10-14T18:57:26.448 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108271.log 2023-10-14T18:57:26.448 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118248.log 2023-10-14T18:57:26.448 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92306.log.gz 2023-10-14T18:57:26.448 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98207.log 2023-10-14T18:57:26.449 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95143.log.gz 2023-10-14T18:57:26.449 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118248.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.108271.log.gz 2023-10-14T18:57:26.449 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118248.log.gz 2023-10-14T18:57:26.449 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98207.log.gz 2023-10-14T18:57:26.449 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100530.log 2023-10-14T18:57:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113580.log 2023-10-14T18:57:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96448.log 2023-10-14T18:57:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100530.log.gz 2023-10-14T18:57:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113580.log.gz 2023-10-14T18:57:26.450 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96448.log.gz 2023-10-14T18:57:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100362.log 2023-10-14T18:57:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T18:57:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119077.log 2023-10-14T18:57:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mon.a.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100362.log.gz 2023-10-14T18:57:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112099.log 2023-10-14T18:57:26.452 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119077.log.gz 2023-10-14T18:57:26.452 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94921.log 2023-10-14T18:57:26.452 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112099.log: /var/log/ceph/ceph-client.admin.94921.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112099.log.gz 2023-10-14T18:57:26.452 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94921.log.gz 2023-10-14T18:57:26.452 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101937.log 2023-10-14T18:57:26.453 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87090.log 2023-10-14T18:57:26.453 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106567.log 2023-10-14T18:57:26.453 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87090.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101937.log.gz 2023-10-14T18:57:26.453 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106567.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87090.log.gz 2023-10-14T18:57:26.453 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106567.log.gz 2023-10-14T18:57:26.454 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112757.log 2023-10-14T18:57:26.454 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94588.log 2023-10-14T18:57:26.454 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119287.log 2023-10-14T18:57:26.454 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112757.log.gz 2023-10-14T18:57:26.454 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94588.log.gz 2023-10-14T18:57:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119287.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119287.log.gz 2023-10-14T18:57:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110628.log 2023-10-14T18:57:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110976.log 2023-10-14T18:57:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110357.log 2023-10-14T18:57:26.455 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110976.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110628.log.gz 2023-10-14T18:57:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110357.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110976.log.gz 2023-10-14T18:57:26.456 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110357.log.gz 2023-10-14T18:57:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111526.log 2023-10-14T18:57:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91105.log 2023-10-14T18:57:26.456 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87489.log 2023-10-14T18:57:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91105.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111526.log.gz 2023-10-14T18:57:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87489.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91105.log.gz 2023-10-14T18:57:26.457 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87489.log.gz 2023-10-14T18:57:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101156.log 2023-10-14T18:57:26.457 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115278.log 2023-10-14T18:57:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101156.log: /var/log/ceph/ceph-client.admin.115278.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101156.log.gz 2023-10-14T18:57:26.458 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115278.log.gz 2023-10-14T18:57:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105665.log 2023-10-14T18:57:26.458 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90920.log 2023-10-14T18:57:26.459 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100618.log 2023-10-14T18:57:26.459 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90920.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.105665.log.gz 2023-10-14T18:57:26.459 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100618.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90920.log.gz 2023-10-14T18:57:26.459 INFO:teuthology.orchestra.run.smithi079.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100618.log.gz 2023-10-14T18:57:26.459 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99723.log 2023-10-14T18:57:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90752.log 2023-10-14T18:57:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118038.log 2023-10-14T18:57:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90752.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99723.log.gz 2023-10-14T18:57:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118038.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90752.log.gz 2023-10-14T18:57:26.460 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118038.log.gz 2023-10-14T18:57:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98157.log 2023-10-14T18:57:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101353.log 2023-10-14T18:57:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98157.log: /var/log/ceph/ceph-client.0.101353.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98157.log.gz 2023-10-14T18:57:26.461 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101353.log.gz 2023-10-14T18:57:26.461 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89337.log 2023-10-14T18:57:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116723.log 2023-10-14T18:57:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91147.log 2023-10-14T18:57:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116723.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89337.log.gz 2023-10-14T18:57:26.462 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91147.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116723.log.gz 2023-10-14T18:57:26.462 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91147.log.gz 2023-10-14T18:57:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94983.log 2023-10-14T18:57:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97661.log 2023-10-14T18:57:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94983.log: /var/log/ceph/ceph-client.admin.97661.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94983.log.gz 2023-10-14T18:57:26.463 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97661.log.gz 2023-10-14T18:57:26.463 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111018.log 2023-10-14T18:57:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110399.log 2023-10-14T18:57:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.111018.log: /var/log/ceph/ceph-client.admin.110399.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111018.log.gz 2023-10-14T18:57:26.464 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110399.log.gz 2023-10-14T18:57:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94420.log 2023-10-14T18:57:26.464 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110189.log 2023-10-14T18:57:26.465 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115176.log 2023-10-14T18:57:26.465 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110189.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94420.log.gz 2023-10-14T18:57:26.465 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115176.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110189.log.gz 2023-10-14T18:57:26.465 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115176.log.gz 2023-10-14T18:57:26.465 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93160.log 2023-10-14T18:57:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98419.log 2023-10-14T18:57:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93160.log: /var/log/ceph/ceph-client.admin.98419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98419.log.gz 2023-10-14T18:57:26.466 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93160.log.gz 2023-10-14T18:57:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95061.log 2023-10-14T18:57:26.466 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105182.log 2023-10-14T18:57:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107922.log 2023-10-14T18:57:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105182.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95061.log.gz 2023-10-14T18:57:26.467 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105182.log.gz 2023-10-14T18:57:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107922.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107922.log.gz 2023-10-14T18:57:26.467 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99673.log 2023-10-14T18:57:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113009.log 2023-10-14T18:57:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94168.log 2023-10-14T18:57:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113009.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99673.log.gz 2023-10-14T18:57:26.468 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94168.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113009.log.gz 2023-10-14T18:57:26.468 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94168.log.gz 2023-10-14T18:57:26.469 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93076.log 2023-10-14T18:57:26.469 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99505.log 2023-10-14T18:57:26.469 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93076.log: /var/log/ceph/ceph-client.admin.99505.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93076.log.gz 2023-10-14T18:57:26.469 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99505.log.gz 2023-10-14T18:57:26.469 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87995.log 2023-10-14T18:57:26.470 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114446.log 2023-10-14T18:57:26.470 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87995.log: /var/log/ceph/ceph-client.0.114446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87995.log.gz 2023-10-14T18:57:26.470 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114446.log.gz 2023-10-14T18:57:26.470 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117281.log 2023-10-14T18:57:26.470 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100280.log 2023-10-14T18:57:26.471 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117281.log: /var/log/ceph/ceph-client.admin.100280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117281.log.gz 2023-10-14T18:57:26.471 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100280.log.gz 2023-10-14T18:57:26.471 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90542.log 2023-10-14T18:57:26.471 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117397.log 2023-10-14T18:57:26.471 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90542.log: /var/log/ceph/ceph-client.admin.117397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90542.log.gz 2023-10-14T18:57:26.472 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117397.log.gz 2023-10-14T18:57:26.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95619.log 2023-10-14T18:57:26.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91886.log 2023-10-14T18:57:26.472 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97802.log 2023-10-14T18:57:26.472 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91886.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95619.log.gz 2023-10-14T18:57:26.473 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97802.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91886.log.gz 2023-10-14T18:57:26.473 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97802.log.gz 2023-10-14T18:57:26.473 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95185.log 2023-10-14T18:57:26.473 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102752.log 2023-10-14T18:57:26.473 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95185.log: /var/log/ceph/ceph-client.admin.102752.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95185.log.gz 2023-10-14T18:57:26.474 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91978.log 2023-10-14T18:57:26.474 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102752.log.gz 2023-10-14T18:57:26.474 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101853.log 2023-10-14T18:57:26.474 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91978.log: /var/log/ceph/ceph-client.admin.101853.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91978.log.gz 2023-10-14T18:57:26.474 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101853.log.gz 2023-10-14T18:57:26.475 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115753.log 2023-10-14T18:57:26.475 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97388.log 2023-10-14T18:57:26.475 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96692.log 2023-10-14T18:57:26.475 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97388.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115753.log.gz 2023-10-14T18:57:26.475 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97388.log.gz 2023-10-14T18:57:26.476 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96692.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96692.log.gz 2023-10-14T18:57:26.476 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88669.log 2023-10-14T18:57:26.476 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88664.log 2023-10-14T18:57:26.476 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88669.log: /var/log/ceph/ceph-client.admin.88664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88669.log.gz 2023-10-14T18:57:26.476 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95227.log 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88664.log.gz 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117778.log 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.95227.log: /var/log/ceph/ceph-client.admin.117778.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.95227.log.gz 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117778.log.gz 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100202.log 2023-10-14T18:57:26.477 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101811.log 2023-10-14T18:57:26.478 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100202.log: /var/log/ceph/ceph-client.admin.101811.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100202.log.gz 2023-10-14T18:57:26.478 INFO:teuthology.orchestra.run.smithi079.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101811.log.gz 2023-10-14T18:57:26.478 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88670.log 2023-10-14T18:57:26.478 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107778.log 2023-10-14T18:57:26.478 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88670.log: /var/log/ceph/ceph-client.admin.107778.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88670.log.gz 2023-10-14T18:57:26.479 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107778.log.gz 2023-10-14T18:57:26.479 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102882.log 2023-10-14T18:57:26.479 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98863.log 2023-10-14T18:57:26.479 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102882.log: /var/log/ceph/ceph-client.admin.98863.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102882.log.gz 2023-10-14T18:57:26.479 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98863.log.gz 2023-10-14T18:57:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119473.log 2023-10-14T18:57:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87363.log 2023-10-14T18:57:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119473.log: /var/log/ceph/ceph-client.admin.87363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119473.log.gz 2023-10-14T18:57:26.480 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87363.log.gz 2023-10-14T18:57:26.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98797.log 2023-10-14T18:57:26.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86964.log 2023-10-14T18:57:26.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98797.log: /var/log/ceph/ceph-client.admin.86964.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86964.log.gz 2023-10-14T18:57:26.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109023.log 2023-10-14T18:57:26.481 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.98797.log.gz 2023-10-14T18:57:26.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86066.log 2023-10-14T18:57:26.482 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109023.log: /var/log/ceph/ceph-client.admin.86066.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109023.log.gz 2023-10-14T18:57:26.482 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86066.log.gz 2023-10-14T18:57:26.482 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.114450.log 2023-10-14T18:57:26.482 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99994.log 2023-10-14T18:57:26.482 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.114450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115489.log 2023-10-14T18:57:26.483 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.114450.log.gz 2023-10-14T18:57:26.483 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91063.log 2023-10-14T18:57:26.483 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115489.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99994.log.gz 2023-10-14T18:57:26.483 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91063.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115489.log.gz 2023-10-14T18:57:26.483 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91063.log.gz 2023-10-14T18:57:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98503.log 2023-10-14T18:57:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92950.log 2023-10-14T18:57:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98503.log: /var/log/ceph/ceph-client.admin.92950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98503.log.gz 2023-10-14T18:57:26.484 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92950.log.gz 2023-10-14T18:57:26.484 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115405.log 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102021.log 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118741.log 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102021.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.115405.log.gz 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118741.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102021.log.gz 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118741.log.gz 2023-10-14T18:57:26.485 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89505.log 2023-10-14T18:57:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117582.log 2023-10-14T18:57:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89505.log: /var/log/ceph/ceph-client.admin.117582.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117582.log.gz 2023-10-14T18:57:26.486 INFO:teuthology.orchestra.run.smithi079.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.89505.log.gz 2023-10-14T18:57:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88333.log 2023-10-14T18:57:26.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102123.log 2023-10-14T18:57:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88333.log: /var/log/ceph/ceph-client.admin.102123.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88333.log.gz 2023-10-14T18:57:26.487 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102123.log.gz 2023-10-14T18:57:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99060.log 2023-10-14T18:57:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112967.log 2023-10-14T18:57:26.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.99060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100710.log 2023-10-14T18:57:26.488 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99060.log.gz 2023-10-14T18:57:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97599.log 2023-10-14T18:57:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.100710.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112967.log.gz 2023-10-14T18:57:26.488 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97599.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100710.log.gz 2023-10-14T18:57:26.488 INFO:teuthology.orchestra.run.smithi079.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97599.log.gz 2023-10-14T18:57:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110147.log 2023-10-14T18:57:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T18:57:26.489 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110147.log: /var/log/ceph/ceph-osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110147.log.gz 2023-10-14T18:57:26.490 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T18:57:26.509 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T18:57:26.516 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92432.log 2023-10-14T18:57:26.516 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86332.log 2023-10-14T18:57:26.516 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92432.log.gz 2023-10-14T18:57:26.517 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86332.log.gz 2023-10-14T18:57:26.517 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88336.log 2023-10-14T18:57:26.517 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101979.log 2023-10-14T18:57:26.517 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88336.log: 88.4%/var/log/ceph/ceph-client.admin.101979.log: -- replaced with /var/log/ceph/ceph-client.admin.88336.log.gz 2023-10-14T18:57:26.517 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101979.log.gz 2023-10-14T18:57:26.518 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99910.log 2023-10-14T18:57:26.518 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109216.log 2023-10-14T18:57:26.518 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99910.log: /var/log/ceph/ceph-client.0.109216.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99910.log.gz 2023-10-14T18:57:26.518 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109216.log.gz 2023-10-14T18:57:26.519 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108147.log 2023-10-14T18:57:26.519 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114253.log 2023-10-14T18:57:26.519 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108147.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108147.log.gz 2023-10-14T18:57:26.519 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97202.log 2023-10-14T18:57:26.519 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114253.log: /var/log/ceph/ceph-client.admin.97202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114253.log.gz 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97202.log.gz 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94378.log 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111442.log 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94378.log: /var/log/ceph/ceph-client.admin.111442.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94378.log.gz 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111442.log.gz 2023-10-14T18:57:26.520 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108957.log 2023-10-14T18:57:26.521 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108915.log 2023-10-14T18:57:26.521 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108957.log: /var/log/ceph/ceph-client.admin.108915.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108915.log.gz 2023-10-14T18:57:26.521 INFO:teuthology.orchestra.run.smithi079.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.108957.log.gz 2023-10-14T18:57:26.521 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103314.log 2023-10-14T18:57:26.521 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112463.log 2023-10-14T18:57:26.522 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.103314.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103314.log.gz 2023-10-14T18:57:26.522 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.90459.log 2023-10-14T18:57:26.522 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112463.log: /var/log/ceph/ceph-client.2.90459.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112463.log.gz 2023-10-14T18:57:26.522 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.90459.log.gz 2023-10-14T18:57:26.522 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101643.log 2023-10-14T18:57:26.523 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94817.log 2023-10-14T18:57:26.523 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101643.log: /var/log/ceph/ceph-client.admin.94817.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101643.log.gz 2023-10-14T18:57:26.523 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94817.log.gz 2023-10-14T18:57:26.523 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87447.log 2023-10-14T18:57:26.523 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87573.log 2023-10-14T18:57:26.524 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87447.log: /var/log/ceph/ceph-client.admin.87573.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.87447.log.gz 2023-10-14T18:57:26.524 INFO:teuthology.orchestra.run.smithi079.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87573.log.gz 2023-10-14T18:57:26.524 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94462.log 2023-10-14T18:57:26.524 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95491.log 2023-10-14T18:57:26.524 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94462.log: /var/log/ceph/ceph-client.admin.95491.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94462.log.gz 2023-10-14T18:57:26.525 INFO:teuthology.orchestra.run.smithi079.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95491.log.gz 2023-10-14T18:57:26.525 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115671.log 2023-10-14T18:57:26.525 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112715.log 2023-10-14T18:57:26.525 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115671.log: /var/log/ceph/ceph-client.admin.112715.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115671.log.gz 2023-10-14T18:57:26.525 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112715.log.gz 2023-10-14T18:57:26.526 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117181.log 2023-10-14T18:57:26.526 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98671.log 2023-10-14T18:57:26.526 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117181.log: /var/log/ceph/ceph-client.admin.98671.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117181.log.gz 2023-10-14T18:57:26.526 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98671.log.gz 2023-10-14T18:57:26.526 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91508.log 2023-10-14T18:57:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112337.log 2023-10-14T18:57:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91508.log: /var/log/ceph/ceph-client.admin.112337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91508.log.gz 2023-10-14T18:57:26.527 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112337.log.gz 2023-10-14T18:57:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114541.log 2023-10-14T18:57:26.527 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105571.log 2023-10-14T18:57:26.528 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114541.log: /var/log/ceph/ceph-client.admin.105571.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114541.log.gz 2023-10-14T18:57:26.528 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105571.log.gz 2023-10-14T18:57:26.528 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88539.log 2023-10-14T18:57:26.528 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101769.log 2023-10-14T18:57:26.528 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.88539.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88539.log.gz 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.101769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101769.log.gz 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109695.log 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104994.log 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109695.log: /var/log/ceph/ceph-client.admin.104994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109695.log.gz 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104994.log.gz 2023-10-14T18:57:26.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115218.log 2023-10-14T18:57:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88328.log 2023-10-14T18:57:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115218.log: /var/log/ceph/ceph-client.admin.88328.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115218.log.gz 2023-10-14T18:57:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116093.log 2023-10-14T18:57:26.530 INFO:teuthology.orchestra.run.smithi079.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88328.log.gz 2023-10-14T18:57:26.530 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115321.log 2023-10-14T18:57:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116093.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116093.log.gz 2023-10-14T18:57:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115321.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115321.log.gz 2023-10-14T18:57:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112631.log 2023-10-14T18:57:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99807.log 2023-10-14T18:57:26.531 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.112631.log: /var/log/ceph/ceph-client.admin.99807.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112631.log.gz 2023-10-14T18:57:26.532 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99807.log.gz 2023-10-14T18:57:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90500.log 2023-10-14T18:57:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95661.log 2023-10-14T18:57:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90500.log: /var/log/ceph/ceph-client.admin.95661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90500.log.gz 2023-10-14T18:57:26.532 INFO:teuthology.orchestra.run.smithi079.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95661.log.gz 2023-10-14T18:57:26.533 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116916.log 2023-10-14T18:57:26.533 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87279.log 2023-10-14T18:57:26.533 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.116916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116916.log.gz 2023-10-14T18:57:26.533 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87279.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87279.log.gz 2023-10-14T18:57:26.533 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106522.log 2023-10-14T18:57:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116219.log 2023-10-14T18:57:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.106522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106522.log.gz 2023-10-14T18:57:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116219.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116219.log.gz 2023-10-14T18:57:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115965.log 2023-10-14T18:57:26.534 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108663.log 2023-10-14T18:57:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115965.log: /var/log/ceph/ceph-client.admin.108663.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115965.log.gz 2023-10-14T18:57:26.535 INFO:teuthology.orchestra.run.smithi079.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108663.log.gz 2023-10-14T18:57:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90710.log 2023-10-14T18:57:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97943.log 2023-10-14T18:57:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90710.log: /var/log/ceph/ceph-client.admin.97943.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90710.log.gz 2023-10-14T18:57:26.536 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97943.log.gz 2023-10-14T18:57:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94210.log 2023-10-14T18:57:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92600.log 2023-10-14T18:57:26.536 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94210.log: /var/log/ceph/ceph-client.admin.92600.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94210.log.gz 2023-10-14T18:57:26.536 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92600.log.gz 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88917.log 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118164.log: /var/log/ceph/ceph-client.admin.88917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118164.log.gz 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88917.log.gz 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109303.log 2023-10-14T18:57:26.537 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100404.log 2023-10-14T18:57:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.109303.log: /var/log/ceph/ceph-client.admin.100404.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109303.log.gz 2023-10-14T18:57:26.538 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100404.log.gz 2023-10-14T18:57:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87405.log 2023-10-14T18:57:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99463.log 2023-10-14T18:57:26.538 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87405.log: /var/log/ceph/ceph-client.admin.99463.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87405.log.gz 2023-10-14T18:57:26.539 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99463.log.gz 2023-10-14T18:57:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T18:57:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93568.log 2023-10-14T18:57:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.93568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93568.log.gz 2023-10-14T18:57:26.539 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115447.log 2023-10-14T18:57:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115447.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115447.log.gz 2023-10-14T18:57:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116429.log 2023-10-14T18:57:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116429.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.116429.log.gz 2023-10-14T18:57:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91466.log 2023-10-14T18:57:26.540 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91466.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91466.log.gz 2023-10-14T18:57:26.541 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98587.log 2023-10-14T18:57:26.541 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98587.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98587.log.gz 2023-10-14T18:57:26.541 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84605.log 2023-10-14T18:57:26.541 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.tmp-client.admin.84605.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84605.log.gz 2023-10-14T18:57:26.541 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110231.log 2023-10-14T18:57:26.542 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110231.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110231.log.gz 2023-10-14T18:57:26.542 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90668.log 2023-10-14T18:57:26.542 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.90668.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90668.log.gz 2023-10-14T18:57:26.542 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117540.log 2023-10-14T18:57:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117540.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117540.log.gz 2023-10-14T18:57:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102466.log 2023-10-14T18:57:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.102466.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102466.log.gz 2023-10-14T18:57:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107465.log 2023-10-14T18:57:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107465.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107465.log.gz 2023-10-14T18:57:26.544 INFO:teuthology.orchestra.run.smithi079.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T18:57:26.544 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99379.log 2023-10-14T18:57:26.544 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99379.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99379.log.gz 2023-10-14T18:57:26.544 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113876.log 2023-10-14T18:57:26.544 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110273.log 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113876.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113876.log.gz 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86922.log 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.110273.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110273.log.gz 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98755.log 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.86922.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86922.log.gz 2023-10-14T18:57:26.545 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115134.log 2023-10-14T18:57:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98755.log.gz 2023-10-14T18:57:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87984.log 2023-10-14T18:57:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.115134.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115134.log.gz 2023-10-14T18:57:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87984.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87984.log.gz 2023-10-14T18:57:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89639.log 2023-10-14T18:57:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117323.log 2023-10-14T18:57:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89639.log: /var/log/ceph/ceph-client.admin.117323.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89639.log.gz 2023-10-14T18:57:26.547 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117323.log.gz 2023-10-14T18:57:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89463.log 2023-10-14T18:57:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94648.log 2023-10-14T18:57:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89463.log: /var/log/ceph/ceph-client.admin.94648.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89463.log.gz 2023-10-14T18:57:26.548 INFO:teuthology.orchestra.run.smithi079.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94648.log.gz 2023-10-14T18:57:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118993.log 2023-10-14T18:57:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110441.log 2023-10-14T18:57:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118993.log: /var/log/ceph/ceph-client.admin.110441.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118993.log.gz 2023-10-14T18:57:26.549 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110441.log.gz 2023-10-14T18:57:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89085.log 2023-10-14T18:57:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113442.log 2023-10-14T18:57:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89085.log: /var/log/ceph/ceph-client.admin.113442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89085.log.gz 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113442.log.gz 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92908.log 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117498.log 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92908.log: /var/log/ceph/ceph-client.admin.117498.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.92908.log.gz 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117498.log.gz 2023-10-14T18:57:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105801.log 2023-10-14T18:57:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92178.log 2023-10-14T18:57:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105801.log: /var/log/ceph/ceph-client.admin.92178.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105801.log.gz 2023-10-14T18:57:26.551 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92178.log.gz 2023-10-14T18:57:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91189.log 2023-10-14T18:57:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116135.log 2023-10-14T18:57:26.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91189.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91189.log.gz 2023-10-14T18:57:26.552 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116573.log 2023-10-14T18:57:26.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116135.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116135.log.gz 2023-10-14T18:57:26.552 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107633.log 2023-10-14T18:57:26.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116573.log: /var/log/ceph/ceph-client.admin.107633.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116573.log.gz 2023-10-14T18:57:26.553 INFO:teuthology.orchestra.run.smithi079.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.107633.log.gz 2023-10-14T18:57:26.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96130.log 2023-10-14T18:57:26.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94504.log 2023-10-14T18:57:26.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.96130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.96130.log.gz 2023-10-14T18:57:26.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94504.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94504.log.gz 2023-10-14T18:57:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114882.log 2023-10-14T18:57:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99867.log 2023-10-14T18:57:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114882.log: /var/log/ceph/ceph-client.admin.99867.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114882.log.gz 2023-10-14T18:57:26.554 INFO:teuthology.orchestra.run.smithi079.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99867.log.gz 2023-10-14T18:57:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114061.log 2023-10-14T18:57:26.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93423.log 2023-10-14T18:57:26.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114061.log: /var/log/ceph/ceph-client.0.93423.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114061.log.gz 2023-10-14T18:57:26.555 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93423.log.gz 2023-10-14T18:57:26.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87699.log 2023-10-14T18:57:26.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97724.log 2023-10-14T18:57:26.556 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87699.log: /var/log/ceph/ceph-client.admin.97724.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87699.log.gz 2023-10-14T18:57:26.556 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97724.log.gz 2023-10-14T18:57:26.556 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87989.log 2023-10-14T18:57:26.556 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109220.log 2023-10-14T18:57:26.556 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.87989.log: /var/log/ceph/ceph-client.0.109220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87989.log.gz 2023-10-14T18:57:26.557 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109220.log.gz 2023-10-14T18:57:26.557 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92558.log 2023-10-14T18:57:26.557 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92262.log 2023-10-14T18:57:26.557 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92558.log: /var/log/ceph/ceph-client.admin.92262.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.92558.log.gz 2023-10-14T18:57:26.557 INFO:teuthology.orchestra.run.smithi079.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92262.log.gz 2023-10-14T18:57:26.558 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97985.log 2023-10-14T18:57:26.558 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101727.log 2023-10-14T18:57:26.558 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.97985.log: /var/log/ceph/ceph-client.admin.101727.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97985.log.gz 2023-10-14T18:57:26.558 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101727.log.gz 2023-10-14T18:57:26.558 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108355.log 2023-10-14T18:57:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104952.log 2023-10-14T18:57:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.108355.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108355.log.gz 2023-10-14T18:57:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.104952.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104952.log.gz 2023-10-14T18:57:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93773.log 2023-10-14T18:57:26.559 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87783.log 2023-10-14T18:57:26.560 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.93773.log: /var/log/ceph/ceph-client.admin.87783.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93773.log.gz 2023-10-14T18:57:26.560 INFO:teuthology.orchestra.run.smithi079.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87783.log.gz 2023-10-14T18:57:26.560 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118290.log 2023-10-14T18:57:26.560 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92738.log 2023-10-14T18:57:26.560 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.118290.log: /var/log/ceph/ceph-client.admin.92738.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118290.log.gz 2023-10-14T18:57:26.561 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92738.log.gz 2023-10-14T18:57:26.561 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.116920.log 2023-10-14T18:57:26.561 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106792.log 2023-10-14T18:57:26.561 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.116920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.116920.log.gz 2023-10-14T18:57:26.561 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117045.log 2023-10-14T18:57:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106792.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106792.log.gz 2023-10-14T18:57:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99589.log 2023-10-14T18:57:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.117045.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117045.log.gz 2023-10-14T18:57:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116051.log 2023-10-14T18:57:26.562 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99589.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99589.log.gz 2023-10-14T18:57:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94336.log 2023-10-14T18:57:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116051.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116051.log.gz 2023-10-14T18:57:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.94336.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94336.log.gz 2023-10-14T18:57:26.563 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113960.log 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105078.log 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.113960.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113960.log.gz 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92348.log 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.105078.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105078.log.gz 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119371.log 2023-10-14T18:57:26.564 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92348.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92348.log.gz 2023-10-14T18:57:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111974.log 2023-10-14T18:57:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.119371.log: /var/log/ceph/ceph-client.0.111974.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119371.log.gz 2023-10-14T18:57:26.565 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111974.log.gz 2023-10-14T18:57:26.565 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114491.log 2023-10-14T18:57:26.566 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107423.log 2023-10-14T18:57:26.566 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.114491.log: /var/log/ceph/ceph-client.admin.107423.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114491.log.gz 2023-10-14T18:57:26.566 INFO:teuthology.orchestra.run.smithi079.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107423.log.gz 2023-10-14T18:57:26.566 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96776.log 2023-10-14T18:57:26.566 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112925.log 2023-10-14T18:57:26.567 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96776.log: /var/log/ceph/ceph-client.admin.112925.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96776.log.gz 2023-10-14T18:57:26.567 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112925.log.gz 2023-10-14T18:57:26.567 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96992.log 2023-10-14T18:57:26.567 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102710.log 2023-10-14T18:57:26.567 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.96992.log: /var/log/ceph/ceph-client.admin.102710.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96992.log.gz 2023-10-14T18:57:26.568 INFO:teuthology.orchestra.run.smithi079.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102710.log.gz 2023-10-14T18:57:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116387.log 2023-10-14T18:57:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89211.log 2023-10-14T18:57:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.116387.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116387.log.gz 2023-10-14T18:57:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117954.log 2023-10-14T18:57:26.569 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.89211.log: /var/log/ceph/ceph-client.admin.117954.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89211.log.gz 2023-10-14T18:57:26.569 INFO:teuthology.orchestra.run.smithi079.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.117954.log.gz 2023-10-14T18:57:26.569 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92020.log 2023-10-14T18:57:26.569 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103146.log 2023-10-14T18:57:26.569 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.92020.log: /var/log/ceph/ceph-client.admin.103146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92020.log.gz 2023-10-14T18:57:26.570 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103146.log.gz 2023-10-14T18:57:26.570 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98113.log 2023-10-14T18:57:26.570 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118573.log 2023-10-14T18:57:26.570 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.98113.log: /var/log/ceph/ceph-client.admin.118573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98113.log.gz 2023-10-14T18:57:26.570 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118573.log.gz 2023-10-14T18:57:26.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91231.log 2023-10-14T18:57:26.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110816.log 2023-10-14T18:57:26.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.91231.log: /var/log/ceph/ceph-client.admin.110816.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91231.log.gz 2023-10-14T18:57:26.571 INFO:teuthology.orchestra.run.smithi079.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110816.log.gz 2023-10-14T18:57:26.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107964.log 2023-10-14T18:57:26.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117912.log 2023-10-14T18:57:26.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.107964.log: /var/log/ceph/ceph-client.admin.117912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107964.log.gz 2023-10-14T18:57:26.572 INFO:teuthology.orchestra.run.smithi079.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117912.log.gz 2023-10-14T18:57:26.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T18:57:26.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118122.log 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.118122.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118122.log.gz 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106095.log 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.106095.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106095.log.gz 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99547.log 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.99547.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99547.log.gz 2023-10-14T18:57:26.573 INFO:teuthology.orchestra.run.smithi079.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T18:57:26.574 INFO:teuthology.orchestra.run.smithi079.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T18:57:26.575 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T18:57:26.879 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T18:57:26.950 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T18:57:26.999 INFO:teuthology.orchestra.run.smithi144.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T18:57:27.007 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T18:57:27.009 INFO:teuthology.orchestra.run.smithi079.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T18:57:27.010 INFO:teuthology.orchestra.run.smithi144.stderr: 2023-10-14T18:57:27.010 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m0.872s 2023-10-14T18:57:27.010 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m4.028s 2023-10-14T18:57:27.010 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.178s 2023-10-14T18:57:27.049 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T18:57:27.088 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T18:57:27.159 INFO:teuthology.orchestra.run.smithi079.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T18:57:27.206 INFO:teuthology.orchestra.run.smithi079.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T18:57:27.207 INFO:teuthology.orchestra.run.smithi079.stderr: 2023-10-14T18:57:27.208 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m1.098s 2023-10-14T18:57:27.208 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m4.826s 2023-10-14T18:57:27.208 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.471s 2023-10-14T18:57:27.208 INFO:tasks.ceph:Archiving logs... 2023-10-14T18:57:27.209 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi079/log 2023-10-14T18:57:27.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T18:57:28.383 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi144/log 2023-10-14T18:57:28.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T18:57:28.939 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T18:57:28.950 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T18:57:28.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T18:57:28.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T18:57:29.043 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T18:57:29.053 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T18:57:29.053 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:57:29.056 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T18:57:29.070 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-10-14T18:57:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-14T18:57:29.075 INFO:teuthology.orchestra.run.smithi144.stdout:210 Number of sources = 4 2023-10-14T18:57:29.075 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:57:29.076 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-14T18:57:29.076 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 +984us[ +984us] +/- 74ms 2023-10-14T18:57:29.076 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -237us[ -298us] +/- 54ms 2023-10-14T18:57:29.076 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -572us[ -572us] +/- 62ms 2023-10-14T18:57:29.076 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:57:29.077 INFO:teuthology.orchestra.run.smithi079.stdout:210 Number of sources = 4 2023-10-14T18:57:29.077 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T18:57:29.077 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-14T18:57:29.077 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +972us[ +972us] +/- 74ms 2023-10-14T18:57:29.077 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -246us[ -241us] +/- 54ms 2023-10-14T18:57:29.078 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -570us[ -565us] +/- 62ms 2023-10-14T18:57:29.078 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T18:57:29.078 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T18:57:29.088 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T18:57:29.088 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T18:57:29.099 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T18:57:29.228 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T18:57:29.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:57:29.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:57:29.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T18:57:29.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:57:29.389 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T18:57:29.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T18:57:29.483 INFO:teuthology.task.internal:Duration was 1385.168711 seconds 2023-10-14T18:57:29.484 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T18:57:29.493 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T18:57:29.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T18:57:29.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T18:57:29.539 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:57:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T18:57:29.873 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T18:57:29.874 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2023-10-14T18:57:29.874 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T18:57:29.893 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-10-14T18:57:29.893 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T18:57:29.932 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T18:57:29.932 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T18:57:29.936 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T18:57:30.012 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T18:57:30.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T18:57:30.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T18:57:30.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T18:57:30.141 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T18:57:30.141 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T18:57:30.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T18:57:30.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T18:57:30.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T18:57:30.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T18:57:30.231 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2023-10-14T18:57:30.255 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-10-14T18:57:30.269 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T18:57:30.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:57:30.300 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T18:57:30.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T18:57:30.323 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T18:57:30.334 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T18:57:30.335 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi079 2023-10-14T18:57:30.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T18:57:30.380 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783/remote/smithi144 2023-10-14T18:57:30.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T18:57:30.418 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T18:57:30.418 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T18:57:30.421 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T18:57:30.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T18:57:30.479 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T18:57:30.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T18:57:30.538 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T18:57:30.538 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T18:57:30.541 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T18:57:30.553 INFO:teuthology.orchestra.run.smithi079.stdout: 262149 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 18:57 /home/ubuntu/cephtest 2023-10-14T18:57:30.555 INFO:teuthology.orchestra.run.smithi144.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 18:57 /home/ubuntu/cephtest 2023-10-14T18:57:30.556 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T18:57:30.568 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T18:57:30.592 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T18:57:30.619 DEBUG:teuthology.nuke:shortname: smithi079 2023-10-14T18:57:30.620 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:57:30.640 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:26:47.461219', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYk2JnFV1hD/9osJXVTkGSTgA66jIeVDyNBUnusYENk2bNNhg4LLUUYXCAVNS+Lfzt8uNZzM9KaiolF18sa+oo='} 2023-10-14T18:57:30.647 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-14T18:57:30.647 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T18:57:30.669 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-13_20:07:38-fs-quincy-release-distro-default-smithi/7425783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 18:26:47.462745', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrB5DKII1ZhJrgg4sZTw+5WRJyFLlocJrMLwnjOuqNWYLrwG2GQVOyPtDHybcTqAGavr0+uv76+71zljJPXVs8='} 2023-10-14T18:57:30.683 INFO:teuthology.orchestra.console.smithi079:Power off 2023-10-14T18:57:30.684 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T18:57:30.706 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-10-14T18:57:30.706 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:30.721 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-14T18:57:30.722 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T18:57:30.731 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-14T18:57:30.745 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-14T18:57:30.745 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:30.770 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-14T18:57:34.732 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:34.772 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:34.843 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-10-14T18:57:34.884 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-14T18:57:38.846 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:38.886 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:38.957 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-10-14T18:57:38.997 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-14T18:57:39.058 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-10-14T18:57:42.998 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T18:57:43.109 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-14T18:57:43.209 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-14T18:57:43.315 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1385.1687107086182 failure_reason: '"1697309097.1160598 osd.2 (osd.2) 3 : cluster [WRN] OSD bench result of 218088.856815 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.2. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-14T18:57:43.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T18:57:43.399 INFO:teuthology.run:FAIL